Finding files in directory...
Files found in directory: 7801
Loading files info...
Files info loaded
Detecting language of files...
ru: 7779 99.718%
en: 3 0.0384566%
total: 7801
Detecting language of files done
Categorizing started...
Categorizing en files
technology: 2 files
./source_dir/20191129/13/1236842001172151769.html
science: 1 files
./source_dir/20191129/13/6357513199471957104.html
Preparing files...
files readed
[technology] words: 141
[technology] words after min filter: 139
[science] words: 45
[science] words after min filter: 43
[technology] pairs built
[technology] grouped
[science] pairs built
[science] grouped
all threads done
[3/3] 100% | 1000 items in 0.193 sec | 0.000579s  ( groups: 0.000562s/97.0639% ) | Total: 0.000579s
done
Categorizing ru files
[5000/7779] 64.2756% | 1000 items in 0.220667 sec | 1.10334s | Total: 1.71657s
sports: 674 files
./source_dir/20191129/14/2653864116578726784.html
society: 3521 files
./source_dir/20191129/12/8486691206976563575.html
economy: 970 files
./source_dir/20191129/13/746723180308346.html
technology: 936 files
./source_dir/20191129/11/5809680071606121450.html
entertainment: 833 files
./source_dir/20191129/11/1283875978375482721.html
science: 614 files
./source_dir/20191129/12/6359253559700101135.html
other: 231 files
./source_dir/20191129/10/5436052480768697165.html
Preparing files...
files readed
[technology] words: 26592
[entertainment] words: 27223
[economy] words: 24038
[science] words: 22104
[other] words: 8909
[other] words after min filter: 8908
[society] words: 51074
[sports] words: 17717
[sports] words after min filter: 7045
[other] pairs built
[economy] words after min filter: 10626
[science] words after min filter: 8198
[entertainment] words after min filter: 10030
[other] grouped
[society] words after min filter: 25592
[technology] words after min filter: 10989
[science] pairs built
[science] grouped
[sports] pairs built
[sports] grouped
[entertainment] pairs built
[entertainment] grouped
[technology] pairs built
[economy] pairs built
[technology] grouped
[economy] grouped
[society] pairs built
[society] grouped
all threads done
6898 ./source_dir/20191129/14/9118270335807840473.html
7057 ./source_dir/20191129/11/4169793924000727947.html
6871 ./source_dir/20191129/13/4773894380745126596.html
7498 ./source_dir/20191129/10/1894541394576180611.html
7406 ./source_dir/20191129/10/2457611932654750539.html

----------------------------------
990 ./source_dir/20191129/12/1839581756179441140.html
1655 ./source_dir/20191129/12/2457611933090753917.html
1487 ./source_dir/20191129/11/6525545600866785320.html

----------------------------------
796 ./source_dir/20191129/11/3824421121550591610.html
852 ./source_dir/20191129/12/2102188705668550280.html
754 ./source_dir/20191129/15/1894541393593328312.html
119 ./source_dir/20191129/11/7974306616018923416.html

----------------------------------
2176 ./source_dir/20191129/12/4324303572708536213.html
2585 ./source_dir/20191129/10/3446964288877553362.html

----------------------------------
1835 ./source_dir/20191129/12/2457611933772145229.html
1903 ./source_dir/20191129/10/4043864882512060551.html
1919 ./source_dir/20191129/14/4764842323790988701.html

----------------------------------
3089 ./source_dir/20191129/12/2576472880002970726.html
5223 ./source_dir/20191129/12/2857286272936250809.html
3636 ./source_dir/20191129/10/3824421120208780270.html
5490 ./source_dir/20191129/12/6639103542879943156.html
4614 ./source_dir/20191129/13/1193690860798148675.html
3913 ./source_dir/20191129/10/1818969637093478908.html
6073 ./source_dir/20191129/12/397742602395717015.html
2743 ./source_dir/20191129/12/8431099001744427971.html
3010 ./source_dir/20191129/14/5817412785343844223.html
4552 ./source_dir/20191129/10/2578300729807794040.html

----------------------------------
6350 ./source_dir/20191129/14/7916917745066805461.html
6417 ./source_dir/20191129/13/1851638046740096221.html
6376 ./source_dir/20191129/14/8639226686797356773.html
6272 ./source_dir/20191129/13/7427872925494140302.html

----------------------------------
[7779/7779] 100% | 1000 items in 0.506261 sec | 3.93821s  ( groups: 3.87249s/98.3313% ) | Total: 3.93821s
done
Categorizing done