Finding files in directory...
Files found in directory: 7548
Loading files info...
Files info loaded
Detecting language of files...
ru: 0 0%
en: 7547 99.9868%
total: 7548
Detecting language of files done
Categorizing started...
Categorizing ru files
Preparing files...
files readed
all threads done
done
Categorizing en files
[5000/7547] 66.2515% | 1000 items in 0.37696 sec | 1.8848s | Total: 2.84491s
economy: 1099 files
./source_dir/20200214/14/5891794162284782304.html
technology: 843 files
./source_dir/20200214/15/8633418615059456960.html
entertainment: 2008 files
./source_dir/20200214/13/552235480746925926.html
other: 1 files
./source_dir/20200214/14/2038030839586800585.html
science: 600 files
./source_dir/20200214/08/7849457199500755508.html
sports: 537 files
./source_dir/20200214/10/8169236756675787573.html
society: 2459 files
./source_dir/20200214/15/3524240994047147078.html
Preparing files...
files readed
[technology] words: 14382
[sports] words: 10109
[sports] words after min filter: 10108
[science] words: 12874
[science] words after min filter: 12872
[society] words: 26635
[entertainment] words: 27338
[entertainment] words after min filter: 27336
[other] words: 76
[other] words after min filter: 74
[economy] words: 15188
[other] pairs built
[other] grouped
[technology] words after min filter: 7110
[economy] words after min filter: 7788
[society] words after min filter: 14328
[sports] pairs built
[science] pairs built
[sports] grouped
[science] grouped
[technology] pairs built
[technology] grouped
[economy] pairs built
[economy] grouped
[entertainment] pairs built
[entertainment] grouped
[society] pairs built
[society] grouped
all threads done
6919 ./source_dir/20200214/15/5211060990169314644.html
7426 ./source_dir/20200214/15/1887544296114590567.html
7014 ./source_dir/20200214/16/3833521688224543407.html

----------------------------------
1216 ./source_dir/20200214/14/2577526045278736331.html
2336 ./source_dir/20200214/15/9149753394866933640.html
2614 ./source_dir/20200214/16/6010161593515891408.html
1599 ./source_dir/20200214/08/3677959678662454896.html
1970 ./source_dir/20200214/10/5545714967622531908.html
2885 ./source_dir/20200214/13/8538862518344553595.html
1155 ./source_dir/20200214/15/3721530542010760902.html

----------------------------------
240 ./source_dir/20200214/14/1145527432214343782.html
938 ./source_dir/20200214/12/7653256038501752631.html
462 ./source_dir/20200214/14/4286117812700972090.html
289 ./source_dir/20200214/12/1502508924618220345.html
208 ./source_dir/20200214/12/2885715105698722852.html
795 ./source_dir/20200214/12/5283600189925859.html
928 ./source_dir/20200214/09/7653256036998966742.html
1041 ./source_dir/20200214/09/1502508925237233264.html
831 ./source_dir/20200214/09/1502508924940815175.html
417 ./source_dir/20200214/12/7403450741567228062.html
122 ./source_dir/20200214/13/1502508926146835378.html
291 ./source_dir/20200214/16/6679535025247123865.html
209 ./source_dir/20200214/17/2023829371616727878.html
616 ./source_dir/20200214/14/1145527430696587462.html
757 ./source_dir/20200214/15/8669301692351616912.html
1017 ./source_dir/20200214/09/8669301693079347090.html

----------------------------------
3275 ./source_dir/20200214/15/7750663361813623280.html
3576 ./source_dir/20200214/17/675785261810318522.html
3552 ./source_dir/20200214/17/7729859609487499654.html
3350 ./source_dir/20200214/17/2875825628928706844.html
3196 ./source_dir/20200214/14/1491978796192948083.html
3231 ./source_dir/20200214/14/6694993429410848924.html

----------------------------------
6054 ./source_dir/20200214/16/8383944809515793884.html
6128 ./source_dir/20200214/17/8640648837714870771.html
5939 ./source_dir/20200214/16/8300010440626076088.html
5619 ./source_dir/20200214/17/2422791597194546404.html
5717 ./source_dir/20200214/17/7362823821242742841.html
4733 ./source_dir/20200214/16/7327811148266142136.html
4882 ./source_dir/20200214/16/3480199992695979589.html
4379 ./source_dir/20200214/17/7318238120801263225.html
4634 ./source_dir/20200214/16/7324224460242157125.html
4993 ./source_dir/20200214/16/6141642774777560645.html
4642 ./source_dir/20200214/15/3439335389026242448.html
5780 ./source_dir/20200214/12/68426411105479565.html

----------------------------------
6528 ./source_dir/20200214/13/6913978435484218086.html
6622 ./source_dir/20200214/13/682566034656136568.html
6691 ./source_dir/20200214/15/9103146372146106930.html
6299 ./source_dir/20200214/11/4125100339948243144.html
6409 ./source_dir/20200214/11/7605153804530311780.html
6469 ./source_dir/20200214/10/6060938664478274437.html
6514 ./source_dir/20200214/12/8669301694141067107.html

----------------------------------
[7547/7547] 100% | 1000 items in 0.46841 sec | 3.53509s  ( groups: 3.52416s/99.6908% ) | Total: 3.53509s
done
Categorizing done