Finding files in directory...
Files found in directory: 4856
Loading files info...
Files info loaded
Detecting language of files...
ru: 0 0%
en: 4855 99.9794%
total: 4856
Detecting language of files done
Categorizing started...
Categorizing ru files
Preparing files...
files readed
all threads done
done
Categorizing en files
society: 1583 files
./source_dir/20191129/14/6679535025979837437.html
science: 231 files
./source_dir/20191129/11/5911730202786756392.html
entertainment: 1146 files
./source_dir/20191129/10/970161747974709517.html
sports: 533 files
./source_dir/20191129/11/9149753394563646777.html
economy: 645 files
./source_dir/20191129/10/7097669637625766311.html
technology: 717 files
./source_dir/20191129/13/1648269241454940884.html
Preparing files...
files readed
[sports] words: 8568
[technology] words: 12674
[technology] words after min filter: 12672
[science] words: 7756
[science] words after min filter: 7754
[entertainment] words: 20060
[economy] words: 11732
[society] words: 20977
[entertainment] words after min filter: 20058
[sports] words after min filter: 4496
[economy] words after min filter: 5835
[society] words after min filter: 11059
[science] pairs built
[science] grouped
[sports] pairs built
[sports] grouped
[economy] pairs built
[economy] grouped
[technology] pairs built
[technology] grouped
[entertainment] pairs built
[entertainment] grouped
[society] pairs built
[society] grouped
all threads done
3823 ./source_dir/20191129/10/505417274853404823.html
4047 ./source_dir/20191129/10/5544636823141365494.html
4061 ./source_dir/20191129/13/5544636823597653348.html
3882 ./source_dir/20191129/15/8119004128901589236.html
4093 ./source_dir/20191129/13/2875825629993867024.html
4026 ./source_dir/20191129/11/7750663362455743897.html
3871 ./source_dir/20191129/13/675785261697652168.html
3963 ./source_dir/20191129/10/2184971257173380312.html
3831 ./source_dir/20191129/11/2090029849519334348.html
3854 ./source_dir/20191129/11/6090563866600349437.html
3841 ./source_dir/20191129/14/5544636823718284808.html
4056 ./source_dir/20191129/11/5544636823595196657.html
4077 ./source_dir/20191129/10/5544636823290793189.html
4059 ./source_dir/20191129/10/675785260752925610.html
3904 ./source_dir/20191129/10/6141642773789943623.html
4018 ./source_dir/20191129/10/4415806918606116602.html
4088 ./source_dir/20191129/10/2875825628421030322.html
3711 ./source_dir/20191129/13/7580308505321506000.html
4024 ./source_dir/20191129/12/2658445900042692448.html
3800 ./source_dir/20191129/14/7580308505051075561.html
3772 ./source_dir/20191129/10/5544636822355567735.html
3648 ./source_dir/20191129/10/2755902707385073327.html
3745 ./source_dir/20191129/10/3082304906493135753.html
3689 ./source_dir/20191129/15/5544636821862878674.html
3719 ./source_dir/20191129/11/3480199993080884156.html
3809 ./source_dir/20191129/10/675785261649217695.html
3885 ./source_dir/20191129/10/7580308505341113528.html
3717 ./source_dir/20191129/10/5456729299319880687.html

----------------------------------
2176 ./source_dir/20191129/14/3480199991341088512.html
2622 ./source_dir/20191129/14/7324224458887266048.html
2557 ./source_dir/20191129/14/6141642773422669568.html
3349 ./source_dir/20191129/14/7686550516348631916.html
3532 ./source_dir/20191129/15/6469275855121159805.html
2150 ./source_dir/20191129/14/6469275855764710093.html
2264 ./source_dir/20191129/14/8288260685604171845.html
2073 ./source_dir/20191129/14/1984146901457362756.html
2296 ./source_dir/20191129/15/675785260676644280.html
2635 ./source_dir/20191129/14/8196011179297144171.html

----------------------------------
4611 ./source_dir/20191129/13/5090408755763030026.html
4753 ./source_dir/20191129/12/8325046882414738589.html
4675 ./source_dir/20191129/14/8325046884203211994.html
4819 ./source_dir/20191129/14/5090408757618781402.html
4333 ./source_dir/20191129/12/5090408755830307997.html
4562 ./source_dir/20191129/13/8325046882347460618.html

----------------------------------
520 ./source_dir/20191129/15/6060062400733889141.html
612 ./source_dir/20191129/15/5090408756965130869.html
244 ./source_dir/20191129/15/5575934301309092469.html

----------------------------------
1943 ./source_dir/20191129/14/355432919664969927.html
1957 ./source_dir/20191129/12/8325046884201461907.html
1920 ./source_dir/20191129/12/5575934301960992915.html
1826 ./source_dir/20191129/12/1276819565249003537.html

----------------------------------
1205 ./source_dir/20191129/13/6141642774076863267.html
1261 ./source_dir/20191129/13/8196011178971856212.html
1568 ./source_dir/20191129/15/7654946769251137125.html
1155 ./source_dir/20191129/13/4415806919299975614.html
962 ./source_dir/20191129/13/3480199991995282211.html
1783 ./source_dir/20191129/10/7362823819520284695.html

----------------------------------
[4855/4855] 100% | 1000 items in 0.28138 sec | 1.3661s  ( groups: 1.35725s/99.3521% ) | Total: 1.3661s
done
Categorizing done