I've been exploring ways of calculating the subject matter discussed by Russian newspapers recently. In the end I settled on using TF-IDF (Term Frequence - Inverse Document Frequency) keywords on a large (read: near exhaustive) database of the Russian press. Taking each keyword as a node, and each keyword pair that occur in a document as an edge (I collected the top ten keywords for each text), quite nice topic maps can be created.
The size of a node is proportional to how often it features. The edges are similarly weighted according to frequency. This is material I'll be using for my thesis, so I'm not keen to spread it all over the internet at this stage, but here is a snippet of Novaia Gazeta's sports pages. (here or click image for hi-res version)
I find it surprising there is no big tennis cluster, and am also quite surprised the NHL features as strongly as it does. Of course the Olympics are very present, closely linked with doping. And Lokomotiv Moscow as the most written about football team, or merely the most unusual word, and consequently captured by the algorithm. There are some obvious mistakes (e.g. голый), but on the whole it looks pretty convincing. I put this down Mikhail Korobov's brilliant Pymorphy2 morphological analyzer. No more word-stemmers for me, so it's farewell Snowball!
KARNA RASA HATI YANG GEMBIRA BERKAT BANTUAN AKI SOLEH
ReplyDeleteMAKANYA SENGAJA NAMA BELIAU SAYA CANTUNKAN DI INTERNET !!!
assalamualaikum wr, wb, saya IBU PUSPITA WATI saya Mengucapkan banyak2
Terima kasih kepada: AKI SOLEH
atas nomor togelnya yang kemarin AKI berikan "4D"
alhamdulillah ternyata itu benar2 tembus AKI
dan berkat bantuan AKI SOLEH saya bisa melunasi semua hutan2…
orang tua saya yang ada di BANK BRI dan bukan hanya itu AKI alhamdulillah,
sekarang saya sudah bisa bermodal sedikit untuk mencukupi kebutuhan keluarga saya sehari2.
Itu semua berkat bantuan AKI SOLEH sekali lagi makasih banyak ya, AKI
yang ingin merubah nasib
seperti saya...?
SILAHKAN GABUNG SAMA AKI SOLEH No; { 082-313-336-747 }
Sebelum Gabung Sama AKI Baca Duluh Kata2 Yang Dibawah Ini
Apakah anda termasuk dalam kategori di bawah ini...!!
1: Di kejar2 tagihan hutang..
2: Selaluh kalah dalam bermain togel
3: Barang berharga sudah
terjual buat judi togel..
4: Sudah kemana2 tapi tidak
menghasilkan, solusi yang tepat..!
5: Sudah banyak dukun ditempati minta angka ritual blom dapat juga,
satu jalan menyelesaikan masalah anda..
Dijamin anda akan berhasil
silahkan buktikan sendiri
Atau Chat/Tlpn di WhatsApp (WA)
No WA Aki : 082313336747
TERIMA KASIH YANG PUNYA
ROOM ATAS TUMPANGANYA SALAM KOMPAK SELALU
"KLIK DISINI BOCORAN TOGEL SGP HK SDY DAN DLL"
Jammy Star Casino Resort in Phoenix, Arizona
ReplyDelete› › Phoenix 파주 출장샵 › › Phoenix 성남 출장샵 Jan 2, 2021 — Jan 2, 2021 Jammy 포천 출장샵 Star 남양주 출장안마 Casino Resort and Casino in Phoenix, Arizona has teamed up with JTG Gaming to bring your fun gaming experience 천안 출장샵 to the Arizona gaming