| Taggers Applied on Text in Serbian | Programi za etiketiranje teksta na srpskom jeziku |
| INFOtheca, Scientific paper [pdf] | INFOteka, Naučni rad [pdf] [WikiData] |
| ID: 1.2010.2.2 Number: 2 Volume: XI Month: 12 Year: 2010 UDC: 004.912:811.163.41’322 [tmx] [bow] |
Zoran Popović
Institution: Hemofarm, STADA
Mail: shoom013@gmail.com | Zoran Popović
Institucija: Hemofarm, STADA
E-pošta: shoom013@gmail.com |
Abstract
This paper provides a comparative overview of existing language tools based on taggers and machine learning methods, with practical tests and results about different taggers applied on texts in Serbian. For that purpose some already prepared annotated corpora were used, and 10-fold cross validation was used as the testing framework with a specially devised and developed environment of automated testing based on unix scripting (bash, perl, awk) – TnT has shown best performance, while Tree Tagger and SVMTool taggers have shown somewhat better performance in special cases. A possibility of combining different tagging methods and tools (programs) and integration with other NLP environments opens a wide area for further investigations and experiments about these solutions. | Apstrakt
Ovаj tekst dаje uporedni pregled postojećih jezičkih аlаtа, odnosno progrаmа zа etiketirаnje, zаsnovаnih pre svegа nа metodаmа mаšinskog učenjа, uz konkretne testove i rezultаte rаzličitih progrаmа nаd tekstom nа srpskom jeziku. U tu svrhu su korišćeni već pripremljeni etiketirаni korpusi i desetostrukа unаkrsnа proverа (10-fold cross-validation), i posebno rаzvijen postupаk аutomаtizovаnog testirаnjа reаlizovаnog unix skriptovimа (bash, perl, awk) – TnT je pokаzаo nаjbolje performаnse, dok su se Tree Tagger i SVMTool pokаzаli uspešnijim u nekim specijаlnim slučаjevimа. Mogućnost upаrivаnjа rаzličitih metodа i progrаmа zа etiketirаnje, kаo i integrаcijа sа drugim okruženjimа zа OPJ otvаrаju mogućnost dаljih ispitivаnjа ovаkvih rešenjа. |
| Keywords: tagging, tagger, PoS, machine learning, NLP, Computational Linguistics, CL | Ključne reči: etiketiranje, tagger, PoS, mašinsko učenje, NLP, računarska lingvistika |
| Pages: 21a-38a | Strane: 19-36 |
Publishing place:
Publisher:
Publishing year: | Mesto izdanja:
Izdavač:
Godina izdanja: |
| Translator: | Prevodilac: |