{"id":328,"date":"2024-07-20T14:56:56","date_gmt":"2024-07-20T12:56:56","guid":{"rendered":"https:\/\/blogs.phil.hhu.de\/writingacrosslanguages\/?p=328"},"modified":"2024-07-20T14:58:36","modified_gmt":"2024-07-20T12:58:36","slug":"analyzing-multilingual-sentences-with-annis-experience-and-disappointments","status":"publish","type":"post","link":"https:\/\/blogs.phil.hhu.de\/writingacrosslanguages\/2024\/07\/20\/analyzing-multilingual-sentences-with-annis-experience-and-disappointments\/","title":{"rendered":"Analyzing multilingual sentences with ANNIS: Experience and Disappointments"},"content":{"rendered":"\n

Working with ANNIS has been a new experience for me, as I haven\u2019t closely worked with corpus searches before. The interface was a bit overwhelming and confusing at first, but with some visual instructions it was easier to navigate the corpus. <\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

From our previous work on sentence annotation, I was already expecting a high number of Proper Nouns for non-English words, but it was still surprising to see how frequent they were. <\/p>\n\n\n\n

I created a table to show the frequency of the more frequent POS types for non-English words. <\/p>\n\n\n\n

isForeign=“True“<\/strong><\/td>681<\/strong><\/td>100%<\/strong><\/td><\/tr>
PROPN<\/td>420<\/td>61,7%<\/td><\/tr>
NOUN<\/td>168<\/td>24,7%<\/td><\/tr>
ADJ<\/td>26<\/td>3,8%<\/td><\/tr>
VERB<\/td>25<\/td>3,7%<\/td><\/tr>
ADV<\/td>10<\/td>1,5%<\/td><\/tr>
ADP<\/td>10<\/td>1,5%<\/td><\/tr>
INTJ<\/td>6<\/td>0,8%<\/td><\/tr>
other<\/td>16<\/td>2,3%<\/td><\/tr><\/tbody><\/table>
overview for non-English words<\/em><\/figcaption><\/figure>\n\n\n\n

As you can see, PROPN <\/strong>dominate the non-English words with over 60%. The second highest group is NOUN <\/strong>with roughly 25%. However, this doesn\u2019t mean they are correctly tagged, as our previous experience with sentence annotation already taught us. A quick glance at the so-called PROPN is enough to realize that most of theses probably aren\u2019t actual proper nouns. Again, these seem to be arbitrarily assigned. For NOUN, the matches are a mix of correct and incorrect categorizations. Finding a clear pattern is difficult, but often a NOUN is assigned when a DET or ADJ preceded the word. In those cases, the categorization seems mostly correct.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

As a comparison, PROPN for English words are less common with about 4%, while NOUN is the most frequent POS type with 12,9%.<\/p>\n\n\n\n

isForeign=“False“<\/strong><\/td>3405<\/strong><\/td>100%<\/strong><\/td><\/tr>
PROPN<\/td>149<\/td>4,3%<\/td><\/tr>
NOUN<\/td>438<\/td>12,9%<\/td><\/tr><\/tbody><\/table>
PROPN and NOUN for English words<\/em><\/figcaption><\/figure>\n\n\n\n

Actually the dominating POS for non-foreign words is punctuation <\/strong>with 932 matches, but that is because every type of punctuation has been marked as non-foreign.<\/p>\n\n\n\n

That being said, we are working with a small corpus with many different languages, so it would be too early to draw any generalizing conclusions. Perhaps our own selection of sentences is a little biased, as we do have many sentences that feature nouns from food items or culturally specific terms.<\/p>\n","protected":false},"excerpt":{"rendered":"

Working with ANNIS has been a new experience for me, as I haven\u2019t closely worked with corpus searches before. The interface was a bit overwhelming and confusing at first, but with some visual instructions it was easier to navigate the … Weiterlesen →<\/span><\/a><\/p>\n","protected":false},"author":388,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1,2,4,3],"tags":[34,26,5],"class_list":["post-328","post","type-post","status-publish","format-standard","hentry","category-allgemein","category-blog-posts","category-student-entries","category-writing-across-languages","tag-annis","tag-annotation","tag-multilingualism"],"_links":{"self":[{"href":"https:\/\/blogs.phil.hhu.de\/writingacrosslanguages\/wp-json\/wp\/v2\/posts\/328","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.phil.hhu.de\/writingacrosslanguages\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.phil.hhu.de\/writingacrosslanguages\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.phil.hhu.de\/writingacrosslanguages\/wp-json\/wp\/v2\/users\/388"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.phil.hhu.de\/writingacrosslanguages\/wp-json\/wp\/v2\/comments?post=328"}],"version-history":[{"count":2,"href":"https:\/\/blogs.phil.hhu.de\/writingacrosslanguages\/wp-json\/wp\/v2\/posts\/328\/revisions"}],"predecessor-version":[{"id":332,"href":"https:\/\/blogs.phil.hhu.de\/writingacrosslanguages\/wp-json\/wp\/v2\/posts\/328\/revisions\/332"}],"wp:attachment":[{"href":"https:\/\/blogs.phil.hhu.de\/writingacrosslanguages\/wp-json\/wp\/v2\/media?parent=328"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.phil.hhu.de\/writingacrosslanguages\/wp-json\/wp\/v2\/categories?post=328"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.phil.hhu.de\/writingacrosslanguages\/wp-json\/wp\/v2\/tags?post=328"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}