For me, working with ANNIS was much more fun than annotating sentences in Google Collab. I liked actually being able to get some quantifications out of the sentences we annotated. Although in the end the corpus we uploaded on ANNIS was not that extensive, it was still very interesting to see the possibilities the program offers. <\/p>\n\n\n\n
During the course of this semester, we already noticed an extremely high error rate in the POS classification and dependency tagging of spaCY. I was interested to see, how high that rate is in numbers, now that we could do analysis of that sort with ANNIS. Because it was the end of the semester and my time and capacities were limited, I limited my research to four POS, which I thought were most interesting. <\/p>\n\n\n\n
With the help of the ANNIS Query Builder I looked for all proper nouns (PROPN), nouns (NOUN), verbs (VERB) and adjectives (ADJ) that were annotated (manually) as foreign. I then checked, how many of the POS tags were actually correct. Because my language skills are limited and it wasn’t always clear what language I was analysing, there were some words (or tokens) I couldn’t identify even through research. These are my findings: <\/p>\n\n\n\n As you can see, the POS tagged the most is the proper noun, which was also our impression in previous sessions. It seems that labelling a token as PROPN is an easy solution for words which can’t be recognised by the machine. It is also the category with the most mistakes. <\/p>\n\n\n\n The POS with the least mistakes is the NOUN. This might be due to the fact that a noun is relatively easy to identify, especially if it is the only foreign word in an English sentence and maybe even accompanied by a determinant. This is probably also the reason, why authors of multilingual literary texts use relatively many foreign nouns: they are easy to discern for English readers. <\/p>\n\n\n\n For ADJ and VERB, the number of findings is relatively low, so I’m not comfortable making any conclusions because of my „findings“. I suspect, that verbs and adjectives are a lot harder to identify than nouns and proper nouns, also because they usually change due to flexion and conjugation (at least in the languages that I know).<\/p>\n\n\n\n I know that our corpus is not yet big enough to come to definitive conclusions. It might also be biased, because we tried choosing a high variety of sentences out of every book. Still, it was quite interesting to see (if only on a small scale) what ANNIS can do. <\/p>\n","protected":false},"excerpt":{"rendered":" For me, working with ANNIS was much more fun than annotating sentences in Google Collab. I liked actually being able to get some quantifications out of the sentences we annotated. Although in the end the corpus we uploaded on ANNIS … Weiterlesen POS<\/td> Foreign words with that tag<\/td> classification considered correct<\/td> unsure about classification<\/td><\/tr> PROPN<\/td> 420<\/td> 55<\/td> –<\/td><\/tr> ADJ<\/td> 26<\/td> 4<\/td> 2<\/td><\/tr> NOUN<\/td> 168<\/td> 93<\/td> 23<\/td><\/tr> VERB<\/td> 25<\/td> 8<\/td> 5<\/td><\/tr><\/tbody><\/table>