The Impact of Mental Fatigue, Task Monotony, and Data Skewness on Data Annotator Performance
Intro There are two topic that people rarely discuss when in comes to data annotation. First, that annotators are not just things that needs to be trained, and whose performance needs to be closely monitored but regular human beings like any one of ourselves as people who can get tried, or distracted. And second, how the data we push through those people influences their annotators’ performance. As I feel compassion, and deep respect for annotators I work with on daily basis I wanted to cover that topic in one of my writing but never had time to do so as well as bandwidth to conduct a proper study. With help from, AI and all researches who has done the ground work, I can at least share a short summary. ...