You can simply rely on communities for a robust characterization of stances

Abstract

We show that the structure of communities in social me- dia provides robust information for weakly supervised approaches to assign stances to tweets. Using as seed the SemEval 2016 Stance Detection Task annotated data, we retrieved a high number of topically related tweets. We then propagated information from the manually an- notated seed to the retrieved tweets and thus obtained a bigger training corpus. Classifiers trained with this bigger, weakly supervised dataset reach similar or better performance than those trained with the manually annotated seed. In addition, they are more robust with respect to common manual annotator errors or biases and they have arguably more coverage than smaller datasets. Weakly supervised approaches, most notably self- supervision, commonly suffer from error propagation. Interestingly, communities seem to provide a structure that constrains error propagation. In particular, weakly supervised classifiers that incorporate community struc- ture are more robust with respect to class imbalance. Additionally, this is a straightforward, transparent ap- proach, using standard tools and pipelines, cheaper and faster than methods like crowd sourcing for manual an- notations. Thus it facilitates adoption, interpretability and accountability.