Nuno Ricardo Guimarães

Abstract

Abstract

Abstract
The negative impact of false information on social networks is rapidly growing. Current research on the topic focused on the detection of fake news in a particular context or event (such as elections) or using data from a short period of time. Therefore, an evaluation of the current proposals in a long-term scenario where the topics discussed may change is lacking. In this work, we deviate from current approaches to the problem and instead focus on a longitudinal evaluation using social network publications spanning an 18-month period. We evaluate different combinations of features and supervised models in a long-term scenario where the training and testing data are ordered chronologically, and thus the robustness and stability of the models can be evaluated through time. We experimented with 3 different scenarios where the models are trained with 15-, 30-, and 60-day data periods. The results show that detection models trained with word-embedding features are the ones that perform better and are less likely to be affected by the change of topics (for example, the rise of COVID-19 conspiracy theories). Furthermore, the additional days of training data also increase the performance of the best feature/model combinations, although not very significantly (around 2%). The results presented in this paper build the foundations towards a more pragmatic approach to the evaluation of fake news detection models in social networks.

Abstract
IntroductionPeople with schizophrenia experience higher levels of stigma compared with other diseases. The analysis of social media content is a tool of great importance to understand the public opinion toward a particular topic.ObjectivesThe aim of this study is to analyse the content of social media on schizophrenia and the most prevalent sentiments towards this disorder.MethodsTweets were retrieved using Twitter’s Application Programming Interface and the keyword “schizophrenia”. Parameters were set to allow the retrieval of recent and popular tweets on the topic and no restrictions were made in terms of geolocation. Analysis of 8 basic emotions (anger, anticipation, disgust, fear, joy, sadness, surprise, and trust) was conducted automatically using a lexicon-based approach and the NRC Word-Emotion Association Lexicon.ResultsTweets on schizophrenia were heterogeneous. The most prevalent sentiments on the topic were mainly negative, namely anger, fear, sadness and disgust. Qualitative analyses of the most retweeted posts added insight into the nature of the public dialogue on schizophrenia.ConclusionsAnalyses of social media content can add value to the research on stigma toward psychiatric disorders. This tool is of growing importance in many fields and further research in mental health can help the development of public health strategies in order to decrease the stigma towards psychiatric disorders.

Abstract
Social networks have provided the means for constant connectivity and fast information dissemination. In addition, real-time posting allows a new form of citizen journalism, where users can report events from a witness perspective. Therefore, information propagates through the network at a faster pace than traditional media reports it. However, relevant information is a small percentage of all the content shared. Our goal is to develop and evaluate models that can automatically detect journalistic relevance. To do it, we need solid and reliable ground truth data with a significantly large quantity of annotated posts, so that the models can learn to detect relevance over all the spectrum. In this article, we present and confront two different methodologies: an automatic and a human approach. Results on a test data set labelled by experts' show that the models trained with automatic methodology tend to perform better in contrast to the ones trained using human annotated data.