Embed2Detect: temporally clustered embedded words for event detection in social media

Hettiarachchi, Hansi and Adedoyin-Olowe, Mariam and Bhogal, Jagdev and Gaber, Mohamed Medhat (2021) Embed2Detect: temporally clustered embedded words for event detection in social media. Machine Learning. ISSN 0885-6125

Hettiarachchi2021_Article_Embed2DetectTemporallyClustere.pdf - Published Version
Available under License Creative Commons Attribution.

Download (2MB)


Social media is becoming a primary medium to discuss what is happening around the world. Therefore, the data generated by social media platforms contain rich information which describes the ongoing events. Further, the timeliness associated with these data is capable of facilitating immediate insights. However, considering the dynamic nature and high volume of data production in social media data streams, it is impractical to filter the events manually and therefore, automated event detection mechanisms are invaluable to the community. Apart from a few notable exceptions, most previous research on automated event detection have focused only on statistical and syntactical features in data and lacked the involvement of underlying semantics which are important for effective information retrieval from text since they represent the connections between words and their meanings. In this paper, we propose a novel method termed Embed2Detect for event detection in social media by combining the characteristics in word embeddings and hierarchical agglomerative clustering. The adoption of word embeddings gives Embed2Detect the capability to incorporate powerful semantical features into event detection and overcome a major limitation inherent in previous approaches. We experimented our method on two recent real social media data sets which represent the sports and political domain and also compared the results to several state-of-the-art methods. The obtained results show that Embed2Detect is capable of effective and efficient event detection and it outperforms the recent event detection methods. For the sports data set, Embed2Detect achieved 27% higher F-measure than the best-performed baseline and for the political data set, it was an increase of 29%.

Item Type: Article
Identification Number: https://doi.org/10.1007/s10994-021-05988-7
24 April 2021Accepted
24 May 2021Published Online
Uncontrolled Keywords: word embedding, hierarchical clustering, dendrogram, vocabulary, social media
Subjects: CAH11 - computing > CAH11-01 - computing > CAH11-01-01 - computer science
Divisions: Faculty of Computing, Engineering and the Built Environment > School of Computing and Digital Technology
Depositing User: Mohamed Gaber
Date Deposited: 22 Jul 2021 13:52
Last Modified: 12 Jan 2022 12:52
URI: https://www.open-access.bcu.ac.uk/id/eprint/11982

Actions (login required)

View Item View Item


In this section...