Cross the data desert: Generating textual-visual summary on the evolutionary microblog stream

Xiong, Y, Zhou, X, Zhang, Y, Feng, S and Wang, D 2019, 'Cross the data desert: Generating textual-visual summary on the evolutionary microblog stream', Multimedia Tools and Applications, vol. 78, no. 6, pp. 6409-6440.

Document type: Journal Article
Collection: Journal Articles

Title Cross the data desert: Generating textual-visual summary on the evolutionary microblog stream
Author(s) Xiong, Y
Zhou, X
Zhang, Y
Feng, S
Wang, D
Year 2019
Journal name Multimedia Tools and Applications
Volume number 78
Issue number 6
Start page 6409
End page 6440
Total pages 32
Publisher Springer New York LLC
Abstract Effectively and efficiently summarizing social media is crucial and non-trivial to analyse social media. On social streams, events which are the main concept of semantic similar social messages, often bring us a firsthand story of daily news. However, to identify the valuable news, it is almost impossible to plough through millions of multi-modal messages one by one with traditional methods. Thus, it is urgent to summarize events with a few representative data samples on the streams. In this paper, we provide a vivid textual-visual media summarization approach for microblog streams, which exploits the incremental latent semantic analysis (LSA) of detected events. Firstly, with a novel weighting scheme for keyword relationship, we can detect and track daily sub-events on a keyword relation graph (WordGraph) of microblog streams effectively. Then, to summarize the stream with representative texts and images, we use cross-modal fusion to analyze the semantics of microblog texts and images incrementally and separately, with a novel incremental cross-modal LSA algorithm. The experimental results on a real microblog dataset show that our method is at least 1.31% better and 23.67% faster than existing state-of-the-art methods, and cross-modal fusion can improve the summarization performance by 4.16% on average.
Subject Pattern Recognition and Data Mining
Database Management
Keyword(s) Event detection and tracking
Textual-visual summarization
Incremental latent semantic analysis
Cross-modal data fusion
Social media event
Microblog stream
DOI - identifier 10.1007/s11042-018-6297-6
Copyright notice © Springer Science+Business Media, LLC, part of Springer Nature 2018
ISSN 1573-7721
Version Filter Type
Citation counts: TR Web of Science Citation Count  Cited 0 times in Thomson Reuters Web of Science Article
Scopus Citation Count Cited 0 times in Scopus Article
Altmetric details:
Access Statistics: 31 Abstract Views  -  Detailed Statistics
Created: Thu, 27 Jun 2019, 10:20:00 EST by Catalyst Administrator
© 2014 RMIT Research Repository • Powered by Fez SoftwareContact us