Shi-Yong Neo
ABSTRACT
Earlier research in news video has been focusing mainly on improving retrieval accuracies given the limited amount of extractable video semantics. In this paper, we propose an enhancement to news video searching by leveraging extractable video semantics coupled with relevant external information resources to support event-based analysis; leading to discovery of topic hierarchy for browsing key events and supporting question answering (QA). We introduce topic browsing based on news structures obtained through hierarchical clustering and threading, with emphasis on interesting events determined by measuring the amount of "web activities" on these events on Blog sites. For QA, we employ extensive query analysis to obtain various query features in addition to the topic hierarchical structures to answer both context-oriented and visual-oriented questions. Our main contributions includes: (a) combining multimodal event information extracted from news video, web news articles and news blogs to support event analysis, (b) introducing topic evolution browsing based on users' interest and (c) extending QA on top of topic hierarchy to handle various types of specialized video queries. Experiments performed on 70 hours of multilingual news from TRECVID 2005 dataset shows that the proposed approach is effective and appealing to users.
- J. Adcock, M. Cooper, A. Girgensohn, and L. Wilox. "Interactive Video Search Using Multilevel Indexing" CIVR 2005, Singapore, 205--214, July 2005.Google Scholar
- J. Allan, R. Papka and V. Lavrenko, "On-Line New Event Detection and Tracking" SIGIR 1998, Melbourne, Australia, 37--45, 1998. Google ScholarDigital Library
- A. Amir, G. Iyengar, J. Argillander, M. Campbell, A. Haubold, S. Ebadollahi, F. Kang, M. R. Naphade, A. P. Natsev, J. R Smith, J. Tesic, T. Volkmer, "IBM research TRECVID - 2005 video retrieval system" TRECVID 2005 Workshop, NIST, USA Nov 2005.Google Scholar
- AQUAINT, http://www.ldc.upenn.edu/Catalog/docs/Google Scholar
- A. Bocker, S. Derksen, E. Schmidt, A. Teckentrup, G. Schneider, "A Hierarchical clustering Approach for Large Compound Libraries," Journal of CIM, 807--815, 2005.Google Scholar
- H. Bruce, "Perceptions of the Internet: What People Think When They Search the Internet for Information" Internet Research: Electronic Networking Applications & Policy, Vol 9, 187--199. 1999.Google ScholarCross Ref
- L. Chaisorn, T. S. Chua and C. H. Lee, "The segmentation of news video into story units" ICME 2002, Ischia, Italy, Jul 2002.Google Scholar
- M. G. Christel, A. G. Hauptmann, H. D. Wactlar and T. D. Ng, "Collages as Dynamic Summaries for News Video" ACM Multimedia 2002, 561--569, Juan-les-Pins, France, Dec 2002. Google ScholarDigital Library
- T. S. Chua, S. Y. Neo, H. K. Goh, M. Zhao, Y. Xiao, G. Wang, "TRECVID 2005 by NUS PRIS" TRECVID 2005 Workshop, NIST, USA Nov 2005.Google Scholar
- W. B Croft, H. R. Turtle, D. D. Lewis, "The use of phrases and structured queries in information retrieval" ACM SIGIR 1991, Chicago, USA, 32--45, 1991. Google ScholarDigital Library
- A. Davis, P. Pennert, R. Rubinoff, T. Sibley, E. Tzoukemann, "Retrieving what is relevant in audio and video: statistics and linguistics in combination". RIAO'2004.Google Scholar
- C. Fellbaum. WordNet: An Electronic Lexical Database. MIT Press 98.Google Scholar
- Flickr, http://www.flickr.comGoogle Scholar
- S. Har-Peled, B. Sadri, "How Fast Is the k-Means Method?" Algorithmica 41, Vol.3, 185--202, Jan. 2005. Google ScholarDigital Library
- W. H. Hsu, L. Kennedy, S. F. Chang, M. Franz, and J. Smith, "Columbia-IBM News Video Story Segmentation in TRECVID 2004", Columbia ADVENT Technical Report, New York 2005Google Scholar
- C. Kenneth and P. Hanks, "Word Association Norms, Mutual Information, and Lexicography," ACL, 1989Google Scholar
- LSCOM Lexicon http://www.ee.columbia.edu/dvmm/lscomGoogle Scholar
- J. McCarley, M. Franz. "Influence of speech recognition errors on topic detection". SIGIR 2000, 342--344, New York, NY, USA, 2000. Google ScholarDigital Library
- S. Y. Neo, Y. Zheng, T. S. Chua, Q. Tian, "News Video Search with Fuzzy Event Clustering using High-level Features" ACM Multimedia 2006, Santa Barbara, USA, 23--27 Oct 2006. Google ScholarDigital Library
- S. Y. Neo, J. Zhao, M. Y. Kan, T. S. Chua, "Video Retrieval Using High-level features, "Exploiting Query-matching and Confidence-based Weighting", CIVR 2006, Arizona, USA, 143--152, July 2006. Google ScholarDigital Library
- C. Petersohn. "Fraunhofer HHI at TRECVID 2004: Shot Boundary Detection System" TRECVID 2004 Workshop, NIST, US, Nov 2005Google Scholar
- P. Resnik, "Semantic similarity in a taxonomy: An information-based measure and its applications to problems of ambiguity in natural language" Journal of Artificial Intelligence Research, 95--130, Nov 1999.Google ScholarCross Ref
- Technorati, http://www.technorati.comGoogle Scholar
- TREC, Text Retrieval Conference, http://trec.nist.govGoogle Scholar
- TRECVID, TREC Video Retrieval Evaluation, http://www-nlpir.nist.gov/projects/trecvidGoogle Scholar
- Vivisimo, http://www.vivisimo.comGoogle Scholar
- H. D. Wactlar, A. G. Hauptman, M. G. Christel, R. A. Houghton, and A. M. Olligschlaeger, "Complementary video and audio analysis from Broadcast News Archives" Comm. of ACM, Vol 43. No. 2, 42--47, Feb 2000. Google ScholarDigital Library
- Wikipedia News, http://en.wikipedia.org/wiki/Nov_04Google Scholar
- R. Yan, J. Yang, and A. G. Hauptmann, "Learning Query-Class Dependent Weights for Automatic Video Retrieval" ACM Multimedia 2004, New York, Oct 2004. Google ScholarDigital Library
- H. Yang, L.Chaisorn, Y. Zhao, S.-Y. Neo, T. S. Chua, "VideoQA: question answering on news video" ACM Multimedia 2003, Berkeley, USA, 632--641, Nov 2003. Google ScholarDigital Library
- H. Yang, T. Chua, S. Wang and C. Koh. "Structured use of external knowledge for event-based open-domain question-answering" SIGIR 2003, Canada, Jul 2003. Google ScholarDigital Library
- M. Zhao, S. Y. Neo, H. K. Goh, T. S. Chua, "Multi-Faceted Contextual Model for Person Identification in News Video" MMM 2006, Beijing, China, 2006.Google Scholar
Index Terms
- The use of topic evolution to help users browse and find answers in news video corpus
Recommendations
Discovering Event Evolution Graphs Based on News Articles Relationships
ICEBE '14: Proceedings of the 2014 IEEE 11th International Conference on e-Business EngineeringThere are many news articles reported online everyday. Within an ongoing topic, people can find a huge amount of news articles. A topic often consists of several events, and people are interested in the whole evolution of a topic along a timeline. This ...
Discovering event evolution graphs from news corpora
Given the advance of Internet technologies, we can now easily extract hundreds or thousands of news stories of any ongoing incidents from newswires such as CNN.com, but the volume of information is too large for us to capture the blueprint. Information ...
Topic chains for understanding a news corpus
CICLing'11: Proceedings of the 12th international conference on Computational linguistics and intelligent text processing - Volume Part IIThe Web is a great resource and archive of news articles for the world. We present a framework, based on probabilistic topic modeling, for uncovering the meaningful structure and trends of important topics and issues hidden within the news archives on ...
Comments