Accommodating Hybrid Retrieval in a Comprehensive Video Data

EDICS

*Contact information:

Dr. Qing Li

Department of Computer Science, City University of Hong Kong, Tat Chee Avenue, Kowloon, Hong Kong.Email: Tel: (852) 2788 9695 Fax: (852) 2788 8292

Accommodating Hybrid Retrieval in a Comprehensive Video

Database Management System

Shermann S.M. Chan Qing Li*

Department of Computer Science

City University of Hong Kong, ChinaYi Wu Yueting ZhuangDepartment of Computer ScienceZhejiang University, Hangzhou, China

Abstract

A comprehensive video retrieval system should be able to accommodate and utilize

various (complementary) description data in facilitating effective retrieval. In this

paper, we advocate a hybrid retrieval approach by integrating a query-based

(database) mechanism with content-based retrieval (CBR) functions. We describe

the VideoMAP+ architecture, discuss issues related to developing such a

comprehensive video database management system, and its specific language

mechanism (CAROL/ST with CBR) which provides an improved expressive power

than what pure query-based or CBR methods currently offer. We also describe an

experimental prototype being developed based on a commercial object-oriented

toolkit using VC++ and Java.

1. Introduction

A current important trend in multimedia information management is towards web-based/enabledmultimedia search and management systems. Video is a rich and colorful media widely used in many of ourdaily life applications like education, entertainment, news spreading, etc. Digital videos have diverse sourcesof origin such as cassette recorder, tape recorder, home video camera, VCD and Internet. Expressiveness ofvideo documents decides their dominant position in the next-generation multimedia information systems.Unlike traditional / static types of data, digital video can provide more effective dissemination ofinformation for its rich content. Collectively, a (digital) video can have several information descriptors: (1)metadata - the actual video frame stream, including its encoding scheme and frame rate; (2) media data - theinformation about the characteristic of video content, such as visual feature, scene structure and spatio-temporal feature; (3) semantic data - the text annotation relevant to the content of video, obtaining bymanual or automatic understanding.

Video metadata is created independently from how its contents are described and how its databasestructure is organized later. It is thus natural to define “video” and other meaningful constructs such as“scene”, “frame” as objects corresponding to their respective inherent semantic and visual contents.Meaningful video scenes are identified and associated with their description data incrementally. But the gapEDICS

1

EDICS

between the user realization and video content remains a big problem. Depending on the user’s viewpoint,the same video/scene may be given different descriptions. It is extremely difficult (if not impossible) todescribe the whole contents of a video, especially due to the visual content.

1.1 Background of Research

Over the last couple of years we have been working on developing a generic video management andapplication processing (VideoMAP) framework [CL99a, CL99b, LLS00]. A central component ofVideoMAP is a query-based video retrieval mechanism called CAROL/ST, which supports spatio-temporalqueries [CL99a, CL99b].

While the original CAROL/ST has contributed on working with video semantic data based on anextended object oriented approach, little support has been provided to support video retrieval using visualfeatures. To come up with a more effective video retrieval system, we have been making extensions to theVideoMAP framework, and particularly the CAROL/ST mechanism to furnish a hybrid approach

[CWLZ01]. In this paper we thus present VideoMAP+, a successor of VideoMAP, which has an extendedcapability of supporting the hybrid approach to video retrieval through integrating the query-based (database)approach with the CBR paradigm.

1.2 Paper Contribution and Organization

In order to develop an effective video retrieval system, one should go beyond the traditional query-basedor purely content-based retrieval (CBR) paradigm. Our standpoint is that videos are multi-faceted dataobjects, and an effective retrieval system should be able to accommodate all of the complementaryinformation descriptions for retrieving videos. In this paper, we discuss the main issues involved indeveloping such a comprehensive video database management system supporting hybrid retrieval.

The rest of our paper is organized as follows. In next section we review some related on video processingand database management. Section 3 is devoted to the introduction of the hybrid approach to video retrievalundertaking by VideoMAP+; the CBR and query-based retrieval methods are elaborated and their integrationinto a single language framework is presented. In section 4, we describe an experimental prototype systemwhich we have been building, by highlighting on the main user interface facilities; sample queries are alsogiven to illustrate the expressive power of this mechanism. Finally, we conclude the paper and offer furtherresearch directions in section 5.

2. Related Work

There has been significant interests and considerable amount of research in developing managementsystems for video databases in recent years. Here we review some existing work with an attempt to compareand contrast different approaches of modeling and managing video data. While there have been severalresearch projects on video databases initiated, the following are what we regard as representative ones which

EDICS

support either content-based search or annotation/query-based retrieval techniques in their models andsystems. Besides, some e …… 此处隐藏：7270字，全部文档内容请下载后查看。喜欢就下载吧 ……