Multimedia databases store various media types like text, images, audio and video. They allow querying and retrieval of data based on content. Relational databases store multimedia as BLOBs while object-oriented databases represent multimedia as classes and objects. Challenges include large data size, different formats, and complex queries required for content-based retrieval from multimedia data. Applications include digital libraries, education, entertainment and geographic information systems.
2. Multimedia Database(MMDB)?
• Multimedia database is a collection of related multimedia
data.
• MMDB stores data in the form of, text, images, graphic,
animation, audio and video.
• A multimedia database is a database that include one or
more primary media file types such as .txt (documents),
.jpg (images), .swf (videos), .mp3 (audio), etc.
TEXT
AUDIO
GRAPHIC
VIDEO
ANIMATION
3. EVOLUTION OF MMDB
Since existing relational and OO databases comprise the
basic requirements of any database, but to store multimedia
data -MMDB’s were evolved, that includes:
• long bit and byte strings
• BLOBS
• paths or references of images where the actual image
stored elsewhere, such as on an optical storage
subsystem.
• Content retrieval capabilities.
4. MultimediaDatabaseManagementSystem
(MMDBMS) ?
• It is a framework that manages different types of data
potentially represented in a wide diversity of format on a
wide array of media sources. It provides support for
multimedia data types
• Provide facilitate for
• Creation,
• Storage,
• Access,
• Query
• Control of a multimedia database.
5. Contents of MMDBA
• Media data - actual data representing images, audio, video that
are captured, digitized, processes, compressed and stored.
• Media format data - contains format information of the
media data after it goes through the acquisition, processing, and
encoding phases.
• For instance, this consists of information such as the sampling rate,
resolution, frame rate, encoding scheme etc.
• Media keyword data - contains the keyword descriptions,
• For example, for a video, this might include the date, time, and place
of recording , the person who recorded, the scene that is recorded,
etc .This is also called as content descriptive data.
• Media feature data - contains the features derived from the
media data. For example, contain information about the distribution
of colors, the kinds of textures and the different shapes present in
an image. This is also referred to as content dependent data.
6. Continue…
• The last three types are called meta data as they describe
several different aspects of the media data.
• The media keyword data and media feature data are used as
indices for searching purpose.
• The media format data is used to present the retrieved
information.
7. Types of multimedia data
• Text: using a standard language (HTML)
• Graphics: encoded in CGM, postscript
• Images: bitmap, JPEG, MPEG
• Video: sequenced image data at specified rates
• Audio: aural recordings in a string of bits in digitized
form
8. data types are categorized into 3 classes
• Static media
• time-independent
• image and graphic object
• Dynamic media
• time-dependent
• Audio, video and animation
Dimensional media
• 3D game and Computer Aided Drafting (CAD) programs.
9. Characteristics of MMDM
Corresponding Storage Media
Data must be stored & managed according to their
specific characteristics of the storage media
Descriptive Search Methods
Query must be descriptive & content oriented
View Specific & Simultaneous Data Access
Same data can be accessed through different queries
by different applications
Management of Large Amounts of data
Real time Data Transfer
Data transfer of real time activity gets higher priority
than other database activities
Large Transactions
Large transactions must be done in a reliable fashion,
since it take long time.
10. Requirements of Multimedia databases
• Integration
• Data items do not need to be duplicated for different programs
invocations
• Data independence
• Separate the database and the management from the application
programs
• Concurrency control
• Allows concurrent transactions
• Persistence
• Data objects can be saved and re-used by different transactions
and program invocations
• Privacy
• Access and authorization control
11. Continue…
• Integrity control
• Ensures database consistency between transactions
• Recovery
• Failures of transactions should not affect the persistent data
storage
• Query support
• Allows easy querying of multimedia data
12. Design goal of MMDB
• Manage different types of input, output, and storage devices
• Handle a variety of data compression and storage formats
• Support different computing platforms and operating systems
• Integrate different data model.-(R database , OO database)
• Offer a variety of user-friendly query systems suited to
different kinds of media.
• Handle different kinds of indices
• Provide transparent view of geographically distributed data
• Synchronize different media types while presenting to user
14. Data Structures
1) Raw Data - Uncompressed Image
2) Registering Data - Size & coding details of raw data
3) Descriptive Data - Textual numerical annotations
Media Raw Registering Descriptive
Text Characters Coding scheme (ASCII),
length / end symbol
Key words, information
for structuring
Images Pixels Height/ Width of picture,
Mode of Compression, if
JPEG, tables for
quantization purpose
Pic.Date = 21/04/07
Pic.Reason = Birthday
Etc
Video Pixels Frames/second, coding
details, frame types…
Scene description
Audio Sample
sequence
Audio coding (PCM,…) ,
resolution of samples
Content of audio
passages in short form
16. Querying MM data
A DBMS permits a user to search the database by
content e.g. give the name of the student with roll
number 123456 We would like to do the same with
multimedia data
e.g. Consider a police investigation of a murder
case. give the picture of a this person or audio files
to multimedia data library( contain CCTV footage,
authorized telephone wiretaps, document data ,bank
transition.)
With standard data this is easy – numeric and string
operators are well understood With multimedia data
this is more difficult and requires some method of
identifying contents of which there are two kinds:
17. Cont …
automatic identification
an algorithm takes the data and returns a
measure which can be compared – e.g. of
blackness
manual identification
a person examines the data and catalogues it
– e.g. in a table of pictures, there is a column
for the picture and another for the painter
18. Housing Multimedia Data
There are three kinds of DBMS that might
be used for housing multimedia data.
Relational DBMS store everything as First
Normal Form tables
Object-oriented DBMS store everything as
classes of objects
Object-relational DBMS are fundamentally
relations but are not First Normal Form
19. Relational DBMS
• Oracle support three large object types:
• BLOB(Binary Large Objects – BLOB) –
• The BLOB domain type stores unstructured binary data
in the database. BLOBs can store up to four gigabytes of
binary data.
• CLOB – The CLOB domain type stores up to four
gigabytes of single-byte character set data
• NCLOB - The NCLOB domain type stores up to four
gigabytes of fixed-width and varying width multi-byte
national character set data
• relational databases efficient for numeric and textual
data store, but do not conveniently support content-
based searches for multimedia content.
20. Storing in Database
• Oracle InterMedia
• Example:
create table image_blob_table (
id number primary key,
image_blob BLOB);
insert into image_blob_table (id, image_blob)
values (1, “Path of image”) ;
21. Object-oriented DBMS
• Jasmine is an Object-Oriented database that
stores the data in form of classes and objects
• It comes with a number of built in classes include
four multimedia classes:
• Picture -
• Image –
• Video –
• Audio -
• These come with manipulation and compression
facilities.
• They also have been made to fit well with Java
Media Framework
22. Object-relational DBMS
• The BFILE data type in Oracle provides access to BLOB
files of up to 4 gigabytes that are stored in file systems
outside an Oracle database.
• The BFILE data type allows read-only support of large
binary files; you cannot modify a file through Oracle.
Oracle provides APIs to access file data.
23. Example:
• CREATE OR REPLACE PROCEDURE insert_image_file (p_id
NUMBER, p_image_name IN VARCHAR2) IS
src_file BFILE;
dst_file BLOB;
BEGIN src_file := BFILENAME ('image_DIR', p_image_name);
INSERT INTO temp_image (ID, image_name, image )
VALUES (p_id, p_image_name, EMPTY_BLOB () )
RETURNING image INTO dst_file;
END insert_image_file;
• Execute:
EXECUTE insert_image_file(1,'test_image.jpg');
24. Performance Issues
MMDBMSs provides good performance for real-time
querying and updating. Some of the features that
influence this are:
• indexing - most DBs use single key access (B-trees)
whereas, MM have multidimensional indexes with two
dimensional objects have X and Y co-ordinates (R-trees)
• content-retrieval indexing - special indexes are required
for this. For example, the index for a video could contain
the frame number of the start of each clip or scene.
• query optimization - MMDBs are large and manage
many complex object providing query optimization
25. Databases requires
• well structured data organisation
• efficient storage of large amounts of data
• Querying
• Fast retrieval of request
• transactional support for concurrent users
26. Issues and challenges
• Multimedia data consists of a variety of media formats or file
representations including TIFF, BMP, PPT, FPX, MPEG, AVI,
MID, WAV, DOC, GIF,PNG,TEC
• Because of restrictions on the conversion from one format to
the other, the use of the data in a specific format has been
limited as well.
• Usually, the data size of multimedia is large such as video;
therefore, multimedia data often require a large storage.
• Multimedia database consume a lot of processing time, as
well as bandwidth.
27. • multimedia data structures takes much time in retrieval than
standard database structures
• multimedia data structures do not easily lend themselves to
content-based searching
28. APPLICATIONS
• Digital Libraries
• Documentation and keeping Records
• Knowledge distribution
• Education and Training
• News-on-Demand
• Advertisement
• Video-on-Demand
• Entertainment
• Music database
• Geographic Information System
• Marketing