I made this presentation in order to convince Web3D and Khronos folks that community and industry need one single standard for 3D graphics compression. It contains a list of MPEG-4 tools for graphics compression that are royalty free and for which open source software implementation exist. A JavaScript implementation of decoder and WebGL complaient MPEG-4 player is also introduced.
Portal Kombat : extension du réseau de propagande russe
MPEG 3D graphics compression offer
1. MPEG offer for 3D Graphics
Compression
Web3D Conference, June 2013@San Sebastien
Marius PREDA
Institut MINES Telecom, France
MPEG 3DG Chairman
2. Hard problem
Data heterogeneity
Scene
Geometry
Attributes
Animation
Different Representation Methods
Different Application Requirements
3D Graphics Compression
A good compression method is agnostic to the signal but
exploits the signal nature
3DG Comp: N dimensional problem
Image and Video is easy, only color
3. MPEG 3DG Technologies
MPEG-1/2
(AV content)
1992/4
VRML
1997
• Part 11 - BIFS:
-Binarisation of VRML
-Extensions for streaming
-Extensions for server command
-Extensions for 2D graphics
- Real time augmentation with
audio & video
• Part 2 - Visual:
- 3D Mesh compression
- Face animation
1998
• Part 2 – Visual
- Body animation
1999
MPEG-4 v.1
MPEG-4 v.2
First form of broadcast signal augmentation
4. MPEG 3DG Technologies
MPEG-4
2003
•AFX 2nd Edition:
- Animation by
morphing
- Multi-texturing
2005
• AFX 3rd Edition
- WSS for terrain
and cities
- Frame based
animation
2007
MPEG-4
MPEG-4
• Part 16 - AFX:
- A rich set of 3D
graphics tools
- Compression of
geometry,
appearance,
animation
• AFX 4th Edition
- Scalable complexity
mesh coding
2011
MPEG-4A rich set of 3D Graphics
representation and
compression tools
5. MPEG 3DG Technologies
MPEG-4
2003
•AFX 2nd Edition:
- Animation by
morphing
- Multi-texturing
2005
• AFX 3rd Edition
- WSS for terrain
and cities
- Frame based
animation
2007
MPEG-4
MPEG-4
• Part 16 - AFX:
- A rich set of 3D
graphics tools
- Compression of
geometry,
appearance,
animation
• AFX 4th Edition
- Scalable complexity
mesh coding
2011
MPEG-4
2009
• Part 25
- Compression of
third-party XML
(X3D, COLLADA)
MPEG-4
2004
• Part 16
- X3D
Interactive
Profile
MPEG-4
6. Today’s Topic : Royalty Free
Static Geometry Compression: TFAN
Animation and Animated Geometry Compression: BBA and FAMC
Web 3D Graphics Coding
Compression Benchmark Platform
Focus on 3D Object Compression
7. Decompose a triangle mesh into a set of
triangle fans
Encoder each triangle fan with a special code
depending on the configuration of its
neighborhood
Arithmetically encode the TFAN codes
TFans:
1675,
62937,
2984
Low complexity: linear encoding/decoding complexity
Handles directly (without stitching) arbitrary connectivity
(manifold or not, oriented or not, with or without holes, any genus)
Offers the possibility to preserve the Vertices Order
(VO) and Triangles Order (TO)
Principle
Advantages
Triangle FAN
Connectivity encoding
9. Bone-base Animation - BBA
Geometry
Seamless mesh: shapes sharing
the same vertices list
Texture
Image Mapping on vertices
sub-set
Hierarchy
Skeleton layer
Muscle layer
Animation Parameters
1D controllers: bones and muscles
Courtesy of VRLab, EPFL
Courtesy of IMT
10. Widely supported by ATs
Able to build and animate any
kind of skeleton
Courtesy of Televirtual
Realistic and high quality
animation
Bone-base Animation - BBA
11. Frame #n
Uncompressed
BBA
Binary file
Frame P
Prediction
Arithmetic
coding
Quantization
Frame I
Arithmetic
coding
Quantization
Segment #nUncompressed
BBA
DCT
Binary file
Segment P
Prediction
DC Q
Segment I
Huffman coding
DC Q
DC Coeff. AC Coeff.
Huffman coding
AC Q
Bone-base Animation - BBA
Two compression methods: frame-based and DCT-based
5-30 kbps
12. Frame-based Mesh Compression -
FAMC
What if no skeleton is defined, only animated meshes?
FAMC: cluster the vertices
and encode cluster animation
parameters plus corrections
14. Compression benchmarking
more than 10 000 objects of
various kinds
distortion vs bitrate
encoding and decoding time
per object and global statistics
18. TFAN and BBA open source implementation
3DSMax to MPEG-4 (TFAN and BBA) open source exporter
JS Implementation of TFAN and BBA decoders
WebGL Implementation
Open Resources
www.MyMultimediaWorld.com : Software/OpenSource Tab
19. The outside world is waiting us with a UNIQUE compression
solution for A 3D Object
Time to set the common base and work TOGETHER for a
common profile
Many technologies are already available, time to do SELECTIONS
Conclusions