Live Streaming in Android - Devoxx UK

2. Live Streaming in Android
Ahmet Oğuz Mermerkaya
Software Developer
Aselsan
@mekya84
ahmetmermerkaya@gmail.com

3. *
Ahmet Oğuz Mermerkaya
● Writer of an Android Application Programming book,
Merhaba Android, in Turkish
● Member of GDG Ankara
● Software Developer in Aselsan, Defense Industry
Company in Turkiye

4. *
Outline
● How live streaming works
● Building FFmpeg(with x264 and fdk-aac)
● Using Vitamio MediaPlayer
● Implementing a RTSP Server
● Sending Previews and Audio From RTSP Server
● Receiving and Playing Audio On Client

5. *
How live streaming works
● RTSP (Real Time Streaming Protocol)
● RTP (Real Time Protocol)

6. *
How live streaming works
● RTSP (Real Time Streaming Protocol)
● RTP (Real Time Protocol)
This is the
part FFmpeg
takes place

7. *
What is FFmpeg?
● Open-source, cross-platform multimedia framework
● Supports almost all codecs and formats(H264, H263,
AAC, AMR, MP4, MP3, AVI)
● Streams Audio and Video
ffmpeg.org

8. *
Building FFmpeg
● Download
o FFmpeg (http://fmpeg.org)
o fdk_aac for using AAC encoder
(http://sourceforge.net/projects/opencore-amr/files/fdk-aac/)
o libx264 source code for H264 encoder
(http://www.videolan.org/developers/x264.html)
o Android NDK for cross compiling(http://developer.android.com)
● Configure & Make

9. *
Building FFmpeg - Configure & Make
export PATH=ANDROID_NDK/toolchains/arm-linux-androideabi-4.4.3/prebuilt/linux-x86/bin:$PATH
#libx264
./configure --cross-prefix=arm-linux-androideabi- enable-pic --disable-cli -enable-static --disable-shared -
-host=arm-linux --extra-cflags="-march=armv7-a -mfloat-abi=softfp" --sysroot=/path/to/android-
ndk/platforms/android-87arch-arm/
make
#fdk-aac
./configure --host=arm-android-eabi-linux --enable-static --prefix=/path/to/fdk-aac/ --disable-shared
make
#ffmpeg
./configure --disable-everything --enable-gpl --enable-libx264 --enable-libfdk-aac --enable-nonfree --
enable-pthreads --cross-prefix=arm-linux-androideabi- --arch=arm --sysroot=/path/to/android-
ndk/platforms/android-8/arch/arm/ --extra-cflags="-march=armv7-a -mfloat-abi=softfp" --extra-cflags="-
I./x264" --extra-cflags="-I./fdk-aac/include/" --extra-ldflags="-L./x264" --extra-ldflags="-L./fdk-aac/lib"
--datadir="/data/ffmpeg/bin/ffpresets" --enable-version3 --enable-decoder=rawvideo --enable-demuxer=rawvideo
--enable-decoder=aarc --enable-demuxer=aac --enable-muxer=h264 --enable-encoder=pcm_s16le --enable-
protocol=rtp --enable-protocol=udp --enable-muxer?rtp --enable-demuxer=image2pipe --enable-muzer=adts --
enable-muxer=pcm_s16le --enable-demuxer=pcm_s16le --enable-demuxer=h264 --enable-filter=scale --enable-
encoder=libx264 --enable-encoder=libfdk_aac -enable-protocol=pipe --enable-decoder=pcm_s16le --enable-
filter=aresample
make

10. *
Using Vitamio Player
● Get it from vitamio.org and extract
Line 1 VideoView videoView = (VideoView) findViewById(R.id.videoView);
Line 2 videoView.setVideoPath("rtsp://IP_OF_ANDROID_STREAM_SERVER:PORT/live.ts");
● To start vitamio play with partial buffer, follow the instructions on http://vitamio.org/topics/104?locale=en
Then we need a RTSP server

11. *
Implementing a RTSP Server
Client (MediaPlayer - Vitamio) RTSP Server

12. *
Sending Previews From RTSP Server
Line 1 public void startVideo(String address, int port) {
Line 2 String videoCommand = "path/to/ffmpeg -analyzeduration 0 -pix_fmt nv21
Line 3 -s 480x360 -vcodec rawvideo -f image2pipe -i - -s 320x240 -crf
18
Line 4 -preset ultrafast -vcodec libx264 -f rtp
rtp://"+address+":"+port;
Line 5 Process ffmpegVideoProcess = Runtime.getRuntime().exec(videoCommand);
Line 6 OutputStream ostream = ffmpegVideoProcess.getOutputStream();
Line 7
Line 8 getCamera().setPreviewCallback(new PreviewCallback(){
Line 9 public void onPreviewFrame(byte[] buffer, Camera cam) {
Line 10 ostream.write(buffer);
Line 11 ostream.flush();
Line 12 }
Line 13 });
Line 14 }

13. *
Sending Audio From RTSP Server
Line 1 public void startAudio(String address, int port) {
Line 2 String audioCommand = "path/to/ffmpeg -analyzeduration 0 -f s16le -ac
Line 3 44100 -ac 1 -i - -ac 1 -acodec libfdk_aac -f adts -vbr
3
Line 4 udp://"+address+ ":" + port +"/";
Line 5 Process ffmpegAudioProcess = Runtime.getRuntime().exec(audioCommand);
Line 6 OutputStream ostream = ffmpegAudioProcess.getOutputStream();
Line 7 prepareAudioRecord();
Line 8 new Thread(){ public void run(){
Line 9 while(true) {
Line 10 int len = audioRecord.read(audioBuffer, 0,
audioBuffer.length);
Line 11 ostream.write(audioBuffer, 0, len);
Line 12 ostream.flush()
Line 13 }
Line 14 }}.start();

14. *
Receiving Audio On Client
Line 1 public void receiveAudio() {
Line 2 String audioCommand = "path/to/ffmpeg -analyzeduration 0 -f aac -strict -2 -
acodec
Line 3 aac -b:a 120k -ac 1 -i - -ac 1 -acodec pcm_s16le -ar 44100 -f s16le -";
Line 5 Process ffmpegAudioProcess = Runtime.getRuntime().exec(audioCommand);
Line 6 OutputStream ostream = ffmpegAudioProcess.getOutputStream();
Line 7 DatagramSocket udpsocket = new DatagramSocket(PORT);
Line 8 DatagramPacket packet = new DatagramPacket(new byte[2048], 2048);
Line 9 new Thread(){ public void run(){
while(true) {
Line 10 udpsocket.receive(packet);
Line 11 ostream.write(datagramPacket.getData(), 0,
datagram.getLength());
Line 12 ostream.flush();
Line 13 }}}.start();

15. *
Playing Audio On Client
Line 1 public void playAudio(final InputStream istream) {
Line 2 byte[] buffer = new byte[2048];
Line 3 int bufferSize = AudioTrack.getMinBufferSize(44100,...);
Line 5 audioTrack = new AudioTrack(AudioManager.STREAM_MUSIC,44100,
Line 6 AudioFormat.CHANNEL_OUT_MONO,
AudioFormat.ENCODING_PCM_16BIT,
Line 7 bufferSize, AudioTrack.MODE_STREAM);
Line 8 audioTrack.play();
Line 9 while (true) {
Line 10 int len = istream.read(buffer, 0, buffer.length);
Line 11 audioTrack.write(buffer, 0, len);
Line 12 audioTrack.flush()
Line 13 }
Line 14 }

16. Demo

17. *
Android Developer Days
● Expected 1500~ participants
● Partner of Droidcon.com
● 15 co-organizers from 7 countries
● Free of charge
● This year more inspiration, more
networking and more fun
● ADD 2012 web site ->
www.androiddeveloperdays.com/2012
Date: June 14, 15 2013
Venue: METU, Ankara, Turkiye
www.androiddeveloperdays.com

18. Thank you for listening
Live Streaming in Android
Ahmet Oğuz Mermerkaya
@mekya84
ahmetmermerkaya@gmail.com