Embedded Streaming Media with GStreamer and BeagleBoard

Embedded Streaming Media with GStreamer and BeagleBoard Outline

Embedded Streaming Media with GStreamerand BeagleBoard ESC-228 Presented by Santiago Nunez santiago.nunez (at) ridgerun.com

Agenda  Introduction to BeagleBoard multimedia architecture features.  GStreamer concepts  OMAP GStreamer hands on exercises  DMAI and GStreamer  Questions

Introduction  Primary objective for this class is to introduce audience to GStreamer on OMAP3 with hands on exercises  This doesn’t class won’t cover extensively the APIs available and assumes basic knowledge on C programming, Linux and computer graphics.

BeagleBoard and OMAP3architecture  Provides architecture with several multimedia features:  Cortex A8 with Neon C64x DSP Video accelerators  How to utilize the hardware features with the software stack?

GStreamer  Streaming media framework – audio and video  Close to 200 plug-ins available  Higher level than just input / filters / output  Networking, audio/video mixed streams, auto data handling  Various options utilizing hardware accelerators

GStreamer Overview  Elements  Sources, filters, sinks  Bins and Pipelines  Containers, pipeline is the overal bin  Pads  Element source / sink connection points  Caps  Capabilities organized by stream type with a set of properties

GStreamer Overview  Elements  Plugin  Sources, filters, sinks  Col ection of  Bins and Pipelines elements  Containers, pipeline is the overal bin  Pads  Element source / sink connection points  Caps  Capabilities organized by stream type with a set of properties

Simple MP3 Player pipeline filesrc mad alsasink src sink src sink location=music.mp3  Create dynamical y using gstlaunch Source element reads from a file  Filter element converts MP3 to PWM  Sink element passes to ALSA output gst-launch filesrc location=a.mp3 ! mad ! alsasink

Hands On Exercise 0  Start up Windowing environment with two terminals  cd gst . s Period character to source the file named ‘s’

Hands On Exercise 0  Play audio file  a2 Actual command gstlaunch filesrc location=bbb.flac ! flacdec !alsasink  You can see the contents of the script cat a2  There are lots of audio scripts to try  a1, a2, a3

Simple Audio PlayerSource Code  Create pipeline, source, filter, sink  Set element properties  Build into pipeline  Connect src and sink pads  Setup pipeline event handler  End of stream  Set pipeline state to play  Run

Simple PA System  Create dynamical y using gstlaunch Source element ALSA audio in  Try it:  No filters r  Sink element passes to ALSA output pipeline alsasrc alsasink src sink gstlaunch alsasrc numbuffers=100 ! alsasink

Keeping Plug-ins Organized  Each known plug-in is added to registry  Most aspects of plug-in are tracked in the registry  Registry support run-in pipeline creation and dynamic filter selection  Use gstinspect to list plug-ins gstinspect | lessgstinspect filesrc

Hands On Exercise 1  Using gstinspect, list  Al plug-ins Al video plug-ins Element properties for filesrc plug-in

Hands On Exercise 2  GStreamer video pipelines  v1 – script shown below gstlaunch videotestsrc ! ffmpegcolorspace ! fbdevsink  Other video scripts  v1, v2, v3, v4  Idea is the same  source data, filter data, send data to sink

PerformanceData Passing  Stream held in buffers with data, timestamp, other info  When possible, buffer memory allocated by sink pad  Use hardware when data copy is necessary

PerformanceData Transformation  Cortex A8 compiler optimization  NEON  Single Instruction Multiple Data  C64  Video accelerator  DMA and other data movers

Davinci Multimedia Application Interface Cortex Linux Application GStreamer Libraries gst DMAI gst N DSP Link plugin plugin plugin DSP BIOS Davinci Multimedia Application Interface Framework Components audio video display frame copy Cortex with NEO codec video codec codec ARM IVA2 with C64 DSP Codec Engine video hardware accelerator VISA OSAL CMEM DSP Link

DMAI and GStreamer  Davinci Multimedia Application Interface  Exposes OMAP/Davinci hardware using high level of abstraction  Stream audio / video Graphics display Hardware optimized frame/data copy

OMAP3 Codec Engine  Isolates users for audio/video codecs from those implementing the codecs  Codec can run in several places without the cal ing application being aware  Cortex A8, NEON, C64, hardware accelerator Uses DSPLink and DSPBios conventions to support DSP based algorithms dynamical y

Video Phone  Vision – video phone application can create audio and video GStreamer pipelines for capture / rendering  DMAI, Codec engine, DSPLink, C64 algorithms perform heavy lifting  OMAP3 hardware capabilities utilized  Video phone application focused on call management, not streaming data manipulation

GStreamer in3 Layers Your Way Cool Application GStreamer Media Handling API for Super Fast Hardware

Download Embedded Streaming Media with GStreamer and BeagleBoard Powerpoint Presentation

By downloading this powerpoint presentation file, you agree to our terms of use. If you interesting in "Embedded Streaming Media with GStreamer and BeagleBoard" powerpoint themes, you can download to use this powerpoint template for your own presentation template. For viewing only, you can play with our flash based presentation viewer instead of downloading the ppt file.