maemo.org - Talk - Optimized GStreamer media plugin for OMAP35x

maemo.org - Talk (https://talk.maemo.org/index.php)

- Development (https://talk.maemo.org/forumdisplay.php?f=13)

- - Optimized GStreamer media plugin for OMAP35x (https://talk.maemo.org/showthread.php?t=29072)

Optimized GStreamer media plugin for OMAP35x

"Aiming to improve Linux multimedia development using its processors, Texas Instruments (TI) has released a version of the open source GStreamer media plugin for its OMAP35x and DaVinci system-on-chips (SoCs). The Linux-based GStreamer library supports development of audio and video playback, audio and video synchronization, and recording capabilities, says TI."

Could this give more oxygen to multimedia apps on our tablets?

http://www.linuxdevices.com/news/NS7...36.html?kc=rss

https://gstreamer.ti.com/gf/project/...T+gstreamer-pr

Re: Optimized GStreamer media plugin for OMAP35x

Sadly, that will do nothing for the current-gen tablets. All that stuff is obviously aimed squarely at the next-gen Maemo 5 devices, which use the OMAP3 SoC, rather than the OMAP2 SoC on our beloved tablets.

The good news is that we will probably be able to use GStreamer to do A/V tasks on the new tablets. This means recording audio and video, streaming A/V out to the Net, etc. All with very little programming.

EDIT: With the new devices having a lot of processing muscle, and GStreamer plugins already written for them, there are some very interesting options opening up, such as a mobile media server...

Re: Optimized GStreamer media plugin for OMAP35x

I'm getting more and more excited as I read about this Flumotion server... Looks pretty straightforward to set up a web cam to stream out to the web...

Makes me wonder if this can be done already using the tablet as the "Video Worker" and a desktop computer as the "Manager," "Muxer Worker," and "Streamer Worker". That might take some of the strain off of the poor little tablet.

http://www.flumotion.net/doc/flumoti...th-workers.png

Re: Optimized GStreamer media plugin for OMAP35x

Clearly the next tablet is going to be heavily orientated around its media capabilities. At OSiM last year there was a lot of talk about the camera and what you could do with it, video, photo's e.t.c. I can't see why streaming wouldn't be a big factor too. With the online OVI presence Nokia has, uploading videos and even live streaming would fit in with their slogan "Share photos and videos. Anytime. Anywhere."[1]

[1] http://share.ovi.com/?utm_campaign=O...id=ShareBridge

Re: Optimized GStreamer media plugin for OMAP35x

Quote:

Originally Posted by qole (Post 288720)

I wonder how different the OMAP3 DSP is - maybe some of these codecs could be ported?

gst-ti-plugin-full-0.99.00/ti_build/ticodecplugin/src/gstticodecs_omap3530.c lists the following:

Code:

/* Audio Decoders */

{

    "AAC Audio Decoder",     /* String name of codec used by plugin      */

    "aachedec",              /* String name of codec used by CE          */

    decodeEngine             /* Engine that contains this codec          */

}, {

    "MPEG1L2 Audio Decoder", /* String name of codec used by plugin      */

    "mp3dec",                /* String name of codec used by CE          */

    decodeEngine             /* Engine that contains this codec          */

}, {

    "MPEG1L3 Audio Decoder", /* String name of codec used by plugin      */

    "mp3dec",                /* String name of codec used by CE          */

    decodeEngine             /* Engine that contains this codec          */

}, {

    "WMA Audio Decoder",     /* String name of codec used by plugin      */

    "wmadec",                /* String name of codec used by CE          */

    decodeEngine             /* Engine that contains this codec          */

},



/* Video Decoders */

{

    "H.264 Video Decoder",   /* String name of codec used by plugin      */

    "h264dec",               /* String name of codec used by CE          */

    decodeEngine             /* Engine that contains this codec          */

}, {

    "MPEG4 Video Decoder",   /* String name of codec used by plugin      */

    "mpeg4dec",              /* String name of codec used by CE          */

    decodeEngine             /* Engine that contains this codec          */

}, {

    "MPEG2 Video Decoder",   /* String name of codec used by plugin      */

    "mpeg2dec",              /* String name of codec used by CE          */

    decodeEngine             /* Engine that contains this codec          */

},



/* Image Decoders */

{

    "JPEG Image Decoder",    /* String name of codec used by plugin      */

    "jpegdec",               /* String name of codec used by CE          */

    decodeEngine             /* Engine that contains this codec          */

},



/* Video Encoders */

{

    "H.264 Video Encoder",   /* String name of codec used by plugin      */

    "h264enc",               /* String name of codec used by CE          */

    encodeEngine             /* Engine that contains this codec          */

}, {

    "MPEG4 Video Encoder",   /* String name of codec used by plugin      */

    "mpeg4enc",              /* String name of codec used by CE          */

    encodeEngine             /* Engine that contains this codec          */

},



/* Image Encoders */

{

    "JPEG Image Encoder",    /* String name of codec used by plugin      */

    "jpegenc",               /* String name of codec used by CE          */

    encodeEngine             /* Engine that contains this codec          */

},

No DSP-accelerated Ogg, sadly, but JPEG seems interesting... would it make sense to use it in non-streaming applications (image viewers, web browsers etc)?

Re: Optimized GStreamer media plugin for OMAP35x

It's very different I'm afraid, it supports 8-bit types for example.

Re: Optimized GStreamer media plugin for OMAP35x

We could do JPEG acceleration on the current DSP. I setup a Garage project and started work on this, but other things have got in the way. If anyone's interested then I can have a chat to you about it.

Re: Optimized GStreamer media plugin for OMAP35x

I'd be interested, especially if we could integrate it into pyqtoreader, but my ARM/ASM skills are worse than puny. :(

Re: Optimized GStreamer media plugin for OMAP35x

No need for ASM in the fist instance, the DSP can be programmed in plain C (and use the wrapped macros to access the accelerated functions, etc.). But there are no 8-bit types on the DSP, only a small problem ;)

I was thinking of writing something which has the same sorts of entry points as libjpeg does, so that would certainly be doable.

The only issue is writing the algorithmic stuff to support all the jpeg types, and I've just not had the time to do this. Yet. I'm sure with some support/interest I'll get it sorted.

Re: Optimized GStreamer media plugin for OMAP35x

Quote:

Originally Posted by Baloo (Post 288736)

Clearly the next tablet is going to be heavily orientated around its media capabilities. At OSiM last year there was a lot of talk about the camera and what you could do with it, video, photo's etc. I can't see why streaming wouldn't be a big factor too. With the online OVI presence Nokia has, uploading videos and even live streaming would fit in with their slogan "Share photos and videos. Anytime. Anywhere."

I've been thinking more about this; with fast enough hardware (or good hardware encoding), and a good enough camera, you could easily have high-quality, live-to-broadcast streaming video, like Edison Carter in Max Headroom, except your camera is a tiny handheld device.