Notices
Page 1 of 2 1 2
Reply
Thread Tools
colin.stephane is offline colin.stephane
2012-12-06 , 21:44
Posts: 458 | Thanked: 783 times | Joined on Jan 2010 @ France
#1
Hi all,

Here is my first attempt to package the latest version of movgrab :

Edit the 30th April 2013 : Pushed version up to the latest (1.2.1) ...

Changelog :

Version 1.2.1
  • Fixes for many sites.
  • Added 'sshtunnel' proxy type.


movgrab :

movgrab is a downloader for all those pesky sites that insist you use a big fat browser that runs flash in order to see their content. It's a command-line app written in straight C, and so doesn't require you to install perl. Nor ruby. Nor python. Nor guile, scheme, glib, gtk, qt, gnome, kde, X-windows, m4, firefox or windows. No! Not any of that! It *should* compile on all posix unix systems, I think (although I'm a bit worried about the whole little-endian/big-endian thing).

Overview :

Written in straight C.
Command-line application.
No dependancies, everything needed is in the .tar.gz source file.
HTTP Proxy server support.
Write download to std-out to feed into another application: (eg movgrab -f - URL | mplayer -).
Progress display while downloading.
Fork into background with '-b' flag.

Homepage :

https://sites.google.com/site/columscode/home/movgrab

Download packages from extra-devel :

Activate all repositories following this tutorial : Repositories Activation

Then, as usual, as root, install with :

Code:
-bash-2.05b# apt-get install movgrab && movgrab --help
Reading package lists... Done
Building dependency tree       
Reading state information... Done
The following NEW packages will be installed:
  movgrab
0 upgraded, 1 newly installed, 0 to remove and 19 not upgraded.
Need to get 0B/77,5kB of archives.
After this operation, 188kB of additional disk space will be used.
Selecting previously deselected package movgrab.
(Reading database ... 47546 files and directories currently installed.)
Unpacking movgrab (from .../movgrab_1.1.14-1maemo0_armel.deb) ...
Setting up movgrab (1.1.14-1maemo0) ...

Movgrab: version 1.1.14
Author: Colum Paget
Email: colums.projects@gmail.com
Blogs: 
	tech: http://idratherhack.blogspot.com 
	rants: http://thesingularitysucks.blogspot.com 

Usage: movgrab [-t <type>] -a [<username>:<password>] [-p http://username:password@x.x.x.x:80 ] [-r] [-b] [-x] [-q] [-st <stream timeout>] [-f <format list>] [-v] [-P] [-Pp] [-o <output file>] [+o <extra output file>] url
	movgrab -test-sites

'-v'		increases verbosity/debug level
'-v -v'		prints out all webpages encountered
'-v -v -v'	maximum debugging
'-T'		Test mode, don't do final download
'-P <program>'		Player program (e.g. "mplayer")
'-Pp'		Percent download to launch player at (default 25%)
'-a'		Authentication info in Username:Password format.
'-q'		QUIET. No progress/informative output.
'-b'		Background. Fork into background and nohup
'-p'		address of HTTP proxy server in URL format.
'-w'		Wait for addresses to be entered on stdin.
'-st'		Connection inactivity timeout in seconds. Set high for sites that 'throttle'
'-t'		specifies website type.
'-r'		Resume download (only works when writing a single file, not with +o).
'-f'		specifies preferred video/audio formats for sites that offer more than one
			example: flv:640x480,flv,mp4,mp3
			Use -T to get a list of formats the site offers
			Use * to mean 'any format' (the default)
			example: flv:640x480,mp4:640x480,*
'-o'		specifies output file ( '-' for stdout)
'+o'		add an output file to list of output files ( '-' for stdout)
'-x'		try to avoid 'family filter' on some sites
'-n'		For pages with multiple movies (not movie formats, but movies) specifes item selection for download. Argument has the form:
			-n all		Download all
			-n 2		Download 2nd item
			-n 2-5		Download 2nd to 5th item
			-n 2-		Download from 2nd item onwards
			-n -8		Download from 1st to 8th item
-test-sites		Test downloading from each supported website
The '-t' argument is optional, Movgrab will try to guess the download type from the provided url.

The url should be that of the page that the movie would normally appear on. Movgrab examines the page for embed tags and other information that would normally cause the movie to play on that page.

Download types are:
generic              Generic: Search in page for http://*.flv, http://*.mp3, http//*.mp4 etc, etc, etc
youtube              YouTube: http://www.youtube.com
metacafe             Metacafe: http://www.metacafe.com
dailymotion          Daily Motion: http://www.dailymotion.com
break                www.break.com
ehow                 www.ehow.com
vimeo                www.vimeo.com
5min                 www.5min.com
vbox7                www.vbox7.com
blip.tv              www.blip.tv
ted                  www.ted.com
myvideo              www.myvideo.de
clipshack            www.clipshack.com
mytopclip            www.mytopclip.com
redbalcony           www.redbalcony.com
mobango              www.mobango.com
yale                 Yale University: http://oyc.yale.edu
princeton            Princeton University: http://www.princeton.edu/WebMedia/
reuters              Reuters: http://www.reuters.com/
liveleak             Liveleak: http://www.liveleak.com
academicearth        Academic Earth: http://www.academicearth.org
photobucket          Photobucket: http://www.photobucket.com
aljazeera            Aljazeera: english.aljazeera.net
mefeedia             mefeedia.com
iviewtube            iViewTube: www.iviewtube.com
washingtonpost       Washington Post: www.washingtonpost.com
cbsnews              CBS News: www.cbsnews.com
france24             France24: www.france24.com
euronews             Euronews: www.euronews.net
metatube             www.metatube.com
motionfeeds          www.motionfeeds.com
escapist             www.escapistmagazine.com
guardian             www.guardian.co.uk
redorbit             www.redorbit.com
scivee               www.scivee.tv
izlese               www.izlese.org
uctv.tv              University of California Television: http://www.uctv.tv/
royalsociety.tv      http://royalsociety.org/
britishacademy       http://britac.studyserve.com
kitp                 KAVLI INSTITUTE: http://online.itp.ucsb.edu/plecture/
dotsub               dotsub.com
astronomy.com        astronomy.com
teachertube.com      teachertube.com
discovery            dsc.discovery.com
bloomberg            www.bloomberg.com (not bloomberg.tv)
nationalgeographic   National Geographic (http://video.nationalgeographic.com)
videobash            videobash
ibtimes              International Business Times
smh                  Sidney Morning Herald
presstv              Press TV (Iran)
videojug             www.videojug.com
animehere            www.animehere.com

If a website is not in the list, try 'movgrab -t generic <url>'

Feel free to email me and tell me if you've used this software!

Thanks for bug reports go to: Mark Gamar, Rich Kcsa, 'Rampant Badger', 'nibbles', 'deeice', Omair Eshkenazi, Matthias B, Ashish Disawal, Timo Juhani Lindfors, Abhisek Sanyal and others.

Special thanks to:
	'legatvs' for clive (http://clive.sourceforge.net) another downloader into whose code I had to look to figure out how to get youtube and daily motion working again.
	Robert Crowley (http://oldcoder.org/) For all sorts of bug reports and advice.
-bash-2.05b#
After successful installation, just use it !!!

Example :

- First we use '-T' option to show all formats available ...

Code:
-bash-2.05b$ movgrab -T http://www.youtube.com/watch?v=mL8puJMUDpk

Formats available for this Movie:webm:1920x1080 (233.7M), mp4:1920x1080 (224.5M), webm:1280x720 (118.9M), mp4:1280x720 (111.2M), webm:854x480 (50.1M), flv-h264:854x480 (47.3M), webm:640x360 (35.7M), flv-h264:640x360 (31.7M), mp4:480x360 (29.0M), flv:400x240 (14.9M), 3gp:400x240 (9.9M), 3gp:176x144 (3.6M), 

Selected format item:3gp:400x240
TEST MODE: would have downloaded 'AWESOME X: Beautiful Moments' url=http://r4---sn-nwj7kney.c.youtube.com/videoplayback?upn=Tzi_NDCvsb4&sparams=algorithm%2Cburst%2Ccp%2Cfactor%2Cgcr%2Cid%2Cip%2Cipbits%2Citag%2Csource%2Cupn%2Cexpire&fexp=901803%2C923108%2C901444%2C922401%2C920704%2C912806%2C925703%2C925706%2C928001%2C922403%2C929901%2C913605%2C913546%2C913556%2C908493%2C920201%2C911116%2C901451&ms=au&algorithm=throttle-factor&burst=40&ip=62.147.196.247&itag=36&gcr=fr&sver=3&mt=1354832351&mv=m&source=youtube&key=yt1&ipbits=8&factor=1.25&cp=U0hUSVhQVF9JSkNONF9QSlhHOnFRdThmN3gxUjhF&expire=1354856640&id=98bf29b893140e99&newshard=yes&signature=AA3A9490D0CB7015E5B58FF4109D7FAD65CA5560.73511B67941FA7219579600F8ACC3778FDCF5082
-bash-2.05b$
- Then we select the one we want to download ...

Code:
-bash-2.05b$ movgrab -o "AWESOME X: Beautiful Moments.mp4" -f 3gp:176x144 http://www.youtube.com/watch?v=mL8puJMUDpk

Formats available for this Movie:webm:1920x1080 (233.7M), mp4:1920x1080 (224.5M), webm:1280x720 (118.9M), mp4:1280x720 (111.2M), webm:854x480 (50.1M), flv-h264:854x480 (47.3M), webm:640x360 (35.7M), flv-h264:640x360 (31.7M), mp4:480x360 (29.0M), flv:400x240 (14.9M), 3gp:400x240 (9.9M), 3gp:176x144 (3.6M), 

Selected format item:3gp:176x144

Getting: AWESOME X: Beautiful Moments...  Size: 3.6M  Format: 3gp:176x144
	Progress: 99.76%  3.6M of 3.6M  21.9k/s            
-bash-2.05b$
Hope you like it ...

A++
Last edited by colin.stephane; 2013-04-30 at 12:29. Reason: Pushed version up to the latest (1.2.1) ...
 

The Following 33 Users Say Thank You to colin.stephane For This Useful Post:
xes is offline xes
2012-12-06 , 21:50
Posts: 638 | Thanked: 1,692 times | Joined on Aug 2009
#2
Nice work! Thanks! ...I'm going to test how it works...
 

The Following User Says Thank You to xes For This Useful Post:
mr_pingu is offline mr_pingu
2012-12-06 , 21:53
Posts: 1,163 | Thanked: 1,873 times | Joined on Feb 2011 @ The Netherlands
#3
Thanks, are you the big brother of the autobuilder? :P
__________________
N900 loaded with:
CSSU-T (Thumb)
720p recording,
Pierogi, Lanterne, Cooktimer, Frogatto
N9 16GB loaded with:
Kernel-Plus
--
[TCPdump & libpcap | ngrep]
--
donate
 

The Following 3 Users Say Thank You to mr_pingu For This Useful Post:
sifo's Avatar
sifo is offline sifo
2012-12-06 , 21:59
Posts: 1,359 | Thanked: 1,292 times | Joined on Oct 2011 @ Tartus.Syria
#4
You're doing a great job man ! hopefully we'll se more stuff for fremantle
Thanks

./sifo
__________________
[ N900-Crack ] [ The Purge ] [ New Smiles ] [ New icons ] [ ? ]
" Hey ! I've just met you and this is crazy, so install cssu maybe ? "
Please help out keeping Maemo.org alive, and consider donating.
https://www.facebook.com/ZoRk7
 

The Following User Says Thank You to sifo For This Useful Post:
thedead1440 is offline thedead1440
2012-12-07 , 06:59
Moderator | Posts: 6,215 | Thanked: 6,400 times | Joined on Nov 2011
#5
colin.stephane has been on a roll this month; its like see every new announce thread and its highly likely that its another compilation by colin.stephane
 

The Following 4 Users Say Thank You to thedead1440 For This Useful Post:
ladoga is offline ladoga
2012-12-07 , 12:10
Posts: 230 | Thanked: 302 times | Joined on Oct 2009 @ Helsinki, Suomi (Finland)
#6
Thanks for packaging. Works nicely on Harmattan.
Last edited by ladoga; 2012-12-07 at 12:13.
 

The Following 2 Users Say Thank You to ladoga For This Useful Post:
thedead1440 is offline thedead1440
2013-01-03 , 13:02
Moderator | Posts: 6,215 | Thanked: 6,400 times | Joined on Nov 2011
#7
I've tried building movgrab v1.1.15 for Harmattan.

Get it from here...


Caution: This is one of my first few compiles so may contain errors though never got any when I tried it
 

The Following 8 Users Say Thank You to thedead1440 For This Useful Post:
colin.stephane is offline colin.stephane
2013-01-03 , 13:39
Posts: 458 | Thanked: 783 times | Joined on Jan 2010 @ France
#8
I have already pushed the latest version to the auto-builder, but it look like it was offline for maintenance ...

A++
 

The Following 4 Users Say Thank You to colin.stephane For This Useful Post:
colin.stephane is offline colin.stephane
2013-03-29 , 11:00
Posts: 458 | Thanked: 783 times | Joined on Jan 2010 @ France
#9
Hi all,

Edit the 29th March 2013 : Pushed version up to the latest (1.1.15) ...

A++
 

The Following 4 Users Say Thank You to colin.stephane For This Useful Post:
raaj13 is offline raaj13
2013-03-29 , 12:51
Posts: 404 | Thanked: 186 times | Joined on Oct 2010 @ Dehradun,India
#10
Does it works for sites with multiple embbeded videos??
 

The Following User Says Thank You to raaj13 For This Useful Post:
Reply
Page 1 of 2 1 2

Tags
nokia n900

« Previous Thread | Next Thread »

 
Forum Jump


All times are GMT. The time now is 12:42.

Contact Us - Home - Archive - Top