Commit graph

8853 commits

Author SHA1 Message Date
Sergey M․ cdfcc4ce95
[mtv] Improve _VALID_URL 2016-09-27 22:27:10 +07:00
Kacper Michajłow e384552590
[vk] Add support for dailymotion embeds
Fixes #10661
2016-09-27 21:58:14 +07:00
Sergey M․ 1a2fbe322e
[periscope] Treat timed_out state as finished stream 2016-09-27 21:55:51 +07:00
Sergey M․ f9dd86a112
[npo] Clarify IE_NAMEs (Closes #10775) 2016-09-27 21:37:33 +07:00
Remita Amine 2342733f85 fix tests related to 1978540a5122c53012e17a78841f3da0df77fd34(closes #10774) 2016-09-27 15:31:25 +01:00
Remita Amine 93933c9819 [awaan:video] fix test(closes #10773) 2016-09-27 15:31:25 +01:00
Yen Chi Hsuan d75d9e343e
[einthusan] Fix extraction (closes #10714) 2016-09-27 14:38:41 +08:00
Sergey M․ 72c3d02d29
[promptfile] Improve and modernize 2016-09-26 23:39:54 +07:00
Ondřej Bárta d3dbb46330
[promptfile] Fix extraction (Closes #10634) 2016-09-26 23:20:58 +07:00
Sergey M․ fffb9cff94
[kaltura] Speed up embed regexes (#10764) 2016-09-26 22:15:58 +07:00
Sergey M․ 2d5b4af007
[extractors] Add import for anderetijden extractor 2016-09-25 23:30:57 +07:00
Sergey M․ 5742c18bc1
[npo] Add support for anderetijden.nl (Closes #10754) 2016-09-25 22:26:14 +07:00
Sergey M․ ddb19772d5
[vpro] Fix playlist title extraction and update tests 2016-09-25 22:26:06 +07:00
Sergey M․ a3d8b38168
[npo] Generalize playlist extractors 2016-09-25 22:26:00 +07:00
stepshal 2d3d29976b
[youtube] Change test URLs from http to https 2016-09-25 17:45:24 +07:00
Sergey M․ 493353c7fd
[prosiebensat1] Add support for advopedia 2016-09-25 06:25:57 +07:00
Sergey M․ 0a078550b9
[prosiebensat1] Improve _VALID_URL 2016-09-25 06:19:17 +07:00
Sergey M․ f92bb612c6
[mwave] Relax _VALID_URLs (Closes #10735, closes #10748) 2016-09-25 06:14:32 +07:00
Sergey M․ ddde91952f
[prosiebensat1] Fix playlist support (Closes #10745) 2016-09-25 05:36:18 +07:00
Sergey M․ 63c583eb2c
[prosiebensat1] Add support for sat1gold (#10745) 2016-09-25 04:43:10 +07:00
Remita Amine 7fd57de6fb [cbsnews:livevideo] fix extraction and extract m3u8 formats 2016-09-24 22:01:33 +01:00
Remita Amine e71a450956 [common] add hdcore sign to akamai f4m formats 2016-09-24 21:55:53 +01:00
Remita Amine 27e99078d3 [brightcove:new] add support for live streams 2016-09-24 15:39:48 +01:00
Sergey M․ 7518a61d41
[soundcloud] Fix typo in playlist base class name 2016-09-24 19:29:49 +07:00
Sergey M․ 8e45e1cc4d
[soundcloud] Generalize playlist entries extraction (#10733) 2016-09-24 19:18:01 +07:00
Yen Chi Hsuan f0bc5a8609
[twitter] Support Periscope embeds (closes #10737)
Also update _TESTS
2016-09-24 20:00:29 +08:00
Remita Amine a54ffb8aa7 [mtv] add common IE_NAME prefix for MTVIE and MTVVideoIE 2016-09-24 10:50:14 +01:00
Remita Amine 8add4bfecb [mtv] add support for new website urls(closes #8169)(closes #9808) 2016-09-24 10:42:20 +01:00
Yen Chi Hsuan 0711995bca
[openload] Support subtitles (closes #10625) 2016-09-24 14:27:08 +08:00
Yen Chi Hsuan 5968d7d2fe
[extractor/common] Improved support for HTML5 subtitles
Ref: #10625

In a strict sense, <track>s with kind=captions are not subtitles. [1]
openload misuses this attribute, and I guess there will be more
examples, so I add it to common.py.

Also allow extracting information for subtitles-only <video> or <audio>
tags, which is the case of openload.

[1] https://www.w3.org/TR/html5/embedded-content-0.html#attr-track-kind
2016-09-24 14:20:42 +08:00
Sergey M․ 24628cf7db
[soundcloud:playlist] Provide video id for playlist entries (Closes #10733) 2016-09-24 02:01:01 +07:00
Sergey M․ 71ad00c09f
[prosiebensat1] Add support for kabeleinsdoku (Closes #10732) 2016-09-23 21:08:16 +07:00
Remita Amine 45cae3b021 [cbs] extract info from thunder videoPlayerService(closes #10728) 2016-09-22 19:28:22 +01:00
Yen Chi Hsuan 4ddcb5999d
[openload] Fix extraction (closes #10408, closes #10727)
Thanks to @daniel100097 for providing a working version
2016-09-23 01:47:51 +08:00
Yen Chi Hsuan e3d6bdc8fc
[ustream] Support HLS streams (closes #10698) 2016-09-23 01:11:13 +08:00
Sergey M․ 0a439c5c4c
[udemy] Stringify video id 2016-09-22 21:48:53 +07:00
Remita Amine 1978540a51 [ooyala] extract all hls formats 2016-09-21 21:49:52 +01:00
Sergey M․ 12f211d0cb
[videomore] Fix embed regex 2016-09-21 22:51:36 +07:00
Remita Amine 3a5a18705f [adobepass] add support MSO that depend on watchTVeverywhere(closes #10709) 2016-09-21 15:57:27 +01:00
Remita Amine 1ae0ae5db0 [cartoonnetwork] add support Adobe Pass auth 2016-09-20 18:52:00 +01:00
Sergey M․ f62a77b99a
[soundcloud] Modernize 2016-09-20 21:56:57 +07:00
coolsa 4bfd294e2f
[soundcloud] Extract license metadata 2016-09-20 21:56:57 +07:00
Remita Amine e33a7253b2 [fox] add support for Adobe Pass auth(closes #8584) 2016-09-20 15:52:23 +01:00
Remita Amine c38f06818d add support for Adobe Pass auth in tbs,tnt and trutv extractors(fixes #10642)(closes #10222)(closes #10519) 2016-09-20 11:55:30 +01:00
Sergey M․ 70b4cf9b1b
[crunchyroll] Check if already logged in (Closes #10700) 2016-09-19 02:50:06 +07:00
Sergey M․ cc764a6da8
[twitch:stream] Remove fallback to profile extraction when stream is offline
Main page does not contain profile videos anymore
2016-09-18 19:10:18 +07:00
Yen Chi Hsuan d8dbf8707d
[thisav] Improve title extraction (closes #10682)
I didn't add a test case as the one in #10682 looks like a copyrighted
product.
2016-09-18 18:35:38 +08:00
Sergey M․ a1da888d0c
[vyborymos] Improve station info extraction 2016-09-18 17:30:55 +07:00
Sergey M․ 14ae11efab
[vyborymos] Add extractor (Closes #10692) 2016-09-18 16:56:40 +07:00
Sergey M․ 190d2027d0
[xfileshare] Add title regex for streamin.to and fallback to video id (Closes #10646) 2016-09-18 07:22:06 +07:00
Sergey M․ 26394d021d
[globo:article] Add support for multiple videos (Closes #10653) 2016-09-17 23:34:10 +07:00
Sergey M․ 30d0b549be
[extractor/common] Add manifest_url for hls and hds formats 2016-09-17 21:33:38 +07:00
Sergey M․ 86f4d14f81
Refactor fragments interface and dash segments downloader
- Eliminate segment_urls and initialization_url
+ Introduce manifest_url (manifest may contain unfragmented data in this case url will be used for direct media URL and manifest_url for manifest itself correspondingly)
* Rewrite dashsegments downloader to use fragments data
* Improve generic mpd extraction
2016-09-17 20:35:22 +07:00
Sergey M․ 21d21b0c72
[svt] Fix DASH formats extraction 2016-09-17 19:25:31 +07:00
Sergey M․ b4c1d6e800
[extractor/common] Expose fragments interface for dashsegments formats 2016-09-17 18:31:18 +07:00
Sergey M․ a0d5077c8d
[extractor/common] Introduce fragments interface 2016-09-17 18:31:09 +07:00
Yen Chi Hsuan 584d6f3457
[thisav] Recognize jwplayers (closes #10447) 2016-09-17 18:46:43 +08:00
Yen Chi Hsuan e14c82bd6b
[jwplatform] Use js_to_json to detect more JWPlayers 2016-09-17 18:45:08 +08:00
Sergey M․ c51a7f0b2f
[franceinter] Fix upload date extraction 2016-09-17 15:44:37 +07:00
Remita Amine d05ef09d9d [mangomolo] fix domain regex 2016-09-17 08:11:01 +01:00
Remita Amine fc86d4eed0 [mangomolo] fix typo 2016-09-16 20:10:47 +01:00
Remita Amine 7d273a387a [mangomolo] add support for Mangomolo embeds 2016-09-16 19:31:39 +01:00
Remita Amine 6ad0219556 [common] add helper method for Wowza Streaming Engine format extraction 2016-09-16 19:30:38 +01:00
Remita Amine 98b7506e96 [toutv] add support for authentication(closes #10669) 2016-09-16 17:40:15 +01:00
Sergey M․ 52dc8a9b3f
[franceinter] Fix upload date extraction 2016-09-16 22:02:59 +07:00
Sergey M․ 9d8985a165
[tv4] Fix hls and hds formats (Closes #10659) 2016-09-16 00:54:34 +07:00
stepshal 490b755769
Improve some id regexes 2016-09-15 23:12:58 +07:00
Sergey M․ 1dec2c8a0e
[adobepass] Change mvpd cache section name
In order to better emphasize it's relation to Adobe Pass
2016-09-15 22:47:45 +07:00
Sergey M․ dcce092e0a
[extractor/common] Simplify _get_netrc_login_info and carry long lines 2016-09-15 22:35:12 +07:00
Sergey M․ 32443dd346
[extractor/common] Update _get_login_info's comment 2016-09-15 22:34:29 +07:00
Sergey M․ 2133565cec
[extractor/common] Simplify _get_login_info 2016-09-15 22:26:37 +07:00
Sergey M․ c849836854
[utils] Improve _hidden_inputs 2016-09-15 21:54:48 +07:00
Sergey M․ eb5b1fc021
[crunchyroll] Fix authentication (Closes #10655) 2016-09-15 21:53:35 +07:00
Sergey M․ 95be29e1c6
[twitch] Fix api calls (Closes #10654, closes #10660) 2016-09-15 20:58:02 +07:00
Remita Amine c035dba19e [bellmedia] add support for more sites 2016-09-15 08:12:12 +01:00
Remita Amine 797c636bcb [ap] improve adobe pass names and parse error handling 2016-09-14 18:58:47 +01:00
Sergey M․ 0002962f3f
[franceinter] Improve extraction (Closes #10538) 2016-09-14 23:59:38 +07:00
renalid a942d6cb48
[utils,franceinter] Add french months' names and fix extraction
Update of the "FranceInter" radio extractor : webpages HTML structure
had changed, the extractor didn't work. So I updated this extractor to
get the mp3 URL and all details.
2016-09-14 23:59:38 +07:00
Yen Chi Hsuan 961516bfd1
[kwuo:song] Improve error detection (closes #10650) 2016-09-15 00:56:15 +08:00
Yen Chi Hsuan 6db354a9f4
[kuwo] Update _TESTS 2016-09-15 00:53:04 +08:00
Remita Amine 353f340e11 [go] fix typo 2016-09-14 17:22:42 +01:00
Remita Amine 014b7e6b25 [go] add support for free full episodes(#10439) 2016-09-14 17:08:25 +01:00
stepshal 925194022c
Improve some _VALID_URLs 2016-09-14 22:47:21 +07:00
Sergey M․ b690ea15eb
[viafree] Fix test 2016-09-14 22:45:23 +07:00
Remita Amine 5712c0f426 [adobepass] remove unnecessary option 2016-09-14 16:37:21 +01:00
Yen Chi Hsuan 86d68f906e
[bilibili] Fix extraction for videos without backup_url (#10647) 2016-09-14 22:11:49 +08:00
Yen Chi Hsuan 4875ff6847
[bilibili] Remove copyrighted test cases
I can't find any English or Chinese material that claims BiliBili has
bought legal redistribution permissions for copyrighted products from
copyrighted holders.

References for removed test cases:
"刀语": https://en.wikipedia.org/wiki/Katanagatari, by White Fox
"哆啦A梦": https://en.wikipedia.org/wiki/Doraemon, by Shin-Ei Animation
"岳父岳母真难当": https://en.wikipedia.org/wiki/Serial_(Bad)_Weddings, by Les films du 24
"混沌武士": https://en.wikipedia.org/wiki/Samurai_Champloo, by Manglobe

I shouldn't have added them to _TESTS
2016-09-14 22:09:43 +08:00
Remita Amine 1b6712ab23 [adobepass] add specific options for adobe pass authentication
- add --ap-username and --ap-password option to specify
TV provider username and password in the cmd line
- add --ap-retries option to limit the number of retries
- add --list-ap-msi-ids to list the supported TV Providers
2016-09-13 22:16:01 +01:00
Sergey M․ 8414c2da31
[adobepass] PEP 8 2016-09-13 23:22:16 +07:00
Sergey M․ 45396dd2ed
[nhk] Fix extraction (Closes #10633) 2016-09-13 23:20:25 +07:00
Remita Amine 7a7309219c [adobepass] add an option to specify mso_id and support for ROGERS TV Provider(closes #10606) 2016-09-12 23:39:35 +01:00
Sergey M․ a6ccc3e518
[safari] Improve ids regexes (#10617) 2016-09-12 23:05:52 +07:00
Sergey M․ 1d16035bb4
[kaltura] Improve audio detection 2016-09-12 22:43:45 +07:00
Sergey M․ e8bcd982cc
[kaltura] Skip chun format 2016-09-12 22:33:00 +07:00
Sergey M․ a5ff05df1a
[extractor/generic] Add vimeo embed that requires Referer passed 2016-09-12 21:49:31 +07:00
Sergey M․ d002e91986
[vimeo:ondemand] Pass Referer along with embed URL (#10624) 2016-09-12 21:48:45 +07:00
Yen Chi Hsuan be45730226
[nbc] Add new extractor for NBC Olympics (#10295, #10361) 2016-09-12 02:55:15 +08:00
Sergey M․ ee7e672eb0
[tube8] Remove proxy settings from test 2016-09-11 23:46:50 +07:00
Sergey M․ bc9186c882
[tvplay] Remove unused import 2016-09-11 22:51:12 +07:00
Sergey M․ 6599c72527
[tube8] Extract categories and tags (Closes #10579) 2016-09-11 22:50:36 +07:00