Commit graph

599 commits

Author SHA1 Message Date
Elan Ruusamäe d226c560a6 Refactor code to use url_result 2019-01-01 23:56:05 +07:00
Sergey M․ 5ee7ae5c75
[teachable] Add support for teachable based platform sites (closes #5451, closes #18150, closes #18272) 2018-12-09 22:36:36 +07:00
Sergey M․ 83852e57bf
[zype] Add extractor (closes #18143) 2018-11-11 00:44:49 +07:00
Sergey M․ 476cf548e1
[sportbox] Improve extraction, add support for matchtv.ru and fix video id (closes #17978) 2018-10-29 00:21:50 +07:00
Sergey M․ 8fd12a0831
[mediaset] Improve embed support (closes #17668) 2018-09-26 05:38:41 +07:00
Sergey M․ 2e4350eec6
[generic] PEP 8 (#17455) 2018-09-08 17:24:59 +07:00
Mohammed Yaseen Mowzer 3d08f63dc5
[generic] Skip unsuccessful jwplayer extraction (closes #16735) 2018-09-03 02:15:17 +07:00
Sergey M․ 287cf7e443
[generic] Remove unused import 2018-08-26 20:09:02 +07:00
Sergey M․ e0b6e98871
[generic] Allow relative src for videojs embeds (closes #17324) 2018-08-24 23:12:53 +07:00
Sergey M․ 57c68ec4c3
[generic] Add support for expressen embeds 2018-08-14 22:51:44 +07:00
Sergey M․ 9d1b213845
[viqeo] Add extractor (closes #17066) 2018-07-30 03:05:36 +07:00
Sergey M․ 3052a30d42
Improve URL extraction 2018-07-21 19:08:28 +07:00
Sergey M․ 7b393f9cc5
[svt] Improve extraction and add support for pages (closes #16802) 2018-06-28 04:29:11 +07:00
Sergey M․ f51f526b0a
[foxnews] Add support for iframe embeds (closes #15810, closes #16711) 2018-06-20 23:53:37 +07:00
Sergey M․ 8b4b400aef
[peertube] Improve generic support (closes #16733) 2018-06-19 23:00:36 +07:00
Sergey M․ cfd7f2a636
[apa] Add extractor (closes #15041, closes #15672) 2018-05-27 18:24:54 +07:00
Sergey M․ aee36ca832
[indavideo] Add support for generic embeds (closes #11989) 2018-05-26 01:25:40 +07:00
Sergey M․ 6bd499e8ca
[peertube] Add support for generic embeds 2018-05-26 00:28:30 +07:00
Sergey M․ 789b7774a7
[businessinsider] Add extractor (closes #16387, closes #16388, closes #16389) 2018-05-06 21:58:55 +07:00
Sergey M․ 660a230b2d
[cloudflarestream] Add support for cloudflare streams (closes #16375) 2018-05-05 01:21:52 +07:00
Sergey M․ c21692fa94
[kaltura] Improve iframe embeds detection (closes #16337) 2018-05-01 03:09:04 +07:00
Bastian de Groot 01aec84880 [generic] Prefer enclosures over links in RSS feeds 2018-04-29 22:14:37 +07:00
Sergey M․ 6cc622327f
[utils] Introduce merge_dicts 2018-04-28 02:47:17 +07:00
Sergey M․ e30991f920
[kaltura] Improve embeds detection (closes #16201) 2018-04-18 01:26:15 +07:00
Sergey M․ 069937151e
[generic] Add support for tube8 embeds 2018-04-09 00:37:15 +07:00
Sergey M․ d3431dcb90
[generic] Restrict share-videos.se embeds regex to filter bogus URLs (#16115) 2018-04-09 00:25:44 +07:00
Surya Oktafendri 1fc37ca3f1 [generic] Add support for share-videos.se embeds (closes #16089) 2018-04-09 00:19:23 +07:00
Sergey M․ 8b7340a45e
[lenta] Add extractor (closes #15953) 2018-03-22 23:07:31 +07:00
Sergey M․ 47a5cb7734
Generalize XML manifest processing code and improve XSPF parsing (closes #15794) 2018-03-18 02:52:17 +07:00
Ricardo Constantino 96b8b9abae
[extractor/generic] Support relative URIs in _parse_xspf
<location> can have relative URIs, not just absolute.
2018-03-18 02:48:44 +07:00
Sergey M․ 178ee88319
[generic] Add support for xfileshare embeds (closes #15879) 2018-03-17 23:57:07 +07:00
Sergey M․ 86c8cfc555
[vice] Fix extraction and rework extractors (closes #11101, closes #13019, closes #13622, closes #13778) 2018-03-03 23:08:43 +07:00
Sergey M․ 4c780fbd0a
[yapfiles] Add extractor (closes #15726, refs #11085) 2018-03-03 01:24:36 +07:00
Sergey M․ ea69624992
[youtube] Handle shared URLs with generic extractor (closes #14303) 2018-02-15 22:33:11 +07:00
Sergey M․ 5399ab3f0c
[brightcove] Pass embed page URL as referrer (closes #15486) 2018-02-04 07:55:04 +07:00
Sergey M․ 7d5406216a
[springboardplatform] Add extractor 2018-01-20 00:34:10 +07:00
Sergey M․ b0ead0e09a
[jwplatform] Add support for multiple embeds (closes #15192) 2018-01-07 21:49:23 +07:00
Sergey M․ 2ca7ed41fe
[mediasite] Improve extraction and code style, add support for DASH (closes #11185, closes #14343, refs #5428) 2017-12-30 08:04:43 +07:00
felix 8056c8542d
[mediasite] Add extractor, subsume sandia and collegerama extractors 2017-12-30 07:23:41 +07:00
Remita Amine 3c4fbfeca2 [dailymotion] remove dailymotion cloud extractor(closes #6794)
https://web.archive.org/web/20160312110217/https://www.dmcloud.net/
2017-12-06 10:56:48 +01:00
Sergey M․ d3f8b76b69
[extractor/generic] Fix typo (closes #14902)
Don't pass video_id as mpd_id
2017-12-05 23:11:15 +07:00
John Hawkinson 805f5bf759 [Generic] ie_key in JWPlatform test 72 2017-11-24 21:39:55 +08:00
John Hawkinson 6899b1d9e8 [Generic] Update test 69 (suffolk/sjc)
suffolk.edu/sjc => suffolk.edu/sjc/live.php

Unfortunately it only transmits video a few mornings per month, so
leaving the 'skip' is probably appropriate. Updating the 'skip- to
include the calendar information though.
2017-11-24 21:39:55 +08:00
John Hawkinson 939be9adfe [JWPlatform] Support iframes
Support content.jwplatform... src attributes inside <iframe> tags in
addition to <script> tags. Just a regexp change.

Add a test (currently Generic_72).
2017-11-24 21:39:55 +08:00
Timendum 0987f2ddb2 [vshare] Fix extraction (closes #14473) 2017-11-14 22:34:45 +07:00
Remita Amine 2637fadc38 [generic] fix some of the tests 2017-10-12 16:14:43 +00:00
Sergey M․ ff3f1a62f0
[funk] Add extractor (closes #14464) 2017-10-12 00:44:13 +07:00
Sergey M․ 26bae2d965
[generic] Add support for channel9 embeds (closes #14469) 2017-10-11 21:59:30 +07:00
Sergey M․ 197224b7a4
Fix some regexes 2017-10-09 23:50:53 +07:00
Sergey M․ c5b7014a9c
[generic] Add support for single format Video.js embeds (closes #14371) 2017-10-01 07:01:42 +07:00
Sergey M․ 63d990d285
[generic] Add support for Video.js embeds 2017-09-28 00:37:30 +07:00
Sergey M․ 02d01e15f1
[generic] Fix infinite recursion for twitter:player URLs (closes #14339) 2017-09-26 21:47:18 +07:00
kayb94 9ce1ac4046 [generic] Fix support for multiple HTML5 videos on one page (closes #14080) 2017-09-23 05:49:48 +07:00
Sergey M․ 66c9fa36c1
[youtube] Separate methods for embeds extraction 2017-09-06 00:48:37 +07:00
Sergey M․ ff17be3ac9
[extractor/generic] Extract from LD-JSON last of all
Previous sources may contain several formats, e.g. http://tamasha.com/v/PgGZ
2017-08-27 03:31:40 +07:00
Yen Chi Hsuan 09747ba766
[liveleak] Support another liveleak embedding pattern (closes #13336) 2017-08-19 22:28:13 +08:00
Sergey M․ 5551d7714d
[generic] Convert redirect URLs to unicode strings (closes #13951) 2017-08-17 23:58:01 +07:00
Sergey M․ eb02940cc7
[generic] Add test for #13895 2017-08-13 01:11:27 +07:00
Sergey M․ 1663bd6e1c
[generic] Replace vzaar embed test 2017-08-11 22:02:00 +07:00
tetra-eder 41918eaa5c [generic] Add support for vzaar embeds 2017-08-11 22:00:39 +07:00
Grzegorz Ruciński 198d4cb40c [generic] Add support for another ooyala embed pattern (closes #13727) 2017-07-30 01:30:04 +07:00
Sergey M․ 95908ce453
[extractor/generic] PEP 8 2017-07-29 15:13:12 +07:00
Philipp Hagemeister 24e966e8da [megaphone] Add extractor 2017-07-28 12:13:19 +02:00
Sergey M․ bb176df3bb
[spiegel:article] Move test 2017-07-17 22:19:40 +07:00
Sergey M․ 3f59b0154a
[nexx:embed] Add extractor for iframe embeds 2017-07-16 04:32:37 +07:00
Sergey M․ 4e826cd9ae
[nexx] Add extractor (closes #10807, closes #13465) 2017-07-15 07:02:57 +07:00
Robin Neatherway 2583c0b54e Fix bugs caused by typos 2017-07-14 23:08:32 +07:00
Sergey M․ 71a1db8919
[dailymail] Add support for embeds 2017-07-09 20:06:24 +07:00
Sergey M․ 73cf76a93f
[joj] Rewrite and add support for generic embeds (closes #13268) 2017-07-09 19:17:54 +07:00
Sergey M․ 4328ddf82b
[extractor/common] Add support for AMP tags in _parse_html5_media_entries 2017-07-09 16:29:52 +07:00
Sergey M․ 250b042c7e
[generic] Add tests for #13557 2017-07-09 16:02:38 +07:00
Sergey M․ 665e945246
[eagleplatform] Add support for referrer protected videos (closes #13557) 2017-07-09 15:57:58 +07:00
Sergey M․ b311b0ead2
[generic] Extract more generic metadata (closes #13527) 2017-06-30 21:42:04 +07:00
Sergey M․ fd1c5fba6b
[facebook] Add test for plugin video embed (#13493) 2017-06-27 22:38:59 +07:00
Sergey M․ 0646e34c7d
[facebook] Add support for plugin video embeds and multiple embeds (closes #13493) 2017-06-27 22:38:54 +07:00
Sergey M․ 4e3637034c
[extractor/generic] Ensure format id is unicode string 2017-06-10 23:56:20 +07:00
Sergey M․ 2b8e6a68f8
[extractor/generic] Add test for mediaset embed 2017-05-14 06:40:19 +07:00
Sergey M․ 5d29af3d15
[extractor/generic] Add support for mediaset embeds 2017-05-14 06:29:16 +07:00
Sergey M․ 946826eec7
[extractor/generic] Remove duplicate limelight code 2017-05-14 06:17:34 +07:00
Sergey M․ 58bb440283
[extractor/generic] Extract wistia embed code into separate method 2017-05-13 21:51:58 +07:00
Remita Amine 6c52477f59 [condenast] improve embed support 2017-05-12 16:37:09 +01:00
Sergey M․ 9edf47df7b
[brightcove] Allow whitespace around attribute names in embedded code 2017-05-01 01:03:47 +07:00
John Hawkinson 557194591a
[washingtonpost] Add support for embeds (closes #12699) 2017-04-29 23:07:26 +07:00
Sergey M․ 7986c3abcd
[anvato] Improve extraction (closes #12913)
* Promote to regular shortcut based extractor
* Add mcp to access key mapping table
* Add support for embeds extraction
* Add support for anvato embeds in generic extractor
2017-04-29 19:49:04 +07:00
Yen Chi Hsuan 06d0ad9a4e
[brightcove] Support URLs with bcpid instead of playerID
Fixes #12482
2017-04-18 23:04:22 +08:00
Sergey M․ ab87c26009
[extractor/generic] Add test for #12761 2017-04-17 00:36:59 +07:00
Sergey M․ e5d39886ec
[limelight] Improve embeds extraction (closes #12761)
* Move extraction code to extractor
* Add extraction for LimelightEmbeddedPlayerFlash embeds
* Extract multiple video
2017-04-17 00:23:16 +07:00
Sergey M․ 413c1f8e2f
[extractor/generic] Extract RSS entries as url_transparent (#11163) 2017-04-16 00:57:32 +07:00
Sergey M․ 0254f93b08
[brightcove] Validate ambiguous embeds' URLs (closes #9163, closes #12005, closes #12178, closes #12480) 2017-04-15 20:31:49 +07:00
John Hawkinson 40158f55c9
[brightcove] Relax video tag embeds extraction
BrightcoveNewIE.extract_urls(): Handle player data when it is all in
attributes of the <video> tag, and also the id is
data-brightcove-video-id not data-video-id.

Add test to generic extractor, note HEAD gives 404, no checksum computed(?).
2017-04-15 20:31:43 +07:00
Remita Amine 0ee79a378a [generic] exclude urls with xml ext from valid video urls(closes #10768)(closes #11654) 2017-04-12 16:22:08 +01:00
John Hawkinson 61568e50cf [generic] Add support for <object> youtube embeds (closes #12637) 2017-04-11 00:04:32 +07:00
John Hawkinson a01825a541 [kaltura] Add support for iframe embeds 2017-04-08 16:40:57 +07:00
Remita Amine 3e943cfe09 [generic] pass base_url to _parse_jwplayer_data 2017-03-31 14:54:06 +01:00
Random User 4f06c1c9fc Merge branch 'master' of github.com-rndusr:rg3/youtube-dl into fix/str-item-assignment 2017-03-25 21:36:59 +01:00
Random User c73e330e7a _find_jwplayer_data() returns dict or None
This simplifies code for callers of `_find_jwplayer_data()` which no longer have
to run `_parse_json()` on the return value.

It also makes sure that `_find_jwplayer_data()` returns either a `dict` or
`None` and nothing else.
2017-03-25 19:38:30 +01:00
Random User 03486dbb01 Add test for JWPlayer where config is passed as variable 2017-03-25 19:37:45 +01:00
John Hawkinson e8e4cc5a6a
[generic] Replace LazyYT test with skiplagged
discourse.ubuntu.com has gone away, repalce with skiplagged.com.
Be nice to have a non-frontpage URL that might be more stable,
though I don't have one. Maybe this should move to html
in test/test_InfoExtractor.py?
2017-03-25 19:53:32 +07:00
Sergey M․ 54b960f340
[generic] Do not follow redirects to the same URL 2017-03-24 00:45:24 +07:00
John Hawkinson 97952bdb78 [generic] Add test for Senate ISVP iframe embed 2017-03-22 01:12:14 +08:00