Commit graph

10905 commits

Author SHA1 Message Date
Remita Amine 371dcc1dd4 [theplatform] add support for theplatform Top-level domain customization(#16977) 2018-07-18 18:34:04 +01:00
Remita Amine bd21ead2a2 [extractor/common] add support for DASH and MSS formats extraction in SMIL manifests 2018-07-18 18:34:04 +01:00
Jakub Wilk 905eef2b06 [imgur] Allow digits in filename extension 2018-07-18 23:47:26 +07:00
Sergey M․ 79367a9820
[pornhub] Improve extraction and extract all formats (closes #12166, closes #15891, closes #16262, closes #16959) 2018-07-14 18:05:06 +07:00
Sergey M․ 4b3ee09886
[nrktv] Add support for new season and serie URL schema 2018-07-10 00:27:24 +07:00
Sergey M․ 79fd7320e2
[nrktv] Add support for new episode URL schema (closes #16909) 2018-07-09 23:44:05 +07:00
Sergey M․ 0685d9727b
[utils] Share JSON-LD regex 2018-07-09 23:43:05 +07:00
Sergey M․ 69fcdb845b
[frontendmasters] Fix issues and improve extraction (closes #3661, closes #16328) 2018-07-08 00:55:49 +07:00
Luca Cherubin 6868d272e5
[frontendmasters] Add extractor 2018-07-08 00:49:15 +07:00
Sergey M․ 4742150788
[funk] Fix extraction (closes #16918) 2018-07-06 23:50:02 +07:00
Sergey M․ 1ed0b2f74d
[watchbox] Fix extraction (closes #16904) 2018-07-05 02:22:15 +07:00
Sergey M․ e15141adae
[dplayit] Sort formats 2018-07-05 02:14:50 +07:00
Sergey M․ 94fef94d9c
[dplayit] Fix extraction (closes #16901) 2018-07-05 02:14:06 +07:00
Sergey M․ 9a6628aaf9
[youtube] Improve login error handling (closes #13822) 2018-07-05 00:37:32 +07:00
Sergey M․ 24d26ab380
[lynda] PEP 8 2018-07-04 04:49:03 +07:00
Sergey M․ 836ef4840f
[pluralsight] Switch to graphql (closes #16889, closes #16899) 2018-07-04 04:48:40 +07:00
Sergey M․ 5621c3222e
[lynda] Simplify login and improve error capturing (#16891) 2018-07-03 02:47:09 +07:00
Remita Amine db5debf313 [go90] add support for embed urls(closes #16873) 2018-07-01 22:41:32 +01:00
Remita Amine 8cee692b8b [go90] detect geo restriction error and pass geo verification headers(closes #16874) 2018-07-01 22:41:32 +01:00
coreynicholson 973b6ceebb [vlive] Fix live streams extraction 2018-07-01 21:19:17 +07:00
Sergey M․ eca1f0d115
[extractor/common] Properly escape % in MPD templates (closes #16867) 2018-07-01 02:11:36 +07:00
Sergey M․ 2160768a21
[npo] Fix typo (closes #16872) 2018-06-30 23:39:56 +07:00
Sergey M․ 267d81962a
[mediaset] Fix issues and extract all formats (closes #16568) 2018-06-30 02:19:02 +07:00
Timendum 9cf648c92b
[mediaset] Add support for new videos 2018-06-30 02:17:51 +07:00
Sergey M․ 5e8e2fa51f
[extractor/common] Use source URL as Referer for HTML5 entries (closes #16849) 2018-06-29 01:25:05 +07:00
Sergey M․ acbd0ff5df
[dctptv] Restore extraction based on REST API (closes #16850) 2018-06-29 00:35:05 +07:00
Sergey M․ 7b393f9cc5
[svt] Improve extraction and add support for pages (closes #16802) 2018-06-28 04:29:11 +07:00
Sergey M․ c3bcd206eb
[porncom] Fix extraction (closes #16808) 2018-06-26 00:01:06 +07:00
Sergey M․ a0949fec08
[joj] Relax _VALID_URL (closes #16771) 2018-06-24 23:57:22 +07:00
Remita Amine 74caf528bc [brightcove] workaround sonyliv DRM protected videos(closes #16807) 2018-06-24 12:02:32 +01:00
Sergey M․ 9fb62e35f6
[motherless:group] Fix _VALID_URL 2018-06-21 23:39:13 +07:00
Sergey M․ b71cc71910
[motherless] Fix extraction (closes #16786) 2018-06-21 23:38:32 +07:00
Sergey M․ a4ec45179e
[itv] Sort imports 2018-06-21 23:12:40 +07:00
Sergey M․ 30374f4d40
[itv] Make SOAP request non fatal and extract metadata from a webpage (closes #16780) 2018-06-21 23:06:58 +07:00
Sergey M․ 91aa502d91
[foxnews:insider] Remove extractor (#15810)
Now covered by foxnews:article
2018-06-20 23:59:37 +07:00
Sergey M․ f51f526b0a
[foxnews] Add support for iframe embeds (closes #15810, closes #16711) 2018-06-20 23:53:37 +07:00
Sergey M․ 8b4b400aef
[peertube] Improve generic support (closes #16733) 2018-06-19 23:00:36 +07:00
Remita Amine e12b4b8bcc [6play] use geo verfication headers 2018-06-19 10:35:57 +01:00
Remita Amine 18806e3b6b [rtbf] fix extraction for python 3.2 and older 2018-06-18 19:10:43 +01:00
Sergey M․ 713afa705c
[vgtv] Improve HLS formats extraction 2018-06-18 23:15:38 +07:00
Sergey M․ 721a877d2f
[vgtv] Add support for www.aftonbladet.se/tv/ URLs 2018-06-18 23:08:35 +07:00
Sergey M․ 9283d4ea03
[bbccouk] Use expected_status 2018-06-18 04:54:59 +07:00
Sergey M․ 00a429bea3
[markiza] Expect 500 status code 2018-06-18 04:54:52 +07:00
Sergey M․ d391b7e23d
[extractor/common] Introduce expected_status for convenient accept of failed HTTP requests
Useful when some non-success (2xx) HTTP status codes should be considered normal. Previously this required to manually catch corresponding exceptions and read the response.
2018-06-18 04:54:08 +07:00
Remita Amine 8ba84e4600 [tvnow] try all clear manifest urls(closes #15361) 2018-06-17 20:41:09 +01:00
Sergey M․ ce0edda0f9
[markiza] Add extractors (closes #16750) 2018-06-18 01:17:47 +07:00
Remita Amine 0adf213d8c [wat] try all supported adaptive urls 2018-06-17 15:56:52 +01:00
Remita Amine 8b183bd5f8 [tf1] try all supported adaptive urls 2018-06-17 15:53:29 +01:00
Remita Amine 1882511754 [6play] add support for rtlplay.be and extract hd usp formats 2018-06-17 12:01:14 +01:00
Remita Amine 764cd4e6f3 [rtbf] improve extraction
- add support for audio and live streams(closes #11923)(closes #9638)
- extract HLS, DASH and all HTTP formats
- extract subtitles
- fixup specific http urls(fixes #16101)
2018-06-17 03:13:41 +01:00
Sergey M․ 734d461ca0
[expressen] Add extractor 2018-06-16 21:15:06 +07:00
Urgau 81c5df4f2c [vidzi] Fix extraction (closes #16678) 2018-06-16 05:08:44 +07:00
Sergey M․ 87f89dacdd
[pbs] Improve extraction (closes #16623, closes #16684) 2018-06-16 02:55:20 +07:00
Sergey M․ 61cb66830f
[bilibili] Restrict cid regex (closes #16638, closes #16734) 2018-06-14 22:40:30 +07:00
Remita Amine aa56061627 [discoverynetworks] Add support for disco-api videos(closes #16724) 2018-06-13 16:46:59 +01:00
Remita Amine 18d66f0410 [dailymotion] use compat_struct_pack 2018-06-13 15:12:42 +01:00
Remita Amine f15f7a674b [dailymotion] add support for password protected videos(closes #9789) 2018-06-13 14:51:19 +01:00
Sergey M․ 9aca7fe6a3
[abc:iview] Extract more series metadata 2018-06-12 20:25:50 +07:00
Remita Amine e0671819e7 [abc] fix ABC IView extraction and add support for livestreams(closes #16704)(closes #12354) 2018-06-12 13:07:57 +01:00
Sergey M․ dc53c78634
[crackle] Add support for sonycrackle.com (closes #16698) 2018-06-12 02:06:30 +07:00
Sergey M․ 7dc9c60b4b
[tvnet] Fix _VALID_URL 2018-06-12 02:05:58 +07:00
Sergey M․ e51752754d
[tvnet] Improve video id extraction 2018-06-12 01:50:43 +07:00
Sergey M․ 0645be49cb
[inc] PEP 8 2018-06-12 01:41:23 +07:00
Sergey M․ a572ae6114
[tvnet] Improve and fix issues (closes #15462) 2018-06-12 01:37:34 +07:00
Thomas van der Berg b2df66aeca
[tvnet] Add extractor 2018-06-12 01:37:29 +07:00
Sergey M․ 93cffb1444
[nrk] Update API hosts and try all previously known ones (closes #16690) 2018-06-11 03:08:36 +07:00
Sergey M․ d253df2f65
[wimp] Fix Youtube embeds extraction 2018-06-11 02:40:17 +07:00
Sergey M․ 9d581efe05
[npo] Extend _VALID_URL (closes #16682) 2018-06-10 00:26:16 +07:00
Sergey M․ ff2e486221
[inc] Add support for another embed schema (closes #16666) 2018-06-09 02:53:04 +07:00
Remita Amine 6ae36035d9 [tv4] fix format extraction(closes #16650) 2018-06-06 00:41:08 +01:00
Remita Amine 9afd74d705 [nexx] extract free cdn http formats 2018-06-05 01:02:46 +01:00
Sergey M․ 2e6975306a
[nexx] Update tests 2018-06-05 02:59:25 +07:00
Sergey M․ 06ea7bdd99
[nexx] Add support for free cdn (closes #16538) 2018-06-05 02:55:54 +07:00
Sergey M․ d7be705308
[pbs] Add another cove id pattern (closes #15373) 2018-06-05 00:17:26 +07:00
Sergey M․ 2e190c2ad9
[rbmaradio] Add support for 192k format (closes #16631) 2018-06-04 23:51:25 +07:00
Sergey M․ c3023e9f2e
[camtube] Add extractor 2018-06-03 17:09:20 +07:00
Sergey M․ 77053237c5
[twitter:card] Generalize base API URL 2018-06-03 15:58:12 +07:00
Sergey M․ b6b2ccb72f
[twitter:card] Extract guest token (closes #16609) 2018-06-03 15:57:45 +07:00
Sergey M․ 0a10f50e2f
[chaturbate] Use geo verification headers 2018-06-03 04:30:33 +07:00
Sergey M․ 6d155707e6
[bbc] Add support for bbcthree (closes #16612) 2018-06-03 04:07:59 +07:00
Sergey M․ eb6793ba97
[youtube] Update tests 2018-06-03 02:23:45 +07:00
Sergey M․ 7e72694b5e
[youtube] Move metadata extraction after video availability check 2018-06-03 02:08:38 +07:00
Sergey M․ 936784b272
[youtube] Extract track and artist 2018-06-03 02:05:14 +07:00
Sergey M․ 003fe73ccf
[safari] Add support for new URL schema (closes #16614) 2018-06-03 00:53:11 +07:00
Remita Amine 1ea559c445 [adn] fix extraction 2018-06-02 18:14:22 +01:00
Sergey M․ 9b89daefa6
[facebook] Improve extraction (closes #16554) 2018-06-02 01:42:05 +07:00
Nathan Rossi 9d082e7cb8
[facebook] Add support for tahoe player videos (closes #15441)
Specific videos appear to use a newer/different player, this requires a
second request for the video data as the initial request is missing the
specified data.

Additionally these videos have different page content for the uploader
value, which is stored in the `<meta property="og:title"...>` element of
the initial request.
2018-06-02 01:32:53 +07:00
Sergey M․ f20f636596
[cbc] Improve extraction (closes #16583, closes #16593) 2018-06-02 00:35:07 +07:00
Enes 85750f8972 [openload] Improve ext extraction 2018-06-02 00:16:22 +07:00
Sergey M․ 926d97fc6b
[9c9media] PEP 8 2018-06-01 05:17:49 +07:00
Sergey M․ 2593725a9b
[twitter:card] Add support for another endpoint (closes #16586) 2018-06-01 05:16:00 +07:00
DroidFreak32 0bfdcc1495 [openload] Add support for oload.win and oload.download 2018-05-31 22:01:44 +07:00
Remita Amine c3f75e2454 [audimedia] fix extraction(closes #15309) 2018-05-31 12:39:45 +01:00
Remita Amine 3a8e3730c1 [francetv] add support for sport.francetvinfo.fr(closes #15645) 2018-05-31 11:40:37 +01:00
Remita Amine acca2ac7f3 [mlb] improve extraction(closes #16587) 2018-05-31 02:50:14 +01:00
Remita Amine 128b58ad13 [nhl] remove old extractors 2018-05-31 02:49:35 +01:00
Remita Amine 4fd1437d9d [rbmaradio] check formats availability(closes #16585) 2018-05-30 17:08:32 +01:00
Remita Amine e0d42dd4b2 [teamcoco] Fix extraction for full episodes(closes #16573) 2018-05-30 13:21:07 +01:00
Remita Amine a07879d6b2 [spiegel] fix info extraction(#16538) 2018-05-28 00:10:46 +01:00
Sergey M․ cfd7f2a636
[apa] Add extractor (closes #15041, closes #15672) 2018-05-27 18:24:54 +07:00