Commit Graph

307 Commits

Author SHA1 Message Date
Yen Chi Hsuan e4e50f60b1
[googledrive] Fix extraction on Python 3.6
Since Python 3.6, invalid escape sequences are deprecated. It's likely
that there are invalid escape sequences somewhere on the webpage, so
instead of unescaping the whole webpage, just unescape the URL.

See https://bugs.python.org/issue27364. That change was designed for
string literals, while it affects the 'unicode_escape' encoding as well.
The code path is:

str.decode('unicode_escape')
    codecs.unicode_escape_decode()
        PyUnicode_DecodeUnicodeEscape()
2017-02-05 21:41:08 +08:00
Sergey M․ a713a86755
release 2017.02.04.1 2017-02-04 23:26:39 +07:00
Sergey M․ 7bccd5fc8a
[ChangeLog] Actualize 2017-02-04 23:23:38 +07:00
Sergey M․ 3144eccf55
[ChangeLog] Actualize 2017-02-04 23:22:28 +07:00
Sergey M․ 31487eb974
release 2017.02.04 2017-02-04 22:57:48 +07:00
Yen Chi Hsuan daac118bf4
[ChangeLog] Update after #11901 2017-02-03 18:56:40 +08:00
Yen Chi Hsuan d7f9242e30
[ChangeLog] Update after #11565 2017-02-03 12:13:24 +08:00
Yen Chi Hsuan a22b2fd19b
[youtube] Fix ytsearch* when cookies are provided
Closes #11924

The API with `page` is no longer used in browsers, and YouTube always
returns {'reload': 'now'} when cookies are provided.

See http://youtube.github.io/spfjs/documentation/start/ for how SPF
works. Basically appending static link with a `spf` parameter yields the
corresponding dynamic link.
2017-02-03 01:28:24 +08:00
Yen Chi Hsuan bd8f48c78b
[bilibili] Support new Bangumi URLs (closes #11845)
To reduce complexity, I don't support old Bangumi URLs directly via
_VALID_URL. Instead, I choose to let it go to generic redirection. An
example can be found in #10190:

http://bangumi.bilibili.com/anime/v/40062
2017-02-02 21:51:31 +08:00
Jaime Marquínez Ferrándiz 020c5df52d [elpais] Fix extraction for some URLs (closes #11765) 2017-02-01 23:48:34 +01:00
Sergey M․ 5069594993
release 2017.02.01 2017-02-01 03:20:09 +07:00
Sergey M․ b996b88092
[ChangeLog] Actualize 2017-02-01 23:29:59 +07:00
Yen Chi Hsuan 000f207944
[prosiebensat1] Update ChangeLog 2017-02-01 23:16:35 +08:00
Sergey M․ d7e215b42d
release 2017.01.31 2017-01-31 22:24:45 +07:00
Sergey M․ 3a528ffd89
[ChangeLog] Actualize 2017-01-31 22:22:42 +07:00
Sergey M․ 4d2fdb07c4
release 2017.01.29 2017-01-29 13:21:42 +07:00
Sergey M․ fe323a4800
[ChangeLog] Actualize 2017-01-29 21:21:26 +07:00
Sergey M․ d41ed6d243
release 2017.01.28 2017-01-28 00:33:55 +07:00
Sergey M․ 815d2a36d8
[ChangeLog] Actualize 2017-01-28 00:03:21 +07:00
Sergey M․ 2417d41535
release 2017.01.25 2017-01-25 23:36:03 +07:00
Sergey M․ 2c302cf66b
[ChangeLog] Actualize 2017-01-25 23:33:46 +07:00
Sergey M․ c3a65c3de0
release 2017.01.24 2017-01-24 02:58:37 +07:00
Sergey M․ ee4c091ce5
[ChangeLog] Actualize 2017-01-24 02:56:19 +07:00
Yen Chi Hsuan bc35ed3fb6
[nextmedia] Add support for NextTV (壹電視) 2017-01-23 23:38:31 +08:00
Sergey M․ 9d5b29c881
release 2017.01.22 2017-01-22 18:59:04 +07:00
Sergey M․ 6c031a35f3
[ChangeLog] Actualize 2017-01-22 18:57:15 +07:00
Yen Chi Hsuan 7c20b7484c
[nextmedia] Support redirected URLs 2017-01-22 02:06:34 +08:00
Yen Chi Hsuan 4447fb2332
[cspan] Support Ustream embedded videos
Closes #11547
2017-01-20 22:27:13 +08:00
Sergey M․ 1560baacc6
release 2017.01.18 2017-01-18 23:10:00 +07:00
Sergey M․ 460f61fac4
[ChangeLog] Actualize 2017-01-18 23:06:46 +07:00
Sergey M․ c1c2fe2045
release 2017.01.16 2017-01-16 23:44:04 +07:00
Sergey M․ ddd53c392e
[ChangeLog] Actualize 2017-01-16 23:42:04 +07:00
Yen Chi Hsuan 16e2c8f771
[brightcove] Recognize another player ID
Closes #11688
2017-01-16 00:06:52 +08:00
Yen Chi Hsuan dcae7b3fdc
[niconico] Allow login via cookies
Some codes are borrowed from #7968, which is by @jlhg

Closes #7968
2017-01-15 22:51:54 +08:00
Sergey M․ 5d4c7daa49
release 2017.01.14 2017-01-14 07:31:07 +07:00
Sergey M․ 0b94510cd0
[ChangeLog] Actualize 2017-01-14 07:30:32 +07:00
Sergey M․ 31ea2ad89d
release 2017.01.10 2017-01-10 21:29:20 +07:00
Sergey M․ 2184d44361
[ChangeLog] Actualize 2017-01-10 21:27:17 +07:00
Philipp Hagemeister bfedb2cc5a small fix to Changelog format 2017-01-09 11:26:01 +01:00
Philipp Hagemeister 8084951b7f [egghead:course] Add support for egghead.io course playlists
Individual egghead videos are already handled by the generic/Wistia extractors.
2017-01-09 11:24:40 +01:00
Sergey M․ e7ea724cb9
release 2017.01.08 2017-01-08 20:58:43 +07:00
Sergey M․ e60166020b
[ChangeLog] Actualize 2017-01-08 20:56:38 +07:00
Yen Chi Hsuan 1219201143
[ChangeLog] Update after #11581
[ci skip]
2017-01-06 01:07:30 +08:00
Yen Chi Hsuan 24d8a75982
[discoverygo] Fix JSON data parsing
HTMLParser, which is used by extract_attributes, already unescapes
attribute values with HTMLParser.unescape. They shouldn't be unescaped
again, to there may be parsing errors.

Ref: #11219, #11522
2017-01-05 18:50:34 +08:00
Sergey M․ 7232bb299b
release 2017.01.05 2017-01-05 04:10:15 +07:00
Sergey M․ 2b12e34076
[ChangeLog] Actualize 2017-01-05 04:07:32 +07:00
Sergey M․ 2021b650dd
release 2017.01.02 2017-01-02 23:55:04 +07:00
Sergey M․ b890caaf21
[ChangeLog] Actualize 2017-01-02 23:54:29 +07:00
Sergey M․ dc48a35404
release 2016.12.31 2016-12-31 23:58:41 +07:00
Sergey M․ 1ea0b727c4
[ChangeLog] Actualize 2016-12-31 23:53:30 +07:00
Sergey M․ 5e77c0b58e
release 2016.12.22 2016-12-22 22:52:54 +07:00
Remita Amine ab3091feda
[ChangeLog] Actualize 2016-12-22 22:51:51 +07:00
Sergey M․ 90352a8041
release 2016.12.20 2016-12-20 22:39:39 +07:00
Sergey M․ 1f6a79b0af
[ChangeLog] Actualize 2016-12-20 22:37:06 +07:00
Yen Chi Hsuan 8ab7e6c4cc
[kaltura] Improve widget ID extraction (closes #11480) 2016-12-20 18:45:52 +08:00
Sergey M․ f73d7d5074
release 2016.12.18 2016-12-18 19:50:33 +07:00
Sergey M․ 52a1d48d9f
[ChangeLog] Actualize 2016-12-18 19:48:59 +07:00
Sergey M․ 38be3bc568
release 2016.12.15 2016-12-15 21:16:55 +07:00
Sergey M․ d7ef47bffd
[ChangeLog] Actualize 2016-12-15 21:15:45 +07:00
Yen Chi Hsuan 5c32a5be95 [openload] Recognize oload.tv URLs (#10408) 2016-12-15 17:51:26 +08:00
Yen Chi Hsuan 30918999f5
[facebook] Recognize .onion URLs (closes #11443) 2016-12-15 01:04:49 +08:00
Sergey M․ 3c1e9dc4ec
release 2016.12.12 2016-12-12 01:44:50 +07:00
Sergey M․ 62faf9b55e
[ChangeLog] Actualize 2016-12-12 01:41:08 +07:00
Sergey M․ 18ece70c4d
release 2016.12.09 2016-12-09 02:46:18 +07:00
Sergey M․ 9ed3495eae
[ChangeLog] Actualize 2016-12-09 02:41:49 +07:00
Yen Chi Hsuan 6c20a0bb99
[openload] Fix extraction (closes #10408) 2016-12-09 02:15:16 +08:00
Yen Chi Hsuan d17bfe4095
[thisoldhouse] Recognize /tv-episode/ URLs and update _TESTS
Closes #11271
2016-12-01 14:56:52 +08:00
Sergey M․ 73ec479c7d
release 2016.12.01 2016-12-01 00:15:12 +07:00
Sergey M․ f150530f4d
[ChangeLog] Actualize 2016-12-01 00:13:06 +07:00
Sergey M․ 2b380fc299
release 2016.11.27 2016-11-27 20:05:32 +07:00
Sergey M․ 294d4926d7
[ChangeLog] Actualize 2016-11-27 20:04:03 +07:00
Yen Chi Hsuan 44444f0d3b
[cbslocal] Support newyork.cbslocal.com
Closes #11285
2016-11-24 20:32:17 +08:00
Sergey M․ 3b5daf0736
release 2016.11.22 2016-11-22 22:32:16 +07:00
Sergey M․ c8f56741dd
[ChangeLog] Actualize 2016-11-22 22:29:37 +07:00
Yen Chi Hsuan 1d6ae5628f
[amcnetworks] Recognize more BBC America URLs
Closes #11263
2016-11-22 20:40:57 +08:00
Yen Chi Hsuan 303b38fa84
[ChangeLog] Update for #9028 2016-11-20 00:06:44 +08:00
Sergey M․ 08ec95a6db
[ChangeLog] Actualize 2016-11-19 03:10:20 +07:00
Sergey M․ b25459b88a
release 2016.11.18 2016-11-18 00:25:24 +07:00
Sergey M․ 5f75c4a4ad
[ChangeLog] Actualize 2016-11-18 00:19:55 +07:00
Yen Chi Hsuan d76767c90e
[ChangeLog] Update after #11122 landed 2016-11-16 20:47:15 +08:00
Sergey M․ 6b4dfa2819
release 2016.11.14.1 2016-11-14 02:48:15 +07:00
Sergey M․ 9f60134a9d
[ChangeLog] Actualize 2016-11-14 02:46:12 +07:00
Sergey M․ b3d4bd05f9
release 2016.11.14 2016-11-14 02:39:50 +07:00
Sergey M․ dbffd00ba9
[ChangeLog] Actualize 2016-11-14 02:37:21 +07:00
Yen Chi Hsuan 3eaaa8abac [audioboom] Recognize /posts/ URLs (closes #11149) 2016-11-10 14:52:34 +08:00
Sergey M․ db3367f43e
release 2016.11.08.1 2016-11-08 22:30:53 +07:00
Sergey M․ 6590925c27
[ChangeLog] Actualize 2016-11-08 22:29:16 +07:00
Sergey M․ c58e07a7aa
release 2016.11.08 2016-11-08 22:11:21 +07:00
Sergey M․ f700afa24c
[ChangeLog] Actualize 2016-11-08 22:09:03 +07:00
Yen Chi Hsuan 5d47b38cf5 [tmz:article] Fix extraction (closes #11052) 2016-11-08 21:53:41 +08:00
DarkZeros cb882540e8 [mitele] Fix extraction after website redesign (fixes #10824) 2016-11-07 11:13:59 +01:00
Sergey M․ b30e4c2754
release 2016.11.04 2016-11-04 22:07:54 +07:00
Sergey M․ 09ffe34b00
[ChangeLog] Actualize 2016-11-04 21:59:42 +07:00
Sergey M․ cc99a77ac1
[extractor/generic] Add support for ISM manifests 2016-11-02 03:01:13 +07:00
Sergey M․ 8956d6608a
release 2016.11.02 2016-11-02 02:39:36 +07:00
Sergey M․ a18aeee803
[ChangeLog] Actualize 2016-11-02 02:33:17 +07:00
Sergey M․ e70a5e6566
release 2016.10.30 2016-10-30 18:24:49 +07:00
Sergey M․ 3bf55be466
[ChangeLog] Actualize 2016-10-30 18:19:29 +07:00
Yen Chi Hsuan d9ee2e5cf6
[facebook] Remove SWF params so that 1080P are detected
Closes #11073

In the provided link, SWF params give up to 720P, and VideoConfig
gives 1080P for both best and bestvideo. I guess all Facebook videos
supports HTML5 now, so I remove the old detection for SWF params
2016-10-30 18:20:55 +08:00
Yen Chi Hsuan e1a0b3b81c
[imgur] Recognize /r/ URLs (closes #11071) 2016-10-30 17:02:03 +08:00