Miss Islington (bot)
c3fa1f2b93
[3.7] bpo-32861: urllib.robotparser fix incomplete __str__ methods. (GH-5711) (GH-6795)
...
The urllib.robotparser's __str__ representation now includes wildcard
entries and the "Crawl-delay" and "Request-rate" fields.
(cherry picked from commit bd08a0af2d )
Co-authored-by: Michael Lazar <lazar.michael22@gmail.com >
2018-05-14 21:14:30 +03:00
Miss Islington (bot)
f8a3485dcd
Revert unneccessary changes made in bpo-30296 and apply other improvements. (GH-2624)
...
(cherry picked from commit 3f2e6f15d6 )
Co-authored-by: Serhiy Storchaka <storchaka@gmail.com >
2018-02-26 08:22:24 -08:00
INADA Naoki
579e0b80b9
urllib.request: Remove unused import (GH-5268)
2018-01-22 16:45:31 +09:00
Коренберг Марк
fbd605151f
bpo-32323: urllib.parse.urlsplit() must not lowercase() IPv6 scope value ( #4867 )
2017-12-21 14:16:17 +02:00
Berker Peksag
3df02dbc8e
bpo-31325: Fix usage of namedtuple in RobotFileParser.parse() ( #4529 )
2017-11-23 15:40:26 -08:00
Oren Milman
8df44ee8e0
remove a redundant lower in urllib.parse.urlsplit ( #3008 )
2017-09-02 21:51:39 -07:00
postmasters
90e01e50ef
urllib: Simplify splithost by calling into urlparse. ( #1849 )
...
The current regex based splitting produces a wrong result. For example::
http://abc#@def
Web browsers parse that URL as ``http://abc/#@def ``, that is, the host
is ``abc``, the path is ``/``, and the fragment is ``#@def``.
2017-06-20 15:02:44 +02:00
Jon Dufresne
3972628de3
bpo-30296 Remove unnecessary tuples, lists, sets, and dicts ( #1489 )
...
* Replaced list(<generator expression>) with list comprehension
* Replaced dict(<generator expression>) with dict comprehension
* Replaced set(<list literal>) with set literal
* Replaced builtin func(<list comprehension>) with func(<generator
expression>) when supported (e.g. any(), all(), tuple(), min(), &
max())
2017-05-18 07:35:54 -07:00
Senthil Kumaran
906f5330b9
bpo-29976: urllib.parse clarify '' in scheme values. (GH-984)
2017-05-17 21:48:59 -07:00
Serhiy Storchaka
55fe1ae970
bpo-30022: Get rid of using EnvironmentError and IOError (except test… ( #1051 )
2017-04-16 10:46:38 +03:00
Senthil Kumaran
6fab78e902
Remove superfluous comment in urllib.error. ( #1076 )
2017-04-10 21:08:35 -07:00
Senthil Kumaran
6dfcc81f6b
Remove OSError related comment in urllib.request. ( #1070 )
2017-04-09 19:49:34 -07:00
Senthil Kumaran
a2a9ddd923
Remove invalid comment in urllib.request. ( #1054 )
2017-04-08 23:27:25 -07:00
Senthil Kumaran
257b980b31
correct parse_qs and parse_qsl test case descriptions. ( #968 )
...
* correct parse_qs and parse_qsl test case descriptions.
2017-04-04 21:19:43 -07:00
Ratnadeep Debnath
21024f0662
bpo-16285: Update urllib quoting to RFC 3986 ( #173 )
...
* bpo-16285: Update urllib quoting to RFC 3986
urllib.parse.quote is now based on RFC 3986, and hence
includes `'~'` in the set of characters that is not escaped
by default.
Patch by Christian Theune and Ratnadeep Debnath.
2017-02-25 19:00:28 +10:00
Xiang Zhang
04c15d5bdc
Issue #29142 : Merge 3.6.
2017-01-09 11:52:10 +08:00
Xiang Zhang
c44d58a77a
Issue #29142 : Merge 3.5.
2017-01-09 11:50:02 +08:00
Xiang Zhang
959ff7f1c6
Issue #29142 : Fix suffixes in no_proxy handling in urllib.
...
In urllib.request, suffixes in no_proxy environment variable with
leading dots could match related hostnames again (e.g. .b.c matches a.b.c).
Patch by Milan Oberkirch.
2017-01-09 11:47:55 +08:00
Serhiy Storchaka
8cbd3df3ce
Issue #28992 : Use bytes.fromhex().
2016-12-21 12:59:28 +02:00
Serhiy Storchaka
70d28a184c
Remove unused imports.
2016-12-16 20:00:15 +02:00
Berker Peksag
9a7bbb2e3f
Issue #25400 : RobotFileParser now correctly returns default values for crawl_delay and request_rate
...
Initial patch by Peter Wirtz.
2016-09-18 20:17:58 +03:00
Berker Peksag
f8479eeb34
Issue #25895 : Merge from 3.5
2016-09-16 14:45:15 +03:00
Berker Peksag
f676748a05
Issue #25895 : Enable WebSocket URL schemes in urllib.parse.urljoin
...
Patch by Gergely Imreh and Markus Holtermann.
2016-09-16 14:43:58 +03:00
Christian Heimes
d04863771b
Issue #28022 : Deprecate ssl-related arguments in favor of SSLContext.
...
The deprecation include manual creation of SSLSocket and certfile/keyfile
(or similar) in ftplib, httplib, imaplib, smtplib, poplib and urllib.
ssl.wrap_socket() is not marked as deprecated yet.
2016-09-10 23:23:33 +02:00
Raymond Hettinger
b7f3c944d1
Merge
2016-09-09 16:44:53 -07:00