Miss Islington (bot) 58a1a76bae bpo-35922: Fix RobotFileParser when robots.txt has no relevant crawl delay or request rate (GH-11791) ...

Co-Authored-By: Tal Einat <taleinat+github@gmail.com>
(cherry picked from commit 8047e0e1c6)

Co-authored-by: Rémi Lapeyre <remi.lapeyre@henki.fr>

2019-06-16 00:07:54 -07:00

..

__init__.py

…

error.py

bpo-30022: Get rid of using EnvironmentError and IOError (except test… (#1051)

2017-04-16 10:46:38 +03:00

parse.py

bpo-36742: Corrects fix to handle decomposition in usernames (#13812)

2019-06-04 17:55:29 +02:00

request.py

bpo-35397: Remove deprecation and document urllib.parse.unwrap (GH-11481)

2019-05-27 09:43:45 -04:00

response.py

…

robotparser.py

bpo-35922: Fix RobotFileParser when robots.txt has no relevant crawl delay or request rate (GH-11791)

2019-06-16 00:07:54 -07:00