| BPO | 35457 |
|---|---|
| Nosy | @terryjreedy, @berkerpeksag, @tirkarthi, @andreburgaud |
Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.
Show more detailsGitHub fields:
assignee = None closed_at = None created_at = <Date 2018-12-11.09:30:47.872> labels = ['3.8', 'type-feature', 'library'] title = 'robotparser reads empty robots.txt file as "all denied"' updated_at = <Date 2020-01-02.15:45:55.440> user = 'https://bugs.python.org/larsfuse'
bugs.python.org fields:
activity = <Date 2020-01-02.15:45:55.440> actor = 'gallicrooster' assignee = 'none' closed = False closed_date = None closer = None components = ['Library (Lib)'] creation = <Date 2018-12-11.09:30:47.872> creator = 'larsfuse' dependencies = [] files = [] hgrepos = [] issue_num = 35457 keywords = [] message_count = 6.0 messages = ['331595', '331870', '331963', '359180', '359185', '359202'] nosy_count = 5.0 nosy_names = ['terry.reedy', 'berker.peksag', 'xtreak', 'larsfuse', 'gallicrooster'] pr_nums = [] priority = 'normal' resolution = None stage = 'test needed' status = 'open' superseder = None type = 'enhancement' url = 'https://bugs.python.org/issue35457' versions = ['Python 3.8']
Linked PRs
- gh-79638: Treat an unreachable robots.txt as "disallow all" #138555
- [3.14] gh-79638: Treat an unreachable robots.txt as "disallow all" (GH-138555) #149512
- [3.13] gh-79638: Treat an unreachable robots.txt as "disallow all" (GH-138555) #149513
- gh-79638: Treat an unreachable robots.txt as "disallow all" (GH-138555) #149541
- gh-79638: Test other HTTP error codes besides 403 in test_robotparser #149569
- [3.15] gh-79638: Test other HTTP error codes besides 403 in test_robotparser (GH-149569) #149580
- [3.14] gh-79638: Test other HTTP error codes besides 403 in test_robotparser (GH-149569) #149581
- [3.13] gh-79638: Test other HTTP error codes besides 403 in test_robotparser (GH-149569) #149582
- gh-79638: Restore "Treat an unreachable robots.txt as disallow all" #152525
- [3.15] gh-79638: Restore "Treat an unreachable robots.txt as disallow all" (GH-152525) #153107
- [3.14] gh-79638: Restore "Treat an unreachable robots.txt as disallow all" (GH-152525) #153108
- [3.13] gh-79638: Restore "Treat an unreachable robots.txt as disallow all" (GH-152525) #153109