bpo-21475: Support the Sitemap extension in robotparser#6883

Merged

ned-deily merged 13 commits into

python:masterfrom

mcscope:robotparser_site_maps

May 16, 2018

Commits on May 15, 2018

Replicate original patch by pwirtz, bumping version number
mcscope
committed
8a71766
Copy full SHA for 8a71766
Add unit test to test that robot parser correctly parses sitemaps
mcscope
committed
834367e
Copy full SHA for 834367e
add news
mcscope
committed
72b53af
Copy full SHA for 72b53af

Commits on May 16, 2018

CR from Mariatta
mcscope
committed
4be2015
Copy full SHA for 4be2015
Add to Ack
mcscope
committed
44114b3
Copy full SHA for 44114b3
Spacing
mcscope
committed
ee76a11
Copy full SHA for ee76a11
Update News entry file, limit to 80 chars.
Mariatta
authored
7129e9b
Copy full SHA for 7129e9b
code review by berkerpeksag
mcscope
committed
35442c5
Copy full SHA for 35442c5
Merge branch 'robotparser_site_maps' of github.com:mcscope/cpython into robotparser_site_maps
Show description for 9b83c93
mcscope
committed
9b83c93
Copy full SHA for 9b83c93
I think this will become 80 characters
mcscope
committed
1791c4e
Copy full SHA for 1791c4e
This is more obviously 80 characters
mcscope
committed
97d8491
Copy full SHA for 97d8491
Update 2018-05-15-15-03-48.bpo-28612.E9dz39.rst
berkerpeksag
authored
3e2aa65
Copy full SHA for 3e2aa65
Update test_robotparser.py
berkerpeksag
authored
3e38354
Copy full SHA for 3e38354