/api should be added to robots.txt
Bug #582977 reported by
Francis J. Lacoste
This bug affects 1 person
| Affects | Status | Importance | Assigned to | Milestone | |
|---|---|---|---|---|---|
| Launchpad itself |
Fix Released
|
High
|
Karl Fogel | ||
Bug Description
As seen in OOPS-1597E304 and OOPS-1597C1300 we have googlebot making random requests to the API through the URL space used for AJAX requests.
We deny all requests to /api through the robots.txt file so that these spurious requests (making failures in many case) are solved.
Related branches
lp:~kfogel/launchpad/582977-api-in-robots.txt
- Francis J. Lacoste (community): Approve (code release-critical)
-
Diff: 10 lines (+1/-1)1 file modifiedlib/canonical/launchpad/templates/robotstxt.pt (+1/-1)
| tags: | added: api |
| Changed in launchpad-foundations: | |
| status: | New → In Progress |
| importance: | Undecided → High |
| assignee: | nobody → Karl Fogel (kfogel) |
Revision history for this message
| Karl Fogel (kfogel) wrote | #1 |
| Changed in launchpad-foundations: | |
| status: | In Progress → Fix Released |
Revision history for this message
| Ursula Junque (ursinha) wrote Bug fixed by a commit | #2 |
| Changed in launchpad-foundations: | |
| milestone: | none → 10.05 |
| tags: | added: qa-needstesting |
| tags: |
added: qa-ok removed: qa-needstesting |
To post a comment you must log in.
Done as per RT 39388 (visited https:/
Removing the long-unused template file from the tree is a separate issue; I'm reusing the branch made for this bug to do that. See (internal link, sorry) the thread starting here for details: https:/