Where do robots find what pages are on a website?
Hint:
What does disallow tell a robot?
2 weeks ago
should've added "on this website"
3 weeks ago
It was a little confusing
1 month ago
It was very easy!
3 days ago
tell me about this how it you solve this
WHERE THE WEBSITE DAWG
3 years ago
Great job, but I kinda wish ppl respected newcomers in the comments tho (if u DO NOT want spoilers DON'T READ THE COMMENTS)
8 months ago
4 years ago
Me noob said: reCaptcha xD
2 years ago
wkwkwkw same
Nice and tricky one, just like my ex!
1 year ago
If you don't know what a 'robots.txt' is, you should look it up.
2 weeks ago
should've added "on this website"