Where do robots find what pages are on a website?
Hint:
What does disallow tell a robot?
1 week ago
clue: robot.txt
That is a good challenge
4 weeks ago
Wow it’s nice
1 month ago
Smart for Starters.
thats really smart , i like it , but still ... its not "easy" for many ppl .
i answered "robots.txt" but it is not correct, why?
write it in the link
2 months ago
robots.txt
2 years ago
2 weeks ago
3 years ago
Great job, but I kinda wish ppl respected newcomers in the comments tho (if u DO NOT want spoilers DON'T READ THE COMMENTS)
Me noob said: reCaptcha xD
1 year ago
wkwkwkw same
Nice and tricky one, just like my ex!
If you don't know what a 'robots.txt' is, you should look it up.
1 week ago