Where Can My Robot Go?
30 points Easy

Where do robots find what pages are on a website?

Hint:

What does disallow tell a robot?

Flag
Rating 4.49
5
4
3
2
1

Discussion

bro it was so easy

0
0
Protected
0

I didn't know where robots go, now i know, usefull challenge, thanks

0

if you know, you know lol... or google otherwise

1

It's so obvious XD

-1

a nice combo of google and your brain lol

0
Protected
1

gxnome

0

I made this much harder for myself than it actually is.

0

using robots.txt

0