Where Can My Robot Go?
30 points Easy

Where do robots find what pages are on a website?

Hint:

What does disallow tell a robot?

Flag
Rating 4.56
5
4
3
2
1

Discussion

should've added "on this website"

0

It was a little confusing

0

It was a little confusing

0

It was a little confusing

0

It was a little confusing

0

It was very easy!

0

tell me about this how it you solve this

0
Protected
0
Protected
0

WHERE THE WEBSITE DAWG

0
Protected
0