Where Can My Robot Go?
30 points Easy

Where do robots find what pages are on a website?

Hint:

What does disallow tell a robot?

Flag
Rating 4.52
5
4
3
2
1

Discussion

This challenge is great Hint : search for the file which will guide the robo :-) !!!!!

0

fun thanks.

0
Protected
0
Protected
0

Dam.. This takes long to understand. Needed some research :) my favority till now! thx

0
Protected
0

i was looking for some dns and ips for like an hour....

0

Great challenge

0
Protected
0

good challenge

0