Where Can My Robot Go?
30 points Easy

Where do robots find what pages are on a website?

Hint:

What does disallow tell a robot?

Flag
Miscellaneous ยท intelagent
28797 solves
Rating 4.56
5
4
3
2
1
Must solve to rate

Discussion

avatar
ThaiHo

4 weeks ago

Reply Share

I didn't expect I was supposed to visit the actual text file where robots obey rules

0
avatar
F35_king

2 months ago

Reply Share

.

0
avatar
Msvb

4 months ago

Reply Share

def4lt.json

0
avatar
Msvb

4 months ago

Reply Share

def4lt.json

0
avatar
Jay_vixer

5 months ago

Reply Share

howwwwww

0
avatar
Ninjaflowx0

5 months ago

Reply Share

robots.txt?

0
avatar
SatoriSec

6 months ago

Reply Share

Robots are found in the root of a website

0
avatar
ZadeM

7 months ago

Reply Share

well had to think for a min

0
avatar
ZadeM

7 months ago

Reply Share

well had to think for a min

0
avatar
WormBomb

10 months ago

Reply Share

This one is very neat!

0
avatar
addibeats

6 years ago

Reply Share
<h4>Good</h4>
0