Where Can My Robot Go?
30 points Easy

Where do robots find what pages are on a website?

Hint:

What does disallow tell a robot?

Flag
Miscellaneous ยท intelagent
25857 solves
Rating 4.56
5
4
3
2
1
Must solve to rate

Discussion

avatar
themtyhulk

4 days ago

Reply Share

internal server error !!!!!

0
avatar
Jaymet1

2 weeks ago

Reply Share

not much to go on for the robot go ?

2
avatar
vizjereix

3 weeks ago

Reply Share

Do not search in this challenge, focus on whole portal!

0
avatar
Kelchan23

1 month ago

Reply Share
Protected
1
avatar
nukotani

1 month ago

Reply Share

should've added "on this website"

0
avatar
jem8000

2 months ago

Reply Share

It was a little confusing

0
avatar
jem8000

2 months ago

Reply Share

It was a little confusing

0
avatar
jem8000

2 months ago

Reply Share

It was a little confusing

0
avatar
jem8000

2 months ago

Reply Share

It was a little confusing

0
avatar
mb_ch_st_51

2 months ago

Reply Share

It was very easy!

0
avatar
theclaay

1 month ago

Reply Share

tell me about this how it you solve this

0
avatar
theclaay

1 month ago

Reply Share
Protected
0
avatar
rianbowdash

4 years ago

Reply Share
Protected
0
avatar
Carter365

3 years ago

Reply Share

where did you find robots.txt i dont understand

0
avatar
denzven

3 years ago

Reply Share
Protected
0