Where Can My Robot Go?
30 points Easy

Where do robots find what pages are on a website?

Hint:

What does disallow tell a robot?

Flag
Miscellaneous ยท intelagent
26119 solves
Rating 4.56
5
4
3
2
1
Must solve to rate

Discussion

avatar
Patapam2

1 week ago

Reply Share

I enjoyed this one a lot!

0
avatar
Pctopus929w

2 weeks ago

Reply Share

Guys its simple, change the url to ctflear.com/robots.txt 70r3hnanldfspufdsoifnlds.html, change the url to ctflearn.com/(what you copied)

0
avatar
DoctorHorse

3 weeks ago

Reply Share

whatever

0
avatar
themtyhulk

1 month ago

Reply Share

internal server error !!!!!

0
avatar
Jaymet1

1 month ago

Reply Share

not much to go on for the robot go ?

2
avatar
vizjereix

1 month ago

Reply Share

Do not search in this challenge, focus on whole portal!

0
avatar
Kelchan23

2 months ago

Reply Share
Protected
1
avatar
nukotani

3 months ago

Reply Share

should've added "on this website"

0
avatar
jem8000

3 months ago

Reply Share

It was a little confusing

0
avatar
jem8000

3 months ago

Reply Share

It was a little confusing

0