Easy Live

Where Can My Robot Go?

30 points

7383 Solves

Miscellaneous

Easy

intelagent moderator badge ctflearn++ badge

Community Rating: 4.47 / 5

Where do robots find what pages are on a website?

Hint:

What does disallow tell a robot?

First 10 Solvers


    • Raihan

      no time it's so easy for me

  • g33k4y

    it's rather straightforward, but i still took a couple minutes more than necessary

  • Kur0

    What does disallow not tell a robot

  • Theriphunters

    Protected

    [REDACTED] This comment is only shown to users who have solved this challenge.

  • EinfachEinAlex

    Protected

    [REDACTED] This comment is only shown to users who have solved this challenge.

    • intelagent moderator badge ctflearn++ badge

      Protected

      [REDACTED] This comment is only shown to users who have solved this challenge.

    • v544

      so try the robots.text for ctflearn:)

  • m87donis

    It's really simple if you actually read the question. Took literally a minute or two.

  • roylt84

    The wording is really what throws me off with some of these questions.

  • sharkmagic07

    Protected

    [REDACTED] This comment is only shown to users who have solved this challenge.

  • Lolization

    Protected

    [REDACTED] This comment is only shown to users who have solved this challenge.

    • intelagent moderator badge ctflearn++ badge

      Protected

      [REDACTED] This comment is only shown to users who have solved this challenge.

  • v544

    what file do web crawlers view to index the site

  • v544

    I learned a lot about how webcrawlers work in the course of doing this challenge. It was very much worth it to me. On one of the sites it said "of course if you are a hacker you will want to see which pages are disallowed" which makes sense to me.

  • ibrahimvarol0

    Protected

    [REDACTED] This comment is only shown to users who have solved this challenge.

  • Raavan

    can any one tell me how to improve my ctf skills

  • Lone_wolf

    really man thnx this is really helping me a lot i just research things deeply and boom get some deep knowldege

  • c0conut

    It took me a while to find the hint. The "robot" and the "disallow"

  • wojtek9022

    Im noobie in CTF etc and that was hard for me, but i learned what robots.txt do. So nice, if anyone have problem good luck :)

  • cardynlsyn ctflearn++ badge

    Iā€™m a noob and the research for this taught me a great deal. Took me a long time to think outside the box and finally get it. Loved it.

  • SMALZ

    for putting in the flag is it just the answer or is it flag{answer} or something else

  • vincent_wu

    Protected

    [REDACTED] This comment is only shown to users who have solved this challenge.

  • SIVASANTHOSH

    its better toprovide solutions after end and better to keep a option like give up and show answer

  • Blackmaster

    Protected

    [REDACTED] This comment is only shown to users who have solved this challenge.

  • Flower

    That was nice. Enjoyed it. Learn about google robots.txt and stuff if you are stucked.

  • I may be dumb, I don't know, but I really am struggling with this. I am new to hacking in general, yet I understand this really isn't that hard. I've been struggling for like an hour so can anyone please help me.

  • dhist

    First time I heard about robots, I am noobie and it can be hard, but I loved it!

  • Xavii

    thanks for hints in comments

  • Lethal_Presence

    Really good task for all the newbies. It took me much time and I rad all the comments below and it helped me a lot.

  • thelink

    Man, this challenge was <strong>SUPER COOL</strong>, fantastic... thanks for the comments an thanks to google shared knowledge, i learned a lot.

  • _Z3R0_

    I actually got it. I'm getting better at this. šŸ˜‚šŸ˜‚

  • pinger

    Very easy one, answer to the question is the place for clue.

  • ImYawn

    Hint for people who are stuck: You need to find a file

  • judith

    Don't overthink it. It's straightforward

  • John_Noob5

    hi, i have a question why flag incorrect even tho i'm in robots.txt.. i'm still confused.. sorry i'm new

  • sx313

    <strong>Skynet</strong> is ~~active~~

  • pizzamonkey00

    Gotta say, this is more of a puzzle than some of the others but it's creative enough that I have to give it credit.

  • kr43mr

    this was fun for a beginner like me

  • kr43mr

    this was fun for a beginner like me

  • 5punnr1ng

    <img src="https://i.kym-cdn.com/entries/icons/facebook/000/021/807/ig9OoyenpxqdCQyABmOQBZDI0duHk2QZZmWg2Hxd4ro.jpg" onmouseover="console.log(123)"></img>

  • magpy

    I cant get this flag to work, is there a certain format i need to use?

  • matg8

    Protected

    [REDACTED] This comment is only shown to users who have solved this challenge.

  • Aster

    <img src="" onerror=alert()>

    • TedZak

      What are you trying to do here?

  • RLangdon

    Not so intuitive but a great question to think out of the box.

  • ForynX

    YO DUDE

    <ul> <li>That</li> <li>Was</li> <li>Awesome!</li> </ul>

  • joelczk

    Nice one! The wording threw me off guard really

  • joelczk

    Nice one! The wording threw me off guard really

  • werkzeug

    Silly but nice challenge had me confused a bit

  • UfaiX04

    really easy but i now understand why i needed to "think out of the box", still i learnt how robots work and enjoyed this

  • TedZak

    Protected

    [REDACTED] This comment is only shown to users who have solved this challenge.

  • brvndxn

    Keep going if you think you are on the right track

  • abibabis

    Protected

    [REDACTED] This comment is only shown to users who have solved this challenge.

  • Lualt

    It wasn't this hard because i know alot about web things if you cannot find it search "how to keep web crawlers out"

  • marco_py

    Very easy if the first line "Where do robots find what pages are on a website?" clicks for you. If not, you have to do some research on exclusion standards

  • kojirowave

    is the answer not robots.txt cause im sure it it but its not working for me

  • Stevejob

    Excellent! It can get experiences for me.

  • mimes74

    Another him go to ctflearn.com/robots take a look it the html turn it into another url

  • mimes74

    Another him go to ctflearn.com/robots take a look it the html turn it into another url

  • rianbowdash

    Protected

    [REDACTED] This comment is only shown to users who have solved this challenge.