Easy Live

Where Can My Robot Go?

30 points

5434 Solves

Miscellaneous

Easy

intelagent moderator badge ctflearn++ badge

Community Rating: 4.43 / 5

Where do robots find what pages are on a website?

Hint:

What does disallow tell a robot?

First 10 Solvers


  • g33k4y

    it's rather straightforward, but i still took a couple minutes more than necessary

  • Kur0

    What does disallow not tell a robot

  • Theriphunters

    Protected

    [REDACTED] This comment is only shown to users who have solved this challenge.

  • EinfachEinAlex

    Protected

    [REDACTED] This comment is only shown to users who have solved this challenge.

    • intelagent moderator badge ctflearn++ badge

      Protected

      [REDACTED] This comment is only shown to users who have solved this challenge.

    • v544

      so try the robots.text for ctflearn:)

  • m87donis

    It's really simple if you actually read the question. Took literally a minute or two.

  • roylt84

    The wording is really what throws me off with some of these questions.

  • sharkmagic07

    Protected

    [REDACTED] This comment is only shown to users who have solved this challenge.

  • Lolization

    Protected

    [REDACTED] This comment is only shown to users who have solved this challenge.

    • intelagent moderator badge ctflearn++ badge

      Protected

      [REDACTED] This comment is only shown to users who have solved this challenge.

  • v544

    what file do web crawlers view to index the site

  • v544

    I learned a lot about how webcrawlers work in the course of doing this challenge. It was very much worth it to me. On one of the sites it said "of course if you are a hacker you will want to see which pages are disallowed" which makes sense to me.

  • ibrahimvarol0

    Protected

    [REDACTED] This comment is only shown to users who have solved this challenge.

  • Raavan

    can any one tell me how to improve my ctf skills

  • Lone_wolf

    really man thnx this is really helping me a lot i just research things deeply and boom get some deep knowldege

  • c0conut

    It took me a while to find the hint. The "robot" and the "disallow"

  • wojtek9022

    Im noobie in CTF etc and that was hard for me, but i learned what robots.txt do. So nice, if anyone have problem good luck :)

  • cardynlsyn ctflearn++ badge

    I’m a noob and the research for this taught me a great deal. Took me a long time to think outside the box and finally get it. Loved it.

  • SMALZ

    for putting in the flag is it just the answer or is it flag{answer} or something else

  • vincent_wu

    Protected

    [REDACTED] This comment is only shown to users who have solved this challenge.