It can take some time

Took me a while

it's rather straightforward, but i still took a couple minutes more than necessary

What does disallow not tell a robot

Nice Challenge!

[REDACTED] This comment is only shown to users who have solved this challenge.

[REDACTED] This comment is only shown to users who have solved this challenge.

nice

It's really simple if you actually read the question. Took literally a minute or two.

The wording is really what throws me off with some of these questions.

hard one : |

robots can find webpages?????

[REDACTED] This comment is only shown to users who have solved this challenge.

[REDACTED] This comment is only shown to users who have solved this challenge.

what file do web crawlers view to index the site

I learned a lot about how webcrawlers work in the course of doing this challenge. It was very much worth it to me. On one of the sites it said "of course if you are a hacker you will want to see which pages are disallowed" which makes sense to me.

[REDACTED] This comment is only shown to users who have solved this challenge.

can any one tell me how to improve my ctf skills

My favourite so far

it was a good one

just think about robots

really man thnx this is really helping me a lot i just research things deeply and boom get some deep knowldege

the answer is a filename or what?

It took me a while to find the hint. The "robot" and the "disallow"

Nice.

Interesting.

Mr robot ;)

gave me a headache

super easy

Ez

Im noobie in CTF etc and that was hard for me, but i learned what robots.txt do. So nice, if anyone have problem good luck :)

I’m a noob and the research for this taught me a great deal. Took me a long time to think outside the box and finally get it. Loved it.

for putting in the flag is it just the answer or is it flag{answer} or something else

kinda hard but ok

Definitely took a while but enjoyed it.

Damn.

Good!

[REDACTED] This comment is only shown to users who have solved this challenge.

Super easy

not easy :)