I didn't expect I was supposed to visit the actual text file where robots obey rules

yep, not obvious, I need to look to comments to figure out that the file robot.txt exists the task description is not good in my opinion

.

def4lt.json

def4lt.json

howwwwww

robots.txt?

Robots are found in the root of a website

well had to think for a min

well had to think for a min

Great job, but I kinda wish ppl respected newcomers in the comments tho (if u DO NOT want spoilers DON'T READ THE COMMENTS)

Nice and tricky one, just like my ex!

Me noob said: reCaptcha xD

wkwkwkw same

If you don't know what a 'robots.txt' is, you should look it up.