#COMPSCI from: [[OverTheWire]] key concepts: [[robots.txt]] [[web file structure]], [[web crawlers]]
Solution
"not even google will be able to find this one" I guess you are supposed to go and learn how search engines work after reading this. Guess I will make it more of a habit to search every little thing (like i did with [[bandit32]], which was a lot of fun).
DO NOT ASSUME IT IS "BASIC" AND THAT I AM EXPECTED TO KNOW!!!!
ok, now for the actual solution, the "not even google will be able to find this one" references the fact that the robots.txt file has a disallow