How to Use Robots.txt to Hide Your Embarrassing Internet Exploits

Completely deleting something from the internet is like corralling drunk, feral geese after setting them loose: Damn near impossible. But there are ways to conceal the web content you don’t want anyone to lay eyes on. You can hide all sorts of webpages with what’s essentially a “Keep Out” sign for search engines: a special file called robots.txt.

Read more…



No Responses to “How to Use Robots.txt to Hide Your Embarrassing Internet Exploits”

Post a Comment