robots.txt and a cool HN thread


## the hn thread
- https://news.ycombinator.com/item?id=30299731

### cool urls i found in comments
- https://www.nike.com/robots.txt
- https://www.youtube.com/robots.txt
- https://www.cloudflare.com/robots.txt
- https://www.last.fm/robots.txt
- https://www.bloomberg.com/robots.txt
- https://meta.wikimedia.org/robots.txt

---

lolol, [my](https://trevcan.duckdns.org/robots.txt) robots.txt is merely 2 lines!

And I don't disallow anything. Some of these are pretty creative, I should add
some ascii art myself.