Why “Crawler” is being discussed
The most recent Hacker News stories and comments contributing to this topic's mentions.
Location: Istanbul, Turkey (company registered in the UK) Remote: Yes Willing to relocate: No Technologies: Web accessibility (WCAG 2.2, EN 301 549 / European Accessibility…
by bzcomak · Oct 1, 2026
Many sites deliberately whitelist Google IP's for their search crawler and ignore crawlers who just uses the Http UserAgent of GoogleBot.
by NicoJuicy · Oct 1, 2026
I'm also reading the first dungeon crawler carl series. You might really like the bobiverse, just got another book as well! Before that I read "a short stay in hell", super good…
by RamblingCTO · Oct 1, 2026
Dungeon Crawler Carl is stupid in the best of ways. It doesn't take itself seriously until it does and those parts work as well as all the zany shit.
by tstrimple · Oct 1, 2026
I've also been enjoying Dungeon Crawler Carl like many here. To scratch my neuroscience itch, I recently read: Rethinking Consciousness: A Scientific Theory of Subjective Experi…
by ckrailo · Sep 30, 2026
I just finished book 7 of Dungeon Crawler Carl, as well as Enshittification, myself! Funny. I'm now working my way through "I Am Not A Robot: My Year Using AI To Do (Almost) Eve…
by xd1936 · Sep 30, 2026
Interest
Proportion of Hacker News items mentioning "crawler" over time.
Mentions
Total number of Hacker News items mentioning "crawler" over time.
Crawler may refer to: Read more on Wikipedia