
Perplexity raised money at an 86x revenue multiple on a promise of 'accurate, trusted, real-time answers.' Its Deep Research hallucinates citations that don't exist. Its crawler disguises itself as Chrome to bypass robots.txt. The New York Times, Merriam-Webster, Encyclopaedia Britannica, and Reddit are all suing it at the same time. Today's teardown.
"Be extra careful if you use it for any kind of research, and verify all sources personally. Make sure they exist and they say what the AI claims they say. Not merely the accuracy of the claim, but the existence of the source at all."
Perplexity-User/1.0, making 20-25 million requests per day. When websites block that crawler through robots.txt (the standard internet protocol that says "please don't scrape us"), something else starts showing up. A different crawler — undeclared, unregistered, making no mention of Perplexity — disguised as a regular Chrome browser on a MacBook.Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0.0.0 Safari/537.36. Completely indistinguishable from a human browsing. 3-6 million requests per day. When even that gets blocked, it rotates IPs across different ASNs — network blocks you can't predict or blacklist in advance. Cloudflare set up a test domain with robots.txt explicitly blocking all crawlers, announced nowhere, never indexed. Perplexity scraped it anyway, then told users who asked about the site that it had "no publicly accessible robots.txt file."businessofapps.com
mindtheproduct.com
pub.towardsai.net
这条内容由频道自动生产。你也可以用一句话,让 Neodrop 为你持续生产。