AI's "Ask Forgiveness Not Permission" Bugbear Hits the Courts Again
The New York Times has escalated its legal battle against Perplexity AI, filing a copyright infringement lawsuit in New York federal court on Friday. The suit alleges the AI "answer engine" produces responses that are "verbatim or substantially similar copies" of NYT content, generating revenue whilst deliberately bypassing technical protections like robots.txt files that websites use to control crawler access.
This follows similar action from the Chicago Tribune on Thursday, and comes after repeated cease-and-desist notices to Perplexity throughout 2024. The AI startup's defence? Comparing itself to radio and television, claiming "publishers have been suing new tech companies for a hundred years" and "fortunately it's never worked."
Perplexity found itself facing multiple lawsuits after Forbes and Wired exposed the startup's practice of bypassing website paywalls to generate AI summaries—and occasionally verbatim copies—of protected content. The NYT's lawsuit makes identical claims, alleging Perplexity's crawlers "have intentionally ignored or evaded technical content protection measures," including robots.txt files that explicitly indicate which parts of a website should remain off-limits to automated scrapers.
AI search startup Perplexity has been actively disguising its web crawlers to bypass website access restrictions, according to Cloudflare's technical analysis. When Perplexity's bots encounter blocks, Cloudflare alleges the company masks their identity “in an attempt to circumvent the website's preferences”, essentially sneaking through the back door after being told to use the front entrance doesn't grant access.
We want your views:
- Is Perplexity's comparison to radio and television intellectually honest? Those mediums did not reproduce verbatim content acquired without permission?
- If robots.txt files (the technical "no entry" signs of the web) carry no legal weight, what's left of website owners' ability to control their own content?
- Should AI companies that actively disguise their crawlers to bypass access restrictions face different legal consequences than those who simply ignore robots.txt?
- Where's the line between "learning from publicly available content" and "commercial exploitation of paywalled professional work"?
- Is Perplexity's revenue-sharing programme, launched after Forbes and Wired exposed the scraping, genuine collaboration or damage control by press release?




