TIME Serves AI Crawlers a Separate Markdown Site With Ads
Software developer Vincent Schmalbach found that TIME delivers a simplified Markdown version of its site to some AI crawlers, including ClaudeBot and PerplexityBot, while human browsers get the full HTML page. The AI version includes ads from Mobian and sponsor content that do not appear on the human-facing site.