
AI web crawlers from firms like OpenAI and Meta are overwhelming the internet, consuming up to 30% of traffic and straining servers, especially for small publishers. This sparks an arms race with blocks and circumventions, raising privacy and economic concerns. Without regulation, the open web risks fragmentation and decline.