AI companies hunting for training data are unleashing data-scraping bot swarms on academic libraries, slowing or crashing sites meant for students, researchers and the public. One school reported being hit by more than 11,000 searches on Finnish music in a single day.
Web Scraping
数据抓取
Automated extraction of data from web pages by software programs
Curated Intelligence
Meta revised its commercial terms of service to remove the word "train" and limit data usage to advertising and business products following public backlash. Despite this change, legal experts warn that the new terms still grant Meta broad rights to scrape associated websites, potentially overriding robots.txt protocols, raising ongoing concerns about data sovereignty and copyright compliance.
Meta quietly amended its commercial terms to remove language interpreted by legal experts as granting permission to scrape news sites for AI training, following significant backlash. While the company maintains that these updates do not supersede existing robots.txt preferences, the move signals a retreat from aggressive data acquisition tactics.
Meta's new commercial terms, effective October 30, grant the company permission to crawl and scrape content from websites 'associated' with business accounts on its platforms, including news publishers. Legal experts argue this allows Meta to bypass licensing agreements and use this external data to train its AI models, posing a significant challenge to copyright protections for content creators.
A US federal judge dismissed antitrust lawsuits filed by Chegg and Penske Media against Google's AI Overviews, ruling that the conduct is not illegal. The court determined that search engines providing summaries and reducing traffic are operating normally rather than engaging in unlawful agreements or monopolistic behavior. This verdict offers a preliminary legal resolution to publishers' concerns about AI-driven traffic erosion.