Probably to throttle scraping from AI competitors, and have them pay for the privilege as many other services have been doing