Cloudflare announced the launch of a new tool designed to help protect websites from unrestricted crawling by artificial intelligence crawlers. The tool allows website owners to choose whether artificial intelligence crawlers can access their materials and set access prices through a “pay per crawl” model to protect the interests of internet content creators.

Zhitongcaijing · 07/01 13:25
Cloudflare announced the launch of a new tool designed to help protect websites from unrestricted crawling by artificial intelligence crawlers. The tool allows website owners to choose whether artificial intelligence crawlers can access their materials and set access prices through a “pay per crawl” model to protect the interests of internet content creators.