Publishers can add a Google Extended crawler to their site’s documentation to notify Google that their content should not be used for these two APIs. The move comes in response to demands from publishers for more control over how their content is used in emerging generative AI applications.
According to Google’s vice president of trust, Daniel Romain, this move is critical to ensuring the transparency and control that all AI model providers must offer.
Generative AI chatbots are increasingly being integrated into search results, raising concerns among publishers about how their content is being used by platforms like Bard and Bing AI. The new opt-out option will be available for next-generation models from Bard and Vertex AI.
I am a professional journalist and content creator with extensive experience writing for news websites. I currently work as an author at Gadget Onus, where I specialize in covering hot news topics. My written pieces have been published on some of the biggest media outlets around the world, including The Guardian and BBC News.