The challenge of responsible web crawling and scraping in the AI era
•
The Green Web Foundation
•
par Tim Cowlishaw
When considering the environmental impacts of AI, we shouldn’t just pay attention to model training and inference, but also pay attention to the way in which scraping and crawling by AI bots place stress on broader internet infrastructure. Tim explains how these new behaviours have an impact on carbon emissions, as well as on our…
The post The challenge of responsible web crawling and scraping in the AI era appeared first on Green Web Foundation.