Could they collaborate with the website's creators that have websites behind cloudfare to allow their content to be accessed via an API in exchange of a compensation?.
This could be a way to compensate creators and AI companies be able to access content that's unreachable as it's protected by cloudfare