>> People created AbstractFactoryFactoryBuilders not because they wanted to,

I don't think this is accurate. people created factories like this because they were limited by interface bounds in the languages they were coding in and had to swap out behaviour at run or compile time for testing or configuration purposes.