Fixes #23842 - Load factory_bot only when needed

By moving the factory_bot loading to when it's only needed we make it a
soft dependency. Production installs typically don't have factory_bot
installed which breaks rake tasks.