Fixes #18554 - skip collection_cache_lookup on authorized_for

The call to `authorized_for` can take multiple seconds in some cases,
leading to performance issues.

This patch will bypass the cache lookup, resulting in similar times for
admins and non-admins when viewing pages with lots of hosts.