While looking at https://projects.theforeman.org/issues/38086, realized the query will be much faster with an index to the lookup based on audited resource and action.