Plugins » Katello

Question to myself -- can this just be fixed with a sync and reindex? The reindex should be destroying the old records.

Potential solution: update content view publishing to catch the missing units error and tell the user what repositories need a complete sync. Also ensure that indexing deletes units that no longer exist in Pulp. Perhaps this is only an issue with some units, like modulemds? It's possible that there was an indexing bug from the past that is now fixed. Each content type that is filterable should be checked.

It looks like this may be a bug where, if a module stream changes pulp_href, the new one will be pulled in, but the old one will not be destroyed. As alluded to in my previous message, the old one stays connected to the content view filters and causes the error. We need to make sure that the existing module streams get updated so filters aren't broken.

One question that needs to be answered is if Pulp changes module streams when they get updates outside of the NSVCA. If yes, then we need to "properly" handle this issue by either updating the existing module streams at index time (which will slow down indexing) or by deleting the old module stream and updating the filters with the new one (which will also slow down indexing but likely less).

If Pulp doesn't expect module streams to be replaced with new ones outside of NSVCA changes, then the disappearing units are probably quite rare and we can simply warn the user appropriately to perform a complete resync and report which filters may need fixing.

After some testing, the only way I could see module streams "disappearing" would be if they were removed from a repository entirely. In that case, if the module stream is in a CV filter, it continues being there rather than getting removed. So, we should ensure that filters (by record ID) get updated when content is removed.