Plugins » Katello

Concern stems from a user message on this PR (which should have addressed the bug): https://github.com/Katello/katello/pull/11421

Hi Matt,

In the foreman console, what do you see if you run ::Katello::InstalledPackage.where(nvrea: "openblas-serial64-0.3.15-4.el8.x86_64")?

If there are duplicates still, you can paste the following into the foreman console and run `fix_installed_package_dupes`:

  def fix_installed_package_dupes
    # Remove duplicate installed packages and host installed packages.
    duplicated_nvreas = ::Katello::InstalledPackage.group(:nvrea).having('count(*) > 1').pluck(:nvrea)
    duplicated_nvreas.each do |nvrea|
      packages_relation = ::Katello::InstalledPackage.where(nvrea: nvrea).order(:id)
      original_package = packages_relation.first
      duplicate_package_ids = packages_relation.offset(1).pluck(:id)
      hosts_with_original_package = ::Katello::HostInstalledPackage.where(installed_package_id: original_package.id).pluck(:host_id)
      if hosts_with_original_package.any?
        ::Katello::HostInstalledPackage.where(host_id: hosts_with_original_package, installed_package_id: duplicate_package_ids).delete_all
      end
      ::Katello::HostInstalledPackage.where(installed_package_id: duplicate_package_ids).update_all(installed_package_id: original_package.id)
      ::Katello::InstalledPackage.where(id: duplicate_package_ids).delete_all
    end
  end

Then re-run the InstalledPackage query to check the duplicates again.

This manual verification of the duplicate cleanup removes any complications with the migration not running with the fix for whatever reason.

Matt,

So,

::Katello::InstalledPackage.group(:nvrea).having('count(*) > 1').pluck(:nvrea)

returned

["openblas-threads64-0.3.15-4.el8.x86_64",
 "openblas-openmp64-0.3.15-4.el8.x86_64",
 "openblas-serial64_-0.3.15-4.el8.x86_64",
 "openblas-serial64-0.3.15-4.el8.x86_64",
 "openblas-openmp64_-0.3.15-4.el8.x86_64",
 "openblas-threads64_-0.3.15-4.el8.x86_64"]

but

::Katello::InstalledPackage.where(nvrea: nvrea).order(:id)

returned only

[#<Katello::InstalledPackage:0x00007f87d53f0c28
  id: 18594,
...
  nvrea: "openblas-serial64-0.3.15-4.el8.x86_64",
...]

Something seems off here because that means there actually are not any duplicates with the nvrea "openblas-serial64-0.3.15-4.el8.x86_64".

Regardless, it looks like you did run `fix_installed_package_dupes`, which should have deleted all of the duplicates.

Now that the DB should be fixed, can you run

::Katello::InstalledPackage.where(nvrea: "openblas-serial64-0.3.15-4.el8.x86_64")

to verify that only a single record is returned?

If only a single record is returned, try reindexing the foreman DB to solidify the broken indexes:

sudo -u postgres reindexdb foreman

The same can be run for the pulpcore and candlepin DBs.

After running reindexdb, it turns out my foreman db was riddled with constraint violations (duplicate facts, module streams, etc). I worked through those since there are posts in the community forum about that. But ultimately I had to brute force it and run commands like this to purge those problem packages.

::Katello::InstalledPackage.where(nvrea: "openblas-threads64_-0.3.15-4.el8.x86_64").first.delete

Now I can upgrade and all is well.