Syncing a large product leaves Pulp tasks "waiting".
I've tried a few times to sync a product with ~200 repositories and it never completes successfully. There are always sync tasks left over that are stuck waiting on "pulp:action:publish". The tasks waiting are a mix of Docker and File repos. I've tried restarting Pulp services but that doesn't help. It seems this could be a Katello bug or a Pulp bug.
Detailed information about the server:
-> 154 Docker repos with a mix of BusyBox, Alpine, and Bash. These are Docker Hub official images.
-> 58 file repos. All except 6 have the upstream url http://quartet.usersys.redhat.com/pub/fake-repos/large_file/. 1 has https://repos.fedorapeople.org/repos/pulp/pulp/fixtures/file-many/ and the other 5 have no upstream url.
RAM: 32 GB
Pulp workers: 8
#5 Updated by Justin Sherrill 8 months ago
Would you be able to try a couple things:
1. in /etc/foreman/database.yml, change the 'pool' setting from '5' to '30':
production: adapter: postgresql database: foreman username: foreman password: "SMA42qaA3FFFm2ioiam8RrMJMxpBZ7CB" pool: 30
2. Create a new file:
with this one line:
ForemanTasks.dynflow.config.db_pool_size = 30
3. run foreman-maintain service restart
can you see if that helps at all? I have seen some benefit (with ~40 syncs).