Bug #29370
open
Syncing a large product leaves Pulp tasks "waiting".
Added by Ian Ballou over 4 years ago.
Updated about 1 month ago.
Description
I've tried a few times to sync a product with ~200 repositories and it never completes successfully. There are always sync tasks left over that are stuck waiting on "pulp:action:publish". The tasks waiting are a mix of Docker and File repos. I've tried restarting Pulp services but that doesn't help. It seems this could be a Katello bug or a Pulp bug.
Detailed information about the server:
Repositories: 212
> 154 Docker repos with a mix of BusyBox, Alpine, and Bash. These are Docker Hub official images.
> 58 file repos. All except 6 have the upstream url http://quartet.usersys.redhat.com/pub/fake-repos/large_file/. 1 has https://repos.fedorapeople.org/repos/pulp/pulp/fixtures/file-many/ and the other 5 have no upstream url.
CPUs: 8
RAM: 32 GB
Pulp workers: 8
- Category set to Repositories
- Target version set to Katello 3.16.0
- Triaged changed from No to Yes
- Has duplicate Bug #29458: Syncing of repos got stuck in foreman (katello nightly version ) added
Hello,
This issue is blocking us to test the performance of the katello nightly with the puma web server. Is there any work-around for this issue?
Any suggestions/recommendations??
Would you be able to try a couple things:
1. in /etc/foreman/database.yml, change the 'pool' setting from '5' to '30':
production:
adapter: postgresql
database: foreman
username: foreman
password: "SMA42qaA3FFFm2ioiam8RrMJMxpBZ7CB"
pool: 30
2. Create a new file:
/usr/share/foreman/config/initializers/foreman-tasks-db-pool-size.rb
with this one line:
ForemanTasks.dynflow.config.db_pool_size = 30
3. run foreman-maintain service restart
can you see if that helps at all? I have seen some benefit (with ~40 syncs).
There is an installer option --foreman-db-pool which can be used to change the pool size in /etc/foreman/database.yml. If we need to tune the DB pool size as well then we need a proper way to configure this.
- Related to Tracker #28999: Deploy Foreman with Puma as the application server by default added
- Target version changed from Katello 3.16.0 to 1223
- Target version changed from 1223 to Katello 4.0.0
- Target version changed from Katello 4.0.0 to Katello 3.17.0
- Target version changed from Katello 3.17.0 to Katello 3.18.0
- Target version changed from Katello 3.18.0 to Katello Backlog
- Target version deleted (
Katello Backlog)
Also available in: Atom
PDF