Plugins » Katello

Content promotion seems to throw errors after about >24 hours of uptime for the katello services. This has happened repeatedly for promotion after Library to the next step of the lifecycle environment "TST" but not for the promotion to Library. I have the latest 3.0 packages installed and latest pulp db upgrades performed as of packages available on 6-14-2016.

2016-06-15 13:45:51 [foreman-tasks/dynflow] [W] Error on on_execution_plan_save event | RuntimeError: The Dynflow world was not initialized yet. If your plugin uses it, make sure to call ForemanTasks.dynflow.require! in some initializer | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.7.17/lib/foreman_tasks/dynflow.rb:73:in `world' | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.7.17/app/models/foreman_tasks/task/dynflow_task.rb:48:in `execution_plan' | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.7.17/app/models/foreman_tasks/task/dynflow_task.rb:82:in `main_action' | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.7.17/app/models/foreman_tasks/task/dynflow_task.rb:17:in `update_from_dynflow' | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.7.17/lib/foreman_tasks/dynflow/persistence.rb:46:in `on_execution_plan_save' | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.7.17/lib/foreman_tasks/dynflow/persistence.rb:14:in `block in save_execution_plan' | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.7.17/lib/foreman_tasks/dynflow/persistence.rb:12:in `tap' | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.7.17/lib/foreman_tasks/dynflow/persistence.rb:12:in `save_execution_plan' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/persistence.rb:49:in `save_execution_plan' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/execution_plan.rb:331:in `save' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/execution_plan.rb:83:in `update_state' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/world.rb:294:in `invalidate_execution_lock' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/world.rb:274:in `block (2 levels) in invalidate' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/world.rb:273:in `each' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/world.rb:273:in `block in invalidate' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/coordinator.rb:229:in `call' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/coordinator.rb:229:in `acquire' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/world.rb:266:in `invalidate' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/world.rb:322:in `block in worlds_validity_check' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/world.rb:316:in `each' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/world.rb:316:in `worlds_validity_check' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/world.rb:40:in `initialize' | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.7.17/lib/foreman_tasks/dynflow/configuration.rb:58:in `new' | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.7.17/lib/foreman_tasks/dynflow/configuration.rb:58:in `initialize_world' | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.7.17/lib/foreman_tasks/dynflow.rb:40:in `initialize!' | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.7.17/lib/foreman_tasks/engine.rb:138:in `block in <class:Engine>' | /opt/rh/rh-ror41/root/usr/share/gems/gems/railties-4.1.5/lib/rails/initializable.rb:30:in `instance_exec' | /opt/rh/rh-ror41/root/usr/share/gems/gems/railties-4.1.5/lib/rails/initializable.rb:30:in `run' | /opt/rh/rh-ror41/root/usr/share/gems/gems/railties-4.1.5/lib/rails/initializable.rb:55:in `block in run_initializers' | /opt/rh/rh-ruby22/root/usr/share/ruby/tsort.rb:226:in `block in tsort_each' | /opt/rh/rh-ruby22/root/usr/share/ruby/tsort.rb:348:in `block (2 levels) in each_strongly_connected_component' | /opt/rh/rh-ruby22/root/usr/share/ruby/tsort.rb:429:in `each_strongly_connected_component_from' | /opt/rh/rh-ruby22/root/usr/share/ruby/tsort.rb:347:in `block in each_strongly_connected_component' | /opt/rh/rh-ruby22/root/usr/share/ruby/tsort.rb:345:in `each' | /opt/rh/rh-ruby22/root/usr/share/ruby/tsort.rb:345:in `call' | /opt/rh/rh-ruby22/root/usr/share/ruby/tsort.rb:345:in `each_strongly_connected_component' | /opt/rh/rh-ruby22/root/usr/share/ruby/tsort.rb:224:in `tsort_each' | /opt/rh/rh-ruby22/root/usr/share/ruby/tsort.rb:203:in `tsort_each' | /opt/rh/rh-ror41/root/usr/share/gems/gems/railties-4.1.5/lib/rails/initializable.rb:54:in `run_initializers' | /opt/rh/rh-ror41/root/usr/share/gems/gems/railties-4.1.5/lib/rails/application.rb:300:in `initialize!' | /opt/rh/rh-ror41/root/usr/share/gems/gems/railties-4.1.5/lib/rails/railtie.rb:194:in `public_send' | /opt/rh/rh-ror41/root/usr/share/gems/gems/railties-4.1.5/lib/rails/railtie.rb:194:in `method_missing' | /usr/share/foreman/config/environment.rb:5:in `<top (required)>' | /opt/rh/rh-ruby22/root/usr/share/rubygems/rubygems/core_ext/kernel_require.rb:54:in `require' | /opt/rh/rh-ruby22/root/usr/share/rubygems/rubygems/core_ext/kernel_require.rb:54:in `require' | /opt/rh/rh-ror41/root/usr/share/gems/gems/polyglot-0.3.4/lib/polyglot.rb:65:in `require' | /opt/rh/rh-ror41/root/usr/share/gems/gems/activesupport-4.1.5/lib/active_support/dependencies.rb:247:in `block in require' | /opt/rh/rh-ror41/root/usr/share/gems/gems/activesupport-4.1.5/lib/active_support/dependencies.rb:232:in `load_dependency' | /opt/rh/rh-ror41/root/usr/share/gems/gems/activesupport-4.1.5/lib/active_support/dependencies.rb:247:in `require' | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.7.17/lib/foreman_tasks/dynflow/daemon.rb:15:in `run' | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.7.17/lib/foreman_tasks/dynflow/daemon.rb:53:in `block in run_background' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/application.rb:265:in `call' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/application.rb:265:in `block in start_proc' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/daemonize.rb:84:in `call' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/daemonize.rb:84:in `call_as_daemon' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/application.rb:269:in `start_proc' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/application.rb:295:in `start' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/monitor.rb:49:in `block (3 levels) in watch' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/monitor.rb:49:in `fork' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/monitor.rb:49:in `block (2 levels) in watch' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/monitor.rb:43:in `each' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/monitor.rb:43:in `block in watch' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/monitor.rb:42:in `loop' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/monitor.rb:42:in `watch' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/monitor.rb:66:in `block in start_with_pidfile' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/monitor.rb:61:in `fork' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/monitor.rb:61:in `start_with_pidfile' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/monitor.rb:92:in `start' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/application_group.rb:141:in `create_monitor' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/application.rb:283:in `start' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/controller.rb:56:in `run' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons.rb:193:in `block in run_proc' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/cmdline.rb:88:in `call' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/cmdline.rb:88:in `catch_exceptions' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons.rb:192:in `run_proc' | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.7.17/lib/foreman_tasks/dynflow/daemon.rb:44:in `run_background' | /usr/bin/foreman-tasks:5:in `<main>'
2016-06-15 13:45:51 [foreman-tasks/dynflow] [W] Error on on_execution_plan_save event | RuntimeError: The Dynflow world was not initialized yet. If your plugin uses it, make sure to call ForemanTasks.dynflow.require! in some initializer | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.7.17/lib/foreman_tasks/dynflow.rb:73:in `world' | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.7.17/app/models/foreman_tasks/task/dynflow_task.rb:48:in `execution_plan' | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.7.17/app/models/foreman_tasks/task/dynflow_task.rb:82:in `main_action' | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.7.17/app/models/foreman_tasks/task/dynflow_task.rb:17:in `update_from_dynflow' | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.7.17/lib/foreman_tasks/dynflow/persistence.rb:46:in `on_execution_plan_save' | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.7.17/lib/foreman_tasks/dynflow/persistence.rb:14:in `block in save_execution_plan' | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.7.17/lib/foreman_tasks/dynflow/persistence.rb:12:in `tap' | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.7.17/lib/foreman_tasks/dynflow/persistence.rb:12:in `save_execution_plan' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/persistence.rb:49:in `save_execution_plan' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/execution_plan.rb:331:in `save' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/world.rb:295:in `invalidate_execution_lock' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/world.rb:274:in `block (2 levels) in invalidate' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/world.rb:273:in `each' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/world.rb:273:in `block in invalidate' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/coordinator.rb:229:in `call' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/coordinator.rb:229:in `acquire' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/world.rb:266:in `invalidate' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/world.rb:322:in `block in worlds_validity_check' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/world.rb:316:in `each' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/world.rb:316:in `worlds_validity_check' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/world.rb:40:in `initialize' | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.7.17/lib/foreman_tasks/dynflow/configuration.rb:58:in `new' | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.7.17/lib/foreman_tasks/dynflow/configuration.rb:58:in `initialize_world' | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.7.17/lib/foreman_tasks/dynflow.rb:40:in `initialize!' | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.7.17/lib/foreman_tasks/engine.rb:138:in `block in <class:Engine>' | /opt/rh/rh-ror41/root/usr/share/gems/gems/railties-4.1.5/lib/rails/initializable.rb:30:in `instance_exec' | /opt/rh/rh-ror41/root/usr/share/gems/gems/railties-4.1.5/lib/rails/initializable.rb:30:in `run' | /opt/rh/rh-ror41/root/usr/share/gems/gems/railties-4.1.5/lib/rails/initializable.rb:55:in `block in run_initializers' | /opt/rh/rh-ruby22/root/usr/share/ruby/tsort.rb:226:in `block in tsort_each' | /opt/rh/rh-ruby22/root/usr/share/ruby/tsort.rb:348:in `block (2 levels) in each_strongly_connected_component' | /opt/rh/rh-ruby22/root/usr/share/ruby/tsort.rb:429:in `each_strongly_connected_component_from' | /opt/rh/rh-ruby22/root/usr/share/ruby/tsort.rb:347:in `block in each_strongly_connected_component' | /opt/rh/rh-ruby22/root/usr/share/ruby/tsort.rb:345:in `each' | /opt/rh/rh-ruby22/root/usr/share/ruby/tsort.rb:345:in `call' | /opt/rh/rh-ruby22/root/usr/share/ruby/tsort.rb:345:in `each_strongly_connected_component' | /opt/rh/rh-ruby22/root/usr/share/ruby/tsort.rb:224:in `tsort_each' | /opt/rh/rh-ruby22/root/usr/share/ruby/tsort.rb:203:in `tsort_each' | /opt/rh/rh-ror41/root/usr/share/gems/gems/railties-4.1.5/lib/rails/initializable.rb:54:in `run_initializers' | /opt/rh/rh-ror41/root/usr/share/gems/gems/railties-4.1.5/lib/rails/application.rb:300:in `initialize!' | /opt/rh/rh-ror41/root/usr/share/gems/gems/railties-4.1.5/lib/rails/railtie.rb:194:in `public_send' | /opt/rh/rh-ror41/root/usr/share/gems/gems/railties-4.1.5/lib/rails/railtie.rb:194:in `method_missing' | /usr/share/foreman/config/environment.rb:5:in `<top (required)>' | /opt/rh/rh-ruby22/root/usr/share/rubygems/rubygems/core_ext/kernel_require.rb:54:in `require' | /opt/rh/rh-ruby22/root/usr/share/rubygems/rubygems/core_ext/kernel_require.rb:54:in `require' | /opt/rh/rh-ror41/root/usr/share/gems/gems/polyglot-0.3.4/lib/polyglot.rb:65:in `require' | /opt/rh/rh-ror41/root/usr/share/gems/gems/activesupport-4.1.5/lib/active_support/dependencies.rb:247:in `block in require' | /opt/rh/rh-ror41/root/usr/share/gems/gems/activesupport-4.1.5/lib/active_support/dependencies.rb:232:in `load_dependency' | /opt/rh/rh-ror41/root/usr/share/gems/gems/activesupport-4.1.5/lib/active_support/dependencies.rb:247:in `require' | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.7.17/lib/foreman_tasks/dynflow/daemon.rb:15:in `run' | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.7.17/lib/foreman_tasks/dynflow/daemon.rb:53:in `block in run_background' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/application.rb:265:in `call' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/application.rb:265:in `block in start_proc' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/daemonize.rb:84:in `call' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/daemonize.rb:84:in `call_as_daemon' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/application.rb:269:in `start_proc' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/application.rb:295:in `start' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/monitor.rb:49:in `block (3 levels) in watch' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/monitor.rb:49:in `fork' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/monitor.rb:49:in `block (2 levels) in watch' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/monitor.rb:43:in `each' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/monitor.rb:43:in `block in watch' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/monitor.rb:42:in `loop' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/monitor.rb:42:in `watch' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/monitor.rb:66:in `block in start_with_pidfile' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/monitor.rb:61:in `fork' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/monitor.rb:61:in `start_with_pidfile' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/monitor.rb:92:in `start' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/application_group.rb:141:in `create_monitor' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/application.rb:283:in `start' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/controller.rb:56:in `run' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons.rb:193:in `block in run_proc' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/cmdline.rb:88:in `call' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons/cmdline.rb:88:in `catch_exceptions' | /opt/theforeman/tfm/root/usr/share/gems/gems/daemons-1.2.3/lib/daemons.rb:192:in `run_proc' | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.7.17/lib/foreman_tasks/dynflow/daemon.rb:44:in `run_background' | /usr/bin/foreman-tasks:5:in `<main>'
2016-06-15 13:45:51 [foreman-tasks/dynflow] [E] invalid worlds found {"71042cdf-985d-425a-a298-fc30573dd6b5"=>:invalidated, "d206a181-4e79-4644-9b48-ea6619bd1a22"=>:valid, "8b90f1ba-1e11-4f99-9fbf-3b78a56bcd32"=>:valid}
2016-06-15 13:45:52 [foreman-tasks] [W] Task a6252c31-bacd-47e2-bdcb-bc01daeb632a updated at consistency check: {"state"=>["running", "paused"], "result"=>["pending", "error"]}