Project

General

Profile

Actions

Bug #37977

open

Katello prevents foreman server startup when Pulp is not reachable

Added by Evgeni Golov about 2 months ago. Updated about 2 months ago.

Status:
New
Priority:
Low
Assignee:
-
Category:
-
Target version:
Difficulty:
Triaged:
Yes
Fixed in Releases:
Found in Releases:

Description

Ohai,

I've been experimenting with my setup, and broke Pulp ;)
That happens, but what happened next was unexpected.

I could not (re)start Foreman!

 => Booting Puma
 => Rails 6.1.7.8 application starting in production 
 => Run `bin/rails server --help` for more startup options
 Exiting
 /usr/share/gems/gems/katello-4.14.0/app/services/katello/repository_type_manager.rb:29:in `fix_pulp3_capabilities': A smart proxy seems to have been refreshed without pulpcore being running. Please refresh the smart proxy after ensuring that pulpcore services are running. (Katello::Errors::PulpcoreMissingCapabilities)
         from /usr/share/gems/gems/katello-4.14.0/app/services/katello/repository_type_manager.rb:35:in `enabled_repository_types'
         from /usr/share/gems/gems/katello-4.14.0/app/services/katello/repository_type_manager.rb:79:in `generic_content_types'
         from /usr/share/gems/gems/katello-4.14.0/app/controllers/katello/api/v2/generic_content_units_controller.rb:5:in `block in <class:GenericContentUnitsController>'
         from /usr/share/gems/gems/apipie-rails-1.4.2/lib/apipie/dsl_definition.rb:13:in `instance_exec'
         from /usr/share/gems/gems/apipie-rails-1.4.2/lib/apipie/dsl_definition.rb:13:in `_apipie_eval_dsl'
         from /usr/share/gems/gems/apipie-rails-1.4.2/lib/apipie/dsl_definition.rb:623:in `eval_dsl'
         from /usr/share/gems/gems/apipie-rails-1.4.2/lib/apipie/dsl_definition.rb:147:in `resource_description'
         from /usr/share/gems/gems/katello-4.14.0/app/controllers/katello/api/v2/generic_content_units_controller.rb:3:in `<class:GenericContentUnitsController>'
         from /usr/share/gems/gems/katello-4.14.0/app/controllers/katello/api/v2/generic_content_units_controller.rb:2:in `<module:Katello>'
         from /usr/share/gems/gems/katello-4.14.0/app/controllers/katello/api/v2/generic_content_units_controller.rb:1:in `<top (required)>'
         from <internal:/usr/share/rubygems/rubygems/core_ext/kernel_require.rb>:85:in `require'
         from <internal:/usr/share/rubygems/rubygems/core_ext/kernel_require.rb>:85:in `require'
         from /usr/share/gems/gems/polyglot-0.3.5/lib/polyglot.rb:65:in `require'
         from /usr/share/gems/gems/zeitwerk-2.6.17/lib/zeitwerk/kernel.rb:34:in `require'
         from /usr/share/gems/gems/activesupport-6.1.7.8/lib/active_support/dependencies.rb:332:in `block in require'
         from /usr/share/gems/gems/activesupport-6.1.7.8/lib/active_support/dependencies.rb:299:in `load_dependency'
         from /usr/share/gems/gems/activesupport-6.1.7.8/lib/active_support/dependencies.rb:332:in `require'
         from /usr/share/gems/gems/activesupport-6.1.7.8/lib/active_support/dependencies.rb:424:in `block in require_or_load'
         from /usr/share/gems/gems/activesupport-6.1.7.8/lib/active_support/dependencies.rb:39:in `block in load_interlock'
         from /usr/share/gems/gems/activesupport-6.1.7.8/lib/active_support/dependencies/interlock.rb:14:in `block in loading'
         from /usr/share/gems/gems/activesupport-6.1.7.8/lib/active_support/concurrency/share_lock.rb:151:in `exclusive'
         from /usr/share/gems/gems/activesupport-6.1.7.8/lib/active_support/dependencies/interlock.rb:13:in `loading'
         from /usr/share/gems/gems/activesupport-6.1.7.8/lib/active_support/dependencies.rb:39:in `load_interlock'
         from /usr/share/gems/gems/activesupport-6.1.7.8/lib/active_support/dependencies.rb:402:in `require_or_load'
         from /usr/share/gems/gems/activesupport-6.1.7.8/lib/active_support/dependencies.rb:375:in `depend_on'
         from /usr/share/gems/gems/activesupport-6.1.7.8/lib/active_support/dependencies.rb:288:in `require_dependency'
         from /usr/share/gems/gems/railties-6.1.7.8/lib/rails/engine.rb:493:in `block (2 levels) in eager_load!'
         from /usr/share/gems/gems/railties-6.1.7.8/lib/rails/engine.rb:492:in `each'
         from /usr/share/gems/gems/railties-6.1.7.8/lib/rails/engine.rb:492:in `block in eager_load!'
         from /usr/share/gems/gems/railties-6.1.7.8/lib/rails/engine.rb:489:in `each'
         from /usr/share/gems/gems/railties-6.1.7.8/lib/rails/engine.rb:489:in `eager_load!'
         from /usr/share/gems/gems/railties-6.1.7.8/lib/rails/engine.rb:358:in `eager_load!'
         from /usr/share/gems/gems/railties-6.1.7.8/lib/rails/application/finisher.rb:134:in `each'
         from /usr/share/gems/gems/railties-6.1.7.8/lib/rails/application/finisher.rb:134:in `block in <module:Finisher>'
         from /usr/share/gems/gems/railties-6.1.7.8/lib/rails/initializable.rb:32:in `instance_exec'
         from /usr/share/gems/gems/railties-6.1.7.8/lib/rails/initializable.rb:32:in `run'
         from /usr/share/foreman/config/initializers/0_print_time_spent.rb:45:in `block in run'
         from /usr/share/foreman/config/initializers/0_print_time_spent.rb:17:in `benchmark'
         from /usr/share/foreman/config/initializers/0_print_time_spent.rb:45:in `run'
         from /usr/share/gems/gems/railties-6.1.7.8/lib/rails/initializable.rb:61:in `block in run_initializers'
         from /usr/share/ruby/tsort.rb:228:in `block in tsort_each'
         from /usr/share/ruby/tsort.rb:350:in `block (2 levels) in each_strongly_connected_component'
         from /usr/share/ruby/tsort.rb:431:in `each_strongly_connected_component_from'
         from /usr/share/ruby/tsort.rb:349:in `block in each_strongly_connected_component'
         from /usr/share/ruby/tsort.rb:347:in `each'
         from /usr/share/ruby/tsort.rb:347:in `call'
         from /usr/share/ruby/tsort.rb:347:in `each_strongly_connected_component'
         from /usr/share/ruby/tsort.rb:226:in `tsort_each'
         from /usr/share/ruby/tsort.rb:205:in `tsort_each'
         from /usr/share/gems/gems/railties-6.1.7.8/lib/rails/initializable.rb:60:in `run_initializers'
         from /usr/share/gems/gems/railties-6.1.7.8/lib/rails/application.rb:391:in `initialize!'
         from /usr/share/gems/gems/railties-6.1.7.8/lib/rails/railtie.rb:207:in `public_send'
         from /usr/share/gems/gems/railties-6.1.7.8/lib/rails/railtie.rb:207:in `method_missing'
         from /usr/share/foreman/config/environment.rb:5:in `<top (required)>'
         from <internal:/usr/share/rubygems/rubygems/core_ext/kernel_require.rb>:85:in `require'
         from <internal:/usr/share/rubygems/rubygems/core_ext/kernel_require.rb>:85:in `require'
         from /usr/share/gems/gems/polyglot-0.3.5/lib/polyglot.rb:65:in `require'
         from /usr/share/gems/gems/zeitwerk-2.6.17/lib/zeitwerk/kernel.rb:34:in `require'
         from /usr/share/gems/gems/activesupport-6.1.7.8/lib/active_support/dependencies.rb:332:in `block in require'
         from /usr/share/gems/gems/activesupport-6.1.7.8/lib/active_support/dependencies.rb:299:in `load_dependency'
         from /usr/share/gems/gems/activesupport-6.1.7.8/lib/active_support/dependencies.rb:332:in `require'
         from config.ru:5:in `block in <main>'
         from /usr/share/gems/gems/rack-2.2.9/lib/rack/builder.rb:116:in `eval'
         from /usr/share/gems/gems/rack-2.2.9/lib/rack/builder.rb:116:in `new_from_string'
         from /usr/share/gems/gems/rack-2.2.9/lib/rack/builder.rb:105:in `load_file'
         from /usr/share/gems/gems/rack-2.2.9/lib/rack/builder.rb:66:in `parse_file'
         from /usr/share/gems/gems/rack-2.2.9/lib/rack/server.rb:349:in `build_app_and_options_from_config'
         from /usr/share/gems/gems/rack-2.2.9/lib/rack/server.rb:249:in `app'
         from /usr/share/gems/gems/rack-2.2.9/lib/rack/server.rb:422:in `wrapped_app'
         from /usr/share/gems/gems/rack-2.2.9/lib/rack/server.rb:312:in `block in start'
         from /usr/share/gems/gems/rack-2.2.9/lib/rack/server.rb:379:in `handle_profiling'
         from /usr/share/gems/gems/rack-2.2.9/lib/rack/server.rb:311:in `start'
         from /usr/share/gems/gems/railties-6.1.7.8/lib/rails/commands/server/server_command.rb:39:in `start'
         from /usr/share/gems/gems/railties-6.1.7.8/lib/rails/commands/server/server_command.rb:144:in `block in perform'
         from <internal:kernel>:90:in `tap'
         from /usr/share/gems/gems/railties-6.1.7.8/lib/rails/commands/server/server_command.rb:135:in `perform'
         from /usr/share/gems/gems/thor-1.3.0/lib/thor/command.rb:28:in `run'
         from /usr/share/gems/gems/thor-1.3.0/lib/thor/invocation.rb:127:in `invoke_command'
         from /usr/share/gems/gems/thor-1.3.0/lib/thor.rb:527:in `dispatch'
         from /usr/share/gems/gems/railties-6.1.7.8/lib/rails/command/base.rb:69:in `perform'
         from /usr/share/gems/gems/railties-6.1.7.8/lib/rails/command.rb:48:in `invoke'
         from /usr/share/gems/gems/railties-6.1.7.8/lib/rails/commands.rb:18:in `<top (required)>'
         from <internal:/usr/share/rubygems/rubygems/core_ext/kernel_require.rb>:160:in `require'
         from <internal:/usr/share/rubygems/rubygems/core_ext/kernel_require.rb>:160:in `rescue in require'
         from <internal:/usr/share/rubygems/rubygems/core_ext/kernel_require.rb>:149:in `require'
         from /usr/share/foreman/bin/rails:9:in `<main>'
 <internal:/usr/share/rubygems/rubygems/core_ext/kernel_require.rb>:85:in `require': cannot load such file -- rails/commands (LoadError)
         from <internal:/usr/share/rubygems/rubygems/core_ext/kernel_require.rb>:85:in `require'
         from /usr/share/foreman/bin/rails:9:in `<main>'

This is on 4.14, nightly looks quite identical:

 => Booting Puma
 => Rails 6.1.7.10 application starting in production 
 => Run `bin/rails server --help` for more startup options
 Exiting
 /usr/share/gems/gems/katello-4.15.0.pre.master/app/services/katello/repository_type_manager.rb:29:in `fix_pulp3_capabilities': A smart proxy seems to have been refreshed without pulpcore being running. Please refresh the smart proxy after ensuring that pulpcore services are running. (Katello::Errors::PulpcoreMissingCapabilities)
         from /usr/share/gems/gems/katello-4.15.0.pre.master/app/services/katello/repository_type_manager.rb:35:in `enabled_repository_types'
         from /usr/share/gems/gems/katello-4.15.0.pre.master/app/services/katello/repository_type_manager.rb:79:in `generic_content_types'
         from /usr/share/gems/gems/katello-4.15.0.pre.master/app/controllers/katello/api/v2/generic_content_units_controller.rb:5:in `block in <class:GenericContentUnitsController>'
         from /usr/share/gems/gems/apipie-rails-1.4.2/lib/apipie/dsl_definition.rb:13:in `instance_exec'
         from /usr/share/gems/gems/apipie-rails-1.4.2/lib/apipie/dsl_definition.rb:13:in `_apipie_eval_dsl'
         from /usr/share/gems/gems/apipie-rails-1.4.2/lib/apipie/dsl_definition.rb:623:in `eval_dsl'
         from /usr/share/gems/gems/apipie-rails-1.4.2/lib/apipie/dsl_definition.rb:147:in `resource_description'
         from /usr/share/gems/gems/katello-4.15.0.pre.master/app/controllers/katello/api/v2/generic_content_units_controller.rb:3:in `<class:GenericContentUnitsController>'
         from /usr/share/gems/gems/katello-4.15.0.pre.master/app/controllers/katello/api/v2/generic_content_units_controller.rb:2:in `<module:Katello>'
         from /usr/share/gems/gems/katello-4.15.0.pre.master/app/controllers/katello/api/v2/generic_content_units_controller.rb:1:in `<top (required)>'
         from <internal:/usr/share/rubygems/rubygems/core_ext/kernel_require.rb>:85:in `require'
         from <internal:/usr/share/rubygems/rubygems/core_ext/kernel_require.rb>:85:in `require'
         from /usr/share/gems/gems/polyglot-0.3.5/lib/polyglot.rb:65:in `require'
         from /usr/share/gems/gems/zeitwerk-2.6.18/lib/zeitwerk/kernel.rb:26:in `require'
         from /usr/share/gems/gems/zeitwerk-2.6.18/lib/zeitwerk/cref.rb:91:in `const_get'
         from /usr/share/gems/gems/zeitwerk-2.6.18/lib/zeitwerk/cref.rb:91:in `get'
         from /usr/share/gems/gems/zeitwerk-2.6.18/lib/zeitwerk/loader/eager_load.rb:173:in `block in actual_eager_load_dir'
         from /usr/share/gems/gems/zeitwerk-2.6.18/lib/zeitwerk/loader/helpers.rb:47:in `block in ls'
         from /usr/share/gems/gems/zeitwerk-2.6.18/lib/zeitwerk/loader/helpers.rb:25:in `each'
         from /usr/share/gems/gems/zeitwerk-2.6.18/lib/zeitwerk/loader/helpers.rb:25:in `ls'
         from /usr/share/gems/gems/zeitwerk-2.6.18/lib/zeitwerk/loader/eager_load.rb:168:in `actual_eager_load_dir'
         from /usr/share/gems/gems/zeitwerk-2.6.18/lib/zeitwerk/loader/eager_load.rb:17:in `block (2 levels) in eager_load'
         from /usr/share/gems/gems/zeitwerk-2.6.18/lib/zeitwerk/loader/eager_load.rb:16:in `each'
         from /usr/share/gems/gems/zeitwerk-2.6.18/lib/zeitwerk/loader/eager_load.rb:16:in `block in eager_load'
         from /usr/share/gems/gems/zeitwerk-2.6.18/lib/zeitwerk/loader/eager_load.rb:10:in `synchronize'
         from /usr/share/gems/gems/zeitwerk-2.6.18/lib/zeitwerk/loader/eager_load.rb:10:in `eager_load'
         from /usr/share/gems/gems/zeitwerk-2.6.18/lib/zeitwerk/loader.rb:413:in `block in eager_load_all'
         from /usr/share/gems/gems/zeitwerk-2.6.18/lib/zeitwerk/loader.rb:411:in `each'
         from /usr/share/gems/gems/zeitwerk-2.6.18/lib/zeitwerk/loader.rb:411:in `eager_load_all'
         from /usr/share/gems/gems/railties-6.1.7.10/lib/rails/application/finisher.rb:133:in `block in <module:Finisher>'
         from /usr/share/gems/gems/railties-6.1.7.10/lib/rails/initializable.rb:32:in `instance_exec'
         from /usr/share/gems/gems/railties-6.1.7.10/lib/rails/initializable.rb:32:in `run'
         from /usr/share/foreman/config/initializers/0_print_time_spent.rb:45:in `block in run'
         from /usr/share/foreman/config/initializers/0_print_time_spent.rb:17:in `benchmark'
         from /usr/share/foreman/config/initializers/0_print_time_spent.rb:45:in `run'
         from /usr/share/gems/gems/railties-6.1.7.10/lib/rails/initializable.rb:61:in `block in run_initializers'
         from /usr/share/ruby/tsort.rb:228:in `block in tsort_each'
         from /usr/share/ruby/tsort.rb:350:in `block (2 levels) in each_strongly_connected_component'
         from /usr/share/ruby/tsort.rb:431:in `each_strongly_connected_component_from'
         from /usr/share/ruby/tsort.rb:349:in `block in each_strongly_connected_component'
         from /usr/share/ruby/tsort.rb:347:in `each'
         from /usr/share/ruby/tsort.rb:347:in `call'
         from /usr/share/ruby/tsort.rb:347:in `each_strongly_connected_component'
         from /usr/share/ruby/tsort.rb:226:in `tsort_each'
         from /usr/share/ruby/tsort.rb:205:in `tsort_each'
         from /usr/share/gems/gems/railties-6.1.7.10/lib/rails/initializable.rb:60:in `run_initializers'
         from /usr/share/gems/gems/railties-6.1.7.10/lib/rails/application.rb:391:in `initialize!'
         from /usr/share/gems/gems/railties-6.1.7.10/lib/rails/railtie.rb:207:in `public_send'
         from /usr/share/gems/gems/railties-6.1.7.10/lib/rails/railtie.rb:207:in `method_missing'
         from /usr/share/foreman/config/environment.rb:5:in `<top (required)>'
         from <internal:/usr/share/rubygems/rubygems/core_ext/kernel_require.rb>:85:in `require'
         from <internal:/usr/share/rubygems/rubygems/core_ext/kernel_require.rb>:85:in `require'
         from /usr/share/gems/gems/polyglot-0.3.5/lib/polyglot.rb:65:in `require'
         from /usr/share/gems/gems/zeitwerk-2.6.18/lib/zeitwerk/kernel.rb:34:in `require'
         from /usr/share/gems/gems/activesupport-6.1.7.10/lib/active_support/dependencies.rb:332:in `block in require'
         from /usr/share/gems/gems/activesupport-6.1.7.10/lib/active_support/dependencies.rb:299:in `load_dependency'
         from /usr/share/gems/gems/activesupport-6.1.7.10/lib/active_support/dependencies.rb:332:in `require'
         from config.ru:5:in `block in <main>'
         from /usr/share/gems/gems/rack-2.2.9/lib/rack/builder.rb:116:in `eval'
         from /usr/share/gems/gems/rack-2.2.9/lib/rack/builder.rb:116:in `new_from_string'
         from /usr/share/gems/gems/rack-2.2.9/lib/rack/builder.rb:105:in `load_file'
         from /usr/share/gems/gems/rack-2.2.9/lib/rack/builder.rb:66:in `parse_file'
         from /usr/share/gems/gems/rack-2.2.9/lib/rack/server.rb:349:in `build_app_and_options_from_config'
         from /usr/share/gems/gems/rack-2.2.9/lib/rack/server.rb:249:in `app'
         from /usr/share/gems/gems/rack-2.2.9/lib/rack/server.rb:422:in `wrapped_app'
         from /usr/share/gems/gems/rack-2.2.9/lib/rack/server.rb:312:in `block in start'
         from /usr/share/gems/gems/rack-2.2.9/lib/rack/server.rb:379:in `handle_profiling'
         from /usr/share/gems/gems/rack-2.2.9/lib/rack/server.rb:311:in `start'
         from /usr/share/gems/gems/railties-6.1.7.10/lib/rails/commands/server/server_command.rb:39:in `start'
         from /usr/share/gems/gems/railties-6.1.7.10/lib/rails/commands/server/server_command.rb:144:in `block in perform'
         from <internal:kernel>:90:in `tap'
         from /usr/share/gems/gems/railties-6.1.7.10/lib/rails/commands/server/server_command.rb:135:in `perform'
         from /usr/share/gems/gems/thor-1.3.0/lib/thor/command.rb:28:in `run'
         from /usr/share/gems/gems/thor-1.3.0/lib/thor/invocation.rb:127:in `invoke_command'
         from /usr/share/gems/gems/thor-1.3.0/lib/thor.rb:527:in `dispatch'
         from /usr/share/gems/gems/railties-6.1.7.10/lib/rails/command/base.rb:69:in `perform'
         from /usr/share/gems/gems/railties-6.1.7.10/lib/rails/command.rb:48:in `invoke'
         from /usr/share/gems/gems/railties-6.1.7.10/lib/rails/commands.rb:18:in `<top (required)>'
         from <internal:/usr/share/rubygems/rubygems/core_ext/kernel_require.rb>:160:in `require'
         from <internal:/usr/share/rubygems/rubygems/core_ext/kernel_require.rb>:160:in `rescue in require'
         from <internal:/usr/share/rubygems/rubygems/core_ext/kernel_require.rb>:149:in `require'
         from /usr/share/foreman/bin/rails:9:in `<main>'
 <internal:/usr/share/rubygems/rubygems/core_ext/kernel_require.rb>:85:in `require': cannot load such file -- rails/commands (LoadError)
         from <internal:/usr/share/rubygems/rubygems/core_ext/kernel_require.rb>:85:in `require'
         from /usr/share/foreman/bin/rails:9:in `<main>'

Actions #1

Updated by Ian Ballou about 2 months ago

  • Target version changed from Katello 4.15.0 to Katello 4.16.0
Actions #2

Updated by Ian Ballou about 2 months ago

I feel like I've seen this before actually, I don't think it's a regression. If it is, it's a ~3 year old one.

Actions #3

Updated by Quinn James about 2 months ago

  • Subject changed from Blocks Foreman startup when Pulp is not reachable to Katello prevents foreman server startup when Pulp is not reachable
  • Priority changed from Normal to Low
  • Triaged changed from No to Yes

Leaving category blank to file as 'other'.

Actions

Also available in: Atom PDF