Project

General

Profile

Actions

Bug #20206

open

Remote Execution sending error after upgrade katello 3.4.3

Added by Mario Gamboa almost 7 years ago. Updated over 6 years ago.

Status:
New
Priority:
High
Assignee:
-
Category:
Smart Proxy - SSH
Target version:
-
Difficulty:
Triaged:
Fixed in Releases:
Found in Releases:

Description

This is what i get when try to send a remote update packages

Failed to initialize: Dynflow::ExecutionPlan::Steps::Error - ERF42-3129 [Foreman::Exception]: The smart proxy task 278759f5-3b65-4f85-a6af-01c551daa823 failed.
Loaded plugins: enabled_repos_upload, package_upload, product-id, search-
: disabled-repos, subscription-manager, tracer_upload

No packages marked for update

Uploading Enabled Reposistories Report

Loaded plugins: product-id

Errors:

ERF42-3129 [Foreman::Exception]: The smart proxy task 278759f5-3b65-4f85-a6af-01c551daa823 failed.

This is so weird before the upgrade from katello 3.4 to 3.4.1 and 3.4.2 the remote execution works ok but now is starting to send errors but apparently is complete the task but the host is mark as failed the last execution

and all the contrary i have machines that they really need updates

Loaded plugins: package_upload, product-id, search-disabled-repos, subscription-
: manager

Resolving Dependencies

--> Running transaction check

---> Package ca-certificates.noarch 0:2017.2.11-70.1.el7_3 will be updated

---> Package ca-certificates.noarch 0:2017.2.14-70.1.el7_3 will be an update

---> Package container-selinux.noarch 2:2.12-2.gite7096ce.el7 will be obsoleting

---> Package docker.x86_64 0:1.10.3-57.el7 will be updated

---> Package docker.x86_64 2:1.12.6-28.git1398f24.el7 will be an update

--> Processing Dependency: docker-client = 2:1.12.6-28.git1398f24.el7 for package: 2:docker-1.12.6-28.git1398f24.el7.x86_64

--> Processing Dependency: skopeo-containers for package: 2:docker-1.12.6-28.git1398f24.el7.x86_64

---> Package docker-common.x86_64 0:1.10.3-57.el7 will be updated

---> Package docker-common.x86_64 2:1.12.6-28.git1398f24.el7 will be an update

---> Package docker-rhel-push-plugin.x86_64 0:1.10.3-57.el7 will be updated

---> Package docker-rhel-push-plugin.x86_64 2:1.12.6-28.git1398f24.el7 will be an update

---> Package docker-selinux.x86_64 0:1.10.3-57.el7 will be obsoleted

---> Package glibc.x86_64 0:2.17-157.el7_3.2 will be updated

---> Package glibc.x86_64 0:2.17-157.el7_3.4 will be an update

---> Package glibc-common.x86_64 0:2.17-157.el7_3.2 will be updated

---> Package glibc-common.x86_64 0:2.17-157.el7_3.4 will be an update

---> Package katello-agent.noarch 0:2.7.0-1.el7 will be updated

---> Package katello-agent.noarch 0:3.0.0-2.el7 will be an update

--> Processing Dependency: python2-tracer >= 0.6.12 for package: katello-agent-3.0.0-2.el7.noarch

---> Package katello-agent-fact-plugin.noarch 0:2.7.0-1.el7 will be updated

and i don't get the error but the task is hung and never report back as finish task

Actual result
Error because doesn't have nothing to update or no report task finished when already finish and mark all the hosts as the last execution failed

Expected result
No error and finish the task ok


Related issues 2 (0 open2 closed)

Related to Foreman Remote Execution - Bug #25970: Remote execution bug again can't send back the report of the remote execution to the foreman ResolvedActions
Has duplicate Foreman Remote Execution - Bug #20052: remote execution plugin fail after upgrade from 3.3 to 3.4.1Duplicate06/19/2017Actions
Actions #1

Updated by Daniel Lobato Garcia almost 7 years ago

  • translation missing: en.field_release changed from 266 to 276
Actions #2

Updated by Ivan Necas almost 7 years ago

Anything interesting in `/var/log/foreman-proxy/smart_proxy_dynflow_core.log`? Any chance there were some changes to the server configuration
made manually, that the installer would override?

Actions #3

Updated by Mario Gamboa almost 7 years ago

Let me check monday and paste the logs from the smart proxy

Actions #4

Updated by Mario Gamboa almost 7 years ago

This what i found

[2017-06-19 22:37:51.808 #30437] ERROR -- action: Connection refused - connect(2) for "localhost" port 3000 (Errno::ECONNREFUSED)
/opt/rh/rh-ruby22/root/usr/share/ruby/net/http.rb:879:in `initialize'
/opt/rh/rh-ruby22/root/usr/share/ruby/net/http.rb:879:in `open'
/opt/rh/rh-ruby22/root/usr/share/ruby/net/http.rb:879:in `block in connect'
/opt/rh/rh-ruby22/root/usr/share/ruby/timeout.rb:74:in `timeout'
/opt/rh/rh-ruby22/root/usr/share/ruby/net/http.rb:878:in `connect'
/opt/rh/rh-ruby22/root/usr/share/ruby/net/http.rb:863:in `do_start'
/opt/rh/rh-ruby22/root/usr/share/ruby/net/http.rb:852:in `start'
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:413:in `transmit'
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:176:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:41:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/resource.rb:67:in `post'
/opt/theforeman/tfm/root/usr/share/gems/gems/smart_proxy_dynflow_core-0.1.6/lib/smart_proxy_dynflow_core/callback.rb:22:in `callback'
/opt/theforeman/tfm/root/usr/share/gems/gems/smart_proxy_dynflow_core-0.1.6/lib/smart_proxy_dynflow_core/callback.rb:30:in `send_to_foreman_tasks'
/opt/theforeman/tfm/root/usr/share/gems/gems/smart_proxy_dynflow_core-0.1.6/lib/smart_proxy_dynflow_core/callback.rb:74:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action.rb:512:in `block (3 levels) in execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/middleware/stack.rb:26:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/middleware/stack.rb:26:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/middleware.rb:17:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action/progress.rb:30:in `with_progress_calculation'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action/progress.rb:16:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/middleware/stack.rb:22:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/middleware/stack.rb:26:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/middleware.rb:17:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/middleware.rb:30:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/middleware/stack.rb:22:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/middleware/world.rb:30:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action.rb:511:in `block (2 levels) in execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action.rb:510:in `catch'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action.rb:510:in `block in execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action.rb:425:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action.rb:425:in `block in with_error_handling'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action.rb:425:in `catch'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action.rb:425:in `with_error_handling'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action.rb:505:in `execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action.rb:266:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:9:in `block (2 levels) in execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/execution_plan/steps/abstract.rb:155:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/execution_plan/steps/abstract.rb:155:in `with_meta_calculation'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:8:in `block in execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:22:in `open_action'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:7:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/director.rb:42:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/executors/parallel/worker.rb:11:in `on_message'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/context.rb:46:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/executes_context.rb:7:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/abstract.rb:25:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/actor.rb:26:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/abstract.rb:25:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/awaits.rb:15:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/abstract.rb:25:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/sets_results.rb:14:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/abstract.rb:25:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/buffer.rb:38:in `process_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/buffer.rb:31:in `process_envelopes?'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/buffer.rb:20:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/abstract.rb:25:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/termination.rb:55:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/abstract.rb:25:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/removes_child.rb:10:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/abstract.rb:25:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/sets_results.rb:14:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/core.rb:161:in `process_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/core.rb:95:in `block in on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/core.rb:118:in `block (2 levels) in schedule_execution'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/synchronization/mri_lockable_object.rb:38:in `block in synchronize'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/synchronization/mri_lockable_object.rb:38:in `synchronize'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/synchronization/mri_lockable_object.rb:38:in `synchronize'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/core.rb:115:in `block in schedule_execution'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/executor/serialized_execution.rb:18:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/executor/serialized_execution.rb:18:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/executor/serialized_execution.rb:96:in `work'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/executor/serialized_execution.rb:77:in `block in call_job'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/executor/ruby_thread_pool_executor.rb:348:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/executor/ruby_thread_pool_executor.rb:348:in `run_task'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/executor/ruby_thread_pool_executor.rb:337:in `block (3 levels) in create_worker'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/executor/ruby_thread_pool_executor.rb:320:in `loop'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/executor/ruby_thread_pool_executor.rb:320:in `block (2 levels) in create_worker'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/executor/ruby_thread_pool_executor.rb:319:in `catch'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/executor/ruby_thread_pool_executor.rb:319:in `block in create_worker'
localhost - - [19/Jun/2017:22:38:08 CEST] "GET /tasks/cc4cbaff-62c5-4fd9-8c74-e97d4fe28293/status? HTTP/1.1" 200 3509
localhost - - [19/Jun/2017:22:38:08 CEST] "GET /tasks/cc4cbaff-62c5-4fd9-8c74-e97d4fe28293/status? HTTP/1.1" 200 3509
localhost - - [19/Jun/2017:22:38:10 CEST] "GET /tasks/cc4cbaff-62c5-4fd9-8c74-e97d4fe28293/status? HTTP/1.1" 200 3509
localhost - - [19/Jun/2017:22:38:11 CEST] "GET /tasks/cc4cbaff-62c5-4fd9-8c74-e97d4fe28293/status? HTTP/1.1" 200 3509
localhost - - [19/Jun/2017:22:38:12 CEST] "GET /tasks/cc4cbaff-62c5-4fd9-8c74-e97d4fe28293/status? HTTP/1.1" 200 3509
localhost - - [19/Jun/2017:22:38:34 CEST] "GET /tasks/cc4cbaff-62c5-4fd9-8c74-e97d4fe28293/status? HTTP/1.1" 200 3509
localhost - - [19/Jun/2017:22:38:34 CEST] "GET /tasks/9d5969a6-efee-418a-bc19-56affe82c314/status? HTTP/1.1" 200 3493
localhost - - [19/Jun/2017:22:38:34 CEST] "GET /tasks/2b3e753e-3358-4db8-acfb-818e2a6abc40/status? HTTP/1.1" 200 3491
localhost - - [19/Jun/2017:22:38:34 CEST] "GET /tasks/437183dc-12fc-4854-bfa3-64faf0ac91b2/status? HTTP/1.1" 200 3503
localhost - - [19/Jun/2017:22:38:36 CEST] "GET /tasks/d90dede4-00d2-45ce-971d-de44b55902bd/status? HTTP/1.1" 200 3496
localhost - - [19/Jun/2017:22:38:36 CEST] "GET /tasks/5a7cbdbb-c9f5-46e1-ac79-cbc232dc7128/status? HTTP/1.1" 200 3501
localhost - - [19/Jun/2017:22:38:36 CEST] "GET /tasks/36ccd60c-93bb-419f-8c0a-6e825de7d4ef/status? HTTP/1.1" 200 3505
localhost - - [19/Jun/2017:22:38:38 CEST] "GET /tasks/44ad6897-ab14-4a03-a13a-d47dc80655c1/status? HTTP/1.1" 200 3500
localhost - - [19/Jun/2017:22:38:38 CEST] "GET /tasks/2e06ce7c-2057-4b0f-8853-5e0b8c6ad5d8/status? HTTP/1.1" 200 3497
localhost - - [19/Jun/2017:22:38:38 CEST] "GET /tasks/27dfc80a-50a8-49ab-811f-a92afe1b14cd/status? HTTP/1.1" 200 3499
localhost - - [19/Jun/2017:22:38:38 CEST] "GET /tasks/629af7ae-d143-4422-b2d5-8972a8e77e85/status? HTTP/1.1" 200 3493
localhost - - [19/Jun/2017:22:38:39 CEST] "GET /tasks/b7bf7f42-799b-4bc6-b9aa-3c4a347f6580/status? HTTP/1.1" 200 3507
localhost - - [19/Jun/2017:22:38:40 CEST] "GET /tasks/e7390d0e-8e17-4737-9587-113540984e13/status? HTTP/1.1" 200 3501
localhost - - [19/Jun/2017:22:38:40 CEST] "GET /tasks/b8745e3b-b69a-4d60-96fb-726c30cad990/status? HTTP/1.1" 200 3492
localhost - - [19/Jun/2017:22:38:40 CEST] "GET /tasks/9a52394f-eaf6-4ece-ba76-db49f86d870e/status? HTTP/1.1" 200 3493
localhost - - [19/Jun/2017:22:41:23 CEST] "GET /tasks/cc4cbaff-62c5-4fd9-8c74-e97d4fe28293/status? HTTP/1.1" 200 3509
localhost - - [19/Jun/2017:22:41:23 CEST] "GET /tasks/cc4cbaff-62c5-4fd9-8c74-e97d4fe28293/status? HTTP/1.1" 200 3509
localhost - - [19/Jun/2017:22:41:57 CEST] "GET /tasks/d90dede4-00d2-45ce-971d-de44b55902bd/status? HTTP/1.1" 200 3496
localhost - - [19/Jun/2017:22:41:57 CEST] "GET /tasks/d90dede4-00d2-45ce-971d-de44b55902bd/status? HTTP/1.1" 200 3496
localhost - - [19/Jun/2017:22:47:45 CEST] "GET /tasks/b8745e3b-b69a-4d60-96fb-726c30cad990/status? HTTP/1.1" 200 3492
localhost - - [19/Jun/2017:22:47:45 CEST] "GET /tasks/9a52394f-eaf6-4ece-ba76-db49f86d870e/status? HTTP/1.1" 200 3493
localhost - - [19/Jun/2017:22:47:45 CEST] "GET /tasks/2e06ce7c-2057-4b0f-8853-5e0b8c6ad5d8/status? HTTP/1.1" 200 3497
localhost - - [19/Jun/2017:22:47:45 CEST] "GET /tasks/27dfc80a-50a8-49ab-811f-a92afe1b14cd/status? HTTP/1.1" 200 3499
localhost - - [19/Jun/2017:22:48:25 CEST] "GET /tasks/b8745e3b-b69a-4d60-96fb-726c30cad990/status? HTTP/1.1" 200 3492
localhost - - [19/Jun/2017:22:48:25 CEST] "GET /tasks/9a52394f-eaf6-4ece-ba76-db49f86d870e/status? HTTP/1.1" 200 3493
localhost - - [19/Jun/2017:22:48:25 CEST] "GET /tasks/2e06ce7c-2057-4b0f-8853-5e0b8c6ad5d8/status? HTTP/1.1" 200 3497
localhost - - [19/Jun/2017:22:48:25 CEST] "GET /tasks/27dfc80a-50a8-49ab-811f-a92afe1b14cd/status? HTTP/1.1" 200 3499
localhost - - [19/Jun/2017:22:48:33 CEST] "GET /tasks/b8745e3b-b69a-4d60-96fb-726c30cad990/status? HTTP/1.1" 200 3492
localhost - - [19/Jun/2017:22:48:33 CEST] "GET /tasks/9a52394f-eaf6-4ece-ba76-db49f86d870e/status? HTTP/1.1" 200 3493
localhost - - [19/Jun/2017:22:48:33 CEST] "GET /tasks/2e06ce7c-2057-4b0f-8853-5e0b8c6ad5d8/status? HTTP/1.1" 200 3497
localhost - - [19/Jun/2017:22:48:33 CEST] "GET /tasks/27dfc80a-50a8-49ab-811f-a92afe1b14cd/status? HTTP/1.1" 200 3499
localhost - - [19/Jun/2017:22:48:37 CEST] "GET /tasks/b8745e3b-b69a-4d60-96fb-726c30cad990/status? HTTP/1.1" 200 3492
localhost - - [19/Jun/2017:22:48:37 CEST] "GET /tasks/9a52394f-eaf6-4ece-ba76-db49f86d870e/status? HTTP/1.1" 200 3493
localhost - - [19/Jun/2017:22:48:37 CEST] "GET /tasks/2e06ce7c-2057-4b0f-8853-5e0b8c6ad5d8/status? HTTP/1.1" 200 3497
localhost - - [19/Jun/2017:22:48:37 CEST] "GET /tasks/27dfc80a-50a8-49ab-811f-a92afe1b14cd/status? HTTP/1.1" 200 3499
localhost - - [19/Jun/2017:22:48:42 CEST] "GET /tasks/b8745e3b-b69a-4d60-96fb-726c30cad990/status? HTTP/1.1" 200 3492
localhost - - [19/Jun/2017:22:48:42 CEST] "GET /tasks/9a52394f-eaf6-4ece-ba76-db49f86d870e/status? HTTP/1.1" 200 3493
localhost - - [19/Jun/2017:22:48:42 CEST] "GET /tasks/2e06ce7c-2057-4b0f-8853-5e0b8c6ad5d8/status? HTTP/1.1" 200 3497
localhost - - [19/Jun/2017:22:48:42 CEST] "GET /tasks/27dfc80a-50a8-49ab-811f-a92afe1b14cd/status? HTTP/1.1" 200 3499
localhost - - [19/Jun/2017:22:49:37 CEST] "GET /tasks/b8745e3b-b69a-4d60-96fb-726c30cad990/status? HTTP/1.1" 200 3492
localhost - - [19/Jun/2017:22:49:37 CEST] "GET /tasks/9a52394f-eaf6-4ece-ba76-db49f86d870e/status? HTTP/1.1" 200 3493
localhost - - [19/Jun/2017:22:49:37 CEST] "GET /tasks/2e06ce7c-2057-4b0f-8853-5e0b8c6ad5d8/status? HTTP/1.1" 200 3497
localhost - - [19/Jun/2017:22:49:37 CEST] "GET /tasks/27dfc80a-50a8-49ab-811f-a92afe1b14cd/status? HTTP/1.1" 200 3499
localhost - - [19/Jun/2017:22:49:47 CEST] "GET /tasks/b8745e3b-b69a-4d60-96fb-726c30cad990/status? HTTP/1.1" 200 3492
localhost - - [19/Jun/2017:22:49:47 CEST] "GET /tasks/9a52394f-eaf6-4ece-ba76-db49f86d870e/status? HTTP/1.1" 200 3493
localhost - - [19/Jun/2017:22:49:47 CEST] "GET /tasks/2e06ce7c-2057-4b0f-8853-5e0b8c6ad5d8/status? HTTP/1.1" 200 3497
localhost - - [19/Jun/2017:22:49:47 CEST] "GET /tasks/27dfc80a-50a8-49ab-811f-a92afe1b14cd/status? HTTP/1.1" 200 3499
localhost - - [19/Jun/2017:22:54:49 CEST] "GET /tasks/b8745e3b-b69a-4d60-96fb-726c30cad990/status? HTTP/1.1" 200 3492
localhost - - [19/Jun/2017:22:54:49 CEST] "GET /tasks/9a52394f-eaf6-4ece-ba76-db49f86d870e/status? HTTP/1.1" 200 3493
localhost - - [19/Jun/2017:22:54:49 CEST] "GET /tasks/2e06ce7c-2057-4b0f-8853-5e0b8c6ad5d8/status? HTTP/1.1" 200 3497
localhost - - [19/Jun/2017:22:54:50 CEST] "GET /tasks/27dfc80a-50a8-49ab-811f-a92afe1b14cd/status? HTTP/1.1" 200 3499
localhost - - [19/Jun/2017:22:55:38 CEST] "GET /tasks/count?state=running HTTP/1.1" 200 29
localhost - - [19/Jun/2017:22:55:39 CEST] "POST /tasks/ HTTP/1.1" 200 50
localhost - - [19/Jun/2017:22:55:43 CEST] "GET /tasks/eb77cb6f-bbe9-4577-90b8-85645f3b6b78/status? HTTP/1.1" 200 2329
localhost - - [19/Jun/2017:22:55:43 CEST] "GET /tasks/eb77cb6f-bbe9-4577-90b8-85645f3b6b78/status? HTTP/1.1" 200 2329
localhost - - [19/Jun/2017:22:55:45 CEST] "GET /tasks/eb77cb6f-bbe9-4577-90b8-85645f3b6b78/status? HTTP/1.1" 200 2619
[2017-06-19 22:55:45.601 #30437] ERROR -- action: Connection refused - connect(2) for "localhost" port 3000 (Errno::ECONNREFUSED)
/opt/rh/rh-ruby22/root/usr/share/ruby/net/http.rb:879:in `initialize'
/opt/rh/rh-ruby22/root/usr/share/ruby/net/http.rb:879:in `open'
/opt/rh/rh-ruby22/root/usr/share/ruby/net/http.rb:879:in `block in connect'
/opt/rh/rh-ruby22/root/usr/share/ruby/timeout.rb:74:in `timeout'
/opt/rh/rh-ruby22/root/usr/share/ruby/net/http.rb:878:in `connect'
/opt/rh/rh-ruby22/root/usr/share/ruby/net/http.rb:863:in `do_start'
/opt/rh/rh-ruby22/root/usr/share/ruby/net/http.rb:852:in `start'
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:413:in `transmit'
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:176:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/request.rb:41:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-1.8.0/lib/restclient/resource.rb:67:in `post'
/opt/theforeman/tfm/root/usr/share/gems/gems/smart_proxy_dynflow_core-0.1.6/lib/smart_proxy_dynflow_core/callback.rb:22:in `callback'
/opt/theforeman/tfm/root/usr/share/gems/gems/smart_proxy_dynflow_core-0.1.6/lib/smart_proxy_dynflow_core/callback.rb:30:in `send_to_foreman_tasks'
/opt/theforeman/tfm/root/usr/share/gems/gems/smart_proxy_dynflow_core-0.1.6/lib/smart_proxy_dynflow_core/callback.rb:74:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action.rb:512:in `block (3 levels) in execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/middleware/stack.rb:26:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/middleware/stack.rb:26:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/middleware.rb:17:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action/progress.rb:30:in `with_progress_calculation'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action/progress.rb:16:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/middleware/stack.rb:22:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/middleware/stack.rb:26:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/middleware.rb:17:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/middleware.rb:30:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/middleware/stack.rb:22:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/middleware/world.rb:30:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action.rb:511:in `block (2 levels) in execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action.rb:510:in `catch'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action.rb:510:in `block in execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action.rb:425:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action.rb:425:in `block in with_error_handling'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action.rb:425:in `catch'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action.rb:425:in `with_error_handling'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action.rb:505:in `execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action.rb:266:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:9:in `block (2 levels) in execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/execution_plan/steps/abstract.rb:155:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/execution_plan/steps/abstract.rb:155:in `with_meta_calculation'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:8:in `block in execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:22:in `open_action'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:7:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/director.rb:42:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/executors/parallel/worker.rb:11:in `on_message'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/context.rb:46:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/executes_context.rb:7:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/abstract.rb:25:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/actor.rb:26:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/abstract.rb:25:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/awaits.rb:15:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/abstract.rb:25:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/sets_results.rb:14:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/abstract.rb:25:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/buffer.rb:38:in `process_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/buffer.rb:31:in `process_envelopes?'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/buffer.rb:20:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/abstract.rb:25:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/termination.rb:55:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/abstract.rb:25:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/removes_child.rb:10:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/abstract.rb:25:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/sets_results.rb:14:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/core.rb:161:in `process_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/core.rb:95:in `block in on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/core.rb:118:in `block (2 levels) in schedule_execution'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/synchronization/mri_lockable_object.rb:38:in `block in synchronize'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/synchronization/mri_lockable_object.rb:38:in `synchronize'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/synchronization/mri_lockable_object.rb:38:in `synchronize'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/core.rb:115:in `block in schedule_execution'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/executor/serialized_execution.rb:18:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/executor/serialized_execution.rb:18:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/executor/serialized_execution.rb:96:in `work'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/executor/serialized_execution.rb:77:in `block in call_job'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/executor/ruby_thread_pool_executor.rb:348:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/executor/ruby_thread_pool_executor.rb:348:in `run_task'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/executor/ruby_thread_pool_executor.rb:337:in `block (3 levels) in create_worker'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/executor/ruby_thread_pool_executor.rb:320:in `loop'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/executor/ruby_thread_pool_executor.rb:320:in `block (2 levels) in create_worker'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/executor/ruby_thread_pool_executor.rb:319:in `catch'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/executor/ruby_thread_pool_executor.rb:319:in `block in create_worker'
localhost - - [19/Jun/2017:22:55:46 CEST] "GET /tasks/eb77cb6f-bbe9-4577-90b8-85645f3b6b78/status? HTTP/1.1" 200 3563
localhost - - [19/Jun/2017:22:55:47 CEST] "GET /tasks/eb77cb6f-bbe9-4577-90b8-85645f3b6b78/status? HTTP/1.1" 200 3563
localhost - - [19/Jun/2017:22:55:48 CEST] "GET /tasks/eb77cb6f-bbe9-4577-90b8-85645f3b6b78/status? HTTP/1.1" 200 3563
localhost - - [19/Jun/2017:22:55:49 CEST] "GET /tasks/eb77cb6f-bbe9-4577-90b8-85645f3b6b78/status? HTTP/1.1" 200 3563
localhost - - [19/Jun/2017:22:55:50 CEST] "GET /tasks/eb77cb6f-bbe9-4577-90b8-85645f3b6b78/status? HTTP/1.1" 200 3563
localhost - - [19/Jun/2017:22:55:52 CEST] "GET /tasks/eb77cb6f-bbe9-4577-90b8-85645f3b6b78/status? HTTP/1.1" 200 3563
localhost - - [19/Jun/2017:22:56:39 CEST] "GET /tasks/eb77cb6f-bbe9-4577-90b8-85645f3b6b78/status? HTTP/1.1" 200 3563

As you can see the firewall is off and selinux is not enable is permissive

[root@katelloproxy00 foreman-proxy]# service firewalld status
Redirecting to /bin/systemctl status firewalld.service
● firewalld.service - firewalld - dynamic firewall daemon
Loaded: loaded (/usr/lib/systemd/system/firewalld.service; disabled; vendor preset: enabled)
Active: inactive (dead)
Docs: man:firewalld(1)
[root@katelloproxy00 foreman-proxy]# getenforce 0
Permissive
[root@katelloproxy00 foreman-proxy]#

Actions #5

Updated by Adam Ruzicka almost 7 years ago

[2017-06-19 22:55:45.601 #30437] ERROR -- action: Connection refused - connect(2) for "localhost" port 3000 (Errno::ECONNREFUSED)

I'm not sure how this happened but the smart_proxy_dynflow_core is obviously trying to report back to Foreman at port 3000 (default in devel environment), which should be either 80 or 443 in production. Could you please take a look at /etc/smart_proxy_dynflow_core/settings.yml and see if everything is set correctly there and restart the smart_proxy_dynflow_core service once everything is set up right?

Actions #6

Updated by Ivan Necas almost 7 years ago

  • Has duplicate Bug #20052: remote execution plugin fail after upgrade from 3.3 to 3.4.1 added
Actions #7

Updated by Mario Gamboa almost 7 years ago

Here is the configuration of smart-proxt dynflow

  1. Path to dynflow database, leave blank for in-memory non-persistent database
    :database:
  1. URL of the foreman, used for reporting back
    :foreman_url: 'http://localhost:3000'
  1. SSL settings for client authentication against Foreman
  2. :foreman_ssl_ca: ssl/foreman_ca.pem
  3. :foreman_ssl_key: ssl/foreman_key.pem
  4. :foreman_ssl_cert: ssl/foreman_cert.pem

:console_auth: false

  1. Set to true to make the core fork to background after start
  2. :daemonize: false
  3. :pid_file: /var/run/foreman-proxy/smart_proxy_dynflow_core.pid
  1. Listen on address
    :listen: 127.0.0.1
  1. Listen on port
    :port: 8008
  1. SSL settings for running core as https service
  2. :use_https: false
  3. :ssl_ca_file: ssl/ca.pem
  4. :ssl_private_key: ssl/localhost.pem
  5. :ssl_certificate: ssl/certs/localhost.pem
  1. Use this option only if you need to disable certain cipher suites.
  2. Note: we use the OpenSSL suite name, take a look at:
  3. https://www.openssl.org/docs/manmaster/apps/ciphers.html#CIPHER-SUITE-NAMES
  4. for more information.
    #:ssl_disabled_ciphers: [CIPHER-SUITE-1, CIPHER-SUITE-2]
  1. File to log to, leave empty for logging to STDOUT
  2. :log_file: /var/log/foreman-proxy/smart_proxy_dynflow_core.log
  1. Log level, one of UNKNOWN, FATAL, ERROR, WARN, INFO, DEBUG
  2. :log_level: ERROR
Actions #8

Updated by Mario Gamboa almost 7 years ago

i saw the port is 3000 can i change to 443 this configuration is the same in all my 5 smart proxy already upgraded

Actions #9

Updated by Mario Gamboa almost 7 years ago

Also i notice now checking the foreman-installer answer for the scenario foreman-proxy-content is nothing related to the dynflow port could be the issue and is taking the default is not any relation to change the default port of the configuration from 3000 to the port needed

Actions #10

Updated by Mario Gamboa almost 7 years ago

  • Status changed from New to Feedback
Actions #11

Updated by Mario Gamboa almost 7 years ago

  • Status changed from Feedback to New

After upgrade to the new katello 3.4.3 still the issue with the rex the task run ok in this case and finish but comes back as error

Actions::ProxyAction

Input:

{"ssh_user"=>"remote",
"effective_user"=>"root",
"effective_user_method"=>"sudo",
"ssh_port"=>22,
"hostname"=>"10.215.0.15",
"script"=>
"yum update -y\r\nservice splunk stop\r\n/opt/splunkforwarder/bin/splunk start --accept-license --answer-yes",
"connection_options"=>{"retry_interval"=>15, "retry_count"=>4, "timeout"=>60},
"proxy_url"=>"https://katelloproxy00.loc:9090",
"proxy_action_name"=>"ForemanRemoteExecutionCore::Actions::RunScript",
"locale"=>"en"}

Output:

{"metadata"=>{"timeout"=>"2017-07-18 06:23:09 UTC"},
"proxy_task_id"=>"653c1108-0ac0-4033-82ce-26e5a39f7a18"}

Exception:

Foreman::Exception: ERF42-4144 [Foreman::Exception]: The smart proxy task 653c1108-0ac0-4033-82ce-26e5a39f7a18 failed.

Backtrace:

/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.9.4/app/lib/actions/proxy_action.rb:59:in `check_task_status'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.9.4/app/lib/actions/proxy_action.rb:37:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.9.4/app/lib/actions/proxy_action.rb:159:in `with_connection_error_handling'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.9.4/app/lib/actions/proxy_action.rb:21:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action.rb:512:in `block (3 levels) in execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/middleware/stack.rb:26:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/middleware/stack.rb:26:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/middleware.rb:17:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action/progress.rb:30:in `with_progress_calculation'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action/progress.rb:16:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/middleware/stack.rb:22:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/middleware/stack.rb:26:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/middleware.rb:17:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.4.2/app/lib/actions/middleware/keep_locale.rb:11:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.4.2/app/lib/actions/middleware/keep_locale.rb:22:in `with_locale'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.4.2/app/lib/actions/middleware/keep_locale.rb:11:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/middleware/stack.rb:22:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/middleware/stack.rb:26:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/middleware.rb:17:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/middleware.rb:30:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/middleware/stack.rb:22:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/middleware/world.rb:30:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action.rb:511:in `block (2 levels) in execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action.rb:510:in `catch'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action.rb:510:in `block in execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action.rb:425:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action.rb:425:in `block in with_error_handling'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action.rb:425:in `catch'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action.rb:425:in `with_error_handling'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action.rb:505:in `execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/action.rb:266:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:9:in `block (2 levels) in execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/execution_plan/steps/abstract.rb:155:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/execution_plan/steps/abstract.rb:155:in `with_meta_calculation'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:8:in `block in execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:22:in `open_action'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:7:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/director.rb:55:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/executors/parallel/worker.rb:11:in `on_message'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/context.rb:46:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/executes_context.rb:7:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/abstract.rb:25:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.24/lib/dynflow/actor.rb:26:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/abstract.rb:25:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/awaits.rb:15:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/abstract.rb:25:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/sets_results.rb:14:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/abstract.rb:25:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/buffer.rb:38:in `process_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/buffer.rb:31:in `process_envelopes?'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/buffer.rb:20:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/abstract.rb:25:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/termination.rb:55:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/abstract.rb:25:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/removes_child.rb:10:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/abstract.rb:25:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/behaviour/sets_results.rb:14:in `on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/core.rb:161:in `process_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/core.rb:95:in `block in on_envelope'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/core.rb:118:in `block (2 levels) in schedule_execution'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/synchronization/mri_lockable_object.rb:38:in `block in synchronize'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/synchronization/mri_lockable_object.rb:38:in `synchronize'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/synchronization/mri_lockable_object.rb:38:in `synchronize'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.3/lib/concurrent/actor/core.rb:115:in `block in schedule_execution'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/executor/serialized_execution.rb:18:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/executor/serialized_execution.rb:18:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/executor/serialized_execution.rb:96:in `work'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/executor/serialized_execution.rb:77:in `block in call_job'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/executor/ruby_thread_pool_executor.rb:348:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/executor/ruby_thread_pool_executor.rb:348:in `run_task'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/executor/ruby_thread_pool_executor.rb:337:in `block (3 levels) in create_worker'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/executor/ruby_thread_pool_executor.rb:320:in `loop'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/executor/ruby_thread_pool_executor.rb:320:in `block (2 levels) in create_worker'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/executor/ruby_thread_pool_executor.rb:319:in `catch'
/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.3/lib/concurrent/executor/ruby_thread_pool_executor.rb:319:in `block in create_worker'
/opt/theforeman/tfm/root/usr/share/gems/gems/logging-1.8.2/lib/logging/diagnostic_context.rb:323:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/logging-1.8.2/lib/logging/diagnostic_context.rb:323:in `block in create_with_logging_context'

Actions #12

Updated by Mario Gamboa almost 7 years ago

  • Subject changed from Remote Execution sending error after upgrade katello 3.4 to Remote Execution sending error after upgrade katello 3.4.3
Actions #13

Updated by Mario Gamboa almost 7 years ago

ok i found the issue

After the upgrade
---
  1. Path to dynflow database, leave blank for in-memory non-persistent database
    :database:
  1. URL of the foreman, used for reporting back
    :foreman_url: 'https://satellite.example.com'
  1. SSL settings for client authentication against Foreman <===the upgrade doesn't update this part and for this reason fail to communicate with foreman
    #:foreman_ssl_ca: ssl/foreman_ca.pem
    #:foreman_ssl_key: ssl/foreman_key.pem
    #:foreman_ssl_cert: ssl/foreman_cert.pem

#I added manually the ssl certificates and is works as expected
:foreman_ssl_ca: /etc/foreman-proxy/foreman_ssl_ca.pem
:foreman_ssl_cert: /etc/foreman-proxy/foreman_ssl_cert.pem
:foreman_ssl_key: /etc/foreman-proxy/foreman_ssl_key.pem

:console_auth: false

  1. Set to true to make the core fork to background after start
  2. :daemonize: false
  3. :pid_file: /var/run/foreman-proxy/smart_proxy_dynflow_core.pid
  1. Listen on address
    :listen: 127.0.0.1
  1. Listen on port
    :port: 8008
  1. SSL settings for running core as https service
  2. :use_https: false
  3. :ssl_ca_file: ssl/ca.pem
  4. :ssl_private_key: ssl/localhost.pem
  5. :ssl_certificate: ssl/certs/localhost.pem
  1. Use this option only if you need to disable certain cipher suites.
  2. Note: we use the OpenSSL suite name, take a look at:
  3. https://www.openssl.org/docs/manmaster/apps/ciphers.html#CIPHER-SUITE-NAMES
  4. for more information.
    #:ssl_disabled_ciphers: [CIPHER-SUITE-1, CIPHER-SUITE-2]
  1. File to log to, leave empty for logging to STDOUT
    :log_file: /var/log/foreman-proxy/smart_proxy_dynflow_core.log
  1. Log level, one of UNKNOWN, FATAL, ERROR, WARN, INFO, DEBUG
    :log_level: DEBUG
Actions #14

Updated by Mario Gamboa almost 7 years ago

I just upgrade a smart-proxy from 3.4.1 to 3.4.3 but the issue with REX still apparently the upgrade never change the configuration of the dynflow core in /etc/smart_proxy_dynflow_core/settings.yml

this is the configuration still in the proxy


  1. Path to dynflow database, leave blank for in-memory non-persistent database
    :database:
  1. URL of the foreman, used for reporting back
    :foreman_url: 'http://localhost:3000'
  1. SSL settings for client authentication against Foreman
  2. :foreman_ssl_ca: ssl/foreman_ca.pem
  3. :foreman_ssl_key: ssl/foreman_key.pem
  4. :foreman_ssl_cert: ssl/foreman_cert.pem

:console_auth: false

  1. Set to true to make the core fork to background after start
  2. :daemonize: false
  3. :pid_file: /var/run/foreman-proxy/smart_proxy_dynflow_core.pid
  1. Listen on address
    :listen: 127.0.0.1
  1. Listen on port
    :port: 8008
  1. SSL settings for running core as https service
  2. :use_https: false
  3. :ssl_ca_file: ssl/ca.pem
  4. :ssl_private_key: ssl/localhost.pem
  5. :ssl_certificate: ssl/certs/localhost.pem
  1. Use this option only if you need to disable certain cipher suites.
  2. Note: we use the OpenSSL suite name, take a look at:
  3. https://www.openssl.org/docs/manmaster/apps/ciphers.html#CIPHER-SUITE-NAMES
  4. for more information.
    #:ssl_disabled_ciphers: [CIPHER-SUITE-1, CIPHER-SUITE-2]
  1. File to log to, leave empty for logging to STDOUT
  2. :log_file: /var/log/foreman-proxy/smart_proxy_dynflow_core.log
  1. Log level, one of UNKNOWN, FATAL, ERROR, WARN, INFO, DEBUG
  2. :log_level: ERROR
Actions #15

Updated by Daniel Lobato Garcia over 6 years ago

  • translation missing: en.field_release changed from 276 to 287
Actions #16

Updated by Daniel Lobato Garcia over 6 years ago

  • translation missing: en.field_release changed from 287 to 240
Actions #17

Updated by Ivan Necas over 6 years ago

  • translation missing: en.field_release deleted (240)
Actions #18

Updated by Mario Gamboa about 5 years ago

  • Related to Bug #25970: Remote execution bug again can't send back the report of the remote execution to the foreman added
Actions

Also available in: Atom PDF