Plugins » Foreman Remote Execution

Apparently proxy isn't able to report back to Foreman, so foreman checks the status of the task after a minute on its own and the task there is failed because it couldn't report back. Please check foreman's log for lines like this (the hostnames might be different).

[app] [W] No smart proxy server found on ["localhost", "localhost.localdomain", "localhost4", "localhost4.localdomain4"] and is not in trusted_puppetmaster_hosts

If not, check if foreman_url is set correctly in smart-proxy's settings.yml.

Hey Adam - thanks for the reply.

I checked both production.log and proxy.log and didnt see any error messages like you indicated. However, we also had no entries at all in trusted_puppetmster_hosts. TO be safe - I added all of our foreman infrastructure servers to trusted_puppetmaster_hosts - and retried a job. It failed again after 60 seconds, but "succeeded" otherwise. This is what is output in production.log

As a general comprehension question. i get that when i submit - the dynflow executor is doing its magic to run the jobs between my two smart proxies with the "ssh" feature enabled on then. What specifically is supposed to happen after completion of a job. Is the smart proxy host supposed to be added to trusted_puppetmaster_hosts (it is) or is the host i'm running the remote command on supposed to be added to trusted_puppetmaster_hosts so it can update itself? (basically adding * to trusted_puppetmaster_hosts?)

2017-04-10 16:31:21 aa0214c8 [app] [I] Completed 200 OK in 165ms (Views: 104.7ms | ActiveRecord: 42.8ms)
2017-04-10 16:31:21 aa0214c8 [app] [I] Started GET "/assets/job_invocations-f079e92744b55af1d247e064a15a9711f56c06165fea3cd2a7724ef2bf5b011a.css" for 172.30.17.5 at 2017-04-10 16:31:21 -0400
2017-04-10 16:31:21 aa0214c8 [app] [I] Started GET "/assets/template_invocation-9117a6b7dcc7ac0b02f590094eea767faa2568d6a58e497eb9543477b7eece76.js" for 172.30.17.5 at 2017-04-10 16:31:21 -0400
2017-04-10 16:31:22 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_name_update%5B%5D=1784&host_ids_needing_status_update%5B%5D=1784&_=1491856281679" for 172.30.17.5 at 2017-04-10 16:31:22 -0400
2017-04-10 16:31:23 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:31:23 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_name_update"=>["1784"], "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281679", "id"=>"32"}
2017-04-10 16:31:23 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_name_td.html.erb (0.8ms)
2017-04-10 16:31:23 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (1.0ms)
2017-04-10 16:31:23 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (34.5ms)
2017-04-10 16:31:23 aa0214c8 [app] [I] Completed 200 OK in 69ms (Views: 25.3ms | ActiveRecord: 26.0ms)
2017-04-10 16:31:24 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281680" for 172.30.17.5 at 2017-04-10 16:31:24 -0400
2017-04-10 16:31:24 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:31:24 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281680", "id"=>"32"}
2017-04-10 16:31:24 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.6ms)
2017-04-10 16:31:24 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (28.0ms)
2017-04-10 16:31:24 aa0214c8 [app] [I] Completed 200 OK in 62ms (Views: 22.6ms | ActiveRecord: 22.4ms)
2017-04-10 16:31:25 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281681" for 172.30.17.5 at 2017-04-10 16:31:25 -0400
2017-04-10 16:31:25 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:31:25 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281681", "id"=>"32"}
2017-04-10 16:31:25 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:31:25 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (25.8ms)
2017-04-10 16:31:25 aa0214c8 [app] [I] Completed 200 OK in 73ms (Views: 21.3ms | ActiveRecord: 22.4ms)
2017-04-10 16:31:26 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281682" for 172.30.17.5 at 2017-04-10 16:31:26 -0400
2017-04-10 16:31:26 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:31:26 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281682", "id"=>"32"}
2017-04-10 16:31:26 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:31:26 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (25.9ms)
2017-04-10 16:31:26 aa0214c8 [app] [I] Completed 200 OK in 61ms (Views: 22.0ms | ActiveRecord: 20.5ms)
2017-04-10 16:31:27 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281683" for 172.30.17.5 at 2017-04-10 16:31:27 -0400
2017-04-10 16:31:27 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:31:27 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281683", "id"=>"32"}
2017-04-10 16:31:27 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:31:27 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (24.0ms)
2017-04-10 16:31:27 aa0214c8 [app] [I] Completed 200 OK in 57ms (Views: 19.9ms | ActiveRecord: 21.1ms)
2017-04-10 16:31:28 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281684" for 172.30.17.5 at 2017-04-10 16:31:28 -0400
2017-04-10 16:31:28 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:31:28 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281684", "id"=>"32"}
2017-04-10 16:31:28 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:31:28 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (22.8ms)
2017-04-10 16:31:28 aa0214c8 [app] [I] Completed 200 OK in 53ms (Views: 19.0ms | ActiveRecord: 19.8ms)
2017-04-10 16:31:29 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281685" for 172.30.17.5 at 2017-04-10 16:31:29 -0400
2017-04-10 16:31:29 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:31:29 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281685", "id"=>"32"}
2017-04-10 16:31:29 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:31:29 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (22.9ms)
2017-04-10 16:31:29 aa0214c8 [app] [I] Completed 200 OK in 54ms (Views: 19.1ms | ActiveRecord: 19.9ms)
2017-04-10 16:31:30 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281686" for 172.30.17.5 at 2017-04-10 16:31:30 -0400
2017-04-10 16:31:30 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:31:30 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281686", "id"=>"32"}
2017-04-10 16:31:30 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:31:30 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (23.8ms)
2017-04-10 16:31:30 aa0214c8 [app] [I] Completed 200 OK in 55ms (Views: 20.4ms | ActiveRecord: 19.3ms)
2017-04-10 16:31:31 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281687" for 172.30.17.5 at 2017-04-10 16:31:31 -0400
2017-04-10 16:31:31 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:31:31 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281687", "id"=>"32"}
2017-04-10 16:31:32 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:31:32 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (23.8ms)
2017-04-10 16:31:32 aa0214c8 [app] [I] Completed 200 OK in 86ms (Views: 19.8ms | ActiveRecord: 20.1ms)
2017-04-10 16:31:33 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281688" for 172.30.17.5 at 2017-04-10 16:31:33 -0400
2017-04-10 16:31:33 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:31:33 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281688", "id"=>"32"}
2017-04-10 16:31:33 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.4ms)
2017-04-10 16:31:33 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (24.3ms)
2017-04-10 16:31:33 aa0214c8 [app] [I] Completed 200 OK in 58ms (Views: 20.4ms | ActiveRecord: 20.6ms)
2017-04-10 16:31:34 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281689" for 172.30.17.5 at 2017-04-10 16:31:34 -0400
2017-04-10 16:31:34 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:31:34 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281689", "id"=>"32"}
2017-04-10 16:31:34 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:31:34 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (23.5ms)
2017-04-10 16:31:34 aa0214c8 [app] [I] Completed 200 OK in 56ms (Views: 20.0ms | ActiveRecord: 19.8ms)
2017-04-10 16:31:35 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281690" for 172.30.17.5 at 2017-04-10 16:31:35 -0400
2017-04-10 16:31:35 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:31:35 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281690", "id"=>"32"}
2017-04-10 16:31:35 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:31:35 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (27.3ms)
2017-04-10 16:31:35 aa0214c8 [app] [I] Completed 200 OK in 69ms (Views: 20.7ms | ActiveRecord: 33.0ms)
2017-04-10 16:31:36 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281691" for 172.30.17.5 at 2017-04-10 16:31:36 -0400
2017-04-10 16:31:36 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:31:36 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281691", "id"=>"32"}
2017-04-10 16:31:36 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:31:36 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (24.7ms)
2017-04-10 16:31:36 aa0214c8 [app] [I] Completed 200 OK in 57ms (Views: 20.8ms | ActiveRecord: 20.2ms)
2017-04-10 16:31:37 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281692" for 172.30.17.5 at 2017-04-10 16:31:37 -0400
2017-04-10 16:31:37 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:31:37 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281692", "id"=>"32"}
2017-04-10 16:31:37 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:31:37 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (24.2ms)
2017-04-10 16:31:37 aa0214c8 [app] [I] Completed 200 OK in 57ms (Views: 20.0ms | ActiveRecord: 19.9ms)
2017-04-10 16:31:38 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281693" for 172.30.17.5 at 2017-04-10 16:31:38 -0400
2017-04-10 16:31:38 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:31:38 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281693", "id"=>"32"}
2017-04-10 16:31:38 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:31:38 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (24.5ms)
2017-04-10 16:31:38 aa0214c8 [app] [I] Completed 200 OK in 57ms (Views: 20.1ms | ActiveRecord: 20.6ms)
2017-04-10 16:31:39 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281694" for 172.30.17.5 at 2017-04-10 16:31:39 -0400
2017-04-10 16:31:39 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:31:39 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281694", "id"=>"32"}
2017-04-10 16:31:39 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:31:39 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (24.3ms)
2017-04-10 16:31:39 aa0214c8 [app] [I] Completed 200 OK in 57ms (Views: 20.5ms | ActiveRecord: 20.2ms)
2017-04-10 16:31:40 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281695" for 172.30.17.5 at 2017-04-10 16:31:40 -0400
2017-04-10 16:31:40 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:31:40 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281695", "id"=>"32"}
2017-04-10 16:31:40 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:31:40 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (24.0ms)
2017-04-10 16:31:40 aa0214c8 [app] [I] Completed 200 OK in 59ms (Views: 20.0ms | ActiveRecord: 20.3ms)
2017-04-10 16:31:42 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281696" for 172.30.17.5 at 2017-04-10 16:31:42 -0400
2017-04-10 16:31:42 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:31:42 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281696", "id"=>"32"}
2017-04-10 16:31:42 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.6ms)
2017-04-10 16:31:42 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (24.0ms)
2017-04-10 16:31:42 aa0214c8 [app] [I] Completed 200 OK in 60ms (Views: 20.2ms | ActiveRecord: 19.6ms)
2017-04-10 16:31:43 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281697" for 172.30.17.5 at 2017-04-10 16:31:43 -0400
2017-04-10 16:31:43 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:31:43 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281697", "id"=>"32"}
2017-04-10 16:31:43 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:31:43 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (24.7ms)
2017-04-10 16:31:43 aa0214c8 [app] [I] Completed 200 OK in 58ms (Views: 20.7ms | ActiveRecord: 20.8ms)
2017-04-10 16:31:44 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281698" for 172.30.17.5 at 2017-04-10 16:31:44 -0400
2017-04-10 16:31:44 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:31:44 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281698", "id"=>"32"}
2017-04-10 16:31:44 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:31:44 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (27.4ms)
2017-04-10 16:31:44 aa0214c8 [app] [I] Completed 200 OK in 59ms (Views: 22.1ms | ActiveRecord: 21.2ms)
2017-04-10 16:31:45 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281699" for 172.30.17.5 at 2017-04-10 16:31:45 -0400
2017-04-10 16:31:45 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:31:45 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281699", "id"=>"32"}
2017-04-10 16:31:45 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:31:45 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (25.2ms)
2017-04-10 16:31:45 aa0214c8 [app] [I] Completed 200 OK in 57ms (Views: 21.2ms | ActiveRecord: 20.2ms)
2017-04-10 16:31:46 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281700" for 172.30.17.5 at 2017-04-10 16:31:46 -0400
2017-04-10 16:31:46 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:31:46 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281700", "id"=>"32"}
2017-04-10 16:31:46 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.6ms)
2017-04-10 16:31:46 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (25.8ms)
2017-04-10 16:31:46 aa0214c8 [app] [I] Completed 200 OK in 57ms (Views: 21.4ms | ActiveRecord: 20.2ms)
2017-04-10 16:31:47 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281701" for 172.30.17.5 at 2017-04-10 16:31:47 -0400
2017-04-10 16:31:47 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:31:47 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281701", "id"=>"32"}
2017-04-10 16:31:47 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.6ms)
2017-04-10 16:31:47 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (24.5ms)
2017-04-10 16:31:47 aa0214c8 [app] [I] Completed 200 OK in 56ms (Views: 20.9ms | ActiveRecord: 19.5ms)
2017-04-10 16:31:48 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281702" for 172.30.17.5 at 2017-04-10 16:31:48 -0400
2017-04-10 16:31:48 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:31:48 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281702", "id"=>"32"}
2017-04-10 16:31:48 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:31:48 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (24.3ms)
2017-04-10 16:31:48 aa0214c8 [app] [I] Completed 200 OK in 59ms (Views: 20.3ms | ActiveRecord: 20.0ms)
2017-04-10 16:31:49 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281703" for 172.30.17.5 at 2017-04-10 16:31:49 -0400
2017-04-10 16:31:49 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:31:49 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281703", "id"=>"32"}
2017-04-10 16:31:49 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:31:49 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (22.8ms)
2017-04-10 16:31:49 aa0214c8 [app] [I] Completed 200 OK in 54ms (Views: 18.9ms | ActiveRecord: 20.2ms)
2017-04-10 16:31:50 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281704" for 172.30.17.5 at 2017-04-10 16:31:50 -0400
2017-04-10 16:31:50 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:31:50 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281704", "id"=>"32"}
2017-04-10 16:31:50 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:31:50 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (23.8ms)
2017-04-10 16:31:50 aa0214c8 [app] [I] Completed 200 OK in 55ms (Views: 20.0ms | ActiveRecord: 19.6ms)
2017-04-10 16:31:51 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281705" for 172.30.17.5 at 2017-04-10 16:31:51 -0400
2017-04-10 16:31:51 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:31:51 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281705", "id"=>"32"}
2017-04-10 16:31:52 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.6ms)
2017-04-10 16:31:52 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (24.7ms)
2017-04-10 16:31:52 aa0214c8 [app] [I] Completed 200 OK in 58ms (Views: 20.6ms | ActiveRecord: 21.3ms)
2017-04-10 16:31:53 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281706" for 172.30.17.5 at 2017-04-10 16:31:53 -0400
2017-04-10 16:31:53 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:31:53 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281706", "id"=>"32"}
2017-04-10 16:31:53 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.6ms)
2017-04-10 16:31:53 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (24.6ms)
2017-04-10 16:31:53 aa0214c8 [app] [I] Completed 200 OK in 57ms (Views: 20.3ms | ActiveRecord: 20.7ms)
2017-04-10 16:31:54 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281707" for 172.30.17.5 at 2017-04-10 16:31:54 -0400
2017-04-10 16:31:54 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:31:54 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281707", "id"=>"32"}
2017-04-10 16:31:54 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:31:54 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (24.4ms)
2017-04-10 16:31:54 aa0214c8 [app] [I] Completed 200 OK in 56ms (Views: 20.2ms | ActiveRecord: 19.8ms)
2017-04-10 16:31:55 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281708" for 172.30.17.5 at 2017-04-10 16:31:55 -0400
2017-04-10 16:31:55 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:31:55 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281708", "id"=>"32"}
2017-04-10 16:31:55 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:31:55 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (24.3ms)
2017-04-10 16:31:55 aa0214c8 [app] [I] Completed 200 OK in 56ms (Views: 20.6ms | ActiveRecord: 19.5ms)
2017-04-10 16:31:56 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281709" for 172.30.17.5 at 2017-04-10 16:31:56 -0400
2017-04-10 16:31:56 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:31:56 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281709", "id"=>"32"}
2017-04-10 16:31:56 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:31:56 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (25.1ms)
2017-04-10 16:31:56 aa0214c8 [app] [I] Completed 200 OK in 57ms (Views: 20.7ms | ActiveRecord: 20.8ms)
2017-04-10 16:31:57 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281710" for 172.30.17.5 at 2017-04-10 16:31:57 -0400
2017-04-10 16:31:57 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:31:57 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281710", "id"=>"32"}
2017-04-10 16:31:57 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:31:57 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (25.2ms)
2017-04-10 16:31:57 aa0214c8 [app] [I] Completed 200 OK in 56ms (Views: 21.4ms | ActiveRecord: 18.9ms)
2017-04-10 16:31:58 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281711" for 172.30.17.5 at 2017-04-10 16:31:58 -0400
2017-04-10 16:31:58 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:31:58 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281711", "id"=>"32"}
2017-04-10 16:31:58 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.9ms)
2017-04-10 16:31:58 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (30.7ms)
2017-04-10 16:31:58 aa0214c8 [app] [I] Completed 200 OK in 70ms (Views: 25.6ms | ActiveRecord: 28.5ms)
2017-04-10 16:31:59 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281712" for 172.30.17.5 at 2017-04-10 16:31:59 -0400
2017-04-10 16:31:59 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:31:59 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281712", "id"=>"32"}
2017-04-10 16:31:59 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:31:59 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (24.4ms)
2017-04-10 16:31:59 aa0214c8 [app] [I] Completed 200 OK in 56ms (Views: 20.3ms | ActiveRecord: 20.0ms)
2017-04-10 16:32:00 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281713" for 172.30.17.5 at 2017-04-10 16:32:00 -0400
2017-04-10 16:32:00 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:32:00 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281713", "id"=>"32"}
2017-04-10 16:32:00 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:32:00 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (25.5ms)
2017-04-10 16:32:00 aa0214c8 [app] [I] Completed 200 OK in 58ms (Views: 20.6ms | ActiveRecord: 22.0ms)
2017-04-10 16:32:01 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281714" for 172.30.17.5 at 2017-04-10 16:32:01 -0400
2017-04-10 16:32:01 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:32:01 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281714", "id"=>"32"}
2017-04-10 16:32:01 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:32:01 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (27.3ms)
2017-04-10 16:32:01 aa0214c8 [app] [I] Completed 200 OK in 66ms (Views: 23.0ms | ActiveRecord: 27.1ms)
2017-04-10 16:32:02 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281715" for 172.30.17.5 at 2017-04-10 16:32:02 -0400
2017-04-10 16:32:03 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:32:03 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281715", "id"=>"32"}
2017-04-10 16:32:03 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:32:03 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (25.1ms)
2017-04-10 16:32:03 aa0214c8 [app] [I] Completed 200 OK in 58ms (Views: 20.6ms | ActiveRecord: 21.6ms)
2017-04-10 16:32:04 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281716" for 172.30.17.5 at 2017-04-10 16:32:04 -0400
2017-04-10 16:32:04 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:32:04 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281716", "id"=>"32"}
2017-04-10 16:32:04 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:32:04 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (24.4ms)
2017-04-10 16:32:04 aa0214c8 [app] [I] Completed 200 OK in 56ms (Views: 20.1ms | ActiveRecord: 20.4ms)
2017-04-10 16:32:05 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281717" for 172.30.17.5 at 2017-04-10 16:32:05 -0400
2017-04-10 16:32:05 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:32:05 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281717", "id"=>"32"}
2017-04-10 16:32:05 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:32:05 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (25.1ms)
2017-04-10 16:32:05 aa0214c8 [app] [I] Completed 200 OK in 56ms (Views: 21.2ms | ActiveRecord: 19.5ms)
2017-04-10 16:32:05 [app] [I] memcached cache backend enabled: [:dalli_store, "memaptstl1.pxlabus.com", {:namespace=>"fmndvl", :expires_in=>86400, :compress=>true}]
2017-04-10 16:32:06 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281718" for 172.30.17.5 at 2017-04-10 16:32:06 -0400
2017-04-10 16:32:06 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:32:06 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281718", "id"=>"32"}
2017-04-10 16:32:06 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:32:06 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (31.6ms)
2017-04-10 16:32:06 aa0214c8 [app] [I] Completed 200 OK in 63ms (Views: 25.1ms | ActiveRecord: 22.6ms)
2017-04-10 16:32:07 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281719" for 172.30.17.5 at 2017-04-10 16:32:07 -0400
2017-04-10 16:32:07 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:32:07 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281719", "id"=>"32"}
2017-04-10 16:32:07 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:32:07 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (23.9ms)
2017-04-10 16:32:07 aa0214c8 [app] [I] Completed 200 OK in 58ms (Views: 20.0ms | ActiveRecord: 22.0ms)
2017-04-10 16:32:08 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281720" for 172.30.17.5 at 2017-04-10 16:32:08 -0400
2017-04-10 16:32:08 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:32:08 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281720", "id"=>"32"}
2017-04-10 16:32:08 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:32:08 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (26.6ms)
2017-04-10 16:32:08 aa0214c8 [app] [I] Completed 200 OK in 72ms (Views: 21.6ms | ActiveRecord: 23.4ms)
2017-04-10 16:32:09 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281721" for 172.30.17.5 at 2017-04-10 16:32:09 -0400
2017-04-10 16:32:09 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:32:09 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281721", "id"=>"32"}
2017-04-10 16:32:09 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:32:09 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (25.7ms)
2017-04-10 16:32:09 aa0214c8 [app] [I] Completed 200 OK in 59ms (Views: 20.9ms | ActiveRecord: 23.5ms)
2017-04-10 16:32:10 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281722" for 172.30.17.5 at 2017-04-10 16:32:10 -0400
2017-04-10 16:32:10 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:32:10 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281722", "id"=>"32"}
2017-04-10 16:32:10 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:32:10 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (24.3ms)
2017-04-10 16:32:10 aa0214c8 [app] [I] Completed 200 OK in 57ms (Views: 20.3ms | ActiveRecord: 22.9ms)
2017-04-10 16:32:11 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281723" for 172.30.17.5 at 2017-04-10 16:32:11 -0400
2017-04-10 16:32:11 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:32:11 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281723", "id"=>"32"}
2017-04-10 16:32:11 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:32:11 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (22.6ms)
2017-04-10 16:32:11 aa0214c8 [app] [I] Completed 200 OK in 55ms (Views: 18.6ms | ActiveRecord: 21.7ms)
2017-04-10 16:32:12 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281724" for 172.30.17.5 at 2017-04-10 16:32:12 -0400
2017-04-10 16:32:12 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:32:12 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281724", "id"=>"32"}
2017-04-10 16:32:12 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.6ms)
2017-04-10 16:32:12 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (23.5ms)
2017-04-10 16:32:12 aa0214c8 [app] [I] Completed 200 OK in 82ms (Views: 19.3ms | ActiveRecord: 20.3ms)
2017-04-10 16:32:14 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281725" for 172.30.17.5 at 2017-04-10 16:32:14 -0400
2017-04-10 16:32:14 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:32:14 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281725", "id"=>"32"}
2017-04-10 16:32:14 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:32:14 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (33.8ms)
2017-04-10 16:32:14 aa0214c8 [app] [I] Completed 200 OK in 76ms (Views: 30.0ms | ActiveRecord: 29.9ms)
2017-04-10 16:32:15 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281726" for 172.30.17.5 at 2017-04-10 16:32:15 -0400
2017-04-10 16:32:15 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:32:15 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281726", "id"=>"32"}
2017-04-10 16:32:15 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.6ms)
2017-04-10 16:32:15 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (23.7ms)
2017-04-10 16:32:15 aa0214c8 [app] [I] Completed 200 OK in 56ms (Views: 19.7ms | ActiveRecord: 20.6ms)
2017-04-10 16:32:16 [foreman-tasks/dynflow] [I] start terminating throttle_limiter...
2017-04-10 16:32:16 [foreman-tasks/dynflow] [I] start terminating client dispatcher...
2017-04-10 16:32:16 [foreman-tasks/dynflow] [I] stop listening for new events...
2017-04-10 16:32:16 [foreman-tasks/dynflow] [I] start terminating clock...
2017-04-10 16:32:16 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281727" for 172.30.17.5 at 2017-04-10 16:32:16 -0400
2017-04-10 16:32:16 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:32:16 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281727", "id"=>"32"}
2017-04-10 16:32:16 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:32:16 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (23.2ms)
2017-04-10 16:32:16 aa0214c8 [app] [I] Completed 200 OK in 55ms (Views: 19.5ms | ActiveRecord: 20.4ms)
2017-04-10 16:32:17 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281728" for 172.30.17.5 at 2017-04-10 16:32:17 -0400
2017-04-10 16:32:17 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:32:17 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281728", "id"=>"32"}
2017-04-10 16:32:17 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:32:17 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (23.5ms)
2017-04-10 16:32:17 aa0214c8 [app] [I] Completed 200 OK in 54ms (Views: 19.9ms | ActiveRecord: 19.4ms)
2017-04-10 16:32:18 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281729" for 172.30.17.5 at 2017-04-10 16:32:18 -0400
2017-04-10 16:32:18 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:32:18 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281729", "id"=>"32"}
2017-04-10 16:32:18 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:32:18 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (23.4ms)
2017-04-10 16:32:18 aa0214c8 [app] [I] Completed 200 OK in 54ms (Views: 19.0ms | ActiveRecord: 20.3ms)
2017-04-10 16:32:19 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281730" for 172.30.17.5 at 2017-04-10 16:32:19 -0400
2017-04-10 16:32:19 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:32:19 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281730", "id"=>"32"}
2017-04-10 16:32:19 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:32:19 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (23.0ms)
2017-04-10 16:32:19 aa0214c8 [app] [I] Completed 200 OK in 55ms (Views: 18.8ms | ActiveRecord: 20.9ms)
2017-04-10 16:32:20 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281731" for 172.30.17.5 at 2017-04-10 16:32:20 -0400
2017-04-10 16:32:20 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:32:20 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281731", "id"=>"32"}
2017-04-10 16:32:20 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:32:20 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (23.6ms)
2017-04-10 16:32:20 aa0214c8 [app] [I] Completed 200 OK in 55ms (Views: 19.3ms | ActiveRecord: 20.4ms)
2017-04-10 16:32:21 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281732" for 172.30.17.5 at 2017-04-10 16:32:21 -0400
2017-04-10 16:32:21 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:32:21 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281732", "id"=>"32"}
2017-04-10 16:32:21 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.5ms)
2017-04-10 16:32:21 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (25.4ms)
2017-04-10 16:32:21 aa0214c8 [app] [I] Completed 200 OK in 57ms (Views: 21.3ms | ActiveRecord: 20.1ms)
2017-04-10 16:32:22 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281733" for 172.30.17.5 at 2017-04-10 16:32:22 -0400
2017-04-10 16:32:22 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:32:22 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281733", "id"=>"32"}
2017-04-10 16:32:22 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (0.6ms)
2017-04-10 16:32:22 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (24.2ms)
2017-04-10 16:32:22 aa0214c8 [app] [I] Completed 200 OK in 58ms (Views: 20.2ms | ActiveRecord: 21.1ms)
2017-04-10 16:32:23 [foreman-tasks/action] [E] ERF42-5476 [Foreman::Exception]: The smart proxy task 9ade0444-2012-4264-aaee-84cda12b070a failed. (Foreman::Exception) | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.8.6/app/lib/actions/proxy_action.rb:59:in `check_task_status' | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.8.6/app/lib/actions/proxy_action.rb:37:in `block in run' | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.8.6/app/lib/actions/proxy_action.rb:159:in `with_connection_error_handling' | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.8.6/app/lib/actions/proxy_action.rb:21:in `run' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.17/lib/dynflow/action.rb:506:in `block (3 levels) in execute_run' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.17/lib/dynflow/middleware/stack.rb:26:in `call' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.17/lib/dynflow/middleware/stack.rb:26:in `pass' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.17/lib/dynflow/middleware.rb:17:in `pass' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.17/lib/dynflow/action/progress.rb:30:in `with_progress_calculation' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.17/lib/dynflow/action/progress.rb:16:in `run' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.17/lib/dynflow/middleware/stack.rb:22:in `call' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.17/lib/dynflow/middleware/stack.rb:26:in `pass' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.17/lib/dynflow/middleware.rb:17:in `pass' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.17/lib/dynflow/middleware.rb:30:in `run' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.17/lib/dynflow/middleware/stack.rb:22:in `call' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.17/lib/dynflow/middleware/world.rb:30:in `execute' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.17/lib/dynflow/action.rb:505:in `block (2 levels) in execute_run' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.17/lib/dynflow/action.rb:504:in `catch' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.17/lib/dynflow/action.rb:504:in `block in execute_run' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.17/lib/dynflow/action.rb:419:in `call' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.17/lib/dynflow/action.rb:419:in `block in with_error_handling' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.17/lib/dynflow/action.rb:419:in `catch' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.17/lib/dynflow/action.rb:419:in `with_error_handling' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.17/lib/dynflow/action.rb:499:in `execute_run' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.17/lib/dynflow/action.rb:260:in `execute' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.17/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:9:in `block (2 levels) in execute' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.17/lib/dynflow/execution_plan/steps/abstract.rb:155:in `call' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.17/lib/dynflow/execution_plan/steps/abstract.rb:155:in `with_meta_calculation' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.17/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:8:in `block in execute' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.17/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:22:in `open_action' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.17/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:7:in `execute' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.17/lib/dynflow/director.rb:55:in `execute' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.17/lib/dynflow/executors/parallel/worker.rb:11:in `on_message' | /opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/context.rb:46:in `on_envelope' | /opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/behaviour/executes_context.rb:7:in `on_envelope' | /opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/behaviour/abstract.rb:25:in `pass' | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.17/lib/dynflow/actor.rb:26:in `on_envelope' | /opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/behaviour/abstract.rb:25:in `pass' | /opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/behaviour/awaits.rb:15:in `on_envelope' | /opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/behaviour/abstract.rb:25:in `pass' | /opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/behaviour/sets_results.rb:14:in `on_envelope' | /opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/behaviour/abstract.rb:25:in `pass' | /opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/behaviour/buffer.rb:38:in `process_envelope' | /opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/behaviour/buffer.rb:31:in `process_envelopes?' | /opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/behaviour/buffer.rb:20:in `on_envelope' | /opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/behaviour/abstract.rb:25:in `pass' | /opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/behaviour/termination.rb:55:in `on_envelope' | /opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/behaviour/abstract.rb:25:in `pass' | /opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/behaviour/removes_child.rb:10:in `on_envelope' | /opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/behaviour/abstract.rb:25:in `pass' | /opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/behaviour/sets_results.rb:14:in `on_envelope' | /opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/core.rb:161:in `process_envelope' | /opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/core.rb:95:in `block in on_envelope' | /opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/core.rb:118:in `block (2 levels) in schedule_execution' | /opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.0/lib/concurrent/synchronization/mri_lockable_object.rb:38:in `block in synchronize' | /opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.0/lib/concurrent/synchronization/mri_lockable_object.rb:38:in `synchronize' | /opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.0/lib/concurrent/synchronization/mri_lockable_object.rb:38:in `synchronize' | /opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/core.rb:115:in `block in schedule_execution' | /opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.0/lib/concurrent/executor/serialized_execution.rb:18:in `call' | /opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.0/lib/concurrent/executor/serialized_execution.rb:18:in `call' | /opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.0/lib/concurrent/executor/serialized_execution.rb:96:in `work' | /opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.0/lib/concurrent/executor/serialized_execution.rb:77:in `block in call_job' | /opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.0/lib/concurrent/executor/ruby_thread_pool_executor.rb:333:in `call' | /opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.0/lib/concurrent/executor/ruby_thread_pool_executor.rb:333:in `run_task' | /opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.0/lib/concurrent/executor/ruby_thread_pool_executor.rb:322:in `block (3 levels) in create_worker' | /opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.0/lib/concurrent/executor/ruby_thread_pool_executor.rb:305:in `loop' | /opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.0/lib/concurrent/executor/ruby_thread_pool_executor.rb:305:in `block (2 levels) in create_worker' | /opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.0/lib/concurrent/executor/ruby_thread_pool_executor.rb:304:in `catch' | /opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.0/lib/concurrent/executor/ruby_thread_pool_executor.rb:304:in `block in create_worker' | /opt/theforeman/tfm/root/usr/share/gems/gems/logging-1.8.2/lib/logging/diagnostic_context.rb:323:in `call' | /opt/theforeman/tfm/root/usr/share/gems/gems/logging-1.8.2/lib/logging/diagnostic_context.rb:323:in `block in create_with_logging_context'
2017-04-10 16:32:23 aa0214c8 [app] [I] Started GET "/job_invocations/32?hosts_needs_refresh=&host_ids_needing_status_update%5B%5D=1784&_=1491856281734" for 172.30.17.5 at 2017-04-10 16:32:23 -0400
2017-04-10 16:32:23 aa0214c8 [app] [I] Processing by JobInvocationsController#show as JS
2017-04-10 16:32:23 aa0214c8 [app] [I] Parameters: {"hosts_needs_refresh"=>"", "host_ids_needing_status_update"=>["1784"], "_"=>"1491856281734", "id"=>"32"}
2017-04-10 16:32:24 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/_host_status_td.html.erb (4.9ms)
2017-04-10 16:32:24 aa0214c8 [app] [I] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman_remote_execution-1.2.2/app/views/job_invocations/show.js.erb (32.9ms)
2017-04-10 16:32:24 aa0214c8 [app] [I] Completed 200 OK in 72ms (Views: 28.6ms | ActiveRecord: 26.0ms)

What specifically is supposed to happen after completion of a job.

The action which runs on the proxy runs the script on the remote host tries to report back to foreman when the script run is finished. So the host where the proxy runs should be in the trusted puppetmaster hosts. Adding the "target" hosts wouldn't help anything. To be more precise, the smart_proxy_dynflow_core is running the job and also reports back, not the smart-proxy per se.

To summarize it:
User triggers job in Foreman.
Foreman delegates the job to smart-proxy.
Smart-proxy delegates the job to smart_proxy_dynflow_core (the dynflow executor on the proxy host).
Smart_proxy_dynflow_core runs the job on the target host.
Smart_proxy_dynflow_core reports back to foreman.

I checked both production.log and proxy.log and didnt see any error messages like you indicated.

Ok, this means the proxy couldn't even reach foreman to report back. Could you check if the foreman_url is properly set in smart_proxy_dynflow_core's config file (/etc/smart_proxy_dynflow_core/settings.yml if you installed from rpms/debs). Also some helpful information might be in smart_proxy_dynflow_core's log (by default in /var/log/foreman-proxy/smart_proxy_dynflow_core.log).

Just a side note: you might need to restart the smart_proxy_dynflow_core service before checking logs, due to http://projects.theforeman.org/issues/19224

Thanks so much for your continued response and clarification

I had mistook foreman_url to mean the foreman_url in the default smart proxy settings (which I did have set correctly) in your first message. I also didn't see any config files in /etc/foreman-proxy/settings.d/ for the dynflow smart proxy, but now that i know its instead at /etc/smart_proxy_dynflow_core/settings.yml im going to work on configuring it in the AM. I also see the settings for logging are in there (but commented out) which explains why my dynflow logfiles were empty despite the settings in settings.yml for smart proxy being set to debug. Hopefully this gets me a bit further, or even to a working state. I'll post back tomorrow when I have something!

Ok, I found something.

in /etc/smart_proxy_dynflow_core/settings.yml, I set :use_https: false
but I have to activate
:ssl_ca_file: ssl_ca.pem
:ssl_private_key: ssl_key.pem
:ssl_certificate: ssl_cert.pem
If I comment these options, it does not work

Oups sorry, it's for another issue :)