Support #22946
closedForeman tasks using remote_execution_ssh stuck at pending
Description
I've just upgraded from Foreman 1.15.6 to 1.16.0 on a clone of our existing Foreman server. I'm not sure how best to categorise this but proxy plugin seems like a good place to start.
I've used a clone because I'm actually doing several upgrades
Ubuntu 14.04 - 16.04
Puppet 3.x - 5.x
Foreman
Some time ago I removed the remote execution plugin due to Ruby errors that broke Foreman. During this upgrade I've resolved those issues via downgrade of pg & sequel gems as per one of the tickets on here (sorry I don't have it to hand).
Now the ruby errors are resolved but jobs submitted are stuck at pending 100%.
I've set the foreman-proxy log level to debug but I'm running out of ideas of where to look as nothing is giving the game away.
On the remote host there is no attempt to connect by ssh showing up in /var/log/secure.
I want to use the remote ssh plugin to upgrade my clients from 3.8 to 5 as this cannot be done via the puppet_agent plugin.
I note in dynflow.yml there is an entry of core_url running on port 8008 but netstat -tln lists no such port in use.
If someone could point me in the right direction as where to look next I'd be very grateful.