Plugins » Katello

Hey Ranjit,

Could you provide the logs needed to debug this. Also, you can open a community post around this and close this issue.

https://community.theforeman.org/tags/c/support/katello

Hi All,

I will share the logs. Currently, I am facing some other issue with foreman. Webpage is responding very slow and when tried repo sync I am now getting server timed out error.

I will try to reinstall foreman and katello using foreman-installer and update.

Hi All,

PFB /var/log/messages output

Jan 28 10:33:46 servername puppet-agent²¹⁰⁷⁶: (/Stage[main]/Puppetdb::Server::Command_processing/Ini_setting[puppetdb_command_processing_thre
ads]) Skipping because of failed dependencies
Jan 28 10:33:46 servername puppet-agent²¹⁰⁷⁶: (/Stage[main]/Puppetdb::Server::Command_processing/Ini_setting[puppetdb_command_processing_stor
e_usage]) Skipping because of failed dependencies
Jan 28 10:33:46 servername puppet-agent²¹⁰⁷⁶: (/Stage[main]/Puppetdb::Server::Command_processing/Ini_setting[puppetdb_command_processing_temp
_usage]) Skipping because of failed dependencies
Jan 28 10:33:46 servername puppet-agent²¹⁰⁷⁶: (/Stage[main]/Puppetdb::Server::Database/Ini_setting[puppetdb_psdatabase_username]) Skipping be
cause of failed dependencies
Jan 28 10:33:46 servername puppet-agent²¹⁰⁷⁶: (/Stage[main]/Puppetdb::Server::Database/Ini_setting[puppetdb_psdatabase_password]) Skipping be
cause of failed dependencies
Jan 28 10:33:46 servername puppet-agent²¹⁰⁷⁶: (/Stage[main]/Puppetdb::Server::Database/Ini_setting[puppetdb_classname]) Skipping because of f
ailed dependencies
Jan 28 10:33:46 servername puppet-agent²¹⁰⁷⁶: (/Stage[main]/Puppetdb::Server::Database/Ini_setting[puppetdb_subprotocol]) Skipping because of
failed dependencies
Jan 28 10:33:46 servername puppet-agent²¹⁰⁷⁶: (/Stage[main]/Puppetdb::Server::Database/Ini_setting[puppetdb_pgs]) Skipping because of failed
dependencies
Jan 28 10:33:46 servername puppet-agent²¹⁰⁷⁶: (/Stage[main]/Puppetdb::Server::Database/Ini_setting[puppetdb_subname]) Skipping because of fai
led dependencies
Jan 28 10:33:46 servername puppet-agent²¹⁰⁷⁶: (/Stage[main]/Puppetdb::Server::Database/Ini_setting[puppetdb_gc_interval]) Skipping because of
failed dependencies
Jan 28 10:33:46 servername puppet-agent²¹⁰⁷⁶: (/Stage[main]/Puppetdb::Server::Database/Ini_setting[puppetdb_node_ttl]) Skipping because of fa
iled dependencies
Jan 28 10:33:46 servername puppet-agent²¹⁰⁷⁶: (/Stage[main]/Puppetdb::Server::Database/Ini_setting[puppetdb_node_purge_ttl]) Skipping because
of failed dependencies
Jan 28 10:33:46 servername puppet-agent²¹⁰⁷⁶: (/Stage[main]/Puppetdb::Server::Database/Ini_setting[puppetdb_report_ttl]) Skipping because of
failed dependencies
Jan 28 10:33:46 servername puppet-agent²¹⁰⁷⁶: (/Stage[main]/Puppetdb::Server::Database/Ini_setting[puppetdb_log_slow_statements]) Skipping be
cause of failed dependencies
Jan 28 10:33:46 servername puppet-agent²¹⁰⁷⁶: (/Stage[main]/Puppetdb::Server::Database/Ini_setting[puppetdb_conn_max_age]) Skipping because o
f failed dependencies
Jan 28 10:33:46 servername puppet-agent²¹⁰⁷⁶: (/Stage[main]/Puppetdb::Server::Database/Ini_setting[puppetdb_conn_keep_alive]) Skipping becaus
e of failed dependencies
Jan 28 10:33:46 servername puppet-agent²¹⁰⁷⁶: (/Stage[main]/Puppetdb::Server::Database/Ini_setting[puppetdb_conn_lifetime]) Skipping because
of failed dependencies
Jan 28 10:33:46 servername puppet-agent²¹⁰⁷⁶: (/Stage[main]/Puppetdb::Server::Read_database/File[/etc/puppetlabs/puppetdb/conf.d/read_databas
e.ini]) Skipping because of failed dependencies
Jan 28 10:33:46 servername puppet-agent²¹⁰⁷⁶: (/Stage[main]/Puppetdb::Server::Jetty/Ini_setting[puppetdb_host]) Skipping because of failed de
pendencies
Jan 28 10:33:46 servername puppet-agent²¹⁰⁷⁶: (/Stage[main]/Puppetdb::Server::Jetty/Ini_setting[puppetdb_port]) Skipping because of failed de
pendencies
Jan 28 10:33:46 servername puppet-agent²¹⁰⁷⁶: (/Stage[main]/Puppetdb::Server::Jetty/Ini_setting[puppetdb_sslhost]) Skipping because of failed
dependencies
Jan 28 10:33:46 servername puppet-agent²¹⁰⁷⁶: (/Stage[main]/Puppetdb::Server::Jetty/Ini_setting[puppetdb_sslport]) Skipping because of failed
dependencies
Jan 28 10:33:46 servername puppet-agent²¹⁰⁷⁶: (/Stage[main]/Puppetdb::Server::Jetty/Ini_setting[puppetdb_max_threads]) Skipping because of fa
iled dependencies
Jan 28 10:33:46 servername puppet-agent²¹⁰⁷⁶: (/Stage[main]/Puppetdb::Server::Puppetdb/Ini_setting[puppetdb-connections-from-master-only]) Sk
ipping because of failed dependencies
Jan 28 10:33:46 servername puppet-agent²¹⁰⁷⁶: (/Stage[main]/Puppetdb::Server::Puppetdb/File[/etc/puppetlabs/puppetdb/certificate-whitelist])
Skipping because of failed dependencies
Jan 28 10:33:46 servername puppet-agent²¹⁰⁷⁶: (/Stage[main]/Puppetdb::Server/Service[puppetdb]) Skipping because of failed dependencies
Jan 28 10:33:46 servername puppet-agent²¹⁰⁷⁶: (/Stage[main]/Puppetdb::Master::Config/Puppetdb_conn_validator[puppetdb_conn]) Skipping because
of failed dependencies
Jan 28 10:33:46 servername puppet-agent²¹⁰⁷⁶: (/Stage[main]/Puppetdb::Master::Routes/File[/etc/puppetlabs/puppet/routes.yaml]) Skipping becau
se of failed dependencies
Jan 28 10:33:46 servername puppet-agent²¹⁰⁷⁶: (/Stage[main]/Puppetdb::Master::Storeconfigs/Ini_setting[puppet.conf/master/storeconfigs]) Skip
ping because of failed dependencies
Jan 28 10:33:46 servername puppet-agent²¹⁰⁷⁶: (/Stage[main]/Puppetdb::Master::Storeconfigs/Ini_setting[puppet.conf/master/storeconfigs_backen
d]) Skipping because of failed dependencies
Jan 28 10:33:46 servername puppet-agent²¹⁰⁷⁶: (/Stage[main]/Puppetdb::Master::Puppetdb_conf/Ini_setting[puppetdbserver_urls]) Skipping becaus
e of failed dependencies
Jan 28 10:33:46 servername puppet-agent²¹⁰⁷⁶: (/Stage[main]/Puppetdb::Master::Puppetdb_conf/Ini_setting[soft_write_failure]) Skipping because
of failed dependencies
Jan 28 10:33:46 servername puppet-agent²¹⁰⁷⁶: (/Stage[main]/Puppetdb::Master::Config/Service[puppetserver]) Skipping because of failed depend
encies
Jan 28 10:33:46 servername puppet-agent²¹⁰⁷⁶: Applied catalog in 151.02 seconds

Jan 28 10:37:24 servername pulp: celery.beat:INFO: Scheduler: Sending due task download_deferred_content (pulp.server.controllers.repository.qu
eue_download_deferred)
Jan 28 10:37:24 servername pulp: celery.worker.strategy:INFO: Received task: pulp.server.controllers.repository.queue_download_deferred[910072c
1-e43d-4269-90c2-c6949b08735b]
Jan 28 10:37:29 servername dynflow-sidekiq@worker-hosts-queue: 2021-01-28T10:37:29.782Z 21675 TID-308jwz Dynflow::Executors::Sidekiq::WorkerJob
s::PerformWork JID-53fd3174517aab9a672a1464 INFO: done: 3600.162 sec
Jan 28 10:37:29 servername dynflow-sidekiq@orchestrator: 2021-01-28T10:37:29.784Z 19180 TID-2txv7o Dynflow::Executors::Sidekiq::OrchestratorJob
s::WorkerDone JID-5dfc66996b449ff40c20904b INFO: start
Jan 28 10:37:29 servername dynflow-sidekiq@worker-hosts-queue: 2021-01-28T10:37:29.784Z 21675 TID-308jwz Dynflow::Executors::Sidekiq::WorkerJob
s::PerformWork JID-11791bfba88b52cb891a7202 INFO: start
Jan 28 10:37:29 servername dynflow-sidekiq@orchestrator: 2021-01-28T10:37:29.786Z 19180 TID-2txv7o Dynflow::Executors::Sidekiq::OrchestratorJob
s::WorkerDone JID-5dfc66996b449ff40c20904b INFO: done: 0.002 sec
Jan 28 10:37:29 servername pulp: kombu.transport.qpid:INFO: Connected to qpid with SASL mechanism ANONYMOUS
Jan 28 10:37:29 servername pulp: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._queue_reserved_task[3d8bdfe7-ea96-42b2-b3
93-392601db9a0d]
Jan 28 10:37:31 servername dhcpd: DHCPDISCOVER from 00:50:56:91:36:0f via eth1: network 10.70.70.0/24: no free leases
Jan 28 10:37:43 servername dynflow-sidekiq@worker-hosts-queue: 2021-01-28T10:37:43.279Z 21675 TID-308krv Dynflow::Executors::Sidekiq::WorkerJob
s::PerformWork JID-2f265a3a0a29a9004251b387 INFO: done: 3600.195 sec
Jan 28 10:37:43 servername dynflow-sidekiq@orchestrator: 2021-01-28T10:37:43.280Z 19180 TID-2txv7o Dynflow::Executors::Sidekiq::OrchestratorJob
s::WorkerDone JID-8e1bef7642831163cddad206 INFO: start
Jan 28 10:37:43 servername dynflow-sidekiq@worker-hosts-queue: 2021-01-28T10:37:43.280Z 21675 TID-308krv Dynflow::Executors::Sidekiq::WorkerJob
s::PerformWork JID-cebfbd51114755d52c6c663c INFO: start
Jan 28 10:37:43 servername dynflow-sidekiq@orchestrator: 2021-01-28T10:37:43.282Z 19180 TID-2txv7o Dynflow::Executors::Sidekiq::OrchestratorJob
s::WorkerDone JID-8e1bef7642831163cddad206 INFO: done: 0.002 sec
Jan 28 10:37:43 servername dynflow-sidekiq@worker-hosts-queue: 2021-01-28T10:37:43.289Z 21675 TID-308krv Dynflow::Executors::Sidekiq::WorkerJob
s::PerformWork JID-cebfbd51114755d52c6c663c INFO: done: 0.008 sec
Jan 28 10:37:43 servername dynflow-sidekiq@orchestrator: 2021-01-28T10:37:43.289Z 19180 TID-2txv7o Dynflow::Executors::Sidekiq::OrchestratorJob
s::WorkerDone JID-1e9360d305e62f0b826ce0e8 INFO: start
Jan 28 10:37:43 servername dynflow-sidekiq@orchestrator: 2021-01-28T10:37:43.290Z 19180 TID-2txv7o Dynflow::Executors::Sidekiq::OrchestratorJob
s::WorkerDone JID-1e9360d305e62f0b826ce0e8 INFO: done: 0.001 sec
Jan 28 10:37:43 servername dynflow-sidekiq@worker-hosts-queue: 2021-01-28T10:37:43.291Z 21675 TID-308krv Dynflow::Executors::Sidekiq::WorkerJob
s::PerformWork JID-e8ff035c8a55671e6d68056c INFO: start
Jan 28 10:37:43 servername dynflow-sidekiq@worker-hosts-queue: 2021-01-28T10:37:43.303Z 21675 TID-308krv Dynflow::Executors::Sidekiq::WorkerJob
Jan 28 10:37:43 servername dynflow-sidekiq@orchestrator: 2021-01-28T10:37:43.304Z 19180 TID-2txv7o Dynflow::Executors::Sidekiq::OrchestratorJob
s::WorkerDone JID-5656ccef252052fe016a5946 INFO: start
Jan 28 10:37:43 servername dynflow-sidekiq@orchestrator: 2021-01-28T10:37:43.304Z 19180 TID-2txv7o Dynflow::Executors::Sidekiq::OrchestratorJob
s::WorkerDone JID-5656ccef252052fe016a5946 INFO: done: 0.001 sec
Jan 28 10:37:43 servername dynflow-sidekiq@worker-hosts-queue: 2021-01-28T10:37:43.305Z 21675 TID-308kof Dynflow::Executors::Sidekiq::WorkerJob
s::PerformWork JID-ae39161c68b7e0eac18fceca INFO: done: 3600.22 sec
Jan 28 10:37:43 servername dynflow-sidekiq@orchestrator: 2021-01-28T10:37:43.310Z 19180 TID-2txv7o Dynflow::Executors::Sidekiq::OrchestratorJob
s::WorkerDone JID-6303b76962b3e3501978c074 INFO: start
Jan 28 10:37:43 servername dynflow-sidekiq@orchestrator: 2021-01-28T10:37:43.312Z 19180 TID-2txv7o Dynflow::Executors::Sidekiq::OrchestratorJob
s::WorkerDone JID-6303b76962b3e3501978c074 INFO: done: 0.002 sec
Jan 28 10:37:43 servername dynflow-sidekiq@worker-hosts-queue: 2021-01-28T10:37:43.350Z 21675 TID-308krv Dynflow::Executors::Sidekiq::WorkerJob
s::PerformWork JID-11a4698b1705c8e7ccaee9c6 INFO: start
Jan 28 10:37:43 servername dynflow-sidekiq@worker-hosts-queue: 2021-01-28T10:37:43.352Z 21675 TID-308krv Dynflow::Executors::Sidekiq::WorkerJob
s::PerformWork JID-11a4698b1705c8e7ccaee9c6 INFO: done: 0.003 sec
Jan 28 10:37:43 servername dynflow-sidekiq@orchestrator: 2021-01-28T10:37:43.354Z 19180 TID-2txv7o Dynflow::Executors::Sidekiq::OrchestratorJob
s::WorkerDone JID-6e72073045c2bbf113a6b5bd INFO: start
Jan 28 10:37:43 servername dynflow-sidekiq@orchestrator: 2021-01-28T10:37:43.355Z 19180 TID-2txv7o Dynflow::Executors::Sidekiq::OrchestratorJob
s::WorkerDone JID-6e72073045c2bbf113a6b5bd INFO: done: 0.001 sec
Jan 28 10:37:43 servername dynflow-sidekiq@worker-hosts-queue: 2021-01-28T10:37:43.682Z 21675 TID-308kof Dynflow::Executors::Sidekiq::WorkerJob
s::PerformWork JID-82e02ef66ab0ca648bea5e7f INFO: start
Jan 28 10:37:43 servername dynflow-sidekiq@worker-hosts-queue: 2021-01-28T10:37:43.693Z 21675 TID-308kof Dynflow::Executors::Sidekiq::WorkerJob
s::PerformWork JID-82e02ef66ab0ca648bea5e7f INFO: done: 0.011 sec
Jan 28 10:37:43 servername dynflow-sidekiq@orchestrator: 2021-01-28T10:37:43.694Z 19180 TID-2txv7o Dynflow::Executors::Sidekiq::OrchestratorJob
s::WorkerDone JID-d89b13bd0452e98447a80a25 INFO: start
Jan 28 10:37:43 servername dynflow-sidekiq@orchestrator: 2021-01-28T10:37:43.695Z 19180 TID-2txv7o Dynflow::Executors::Sidekiq::OrchestratorJob
s::WorkerDone JID-d89b13bd0452e98447a80a25 INFO: done: 0.001 sec
Jan 28 10:37:43 servername dynflow-sidekiq@worker-hosts-queue: 2021-01-28T10:37:43.695Z 21675 TID-308krv Dynflow::Executors::Sidekiq::WorkerJob
s::PerformWork JID-1e6ad9d4cd91f07394a01677 INFO: start
Jan 28 10:37:43 servername dynflow-sidekiq@worker-hosts-queue: 2021-01-28T10:37:43.723Z 21675 TID-308kof Dynflow::Executors::Sidekiq::WorkerJob
s::PerformWork JID-28f4c03fde8129f81597ce6b INFO: start
Jan 28 10:37:43 servername dynflow-sidekiq@worker-hosts-queue: 2021-01-28T10:37:43.727Z 21675 TID-308kof Dynflow::Executors::Sidekiq::WorkerJob
s::PerformWork JID-28f4c03fde8129f81597ce6b INFO: done: 0.003 sec
Jan 28 10:37:43 servername dynflow-sidekiq@orchestrator: 2021-01-28T10:37:43.728Z 19180 TID-2txv7o Dynflow::Executors::Sidekiq::OrchestratorJob
s::WorkerDone JID-21871347c29f95b3f418add2 INFO: start
Jan 28 10:37:43 servername dynflow-sidekiq@orchestrator: 2021-01-28T10:37:43.729Z 19180 TID-2txv7o Dynflow::Executors::Sidekiq::OrchestratorJob
s::WorkerDone JID-21871347c29f95b3f418add2 INFO: done: 0.001 sec
Jan 28 10:37:43 servername dynflow-sidekiq@worker-hosts-queue: 2021-01-28T10:37:43.735Z 21675 TID-308kof Dynflow::Executors::Sidekiq::WorkerJob
s::PerformWork JID-c84967b3717d0df04c6690fc INFO: start
Jan 28 10:37:43 servername dynflow-sidekiq@orchestrator: 2021-01-28T10:37:43.738Z 19180 TID-2txv7o Dynflow::Executors::Sidekiq::OrchestratorJob
s::WorkerDone JID-f3a67f60350472d19acdbc34 INFO: start
Jan 28 10:37:43 servername dynflow-sidekiq@worker-hosts-queue: 2021-01-28T10:37:43.736Z 21675 TID-308krv Dynflow::Executors::Sidekiq::WorkerJob
s::PerformWork JID-1e6ad9d4cd91f07394a01677 INFO: done: 0.042 sec
Jan 28 10:37:43 servername dynflow-sidekiq@orchestrator: 2021-01-28T10:37:43.740Z 19180 TID-2txv7o Dynflow::Executors::Sidekiq::OrchestratorJob
s::WorkerDone JID-f3a67f60350472d19acdbc34 INFO: done: 0.002 sec
Jan 28 10:37:43 servername dynflow-sidekiq@worker-hosts-queue: 2021-01-28T10:37:43.744Z 21675 TID-308krv Dynflow::Executors::Sidekiq::WorkerJob
s::PerformWork JID-72399c2281924b0c7b66403f INFO: start
Jan 28 10:37:43 servername dynflow-sidekiq@worker-hosts-queue: 2021-01-28T10:37:43.771Z 21675 TID-308kof Dynflow::Executors::Sidekiq::WorkerJob
s::PerformWork JID-c84967b3717d0df04c6690fc INFO: done: 0.037 sec
Jan 28 10:37:43 servername dynflow-sidekiq@orchestrator: 2021-01-28T10:37:43.773Z 19180 TID-2txv7o Dynflow::Executors::Sidekiq::OrchestratorJob
s::WorkerDone JID-6a5524ea8a2319d3c2b378be INFO: start
Jan 28 10:37:43 servername dynflow-sidekiq@orchestrator: 2021-01-28T10:37:43.776Z 19180 TID-2txv7o Dynflow::Executors::Sidekiq::OrchestratorJob
s::WorkerDone JID-6a5524ea8a2319d3c2b378be INFO: done: 0.002 sec
Jan 28 10:37:43 servername dynflow-sidekiq@worker-hosts-queue: 2021-01-28T10:37:43.778Z 21675 TID-308kof Dynflow::Executors::Sidekiq::WorkerJob
s::PerformWork JID-30ac9fcd41942c91074319fe INFO: start
Jan 28 10:37:43 servername dynflow-sidekiq@worker-hosts-queue: 2021-01-28T10:37:43.830Z 21675 TID-308krv Dynflow::Executors::Sidekiq::WorkerJob
s::PerformWork JID-72399c2281924b0c7b66403f INFO: done: 0.086 sec
Jan 28 10:37:43 servername dynflow-sidekiq@orchestrator: 2021-01-28T10:37:43.831Z 19180 TID-2txv7o Dynflow::Executors::Sidekiq::OrchestratorJob
s::WorkerDone JID-c721468a650dd70c477a2a5c INFO: start
Jan 28 10:37:43 servername dynflow-sidekiq@orchestrator: 2021-01-28T10:37:43.832Z 19180 TID-2txv7o Dynflow::Executors::Sidekiq::OrchestratorJob
s::WorkerDone JID-c721468a650dd70c477a2a5c INFO: done: 0.001 sec
Jan 28 10:37:43 servername dynflow-sidekiq@worker-hosts-queue: 2021-01-28T10:37:43.842Z 21675 TID-308kof Dynflow::Executors::Sidekiq::WorkerJob
s::PerformWork JID-30ac9fcd41942c91074319fe INFO: done: 0.063 sec
Jan 28 10:37:43 servername dynflow-sidekiq@orchestrator: 2021-01-28T10:37:43.842Z 19180 TID-2txv7o Dynflow::Executors::Sidekiq::OrchestratorJob
s::WorkerDone JID-e73af6121a5bc1e9ccc4e8ad INFO: start
Jan 28 10:37:43 servername dynflow-sidekiq@orchestrator: 2021-01-28T10:37:43.843Z 19180 TID-2txv7o Dynflow::Executors::Sidekiq::OrchestratorJob
s::WorkerDone JID-e73af6121a5bc1e9ccc4e8ad INFO: done: 0.001 sec
Jan 28 10:37:49 servername dhcpd: DHCPDISCOVER from 00:50:56:91:36:0f via eth1: network 10.70.70.0/24: no free leases
Jan 28 10:41:32 servername pulpcore-resource-manager: pulp: rq.worker:INFO: Cleaning registries for queue: resource-manager
Jan 28 10:41:57 servername pulpcore-worker-1: pulp: rq.worker:INFO: Cleaning registries for queue: 19089@servername.domain.com
Jan 28 10:42:00 servername su: (to nagios) root on none

PFB /var/log/foreman/production.log output

2021-01-28T10:47:22 [I|app|7fb6d922] Parameters: {"name"=>"servername3.domain.com"}
2021-01-28T10:47:22 [I|app|7fb6d922] Rendering text template
2021-01-28T10:47:22 [I|app|7fb6d922] Rendered text template (Duration: 0.0ms | Allocations: 3)
2021-01-28T10:47:22 [I|app|7fb6d922] Completed 200 OK in 120ms (Views: 0.6ms | ActiveRecord: 28.9ms | Allocations: 33566)
2021-01-28T10:47:22 [I|app|10ee1c98] Started GET "/foreman_tasks/api/tasks/16a5ce2d-c0e2-4c9a-ac88-c723b641d6fd/details?include_permissions" for 1
27.0.0.1 at 2021-01-28 10:47:22 +0000
2021-01-28T10:47:22 [I|app|10ee1c98] Processing by ForemanTasks::Api::TasksController#details as JSON
2021-01-28T10:47:22 [I|app|10ee1c98] Parameters: {"include_permissions"=>nil, "id"=>"16a5ce2d-c0e2-4c9a-ac88-c723b641d6fd"}
2021-01-28T10:47:22 [I|app|10ee1c98] Rendering /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/views/foreman_tasks/api/task
s/details.json.rabl
2021-01-28T10:47:22 [I|app|10ee1c98] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/views/foreman_tasks/api/tasks
/details.json.rabl (Duration: 86.0ms | Allocations: 27210)
2021-01-28T10:47:22 [I|app|10ee1c98] Completed 200 OK in 106ms (Views: 81.1ms | ActiveRecord: 9.9ms | Allocations: 29650)
2021-01-28T10:47:26 [I|app|96646478] Started POST "/api/hosts/facts" for 127.0.0.1 at 2021-01-28 10:47:26 +0000
2021-01-28T10:47:26 [I|app|96646478] Processing by Api::V2::HostsController#facts as JSON

2021-01-28T10:47:27 [E|kat|] POST: https://servername.domain.com/pulp/api/v2/consumers/aa2b11d5-ab7b-4b97-b622-4547afe8dbaf/actions/cont
ent/regenerate_applicability/: {}: {"content_type"=>"application/json", "accept"=>"application/json"}
Timed out reading data from server:
2021-01-28T10:47:27 [E|bac|] Timed out reading data from server (RestClient::Exceptions::ReadTimeout)
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-2.0.2/lib/restclient/request.rb:733:in `rescue in transmit'
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-2.0.2/lib/restclient/request.rb:642:in `transmit'
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-2.0.2/lib/restclient/request.rb:145:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-2.0.2/lib/restclient/request.rb:52:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-2.0.2/lib/restclient/resource.rb:67:in `post'
/opt/theforeman/tfm/root/usr/share/gems/gems/runcible-2.13.1/lib/runcible/base.rb:94:in `get_response'
/opt/theforeman/tfm/root/usr/share/gems/gems/runcible-2.13.1/lib/runcible/base.rb:74:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/runcible-2.13.1/lib/runcible/resources/consumer.rb:163:in `regenerate_applicability_by_id'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.16.2/app/lib/actions/pulp/consumer/generate_applicability.rb:12:in `invoke_external_task'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action/polling.rb:84:in `initiate_external_action'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action/polling.rb:19:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action/cancellable.rb:14:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.16.2/app/lib/actions/pulp/abstract_async_task.rb:45:in `run'
:

/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:571:in `block (3 levels) in execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:32:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.16.2/app/lib/actions/middleware/remote_action.rb:16:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.16.2/app/lib/actions/middleware/remote_action.rb:40:in `block in as_remote_user'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.16.2/app/models/katello/concerns/user_extensions.rb:21:in `cp_config'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.16.2/app/lib/actions/middleware/remote_action.rb:27:in `as_cp_user'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.16.2/app/lib/actions/middleware/remote_action.rb:39:in `as_remote_user'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.16.2/app/lib/actions/middleware/remote_action.rb:16:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/rails_executor_wrap.rb:14:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.1/lib/active_support/execution_wrapper.rb:88:in `wrap'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/rails_executor_wrap.rb:13:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action/progress.rb:31:in `with_progress_calculation'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action/progress.rb:17:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_request_id.rb:15:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_request_id.rb:49:in `restore_current_requ
est_id'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_request_id.rb:15:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in `pass'

/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_timezone.rb:15:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_timezone.rb:44:in `restore_curent_timezon
e'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_timezone.rb:15:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_user.rb:15:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_user.rb:44:in `restore_curent_user'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_user.rb:15:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_taxonomies.rb:45:in `restore_current_taxo
nomies'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:32:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/world.rb:31:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:570:in `block (2 levels) in execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:569:in `catch'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:569:in `block in execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:472:in `block in with_error_handling'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:472:in `catch'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:472:in `with_error_handling'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:564:in `execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:285:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:18:in `block (2 levels) in execu
te'

/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/execution_plan/steps/abstract.rb:167:in `with_meta_calculation'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:17:in `block in execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:32:in `open_action'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:16:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/director.rb:68:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/executors/sidekiq/worker_jobs.rb:11:in `block (2 levels) in perform'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/executors.rb:18:in `run_user_code'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/executors/sidekiq/worker_jobs.rb:9:in `block in perform'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/executors/sidekiq/worker_jobs.rb:25:in `with_telemetry'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/executors/sidekiq/worker_jobs.rb:8:in `perform'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/executors/sidekiq/serialization.rb:27:in `perform'
[ sidekiq ]
[ concurrent-ruby ]
2021-01-28T10:47:27 [I|bac|] Task {label: Actions::Katello::Host::GenerateApplicability, id: 26d3b6be-7bf6-49cd-ab83-0ef226cd4b8d, execution_plan_
id: 265af070-d078-4647-9468-29e5420226c0} state changed: paused result: error
2021-01-28T10:47:27 [I|app|ac813ba8] Started GET "/foreman_tasks/api/tasks/16a5ce2d-c0e2-4c9a-ac88-c723b641d6fd/details?include_permissions" for 1
27.0.0.1 at 2021-01-28 10:47:27 +0000
2021-01-28T10:47:27 [I|app|ac813ba8] Processing by ForemanTasks::Api::TasksController#details as JSON
2021-01-28T10:47:27 [I|app|ac813ba8] Parameters: {"include_permissions"=>nil, "id"=>"16a5ce2d-c0e2-4c9a-ac88-c723b641d6fd"}
2021-01-28T10:47:27 [I|app|ac813ba8] Rendering /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/views/foreman_tasks/api/task
s/details.json.rabl
2021-01-28T10:47:27 [I|app|ac813ba8] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/views/foreman_tasks/api/tasks
/details.json.rabl (Duration: 142.4ms | Allocations: 39764)
2021-01-28T10:47:27 [I|app|ac813ba8] Completed 200 OK in 174ms (Views: 128.6ms | ActiveRecord: 29.3ms | Allocations: 43986)
2021-01-28T10:47:28 [I|app|96646478] Import facts for 'servername.domain.com' completed. Added: 0, Updated: 0, Deleted 0 facts
2021-01-28T10:47:28 [W|app|96646478] Action failed
2021-01-28T10:47:28 [I|app|96646478] Rendering api/v2/errors/standard_error.json.rabl within api/v2/layouts/error_layout
2021-01-28T10:47:28 [I|app|96646478] Rendered api/v2/errors/standard_error.json.rabl within api/v2/layouts/error_layout (Duration: 8.8ms | Alloc
ations: 6108)
2021-01-28T10:47:28 [I|app|96646478] Completed 500 Internal Server Error in 2031ms (Views: 18.9ms | ActiveRecord: 887.8ms | Allocations: 267658)
2021-01-28T10:47:28 [I|app|810cde57] Started GET "/node/servername.domain.com?format=yml" for 127.0.0.1 at 2021-01-28 10:47:28 +0000
2021-01-28T10:47:28 [I|app|810cde57] Processing by HostsController#externalNodes as YML

2021-01-28T10:47:28 [I|app|810cde57] Parameters: {"name"=>"servername.domain.com"}
2021-01-28T10:47:29 [I|app|810cde57] Rendering text template
2021-01-28T10:47:29 [I|app|810cde57] Rendered text template (Duration: 0.0ms | Allocations: 2)
2021-01-28T10:47:29 [I|app|810cde57] Completed 200 OK in 228ms (Views: 0.9ms | ActiveRecord: 46.4ms | Allocations: 33070)
2021-01-28T10:47:29 [I|app|fea13518] Started POST "/api/config_reports" for 127.0.0.1 at 2021-01-28 10:47:29 +0000
2021-01-28T10:47:29 [I|app|fea13518] Processing by Api::V2::ConfigReportsController#create as JSON
2021-01-28T10:47:29 [I|app|fea13518] Parameters: {"config_report"=>"[FILTERED]", "apiv"=>"v2"}
2021-01-28T10:47:29 [I|app|fea13518] Scanning report with: Foreman::PuppetReportScanner, ForemanAnsible::AnsibleReportScanner
2021-01-28T10:47:32 [I|app|ca79434c] Started POST "/api/config_reports" for 127.0.0.1 at 2021-01-28 10:47:32 +0000
2021-01-28T10:47:32 [I|app|ca79434c] Processing by Api::V2::ConfigReportsController#create as JSON
2021-01-28T10:47:32 [I|app|ca79434c] Parameters: {"config_report"=>"[FILTERED]", "apiv"=>"v2"}
2021-01-28T10:47:32 [I|app|ca79434c] Scanning report with: Foreman::PuppetReportScanner, ForemanAnsible::AnsibleReportScanner
2021-01-28T10:47:32 [I|app|fea13518] Imported report for servername3.domain.com in 2814.9 ms, status refreshed in 26.6 ms
2021-01-28T10:47:32 [I|app|fea13518] Rendering api/v2/config_reports/create.json.rabl
2021-01-28T10:47:32 [I|app|2aa1a17c] Started GET "/foreman_tasks/api/tasks/16a5ce2d-c0e2-4c9a-ac88-c723b641d6fd/details?include_permissions" for 1
27.0.0.1 at 2021-01-28 10:47:32 +0000
2021-01-28T10:47:32 [I|app|2aa1a17c] Processing by ForemanTasks::Api::TasksController#details as JSON
2021-01-28T10:47:32 [I|app|2aa1a17c] Parameters: {"include_permissions"=>nil, "id"=>"16a5ce2d-c0e2-4c9a-ac88-c723b641d6fd"}
2021-01-28T10:47:32 [I|app|2aa1a17c] Rendering /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/views/foreman_tasks/api/task
s/details.json.rabl
2021-01-28T10:47:32 [I|app|2aa1a17c] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/views/foreman_tasks/api/tasks
/details.json.rabl (Duration: 100.5ms | Allocations: 30744)
2021-01-28T10:47:32 [I|app|2aa1a17c] Completed 200 OK in 127ms (Views: 90.6ms | ActiveRecord: 17.1ms | Allocations: 33874)
2021-01-28T10:47:33 [I|app|ca79434c] Imported report for servername.domain.com in 1554.2 ms, status refreshed in 22.5 ms
2021-01-28T10:47:34 [I|app|ca79434c] Rendering api/v2/config_reports/create.json.rabl
2021-01-28T10:47:34 [I|app|fea13518] Rendered api/v2/config_reports/create.json.rabl (Duration: 1964.2ms | Allocations: 336195)
2021-01-28T10:47:34 [I|app|fea13518] Completed 201 Created in 4993ms (Views: 1742.2ms | ActiveRecord: 1323.1ms | Allocations: 803212)
2021-01-28T10:47:34 [I|app|ca79434c] Rendered api/v2/config_reports/create.json.rabl (Duration: 881.9ms | Allocations: 162955)
2021-01-28T10:47:34 [I|app|ca79434c] Completed 201 Created in 2585ms (Views: 780.2ms | ActiveRecord: 773.0ms | Allocations: 425765)
2021-01-28T10:47:36 [I|app|6b14a8bc] Started GET "/rhsm/status" for 127.0.0.1 at 2021-01-28 10:47:36 +0000
2021-01-28T10:47:36 [I|app|6b14a8bc] Processing by Katello::Api::Rhsm::CandlepinProxiesController#server_status as JSON
2021-01-28T10:47:36 [I|app|6b14a8bc] Completed 200 OK in 81ms (Views: 0.9ms | ActiveRecord: 3.1ms | Allocations: 2898)
2021-01-28T10:47:37 [I|app|95f9a617] Started GET "/foreman_tasks/api/tasks/16a5ce2d-c0e2-4c9a-ac88-c723b641d6fd/details?include_permissions" for 1
27.0.0.1 at 2021-01-28 10:47:37 +0000

2021-01-28T10:47:37 [I|app|95f9a617] Processing by ForemanTasks::Api::TasksController#details as JSON
2021-01-28T10:47:37 [I|app|95f9a617] Parameters: {"include_permissions"=>nil, "id"=>"16a5ce2d-c0e2-4c9a-ac88-c723b641d6fd"}
2021-01-28T10:47:37 [I|app|95f9a617] Rendering /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/views/foreman_tasks/api/tasks/details.json.rabl
2021-01-28T10:47:37 [I|app|95f9a617] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/views/foreman_tasks/api/tasks/details.json.rabl (Duration: 69.7ms | Allocations: 27210)
2021-01-28T10:47:37 [I|app|95f9a617] Completed 200 OK in 87ms (Views: 66.3ms | ActiveRecord: 7.1ms | Allocations: 29650)
2021-01-28T10:47:41 [I|app|38346195] Started GET "/rhsm/status" for 127.0.0.1 at 2021-01-28 10:47:41 +0000
2021-01-28T10:47:41 [I|app|38346195] Processing by Katello::Api::Rhsm::CandlepinProxiesController#server_status as JSON
2021-01-28T10:47:42 [I|app|38346195] Completed 200 OK in 95ms (Views: 1.0ms | ActiveRecord: 2.6ms | Allocations: 2905)
2021-01-28T10:47:42 [I|app|899f8f7b] Started GET "/rhsm/status" for 127.0.0.1 at 2021-01-28 10:47:42 +0000
2021-01-28T10:47:42 [I|app|899f8f7b] Processing by Katello::Api::Rhsm::CandlepinProxiesController#server_status as JSON
2021-01-28T10:47:42 [I|app|899f8f7b] Completed 200 OK in 70ms (Views: 0.7ms | ActiveRecord: 1.9ms | Allocations: 2904)
2021-01-28T10:47:42 [I|app|7ae14c0b] Started GET "/foreman_tasks/api/tasks/16a5ce2d-c0e2-4c9a-ac88-c723b641d6fd/details?include_permissions" for 127.0.0.1 at 2021-01-28 10:47:42 +0000
2021-01-28T10:47:42 [I|app|7ae14c0b] Processing by ForemanTasks::Api::TasksController#details as JSON
2021-01-28T10:47:42 [I|app|7ae14c0b] Parameters: {"include_permissions"=>nil, "id"=>"16a5ce2d-c0e2-4c9a-ac88-c723b641d6fd"}
2021-01-28T10:47:42 [I|app|7ae14c0b] Rendering /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/views/foreman_tasks/api/tasks/details.json.rabl
2021-01-28T10:47:42 [I|app|7ae14c0b] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/views/foreman_tasks/api/tasks/details.json.rabl (Duration: 59.8ms | Allocations: 27210)
2021-01-28T10:47:42 [I|app|7ae14c0b] Completed 200 OK in 70ms (Views: 55.7ms | ActiveRecord: 6.3ms | Allocations: 29650)
2021-01-28T10:47:47 [I|app|d20b7aef] Started GET "/foreman_tasks/api/tasks/16a5ce2d-c0e2-4c9a-ac88-c723b641d6fd/details?include_permissions" for 127.0.0.1 at 2021-01-28 10:47:47 +0000
2021-01-28T10:47:47 [I|app|d20b7aef] Processing by ForemanTasks::Api::TasksController#details as JSON
2021-01-28T10:47:47 [I|app|d20b7aef] Parameters: {"include_permissions"=>nil, "id"=>"16a5ce2d-c0e2-4c9a-ac88-c723b641d6fd"}
2021-01-28T10:47:47 [I|app|d20b7aef] Rendering /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/views/foreman_tasks/api/tasks/details.json.rabl
2021-01-28T10:47:47 [I|app|d20b7aef] Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/views/foreman_tasks/api/tasks/details.json.rabl (Duration: 74.4ms | Allocations: 27210)
2021-01-28T10:47:47 [I|app|d20b7aef] Completed 200 OK in 92ms (Views: 70.5ms | ActiveRecord: 7.4ms | Allocations: 29650)
2021-01-28T10:47:47 [I|app|26affa04] Started GET "/rhsm/status" for 127.0.0.1 at 2021-01-28 10:47:47 +0000
2021-01-28T10:47:47 [I|app|26affa04] Processing by Katello::Api::Rhsm::CandlepinProxiesController#server_status as JSON
2021-01-28T10:47:47 [I|app|26affa04] Completed 200 OK in 67ms (Views: 0.8ms | ActiveRecord: 2.6ms | Allocations: 2907)

Hi All,

Sync failed with below exception

RestClient::Exceptions::ReadTimeout: Timed out reading data from server

PFB pulp backtrace

/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-2.0.2/lib/restclient/request.rb:733:in `rescue in transmit'
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-2.0.2/lib/restclient/request.rb:642:in `transmit'
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-2.0.2/lib/restclient/request.rb:145:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-2.0.2/lib/restclient/request.rb:52:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/rest-client-2.0.2/lib/restclient/resource.rb:67:in `post'
/opt/theforeman/tfm/root/usr/share/gems/gems/runcible-2.13.1/lib/runcible/base.rb:94:in `get_response'
/opt/theforeman/tfm/root/usr/share/gems/gems/runcible-2.13.1/lib/runcible/base.rb:74:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/runcible-2.13.1/lib/runcible/resources/repository.rb:98:in `sync'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.16.2/app/services/katello/pulp/repository.rb:104:in `sync'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.16.2/app/lib/actions/pulp/repository/sync.rb:20:in `invoke_external_task'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action/polling.rb:84:in `initiate_external_action'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action/polling.rb:19:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action/cancellable.rb:14:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.16.2/app/lib/actions/pulp/abstract_async_task.rb:45:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:571:in `block (3 levels) in execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:32:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.16.2/app/lib/actions/middleware/remote_action.rb:16:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.16.2/app/lib/actions/middleware/remote_action.rb:40:in `block in as_remote_user'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.16.2/app/models/katello/concerns/user_extensions.rb:21:in `cp_config'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.16.2/app/lib/actions/middleware/remote_action.rb:27:in `as_cp_user'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.16.2/app/lib/actions/middleware/remote_action.rb:39:in `as_remote_user'
/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.16.2/app/lib/actions/middleware/remote_action.rb:16:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/rails_executor_wrap.rb:14:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.1/lib/active_support/execution_wrapper.rb:88:in `wrap'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/rails_executor_wrap.rb:13:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action/progress.rb:31:in `with_progress_calculation'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action/progress.rb:17:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_request_id.rb:15:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_request_id.rb:49:in `restore_current_request_id'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_request_id.rb:15:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_timezone.rb:15:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_timezone.rb:44:in `restore_curent_timezone'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_timezone.rb:15:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_user.rb:15:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_user.rb:44:in `restore_curent_user'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_user.rb:15:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in `block in run'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_taxonomies.rb:45:in `restore_current_taxonomies'
/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-2.0.2/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:27:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:19:in `pass'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware.rb:32:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/stack.rb:23:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/middleware/world.rb:31:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:570:in `block (2 levels) in execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:569:in `catch'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:569:in `block in execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:472:in `block in with_error_handling'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:472:in `catch'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:472:in `with_error_handling'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:564:in `execute_run'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/action.rb:285:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:18:in `block (2 levels) in execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/execution_plan/steps/abstract.rb:167:in `with_meta_calculation'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:17:in `block in execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:32:in `open_action'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:16:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/director.rb:68:in `execute'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/executors/sidekiq/worker_jobs.rb:11:in `block (2 levels) in perform'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/executors.rb:18:in `run_user_code'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/executors/sidekiq/worker_jobs.rb:9:in `block in perform'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/executors/sidekiq/worker_jobs.rb:25:in `with_telemetry'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/executors/sidekiq/worker_jobs.rb:8:in `perform'
/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.7/lib/dynflow/executors/sidekiq/serialization.rb:27:in `perform'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:192:in `execute_job'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:165:in `block (2 levels) in process'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/middleware/chain.rb:128:in `block in invoke'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/middleware/chain.rb:133:in `invoke'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:164:in `block in process'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:137:in `block (6 levels) in dispatch'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/job_retry.rb:109:in `local'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:136:in `block (5 levels) in dispatch'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq.rb:37:in `block in <module:Sidekiq>'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:132:in `block (4 levels) in dispatch'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:250:in `stats'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:127:in `block (3 levels) in dispatch'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/job_logger.rb:8:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:126:in `block (2 levels) in dispatch'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/job_retry.rb:74:in `global'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:125:in `block in dispatch'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/logging.rb:48:in `with_context'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/logging.rb:42:in `with_job_hash_context'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:124:in `dispatch'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:163:in `process'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:83:in `process_one'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/processor.rb:71:in `run'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/util.rb:16:in `watchdog'
/opt/theforeman/tfm/root/usr/share/gems/gems/sidekiq-5.2.7/lib/sidekiq/util.rb:25:in `block in safe_thread'
/opt/theforeman/tfm/root/usr/share/gems/gems/logging-2.2.2/lib/logging/diagnostic_context.rb:474:in `block in create_with_logging_context'