Project

General

Profile

Actions

Bug #24866

closed

Caching for job invocation macros

Added by Marek Hulán about 6 years ago. Updated about 6 years ago.

Status:
Closed
Priority:
Normal
Assignee:
Category:
Foreman
Target version:
-

Description

Cloned from https://bugzilla.redhat.com/show_bug.cgi?id=1600920

Description of problem:
When trying to run an Insights plan with 1 rule for "Kernel vulnerable to local privilege escalation via DCCP module (CVE-2017-6074)" on nearly 6K hosts, the execution of the plan seems to be very slow.

While this plan is executing, there are no other kind of jobs that are running in parallel(Repo sync, client reg, etc.)

Currently, the job seems to have executed on only 300 hosts in an hour and taking a look at the database, it seems the planning for task is very slow. Only 301 tasks have been planned.

SELECT COUNT FROM foreman_tasks_tasks WHERE parent_task_id='0f814ce4-2a8e-4be6-83a5-4359bcbb98eb';
-[ RECORD 1 ]
count | 301

Not sure, if this issue should go under which component, so marking it for tasks plugin. Please do correct it if necessary.

Version-Release number of selected component (if applicable):
Satellite 6.4 Snap 10

How reproducible:
Always

Steps to Reproduce:
1. Create a insights plan with applicability to about 6K hosts.
2. Execute the plan by clicking on Run Playbook.

Actual results:
The planning of the tasks for execution plan appears to be slow and the tasks seem to run very slowly(nearly serialized - If there are 2 tasks A and B, then B will start only after A has finished).

Additional info:
Foreman debug: http://debugs.theforeman.org/foreman-debug-vX0MA.tar.xz


Related issues 3 (1 open2 closed)

Related to Foreman Remote Execution - Bug #25178: jobs fails even if all subtasks succeedsNewActions
Related to Foreman Remote Execution - Bug #31310: Only Redis glob strings are supported: /\Ajob_invocationClosedActions
Copied from Ansible - Bug #24262: Insights Plan Execution is slow at scaleClosedMarek HulánActions
Actions #1

Updated by Marek Hulán about 6 years ago

  • Copied from Bug #24262: Insights Plan Execution is slow at scale added
Actions #2

Updated by Marek Hulán about 6 years ago

  • Status changed from New to Ready For Testing
  • Pull request https://github.com/theforeman/foreman_remote_execution/pull/374 added
  • Pull request deleted (https://github.com/theforeman/foreman_ansible/pull/203)

please cherry-pick back for 1.5.z release

Actions #3

Updated by The Foreman Bot about 6 years ago

  • Pull request https://github.com/theforeman/foreman_remote_execution/pull/375 added
Actions #4

Updated by Marek Hulán about 6 years ago

  • Status changed from Ready For Testing to Closed
Actions #5

Updated by Ivan Necas about 6 years ago

  • Fixed in Releases foreman_remote_execution 1.6.3 (Foreman 1.20) added
Actions #6

Updated by Adam Ruzicka about 6 years ago

  • Related to Bug #25178: jobs fails even if all subtasks succeeds added
Actions #7

Updated by Adam Ruzicka about 4 years ago

  • Related to Bug #31310: Only Redis glob strings are supported: /\Ajob_invocation added
Actions

Also available in: Atom PDF