Project

General

Profile

Actions

Bug #20362

closed

Processing outputs of remote command on the smart-proxy is slow.

Added by Adam Ruzicka almost 7 years ago. Updated almost 3 years ago.

Status:
Rejected
Priority:
Normal
Assignee:
Category:
Foreman plugin
Target version:
-
Difficulty:
Triaged:
No
Fixed in Releases:
Found in Releases:

Description

Cloned from https://bugzilla.redhat.com/show_bug.cgi?id=1473263

Description of problem:
When running jobs on large number of hosts, slow checking of outputs can have severe impact on execution time of the entire job.

Version-Release number of selected component (if applicable):

How reproducible:

Steps to Reproduce:
1. Run a job on 1k hosts outputting a single character each second for five minutes.
2. Run a job on 1k hosts outputting a single character into a temporary file each second for five minutes and reading it whole at the end.

Actual results:
The first job is by orders of magnitude slower than the second one.

Expected results:
The two jobs should take roughly the same amount of time to finish.

Additional info:
Job #1: 15:22:43 - 16:43:24 (almost hour and a half)
Job #2: 18:09:38 - 18:23:40 (roughly 15 minutes)


Related issues 1 (0 open1 closed)

Related to foreman-tasks - Bug #32565: Collect chunked outputsClosedAdam RuzickaActions
Actions #1

Updated by Adam Ruzicka almost 7 years ago

  • Category set to Smart Proxy Dynflow
  • Target version set to 113
Actions #2

Updated by Adam Ruzicka about 3 years ago

  • Triaged set to No

Outputs are currently stored as in output column in dynflow_actions table. Each update means reading the entire field, appending the updates and then writing it back. Maybe we should rethink our approach and have a append-only table for outputs?

Actions #3

Updated by Marek Hulán about 3 years ago

Yes

Actions #4

Updated by Adam Ruzicka almost 3 years ago

  • Project changed from Foreman Remote Execution to foreman-tasks
  • Category changed from Smart Proxy Dynflow to Foreman plugin
  • Status changed from New to Assigned
  • Assignee set to Adam Ruzicka
Actions #5

Updated by Adam Ruzicka almost 3 years ago

  • Related to Bug #32565: Collect chunked outputs added
Actions #6

Updated by The Foreman Bot almost 3 years ago

  • Status changed from Assigned to Ready For Testing
  • Pull request https://github.com/theforeman/foreman-tasks/pull/633 added
Actions #7

Updated by Adam Ruzicka almost 3 years ago

  • Status changed from Ready For Testing to Rejected

Due to recent changes, the fix will live in smart_proxy_dynflow. See https://projects.theforeman.org/issues/32565

Actions

Also available in: Atom PDF