Bug #20362
closedProcessing outputs of remote command on the smart-proxy is slow.
Description
Cloned from https://bugzilla.redhat.com/show_bug.cgi?id=1473263
Description of problem:
When running jobs on large number of hosts, slow checking of outputs can have severe impact on execution time of the entire job.
Version-Release number of selected component (if applicable):
How reproducible:
Steps to Reproduce:
1. Run a job on 1k hosts outputting a single character each second for five minutes.
2. Run a job on 1k hosts outputting a single character into a temporary file each second for five minutes and reading it whole at the end.
Actual results:
The first job is by orders of magnitude slower than the second one.
Expected results:
The two jobs should take roughly the same amount of time to finish.
Additional info:
Job #1: 15:22:43 - 16:43:24 (almost hour and a half)
Job #2: 18:09:38 - 18:23:40 (roughly 15 minutes)
Updated by Adam Ruzicka almost 7 years ago
- Category set to Smart Proxy Dynflow
- Target version set to 113
Updated by Adam Ruzicka about 3 years ago
- Triaged set to No
Outputs are currently stored as in output column in dynflow_actions table. Each update means reading the entire field, appending the updates and then writing it back. Maybe we should rethink our approach and have a append-only table for outputs?
Updated by Adam Ruzicka almost 3 years ago
- Project changed from Foreman Remote Execution to foreman-tasks
- Category changed from Smart Proxy Dynflow to Foreman plugin
- Status changed from New to Assigned
- Assignee set to Adam Ruzicka
Updated by Adam Ruzicka almost 3 years ago
- Related to Bug #32565: Collect chunked outputs added
Updated by The Foreman Bot almost 3 years ago
- Status changed from Assigned to Ready For Testing
- Pull request https://github.com/theforeman/foreman-tasks/pull/633 added
Updated by Adam Ruzicka almost 3 years ago
- Status changed from Ready For Testing to Rejected
Due to recent changes, the fix will live in smart_proxy_dynflow. See https://projects.theforeman.org/issues/32565