Status: stopped

Result: warning

Started at: 2016-05-12 13:08:08 UTC

Ended at: 2016-05-27 13:26:12 UTC

sequence concurrence
4: Actions::Pulp::Repository::DistributorPublish (skipped) [ 1297083.46s / 15.79s ]

Started at: 2016-05-12 13:08:09 UTC

Ended at: 2016-05-27 13:26:12 UTC

Real time: 1297083.46s

Execution time (excluding suspended state): 15.79s

Input:

---
pulp_id: Verifone-Centos_6-6
distributor_type_id: nodes_http_distributor
remote_user: admin
remote_cp_user: admin
locale: en

Output:

---
pulp_tasks:
- exception: 
  task_type: pulp.server.managers.repo.publish.publish
  _href: "/pulp/api/v2/tasks/a3eac3cd-ee9e-4120-8ec0-0e70812e9cb1/"
  task_id: a3eac3cd-ee9e-4120-8ec0-0e70812e9cb1
  tags:
  - pulp:repository:Verifone-Centos_6-6
  - pulp:action:publish
  finish_time: '2016-05-12T13:08:45Z'
  _ns: task_status
  start_time: '2016-05-12T13:08:09Z'
  traceback: |
    Traceback (most recent call last):
      File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 240, in trace_task
        R = retval = fun(*args, **kwargs)
      File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 328, in __call__
        return super(Task, self).__call__(*args, **kwargs)
      File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 437, in __protected_call__
        return self.run(*args, **kwargs)
      File "/usr/lib/python2.7/site-packages/pulp/server/managers/repo/publish.py", line 99, in publish
        transfer_repo, conduit, call_config)
      File "/usr/lib/python2.7/site-packages/pulp/server/managers/repo/publish.py", line 127, in _do_publish
        publish_report = publish_repo(transfer_repo, conduit, call_config)
      File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 483, in wrap_f
        return f(*args, **kwargs)
      File "/usr/lib/python2.7/site-packages/pulp_node/distributors/http/distributor.py", line 127, in publish_repo
        publisher.publish(units)
      File "/usr/lib/python2.7/site-packages/pulp_node/distributors/http/publisher.py", line 51, in publish
        manifest_path = super(self.__class__, self).publish(units)
      File "/usr/lib/python2.7/site-packages/pulp_node/distributors/publisher.py", line 127, in publish
        writer.add(unit)
      File "/usr/lib/python2.7/site-packages/pulp_node/manifest.py", line 368, in __exit__
        self.close()
      File "/usr/lib/python2.7/site-packages/pulp_node/manifest.py", line 360, in close
        self.fp.close()
      File "/usr/lib64/python2.7/gzip.py", line 368, in close
        self.fileobj.write(self.compress.flush())
    IOError: [Errno 28] No space left on device
  spawned_tasks: []
  progress_report: {}
  queue: reserved_resource_worker-5@nz2zsat01.pp.vficonnect.net.nz.dq
  state: error
  worker_name: reserved_resource_worker-5@nz2zsat01.pp.vficonnect.net.nz
  result: 
  error:
    code: PLP0000
    data: {}
    description: "[Errno 28] No space left on device"
    sub_errors: []
  _id:
    "$oid": 57348039420b11e84faedd41
  id: 5734803963a1031b148b2a0c
poll_attempts:
  total: 16
  failed: 0

Error:

Katello::Errors::PulpError

PLP0000: [Errno 28] No space left on device

---
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-2.4.1/app/lib/actions/pulp/abstract_async_task.rb:71:in
  `block in done?'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-2.4.1/app/lib/actions/pulp/abstract_async_task.rb:69:in
  `each'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-2.4.1/app/lib/actions/pulp/abstract_async_task.rb:69:in
  `done?'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/action/polling.rb:28:in
  `run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/action/cancellable.rb:9:in
  `run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-2.4.1/app/lib/actions/pulp/abstract_async_task.rb:45:in
  `run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/action.rb:506:in
  `block (3 levels) in execute_run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/middleware/stack.rb:26:in
  `call'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/middleware/stack.rb:26:in
  `pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/middleware.rb:17:in
  `pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/middleware.rb:30:in
  `run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/middleware/stack.rb:22:in
  `call'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/middleware/stack.rb:26:in
  `pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/middleware.rb:17:in
  `pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-2.4.1/app/lib/actions/middleware/remote_action.rb:16:in
  `block in run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-2.4.1/app/lib/actions/middleware/remote_action.rb:46:in
  `block (2 levels) in as_remote_user'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-2.4.1/app/lib/katello/util/thread_session.rb:72:in
  `pulp_config'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-2.4.1/app/lib/actions/middleware/remote_action.rb:32:in
  `as_pulp_user'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-2.4.1/app/lib/actions/middleware/remote_action.rb:45:in
  `block in as_remote_user'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-2.4.1/app/lib/katello/util/thread_session.rb:79:in
  `cp_config'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-2.4.1/app/lib/actions/middleware/remote_action.rb:27:in
  `as_cp_user'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-2.4.1/app/lib/actions/middleware/remote_action.rb:44:in
  `as_remote_user'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-2.4.1/app/lib/actions/middleware/remote_action.rb:16:in
  `run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/middleware/stack.rb:22:in
  `call'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/middleware/stack.rb:26:in
  `pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/middleware.rb:17:in
  `pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/action/progress.rb:30:in
  `with_progress_calculation'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/action/progress.rb:16:in
  `run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/middleware/stack.rb:22:in
  `call'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/middleware/stack.rb:26:in
  `pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/middleware.rb:17:in
  `pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-2.4.1/app/lib/actions/middleware/keep_locale.rb:11:in
  `block in run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-2.4.1/app/lib/actions/middleware/keep_locale.rb:22:in
  `with_locale'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-2.4.1/app/lib/actions/middleware/keep_locale.rb:11:in
  `run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/middleware/stack.rb:22:in
  `call'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/middleware/stack.rb:26:in
  `pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/middleware.rb:17:in
  `pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/middleware.rb:30:in
  `run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/middleware/stack.rb:22:in
  `call'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/middleware/world.rb:30:in
  `execute'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/action.rb:505:in
  `block (2 levels) in execute_run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/action.rb:504:in
  `catch'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/action.rb:504:in
  `block in execute_run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/action.rb:419:in
  `call'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/action.rb:419:in
  `block in with_error_handling'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/action.rb:419:in
  `catch'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/action.rb:419:in
  `with_error_handling'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/action.rb:499:in
  `execute_run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/action.rb:260:in
  `execute'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:9:in
  `block (2 levels) in execute'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/execution_plan/steps/abstract.rb:155:in
  `call'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/execution_plan/steps/abstract.rb:155:in
  `with_meta_calculation'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:8:in
  `block in execute'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:22:in
  `open_action'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:7:in
  `execute'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/executors/parallel/worker.rb:15:in
  `block in on_message'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/algebrick-0.7.3/lib/algebrick/matchers/abstract.rb:74:in
  `block in assigns'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/algebrick-0.7.3/lib/algebrick/matchers/abstract.rb:73:in
  `tap'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/algebrick-0.7.3/lib/algebrick/matchers/abstract.rb:73:in
  `assigns'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/algebrick-0.7.3/lib/algebrick/matching.rb:56:in
  `match_value'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/algebrick-0.7.3/lib/algebrick/matching.rb:36:in
  `block in match?'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/algebrick-0.7.3/lib/algebrick/matching.rb:35:in
  `each'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/algebrick-0.7.3/lib/algebrick/matching.rb:35:in
  `match?'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/algebrick-0.7.3/lib/algebrick/matching.rb:23:in
  `match'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/executors/parallel/worker.rb:12:in
  `on_message'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/context.rb:46:in
  `on_envelope'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/behaviour/executes_context.rb:7:in
  `on_envelope'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/behaviour/abstract.rb:25:in
  `pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/actor.rb:26:in
  `on_envelope'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/behaviour/abstract.rb:25:in
  `pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/behaviour/awaits.rb:15:in
  `on_envelope'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/behaviour/abstract.rb:25:in
  `pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/behaviour/sets_results.rb:14:in
  `on_envelope'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/behaviour/abstract.rb:25:in
  `pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/behaviour/buffer.rb:38:in
  `process_envelope'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/behaviour/buffer.rb:31:in
  `process_envelopes?'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/behaviour/buffer.rb:20:in
  `on_envelope'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/behaviour/abstract.rb:25:in
  `pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/behaviour/termination.rb:55:in
  `on_envelope'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/behaviour/abstract.rb:25:in
  `pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/behaviour/removes_child.rb:10:in
  `on_envelope'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/behaviour/abstract.rb:25:in
  `pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/behaviour/sets_results.rb:14:in
  `on_envelope'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/core.rb:161:in
  `process_envelope'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/core.rb:95:in
  `block in on_envelope'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/core.rb:118:in
  `block (2 levels) in schedule_execution'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.0/lib/concurrent/synchronization/mri_lockable_object.rb:62:in
  `block in synchronize'"
- "/opt/rh/ruby193/root/usr/share/ruby/monitor.rb:211:in `mon_synchronize'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.0/lib/concurrent/synchronization/mri_lockable_object.rb:62:in
  `synchronize'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.2.0/lib/concurrent/actor/core.rb:115:in
  `block in schedule_execution'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.0/lib/concurrent/executor/serialized_execution.rb:18:in
  `call'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.0/lib/concurrent/executor/serialized_execution.rb:18:in
  `call'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.0/lib/concurrent/executor/serialized_execution.rb:96:in
  `work'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.0/lib/concurrent/executor/serialized_execution.rb:77:in
  `block in call_job'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.0/lib/concurrent/executor/ruby_thread_pool_executor.rb:333:in
  `call'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.0/lib/concurrent/executor/ruby_thread_pool_executor.rb:333:in
  `run_task'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.0/lib/concurrent/executor/ruby_thread_pool_executor.rb:322:in
  `block (3 levels) in create_worker'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.0/lib/concurrent/executor/ruby_thread_pool_executor.rb:305:in
  `loop'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.0/lib/concurrent/executor/ruby_thread_pool_executor.rb:305:in
  `block (2 levels) in create_worker'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.0/lib/concurrent/executor/ruby_thread_pool_executor.rb:304:in
  `catch'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-1.0.0/lib/concurrent/executor/ruby_thread_pool_executor.rb:304:in
  `block in create_worker'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/logging-1.8.2/lib/logging/diagnostic_context.rb:323:in
  `call'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/logging-1.8.2/lib/logging/diagnostic_context.rb:323:in
  `block in create_with_logging_context'"

8: Actions::Pulp::Consumer::ActivateNode (success) [ 0.32s / 0.32s ]

Started at: 2016-05-12 13:08:09 UTC

Ended at: 2016-05-12 13:08:09 UTC

Real time: 0.32s

Execution time (excluding suspended state): 0.32s

Input:

---
uuid: 588d0e3f-f488-4340-8292-266bb4b01a41
display_name: awscapsule01.test.aws.syd.vficonnect.internal
remote_user: admin
remote_cp_user: admin
locale: en

Output:

--- {}

11: Actions::Pulp::Consumer::SyncNode (success) [ 212.62s / 21.59s ]

Started at: 2016-05-12 13:08:09 UTC

Ended at: 2016-05-12 13:11:42 UTC

Real time: 212.62s

Execution time (excluding suspended state): 21.59s

Input:

---
consumer_uuid: 588d0e3f-f488-4340-8292-266bb4b01a41
repo_ids:
- Verifone-Centos_6-6
remote_user: admin
remote_cp_user: admin
locale: en

Output:

---
pulp_tasks:
- exception: 
  task_type: 
  _href: "/pulp/api/v2/tasks/3bcd7774-d69d-4a79-9790-a909ae0fe000/"
  task_id: 3bcd7774-d69d-4a79-9790-a909ae0fe000
  tags:
  - pulp:consumer:588d0e3f-f488-4340-8292-266bb4b01a41
  - pulp:action:unit_update
  finish_time: '2016-05-12T13:10:16Z'
  _ns: task_status
  start_time: '2016-05-12T13:09:30Z'
  traceback: 
  spawned_tasks: []
  progress_report:
    progress:
    - state: import_finished
      repo_id: Verifone-Centos_6-6
      unit_add:
        completed: 0
        total: 0
        details: 
    state: finished
  queue: agent.dq
  state: finished
  worker_name: agent
  result:
    details:
      repository:
        details:
          errors: []
          repositories:
          - action: merged
            sources:
              downloads: {}
              total_sources: 0
            repo_id: Verifone-Centos_6-6
            units:
              updated: 0
              removed: 0
              added: 0
        succeeded: true
    num_changes: 0
    succeeded: true
    reboot:
      scheduled: false
      details: {}
  error: 
  _id:
    "$oid": 5734803a63a1031ba9e6fad0
  id: 5734803a63a1031ba9e6fad0
poll_attempts:
  total: 32
  failed: 0
sync_task_is_accepted: true

event time world
start execution 2016-05-12 13:08:09 UTC e808ce32-6ede-488e-8ec8-a95e4c7f63fd
finish execution 2016-05-12 13:11:42 UTC e808ce32-6ede-488e-8ec8-a95e4c7f63fd
start execution 2016-05-27 13:26:12 UTC f036cf4b-051f-42ad-8119-708af1c06338
finish execution 2016-05-27 13:26:12 UTC f036cf4b-051f-42ad-8119-708af1c06338
Back