Turns out the issue was because the module had a symlink in it and pulp failed to import it with an error. Katello did not indicate there was an error though!
pulp error:
Mar 12 13:40:11 box pulp: pulp_puppet.plugins.importers.importer:ERROR: sub_dir = _find_file_in_dir(file_or_dir, filename)
Mar 12 13:40:11 box pulp: pulp_puppet.plugins.importers.importer:ERROR: File "/usr/lib/python2.6/site-packages/pulp_puppet/plugins/importers/metadata.py", line 224, in _find_file_in_dir
Mar 12 13:40:11 box pulp: pulp_puppet.plugins.importers.importer:ERROR: sub_dir = _find_file_in_dir(file_or_dir, filename)
Mar 12 13:40:11 box pulp: pulp_puppet.plugins.importers.importer:ERROR: File "/usr/lib/python2.6/site-packages/pulp_puppet/plugins/importers/metadata.py", line 224, in _find_file_in_dir
Mar 12 13:40:11 box pulp: pulp_puppet.plugins.importers.importer:ERROR: sub_dir = _find_file_in_dir(file_or_dir, filename)
Mar 12 13:40:11 box pulp: pulp_puppet.plugins.importers.importer:ERROR: File "/usr/lib/python2.6/site-packages/pulp_puppet/plugins/importers/metadata.py", line 224, in _find_file_in_dir
Mar 12 13:40:11 box pulp: pulp_puppet.plugins.importers.importer:ERROR: sub_dir = _find_file_in_dir(file_or_dir, filename)
Mar 12 13:40:11 box pulp: pulp_puppet.plugins.importers.importer:ERROR: File "/usr/lib/python2.6/site-packages/pulp_puppet/plugins/importers/metadata.py", line 224, in _find_file_in_dir
Mar 12 13:40:11 box pulp: pulp_puppet.plugins.importers.importer:ERROR: sub_dir = _find_file_in_dir(file_or_dir, filename)
Mar 12 13:40:11 box pulp: pulp_puppet.plugins.importers.importer:ERROR: File "/usr/lib/python2.6/site-packages/pulp_puppet/plugins/importers/metadata.py", line 224, in _find_file_in_dir
Mar 12 13:40:11 box pulp: pulp_puppet.plugins.importers.importer:ERROR: sub_dir = _find_file_in_dir(file_or_dir, filename)
Mar 12 13:40:11 box pulp: pulp_puppet.plugins.importers.importer:ERROR: File "/usr/lib/python2.6/site-packages/pulp_puppet/plugins/importers/metadata.py", line 218, in _find_file_in_dir
Mar 12 13:40:11 box pulp: pulp_puppet.plugins.importers.importer:ERROR: for found in os.listdir(dir):
Mar 12 13:40:11 box pulp: pulp_puppet.plugins.importers.importer:ERROR: OSError: [Errno 2] No such file or directory: '/var/lib/pulp/working/repos/Default_Organization-myproduct-puppet/importers/puppet_importer/tmpjod9Rx/haraldsk-nfs-1.1.1/spec/fixtures/modules/nfs/files'
Mar 12 13:40:11 box pulp: celery.worker.job:INFO: Task pulp.server.managers.content.upload.import_uploaded_unit[ef2e3bbc-3202-46ee-83a3-d6d7a31b72d9] succeeded in 0.0985451119996s: {'details': {}, 'success_flag': False, 'summary': ''}