Project

General

Profile

Pulp 3 Integration » History » Version 75

Justin Sherrill, 09/08/2021 12:29 PM

1 1 Justin Sherrill
h1. Pulp 3 Integration
2
3
This page is meant to capture links to various resources around pulp3 integration
4
5
* Initial Integration Document: https://docs.google.com/document/d/1eFM4H9BteA_nTDbUkRJgEiqSttXfAtB9-51a_OuwVJw/edit?usp=sharing
6
* Initial Community Post: https://community.theforeman.org/t/pulp-3-migration/10474
7
* Youtube Videos: https://www.youtube.com/playlist?list=PL59WSIBtIpv7tbjnsEAWNcdiOKAmjjgqE
8
* Tasks List: https://docs.google.com/spreadsheets/d/1PFx-VAEXlivlqDYR9INMW26AUWtuMS_XtEnwhFVP5Rc/edit?usp=sharing
9 17 John Mitsch
* Main Tracker: https://projects.theforeman.org/issues/26987
10 2 Justin Sherrill
11 41 Justin Sherrill
h2. Katello Dev box with pulp3:
12 40 Samir Jha
13 62 Justin Sherrill
Dev boxes are deployed with pulp3 by default, via an rpm installation
14 40 Samir Jha
* vagrant up katello-dev-box
15 1 Justin Sherrill
* vagrant ssh katello-dev-box
16 40 Samir Jha
17 44 Samir Jha
h2. Katello Dev box with pulp3 on master:
18 1 Justin Sherrill
19 69 Samir Jha
Dev boxes come installed and configured to use yum, docker and files on pulp3. 
20
To enable ansible collection content type, you need to perform the following steps on the devel box:
21 1 Justin Sherrill
22 69 Samir Jha
#  <pre>
23 71 Samir Jha
#  sudo pip3 install pulp-ansible==0.7.0
24 72 Samir Jha
#  sudo mv /usr/local/lib/python3.6/site-packages/pulp_ansibl* /usr/lib/python3.6/site-packages/
25 70 Samir Jha
#  sudo -u pulp PULP_SETTINGS='/etc/pulp/settings.py' DJANGO_SETTINGS_MODULE='pulpcore.app.settings' python3-django-admin migrate --no-input
26 69 Samir Jha
#  </pre>
27
#  In file ~/foreman/config/settings.plugins.d/katello.yaml, 
28
#  Add :ansible_collection: true to the dict of content types.
29 70 Samir Jha
#  Restart foreman server and refresh smart proxy features.
30 1 Justin Sherrill
31
h2. Updating to a New Pulp Version in master & nightly:
32
33 74 Justin Sherrill
1.  Request build of new version via the discourse Development discussion unless its already built: http://yum.theforeman.org/pulpcore/  (https://github.com/theforeman/pulpcore-packaging).  List the plugin versions you would like (usually the latest of them all) and request a time frame (try to give ~2 weeks). Example: https://community.theforeman.org/t/request-for-pulpcore-3-13-builds/23855
34 73 Justin Sherrill
1.  Send an email to satellite-delivery@redhat.com and link to the discourse thread.
35
2.  Once the new yum repo is available, update your pulp packages locally on your devel environment.  If you are wanting to jump ahead, try to pip3 install the new versions and pray.
36 63 Justin Sherrill
3.  Identify any installer changes, open installer PRs
37
4.  Identify katello updates:
38 48 Samir Jha
* Updating pulp client gem bindings in katello.gemspec 
39 1 Justin Sherrill
* re-record vcr cassettes
40 48 Samir Jha
* Identify any katello code changes needed to fix test cases
41 1 Justin Sherrill
* open katello PR with changes
42 67 Justin Sherrill
43 66 Justin Sherrill
5. Update katello-repos in https://github.com/theforeman/foreman-packaging to point to the new version
44
6. Update forklift to deploy with the new version: https://github.com/theforeman/forklift/blob/master/vagrant/config/versions.yaml
45 48 Samir Jha
46 63 Justin Sherrill
5. Update client binding rpms at foreman-packaging
47
48 1 Justin Sherrill
49 75 Justin Sherrill
h2. Using a 2nd server as a pulp server, for use in development.
50
If you have a devel environment and want to spin up a 2nd dev box via pulp_installer to test with, for example to dev or test against a pulp version that doesn't have rpm builds yet.
51
52
1.  Spinup a fresh dev environment, or reset your old one with 'bundle exec rake katello:reset'
53
2.  On your hypervisor, setup pulp-installer:
54 1 Justin Sherrill
<pre>
55 75 Justin Sherrill
git clone https://github.com/pulp/pulp_installer
56
cd pulp_installer
57
git clone  https://github.com/theforeman/forklift.git
58 1 Justin Sherrill
</pre>
59 75 Justin Sherrill
3.  edit pulp_installer/example.user-config.yml  uncomment plugins to install
60
4.  Spin up PULP3 Box:
61 1 Justin Sherrill
<pre>
62 75 Justin Sherrill
vagrant up pulp3-sandbox-centos7
63
vagant ssh pulp3-sandbox-centos7
64 1 Justin Sherrill
</pre>
65 75 Justin Sherrill
5.  grab the ip address and hostname of the PULP3 box:
66 1 Justin Sherrill
<pre>
67 75 Justin Sherrill
sudo yum install net-tools
68
hostname
69
ifconfig
70 1 Justin Sherrill
</pre>
71 75 Justin Sherrill
6.  Add hostname/ipaddress to /etc/hosts on the KATELLO server, as root:
72 60 Samir Jha
<pre>
73 75 Justin Sherrill
   echo "192.168.0.8  pulp3-sandbox-centos7.example.com" >> /etc/hosts
74
</pre> 
75
7.  Reset the admin password on the PULP3 Box:
76
<pre>
77
sudo pulpcore-manager reset-admin-password --password password
78 64 Samir Jha
</pre>
79
80 75 Justin Sherrill
8.  copy contents of  /etc/pulp/certs/root.crt on PULP box to the KATELLO box in file: /etc/pki/ca-trust/source/anchors/pulpcore.crt
81
9.  Update ca trust:
82
<pre>
83
update-ca-trust
84
</pre>
85 62 Justin Sherrill
86 75 Justin Sherrill
10. On the KATELLO box, reconfigure the smart proxy plugin, edit  /etc/foreman-proxy/settings.d/pulpcore.yml  replace contents with (Substituting correct hostname):
87
<pre>
88
---
89
:enabled: https
90
:pulp_url: https://pulp3-sandbox-centos7.balmora.example.com
91
:content_app_url: https://pulp3-sandbox-centos7.balmora.example.com/pulp/content
92
:mirror: false
93
:username: admin
94
:password: password
95
</pre>
96 62 Justin Sherrill
97 75 Justin Sherrill
11.  restart the foreman-proxy:
98 60 Samir Jha
<pre>
99 75 Justin Sherrill
systemctl restart foreman-proxy
100 59 Ian Ballou
</pre>
101 75 Justin Sherrill
12.  Navigate to Infrastructure > Smart proxies and refresh the smart proxy features
102 59 Ian Ballou
103
h2. Example for querying the Pulp 3 API in a development environment:
104 68 Ian Ballou
<pre>
105
curl https://`hostname`/pulp/api/v3/status/   --cert /etc/pki/katello/certs/pulp-client.crt  --key /etc/pki/katello/private/pulp-client.key
106 25 Justin Sherrill
</pre>
107
108
Recommendation: try the pulp-cli: https://github.com/pulp/pulp-cli#katello
109
110
h3. Other Resources
111 1 Justin Sherrill
112
* pulp3 gap analysis wiki https://projects.theforeman.org/projects/katello/wiki/PulpV3GapAnalysis
113
* pulp3 gap analysis etherpad https://etherpad.net/p/pulp3_container
114
* pulp3 docker roadmap https://pulp.plan.io/projects/pulp/wiki/Pulp_Docker_Roadmap