summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2021-02-09Customize helm "--timeout" option format if running helm v3Bartek Grzybowski3-3/+4
Helm v3 requires unit definition for 'timeout' option which is not supported by Helm v2. Change-Id: Ia5839e5c412be1700459c70d43d2e6cc0400633d Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-02-05Redirect chartmuseum stdout/stderr to /dev/nullBartek Grzybowski1-4/+8
Chartmuseum logs to it's stdout/stderr during it's normal operations and since the shell pipe opened by ansible is gone once playbook finishes this resulted in chartmuseum process crashing with "broken pipe" message. Change-Id: I0e2a5471df23f5881248ecb529a0193505f56cfe Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-02-04Drop DIND specific test env settings for 'rke' role/playbookBartek Grzybowski5-76/+1
DIND usage was already dropped so those settings are no longer required. Change-Id: Ifd2b5f26196f84ff0167558c1d5cd4c8218124d7 Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-02-04Improve bin utils symlink creation logicBartek Grzybowski1-14/+9
Change-Id: I9f468b6c731aaa764340e8503e6f377faba522b2 Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-02-04Add test scenario for Helm v3Bartek Grzybowski8-1/+76
Change-Id: Iad5478f70533719e1076f3961613fddffb14eebd Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-02-04Refactor Helm role test setupBartek Grzybowski9-12/+25
Test setup variable inclusion reworked for better sanity. General Molecule docker image is used instead of pre-built one. Change-Id: I013b9d7b92ded86220e6f2092ce75ee47b094d89 Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-02-04Add helm-push Helm v3 plugin to downloaded utilities listBartek Grzybowski2-0/+4
Change-Id: Iafc200d98ee69d444d2fa82ddc95c15ba008889a Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-02-04Fix Helm v3 data dir setupBartek Grzybowski2-4/+8
Verifier test is also added to ensure correct plugin deployment. Change-Id: I2e43d942f39fc7ecfe34c22d84ba0f59978ec225 Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-02-04Add tasks to setup Helm v3 on infra nodeBartek Grzybowski2-0/+15
Change-Id: I959184624f93753ff7217728c3c6011e82f91ef6 Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-02-04Add Helm v3 test scenario to rke playbook testsBartek Grzybowski5-0/+62
Change-Id: I2d6d650110fbdc84ce7e0922239c7b219e35d5ee Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-02-03Change 'rke' role testing strategyBartek Grzybowski12-79/+41
So far Molecule framework setup allowed full rke cluster deployment in testing env but since rke cluster often fails to deploy in resource constrained CI environment this change switches testing strategy to only simulate 'rke up' operation. Change-Id: Ia221da6666d558e086cd24155f5bd81237d82388 Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-02-02Workaround RKE binary download issueBartek Grzybowski1-3/+7
RKE binary download was _randomly_ failing (in ONAP's CI minion only) with a message '_ssl.c:602: The handshake operation timed out' without any easily trackable reason. Hence switching from get_url ansible module to direct 'curl' command invocation which allows better timeout handling at connection phase. Change-Id: I70d734dfd8c04ba8b092350933c97c56f74d6208 Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-01-28Play 'chartmuseum' role in rke playbook if running with Helm v3Bartek Grzybowski1-0/+2
Change-Id: Ica4bc217178ccbaa5574036d693fa40476fb0814 Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-01-28Fix variable inclusion order in RKE playbook testsBartek Grzybowski1-2/+2
Change-Id: Ie95d8fcb49c61f75f644ea3d04414cd6f2285efd Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-01-28Add Helm v3.3.4 to the list of downloaded utilitiesBartek Grzybowski1-0/+1
Change-Id: Ida635aac40557f079fc8ef611352bff82fc3e8c0 Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-01-26Add 'chartmuseum' binary to downloaded utilities listBartek Grzybowski2-0/+4
Packaging script is also altered to properly symlink the chartmuseum binary. Change-Id: I9a2f526852ae1ebdc0763a06a2cf22f093090aa6 Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-01-26Add Molecule test scenario to verify 'chartmuseum' role on UbuntuBartek Grzybowski1-0/+38
Change-Id: Ic3f78a9fd46bef8e3e2138d9c04850db00651b63 Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-01-26Add 'chartmuseum' roleBartek Grzybowski9-0/+119
Added 'chartmuseum' role which runs Helm repository server using chartmuseum. Change-Id: I8745cd7e602e147fb656297e0afb8e82a5d058ff Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-01-26Split Helm v2 setup to separate playbookBartek Grzybowski3-56/+59
Logically splitting the application playbook to put Helm v2 and v3 specific setup actions into separate tasks file. Change-Id: I20446a196bb2687e27fdeb6a45a83565b676fc42 Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-01-26Improve 'application' role test coverageBartek Grzybowski2-1/+10
Helm plugin installation task is now also covered Change-Id: Ib0a724de5dc1b300ea6cd27fe363b99b071d787b Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-01-26Add Helm v3 plugin deployment playbookBartek Grzybowski9-5/+111
Change-Id: I3999dd64dd87f163a3306b74cec88019d821759e Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-01-26Move Helm v2 plugin installation logic into separate playbookBartek Grzybowski5-25/+30
Change-Id: Icc767450da832d8792b7bdf33f85e5ffc97ee435 Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-01-21Add support for Helm v3Bartek Grzybowski1-25/+35
This change adds support for extracting docker image list using Helm version 3. Chartmuseum is used to serve the charts. Change-Id: Ib7d7da312c1d9750548dd560d9571eb4715c0fa8 Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-01-21Fix cleanup sequenceBartek Grzybowski1-2/+2
Chart repository process should be killed before removing it's storage Change-Id: Idd53a0cc812ca0d17beb3e0f7264de4280a6b536 Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-01-21Setup separate script logic for helm v3 handlingBartek Grzybowski1-22/+46
Change-Id: I2c1d5233ff43c2fc2cee104b1438089574935023 Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-01-21Set HELM_VERSION variableBartek Grzybowski1-0/+1
It will be leveraged for different handling of helm v2 and v3 workflow Change-Id: I3d3939ef2ed491e9534b560c24af7e4ba9ed505d Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-01-21Allow setting custom Helm binary pathBartek Grzybowski1-6/+28
Change-Id: I66e232a8c243df89a1a9b573c592a08c72dc5324 Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-01-18Update download link for Helm v2Bartek Grzybowski1-1/+1
Official helm binaries are hosted on get.helm.sh Change-Id: I4aab0b757f38e904a0bfd7483a92728f4a901a3a Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-12-30Support setting custom dns resolverBartek Grzybowski3-0/+8
This change allows setting custom dns resolvers on control node and all k8s hosts. Change-Id: I49db6e5d5d3b5be5082adc73810eb282dce14eed Issue-ID: OOM-2650 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-12-30Support setting custom docker registry mirror in cicdansibleBartek Grzybowski3-1/+20
This facility allows setting custom docker registry mirror on k8s hosts in Docker global config. Change-Id: I01d02bdbabf2bed0b5b55819ae22770dd52de771 Issue-ID: OOM-2650 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-12-22Don't refresh repository cache upon initBartek Grzybowski1-1/+1
Main reason for adding this option is that stable repo url of https://kubernetes-charts.storage.googleapis.com has been obsoleted hence the "init" command fails on trying to reach it. Since we're removing it afterwards anyway thus --skip-refresh will allow "init" to pass without actually trying to get it's contents. Change-Id: I0719648fcfaf30da52ae19327f024b901471f188 Issue-ID: OOM-2660 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-12-17Fix Molecule framework runner setup scriptsBartek Grzybowski1-1/+1
Ansible-lint release has to be set explicitly as the one installed by default breaks the linter execution. Change-Id: Id824fb3f4ae94cf8608736bbebb1809568193050 Issue-ID: OOM-2650 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-25Support "fake" OOM deploymentBartek Grzybowski1-1/+1
"Fake deployment" is an OOM offline deployment mode which allows to enumerate docker images utilized by auxiliary platform deployment tools, which are not used by any real ONAP helm charts, by the means of "helm template". Change-Id: Iaa26281a1e7ef7ac68bb9e9a99521e5791f913b6 Issue-ID: OOM-2639 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-23Enhance repo creation scripts idempotency by supporting cachingBartek Grzybowski2-21/+113
While 'yumdownloader' and 'apt-get download' commands do not re-download packages that are already present in working dir, scripts still need to perform package dependencies resolution which is a time consuming activity hence a feature was added to skip any further actions (download or deps resolution) on packages that are already present locally. For cold versus warm cache the gain in run time is: cold warm RPM 90s 10s DEB 7m 90s Change-Id: Ie502934cff6484844557832251e7ce0991789cfb Issue-ID: OOM-2635 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-20Fix Ubuntu package listBartek Grzybowski1-4/+2
Change-Id: I7d8d83622a3280b7f70b495500855134af1ab7e2 Issue-ID: OOM-2635 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-16Fix race condition while creating dest dir for docker imagesBartek Grzybowski1-2/+1
Docker_downloader module uses threads to concurrently save docker images to dest dir which creation is not guarded with any kind of thread lock object thus it could fail on os.makedirs as other thread could have already created that dir. Hence "exist_ok=True" opt is added to os.makedirs call so that it does not fail in such circumstances. Change-Id: I6e2d2c9864b71d038e7b2ed3018cdd3c01916956 Issue-ID: OOM-2631 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-12Support setting ansible docker image name from env variableBartek Grzybowski1-1/+4
Change-Id: Ie864f8e12bb9eac02a901d93c870c4679aedba94 Issue-ID: OOM-2625 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-12Upgrade nfs-utils package versionBartek Grzybowski1-1/+1
Change-Id: Ie824d8be21269b3c1ba233c6450ddab617f0159e Issue-ID: OOM-2615 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-12Merge changes from topic "OOM-2623"Bartek Grzybowski1-19/+83
* changes: Abort if helm process failed to spawn Add feature to set custom helm repository server port Override oom-cert-service docker container name Setup temporary helm repository
2020-11-12Abort if helm process failed to spawnBartek Grzybowski1-0/+10
Change-Id: I930d3ca4c3d9ab49286a38c0ea298abe807ac781 Issue-ID: OOM-2623 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-12Add feature to set custom helm repository server portBartek Grzybowski1-6/+46
Change-Id: Ia273290ce661c2e4887e16a3a323a7349c609546 Issue-ID: OOM-2623 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-10Add precise operating system package requirementsMarcin Wilk1-1/+1
In order to make sure that kubernetes nodes will be installed with the required software packages before the actual ONAP installation, the more specific requirements have been added to the Installation Guide. Issue-ID: OOM-2627 Change-Id: I4f9e2a5aed969563f94c360e59f034f5f8995f52 Signed-off-by: Marcin Wilk <m.wilk@samsung.com>
2020-11-04Override oom-cert-service docker container nameBartek Grzybowski1-2/+6
Container name for certificate generation tool is hardcoded as "generate-certs" hence multiple builds couldn't run in parallel. This change overrides DOCKER_CONTAINER oom-cert-service makefile variable changing the container name effectively. Change-Id: I397ab7f3b04d35070cfb492ca482521ee10159fa Issue-ID: OOM-2623 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-04Setup temporary helm repositoryBartek Grzybowski1-13/+23
A temporary helm repository will be created for the process of preparing data list and removed afterwards. This allows setting a separate working helm repo not affecting system wide configuration. Change-Id: I775e28b7c5f0e9b5259588032346ff392f1b1803 Issue-ID: OOM-2623 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-04Merge "Update package versions"Bartek Grzybowski1-3/+2
2020-10-30Update package versionsBartek Grzybowski1-3/+2
Drop packages that are downloaded as dependencies of others anyway Dependencies of container-selinux: --> Processing Dependency: policycoreutils-python for package: 2:container-selinux-2.119.2-1.911c772.el7_8.noarch --> Processing Dependency: audit-libs-python >= 2.1.3-4 for package: policycoreutils-python-2.5-34.el7.x86_64 --> Processing Dependency: checkpolicy for package: policycoreutils-python-2.5-34.el7.x86_64 Dependencies of nfs-utils: --> Processing Dependency: gssproxy >= 0.7.0-3 for package: 1:nfs-utils-1.3.0-0.66.el7_8.x86_64 Change-Id: Ia67399685af0205474fa21fbc1fe3ec7eea261bb Issue-ID: OOM-2615 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-30Fail the entrypoint script on any command failureBartek Grzybowski1-1/+2
Most importantly this will allowing propagating the failure to the wrapper script. Change-Id: I3f419f588e0f0fb5b459fa1d8e8d520b9f5c78d5 Issue-ID: OOM-2615 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-30Clean target repository dir prior to downloading packagesBartek Grzybowski1-0/+3
This increases idempotency and allows avoiding side effects in cases where repo dir already contains images that are not on the list of required packages. Change-Id: Ieaa4e407ae7aacdc8d25440d90860cb880df09e2 Issue-ID: OOM-2615 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-30Run docker container in foregroundBartek Grzybowski1-4/+2
This equals current behaviour of running in background and then attaching running container to print logs but will allow wrapper script to inherit exit code from entrypoint script. Change-Id: Ida447ef8024995de6cad81aa2dc857aec36e0d04 Issue-ID: OOM-2615 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-28Support setting custom Docker container name suffixBartek Grzybowski1-9/+14
Change-Id: Ic3e4553442efd4c565c834a80184ff78e978cdba Issue-ID: OOM-2612 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>