summaryrefslogtreecommitdiffstats
path: root/build/creating_data
AgeCommit message (Collapse)AuthorFilesLines
2021-03-18Run chartmuseum in docker containerBartek Grzybowski1-31/+31
Switching from running local chartmuseum binary to chartmuseum docker container since docker engine is a runtime dependency anyway. Change-Id: I8aa66047d1fa91c2d248998a0c69a0e0a520af62 Issue-ID: OOM-2708 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-01-21Add support for Helm v3Bartek Grzybowski1-25/+35
This change adds support for extracting docker image list using Helm version 3. Chartmuseum is used to serve the charts. Change-Id: Ib7d7da312c1d9750548dd560d9571eb4715c0fa8 Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-01-21Fix cleanup sequenceBartek Grzybowski1-2/+2
Chart repository process should be killed before removing it's storage Change-Id: Idd53a0cc812ca0d17beb3e0f7264de4280a6b536 Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-01-21Setup separate script logic for helm v3 handlingBartek Grzybowski1-22/+46
Change-Id: I2c1d5233ff43c2fc2cee104b1438089574935023 Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-01-21Set HELM_VERSION variableBartek Grzybowski1-0/+1
It will be leveraged for different handling of helm v2 and v3 workflow Change-Id: I3d3939ef2ed491e9534b560c24af7e4ba9ed505d Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2021-01-21Allow setting custom Helm binary pathBartek Grzybowski1-6/+28
Change-Id: I66e232a8c243df89a1a9b573c592a08c72dc5324 Issue-ID: OOM-2665 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-12-22Don't refresh repository cache upon initBartek Grzybowski1-1/+1
Main reason for adding this option is that stable repo url of https://kubernetes-charts.storage.googleapis.com has been obsoleted hence the "init" command fails on trying to reach it. Since we're removing it afterwards anyway thus --skip-refresh will allow "init" to pass without actually trying to get it's contents. Change-Id: I0719648fcfaf30da52ae19327f024b901471f188 Issue-ID: OOM-2660 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-25Support "fake" OOM deploymentBartek Grzybowski1-1/+1
"Fake deployment" is an OOM offline deployment mode which allows to enumerate docker images utilized by auxiliary platform deployment tools, which are not used by any real ONAP helm charts, by the means of "helm template". Change-Id: Iaa26281a1e7ef7ac68bb9e9a99521e5791f913b6 Issue-ID: OOM-2639 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-12Abort if helm process failed to spawnBartek Grzybowski1-0/+10
Change-Id: I930d3ca4c3d9ab49286a38c0ea298abe807ac781 Issue-ID: OOM-2623 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-12Add feature to set custom helm repository server portBartek Grzybowski1-6/+46
Change-Id: Ia273290ce661c2e4887e16a3a323a7349c609546 Issue-ID: OOM-2623 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-04Override oom-cert-service docker container nameBartek Grzybowski1-2/+6
Container name for certificate generation tool is hardcoded as "generate-certs" hence multiple builds couldn't run in parallel. This change overrides DOCKER_CONTAINER oom-cert-service makefile variable changing the container name effectively. Change-Id: I397ab7f3b04d35070cfb492ca482521ee10159fa Issue-ID: OOM-2623 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-11-04Setup temporary helm repositoryBartek Grzybowski1-13/+23
A temporary helm repository will be created for the process of preparing data list and removed afterwards. This allows setting a separate working helm repo not affecting system wide configuration. Change-Id: I775e28b7c5f0e9b5259588032346ff392f1b1803 Issue-ID: OOM-2623 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-16Set SKIP_LINT=true prior to building helm repositoryBartek Grzybowski1-0/+1
SKIP_LINT was already configured to be set in deployment stage in change 0d90cf8fe895e62b7343088ca9a017eff32e92dd but was missed to be set in build script. Change-Id: I599882eaa2e509fda6a41ca5bf5ff77a275adf93 Issue-ID: OOM-2599 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-09Ignore error if helm stable repo is already removedBartek Grzybowski1-1/+1
Fixes e941ec1 Change-Id: I8b5cb6a81998e32204d49c0f2630e1097f830aee Issue-ID: OOM-2591 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-10-08Remove helm "stable" repo while building chartsBartek Grzybowski1-0/+1
"Stable" repo is removed on targed deployment by a relevant ansible task, it should be removed in build stage as well. Change-Id: Ia89435e73c547e7d1cc4de19d635173307d083f4 Issue-ID: OOM-2591 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-09-24Create directory for output list file if it doesn't existBartek Grzybowski1-0/+5
Should the output list file directory passed as second param not exist the script would fail. Change-Id: I4586df54b42eba2ace49f6aaf03b68042354b44a Issue-ID: OOM-2578 Signed-off-by: Bartek Grzybowski <b.grzybowski@partner.samsung.com>
2020-05-14Fix: docker-images-collector.sh collect empty image name in output list. ↵Mateusz Pilat1-1/+1
Adding also masterPassword param for helm templating The root cause is that not all parameters are present in aaf chart. It is an issue not only for image params, however other cases are not impacting us. Issue-ID: OOM-2405 Signed-off-by: Mateusz Pilat <m.pilat@partner.samsung.com> Change-Id: I1ad1d33717488a82a2ce1eebe524ee41e1264d40
2020-04-09Remove python 2 dependencyTomáš Levora1-4/+2
Removing python 2 dependency from docker-image-collector.sh Issue-ID: OOM-2359 Signed-off-by: Tomáš Levora <t.levora@partner.samsung.com> Change-Id: I6aa4d27cdb10e93981e3dacfb16b2d02a0bf0762
2019-11-25docker-images-collector.sh to use override values.yamlSamuli Silvius1-2/+2
Change docker-images-collector.sh script to use file oom/kubernetes/onap/resources/overrides/onap-all.yaml as input instead of oom/kubernetes/onap/values.yaml. Also small enable script running in Windows git bash. Issue-ID: OOM-2222 Signed-off-by: Samuli Silvius <s.silvius@partner.samsung.com> Change-Id: Idf7143ed9880ac510c103f4d3a4d5a45f375d71a
2019-10-30Fixing helm repo add missing second argument bugTomáš Levora1-1/+1
Fixing bug in creating new helm repository when the HELM_REPO was passed as one argument instead of two Issue-ID: OOM-2159 Change-Id: Id8aabad7d8e59aa4fb2eef01cfff28e3b7ab1259 Signed-off-by: Tomáš Levora <t.levora@partner.samsung.com>
2019-06-14Merge "Fix issue with yaml.load in docker collector"Petr Ospalý1-1/+1
2019-06-05Wrapping-up download refactorisationMichal Ptacek10-483/+0
This commit is making required adaptations mainly in BuildGuide and removing deprecated old version of download scripts. Change-Id: I6421b55d116831dc3b47c7630e91d361d56414c8 Issue-ID: OOM-1803 Signed-off-by: Michal Ptacek <m.ptacek@partner.samsung.com>
2019-06-05Fix issue with yaml.load in docker collectorTomáš Levora1-1/+1
docker-images-collector.sh script uses yaml.load python function in deprecated way and it is a potential security risk https://github.com/yaml/pyyaml/wiki/PyYAML-yaml.load(input)-Deprecation Issue-ID: OOM-1897 Change-Id: Ie30e60b4ede2c87a02b7bbe76e0695f91dc207c6 Signed-off-by: Tomáš Levora <t.levora@partner.samsung.com>
2019-05-31Fixing bug in docker-images-collector.shTomáš Levora1-1/+8
Some images from oom/kubernetes/common/ were not correctly collected by creating_data/docker-images-collector.sh script Issue-ID: OOM-1886 Change-Id: I044ca8a26353da44cd6f8e94fcb822570c954b49 Signed-off-by: Tomáš Levora <t.levora@partner.samsung.com>
2019-05-31Add comment to automatically generated docker listTomáš Levora1-3/+8
Add comment to docker image list generated by docker-images-collector.sh to reffer to commit id in case of ONAP or to project in other cases Issue-ID: OOM-1884 Change-Id: I7ff32fae84db3476495eb2e560c3bf61e41e2ddb Signed-off-by: Tomáš Levora <t.levora@partner.samsung.com>
2019-05-31Remove tag parameter from docker-image-collector.shTomáš Levora1-11/+11
Removing tag parameter from docker-image-collector.sh as it's not necessary as described in OOM-1881 Issue-ID: OOM-1885 Change-Id: Id83b396c4b994cfa659c518e3f03e704a84d65f0 Signed-off-by: Tomáš Levora <t.levora@partner.samsung.com>
2019-05-23Fixing typo in download-pip.sh scripteronkeo1-1/+1
Change-Id: I1216cb0fc2f47f29ef7f3880a03f4e6a3dfd3ec4 Issue-ID: OOM-1879 Signed-off-by: eronkeo <ronan.keogh@est.tech>
2019-05-17Update of docker for RHELTomáš Levora1-7/+5
Updating docker to 18.09 and its dependencies accordingly Issue-ID: OOM-1857 Change-Id: Ifa3ee7091e2ceeecf8c56d48c31a20a33d273f43 Signed-off-by: Tomáš Levora <t.levora@partner.samsung.com>
2019-05-16Adding rke binary downloadTomáš Levora1-1/+5
Adding rke binary to download script to ensure it will be in place in the offline-installer package Issue-ID: OOM-1778 Change-Id: Ie3249511ab0e49a657608076c38f4d3b67e28f74 Signed-off-by: Tomáš Levora <t.levora@partner.samsung.com>
2019-05-16Update kubectl and helm binariesTomáš Levora1-6/+6
kubectl and helm binaries need to be updated for proper usage with Dublin release kubectl: v1.13.5 helm: v2.12.3 Issue-ID: OOM-1858 Change-Id: I824362c8321317cbf0601ae2bd15ff39ef5c807e Signed-off-by: Tomáš Levora <t.levora@partner.samsung.com>
2019-05-15Merge "Adding script for autocollection of docker images"Michal Ptacek1-0/+118
2019-05-09Fix download scripts to handle empty linesTomáš Levora6-57/+46
Fixing download and saving scripts to be able to ignore empty or 00D ending lines in lists Issue-ID: OOM-1818 Change-Id: I55ef1dfbea628f8c1d4b19745536e629a2dbe0c9 Signed-off-by: Tomáš Levora <t.levora@partner.samsung.com>
2019-05-03Adding script for autocollection of docker imagesTomáš Levora1-0/+118
This script is collecting docker images from oom based on enabled subsystems to specified list There are missing images downloaded in run time based on blueprints and images necessary for rancher Issue-ID: OOM-1678 Change-Id: I4367a8a7c755bbf6045ad192bbfc4dd68daa92f8 Signed-off-by: Tomáš Levora <t.levora@partner.samsung.com>
2019-04-05Adding versions for infra related docker imagesTomáš Levora3-2/+7
1. latest tag replaced by version number for vnc server 2. added specific version for own_nginx image 3. version control improved in ansible roles accordingly Solves OOM-1766 Issue-ID: OOM-1767 Change-Id: I147c56b46a419188099d8ed3e78fed68810893e2 Signed-off-by: Tomáš Levora <t.levora@partner.samsung.com>
2019-04-05Our bare repos need to have casablanca branchMichal Ptacek2-16/+8
This is required to align with OOM charts, otherwise some components like DMAAP might be not initialized properly. Furthmore removing duplicated files, most of our data_lists are same for Casablanca MR and Casablanca base releases. Change-Id: I376410c7915d8f2682287c31392e2f3796adc990 Issue-ID: OOM-1771 Signed-off-by: Michal Ptacek <m.ptacek@partner.samsung.com>
2019-03-26Add python-jsonpointer as a new dependencyPetr Ospalý1-1/+1
Our custom ansible module requires python-jsonpointer module to deal with jsons. Change-Id: Idd7bfcf8fcf75e4397fba51d8219b73c57df5f0e Issue-ID: OOM-1758 Signed-off-by: Petr Ospalý <p.ospaly@partner.samsung.com>
2019-03-20update for missing nginx tarfileeronkeo1-0/+6
This update adds an entry to the docker_images lists file to ensure it is saved as a tar file and available for processing in the "Prepare infra related images to infra folder" section. Change-Id: I293144daa96b3c579443a2e76a407ea04821dce7 Issue-ID: OOM-1738 Signed-off-by: eronkeo <ronan.keogh@est.tech>
2019-02-28Save docker images based on listTomáš Levora1-6/+5
Save all docker images to tarballs based on list instead of saving all local registry to prevent not necessary images in the package Issue-ID: OOM-1683 Change-Id: Iaf4e092ff124f753d50be876d6ab564c7f349ddc Signed-off-by: Tomáš Levora <t.levora@partner.samsung.com>
2019-02-28Fixed path to list for git repos downloadTomáš Levora1-1/+1
Added missing part of file name for correct dowload of git repositories Issue-ID: OOM-1684 Change-Id: Ic8235a04ea12e13ca7e4165734bd15a81f7c8578 Signed-off-by: Tomáš Levora <t.levora@partner.samsung.com>
2019-02-27Merge "Add download of missing dependency python-docker"Tomáš Levora1-0/+4
2019-02-15Adding updated list files for ONAP 3.0.1Tomáš Levora1-1/+4
This change is adding updated resources lists for offline-installer for the tag onap_3.0.1 It's fixing some issues messed by wrongly done rebase in a previous patch and sets some default values Issue-ID: OOM-1615 Change-Id: I58001860d4accdf89cacd315d1af81240aee1303 Signed-off-by: Tomáš Levora <t.levora@partner.samsung.com>
2019-02-14Add download of missing dependency python-dockerTomáš Levora1-0/+4
Fixing a bug with missing python-docker package in local RHEL repository for offline-installer Issue-ID: OOM-1657 Change-Id: I42152f8acf81afcd825bd79378c5a8a8a803d047 Signed-off-by: Tomáš Levora <t.levora@partner.samsung.com>
2019-02-14Fix nfs on nodes does not install nfs packagesMilan Verespej1-1/+1
Issue-ID: OOM-1640 Change-Id: Ieb8d736e543d58facb9a84c3366c5b15418e17d2 Signed-off-by: Milan Verespej <m.verespej@partner.samsung.com>
2019-02-07Create APT repositoryTomáš Levora2-8/+42
Adding creation of APT repository for resources Issue-ID: OOM-1619 Change-Id: I2d4f14dfcbf2508d31bbc105828853c01733bb3e Signed-off-by: Tomáš Levora <t.levora@partner.samsung.com>
2019-02-07Create offline data lists to cover CasablancaTomáš Levora3-62/+58
Adding casablanca related data lists and changing the lists naming rule Modifying related download scripts accordingly Adding parameters for project version to download scripts to be able to use version specific lists Removing download-oom.sh as it should be done in helm charts preparation and patching steps Moving additional build related stuff to build directory Adding missing tags Issue-ID: OOM-1615 Change-Id: Ic5902f646a1f0f40ba615562f8d9b1a43cf8480b Signed-off-by: Tomáš Levora <t.levora@partner.samsung.com>
2019-01-28Remove bash version of installerMilan Verespej17-0/+701
Since bash version of offline installer is not supported in Casablanca release this change removes it and provides small refactor of offline resource building scripts. Change-Id: I953733edc31e994da123b7f0b1c502e156676669 Issue-ID: OOM-1597 Signed-off-by: Milan Verespej <m.verespej@partner.samsung.com>