aboutsummaryrefslogtreecommitdiffstats

ONAP data provider

Data ingestion service for ONAP.

Description

Data provider is a project to provide a tool to automate common ONAP resource creation. For many of tasks in ONAP some resources are needed and could be created once, like cloud region, complex or customer in A\&AI. With that tool it can be automated to create them for every ONAP instance. It can be also used to create requested resource on already running instance on demand.

Usage

This project is intended to be included in automation chain, e.g. triggered from the pipeline. You can also run it locally using Python interpreter or Docker image.

Installation

To run onap-data-provider Python >= 3.8 version is required. Install it using

python setup.py install

command. You can call then

onap-data-provider

command.

Run locally

When installed onap-data-provider is ready to work. We need some data to be created. Let's use samples/vendor.yaml and create SDC's Vendor resource. Call

onap-data-provider -f samples/vendor.yaml

and in your ONAP instance Vendor resource should be created. If that resource already exists no new data will be created. Check samples directory to get more examples of files which describes resources to create.

You can use multiple files as an input:

onap-data-provider -f samples/vendor.yaml -f samples/vsp.yaml

Directories could be used as well:

onap-data-provider -f samples/

Configuration

Configuration is needed if your environment setup is different that usuall so ONAP components listen on different hosts/ports than default, so are available on other URLs than:

AAI_URL     = "https://aai.api.sparky.simpledemo.onap.org:30233"
CDS_URL     = "http://portal.api.simpledemo.onap.org:30449"
MSB_URL     = "https://msb.api.simpledemo.onap.org:30283"
SDC_BE_URL  = "https://sdc.api.be.simpledemo.onap.org:30204"
SDC_FE_URL  = "https://sdc.api.fe.simpledemo.onap.org:30207"
SDNC_URL    = "https://sdnc.api.simpledemo.onap.org:30267"
SO_URL      = "http://so.api.simpledemo.onap.org:30277"
VID_URL     = "https://vid.api.simpledemo.onap.org:30200"
CLAMP_URL   = "https://clamp.api.simpledemo.onap.org:30258"
VES_URL     = "http://ves.api.simpledemo.onap.org:30417"
DMAAP_URL   = "http://dmaap.api.simpledemo.onap.org:3904"

If you want to use another URLs you need to override default onap-data-provider settings by create Python file with values you want to use. Example: I want to test onap-data-provider data creation on my "test" ONAP instance which is available on "172.17.0.1" IP address, so I need to create my_test_onap_instance_settings.py Python file which looks:

AAI_URL     = "https://172.17.0.1:30233"
CDS_URL     = "http://172.17.0.1:30449"
MSB_URL     = "https://172.17.0.1:30283"
SDC_BE_URL  = "https://172.17.0.1:30204"
SDC_FE_URL  = "https://172.17.0.1:30207"
SDNC_URL    = "https://172.17.0.1:30267"
SO_URL      = "http://172.17.0.1:30277"
VID_URL     = "https://172.17.0.1:30200"
CLAMP_URL   = "https://172.17.0.1:30258"
VES_URL     = "http://172.17.0.1:30417"
DMAAP_URL   = "http://172.17.0.1:3904"

and then if I call

ONAP_PYTHON_SDK_SETTINGS=my_test_onap_instance_settings onap-data-provider ...

all data are going to be created on my local instance.

Set proxy

ONAP data provider can be run with proxy configured. You need to pass urls you want to use for proxy connection as --proxy arguments. Call onap-data-provider -f <infra-file> --proxy http://localhost:8080 https://localhost:8080 to setup proxy for http and https on localhost:8080 address.

Data verification

You can verify the data provided is correct, before you would try to actually push it to the ONAP instance. To do so, use the flag --validate-only:

onap-data-provider -f samples/vendor.yml --validate-only

For reference, please see example data files under samples/ directory.

Development and testing

The following utilities are used within the project:

  • Black
  • mypy
  • pydocstyle

To run all the tests (unit tests, linter and mypy checks), install tox and then run it:

pip install tox
tox .

Licenses

The software that data-provider is built on uses the following licenses.

  • Apache 2 License: onapsdk
  • MIT license: PyYAML, jsonschema