aboutsummaryrefslogtreecommitdiffstats
path: root/ice_validator/tests
AgeCommit message (Collapse)AuthorFilesLines
2019-09-24Merge "added Is_nova_server method to helpers"Steven Wright1-0/+8
2019-09-20[VVP] Misc tweaks and fixes to preload generationLovett, Trevor6-20/+274
* Use VALUE_FOR if value is still CHANGE me in .env file * Fix issues with improper parameters being put in VNF parameters in the preload * Fix issue where lists of parameter values pulled from env file could only be put in one template * Exclude platform provided parameters from VNF parameters in preload * Fixed issues with parameter validations * Updated heat requirements * implemented missing test for new requirement that all incremental modules must have a nova server Issue-ID: VVP-312 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com> Change-Id: I1a1225097544b690fb9b854c8a3d9e036f694d6a
2019-09-18added Is_nova_server method to helpers5.0.15.0.0Ezhilarasi1-0/+8
Added is_nova_server check to helpers to remove coginitve complexity in test files Change-Id: I20e68730947cc6472d693eca782bbee36a3c9e1b Issue-ID: VVP-285 Signed-off-by: Ezhilarasi <ezhrajam@in.ibm.com>
2019-09-06Enforce black code format via pre-commit hookLovett, Trevor10-35/+105
Issue-ID: VVP-203 Change-Id: If0de5b4bc1be0c9514decea1f4ff6f5ec79dc41b Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-09-03Sonar issue fix in helpers.pyEzhilarasi1-3/+1
Change-Id: Ief18c717974498ea9b5f1fd2e2987db0d013b732 Issue-ID: VVP-172 Signed-off-by: Ezhilarasi <ezhrajam@in.ibm.com>
2019-08-30Sonarfix:Reduce coginitive complexity vmtype utilEzhilarasi1-5/+6
Change-Id: I4b82df8587b98a142e86031700f8c73e922184d5 Issue-ID: VVP-172 Signed-off-by: Ezhilarasi <ezhrajam@in.ibm.com>
2019-08-27[VVP] Generated completed preload from env filesLovett, Trevor4-5/+87
User can supply an optional directory containing .env files and/or CSAR VSP which can be used to generate populated preloads in the requested format. The nested directories can be used to create sub-environments that inherit their settings from the parent directories. Optionally, values can be specified in a defaults.yaml and they will be used if that value is not defined in the .env file. This is useful if the parameter name and value will be the same in all modules. Issue-ID: VVP-278 Change-Id: Icd9846c63463537793db908be8ce5dba13c4bda3 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-08-21[VVP] test_environment_file_parameters violation fixstark, steven1-4/+5
test_environment_file_parameters check for environment violation is checking the wrong variable. Also doesn't handle environment files with no parameters gracefully. Issue-ID: VVP-267 Signed-off-by: stark, steven <steven.stark@att.com> Change-Id: I9fbedbb5af4c045037131a7e7a7ca7f6c8febb14
2019-08-20Merge "[VVP] Adding preload generation functionality"Steven Wright4-335/+344
2019-08-16[VVP] Adding preload generation functionalityLovett, Trevor4-335/+344
preload.py discovers and loads implementations of AbstractPreloadGenerator from any module on sys.path prefixed with preload_* Initial support is provided for VNF-API and GR-API. The templates will provide a guide for users to provide their values. Known limitations: - No support for Contrail. Preload will be created, but contrail parameters will be skipped. This will be addressed in the future. Issue-ID: VVP-227 Signed-off-by: stark, steven <steven.stark@att.com> Change-Id: I081d50ac379062fbf1bffebd687e920220d32571 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com> Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
2019-08-13VNFRQTS - Update the rst table contentHagop Bozawglanian1-2/+1
Issue-ID: VNFRQTS-651 Signed-off-by: Hagop Bozawglanian <hagop.bozawglanian@att.com> Change-Id: If4f535004e78cf3abaf0113eda3cbfa4e562fba1
2019-07-25[VVP] Fixed ParameterCollector nested get_paramLovett, Trevor1-1/+1
Issue-ID: VVP-248 Change-Id: I27d95c763cafe6d262ea8f6c03fbb3a7ba0f64dc Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-07-24[VVP] Fixed issue in unused parameter detectionLovett, Trevor2-147/+19
Issue-ID: VVP-247 Change-Id: I02e2da52fdfa31a1d056b9839063373453c8ace7 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-07-24Merge "[VVP] Adding bandit security scans and fixes"steven stark3-3/+6
2019-07-24[VVP] Adding bandit security scans and fixesLovett, Trevor3-3/+6
Issue-ID: VVP-244 Change-Id: Ia782f4cc7bf5a379ff8cdcce96cd2e7235998345 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-07-19[VVP] Update AZ tests to not apply to nested templatesLovett, Trevor2-1/+10
Issue-ID: VVP-226 Change-Id: I91e97b1b73daf6be83c227ff2deeeb4e72213ed5 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-07-19[VVP] Properly escape error messages in HTML outputLovett, Trevor2-3/+8
Issue-ID: VVP-159 Change-Id: I741e5abbc80fbcbbb5d7c0332e13217305532bfd Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-07-02[VVP] Modifies uses_sr_iov function in structures.py to return sr_iov true ↵Lokur, Manish1-5/+5
when vnic_type=direct Issue-ID: VVP-231 Signed-off-by: Lokur, Manish <manish.shivakumar.lokur@att.com> Change-Id: I9b42d682f9cca0b8ae68746c5472cf7903933558
2019-07-02[VVP-230] Modified test_non_server_name_unique for non-server name ↵Lokur, Manish1-5/+7
uniqueness check Used heat_template argument which loops through for each base template Created a list of base and it's nested templates for the test Issue-ID: VVP-230 Signed-off-by: Lokur, Manish <manish.shivakumar.lokur@att.com> Change-Id: I84d14ed61ac79d83894a47a79954f4ce8ac1615e
2019-07-01[VVP] Bug fix in conftest.pyLokur, Manish1-1/+1
Relatived Path function failed if the value is an empty string. Issue-ID: VVP-229 Signed-off-by: Lokur, Manish <manish.shivakumar.lokur@att.com> Change-Id: I811234cfc7c3c438bd8934568a3ccbb02bac013a
2019-06-17Merge "[VVP] Allow multi-line error messages on error reports"Steven Wright2-7/+14
2019-06-14[VVP] Allow multi-line error messages on error reportsLovett, Trevor2-7/+14
Issue-ID: VVP-225 Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com> Change-Id: Iebee13d29f8025b3dd5c147f2024a484789464f7
2019-06-10Merge "[VVP] Fix redundant errors: missing base module or nested dirs"Steven Wright3-32/+31
2019-06-07Merge "[VVP] Improved readability of reports"steven stark2-70/+37
2019-06-06[VVP] Fix redundant errors: missing base module or nested dirsLovett, Trevor3-32/+31
Change-Id: I50f9f3f0bd627124a679248b2cf630e818755c59 Issue-ID: VVP-218 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-06-06[VVP] Improved readability of reportsLovett, Trevor2-70/+37
- Removed resolution steps from all reports - Added error number to all reports - Only show base file names - Add auto-filter to excel reports - Shift test ID to right-most column of Excel - Removed raw output from Excel and CSV Change-Id: Ic022b0a14d53fbeab591def631b8743228e1d5c0 Issue-ID: VVP-184 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-06-06[VVP] Adding resource ID to error messageLokur, Manish1-2/+2
Issue-ID: VVP-224 Signed-off-by: Lokur, Manish <manish.shivakumar.lokur@att.com> Change-Id: I36f5033220593ea574d96c991fb1a07994089ef4
2019-06-06Merge "[VVP] removed fixtures for the deleted tests"steven stark2-160/+0
2019-06-06Merge "[VVP] Removed yamllint library"steven stark2-30/+27
2019-06-05[VVP] Removed yamllint libraryLovett, Trevor2-30/+27
Change-Id: If2c26b8650e8aba0a183d0cf47b1b3744dbfaf95 Issue-ID: VVP-201 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-06-05[VVP] removed fixtures for the deleted testsLokur, Manish2-160/+0
Issue-ID: VVP-223 Change-Id: I00def826ff322fa9ae6d308c1107e3cac659e061 Signed-off-by: Lokur, Manish <manish.shivakumar.lokur@att.com>
2019-06-05[VVP] removing duplicate test from vvpaarjvi,desai1-87/+0
Issue-ID: VVP-223 Signed-off-by: aarjvi,desai <aarjvi.desai@att.com> Change-Id: Iee4c666085cbe6fbef3ab37d2d85c9984b88f1d8
2019-06-05[VVP] Performance Enhancements (report generation and test collection)Lovett, Trevor4-126/+54
Issue-ID: VVP-222 Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com> Change-Id: I9dd3506097cb0d6e69bd1434b2d42f6d1965023b
2019-05-30[VVP] Exempt output section from nested get_param checkLovett, Trevor3-4/+7
Change-Id: Ib87b0fb1c70c5689fc7687a21a27ea60934096b1 Issue-ID: VVP-220 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-05-28Merge "[VVP] Refine nested get_param test per R-10834 update"Steven Wright2-76/+42
2019-05-24[VVP] Refine nested get_param test per R-10834 updateLovett, Trevor2-76/+42
R-10834 was updated via VNFRQTS-646 to better reflect SDC's level of support Change-Id: I5232e7dc88c8c20f076788abf368bf33f4f1e1cb Issue-ID: VVP-219 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-05-23[VVP] adding heat template-validate teststark, steven9-0/+258
Issue-ID: VVP-218 Signed-off-by: stark, steven <steven.stark@att.com> Change-Id: If88f9b4b620aaffe61ead3b6f7d5c74dcfd14cba
2019-05-17[VVP] Update validations based on VNFRQTS-637dublinLovett, Trevor10-687/+36
Update to the latest bundled requirements text Update aap_exempt message to better reflect verbiage Remove unneeded test: tests_neutron_port_addresses (requirement removed) Map aap_exempt requirement to associated tests Also adding new helper scripts to help detect divergences between VNF Requirements and VVP as well as other VVP best practices: checks.py - Pre-commit checks - requirements are up-to-date with VNFRQTS - all testable requirements have tests - all non-testable requirements are *not* mapped to tests - flake8 passes - self-test passes update_reqs.py - Updates the the contents of heat_requirements.json with latest req'ts from VNFRQTS Nexus artifact Change-Id: Ia197de3254a1a0369224939f66a5f98c601a314d Issue-ID: VVP-216 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-05-16[VVP] Add test for R-100260 and fix mappingLovett, Trevor (tl2972)15-134/+441
Re-arranged some helper and util functions to more logical locations. Added test to verify than an internal subnet parameter used in an incremental module is defined in the base module. Change-Id: I20369396b18820f0e321c0e75bd47446b0a7a39f Issue-ID: VVP-215 Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
2019-05-15[VVP] R-100280, R-100290, and aap_exempt supportLovett, Trevor11-226/+303
Change-Id: I732af13a22e8c1dadc5fbf622a6efd102146262b Issue-ID: VVP-214 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-05-14[VVP] Adding env file checks for contrailLovett, Trevor17-82/+710
* Introduced helper method get_param to handle extracting param names from both get_params with string and list arguments * Moved test files for environment tests to independent directories to make it easier to isolate unit tests * Added contrail tests related to env file usage related to VNFRQTS-630 Change-Id: I3b44f0ce2d5657e9ab5290cd77f1422b36052b6a Issue-ID: VVP-213 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-05-13[VVP] Adding tests for new reqs from VNFRQTS-630stark, steven18-219/+599
Added tests for reqs: R-100010, R-100030, R-100050, R-100070, R-100090, R-100110, R-100130, R-100150, R-100200, R-100220, R-100240, R-100310, R-100330, R-100360, R-100370, R-100260, R-100000, R-100190, R-100350 Updated neutron param tests to re-use validation code for contrail tests Change-Id: I84af725ca9de176dc690fffda01ffcad453213ea Issue-ID: VVP-211 Signed-off-by: stark, steven <steven.stark@att.com>
2019-05-09Merge "[VVP] adding list support for non-server-name uniqueness"Steven Wright2-3/+29
2019-05-09Merge "[VVP] relaxing test_contrail_fqdn"Steven Wright2-5/+20
2019-05-02[VVP] adding list support for non-server-name uniquenessstark, steven2-3/+29
Change-Id: I9990cc0f3535df96f1ea7679fb87aea36398f433 Issue-ID: VVP-179 Signed-off-by: stark, steven <steven.stark@att.com>
2019-05-02[VVP] relaxing test_contrail_fqdnstark, steven2-5/+20
Test now only validates if using get_param. This allows connecting to internal networks via get_resource, get_attr, etc.. Change-Id: Ib0e9f014b62669aec48d8421a6de97a919126fd6 Issue-ID: VVP-191 Signed-off-by: stark, steven <steven.stark@att.com>
2019-05-02[VVP] adding subnet_uuid to nested parameter checkstark, steven5-1/+28
Change-Id: If0ae761fa20c24b3839234f23037fff6b32d851b Issue-ID: VVP-199 Signed-off-by: stark, steven <steven.stark@att.com>
2019-04-29VNFRQTS - update contrail validationHagop Bozawglanian2-4/+1
Issue-ID: VVP-200 Change-Id: Iae2b9941ac6470e94df988daf9a306924fa3ca3b Signed-off-by: Hagop Bozawglanian <hagop.bozawglanian@att.com>
2019-04-22[VVP] updating nested parameter teststark, steven16-389/+962
R-708564 was updated in RTD to target explicit parameters Change-Id: If860903ae13b76543c43f3e805b8aa03e9e2019d Issue-ID: VVP-197 Signed-off-by: stark, steven <steven.stark@att.com>
2019-04-16Merge "[VVP] Case-insensitive network role comparison"steven stark2-5/+5