aboutsummaryrefslogtreecommitdiffstats
path: root/ice_validator/tests
AgeCommit message (Collapse)AuthorFilesLines
2019-07-24[VVP] Adding bandit security scans and fixesLovett, Trevor3-3/+6
Issue-ID: VVP-244 Change-Id: Ia782f4cc7bf5a379ff8cdcce96cd2e7235998345 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-07-19[VVP] Properly escape error messages in HTML outputLovett, Trevor2-3/+8
Issue-ID: VVP-159 Change-Id: I741e5abbc80fbcbbb5d7c0332e13217305532bfd Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-07-02[VVP] Modifies uses_sr_iov function in structures.py to return sr_iov true ↵Lokur, Manish1-5/+5
when vnic_type=direct Issue-ID: VVP-231 Signed-off-by: Lokur, Manish <manish.shivakumar.lokur@att.com> Change-Id: I9b42d682f9cca0b8ae68746c5472cf7903933558
2019-07-02[VVP-230] Modified test_non_server_name_unique for non-server name ↵Lokur, Manish1-5/+7
uniqueness check Used heat_template argument which loops through for each base template Created a list of base and it's nested templates for the test Issue-ID: VVP-230 Signed-off-by: Lokur, Manish <manish.shivakumar.lokur@att.com> Change-Id: I84d14ed61ac79d83894a47a79954f4ce8ac1615e
2019-07-01[VVP] Bug fix in conftest.pyLokur, Manish1-1/+1
Relatived Path function failed if the value is an empty string. Issue-ID: VVP-229 Signed-off-by: Lokur, Manish <manish.shivakumar.lokur@att.com> Change-Id: I811234cfc7c3c438bd8934568a3ccbb02bac013a
2019-06-17Merge "[VVP] Allow multi-line error messages on error reports"Steven Wright2-7/+14
2019-06-14[VVP] Allow multi-line error messages on error reportsLovett, Trevor2-7/+14
Issue-ID: VVP-225 Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com> Change-Id: Iebee13d29f8025b3dd5c147f2024a484789464f7
2019-06-10Merge "[VVP] Fix redundant errors: missing base module or nested dirs"Steven Wright3-32/+31
2019-06-07Merge "[VVP] Improved readability of reports"steven stark2-70/+37
2019-06-06[VVP] Fix redundant errors: missing base module or nested dirsLovett, Trevor3-32/+31
Change-Id: I50f9f3f0bd627124a679248b2cf630e818755c59 Issue-ID: VVP-218 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-06-06[VVP] Improved readability of reportsLovett, Trevor2-70/+37
- Removed resolution steps from all reports - Added error number to all reports - Only show base file names - Add auto-filter to excel reports - Shift test ID to right-most column of Excel - Removed raw output from Excel and CSV Change-Id: Ic022b0a14d53fbeab591def631b8743228e1d5c0 Issue-ID: VVP-184 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-06-06[VVP] Adding resource ID to error messageLokur, Manish1-2/+2
Issue-ID: VVP-224 Signed-off-by: Lokur, Manish <manish.shivakumar.lokur@att.com> Change-Id: I36f5033220593ea574d96c991fb1a07994089ef4
2019-06-06Merge "[VVP] removed fixtures for the deleted tests"steven stark2-160/+0
2019-06-06Merge "[VVP] Removed yamllint library"steven stark2-30/+27
2019-06-05[VVP] Removed yamllint libraryLovett, Trevor2-30/+27
Change-Id: If2c26b8650e8aba0a183d0cf47b1b3744dbfaf95 Issue-ID: VVP-201 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-06-05[VVP] removed fixtures for the deleted testsLokur, Manish2-160/+0
Issue-ID: VVP-223 Change-Id: I00def826ff322fa9ae6d308c1107e3cac659e061 Signed-off-by: Lokur, Manish <manish.shivakumar.lokur@att.com>
2019-06-05[VVP] removing duplicate test from vvpaarjvi,desai1-87/+0
Issue-ID: VVP-223 Signed-off-by: aarjvi,desai <aarjvi.desai@att.com> Change-Id: Iee4c666085cbe6fbef3ab37d2d85c9984b88f1d8
2019-06-05[VVP] Performance Enhancements (report generation and test collection)Lovett, Trevor4-126/+54
Issue-ID: VVP-222 Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com> Change-Id: I9dd3506097cb0d6e69bd1434b2d42f6d1965023b
2019-05-30[VVP] Exempt output section from nested get_param checkLovett, Trevor3-4/+7
Change-Id: Ib87b0fb1c70c5689fc7687a21a27ea60934096b1 Issue-ID: VVP-220 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-05-28Merge "[VVP] Refine nested get_param test per R-10834 update"Steven Wright2-76/+42
2019-05-24[VVP] Refine nested get_param test per R-10834 updateLovett, Trevor2-76/+42
R-10834 was updated via VNFRQTS-646 to better reflect SDC's level of support Change-Id: I5232e7dc88c8c20f076788abf368bf33f4f1e1cb Issue-ID: VVP-219 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-05-23[VVP] adding heat template-validate teststark, steven9-0/+258
Issue-ID: VVP-218 Signed-off-by: stark, steven <steven.stark@att.com> Change-Id: If88f9b4b620aaffe61ead3b6f7d5c74dcfd14cba
2019-05-17[VVP] Update validations based on VNFRQTS-637dublinLovett, Trevor10-687/+36
Update to the latest bundled requirements text Update aap_exempt message to better reflect verbiage Remove unneeded test: tests_neutron_port_addresses (requirement removed) Map aap_exempt requirement to associated tests Also adding new helper scripts to help detect divergences between VNF Requirements and VVP as well as other VVP best practices: checks.py - Pre-commit checks - requirements are up-to-date with VNFRQTS - all testable requirements have tests - all non-testable requirements are *not* mapped to tests - flake8 passes - self-test passes update_reqs.py - Updates the the contents of heat_requirements.json with latest req'ts from VNFRQTS Nexus artifact Change-Id: Ia197de3254a1a0369224939f66a5f98c601a314d Issue-ID: VVP-216 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-05-16[VVP] Add test for R-100260 and fix mappingLovett, Trevor (tl2972)15-134/+441
Re-arranged some helper and util functions to more logical locations. Added test to verify than an internal subnet parameter used in an incremental module is defined in the base module. Change-Id: I20369396b18820f0e321c0e75bd47446b0a7a39f Issue-ID: VVP-215 Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
2019-05-15[VVP] R-100280, R-100290, and aap_exempt supportLovett, Trevor11-226/+303
Change-Id: I732af13a22e8c1dadc5fbf622a6efd102146262b Issue-ID: VVP-214 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-05-14[VVP] Adding env file checks for contrailLovett, Trevor17-82/+710
* Introduced helper method get_param to handle extracting param names from both get_params with string and list arguments * Moved test files for environment tests to independent directories to make it easier to isolate unit tests * Added contrail tests related to env file usage related to VNFRQTS-630 Change-Id: I3b44f0ce2d5657e9ab5290cd77f1422b36052b6a Issue-ID: VVP-213 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-05-13[VVP] Adding tests for new reqs from VNFRQTS-630stark, steven18-219/+599
Added tests for reqs: R-100010, R-100030, R-100050, R-100070, R-100090, R-100110, R-100130, R-100150, R-100200, R-100220, R-100240, R-100310, R-100330, R-100360, R-100370, R-100260, R-100000, R-100190, R-100350 Updated neutron param tests to re-use validation code for contrail tests Change-Id: I84af725ca9de176dc690fffda01ffcad453213ea Issue-ID: VVP-211 Signed-off-by: stark, steven <steven.stark@att.com>
2019-05-09Merge "[VVP] adding list support for non-server-name uniqueness"Steven Wright2-3/+29
2019-05-09Merge "[VVP] relaxing test_contrail_fqdn"Steven Wright2-5/+20
2019-05-02[VVP] adding list support for non-server-name uniquenessstark, steven2-3/+29
Change-Id: I9990cc0f3535df96f1ea7679fb87aea36398f433 Issue-ID: VVP-179 Signed-off-by: stark, steven <steven.stark@att.com>
2019-05-02[VVP] relaxing test_contrail_fqdnstark, steven2-5/+20
Test now only validates if using get_param. This allows connecting to internal networks via get_resource, get_attr, etc.. Change-Id: Ib0e9f014b62669aec48d8421a6de97a919126fd6 Issue-ID: VVP-191 Signed-off-by: stark, steven <steven.stark@att.com>
2019-05-02[VVP] adding subnet_uuid to nested parameter checkstark, steven5-1/+28
Change-Id: If0ae761fa20c24b3839234f23037fff6b32d851b Issue-ID: VVP-199 Signed-off-by: stark, steven <steven.stark@att.com>
2019-04-29VNFRQTS - update contrail validationHagop Bozawglanian2-4/+1
Issue-ID: VVP-200 Change-Id: Iae2b9941ac6470e94df988daf9a306924fa3ca3b Signed-off-by: Hagop Bozawglanian <hagop.bozawglanian@att.com>
2019-04-22[VVP] updating nested parameter teststark, steven16-389/+962
R-708564 was updated in RTD to target explicit parameters Change-Id: If860903ae13b76543c43f3e805b8aa03e9e2019d Issue-ID: VVP-197 Signed-off-by: stark, steven <steven.stark@att.com>
2019-04-16Merge "[VVP] Case-insensitive network role comparison"steven stark2-5/+5
2019-04-16[VVP] Case-insensitive network role comparisonLovett, Trevor2-5/+5
Change-Id: I3a761040770bac59093e105acda6b59e9f955c48 Issue-ID: VVP-194 Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
2019-04-16[VVP] Reports show test file and case nowLovett, Trevor1-3/+10
Change-Id: I017c1830b61b186f52ba2fe29db03dd41cb68b26 Issue-ID: VVP-192 Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
2019-04-15[VVP] Updated network param validations per reqtsLovett, Trevor25-578/+878
Change-Id: Idb0e051d6063cd94b733ed68093989d527592c9f Issue-ID: VVP-193 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com> Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
2019-04-12Merge "[VVP] updating v6 regex for fip/ip and fip/subnet"Steven Wright2-6/+6
2019-04-11Merge "[VVP] adding base test failure message to report"Steven Wright1-1/+4
2019-04-11[VVP] updating v6 regex for fip/ip and fip/subnetstark, steven2-6/+6
Change-Id: Ia7acc252d6a1429ec0c73f720bb1308dd70178b5 Issue-ID: VVP-188 Signed-off-by: stark, steven <steven.stark@att.com>
2019-04-09[VVP] restricting ip index check to resourcesstark, steven7-204/+73
Restricting check for ip parameter indices to only those parameters that are used in OS::Neutron::Port Issue-ID: VVP-190 Change-Id: Ifaf1a40ee47bcaf83657fe58a33e229c4126b4e8 Signed-off-by: stark, steven <steven.stark@att.com>
2019-04-08[VVP] adding base test failure message to reportstark, steven1-1/+4
Change-Id: Ibdb75750624d1482d87466b17aa2486f794a5fd6 Issue-ID: VVP-189 Signed-off-by: stark, steven <steven.stark@att.com>
2019-03-21Merge "VVP - Fixing script to include static validations"Steven Wright1-57/+104
2019-03-21[VVP] updating OS::Neutron::Port parameter testsstark, steven21-2972/+316
AAP, FIP/IP, FIP/Subnet parameters use same validation (ports.py) REGEX moved to specific tests Added tests for R-159016, R-717227, R-805572 Removed mapping for R-98748 Updated env file test to exclude internal AAP params Change-Id: Iddde8ee42400b8df9be49b8c15718b451101b37b Issue-ID: VVP-181 Signed-off-by: stark, steven <steven.stark@att.com>
2019-03-20VVP - Fixing script to include static validationsBozawglanian, Hagop (hb755d)1-57/+104
Change-Id: I0b210d788439e856c8229430abf7264768843867 Issue-ID: VVP-187 Signed-off-by: Bozawglanian, Hagop (hb755d) <hb755d@att.com>
2019-03-07[VVP] Ensure report.json always producedLovett, Trevor1-4/+5
Also fixed error where rst.csv did not use the requested output directory if the default is overridden Change-Id: Ife7bead97e5172ee115a7d07bd4ac917046f3b31 Issue-ID: VVP-185 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-03-05[VVP] Allow AZ CDL params in nested templatesLovett, Trevor1-0/+3
Issue-ID: VVP-183 Change-Id: Iad69ca26eb54a2200186ddf1b8d410e1248d1bcd Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
2019-03-04[VVP] Handle missing requirement in needs.jsonLovett, Trevor1-2/+2
Change-Id: Id22840cf58fdc0063f925a55672de58a9753b59c Issue-ID: VVP-182 Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
2019-02-28Merge "[VVP-171] R-84123 and R-76160 test update"Steven Wright7-152/+138