aboutsummaryrefslogtreecommitdiffstats
path: root/ice_validator/tests/utils
AgeCommit message (Collapse)AuthorFilesLines
2019-07-24[VVP] Fixed issue in unused parameter detectionLovett, Trevor1-146/+18
Issue-ID: VVP-247 Change-Id: I02e2da52fdfa31a1d056b9839063373453c8ace7 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-06-06[VVP] Adding resource ID to error messageLokur, Manish1-2/+2
Issue-ID: VVP-224 Signed-off-by: Lokur, Manish <manish.shivakumar.lokur@att.com> Change-Id: I36f5033220593ea574d96c991fb1a07994089ef4
2019-06-05[VVP] Performance Enhancements (report generation and test collection)Lovett, Trevor1-22/+12
Issue-ID: VVP-222 Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com> Change-Id: I9dd3506097cb0d6e69bd1434b2d42f6d1965023b
2019-05-17[VVP] Update validations based on VNFRQTS-637dublinLovett, Trevor1-21/+32
Update to the latest bundled requirements text Update aap_exempt message to better reflect verbiage Remove unneeded test: tests_neutron_port_addresses (requirement removed) Map aap_exempt requirement to associated tests Also adding new helper scripts to help detect divergences between VNF Requirements and VVP as well as other VVP best practices: checks.py - Pre-commit checks - requirements are up-to-date with VNFRQTS - all testable requirements have tests - all non-testable requirements are *not* mapped to tests - flake8 passes - self-test passes update_reqs.py - Updates the the contents of heat_requirements.json with latest req'ts from VNFRQTS Nexus artifact Change-Id: Ia197de3254a1a0369224939f66a5f98c601a314d Issue-ID: VVP-216 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-05-16[VVP] Add test for R-100260 and fix mappingLovett, Trevor (tl2972)2-1/+95
Re-arranged some helper and util functions to more logical locations. Added test to verify than an internal subnet parameter used in an incremental module is defined in the base module. Change-Id: I20369396b18820f0e321c0e75bd47446b0a7a39f Issue-ID: VVP-215 Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
2019-05-15[VVP] R-100280, R-100290, and aap_exempt supportLovett, Trevor1-11/+52
Change-Id: I732af13a22e8c1dadc5fbf622a6efd102146262b Issue-ID: VVP-214 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-05-13[VVP] Adding tests for new reqs from VNFRQTS-630stark, steven1-96/+90
Added tests for reqs: R-100010, R-100030, R-100050, R-100070, R-100090, R-100110, R-100130, R-100150, R-100200, R-100220, R-100240, R-100310, R-100330, R-100360, R-100370, R-100260, R-100000, R-100190, R-100350 Updated neutron param tests to re-use validation code for contrail tests Change-Id: I84af725ca9de176dc690fffda01ffcad453213ea Issue-ID: VVP-211 Signed-off-by: stark, steven <steven.stark@att.com>
2019-03-21[VVP] updating OS::Neutron::Port parameter testsstark, steven1-184/+105
AAP, FIP/IP, FIP/Subnet parameters use same validation (ports.py) REGEX moved to specific tests Added tests for R-159016, R-717227, R-805572 Removed mapping for R-98748 Updated env file test to exclude internal AAP params Change-Id: Iddde8ee42400b8df9be49b8c15718b451101b37b Issue-ID: VVP-181 Signed-off-by: stark, steven <steven.stark@att.com>
2019-02-15[VVP] ports.py check port typestark, steven1-4/+7
get_invalid_ip_addresses needs to be enhanced to check the neutron port type (internal or external) before validating the IP parameter format. The IP parameter format should not be validated against both internal and external, it should only be validated against the formats for the ports type. Change-Id: Ic8b66b83729f6ea5d268d55816e03dcbbfec12fd Issue-ID: VVP-167 Signed-off-by: stark, steven <steven.stark@att.com>
2019-02-01[VVP] pseudo-parameters nested parametersstark, steven1-2/+6
Change-Id: Iff7630a6f62fa8b83c80048d6efc12d187037412 Issue-ID: VVP-157 Signed-off-by: stark, steven <steven.stark@att.com>
2019-01-30[VVP] Removing unnecessary trademark linesLovett, Trevor9-9/+0
Issue-ID: VVP-152 Change-Id: I6b978768324f69adba50c75a187509c4a7605341 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-01-29[VVP] stand alone tool, script updatesstark, steven1-1/+19
1) Validation script updates: Various bug fixes and script enhancements New tests for: R-18683 R-94669 R-304011 R-01455 R-86476 R-708564 R-85734 R-18683 R-94669 R-304011 R-01455 R-86476 R-86476 R-589037 Removed tests for: R-75202 R-62954 R-22441 R-49177 R-16576 R-86237 R-44491 R-70757 R-01896 R-26124 2) Stand Alone tool introduced 3) Added optional "categories" capability Change-Id: I193cd5c267750791d97b350e91fc36faa72d8d5f Issue-ID: VVP-143 Signed-off-by: stark, steven <steven.stark@att.com>
2018-12-17[VVP] updating validation scripts in dublinstark, steven8-310/+472
- adding backlog of new validation scripts for dublin - updating existing tests - removing outdated tests Issue-ID: VVP-123 Change-Id: Ib8260889ac957c1dd28d8ede450fc8edc6fb0ec0 Signed-off-by: stark, steven <steven.stark@att.com>
2018-09-14[VVP] udpating scripts for casablanca 2stark, steven1-1/+1
adding scripts updates adding docrators for sections 5.2.6 - end closes out VVP 80 Change-Id: Iecac476949aa3ae3982f8c77671869583eb313d6 Issue-ID: VVP-80 Signed-off-by: stark, steven <ss820f@att.com>
2018-09-13[VVP] udpating scripts for casablancastark, steven6-187/+197
adding new "infrastructure" scripts addresses bugs VVP-100, VVP-101, VVP-102 adding base tests updating tests where arguments have changed Adds traceability for task VVP-92 Change-Id: I067d8e80934403039e66fbc9fc93766587f67b4e Issue-ID: VVP-80 Signed-off-by: stark, steven <ss820f@att.com>
2018-08-22[VVP] Added new three new reportsLovett, Trevor (tl2972)5-171/+177
Resolves VVP-81 by introducing three new reports to the validation script output. Each report is written to the output directory under ice_validator. * mapping_errors.csv - each row represents an issue where a test is mapped to a requirement that does not exist in the requirement.json file * traceability.csv - Shows a mapping between all test cases and requirements. Rows will also be shown where a requirement does not have a tests, and where tests are not mapped to a requirement * report.{html|csv|xlsx} - Formatted error report that shows each failure that was detected and maps it to a the file name, requirement(s) violated if known, possible resolution steps, error message, and raw output from pytest. The report can be written in html, csv, or Excel format Other minor changes: * Replaced smart quotes with regular quotes to resolve issues with py3 * Updated copyright of modified files * Fixed Flake-8 errors Issue-ID: VVP-81 Change-Id: I659836cb20262ae44652c03639281a817dd051ae Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
2018-08-09[VVP] create new validation scriptsstark, steven8-16/+83
- create validation scripts for R-04747, R-30804, R-11690, R-46839, R-98407 - other small script enhancements Change-Id: I12c42a43c83e5cb4217895c19fd0beef928dc955 Issue-ID: VVP-103 Signed-off-by: stark, steven <ss820f@att.com>
2018-07-31[VVP] Updating error reporting for helpersBozawglanian, Hagop (hb755d)1-3/+5
Change-Id: Ib93b6ff452613b2ee1f2804d958f4c6f66d6dee4 Issue-ID: VVP-80 Signed-off-by: Bozawglanian, Hagop (hb755d) <hb755d@att.com>
2018-07-19[VNFRQTS] update decorator for validation scriptstark, steven1-47/+44
update decorator for validation script corresponding to 5.2.1 of VNFRTQS update decorator for validation script corresponding to 5.2.2 of VNFRTQS Change-Id: I063e799a27c76bb58c031273aca48031965849d9 Issue-ID: VVP-88 Signed-off-by: stark, steven <ss820f@att.com>
2018-04-23[VVP] add bug fixes and reserve port updatesstark, steven3-2/+39
Adding test script updates and reserve port Change-Id: I2af5263a48a53117021f166d08395685e89fd122 Issue-ID: VVP-56 Signed-off-by: stark, steven <ss820f@att.com>
2017-09-14Commit test list join for availability_zoneedan-att1-0/+6
These changes were imported from upstream @ commit e38076e29ef8c86c510fca3141954d10602040bb - Updated `nested_iterables` to parse list_join if available in the templates - Updated `test_volume_resource_ids` to allow volume ids to be provided as a parameter list - Appropriate fixture additions and changes Change-Id: Ia2187fe4eb7a389c8df01061be229246262d9a24 Issue-Id: VVP-29 Signed-off-by: Edan Binshtok <eb578m@intl.att.com>
2017-09-05Commit seed code for validation-scriptsMichael F. Lamb8-0/+976
This imports the initial seed code for validation scripts. These files were imported from a tarball with the SHA1SUM ce2ae49c82546b987c8ad2f68ac43d94b4934818. From the contents of the tarball, some errant .pyc files were removed, and a .gitignore file was added. The result matches exactly the contents of the origin private repository at hash 88c656e. Change-Id: I97d19b11495e116890ca6577e83037b0934519cc Issue-Id: VVP-11 Signed-off-by: Michael F. Lamb <mike@datagrok.org>