aboutsummaryrefslogtreecommitdiffstats
path: root/ice_validator/tests/utils
AgeCommit message (Collapse)AuthorFilesLines
2020-04-08[VVP] fixing relative imports for VVPstark, steven1-1/+1
Issue-ID: VVP-400 Signed-off-by: stark, steven <steven.stark@att.com> Change-Id: I7d5c172a6f386a1d5b30bf82ddb9dafa3395b527
2020-01-22VVP - Removed unused function and classLovett, Trevor1-16/+0
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com> Issue-ID: VVP-366 Change-Id: I02c952662bb8ed931f46c58cbf4ab100435d00fb
2020-01-16[VVP] Resources not allowed in 2nd level templatesLovett, Trevor1-81/+2
Cleaned up nesting detection logic Deleted test in Nova Server file as the nesting is no longer related to Nova servers Added check for resources in 2nd level nested files to existing test. Change-Id: I136efb786f67cf4c45fe4da3abaa3fcec024ba50 Issue-ID: VVP-357 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-11-18[VVP] Updating vm_type class test to proceed if no cinderstark, steven1-2/+3
Other minor changes - updating error message to be more clear for vm_type class - updating test_network_format to handle nested files w/ no resources - updating ports.py to handle hardcoded str_replace param/values Issue-ID: VVP-342 Signed-off-by: stark, steven <steven.stark@att.com> Change-Id: I63fcda582fe25dcedca87e874327b7ea56fe6ef3
2019-11-12[VVP] updating ports.py to check str_replace paramsstark, steven1-94/+140
allowed_address_pairs/ip_address can use CIDR format, and is often done by using the intrinsic function str_replace. This update will naively go through each param in a str_replace to check if one is a valid allowed_address_pair/ip_address parameter. Issue-ID: VVP-341 Signed-off-by: stark, steven <steven.stark@att.com> Change-Id: I24e7ad6b74e5795b577d99468517287be46cd2b7
2019-10-08[VVP] Flag duplicate parameters in .env filesLovett, Trevor2-14/+35
Also some minor tweaks to preload generation so it doesn't fail on partial heat templates Change-Id: If39288dde645b0b53a338e7672336807ffa1b6d7 Issue-ID: VVP-284 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-10-04[VVP] Bug fix if resource value is hardcodedstark, steven1-2/+9
If the property value isn't a dictionary than the test run crashes Issue-ID: VVP-313 Signed-off-by: stark, steven <steven.stark@att.com> Change-Id: I926bc233909db245d5a051035f26fefaa39b5ede
2019-10-03Refactor function to reduce Cognitive Complexityanushadasari1-3/+1
Issue-ID: VVP-314 Change-Id: I0843dde3cc01ef2efbb08a282b93c5e3414a1cd2 Signed-off-by: anushadasari <danush10@in.ibm.com>
2019-09-26Sonarfix: Reduce cognitive complexityEzhilarasi1-7/+1
Change-Id: I18a9802c643f778c2aedb658848c091ff8a1587c Issue-ID: VVP-296 Signed-off-by: Ezhilarasi <ezhrajam@in.ibm.com>
2019-09-06Enforce black code format via pre-commit hookLovett, Trevor1-1/+5
Issue-ID: VVP-203 Change-Id: If0de5b4bc1be0c9514decea1f4ff6f5ec79dc41b Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-08-30Sonarfix:Reduce coginitive complexity vmtype utilEzhilarasi1-5/+6
Change-Id: I4b82df8587b98a142e86031700f8c73e922184d5 Issue-ID: VVP-172 Signed-off-by: Ezhilarasi <ezhrajam@in.ibm.com>
2019-07-25[VVP] Fixed ParameterCollector nested get_paramLovett, Trevor1-1/+1
Issue-ID: VVP-248 Change-Id: I27d95c763cafe6d262ea8f6c03fbb3a7ba0f64dc Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-07-24[VVP] Fixed issue in unused parameter detectionLovett, Trevor1-146/+18
Issue-ID: VVP-247 Change-Id: I02e2da52fdfa31a1d056b9839063373453c8ace7 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-06-06[VVP] Adding resource ID to error messageLokur, Manish1-2/+2
Issue-ID: VVP-224 Signed-off-by: Lokur, Manish <manish.shivakumar.lokur@att.com> Change-Id: I36f5033220593ea574d96c991fb1a07994089ef4
2019-06-05[VVP] Performance Enhancements (report generation and test collection)Lovett, Trevor1-22/+12
Issue-ID: VVP-222 Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com> Change-Id: I9dd3506097cb0d6e69bd1434b2d42f6d1965023b
2019-05-17[VVP] Update validations based on VNFRQTS-637dublinLovett, Trevor1-21/+32
Update to the latest bundled requirements text Update aap_exempt message to better reflect verbiage Remove unneeded test: tests_neutron_port_addresses (requirement removed) Map aap_exempt requirement to associated tests Also adding new helper scripts to help detect divergences between VNF Requirements and VVP as well as other VVP best practices: checks.py - Pre-commit checks - requirements are up-to-date with VNFRQTS - all testable requirements have tests - all non-testable requirements are *not* mapped to tests - flake8 passes - self-test passes update_reqs.py - Updates the the contents of heat_requirements.json with latest req'ts from VNFRQTS Nexus artifact Change-Id: Ia197de3254a1a0369224939f66a5f98c601a314d Issue-ID: VVP-216 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-05-16[VVP] Add test for R-100260 and fix mappingLovett, Trevor (tl2972)2-1/+95
Re-arranged some helper and util functions to more logical locations. Added test to verify than an internal subnet parameter used in an incremental module is defined in the base module. Change-Id: I20369396b18820f0e321c0e75bd47446b0a7a39f Issue-ID: VVP-215 Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
2019-05-15[VVP] R-100280, R-100290, and aap_exempt supportLovett, Trevor1-11/+52
Change-Id: I732af13a22e8c1dadc5fbf622a6efd102146262b Issue-ID: VVP-214 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-05-13[VVP] Adding tests for new reqs from VNFRQTS-630stark, steven1-96/+90
Added tests for reqs: R-100010, R-100030, R-100050, R-100070, R-100090, R-100110, R-100130, R-100150, R-100200, R-100220, R-100240, R-100310, R-100330, R-100360, R-100370, R-100260, R-100000, R-100190, R-100350 Updated neutron param tests to re-use validation code for contrail tests Change-Id: I84af725ca9de176dc690fffda01ffcad453213ea Issue-ID: VVP-211 Signed-off-by: stark, steven <steven.stark@att.com>
2019-03-21[VVP] updating OS::Neutron::Port parameter testsstark, steven1-184/+105
AAP, FIP/IP, FIP/Subnet parameters use same validation (ports.py) REGEX moved to specific tests Added tests for R-159016, R-717227, R-805572 Removed mapping for R-98748 Updated env file test to exclude internal AAP params Change-Id: Iddde8ee42400b8df9be49b8c15718b451101b37b Issue-ID: VVP-181 Signed-off-by: stark, steven <steven.stark@att.com>
2019-02-15[VVP] ports.py check port typestark, steven1-4/+7
get_invalid_ip_addresses needs to be enhanced to check the neutron port type (internal or external) before validating the IP parameter format. The IP parameter format should not be validated against both internal and external, it should only be validated against the formats for the ports type. Change-Id: Ic8b66b83729f6ea5d268d55816e03dcbbfec12fd Issue-ID: VVP-167 Signed-off-by: stark, steven <steven.stark@att.com>
2019-02-01[VVP] pseudo-parameters nested parametersstark, steven1-2/+6
Change-Id: Iff7630a6f62fa8b83c80048d6efc12d187037412 Issue-ID: VVP-157 Signed-off-by: stark, steven <steven.stark@att.com>
2019-01-30[VVP] Removing unnecessary trademark linesLovett, Trevor9-9/+0
Issue-ID: VVP-152 Change-Id: I6b978768324f69adba50c75a187509c4a7605341 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-01-29[VVP] stand alone tool, script updatesstark, steven1-1/+19
1) Validation script updates: Various bug fixes and script enhancements New tests for: R-18683 R-94669 R-304011 R-01455 R-86476 R-708564 R-85734 R-18683 R-94669 R-304011 R-01455 R-86476 R-86476 R-589037 Removed tests for: R-75202 R-62954 R-22441 R-49177 R-16576 R-86237 R-44491 R-70757 R-01896 R-26124 2) Stand Alone tool introduced 3) Added optional "categories" capability Change-Id: I193cd5c267750791d97b350e91fc36faa72d8d5f Issue-ID: VVP-143 Signed-off-by: stark, steven <steven.stark@att.com>
2018-12-17[VVP] updating validation scripts in dublinstark, steven8-310/+472
- adding backlog of new validation scripts for dublin - updating existing tests - removing outdated tests Issue-ID: VVP-123 Change-Id: Ib8260889ac957c1dd28d8ede450fc8edc6fb0ec0 Signed-off-by: stark, steven <steven.stark@att.com>
2018-09-14[VVP] udpating scripts for casablanca 2stark, steven1-1/+1
adding scripts updates adding docrators for sections 5.2.6 - end closes out VVP 80 Change-Id: Iecac476949aa3ae3982f8c77671869583eb313d6 Issue-ID: VVP-80 Signed-off-by: stark, steven <ss820f@att.com>
2018-09-13[VVP] udpating scripts for casablancastark, steven6-187/+197
adding new "infrastructure" scripts addresses bugs VVP-100, VVP-101, VVP-102 adding base tests updating tests where arguments have changed Adds traceability for task VVP-92 Change-Id: I067d8e80934403039e66fbc9fc93766587f67b4e Issue-ID: VVP-80 Signed-off-by: stark, steven <ss820f@att.com>
2018-08-22[VVP] Added new three new reportsLovett, Trevor (tl2972)5-171/+177
Resolves VVP-81 by introducing three new reports to the validation script output. Each report is written to the output directory under ice_validator. * mapping_errors.csv - each row represents an issue where a test is mapped to a requirement that does not exist in the requirement.json file * traceability.csv - Shows a mapping between all test cases and requirements. Rows will also be shown where a requirement does not have a tests, and where tests are not mapped to a requirement * report.{html|csv|xlsx} - Formatted error report that shows each failure that was detected and maps it to a the file name, requirement(s) violated if known, possible resolution steps, error message, and raw output from pytest. The report can be written in html, csv, or Excel format Other minor changes: * Replaced smart quotes with regular quotes to resolve issues with py3 * Updated copyright of modified files * Fixed Flake-8 errors Issue-ID: VVP-81 Change-Id: I659836cb20262ae44652c03639281a817dd051ae Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
2018-08-09[VVP] create new validation scriptsstark, steven8-16/+83
- create validation scripts for R-04747, R-30804, R-11690, R-46839, R-98407 - other small script enhancements Change-Id: I12c42a43c83e5cb4217895c19fd0beef928dc955 Issue-ID: VVP-103 Signed-off-by: stark, steven <ss820f@att.com>
2018-07-31[VVP] Updating error reporting for helpersBozawglanian, Hagop (hb755d)1-3/+5
Change-Id: Ib93b6ff452613b2ee1f2804d958f4c6f66d6dee4 Issue-ID: VVP-80 Signed-off-by: Bozawglanian, Hagop (hb755d) <hb755d@att.com>
2018-07-19[VNFRQTS] update decorator for validation scriptstark, steven1-47/+44
update decorator for validation script corresponding to 5.2.1 of VNFRTQS update decorator for validation script corresponding to 5.2.2 of VNFRTQS Change-Id: I063e799a27c76bb58c031273aca48031965849d9 Issue-ID: VVP-88 Signed-off-by: stark, steven <ss820f@att.com>
2018-04-23[VVP] add bug fixes and reserve port updatesstark, steven3-2/+39
Adding test script updates and reserve port Change-Id: I2af5263a48a53117021f166d08395685e89fd122 Issue-ID: VVP-56 Signed-off-by: stark, steven <ss820f@att.com>
2017-09-14Commit test list join for availability_zoneedan-att1-0/+6
These changes were imported from upstream @ commit e38076e29ef8c86c510fca3141954d10602040bb - Updated `nested_iterables` to parse list_join if available in the templates - Updated `test_volume_resource_ids` to allow volume ids to be provided as a parameter list - Appropriate fixture additions and changes Change-Id: Ia2187fe4eb7a389c8df01061be229246262d9a24 Issue-Id: VVP-29 Signed-off-by: Edan Binshtok <eb578m@intl.att.com>
2017-09-05Commit seed code for validation-scriptsMichael F. Lamb8-0/+976
This imports the initial seed code for validation scripts. These files were imported from a tarball with the SHA1SUM ce2ae49c82546b987c8ad2f68ac43d94b4934818. From the contents of the tarball, some errant .pyc files were removed, and a .gitignore file was added. The result matches exactly the contents of the origin private repository at hash 88c656e. Change-Id: I97d19b11495e116890ca6577e83037b0934519cc Issue-Id: VVP-11 Signed-off-by: Michael F. Lamb <mike@datagrok.org>