aboutsummaryrefslogtreecommitdiffstats
path: root/ice_validator/tests/fixtures
AgeCommit message (Collapse)AuthorFilesLines
2020-01-21[VVP] Disallow vf_module_index look ups per R-55307Lovett, Trevor4-0/+217
Change-Id: I2aa9502cbb38f4b1be943d6d100164de1e1b1628 Issue-ID: VVP-354 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2020-01-17[VVP] Allow base templates to not have resourcesLovett, Trevor5-0/+98
Change-Id: I44232d58697ff95b418e9594451cda3c3a90c798 Issue-ID: VVP-361 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2020-01-16[VVP] Resources not allowed in 2nd level templatesLovett, Trevor14-492/+11
Cleaned up nesting detection logic Deleted test in Nova Server file as the nesting is no longer related to Nova servers Added check for resources in 2nd level nested files to existing test. Change-Id: I136efb786f67cf4c45fe4da3abaa3fcec024ba50 Issue-ID: VVP-357 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-11-12[VVP] updating ports.py to check str_replace paramsstark, steven9-397/+177
allowed_address_pairs/ip_address can use CIDR format, and is often done by using the intrinsic function str_replace. This update will naively go through each param in a str_replace to check if one is a valid allowed_address_pair/ip_address parameter. Issue-ID: VVP-341 Signed-off-by: stark, steven <steven.stark@att.com> Change-Id: I24e7ad6b74e5795b577d99468517287be46cd2b7
2019-10-08[VVP] Flag duplicate parameters in .env filesLovett, Trevor4-0/+57
Also some minor tweaks to preload generation so it doesn't fail on partial heat templates Change-Id: If39288dde645b0b53a338e7672336807ffa1b6d7 Issue-ID: VVP-284 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-10-07[VVP] Enforce R-35666 by ensuring a network exists for int_ parametersLovett, Trevor9-55/+306
Implements a basic sanity check that if parameters match the internal network naming convention, then we ensure the network itself was defined in a heat template. Change-Id: I37c84e2c62745a51a90dd60f0aaeb213d784f003 Issue-ID: VVP-327 Signed-off-by: Lovett, Trevor (tl2972) <trevor.lovett@att.com>
2019-09-20[VVP] Misc tweaks and fixes to preload generationLovett, Trevor4-0/+191
* Use VALUE_FOR if value is still CHANGE me in .env file * Fix issues with improper parameters being put in VNF parameters in the preload * Fix issue where lists of parameter values pulled from env file could only be put in one template * Exclude platform provided parameters from VNF parameters in preload * Fixed issues with parameter validations * Updated heat requirements * implemented missing test for new requirement that all incremental modules must have a nova server Issue-ID: VVP-312 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com> Change-Id: I1a1225097544b690fb9b854c8a3d9e036f694d6a
2019-06-05[VVP] removed fixtures for the deleted testsLokur, Manish2-160/+0
Issue-ID: VVP-223 Change-Id: I00def826ff322fa9ae6d308c1107e3cac659e061 Signed-off-by: Lokur, Manish <manish.shivakumar.lokur@att.com>
2019-05-30[VVP] Exempt output section from nested get_param checkLovett, Trevor1-1/+2
Change-Id: Ib87b0fb1c70c5689fc7687a21a27ea60934096b1 Issue-ID: VVP-220 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-05-28Merge "[VVP] Refine nested get_param test per R-10834 update"Steven Wright1-12/+9
2019-05-24[VVP] Refine nested get_param test per R-10834 updateLovett, Trevor1-12/+9
R-10834 was updated via VNFRQTS-646 to better reflect SDC's level of support Change-Id: I5232e7dc88c8c20f076788abf368bf33f4f1e1cb Issue-ID: VVP-219 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-05-23[VVP] adding heat template-validate teststark, steven7-0/+112
Issue-ID: VVP-218 Signed-off-by: stark, steven <steven.stark@att.com> Change-Id: If88f9b4b620aaffe61ead3b6f7d5c74dcfd14cba
2019-05-17[VVP] Update validations based on VNFRQTS-637dublinLovett, Trevor7-531/+0
Update to the latest bundled requirements text Update aap_exempt message to better reflect verbiage Remove unneeded test: tests_neutron_port_addresses (requirement removed) Map aap_exempt requirement to associated tests Also adding new helper scripts to help detect divergences between VNF Requirements and VVP as well as other VVP best practices: checks.py - Pre-commit checks - requirements are up-to-date with VNFRQTS - all testable requirements have tests - all non-testable requirements are *not* mapped to tests - flake8 passes - self-test passes update_reqs.py - Updates the the contents of heat_requirements.json with latest req'ts from VNFRQTS Nexus artifact Change-Id: Ia197de3254a1a0369224939f66a5f98c601a314d Issue-ID: VVP-216 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-05-16[VVP] Add test for R-100260 and fix mappingLovett, Trevor (tl2972)6-84/+302
Re-arranged some helper and util functions to more logical locations. Added test to verify than an internal subnet parameter used in an incremental module is defined in the base module. Change-Id: I20369396b18820f0e321c0e75bd47446b0a7a39f Issue-ID: VVP-215 Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
2019-05-15[VVP] R-100280, R-100290, and aap_exempt supportLovett, Trevor7-0/+205
Change-Id: I732af13a22e8c1dadc5fbf622a6efd102146262b Issue-ID: VVP-214 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-05-14[VVP] Adding env file checks for contrailLovett, Trevor14-4/+505
* Introduced helper method get_param to handle extracting param names from both get_params with string and list arguments * Moved test files for environment tests to independent directories to make it easier to isolate unit tests * Added contrail tests related to env file usage related to VNFRQTS-630 Change-Id: I3b44f0ce2d5657e9ab5290cd77f1422b36052b6a Issue-ID: VVP-213 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-05-13[VVP] Adding tests for new reqs from VNFRQTS-630stark, steven7-3/+239
Added tests for reqs: R-100010, R-100030, R-100050, R-100070, R-100090, R-100110, R-100130, R-100150, R-100200, R-100220, R-100240, R-100310, R-100330, R-100360, R-100370, R-100260, R-100000, R-100190, R-100350 Updated neutron param tests to re-use validation code for contrail tests Change-Id: I84af725ca9de176dc690fffda01ffcad453213ea Issue-ID: VVP-211 Signed-off-by: stark, steven <steven.stark@att.com>
2019-05-09Merge "[VVP] adding list support for non-server-name uniqueness"Steven Wright1-0/+20
2019-05-09Merge "[VVP] relaxing test_contrail_fqdn"Steven Wright1-5/+15
2019-05-02[VVP] adding list support for non-server-name uniquenessstark, steven1-0/+20
Change-Id: I9990cc0f3535df96f1ea7679fb87aea36398f433 Issue-ID: VVP-179 Signed-off-by: stark, steven <steven.stark@att.com>
2019-05-02[VVP] relaxing test_contrail_fqdnstark, steven1-5/+15
Test now only validates if using get_param. This allows connecting to internal networks via get_resource, get_attr, etc.. Change-Id: Ib0e9f014b62669aec48d8421a6de97a919126fd6 Issue-ID: VVP-191 Signed-off-by: stark, steven <steven.stark@att.com>
2019-05-02[VVP] adding subnet_uuid to nested parameter checkstark, steven4-1/+21
Change-Id: If0ae761fa20c24b3839234f23037fff6b32d851b Issue-ID: VVP-199 Signed-off-by: stark, steven <steven.stark@att.com>
2019-04-29VNFRQTS - update contrail validationHagop Bozawglanian1-3/+0
Issue-ID: VVP-200 Change-Id: Iae2b9941ac6470e94df988daf9a306924fa3ca3b Signed-off-by: Hagop Bozawglanian <hagop.bozawglanian@att.com>
2019-04-22[VVP] updating nested parameter teststark, steven14-345/+754
R-708564 was updated in RTD to target explicit parameters Change-Id: If860903ae13b76543c43f3e805b8aa03e9e2019d Issue-ID: VVP-197 Signed-off-by: stark, steven <steven.stark@att.com>
2019-04-16[VVP] Case-insensitive network role comparisonLovett, Trevor1-1/+1
Change-Id: I3a761040770bac59093e105acda6b59e9f955c48 Issue-ID: VVP-194 Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
2019-04-15[VVP] Updated network param validations per reqtsLovett, Trevor21-357/+718
Change-Id: Idb0e051d6063cd94b733ed68093989d527592c9f Issue-ID: VVP-193 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com> Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
2019-04-09[VVP] restricting ip index check to resourcesstark, steven6-202/+57
Restricting check for ip parameter indices to only those parameters that are used in OS::Neutron::Port Issue-ID: VVP-190 Change-Id: Ifaf1a40ee47bcaf83657fe58a33e229c4126b4e8 Signed-off-by: stark, steven <steven.stark@att.com>
2019-03-21[VVP] updating OS::Neutron::Port parameter testsstark, steven15-2540/+36
AAP, FIP/IP, FIP/Subnet parameters use same validation (ports.py) REGEX moved to specific tests Added tests for R-159016, R-717227, R-805572 Removed mapping for R-98748 Updated env file test to exclude internal AAP params Change-Id: Iddde8ee42400b8df9be49b8c15718b451101b37b Issue-ID: VVP-181 Signed-off-by: stark, steven <steven.stark@att.com>
2019-02-28Merge "[VVP-171] R-84123 and R-76160 test update"Steven Wright4-9/+5
2019-02-27[VVP-171] R-84123 and R-76160 test updatestark, steven4-9/+5
R-84123 and R-76160 test_neutron_port_internal_fixed_ips should only be checking incremental modules Change-Id: I7ef3cd4aa2b01273c2592f0b17751c5cb79c002b Issue-ID: VVP-171 Signed-off-by: stark, steven <steven.stark@att.com>
2019-02-26[VVP] R-95430 modified in vnfrqtsstark, steven2-6/+0
Removing test for R-95430 because requirement was changed from MUST to MAY Change-Id: I3430c54d319561b26a98380146e365a3b3b90f3c Issue-ID: VVP-178 Signed-off-by: stark, steven <steven.stark@att.com>
2019-02-12[VVP] Allow lists in test_availability_zoneLovett, Trevor1-52/+0
Change-Id: I590830db83b0c7dd5df2ac59992a7771483eab03 Issue-ID: VVP-165 Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
2019-02-08[VVP] Improved message on test_base_template_nameLovett, Trevor2-0/+112
Change-Id: I5974ed3b8ff6e20ab747b3e96af37f84a133ecbb Issue-ID: VVP-141 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-02-08[VVP] Fixing internal network checkLovett, Trevor3-23/+70
The test_neutron_port_internal_network test is intended to check that internal networks referenced in **incremental** modules are defined and exported in the base template. The current version of the test applies this check to nested modules as well causing false violations to be flagged. Issue-ID: VVP-163 Change-Id: I42cc81acf0cc2b6827ae8cf4e9a7faa4af91f9b4 Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
2019-02-05[VVP] Removing invalid testsLovett, Trevor14-1513/+0
Change-Id: I9336fa834b08748cabb5ac49495f1591f15939f8 Issue-ID: VVP-150 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-02-04[VVP] enhance tests for nested templatesstark, steven3-3/+3
Change-Id: I17047fa3df555fafcdae566fad50b8c19ddca16f Issue-ID: VVP-158 Signed-off-by: stark, steven <steven.stark@att.com>
2019-01-30[VVP] Removing unnecessary trademark linesLovett, Trevor362-504/+163
Issue-ID: VVP-152 Change-Id: I6b978768324f69adba50c75a187509c4a7605341 Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
2019-01-29[VVP] stand alone tool, script updatesstark, steven43-486/+1468
1) Validation script updates: Various bug fixes and script enhancements New tests for: R-18683 R-94669 R-304011 R-01455 R-86476 R-708564 R-85734 R-18683 R-94669 R-304011 R-01455 R-86476 R-86476 R-589037 Removed tests for: R-75202 R-62954 R-22441 R-49177 R-16576 R-86237 R-44491 R-70757 R-01896 R-26124 2) Stand Alone tool introduced 3) Added optional "categories" capability Change-Id: I193cd5c267750791d97b350e91fc36faa72d8d5f Issue-ID: VVP-143 Signed-off-by: stark, steven <steven.stark@att.com>
2018-12-17[VVP] updating validation scripts in dublinstark, steven175-1597/+8574
- adding backlog of new validation scripts for dublin - updating existing tests - removing outdated tests Issue-ID: VVP-123 Change-Id: Ib8260889ac957c1dd28d8ede450fc8edc6fb0ec0 Signed-off-by: stark, steven <steven.stark@att.com>
2018-09-14[VVP] udpating scripts for casablanca 2stark, steven39-834/+1587
adding scripts updates adding docrators for sections 5.2.6 - end closes out VVP 80 Change-Id: Iecac476949aa3ae3982f8c77671869583eb313d6 Issue-ID: VVP-80 Signed-off-by: stark, steven <ss820f@att.com>
2018-09-13[VVP] udpating scripts for casablancastark, steven2-8/+8
adding new "infrastructure" scripts addresses bugs VVP-100, VVP-101, VVP-102 adding base tests updating tests where arguments have changed Adds traceability for task VVP-92 Change-Id: I067d8e80934403039e66fbc9fc93766587f67b4e Issue-ID: VVP-80 Signed-off-by: stark, steven <ss820f@att.com>
2018-08-22[VVP] Added new three new reportsLovett, Trevor (tl2972)217-641/+641
Resolves VVP-81 by introducing three new reports to the validation script output. Each report is written to the output directory under ice_validator. * mapping_errors.csv - each row represents an issue where a test is mapped to a requirement that does not exist in the requirement.json file * traceability.csv - Shows a mapping between all test cases and requirements. Rows will also be shown where a requirement does not have a tests, and where tests are not mapped to a requirement * report.{html|csv|xlsx} - Formatted error report that shows each failure that was detected and maps it to a the file name, requirement(s) violated if known, possible resolution steps, error message, and raw output from pytest. The report can be written in html, csv, or Excel format Other minor changes: * Replaced smart quotes with regular quotes to resolve issues with py3 * Updated copyright of modified files * Fixed Flake-8 errors Issue-ID: VVP-81 Change-Id: I659836cb20262ae44652c03639281a817dd051ae Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
2018-08-09[VVP] create new validation scriptsstark, steven14-0/+1038
- create validation scripts for R-04747, R-30804, R-11690, R-46839, R-98407 - other small script enhancements Change-Id: I12c42a43c83e5cb4217895c19fd0beef928dc955 Issue-ID: VVP-103 Signed-off-by: stark, steven <ss820f@att.com>
2018-07-19[VNFRQTS] update decorator for validation scriptstark, steven4-4/+132
update decorator for validation script corresponding to 5.2.1 of VNFRTQS update decorator for validation script corresponding to 5.2.2 of VNFRTQS Change-Id: I063e799a27c76bb58c031273aca48031965849d9 Issue-ID: VVP-88 Signed-off-by: stark, steven <ss820f@att.com>
2018-06-21[VVP] test port resource idsstark, steven1-10/+12
test port resource ids regex and logic doesn't properly validate ports Change-Id: Iae9a83c65eb04a232fb229a97c944f0ac4d62497 Issue-ID: VVP-85 Signed-off-by: stark, steven <ss820f@att.com>
2018-04-23[VVP] add bug fixes and reserve port updatesstark, steven21-153/+993
Adding test script updates and reserve port Change-Id: I2af5263a48a53117021f166d08395685e89fd122 Issue-ID: VVP-56 Signed-off-by: stark, steven <ss820f@att.com>
2017-09-14Commit test list join for availability_zoneedan-att9-2/+705
These changes were imported from upstream @ commit e38076e29ef8c86c510fca3141954d10602040bb - Updated `nested_iterables` to parse list_join if available in the templates - Updated `test_volume_resource_ids` to allow volume ids to be provided as a parameter list - Appropriate fixture additions and changes Change-Id: Ia2187fe4eb7a389c8df01061be229246262d9a24 Issue-Id: VVP-29 Signed-off-by: Edan Binshtok <eb578m@intl.att.com>
2017-09-05Commit seed code for validation-scriptsMichael F. Lamb219-0/+19746
This imports the initial seed code for validation scripts. These files were imported from a tarball with the SHA1SUM ce2ae49c82546b987c8ad2f68ac43d94b4934818. From the contents of the tarball, some errant .pyc files were removed, and a .gitignore file was added. The result matches exactly the contents of the origin private repository at hash 88c656e. Change-Id: I97d19b11495e116890ca6577e83037b0934519cc Issue-Id: VVP-11 Signed-off-by: Michael F. Lamb <mike@datagrok.org>