Age | Commit message (Collapse) | Author | Files | Lines |
|
Added the following columns:
* Keyword - MUST, MUST NOT, etc.
* Validation Mode - contents of :validation_mode: from vnfrqts
* Is Testable - TRUE if requirement is testable based on keyword
and validation mode, FALSE otherwise
Also fixed issue following issues:
* Traceability and mapping error reports were not going to the
configured output directory if a custom value was provided
* Removed duplicate rows from traceability report
* Traceability report shows all Heat requirements
Change-Id: I339b42e9e662f1681b78d1a49bd7e71e87cae21a
Issue-ID: VVP-148
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
|
|
|
|
Change-Id: Ia90b2fd528af9e8da8052161e668a6e575652123
Issue-ID: VVP-147
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
|
|
Updated to the latest version of the needs.json
R-52530 was removed and replaced with R-511776 which is already
covered by a different test.
test_07_nested_template_in_same_directory: the only remaining
purpose of this method was to test for the existence of the
nested file, but this is already covered by test_valid_nesting
I mapped the unmapped tests in test_inital_configuration to
to the requirement that states the templates must be valid Heat
Change-Id: Ia71d774df8873ebb4182f44eb66b108f9ff24d20
Issue-ID: VVP-142
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
|
|
Also resolving some flake8 failures
Change-Id: I2de20975106de0308bc20c2a8944e3552f6f7cca
Issue-ID: VVP-140
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
|
|
1) Validation script updates:
Various bug fixes and script enhancements
New tests for:
R-18683
R-94669
R-304011
R-01455
R-86476
R-708564
R-85734
R-18683
R-94669
R-304011
R-01455
R-86476
R-86476
R-589037
Removed tests for:
R-75202
R-62954
R-22441
R-49177
R-16576
R-86237
R-44491
R-70757
R-01896
R-26124
2) Stand Alone tool introduced
3) Added optional "categories" capability
Change-Id: I193cd5c267750791d97b350e91fc36faa72d8d5f
Issue-ID: VVP-143
Signed-off-by: stark, steven <steven.stark@att.com>
|
|
Added a new JSON output format with complete results of
the test run. This can be produced using the existing
--report-format option and passing the json value to it.
Additionally users can now customize where output files are written
using the --output-directory option.
Issue-ID: VVP-132
Change-Id: I7b8a01bd3d5179ecb75b1db588da3bb057b9b573
Signed-off-by: Lovett, Trevor <trevor.lovett@att.com>
Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
|
|
- adding backlog of new validation scripts for dublin
- updating existing tests
- removing outdated tests
Issue-ID: VVP-123
Change-Id: Ib8260889ac957c1dd28d8ede450fc8edc6fb0ec0
Signed-off-by: stark, steven <steven.stark@att.com>
|
|
Change-Id: Ib639b5eb271e48ded9d5c8bb8857b5e12260deed
Issue-ID: VVP-116
Signed-off-by: stark, steven <steven.stark@att.com>
|
|
Fixing try catch to account for service outage.
Issue-ID: VNFRQTS-236
Change-Id: Ic7ef03215fa4ed6319d7b5e986828bc83c17465a
Signed-off-by: Bozawglanian, Hagop (hb755d) <hb755d@att.com>
|
|
adding scripts updates
adding docrators for sections 5.2.6 - end
closes out VVP 80
Change-Id: Iecac476949aa3ae3982f8c77671869583eb313d6
Issue-ID: VVP-80
Signed-off-by: stark, steven <ss820f@att.com>
|
|
adding new "infrastructure" scripts
addresses bugs VVP-100, VVP-101, VVP-102
adding base tests
updating tests where arguments have changed
Adds traceability for task VVP-92
Change-Id: I067d8e80934403039e66fbc9fc93766587f67b4e
Issue-ID: VVP-80
Signed-off-by: stark, steven <ss820f@att.com>
|
|
Fixed the conftest.py script so traceability wouldn't have repeats
and it pulls the newest JSON it runs.
Issue-ID: VNFRQTS-236
Change-Id: Id33965b64f939bed0a6bbb7ab3a9e692829b4603
Signed-off-by: Bozawglanian, Hagop (hb755d) <hb755d@att.com>
|
|
validation scripts pytest --self-test "xfail" being skipped
Issue-ID: VVP-108
Change-Id: I1bdb146db3de78b393315499491b3ad65597213c
Signed-off-by: stark, steven <ss820f@att.com>
|
|
Resolves VVP-81 by introducing three new reports to the validation
script output.
Each report is written to the output directory under ice_validator.
* mapping_errors.csv - each row represents an issue where a test is
mapped to a requirement that does not exist
in the requirement.json file
* traceability.csv - Shows a mapping between all test cases and
requirements. Rows will also be shown
where a requirement does not have a tests, and
where tests are not mapped to a requirement
* report.{html|csv|xlsx} - Formatted error report that shows each
failure that was detected and maps it to
a the file name, requirement(s) violated if
known, possible resolution steps, error
message, and raw output from pytest. The
report can be written in html, csv, or Excel
format
Other minor changes:
* Replaced smart quotes with regular quotes to resolve issues with py3
* Updated copyright of modified files
* Fixed Flake-8 errors
Issue-ID: VVP-81
Change-Id: I659836cb20262ae44652c03639281a817dd051ae
Signed-off-by: Lovett, Trevor (tl2972) <tl2972@att.com>
|
|
- create validation scripts for R-04747, R-30804, R-11690, R-46839, R-98407
- other small script enhancements
Change-Id: I12c42a43c83e5cb4217895c19fd0beef928dc955
Issue-ID: VVP-103
Signed-off-by: stark, steven <ss820f@att.com>
|
|
Change-Id: Ib93b6ff452613b2ee1f2804d958f4c6f66d6dee4
Issue-ID: VVP-80
Signed-off-by: Bozawglanian, Hagop (hb755d) <hb755d@att.com>
|
|
update decorator for validation script corresponding to 5.2.8 of VNFRTQS
update decorator for validation script corresponding to 5.2.7 of VNFRTQS
Change-Id: Ibb5bb639908538c8ce07e2f2913a0fb447c27746
Issue-ID: VVP-94
Signed-off-by: stark, steven <ss820f@att.com>
|
|
Change-Id: I422fad86438380092254e46e3940f32fe6dc732f
Issue-ID: VVP-92
Signed-off-by: stark, steven <ss820f@att.com>
|
|
Change-Id: I2867bdcb2f86410e1c047d90e156471f84baf422
Issue-ID: VVP-92
Signed-off-by: stark, steven <ss820f@att.com>
|
|
update decorator for validation script corresponding to 5.2.1 of VNFRTQS
update decorator for validation script corresponding to 5.2.2 of VNFRTQS
Change-Id: I063e799a27c76bb58c031273aca48031965849d9
Issue-ID: VVP-88
Signed-off-by: stark, steven <ss820f@att.com>
|
|
Adding initial set of decorators
Change-Id: I1d2064c94995fe30b607e7c7b8a0faebe7426f9b
Issue-ID: VVP-80
Signed-off-by: stark, steven <ss820f@att.com>
|
|
Change-Id: I35c7630d0aabb970e67323e1e895a57cbcb23fb2
Issue-ID: VVP-79
Signed-off-by: stark, steven <ss820f@att.com>
|
|
test port resource ids regex and logic doesn't properly validate ports
Change-Id: Iae9a83c65eb04a232fb229a97c944f0ac4d62497
Issue-ID: VVP-85
Signed-off-by: stark, steven <ss820f@att.com>
|
|
Adding test script updates and reserve port
Change-Id: I2af5263a48a53117021f166d08395685e89fd122
Issue-ID: VVP-56
Signed-off-by: stark, steven <ss820f@att.com>
|
|
These changes were imported from upstream @ commit
e38076e29ef8c86c510fca3141954d10602040bb
- Updated `nested_iterables` to parse list_join if available in
the templates
- Updated `test_volume_resource_ids` to allow volume ids
to be provided as a parameter list
- Appropriate fixture additions and changes
Change-Id: Ia2187fe4eb7a389c8df01061be229246262d9a24
Issue-Id: VVP-29
Signed-off-by: Edan Binshtok <eb578m@intl.att.com>
|
|
This imports the initial seed code for validation scripts.
These files were imported from a tarball with the SHA1SUM
ce2ae49c82546b987c8ad2f68ac43d94b4934818.
From the contents of the tarball, some errant .pyc files were removed,
and a .gitignore file was added. The result matches exactly the contents
of the origin private repository at hash 88c656e.
Change-Id: I97d19b11495e116890ca6577e83037b0934519cc
Issue-Id: VVP-11
Signed-off-by: Michael F. Lamb <mike@datagrok.org>
|