1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
|
1. History
==========
* Development started over 2 years ago as part of the Network Automation, the Intelligent Service Composition project
* It was supporting the model driven composition of resources/services/products
2. Scope
========
* Development of a tool as generic as possible
- not bound to a particular schema/profile
- no particular type of post-processing (orchestrator)
- limited to TOSCA yaml profile
- Java language
3. Goals
========
* Ensure that a (set of) TOSCA template(s)is conform to a correctly defined type system
- avoid errors at more expensive later processing stages
- pre-requisite to further processing: UI rendeing, persistence
* Generate an intermediate form that could facilitate further processing
* Extensibility
- accommodate extensions to the standard and checks pertinent to these extensions
4. The checker
==============
* Validate yaml document
- supports streaming documents (multiple documents within one file), yaml anchors, etc
- currently uses the snakeyaml library
* Syntax check
- two pre-defined grammars, 1.0 and 1.1, with the possibility of handling a mix of documents version wise
+ other versions/variants can be added 'on the fly', identified through the tosca_definitions_version entry
- accept the short forms
+ declare the short forms within the grammar
+ builds a canonical form from which the shorts forms are eliminated (so further processing steps do not need to handle them)
- grammar written in yaml
+ easy to maintain/modify
+ processed through a modified version of the kwalify library
* Checks
- type hierarchy checks for all constructs
+ valid re-definitions: from relatively simple (properties) to rather complicated (interface opearations)
- valid type references: all referenced types are pre-declared (as super-types, as valid source types, etc)
- templates respect their respective type definition
+ example: check type of interface operation inputs
+ other references: capabilities and requirements in substitution mappings
- data checks: assignments match the type specification, function argument compatibility (for built-in functions), constraints matching
* Process the entire document tree specified through import statements
* Extensibility
- pluggable document locator/loader
- pluggable handlers at syntax check (pre/post validation)
- pluggable checks based on document location
+ a new construct (new grammar) can be subject to new semantic checks plugged without checker code being re-built.
5. Output
=========
* Error reporting
- Differs depending on the stages
+ Document position indication during parsing
+ Document path and rule during syntax check
+ Document path during checking
* Catalog
- No explicit representation of TOSCA constructs, offers a query interface with results being exposed as common Java types: maps, lists, ..
- domain specific (TOSCA constructs) navigation built through a proxy based approach on top of above representation
6. Usage
========
* API
- simple API that allows access to any stage of the checker
+ One can build an in-memory representation of a TOSCA document and skip the yaml parsing.
+ Re-usable Catalog (hierarchical Catalogs)
+ One or more documents can be processed and the resulting Catalog be preserved and used for later processing of other documents using the previous catalog as base catalog
* CLI
- basic command line interface
* Service
- stateful REST service layer on top of checker API
+ a schema (document with type specifications) can be submitted and be referenced (imports) from subsequently submitted templates
7. Post-processing
==================
* A tiny framework for additional processing
- one basic implementation of a JavaScript post-processor where the Catalog and topology graph are exposed to javascript scripts implementing business validation rules
|