aboutsummaryrefslogtreecommitdiffstats
path: root/cps-application/src
AgeCommit message (Collapse)AuthorFilesLines
2025-02-05Merge "Remove multithreading from module sync watchdog"Toine Siebelink1-4/+0
2025-02-05Merge "Change event topic name for trust level"Daniel Hanrahan1-0/+1
2025-02-04Remove multithreading from module sync watchdogdanielhanrahan1-4/+0
After introduction of module set tag improvements, there is no need to multithreading in module sync. Performance impact is minimal. Issue-ID: CPS-2165 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I1557fc8348d39da3654a1b92944c6ad49fa8670d
2025-01-27Change event topic name for trust levelemaclee1-0/+1
- Seperate inventory related topics to cm data event topic Issue-ID: CPS-2500 Change-Id: I41a2cda78568f9979fc9f030f076c295c8d6908b Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech>
2025-01-24Disable JVM process metrics by defaultdanielhanrahan2-0/+5
Issue-ID: CPS-2583 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: I9c7a543201a63c1f128737bb0995843af6075a6b
2025-01-24Merge "Fix for cm handles stuck in LOCKED during registration"Priyank Maheshwari1-2/+0
2025-01-23Expose JVM process metricsdanielhanrahan2-1/+21
Currently, Grafana only shows memory used inside the JVM, but not including memory used by the JVM process itself. These metrics are needed for determining real memory usage. Issue-ID: CPS-2583 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: Ib77f9057c7301ea5afc2a621526736213ddd817a
2025-01-23Fix for cm handles stuck in LOCKED during registrationToineSiebelink1-2/+0
- Additional Error logging when cm handles fail module sync - Swallow already defined exception upon schema and/or anchor creation - Updated integration test to try to reproduce the problem (but couldn't) - Ignored integration tests that depend/affected by race conditions (they are useful for troubleshooting but not for pipeline checks) - Removed last remnants of springboot retry annotation option (incl dependencies) Issue-ID: CPS-2576 Change-Id: I910e802268332f955134c043bd1b46a7ec57233b Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
2025-01-22Merge "Moved builders under impl in CPS Service"Toine Siebelink1-0/+1
2025-01-22Add 'Deleted' cm handle state for gaugeemaclee2-5/+21
Issue-ID: CPS-2456 Change-Id: I2f7ff2dd18d164dbf685269fb2d2e47d08c3c5f5 Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech>
2025-01-21Remove retry mechanism for duplicate module(resource) errorsToineSiebelink1-3/+2
- CM Handle with problems will go into 'LOCKED' state and retried using existing business logic Issue-ID: CPS-2555 Change-Id: I563f6bc536d8fd8c6675891c62318ff2fb43fea6 Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
2025-01-20Moved builders under impl in CPS Serviceleventecsanyi1-0/+1
- moved builders and fixed the Arch test Issue-ID: CPS-2542 Change-Id: Iac9d47f20fff2e6fa415ada8bc17880b0b032591 Signed-off-by: leventecsanyi <levente.csanyi@est.tech>
2025-01-20On demand heapdump and threaddump generation for cps-and-ncmpmpriyank1-1/+1
- Generate the heapdump of a running application on demand using the /actuator/heapdump endpoint and threaddump using /actuator/threaddump - RTD update as separate patch when the python issue is sorted Issue-ID: CPS-2453 Change-Id: Ifcf4e7aecc1ee15f57011a1c4a4ec7bf67e45a6f Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2025-01-17Merge "Moved impl package out from api package"Toine Siebelink1-4/+2
2025-01-17Merge "Make Response Timeout Configurable in WebClient Configuration"Lee Anjella Macabuhay1-0/+3
2025-01-17Moved impl package out from api packageleventecsanyi1-4/+2
- refactored cps service packages and the architecture test Issue-ID: CPS-2543 Change-Id: I0fab54cebd157b19ff6105b7d4b6d8265a1af485 Signed-off-by: leventecsanyi <levente.csanyi@est.tech>
2025-01-16Make Response Timeout Configurable in WebClient Configurationsourabh_sourabh1-0/+3
- Added responseTimeoutInSeconds property in the ServiceConfig class to allow dynamic configuration of the timeout. - Updated WebClientConfiguration to read the responseTimeoutInSeconds from ServiceConfig and set it in the HttpClient. Issue-ID: CPS-2565 Change-Id: I096688319c55f0342b524511883ec0d33806b9b7 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2025-01-16Handle restart case for cps-ncmp gauge metricsemaclee2-27/+11
Issue-ID: CPS-2456 Change-Id: I9ac5d6774fcd745d8141551eeff8a1deb1938f57 Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech>
2025-01-07Add gauge metric for NCMP "cmhandle states"emaclee3-9/+112
Issue-ID: CPS-2456 Change-Id: I1aebcc68dfdc9c48c230c74376742d67b05c0615 Signed-off-by: emaclee <lee.anjella.macabuhay@est.tech>
2024-12-05Moved common classes under the api package under apileventecsanyi2-7/+5
- moved common classes under the api package - moved Spec files Issue-ID: CPS-2512 Change-Id: I88046280ce359ce8cc488ad37d4e6f85406b0dbf Signed-off-by: leventecsanyi <levente.csanyi@est.tech>
2024-10-29Merge "Add metadata related to builds and commits"Toine Siebelink1-0/+5
2024-10-24Added arcitecture tests for CPS (REST and service and RI)leventecsanyi3-48/+149
- added Base class and extracted common method for 3pp checks - added ArchTests for cps REST and cps service Issue-ID: CPS-2423 Change-Id: Icf70b79d1397b002d75ec5c8761775dfd7a6c6d9 Signed-off-by: leventecsanyi <levente.csanyi@est.tech>
2024-10-23Add metadata related to builds and commitsmpriyank1-0/+5
- removing the build-info goal from the existing spring-boot-maven-plugin - adding git-commit-id-maven-plugin to expose the git related info using actuator/info endpoint - adding the dateFormat to git plugin to make it same as the build-info - cleaning up a duplicate dependency in cps-ncmp-rest-stub module Issue-ID: CPS-2445 Change-Id: Id7179a81361718d293b7b31f50c1adbdd2ad4302 Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2024-10-17Release notes and documentation updates for 3.5.4danielhanrahan1-2/+0
- Release notes update - Update openapi info.version to 3.5.4 - Update scheduled-tasks docs to reflect changes in retry mechanism - Update deployment docs to update configurable timer parameters - Remove unused locked-module-sync.sleep-time-ms Issue-ID: CPS-2457 Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech> Change-Id: Ieb559bbfe348848c4b8669410861edfeeb6c9bf3
2024-10-10Merge "use one hazelcast instance per jvm"Lee Anjella Macabuhay1-0/+1
2024-10-10use one hazelcast instance per jvmmpriyank1-0/+1
- updated all the cache(distributed datastructures) to use the same instance config now. - there will be just one instance per JVM now - Better cleanup of hz instance in the testware - Refactored the testware to verify the configs - Expected Impact on lowering the memory usage, less number of TCP communications between members - NOTE: we need to do a full regression as the changes impacts all the use cases which involves cache Issue-ID: CPS-2408 Change-Id: I7564992a9990f44ef3defb4f50cb7d094cad7b92 Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2024-10-09Merge "Added architecture tests to validate ONLY NCMP REST/Service dependencies"Sourabh Sourabh2-72/+98
2024-10-09Added architecture tests to validate ONLY NCMP REST/Service dependenciesleventecsanyi2-72/+98
- removed old tests and added new test cases for the NCMP controller and service layers - other dependencies will be added in later commits Issue-ID: CPS-2422 Change-Id: Iabc4b53e9414477cf3d0b2e1e5a03ba8b4995169 Signed-off-by: leventecsanyi <levente.csanyi@est.tech>
2024-10-03Policy Executor: handle errors, part 2ToineSiebelink1-1/+1
(fighting between IntelliJ and Checkstyle best practices) - non-2xx responses are processed using web client exceptions - handle unknown host exception - upgraded spotbugs (checkstyle and related mvn plugin) - fixed some small spotbugs due to upgrade - added commented instructions in docker compose to enable debugging - added some environment variables for policy executor configuration - extract out Sleeper in stub service to achieve 100% coverage - added cause to Policy Executor exceptions where applicable - ignored (new) spotbug rule about catch NPE because of issue in 3pp - ignored (new) spotbug rule about \n in string due to multiline string block Issue-ID: CPS-2412 Change-Id: I6835a73320c436cbeea12cc7a06f15899eec7bf1 Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
2024-09-25Policy Executor: handle errorsToineSiebelink1-0/+1
- configurable default answer - apply default answer upon non 2xx response - delayed default webclient read timeout - add custom timeout method with original read timeout in seconds - apply default answer upon timeout - add integration test with short timeout error scenario Issue-ID: CPS-2412 Change-Id: I62527a27e426c2f01fda2182ebd2513242c29ac1 Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
2024-09-19Retry mechanism (with back off algorithm) is removed with more frequent ↵sourabh_sourabh1-1/+1
watchdog poll - Increased watchdog frequency for locked cm handle. - Removed retry backoff algorithm for locked cm handle. Issue-ID: CPS-2395 Change-Id: I54d0ec8f9de53a7d181639c14aaaa93736f03e19 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2024-09-18Merge "Refactored cps-ri package structure"Sourabh Sourabh1-2/+2
2024-09-17Refactored cps-ri package structureleventecsanyi1-2/+2
- fixed import order and moved package structure Issue-ID: CPS-2293 Change-Id: Ie2f9f057f261577054530feee7480850ba4b41e1 Signed-off-by: leventecsanyi <levente.csanyi@est.tech>
2024-09-17Policy Executor API: Add Prefix in YamlToineSiebelink1-3/+3
- Remove servers from yaml. - Add prefix to path in yaml. - Remove basepath prefix from Controller Impl. - Added policy server port to 8093. - Exposed docker env. vars for policy services. Issue-ID: CPS-2291 Change-Id: Idcc9e23f9d63bad2480537dc8d39523fe82b4b83 Signed-off-by: ToineSiebelink <toine.siebelink@est.tech> Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2024-08-29Invoke Policy Executor and handle not-allowed responseToineSiebelink1-3/+3
- Execute Policy Executor REST request - Act (and log) on response from Policy Executor - Add dispatcher(mock) in integration test FWK - Add integration test for allow/non allowed and no authorization use cases - disabled PolicyExecution feature by default (only enabled for testware) Issue-ID: CPS-2247 Change-Id: I111ba9ba89cc91649b63b20f88414aa33721dbeb Signed-off-by: ToineSiebelink <toine.siebelink@est.tech> Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2024-08-26Policy Executor and DMI WebClient configurationsToineSiebelink1-6/+19
- separated dmi and policy executor http client configuration Issue-ID: CPS-2324 Change-Id: Ib4e757da188673e163abe6078dfd6ddae447eaab Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
2024-08-13CPS-NCMP: Slow cmHandle registration when we use moduleSetTag, alternateId ↵sourabh_sourabh1-1/+1
and dataProducerIdentifier - Created a new repo. service for fragment table that executes a native sql query to find first ready cm handle id based on moduleset tag and then returns list of module references. - Exposed a new interface into module service that is used by module sync service to get list of midule refs by module set tag. Issue-ID: CPS-2353 Change-Id: I438dbd1ed37c1ff4e15f792e93a095aa604120bc Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2024-07-31Effect changes on scheduled tasks (don't want scheduled tasks to be monitored)sourabh_sourabh1-0/+1
- Applied a filter on tasks.scheduled.execution. - It is configurable from application.ymal into cps.scheduled-task-names: - tasks.scheduled.execution by default. - Added a new property configuration bean for open telemetry. - Introduced new propery attribute that takes list of task names to be filtered. Issue-ID: CPS-2250 Change-Id: I8e5334cd166343181df6dd1985471f5465f14f0e Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2024-06-26Move TrustLevel FeatureToineSiebelink1-0/+4
-Moved TrustLevel impl from Controller to Inventory Facade -Applied new package name convention using impl\inventory\trustlevel for this (sub)feature -Renamed some trustlevel related classes to better describe their role -Disabled failing architecture test (agreed this is tech. debt and created CPS-2293) -Refactored YangDataConverter method names and signatures (moved Spec to correct place) -Cleaned up names and javadoc of class now called DeviceTrustLevelMessageConsumer -Applied conventions to modified test methods Issue-ID: CPS-2255 Change-Id: Iccd20541488e6b61444bb2c7406c90e61a34124d Signed-off-by: ToineSiebelink <toine.siebelink@est.tech>
2024-06-19Handle high frequency (faster then DMI) of passthrough request in NCMPsourabh_sourabh1-0/+2
- Added pendingAcquireMaxCount property into appliaction.yml. - Added findbugs google annotations dependency. - Supressed "BC_UNCONFIRMED_CAST_OF_RETURN_VALUE" spotbugs low error for reactor.netty.resources.ConnectionProvider. Issue-ID: CPS-2262 Change-Id: Ie755e40282473933f2052fbe7654e7090bb9b337 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2024-06-06#1: Dedicated web client instance is assigned for data, model and health ↵sourabh_sourabh1-5/+12
services - Switched web client instance based on dmi service type (like data or model) - 3 diff. beans are configured for data, model and health dmi service. - Added configurable properties for data and model. - Hard coded properties are assigned for health service. Issue-ID: CPS-2231 Change-Id: I39fb739c07c41430dae43509fe29ece5306b7d71 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2024-05-31Added OpenTelemetry to CPSdavid.mcweeney1-0/+21
Change-Id: I192fa53e293ea43cdff92ebd44d0382eb290bb76 Signed-off-by: david.mcweeney <david.mcweeney@est.tech> Issue-ID: CPS-2172
2024-05-22Remove un-used code of RestTemplatesourabh_sourabh1-2/+2
- Removed unused property belons to resttemplate - Refactored dmi properties class (from static internal class) - Overriden getter method of dmi basepath that removes any leading and trailing slashes from it. Issue-ID: CPS-2202 Change-Id: I16f61388fce2a6b9e258788fa826d485581d6138 Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2024-05-20Merge "CmSubscription topics param update"Lee Anjella Macabuhay1-4/+4
2024-05-17Replaced RestTemplate with WebClient in synchronous DMI callssourabh_sourabh1-0/+1
- added DmiWebClientConfiguration - use WebClient in DmiRestClient - fixed unit tests - encode query params for DMI request - added configurable buffer size - Re-used ncmp.dmi.httpclient.maximumConnectionsTotal parameter (as documented in RTD) to control webclient connection poolsize Issue-ID: CPS-2173 Change-Id: I21584563034d58e8ae3ff3cbcf172e0d14b408fb Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>
2024-05-17CmSubscription topics param updatempriyank1-4/+4
- topic application parameters updated to be in sync with the actual convention we are following for the flow. - environment variables also updated to follow the same - removed the unused parameters related to notification Issue-ID: CPS-2210 Change-Id: If5adb3dac1ce81df5afe2e99f99513adc2011cc9 Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2024-05-08Conditional cps change eventsmpriyank2-2/+6
- introduced a parameter to control the cps core change event notifications. we should be able to disable these notifications without affecting other notification flows. - fixed the LayeredArchitectureTest as we are accessing the Anchor model in the events package now. Issue-ID: CPS-2213 Change-Id: Id875925bc14de1cc6e8fa3193c0df470e09fe43f Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2024-05-02Merge "Add Notification support in cps core"Priyank Maheshwari1-3/+4
2024-04-30[BUG]Defaults for cps and dmi user and passmpriyank1-4/+4
- provided default values for DMI_USERNAME and DMI_PASSWORD which is required to set when DMI_AUTH_ENABLED is true - Also provided defaults for CPS_USERNAME and CPS_PASSWORD as its been used in the logback xml file and if not provided then causes an issue with the logger Issue-ID: CPS-2194 Change-Id: I70fdbeca970556c7bd19f27c1b6b5123fd591283 Signed-off-by: mpriyank <priyank.maheshwari@est.tech>
2024-04-30Reverted web client changes as it breaking CPS functionality:sourabh_sourabh1-1/+0
1. Error handling not working 2. Unable to make dmi call as url appens extra "/" Commit 1: Replace RestTemplate with WebClient in synchronous DMI calls - added DmiWebClientConfiguration - use WebClient in DmiRestClient - fixed unit tests - ingnored failing NCMP related integration tests (related to WebClient, will be fixed in a future patch) - encode query params for DMI requests Commit 2: Module sync task failing with WebClient - added configurable buffer size Commit 3: Re-use ncmp.dmi.httpclient.maximumConnectionsTotal parameter (as documented in RTD) to control webclient connection poolsize Issue-ID:CPS-989, CPS-2195, CPS-2198 Change-Id: I6c71ab2801b222708404f51bd60f2b3031ebf32e Signed-off-by: sourabh_sourabh <sourabh.sourabh@est.tech>