Versions Compared

Old Version 14

changes.mady.by.user Gilles Thouenon

Saved on

compared with

New Version 15

changes.mady.by.user Gilles Thouenon

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

available at TransportPCE meetings
https://wiki.opendaylight.org/display/ODL/TransportPCE+meetings

03/16/2023

General information

  • ODL Argon release: we should release ODL Ar today. Last week, Gilles released all artifacts related to transportPCE after having merged all pending changes. Will remain the documentation to handle. Olivier will write a paragraph on impairment aware path computation.

  • Next deadline is Cl SR-3 on the 8th of May

  • Sulfur shall also be End of Life today. However, ODL community proposed to release Sulfur SR-4 as a courtesy release. We are invited to provide the corresponding tpce artifacts.

  • OFC: Nokia presented a demo “Network Management as code”. Javier will share the paper. Nokia also shared in OFC some elements on T-API 2.4. There were almost more than 11000 attendees in OFC this year, which brings it to the level we had before the pandemics. Nathan made different demonstrations based on One Engine and TransportPCE. UTD observed some contention issues with tpce when PMs are also polled by One-Engine. The provisioning of a service then can fail. Nathan changed the code to poll the PM directly from the device rather than passing through tpce. The problems is associated with configuration locking while reading the configuration and potential associated time-out. Guillaume mentions that this could happen when device do not have any candidate Data Store. Gilles mentioned that his recent change on the refactoring of the RequestProcessor class may solve this kind of concurrency issue.

Review

  • Status on changes merged  since last meeting:

    • on transportpce-models project, several changes related to the addition of new T-API models in 2.4. Gilles highligth the fact that T-api models do not put the revision date in the imports. So, he managed this issue through specific changes so that the last version is not automatically imported if we use 2.1 models. Anyway this did not solve a side-effect issue on transportpce project, so Gilles splited models through two different features in  “Split odl-tapi models feature”. Actually, T-API modles in R2.1.1 and 2.4.0 are incompatibles. We can not activate features implementing each version on the same time, but must choose either the feature implementing models in 2.1.1, or the feature implementing models in 2.4.0.
    • Gilles pulled stable/argon branch, updated releng/builder project to have jenkins jobs available for stable/argon branhces, and then released transportpce-models-18.0.0 and transportpce-7.0.0 artifacts for Argon
    • on transportpce project, before releasing, Gilles merged all pending changes that were under review:
      • speed functional tests
      • end of the PostAlgoPathValidator  refactoring
      • all the relation chain related to the migration to Junit 5
      • changes related to the handling of the photonic restoration on real device, used for the OFC demo
      • Bala's relation chain on Regen
      • migration to the latest Argon upstream dependencies
  • transportpce-models or transportpce changes under review:
    • “Bump  project version to 18.1.0 snapshot” on transportpce-models can be merged
    • Discussion on Nathan's change related to kafka: Gilles proposes to wait for his refactoring of OSGi management inside transportpce. Indeed, he is currently working on the removal of all the blueprints file, leveraging OSGi Declarative Service annotations.

03/09/2023

No Meeting

03/02/2023

General information

  • Argon will be released the 16th of March. We are almost ready on transportPCE side. We will just need to bump the upstream dependencies to their latest version. Sulfur will be at that time EOL.

  • Cl-SR3 is targeted on the 8th of May

Review

  • Status on changes merged  since last meeting:

    • "Bump upstream dependencies to Argon” aligns master branch on Argon
    • “Upgrade device 7.1.0 sims version” solves the xslt issue we had for regens
    • Relation chain related to Argon
      • “Change getter in ConvertORTopoToTapiFullTopo” uses a non-null getter to solve some issues
      • Different changes address concurrent access to the Data Stores : “Remove some forced transaction closure”,  “Reimplement Request Processor”, “Remove close method from Request Processor”,  “Bump Upstream dependencies to Argon”.
    • “Speed up functional tests” execution” changing some time constant allows saving 20 minutes in the functional test
    • “Refactor impairment aware path computation step3” and “Leverage Map Ref in PCE PostAlgoPathValidator” finalize the refactoring of the PostAlgoValidator and allows reducing drastically the cyclomatic complexity.
  • transportpce-models changes under review:
    • “Revert “Revert” Add new T-API 2.4 models” has been merged during the meeting.
    • Before adding newer version of OpenROADM device models we may wait to know if 10.1 or 12.1 is the best candidate. This may be clarified next week through different meeting in OFC.
  • transportpce changes under review:
    • Gilles puhsed a new relation chain associated to the migration of all the project Junit tests to Junit 5 (several changes according to the module handled): all unitary tests have been migrated by Gilles to Junit 5 which provides new engine and many interested features.
      • “Fix string issue in OpenRoadmInterfacesException” solves an issue associated with this migration.
      • Gilles also reactivated some Junit test that had been disabled.
      • “Use QName constant” instead of manually create associated container simplify the configuration of the tests when we change a yand module revision.
    • “Update port-mapping data for regen xpdr type”: Bala is still working on associated functional tests but considers this change could be merged.

...

  • UTD question (Nathan) about  the issue with Karaf Logs: is it still the case with the latest versions of PCE?
    The Karaf client, no longer working is an issue we had some time ago, and which is not solved with the current Karaf version. It is an upstream bug in the Apache Karaf project. Karaf server is however still usable. So Karaf client does not need to be launched to observe the logs. However for UTD who wants to extract some messages from the LOG, it could be an issue. Lighty was not deeply tested by UTD. UTD is asking whether they should move to Lighty to solve this issue. Gilles answers that to him the real way to solve the issue is to use the nbi-notification module. However Nathan mentions that a lot of information is needed by their application, which would imply to write a lot of code to complement current implementation. Gilles explained that each TransportPCE module communicates to other modules through the mdsal-notification mechanism. Looking at the logs, it is quite easy to figure out which are the notifications sent through this process, and if need be, complement them and filter them from the Karaf Logs...  

02/23/2023

Review

  • Status on changes merged  since last meeting:

    • "Refactor PostAlgoValidatorStep2": was addressed during last call. It is refactoring to improve Sonar statistics.
  • transportpce changes under review:
    • "Refactor PostAlgoValidatorStep3": All further steps have been squashed into the step3. This refactoring shall reduce the cyclomatic complexity. AtoZ and ZtoA directions handling was split into 2 different methods. The first For loop is threating extremities. The second handles intermediate elements.
    • “Leverage Map ref in PCE PostAlgoValidator” is the last step of the refactoring, handling parameters passed to the different methods through maps.
    • “Upgrade device 7.1.0 sims version” was merged during the meeting.

    • Gilles created a new relation chain of changes in the scope of the migration to Argon:

      • “Update tapi device notification functional tests” provides some adjustments to clean up the environment at the end of the test, to improve the behavior of the CI/CD, and get a reproducible environment.
      • “Change getter in covertORTopoToTapiFullTopo” solves a NPE
      • “Remove some forced transaction closures” : removes some forcing closures of R/W transactions which are not efficient and lead to some errors if the following change is applied.
      • “Reimplement Request Processor” : separates the handling of Read and Write transactions. Also provides some enhancement in the way the different thread access to the datastore, handling the accesses through a map. Adds a block finally to correctly handle the locks associated with the transactions. This solves some issues observed on the gate running the tests, which are associated to concurrent accesses in the data store that were not correctly handled. Commit is now done after any kind of write transactions.
      • “Use networkTransactionService to access to the DS” solves an issue observed with test on GNPy that were not handling transaction using this networkTransactionService.
      • “Bump Upstream dependencies to Argon” will be finally applied after all the issues evoked before are solved.

...

  • Since a while, Bala has experienced some issues with the equipment in the labs, on their candidate datastore, deleting interfaces (this is even not using the renderer, but doing it directly on the device pointing to the right url). He will provide more details about it.

  • Gilles observed on his side that we regularly lose during the tests some Netconf sessions. Bala observed previously the same kind of issues which were solved setting the Time_To_leave parameters.

02/16/2023

General information

  • Guillaume presented at the  LNF virtual developer and testing forum a topic about the migration of transportPCE test to RFC 8040.

Review

  • Status on changes merged  since last meeting:

    • “Update upstream depencencies” addresses the upgrade to the latest Argon upstream dependencies, done on transportpce-models project.
    • Robert provided a new relation chain  (9 changes) related to the reorganization of the dependency injection for common module. At the final step, he removed the autogenerated common-blueprint file, relying on OSGi annotations. Gilles fixed some side effects on the project during the week and added a new change (“Fix small issues in nbi notification module”) to fix some small issues.
    • “Fix docs git Hooks dead url” is proposed by Guillaume to avoid docs-link-check failures on the gate.
  • transportpce changes under review:
    • Gilles updated 2 changes associated with Argon migration (“Bump upstream dependencies to Argon”, “Clean maven files”).
    • Last changes proposed by Bala to handle regeneration were rebased by Gilles, who also added a new change “Upgrade device7.1 sims version” to use the newest version of HoneyNode code that fixes the xsl transform issue reported last week by Bala.
    • Pce Autonomous impairment aware path computation refactoring is ongoing. Guillaume merged step 1. Step 2 reduces the complexity of the checkOSNR method. The global idea is to split checkOSNR in 2 according to the direction (AZ/ZA), which allows removing some tests. The main loop has been split in 3 parts (there were many conditions on the extremities of the path). He also created separate functions to handle SRGs Degrees and TSP.
    • Gilles would like to merge changes addressing the bugs observed during the demo of restoration on real equipment including “Hack to update degree port on portMapping”, which shall be possible after they are rebased.

...

  • OpenROADM device model update: it seems more reasonable to update the device model directly to 12.1 rather than 10.1, since it should cover all required functionality (GCC option, Y cable, 800G modeling…)

02/09/2023

General information

Review

  • Status on transportpce changes merged  since last meeting:

    • "Autonomous, impairment aware path computation” was merged at the end of last week.
    • "Fix Pylint issues": solves a small issue in one functional test
    • "Use a coherent style in common InstanceIdentifiers” is the first of upcoming changes.
  • transportpce changes under review:
    • "Refactor graph PostAlgoValidator step 1…3" : provides some refactoring of the PostAlgoValidator method. Step1 focuses on code style and intermediate variables. Step2 is a real refactoring of the method to reduce its complexity. The problem is that comments might be adjusted as some part of the code has been moved to separate method. Step3 focused on checkOSNR to decrease its complexity. Olivier will have a look to them
    • “Refactor networkmodel serv. FrequenciesServiceImpl”, “Refactor PCE networkAnalyser PceLink” focus on code style issues, intermediate variables….
    • "Hack to update degree port on portMapping” has been tested by Tianliang on real devices and seems to work in 4 different scenarii. This change allows the OFC demo running. It can be merged now.
    • "PortMapping to support regen capabilities” has been adjusted by Bala. A few test files still need to be adapted, and Bala will push them in a short time.
    • “Support create/delete interfaces for regen” is almost ready to be merged as soon as it will have been rebased. Bala tries to write associated functional test. For this, he needs to adjust the configuration files (transportpce-oper-XPDRA2.xml). However there is an issue : one function does not succeed to find a circuit-pack, whereas this last appears in the operational DataStore when the device is mounted. From some discussions appeared that the Configuration DataStore is however not well populated. Honeynode starts successfully, but an error is generated about the schema. The issue may be related with the XSLT transform that may need to be upgraded with a new parameter, used in regen which is “recolor”.
    • “Remove use of ODL blueprint extensions” has just been submitted by Robert

02/02/2023

General information

  • ODL distribution released in Cl-SR2
  • Annual LFN Operational survey has been launched. Gilles proposes that some of us reply to this survey to provide feedback which would help notably, improving processes (https://linuxfoundation.surveymonkey.com/r/RN6HQYK)

Review

  • Status on transportpce changes merged  since last meeting:

    • “Workaround to install tapi feature in func tests”: allows starting karaf with the appropriate configuration file where tapi feature is already installed.
    • “Unenforce Lighty use in CI”: switch from lighty.io runtime to the karaf one
    • “Remote websocket config from post-install scripts”
    • “Add tests utils ODL startup  opt-out support” allows disabling the start of the controller when launching test, and associates karaf start mode to a variable.
    • “Use karaf client batch mode” : Karaf 'client' command has a batch mode option ('-b') to take commands from stdin without requiring TTY. Hence this option makes it possible to run the command without getting affected by the Karaf terminal property setup issue. Gilles is not sure this change may not lead to some issues with Linux terminal, but the change has been merged. Additionally previous change may not be needed anymore, as this one is merged.
    • “Restore TAPI feat install w/ Karaf client in tests” will need to be updated
    • "Add test_utils ODL startup opt-out support"
  • transportpce changes under review:
    • “Slight refactor of common PortMappingVersion2.2.1” is about optimization trying to avoid the use intermediate variables.
    • “Improve functional test launcher pytest support” addresses the difficulty to stop some processes with ^C. Guillaume would like Gilles to test it.
    • “Autonomous Impairment aware path computation” : Olivier addressed most of the Guillaume comments. Still a few comments need to be addressed, and some conflicts to be solved, but this change is close to be merged.
    • “PortMapping to support regen capabilities”: It took some time to Bala to make some corrections since the creation of interfaces was not working with some of the real equipment in the labs.
    • Migration to Argon: nothing new since last week

...

  • An equipment manufacturer works on R10.1 of device models. Bala did not identified major changes from 7.1 to 10.1. But the support is required in PortMapping. Rendering part should not be that much affected. The migration to 10.1 shall be needed to test the product as it will be released in the Open Lab. Currently UTD has one of their equipment which is a Switchponder with 100G line port. But the new unit shall be a 400G transponder. Having an example of configuration file for TPCE sims would help a lot.

01/26/2023

General information

Review

  • Status on transportpce-models changes merged  since last meeting:

    • Migration towards Argon
    • ”Update upstream dependencies” (mdsal & Netconf) to use the latest ones
    • Gilles also tried to merge the T-API 2.4.0 but reverted it. He wants to finish the migration to Argon prior to manage the integration of T-API models to avoid conflict/issues.

  • Status on transportpce changes merged  since last meeting:

    • changes related to backports to stable/chlorine to release Cl-SR2
  • transportpce changes under review:
    • “Slight refactor of common PortMappingVersion2.2.1” is about optimization trying to avoid the use intermediate variables.
    • “Hack to update degree port on PortMapping” will not be merged soon as we need some feedback from Tianliang
    • “Improve functional tests launcher pytest support”  propose to use pytest from the python interpreter to avoid generating unwanted behavior and so that all associated subprocesses are killed using Ctrl C.
    • New relation chain concerning the CI :
      • “Workaround to install tapi feature in funct tests” will solve the installation of the T-API feature in Karaf while the identified bug with Karaf is not solved
      • “Unenforce Lighty use in CI”
      • “Remove websocket config from post install script” solves some issues with the obsolescence of some dependencies
    • Migration to Argon: Gilles wanted to make it quickly in order to provide feedback towards kernel projects if some issues were encountered. Appart karaf issue
      Jira
      showSummaryfalse
      serverOpenDaylight Jira
      serverId355b3776-d12d-3197-b123-4e6c3281c19a
      keyTRNSPRTPCE-701
      , everything seems OK
      • “Bump upstream dependencies to Argon”: migration of the master branch to Argon
      • “Clean Maven file” solves some compilation warnings

...

  • Bala is using Inteligy IDE, but can’t see the import of the OpenROADM yang files. This is associated with the move of those to transportpce-models dedicated repository. They should appear in external-dependencies when selecting project files view in this IDE.

01/19/2023

General information

  • Gilles released last week transportpce-models artifacts for Cl-SR2, and is planning to release transportpce Cl-SR2 artifacts tomorrow

  • Casey sent a mail regarding mentorship (accompanying students or other people to work in a LFN opensource project)

Review

  • Status on transportpce-models changes merged  since last meeting:

    • “Bump upstream dependencies to Cl SR2”, to release artifacts

  • Status on transportpce changes merged  since last meeting:

    • “Refactor few LOG messages management” which extracts some modification that can be applied out of the autonomous path computation
    • “Bump upstream dependencies to Cl SR2" to use the latest dependencies (especially transportpce-model release version and the latest lighty version)
    • Relation chain concerning Junit tests refactoring
    • backports on stable/chlorine branch
  • transportpce-models changes under review:
    • “Add new T-API-2.4.0 models”: Gilles added new tapi models after correcting some trailing spaces. Anyway, Pyang still generates a lot of Warning associated with imports. This could be an issue with Pyang. The models however compile correctly on the gate. Would be worth adding a yang linter on the CI
    • “Bump upstream dependencies to Argon" has been updated to align with latest dependencies and can be merged
  • transportpce changes under review:
    • “Slight refactor of CommonPortMappingVersion221” provides some optimization removing some intermediate variables
    • “Hack to update degree port on portMapping”: Guillaume steps back on one of the optimization of previous change
    • “Autonomous impairment aware path computation” needs to be rebased again, and wait for a last review before being merged

...

View file
nameOM-Catalog-use.pptx
height150

01/12/2023

General information

  • netconf-5.0.0 being just released, we can start now our migration to Argon

Review

  • Status on transportpce changes merged  since last meeting:

    • “Use Maven 3.8.7 in CI CentOS install script”, was pushed to repair our CI
  • transportpce changes under review:
    • “Autonomous Impairment aware path computation” : Olivier has addressed most of Guillaume's comments. Remains some questions regarding the log level to see with Guillaume.
    • Jonas proposed a change to make the OLM process stopped when one node is no longer connected to the controller. The change makes the JUnit tests associated with OLM failing. In this context, Gilles proposed  a relation chain to address this and to improve Junit test relevance and efficiency.
      • “Check input node parameters of get PM RPC”: It notably solves a NPE when we invoke a node which is not connected
      • “Rewrite Junit tests of PowerMgmt implementation” : Gilles rewrote the Junit tests trying to avoid multiple write operations in Data Store to improve the test efficiency, and using Mockito
      • “Rewrite Junit tests of OlmPowerServiceImpl” : Gilles also rewrote the Junit tests for the same reason, and in the same way

      • "Remove getNode method from OlmUtils": uses get node method of PortMapping rather than creating a redundant one in OLM Utils.

    • “Support create/delete interfaces for regen”: Bala addressed some comments from Guillaume but he still has some work to do on it.
    • “Bump Upstream dependencies to Cl SR2 “ can be merged.
    • “Complement sims configuration files” can also be merged

01/05/2023

General information

  • ODL Cl-SR1 distribution was released released en 2022 with transportpce-models and transportpce projects integrated as managed projects.
  • Next step are Cl SR2 which is planned for the 23rd of January and Argon due for the 16th of March.

Review

  • Status on transportpce-models changes merged since last meeting: all changes are associated with the integration in Cl-SR1, and bump of upstream dependencies to Cl-SR2

  • Status on transportpce changes merged  since last meeting:

    • same kind of changes related to the integration of the project inside the distribution
    • backports of changes from stable/chorine branch towards master
    • backports of few changes from master to stable/chlorine, forgotten for Cl-SR1 that will be present in Cl-SR2
    • Change from Jonas on LLDP control

...