Dovetail Team Meetings
Meeting Info
- Dovetail doesn't have a regular weekly meeting now. If you have something to bring to Dovetail team, please insert it into the meeting agenda here and inform the chair. Then the chair will schedule the meeting.
- Weekly Technical Discussion Wednesday at 13:00-14:00 UTC (6:00-7:00AM Pacific Daylight Time)
- https://zoom.us/j/2362828999
IRC channel: IRC channel: #opnfv-dovetail@ Freenode (Web Chat)
- Chaired by Dan Xu (xudan)
- IRC Meeting Logs: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-dovetail/
Intro & Rules
Meeting agendas and minutes are kept below. If you would like to add an item to the agenda, please insert it into the appropriate meeting agenda (upcoming) and inform the chair. Please do NOT change past meeting minutes, if you believe there is an inaccuracy, please inform the chair.( as agreed by the dovetial meeting, the minutes will be recorded by the IRC,Jan 13)
Meetings
Action Items
October 9, 2019
- Verify job "dovetail-rtd-verify-master" failed after changing to python 3
- A quick bug fix
- AOB
September 4, 2019
- Cancelled
August 28, 2019
- Review current gerrit patches
- AOB
August 21, 2019
- update Dovetail results format
- Status of patch "Support for Python 3"
- Status of deploying XCI ha
- AOB
Minutes: No minutes because not discussion all these items. No one related to these items joined the meeting.
August 14, 2019
- Dovetail results format for OVP portal
- Update of VNF and NFVi portals
- Status of patch "Support for Python 3"
- Status of deploying XCI ha
- AOB
August 7, 2019
- Status of running Dovetail on XCI
- Support for Python 3
- Common API to OPNFV test tools
- Next release Plan
- AOB
July 31, 2019
Cancelled
July 24, 2019
Cancelled
July 17, 2019
- Introduction of 2 new Dovetail run test cases API
- Status of running Dovetail on XCI
- AOB
July 10, 2019
Cancelled
July 3, 2019
- Introduce of the new Dovetail API Swagger UI
- AOB
June 26, 2019
- Progress on running Dovetail on XCI
- Progress on Functest blacklist usage
- AOB
June 19, 2019
- Yardstick HA issue
- Functest blacklist usage
- Running Dovetail on XCI
- AOB
May 22, 2019
- Review SFC patch
- AOB
May 15, 2019
- Review SFC patch
- Review RESTFUL patch
- OVP 2019.0x release plan update
- AOB
May 8, 2019
April 24, 2019
- Continue reviewing the 2 portals development
- Proposal to cancel next weekly meeting
- AOB
April 17, 2019
- Discussion on creating a script to automatically deploy Dovetail
- Review the 2 portals after updating and fixing some bugs
- AOB
April 10, 2019
- Introduction about enhancements of NFVI portal
- Discussion about current OVP workflow
- Status of pushing results to OPNFV DB
- Status of Dovetail API
- Already used by http://159.138.5.142:8848/cvctestcenter/
- AOB
April 3, 2019
Cancelled due to ONS NA 2019
March 27, 2019
- Issues when running VVP
- Discussion on how to use OPNFV testapi to analyze all results: http://testresults.opnfv.org/test/#/results
- AOB
March 20, 2019
- Status of test cases
- AOB
March 13, 2019
- Status of ovp-2.2.0
- Patch review
- Unsigned JIRA tickets and tasks
- 3rd release Timeline
- AOB
March 6, 2019
- Status of ovp-2.2.0
- OVP 3rd release status
- https://etherpad.opnfv.org/p/scope_of_ovp_2019.0x
- Unsigned JIRA tickets and tasks
- Timeline
- AOB
February 27, 2019
- Availability of installers and their impact on the next OVP release.
- Which OPNFV version should the next OVP release be based on.
- Broad forward by David McBride
- Review patch fixing stress ping timeout issue
- Review other patches
- OVP 3rd release status
- AOB
February 20, 2019
- Review pending patches
- Add checksum for VNF tests
- Suggest to add Dovetail restful APIs
- AOB
February 13, 2019
- Integrate neutron-tempest-plugin-api
- Review existing patches
- One issue on all tempest test cases
- Suggest to add Dovetail restful APIs (not discussed)
- AOB (not discussed)
January 30, 2019
- Next meeting plan due to the Chinese spring festival
- Another bug fix patch merged to Dovetail Fraser
- https://gerrit.opnfv.org/gerrit/#/c/66629/
- Plan to tag ovp-2.1.1 as well as the Docker image tag
- Procedure of release a patch OVP version
- Review patch of integrating VVP into Dovetail
- 2019.0x test scope
- Review of adding Intel NFV CI test cases
- AOB
January 23, 2019
- Change weekly meeting time
- Reviewing patch of making flavor configurable by Bottleneck
- https://gerrit.opnfv.org/gerrit/#/c/66055/
- Release a patch version after merging it
- Review patch of Yardstick HA update
- Review JIRA about updating portal
- AOB
January 16, 2019
- Requirements of updating VTP integration
- Reviewing patch of making flavor configurable by Bottleneck
- Requirements of Dovetail tool and web portal results data format
- HA test cases results of release 2.0 - Eddy
- AOB
December 19, 2018
- Feedback from Eddie about simplifying the application process
- Solution of making flavor configurable by Bottleneck
- - BOTTLENECK-248Getting issue details... STATUS
- Reference to https://gerrit.opnfv.org/gerrit/#/c/59967/
- JIRA clean
- AOB
December 12, 2018
- Progress on the portal development of integrating Casablanca VNF SDK
- Document about Dovetail Generic Framework
- JIRA clean
- AOB
December 5, 2018
- Patrole vxlan dependent test cases exemption patches review
- ONAP VNF SDK web integration
- Plugfest plan
- AOB
November 28, 2018
- propose to change meeting time
- Exemption process and technical solution for Vxlan required test cases
- Plugfest plan (not discussed)
- AOB (not discussed)
November 21, 2018
- JIRA clean and review open JIRA tickets
- AOB
November 14, 2018
- Web portal development
- Patch review
- JIRA clean and review open JIRA tickets
- AOB
November 7, 2018
- OPNFV gambia plugfest presentation
- Web portal development
- Support ONAP - DOVETAIL-669Getting issue details... STATUS
- Restructure https://etherpad.opnfv.org/p/restructure_OVP_web_portal
- JIRA clean and review open JIRA tickets
- Review OVP 2019.0x scope (not discussed)
- AOB (not discussed)
October 31, 2018
- Introduction of OPNFV web portal
- Web portal issues
- Review OVP 2019.0x scope
- OPNFV gambia plugfest
- AOB
October 24, 2018
- Handling of Offline scripts in Dovetail repo
- VNFSDK integration: Current Progress
- Performance testing integration
- CVC already opened a wiki page and etherpad to discuss this
- Current patches review
- Web portal update and tag ovp-2.0.0
- Review OVP 2019.0x scope
- AOB
October 17, 2018
- Dovetail webportal tag and logo issue
- PTL transition: Current Progress
- Etherpad with 2019.0x scope - Next actions
- JIRA Tickets: Currently Opened and Creation of New
- Handling of Offline scripts in Dovetail repo (not discussed)
- VNFSDK integration: Current Progress (not discussed)
- AOB
October 10, 2018
- AP follow-up
- Release planning
- Implementation status
- ONAP integration
- AOB
October 3, 2018
- Committer promotion
- PTL transition
- report from OVS unconference session at ONS Europe (Georg, tentative)
- input from the compliance verification committee (Georg, tentative)
- release planning (revisiting the etherpad and JIRA)
- AOB
September 26, 2018
- cancelled
September 19, 2018
- AP follow-up
- Identity v2 support wrap-up
- release preparations
- update of marketing message on web portal
- tagging of Dovetail (ovp-2.0.0)
- tagging of test projects
- tagging of web portal
- committer promotions
- unconference session at ONS
- cancellation of next week's meeting due to ONS
- PTL transition and Georg out-of-office for 2 weeks in October
- AOB
September 12, 2018
- AP follow-up
- Identity v2 support
- approval of updated scope pending
- release preparations
- official OVP version will be 2018.09
- rename occurrences in the code
- update live web portal afterwards
- official OVP version will be 2018.09
- begin scoping the focus of the 2019.0x release
- committer promotion proposals
- AOB
September 5, 2018
- AP follow-up
- status of pre-testing
- JIRA review
- release preparations
- release decision
- AOB
August 29, 2018
- AP follow-up
- Status of pre-testing on commercial platforms
- Test case status
- Status of proposed tests
- OpenStack interop tests
- correct number of tests: 200?
- final update of number test cases
- CI runs of Fuel and Compass
- Documentation status
- documentation links added to opnfvdocs (master, stab/fraser pending)
- addendum updated (under review)
- reviewer guide (under review)
- documentation links on web portal
- release notes (merged)
- user guide (merged)
- Release candidate
- tag repo and push image
- Anything else release related
- AOB
August 22, 2018
- Status of pre-testing on commercial platforms
- Test cases status
- HA tests
- OS interop tests
- Support for Identity v2 tempest tests
- Documentation status
- Close finished tickets
- Release notes
- Final check of user guide
- Release candidate
- Create stable branch: stable/fraser
- Push release candidate tag: ovp-2.0.0-rc1
- AOB
August 1, 2018
- Meetings next two weeks
- Pre-testing
- JIRA ticket review
- AOB
July 25, 2018
- Vacation Georg
- Release timeline and preparations
- Pre-testing on commercial systems
- Release candidate
- Marketing preparations
- Missing items
- CI status
- Disable proposed tests test suite in CI to save resources
- Development update
- Web portal
- Merge pending patches
- AOB
July 18, 2018
- Plugtest report
- CI status
- restructuring of CI jobs
- https://build.opnfv.org/ci/view/dovetail/
- https://build.opnfv.org/ci/view/dovetail-webportal/
- Bug reports
- Development status
- web portal builds from new repo
- web portal builds from new repo
- Documentation status
- AOB
July 11, 2018
- Test case status
- Inconsistent number of tests of OpenStack Interop tests
-
DOVETAIL-662Getting issue details...
STATUS
- Fuel and Compass: 204 test cases
- Apex inconsistent number of test cases
- failing HA test cases
- Fuel: https://gerrit.opnfv.org/gerrit/#/c/58499/
- Apex: open
- Inconsistent number of tests of OpenStack Interop tests
-
DOVETAIL-662Getting issue details...
STATUS
- Development and Documentation status
-
DOVETAIL-597Getting issue details...
STATUS
- Development
- make web portal understand new results
- moving web portal to a seperate repo
- create input for testcases.json
- run tests on DPDK-enabled systems
- Documentation
- SDNVPN Tempest tests: https://gerrit.opnfv.org/gerrit/51621
- Neutron Trunk: https://gerrit.opnfv.org/gerrit/59631
- SDNVPN Tempest tests: https://gerrit.opnfv.org/gerrit/51621
- Development
- AOB
July 4, 2018
- Test case status
- HA test cases in CI
- VNF test cases in CI
- Documentation status
- Web portal status
- updated testcases.json to read new result files
- moving code to separate repo
- Integration of test cases in Functest
June 27, 2018
- commercial pre-testing
- test scope
- IPv6
- API tests: mandatory
- scenario tests: optional
- networking
- API tests: mandatory
- scenario tests: optional
- bottlenecks out
- not passing in daily loops
- Snaps mandatory
- passing on all platforms in daily loops
- urgent work items
- AOB
June 20, 2018
- Input from Rabi (Vodafone) on performance tests
Talk proposals for ONS Europe and Open Source Summit Europe
CI status and test case selection
- https://wiki.opnfv.org/display/dovetail/Status+of+proposed+tests
- https://wiki.opnfv.org/display/dovetail/Proposed+Test+Scope+of+OVP+2018.0x?focusedCommentId=24576521
- AOB
June 13, 2018
- plugfest recap
- test API broken due to Dovetail requirements?
- release plan review & TSC update
- CI status & test case selection
- AOB
- remove JOID from releng scripts
May 30, 2018
- web portal update
- proposal for a first performance test for OVP
- critical bug: vping reported as passed despite failing
- plugfest preparation
- CI status
- AOB
May 23, 2018
- next week's call
- web portal update
- plugfest update
- CI status
- AOB
May 16, 2018
- Marketplace on web portal (Eddie)
- plugfest update
- OpenStack Summit update
- SNAPs smoke test suite
- CI status
- AOB
May 9, 2018
- plugfest
- https://wiki.plugtests.net/NFV-PLUGTESTS/index.php/Dovetail_Track
- HIVE connectivity
- pre-testing
- OpenStack Summit
- Test case renaming and branching
- CI status
- restructured sub-pages of Dovetail space
- https://wiki.opnfv.org/display/dovetail/Status+of+proposed+tests
- AOB
May 2, 2018
- plugfest preparation
- Dovetail track
- office hour
- status of CI runs
- release work items for next release (
-
DOVETAIL-597Getting issue details...
STATUS
)
- integration of new test cases
- neutron_trunk
- patrole
- juju_epc
- MySQL HA test (TC090)
- Corosync HA test (TC057)
- question
- how to handle skipped test cases?
- add list of exception
- service release of OVP 2018.01
- update documentation, participation form
April 25, 2018
- ETSI plugtest
- Dovetail track: https://wiki.plugtests.net/NFV-PLUGTESTS/index.php/Dovetail_Track
- feedback from VIMs
- release plan proposal
- https://wiki.opnfv.org/download/attachments/2926467/OVP%202018.07%20release%20plan%20-%20gantt.xlsx?version=1&modificationDate=1524167178000&api=v2
- agree within project on proposed release plan
- framework refactoring
- service release of OVP to include API exemption
- renaming of test cases
April 18, 2018
- OPNFV/ETSI Plugfest
- Review release plan proposal for OVP 2018.08 release
- Additional test case candidates in Fraser
- https://wiki.opnfv.org/display/SWREL/Fraser+Release+Key+Updates
- Functest
- OpenStack
- neutron_trunk
- patrole
- juju_epc
- Kubernetes
- k8s_smoke
- k8s_conformance
- stor4nfv
- clover
- Yardstick
- OpenStack
- HA test cases
- restructuring and renaming of test cases
April 11, 2018
- Implementation of exemption
- ESTI plugtest / OPNFV plugfest planning
- Next Release
- Test case structure
- CI Status (Euphrates)
- Framework refactoring
March 21, 2018
- Next two meetings
- ONS session
- Status of Dovetail runs in CI
- Release roadmap
- AOB
March 13, 2018
- Strict API exemption process - next steps
- ONS session - brief update
- Roadmap discussion and JIRA ticket review (slides)
March 7, 2018
- Strict API exemption process - review of TSC feedback and next steps
- lack of CI resources - run Dovetail on Euphrates or Fraser; impact on OVP 2.0
- roadmap discussion - release date of OVP 2.0.0 (slides)
- meeting details - transition to Zoom and daylight saving changes
- AOB
February 28, 2018
- Update on exemption process proposal
- ONS planning
- JIRA triage
- Euphrates scope / patchset review
- HA test cases
- Unified test case file
Feb 14, 2018
- ONS update
- Committer promotions
- Euphrates release scope
- Fraser release scope
- Consistency of test cases
Feb 7, 2018
- OVP launch
- ONS talk proposal & OpenStack talk proposal
- Euphrates release scope
-
DOVETAIL-597Getting issue details...
STATUS
- Ongoing test tool and test case integration
- SDNVPN
- Test spec: https://gerrit.opnfv.org/gerrit/#/c/51621/
- Test integration: https://gerrit.opnfv.org/gerrit/#/c/51625/
- others
- Review of test case candidates
- Neutron trunk port https://github.com/openstack/neutron/blob/stable/pike/neutron/tests/tempest/api/test_trunk.py
- Ongoing test tool and test case integration
- Exemption phase for strict API checking
- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-dovetail/2018/opnfv-dovetail.2018-02-07-14.00.log.html
Jan 31, 2018
Dovetail / ONAP VNF SDK integration demo - Moshe
Dovetail 1.0.0 (OVP 2018.01) launch
- Final reviews of results from beta participants
- Close on container/git tags and testing - DOVETAIL-580
- Close SUT version - DOVETAIL-572Future planning and new JIRA tickets
- Euphrates scope DOVETAIL-597
- Fraser scope DOVETAIL 600
Test specifications
- Development update
- Minutes:http://ircbot.wl.linuxfoundation.org/meetings/opnfv-dovetail/2018/opnfv-dovetail.2018-01-31-13.53.html
Jan 24, 2018
Meeting logistics – GTM worked in Wed slot
Review outstanding Dovetail 1.0.0 (OVP 2018.01) release deliverables
Reviewed closed issues for OVP web portal (left-side navigation and home text): DOVETAIL-582, DOVETAIL-579
Need to fix bug with SUT version for DOVETAIL-572
Resubmit process for OVP graduates - participation form, fill-in SUT version
ONAP VNF SDK integration
Functest E-release integration findings
- Use default containers rather than building Dovetail specific ones
- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-dovetail/2018/opnfv-dovetail.2018-01-24-13.54.html
Jan 19, 2018
- Team Logistics
- Potential Dovetail weekly meeting change - change to Wednesday only has one objection currently
- Gerrit - use Dovetail Team group for broad reviews of core changes moving forwardEuphrates release
- Begin integration of Euphrates Functest & Yardstick containers - use master and update Dovetail conf file to pull new dependent containers
- Update on Yardstick test cases - drop 57 from consideration - focus on 25, 56, 58
- Functest-features - leverage new test cases for sdnvpn
- Begin drafting for test areas targeted for Fraser and beyond: NFVI performance (determine consensus after skeleton draft), VNF lifecycle stability
- Confirm relaxing strict API checking in Tempest and discuss patch - form broader perspective before adding patch
- Creating project with container artifact similar to Yardstick
- Will establish further cross-team communication channels Dovetail 1.0.0 (OVP 2018.01)Walkthrough of landing page, web portal and documents
- Online 'participation form' - please note terminology change from 'application form'
- External landing page - www.opnfv.org/verified
- Review release notes before patch submission
- Waiting on OPNFV marketing for final program/legal doc links (Governance + T&C) to finalize OVP portal revision and release notes
- Launch next week (hopefully)
- Resubmit process for first wave of OVP graduates
- Discuss overall meaning and tightening of qualifications in upcoming C&C meeting
- Minutes:http://ircbot.wl.linuxfoundation.org/meetings/opnfv-dovetail/2018/opnfv-dovetail.2018-01-19-13.48.html
- Jan 12, 2018
- Strict API checking in Tempest - Georg/Eddy
- Agreed to consider relaxing strict checking in Euphrates release assuming community has no objection
- Continue discussion on Euphrates scope and timing
- Content - discuss feasibility
- 4 HA Yardstick tests cases discussed in Dec 15 Dovetail meeting (25, 56, 57, 58)
- Functest Euphrates
- functest-smoke
- Tiers: refstack-defcore, tempest_smoke_serial, rally_sanity, snaps_smoke
- Identified some new test cases from tempest_smoke_serial and snaps_smoke
- functest-vnf
- Tiers: cloudify_ims, orchestra_openims, or orchestra_clearwaterims
- Cloudify & OpenBaton orchestrators / Clearwater & OpenIMS VNF
- Discuss if cloudify_ims can be employed as a use-case test scenario
- functest-smoke
- Bottlenecks / VNF lifecycle stability - probably a long-shot for an E-release
- Framework - discuss priority
- Decoupling of test content from framework to support dev testing and other LFN communities/projects
- Improved test execution - see new JIRA ticket - DOVETAIL-581
- Object clean-up/deletion for failed test runs
- Config file unification and/or interactive generator
- Improved summary reporting
- Debug tools - tracing to monitor system messaging and object creation
- Reviewed outstanding Dovetail 1.0.0 (OVP 2018.01) release deliverables - please approve outstanding Gerrit patches
- Minutes:http://ircbot.wl.linuxfoundation.org/meetings/opnfv-dovetail/2018/opnfv-dovetail.2018-01-12-13.52.html
- Jan 5, 2018
- Dovetail 1.0.0 (OVP 2018.01) release deliverables
- Resubmit process for first wave of OVP graduates
- Use of verified@opnfv.org instead of cvp@opnfv.org for applicant correspondence and review process
- Resubmit application form using online version and resubmit beta results
- OVP Web Portal
- OVP version added to application form
- SUT version number added to OVP web portal - Gerrit, DOVETAIL-572
- Updating home page links - DOVETAIL-579
- Documentation
- Finalize on changes Georg made to docs from CVP to OVP name change - Gerrit CVP to OVP
- Finalize on user guide modifications - Gerrit, DOVETAIL-553
- Finalize reviewer guide - Gerrit, DOVETAIL-555, DOVETAIL-408
Review release notes - Gerrit, DOVETAIL-578
Align container tags, github release tags and test configuration yaml for initial release - DOVETAIL-580
- Test framework / content separation to support LFN umbrella - slide from Bruce on ONAP VNFTest (VNF SDK) / Dovetail integration initial requirements
- Minutes:http://ircbot.wl.linuxfoundation.org/meetings/opnfv-dovetail/2018/opnfv-dovetail.2018-01-05-13.54.html
- Dec 29, 2017
- Cancelled
- Cancelled
- Dec 22
- Holiday meeting schedule - skip Dec 29th and resume Jan 5th
- Introduced Jack Chan - OVP portal developer
- Reviewed ongoing technical issues
- Wind River - discussion on tempest test cases where schemas do strict checking of additional metadata added to REST messages. Currently 'additionalProperties' is set to false in tempest schemas, which causes some test cases to fail
- Amdocs ONAP VNF conformance / Dovetail integration PoC - Bruce T provided overview
- Update on Dovetail / OPNFV Installer CI jobs - Xudan - added to both Daisy/Fuel jobs
- Dovetail 1.0.0 (OVP 2018.01) release deliverables
- Georg made changes in documentation for the CVP to OVP naming change
- Put release notes into master and cherry pick to stable/danube
- Euphrates release scope and timing - Framework, Functest, Yardstick HA
- Bottlenecks / VNF lifecycle stability - begin methodology work
- Consider tracing capability for framework
- Discussed a possible March release for Euphrates with limited scope
- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-12-22-13.54.html
- Dec 15
- Dovetail 1.0.0 (OVP 2018.01) release planning
- Git branching/versioning update - branch stable/danube updated from master
- OVP portal home page updates
- OPNFV installer SUT testing strategy per release
- OVP docs changes, release notes
- Euphrates: Available HA extensions test-cases
- Controller Messaging Queue Service- opnfv_yardstick_tc056.rst
- Controller Cluster Management Service - opnfv_yardstick_tc057.rst
- Virtual Router Service - opnfv_yardstick_tc058.rst
- Controller Node Shutdown - opnfv_yardstick_tc025.rst (with reboot possibly)
- Etherpad from Fuqiao/Georg:
- https://etherpad.opnfv.org/p/plugfest_portland_reliability_testing
- Euphrates: Audit of available functest test-cases: Ex. snap_smoke
- Euphrates: Dovetail Framework
- Results, Logging, Test Suite / Framework separation
- Euphrates: discussion if bottlenecks test-cases should be targeted: Ex. VNF scale-up/out
- Stress testing taxonomy from plugfest: Stability, Overload Robustness, Reliability, Capacity and Scalability, Multi-Dimensional System Performance
- Fraser & beyond: Use-case/performance testing – drafting of test specifications
- Fraser & beyond: ONAP VVP (Heat) / VNF SDF (TOSCA) integration assessment
- Minutes:http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-12-15-13.55.html
- Dovetail 1.0.0 (OVP 2018.01) release planning
- Dec 8
- Reviewed ongoing technical issues
- Feedback from Dovetail testing at plugfest - Xudan and Stephen to continue to work on Keystone v2/3 issue
- Requirements for HA extensions discussed during plugfest - will consider a few test cases in Euphrates
- Audit of available functest/yardstick test cases available for integration in short-term
- Use-case/performance testing – start drafting of test specifications
- Release planning
- Git branching/versioning
- OPNFV installer SUT testing strategy per release - XCI, Fuel, JOID, Compass, Apex …
- OVP portal home page updates, release notes
- Initial graduating class
- Minutes:http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-12-08-15.50.html
- Dec 1
- Reviewed ongoing technical issues
- Plugfest planning
- OVP/Dovetail session
- Discuss how to structure roadmap portion
- Framework/platform
- Conformance: VNF onboarding (ONAP VVP collaboration)
- Use-case: identify robust test VNFs
- Security: VIM vulnerability scanning, NFVi tenant security
- Performance: VIM/NFVi scale-out, NFVi forwarding performance
- Network: IPv6 Extensions, ...
- HA Extensions
- Containerized SUT: core cloud capability within current Dovetail scope, K8 lifecycle scenarios
- Discuss how to structure roadmap portion
- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-12-01-13.52.html
- Nov 24
- Cancelled
- Nov 17
- Review post-beta issues
- HA considerations from Wind River - Stephen/Xudan
- Release plan
- Packaging and versioning
- Future planning
- Plugfest content discussion (action from last week) - tutorial and review of 1st release planned
- Decide and prepare content for roadmap discussion - review a few slides to kick-start (below are ideas)
- HA extensions, NFVi forwarding performance, VIM vulnerability scanning, VNF onboarding
- Hands-on portion needs discussion (below are just ideas):
- Run Dovetail against Euphrates (including containerized version)
- Execute open-source/OPNFV traffic generators against OVS
- Setup and run vulnerability scanning tools against VIM elements
- Execute new HA test-cases
- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-11-17-13.53.html
- Nov 10
- Discuss ongoing Beta issues
- CVP Portal
- Reviewer role submits results - DOVETAIL-549
- Result sharing issue by email (instead of user ID) - DOVETAIL-551
- Multiple primary contacts (for submitting results)
- Closed issues: DOVETAIL-548 (CentOS issue), DOVETAIL-550
- osinterop test area taking 7hrs (Wind River) – resolved?
- Log file consistency / Dovetail log (potential future improvement)
- General review/approve process
- CVP Danube Reviewer Guidelines
- Beta Summary (final day)
- Documentation
- User guide improvements (action from last week) - DOVETAIL-553
- Dovetail evolution and packaging discussion
- Will Dovetail Danube test-cases pass for Euphrates?
- How is alignment achieved between Dovetail and OPNFV releases?
- Minutes:http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-11-10-13.55.html
- Nov 3
- C&C committee meeting update from 10/30
- CVP Review Workflow: CVP Review Workflow v0.3.ppt
- CVP portal updates
- Demo of owner column (DOVETAIL-545), SUT identification (DOVETAIL-541, DOVETAIL-547)
- Discuss beta issues
- CentOS issue (DOVETAIL-543)
- Stephen @ Wind River issues
- Future planning
- Dovetail Future Release Priority Inputs
- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-11-03-12.56.html
- Oct 27
Updates on Dovetail / CVP Portal 0.8.0, short demo
Beta status, issues, questions
Docs-danube update
Future planning etherpad:
https://etherpad.opnfv.org/p/Dovetail_Future_Release_Priority_Inputs
Minutes:http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-10-27-13.02.html
- Oct 20
Review plan for minor release of Dovetail / CVP Portal during Beta - Eddie / Xudan
Documentation update - Georg
Euphrates/Fraser Planning
- Minutes:http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-10-20-13.02.html
- Oct 13
Feedback to questions raised in test WG… (xudan, georg)
Tutorial : hands on process going through CVP testing (Eddie Arrage)
- Minutes:http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-10-13-13.00.log.html
- Oct 6
- Cancelled
- Sep 29
- For this week, we have a singular focus to review preparations and to start beta, including 0.7.0 (beta) release, web portal, all relevant docs, and support mechanism.
- Next week we may be impacted by China’s holidays – let’s see if we need to cancel the call and if any alternative support is needed.
- If time permit, Georg, can you update if we are ready to finalize on doc publication plan?
- Sep 22
- -Review of status: revision 0.7.0, web portal, remaining doc related tasks (xudan/leo)
- -Doc publication (Georg)
- -Beta process and logistics of organizing and supporting beta tests
- -Review dovetail branching scheme, support-ability
- http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-09-22-13.01.log.html
- Sep 15
- Status update/beta readiness: dovetail software, web portal, docs
- remaining open docs, doc publication
- Jira ticket cleanup
- and beta process
- Minutes:http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-09-15-13.00.log.html
- Sep 8
-Status update on docs for test specs and the cvp progam and web portal
-The next 0.6.0 release and testing report
-Finalizing beta test plan
-Project update (scheduled for 9/12) preparation
- Minutes:http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-09-08-13.05.log.html
- Sep 1
-dovtail v0.5 test case run results/status
-Test case docs to be merged
-Status on the portal
-Tsc update
-Beta plan timeline
- Minutes:http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-09-01-13.00.log.html
- Aug 25
- Review and merge priority docs to be ready for tsc review.
- Status update of dovetail software and test suite - currently 0.5.0 - remaining testing and bug fixes
- Status update of the web portal
- Minutes:http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-08-25-13.00.log.html
- Aug 18
- -Current tool+test status
-dovetail version 0.5
-Testing pod resources
-Docs, including the test case requirement patch
-Overall status review and plan for the remaining milestones. - Minutes:http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-08-18-13.01.log.html
- -Current tool+test status
- Aug 11
- Current tool+test status: (10 min)
- dovetail version 0.5
- Testing pod resources
- Docs, including the test case requirement patch
- Overall status review and plan for the remaining milestones.- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-08-11-13.00.log.html
- Aug 4
-Review xudan’s patch https://gerrit.opnfv.org/gerrit/#/c/38379/3, and map that with the Addendum requirements and gap analysis results
-Update on LF meeting and plan for the cvp web portal
-Dovetail 0.4 draft release. Cvp web portal demo and feedbacks on login, and test result page
-Tentative release plan discussion.
- Minutes:http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-08-04-13.01.log.html
- July 28
- - Review of Gap analysis findings
-update for the workflow - Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-07-28-13.00.log.html
- - Review of Gap analysis findings
- July 21
-Update on the most recent Dovetail release 0.3
-Another round of review on the addendum document
-Continue to look through the open task list, including docs that still remain in drafts
- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-07-21-13.01.log.html
- July 14
-Determine if everyone is OK to extend an hour to the meeting time… just this once
-A few minutes to update status and the most recent 0.2 release
-Review addendum document for test scope
- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-07-14-13.00.log.html
- June 30
- Review the feedbacks from tsc members
- Examine remaining work items required for first release and decide how to close them
- Quick new status updates
- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-06-30-13.00.log.html
- June 23
- Openstack Interop WG discussion
- A 5 min for Hongbo to propose to PTL election using the yardstick/functest model.
- A 5 min quick #agree on moving https://gerrit.opnfv.org/gerrit/#/c/34343/ forward.
- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-06-23-13.00.log.html
- June 2
-2x one hour slots have been scheduled for design summit – Shall we add an hour or more of dedicated time to ETSI TST, operator/EUAG feedback, and, upstream/openstack-interop if people are available?
-The questions raised during the TSC discussion (which will continue next Tuesday): scope in terms of considering more projects in Danube, mandatory vs optional, agreement needed from the TSC.
- Any docs that need an urgent push to complete – give them some concerted effort.
-Other topics inherited from the last week
- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-06-02-13.00.log.html
- May 26
- Preparation for TSC review on 5/30
- Review the Danube addendum
- QA dovetail
-Tagging / release schemes
-Invited speakers: openstack interop wg, ETSI TST
-Design summit topics
- http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-05-26-13.00.log.html
- May 19
- -Welcome new committers and where we need immediate new contribution and attention
-Preparation for tsc review on 5/30
-Ask – what we need to ask from c&c and board? How should we take on the administrative side of tasks. Also the Danube addendum for 5/22.
-Naming convention of test cases
-Vendor lab testing – needs volunteers to sign up beta testers
-Tagging / releases, offline support
-Design summit topics - Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-05-19-13.00.log.html
- -Welcome new committers and where we need immediate new contribution and attention
- May 12
-testcase reveiew update: Refstack, IPV6, HA and SDNVPN
-Documents update
-dovetail planning for the OPNFV design summit
-dovetail testing try in vendors environments
- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-05-12-13.01.log.html
- May 5
-Summary of the OPNFV plugfest
-Sdnvpn test case sample format
-Refstack test cases
-Next steps for the test case review
-Document status
- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-05-05-13.00.log.html
- April 21, 2017
- -Review of last meeting's minutes (not in the IRC log)
-Plugfest planned activities last check: - Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-04-21-12.59.log.html
- -Review of last meeting's minutes (not in the IRC log)
- April 14, 2017
- http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-04-14-13.00.log.html
- The IRC minutes were not adequately recorded on this call - I added the following for the record. We can review it in the next call to see if there is any objections.
- Also reviewed the documentation status: Trevor is to start drafting a developer's guide, and Wenjing to draft the tester's guide which would be a part of the user facing doc.
- Wenjing's testing guide draft is here: Dovetail Testing Guide, (a part of the user facing doc to be integrated). Will use plugfest testing to validate this doc's accuracy and completeness etc.
- Trevor's developer guide draft: https://gerrit.opnfv.org/gerrit/#/c/33367/1
- The worksheet of test case requirements: https://gerrit.opnfv.org/gerrit/#/c/33317/
- Reviewed the plugfest meetings related to dovetail. Agreed to add a few other meetings: one to review doc, another to start reviewing test areas such as ha, ipv6, sdnvpn, third for e/future planning.
- Reviewed plugfest testing for dovetail, goals, facilities, time/schedule. A lot more to be done in order to plan logistics. Action item on Hongbo to get more people to assign time/resource, and scenario/installer may need to be pre-installed.
- Uli is tasked with the action item to connect with security wg/infra wg on possible security topics - none identified so far but should get a definitive resolution.
- Discussed the slow progress in functest on testapi login method - Wenjing to email to urge for quicker resolution. If that's not possible, need to have plan B for plugfest testing with a no-login server.
- April 7, 2017
- March 31,2017
March 24,2017
- http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-03-24-13.01.log.html
- Test case requirement wiki reviewed, and agreed to.
- Chris was not available to discuss the test strategy doc, but email response was discussed. Called on everyone to review the patch.
- SDN controller: agreed on Neutron based api testing only in Danube. Other networking features such as bgpvpn, discussed. Tim to follow up.
- Project update reviewed for presentation to TSC. JIRA status/cleanup reviewed.
March 17,2017
Here is last week’s meeting minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-03-17-13.00.log.html
We covered all the items in the agenda, except #5. And in addition, we also briefly touched upon the test strategy document draft http://artifacts.opnfv.org/dovetail/review/30811/testing_user_teststrategy/index.html
Please provide feedback/comment.
The rest of the Dovetail plan for Danube (draft) is still here: https://wiki.opnfv.org/display/dovetail/Dovetail+Danube+Plan
March 10,2017
We reviewed the dovetail plan brainstorming inputs and started to summarize into agreements and action items https://wiki.opnfv.org/display/dovetail/Dovetail+Danube+Plan in today’s weekly call. The minutes can be found here:
http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-03-10-14.00.html
As part of the action items, the test case requirement criteria will be updated based on inputs collected in the last few weeks on etherpad, wiki pages and mailing list. Dave Neary took this action item to summarize and make the updated wiki page ready for community review. The page is: https://wiki.opnfv.org/display/dovetail/Dovetail+Test+Case+Requirements. Once updated and reviewed, these requirements will then be used as criteria when we start reviewing test cases for inclusion into the dovetail suite.
Openstack is a major component in opnfv’s stacks and they have developed defcore/refstack for interoperability testing. This part will be incorporated as a whole for dovetail, and this model of upstream collaboration could be extended in the future. Some technical questions are still open but developers are making good progress to close them.
A draft milestone time table is also in the plan page https://wiki.opnfv.org/display/dovetail/Dovetail+Danube+Plan. We are still working on validation of assumptions and resource assignments; you are welcome to review the milestones and give your inputs.
As a last note, we are to finalize the plan and present to TSC for review on March 21 call, so if you like to give input please engage now. Next week is the only time we have. Thanks!
March 3,2017
Feb 24,2017
Feb.17,2017
Jan 20, 2017
- http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-02-10-14.00.html
- http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-02-10-14.00.log.html
- Jan 13, 2017:
- Chris Price had to drop off early and so IRC didn’t capture the second half of minutes: below is manually taken minutes by wenjing, please correct if you find anything not accurate
- Dovetail test case review: wiki https://wiki.opnfv.org/display/dovetail/Dovetail+Test+Areas+and+Test+Cases
- Vim operation 5 areas: included
- Nfvi and mini-use cases: included, need complete more info in wiki to fully understand (action item: fill in more details)
- HA: included. description from HA project. Comment: we should put info in one place for easier access (action item: gather info and fill in here)
- Ipv6: included. Same as above to gather info in one place.
- Vpn or l3vpn: unclear if the l3vpn feature is completed fully in C release (action: to collect definitive answer for next review). Commented that it should be excluded on the ground of not yet mature and have adoption (see test case reqs & cvp description).
- Fault mgmt.: noted that the current feature has dependency on modules such as ceilometer, congress, vitrage etc. that have not yet maturity. To exclude/postpone.
- The other test case areas to be reviewed next time.
- Topic changed to process and time schedule.
- Documentation to-do: https://etherpad.opnfv.org/p/collabrationofdovetail. High level content agreed. Comment: it should have a self-contained format.
- Agreed gerrit review and commit process
- Test suite: compliance_set.yml: patches (one patch per area)
- Test case: e.g. ipv6_tc001.yml: 1 patch per case
- Tool: normal software patches
- Each area/feature: request project rep to review & cc TWG
- Agreed: report to TSC: next Tuesday
- Proposed time schedule
- November 25, 2016: Minutes
- November 18, 2016: Minutes
- November 11, 2016: Minutes
- November 4, 2016: Minutes
- October 25, 2016: Minutes
- October 21, 2016: Minutes
- October 14, 2016: Minutes
- October 7, 2016: Minutes
- September 30, 2016: Minutes
- September 16, 2016: Minutes
- September 9, 2016: Minutes
- September 2, 2016: Minutes
- August 26, 2016: Minutes
- August 19, 2016: Minutes
- August 12, 2016: Minutes
- August 5, 2016: Minutes
- July 29, 2016: Minutes
- July 22, 2016: Minutes
- July 15, 2016: Minutes
- July 8, 2016: Minutes
- July 1, 2016: Minutes
- May 27, 2016: Minutes
- May 20, 2016: Minutes
- April 1, 2016
- March 18,2016:the meeting has been canseled due to the Hackfest meeting
- March 11, 2016: Minutes
- March 04, 2016: Minutes
- February 26, 2016: Minutes
- February 19, 2016: Minutes
- January 29, 2016: Minutes
- January 21, 2016: Minutes
- January 07, 2016: Minutes
Mika Rautakumpu
- Review any ongoing technical issues
- Dovetail 1.0.0 (OVP 2018.01) release planning
- Git branching/versioning update
- OVP portal home page updates
- Release notes
· OPNFV installer SUT testing strategy per release
Euphrates: Available HA extensions test-cases
- Controller Messaging Queue Service- opnfv_yardstick_tc056.rst
- Controller Cluster Management Service - opnfv_yardstick_tc057.rst
- Virtual Router Service - opnfv_yardstick_tc058.rst
- Controller Node Shutdown - opnfv_yardstick_tc025.rst (with reboot possibly)
- Etherpad from Fuqiao/Georg:
- https://etherpad.opnfv.org/p/plugfest_portland_reliability_testing
Euphrates: Audit of available functest test-cases
- Ex. snap_smoke
- Euphrates: Dovetail Framework
- Results, Logging, Test Suite / Framework separation
- Euphrates: discussion if bottlenecks test-cases should be targeted
- Ex. VNF scale-up/out
- Stress testing taxonomy from plugfest:
- Stability, Overload Robustness, Reliability, Capacity and Scalability, Multi-Dimensional System Performance
- Fraser & beyond: Use-case/performance testing – drafting of test specifications
- Fraser & beyond: ONAP VVP (Heat) / VNF SDF (TOSCA) integration assessment
- Other - TBD
final update of number test cases