Dovetail Team Meetings

Meeting Info

Weekly Technical Discussion Wednesday at 14:00-15:00 UTC (7:00-8:00AM Pacific Daylight Time)
IRC channel: IRC channel: #opnfv-dovetail@ Freenode (Web Chat )
Chaired by Georg Kunz (georgk)
https://zoom.us/j/2362828999
IRC Meeting Logs: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-dovetail/

Intro & Rules

Meeting agendas and minutes are kept below. If you would like to add an item to the agenda, please insert it into the appropriate meeting agenda (upcoming) and inform the chair. Please do NOT change past meeting minutes, if you believe there is an inaccuracy, please inform the chair.( as agreed by the dovetial meeting, the minutes will be recorded by the IRC,Jan 13)

Meetings

June 20, 2018

Input from Rabi (Vodafone) on performance tests
Talk proposals for ONS Europe and Open Source Summit Europe
CI status and test case selection

AOB

Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-dovetail/2018/opnfv-dovetail.2018-06-20-14.01.html

June 13, 2018

plugfest recap
test API broken due to Dovetail requirements?
release plan review & TSC update
CI status & test case selection
AOB
- remove JOID from releng scripts

Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-dovetail/2018/opnfv-dovetail.2018-06-13-14.00.html

May 30, 2018

web portal update
proposal for a first performance test for OVP
critical bug: vping reported as passed despite failing
plugfest preparation
CI status
AOB

Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-dovetail/2018/opnfv-dovetail.2018-05-30-13.01.html

May 23, 2018

next week's call
web portal update
plugfest update
CI status
AOB

Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-dovetail/2018/opnfv-dovetail.2018-05-23-14.00.html

May 16, 2018

Marketplace on web portal (Eddie)
plugfest update
OpenStack Summit update
SNAPs smoke test suite
CI status
AOB

Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-dovetail/2018/opnfv-dovetail.2018-05-16-14.01.html

May 9, 2018

plugfest
- https://wiki.plugtests.net/NFV-PLUGTESTS/index.php/Dovetail_Track
- HIVE connectivity
- pre-testing
OpenStack Summit
Test case renaming and branching
CI status
- restructured sub-pages of Dovetail space
- https://wiki.opnfv.org/display/dovetail/Status+of+proposed+tests
AOB

Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-dovetail/2018/opnfv-dovetail.2018-05-09-14.00.html

May 2, 2018

plugfest preparation
- Dovetail track
- office hour
status of CI runs
release work items for next release ( DOVETAIL-597 - Getting issue details... STATUS )
- integration of new test cases
  - neutron_trunk
  - patrole
  - juju_epc
  - MySQL HA test (TC090)
  - Corosync HA test (TC057)
- question
  - how to handle skipped test cases?
  - add list of exception
service release of OVP 2018.01
- update documentation, participation form

Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-dovetail/2018/opnfv-dovetail.2018-04-25-14.01.html

April 25, 2018

ETSI plugtest
- Dovetail track: https://wiki.plugtests.net/NFV-PLUGTESTS/index.php/Dovetail_Track
- feedback from VIMs
release plan proposal
- https://wiki.opnfv.org/download/attachments/2926467/OVP%202018.07%20release%20plan%20-%20gantt.xlsx?version=1&modificationDate=1524167178000&api=v2
- agree within project on proposed release plan
framework refactoring
service release of OVP to include API exemption
renaming of test cases

Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-dovetail/2018/opnfv-dovetail.2018-04-25-14.01.html

April 18, 2018

OPNFV/ETSI Plugfest
Review release plan proposal for OVP 2018.08 release
- Excel sheet
Additional test case candidates in Fraser
- https://wiki.opnfv.org/display/SWREL/Fraser+Release+Key+Updates
- Functest
  - OpenStack
    - neutron_trunk
    - patrole
    - juju_epc
  - Kubernetes
    - k8s_smoke
    - k8s_conformance
    - stor4nfv
    - clover
- Yardstick
  - OpenStack
    - HA test cases
restructuring and renaming of test cases

Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-dovetail/2018/opnfv-dovetail.2018-04-18-14.00.html

April 11, 2018

Implementation of exemption
ESTI plugtest / OPNFV plugfest planning
Next Release
Test case structure
CI Status (Euphrates)
Framework refactoring

Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-dovetail/2018/opnfv-dovetail.2018-04-11-14.02.html

March 21, 2018

Next two meetings
ONS session
Status of Dovetail runs in CI
Release roadmap
AOB

Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-dovetail/2018/opnfv-dovetail.2018-03-21-14.00.html

March 13, 2018

Strict API exemption process - next steps
ONS session - brief update
Roadmap discussion and JIRA ticket review (slides)

Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-dovetail/2018/opnfv-dovetail.2018-03-14-14.01.html

March 7, 2018

Strict API exemption process - review of TSC feedback and next steps
lack of CI resources - run Dovetail on Euphrates or Fraser; impact on OVP 2.0
roadmap discussion - release date of OVP 2.0.0 (slides)
meeting details - transition to Zoom and daylight saving changes
AOB

Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-dovetail/2018/opnfv-dovetail.2018-03-07-14.00.html

February 28, 2018

Update on exemption process proposal
ONS planning
JIRA triage
Euphrates scope / patchset review
HA test cases
Unified test case file

Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-dovetail/2018/opnfv-dovetail.2018-02-28-14.04.htm

Feb 14, 2018

ONS update
Committer promotions
Euphrates release scope
Fraser release scope
Consistency of test cases

Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-dovetail/2018/opnfv-dovetail.2018-02-14-14.00.html

Feb 7, 2018

OVP launch
ONS talk proposal & OpenStack talk proposal
Euphrates release scope DOVETAIL-597 - Getting issue details... STATUS
Ongoing test tool and test case integration
Review of test case specs:
- SDNVPN
- Test spec: https://gerrit.opnfv.org/gerrit/#/c/51621/
- Test integration: https://gerrit.opnfv.org/gerrit/#/c/51625/
- others
Fraser release scope DOVETAIL-600 - Getting issue details... STATUS
- Review of test case candidates
- Neutron trunk port https://github.com/openstack/neutron/blob/stable/pike/neutron/tests/tempest/api/test_trunk.py
Exemption phase for strict API checking
Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-dovetail/2018/opnfv-dovetail.2018-02-07-14.00.log.html

Jan 31, 2018

Dovetail / ONAP VNF SDK integration demo - Moshe
Dovetail 1.0.0 (OVP 2018.01) launch
- Final reviews of results from beta participants
- Close on container/git tags and testing - DOVETAIL-580
- Close SUT version - DOVETAIL-572
Future planning and new JIRA tickets
- Euphrates scope DOVETAIL-597
- Fraser scope DOVETAIL 600
OVP session at ONS developer forum
- OPNFV Unconference topics at LFN Developer Forum
Test specifications
Development update
Minutes:http://ircbot.wl.linuxfoundation.org/meetings/opnfv-dovetail/2018/opnfv-dovetail.2018-01-31-13.53.html

Jan 24, 2018

Meeting logistics – GTM worked in Wed slot
Review outstanding Dovetail 1.0.0 (OVP 2018.01) release deliverables
- Reviewed closed issues for OVP web portal (left-side navigation and home text): DOVETAIL-582, DOVETAIL-579
- Need to fix bug with SUT version for DOVETAIL-572
- Resubmit process for OVP graduates - participation form, fill-in SUT version
ONAP VNF SDK integration
Functest E-release integration findings
- Use default containers rather than building Dovetail specific ones
Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-dovetail/2018/opnfv-dovetail.2018-01-24-13.54.html

Jan 19, 2018

Team Logistics
- Potential Dovetail weekly meeting change - change to Wednesday only has one objection currently
- Gerrit - use Dovetail Team group for broad reviews of core changes moving forward
Euphrates release
- Begin integration of Euphrates Functest & Yardstick containers - use master and update Dovetail conf file to pull new dependent containers
- Update on Yardstick test cases - drop 57 from consideration - focus on 25, 56, 58
- Functest-features - leverage new test cases for sdnvpn
- Drafting test specifications: Yardstick HA, Functest smoke, sdnvpn
  - Begin drafting for test areas targeted for Fraser and beyond: NFVI performance (determine consensus after skeleton draft), VNF lifecycle stability
- Confirm relaxing strict API checking in Tempest and discuss patch - form broader perspective before adding patch
ONAP VNF SDK Integration
- Creating project with container artifact similar to Yardstick
- Will establish further cross-team communication channels
Dovetail 1.0.0 (OVP 2018.01)
- Walkthrough of landing page, web portal and documents
  - Online 'participation form' - please note terminology change from 'application form'
  - External landing page - www.opnfv.org/verified
  - Review release notes before patch submission
  - Waiting on OPNFV marketing for final program/legal doc links (Governance + T&C) to finalize OVP portal revision and release notes
  - Launch next week (hopefully)
- Resubmit process for first wave of OVP graduates
Preferred Labs
- Discuss overall meaning and tightening of qualifications in upcoming C&C meeting
Minutes:http://ircbot.wl.linuxfoundation.org/meetings/opnfv-dovetail/2018/opnfv-dovetail.2018-01-19-13.48.html
Jan 12, 2018
- Strict API checking in Tempest - Georg/Eddy
  - Agreed to consider relaxing strict checking in Euphrates release assuming community has no objection
- Continue discussion on Euphrates scope and timing
  - Content - discuss feasibility
    - 4 HA Yardstick tests cases discussed in Dec 15 Dovetail meeting (25, 56, 57, 58)
    - Functest Euphrates
      - functest-smoke
        Tiers: refstack-defcore, tempest_smoke_serial, rally_sanity, snaps_smoke
        Identified some new test cases from tempest_smoke_serial and snaps_smoke
      - functest-vnf
        Tiers: cloudify_ims, orchestra_openims, or orchestra_clearwaterims
        Cloudify & OpenBaton orchestrators / Clearwater & OpenIMS VNF
        Discuss if cloudify_ims can be employed as a use-case test scenario
    - Bottlenecks / VNF lifecycle stability - probably a long-shot for an E-release
  - Framework - discuss priority
    - Decoupling of test content from framework to support dev testing and other LFN communities/projects
    - Improved test execution - see new JIRA ticket - DOVETAIL-581
      - Object clean-up/deletion for failed test runs
    - Config file unification and/or interactive generator
    - Improved summary reporting
    - Debug tools - tracing to monitor system messaging and object creation
- Reviewed outstanding Dovetail 1.0.0 (OVP 2018.01) release deliverables - please approve outstanding Gerrit patches
- Minutes:http://ircbot.wl.linuxfoundation.org/meetings/opnfv-dovetail/2018/opnfv-dovetail.2018-01-12-13.52.html
Jan 5, 2018
- Dovetail 1.0.0 (OVP 2018.01) release deliverables
  - Resubmit process for first wave of OVP graduates
    - Use of verified@opnfv.org instead of cvp@opnfv.org for applicant correspondence and review process
    - Resubmit application form using online version and resubmit beta results
  - OVP Web Portal
    - OVP version added to application form
    - SUT version number added to OVP web portal - Gerrit, DOVETAIL-572
    - Updating home page links - DOVETAIL-579
  - Documentation
    - Finalize on changes Georg made to docs from CVP to OVP name change - Gerrit CVP to OVP
    - Finalize on user guide modifications - Gerrit, DOVETAIL-553
    - Finalize reviewer guide - Gerrit, DOVETAIL-555, DOVETAIL-408
    - Review release notes - Gerrit, DOVETAIL-578
  - Align container tags, github release tags and test configuration yaml for initial release - DOVETAIL-580
- Test framework / content separation to support LFN umbrella - slide from Bruce on ONAP VNFTest (VNF SDK) / Dovetail integration initial requirements
- Minutes:http://ircbot.wl.linuxfoundation.org/meetings/opnfv-dovetail/2018/opnfv-dovetail.2018-01-05-13.54.html
Dec 29, 2017
- Cancelled
Dec 22
- Holiday meeting schedule - skip Dec 29th and resume Jan 5th
- Introduced Jack Chan - OVP portal developer
- Reviewed ongoing technical issues
  - Wind River - discussion on tempest test cases where schemas do strict checking of additional metadata added to REST messages. Currently 'additionalProperties' is set to false in tempest schemas, which causes some test cases to fail
- Amdocs ONAP VNF conformance / Dovetail integration PoC - Bruce T provided overview
- Update on Dovetail / OPNFV Installer CI jobs - Xudan - added to both Daisy/Fuel jobs
- Dovetail 1.0.0 (OVP 2018.01) release deliverables
  - Georg made changes in documentation for the CVP to OVP naming change
  - Put release notes into master and cherry pick to stable/danube
- Euphrates release scope and timing - Framework, Functest, Yardstick HA
  - Bottlenecks / VNF lifecycle stability - begin methodology work
  - Consider tracing capability for framework
  - Discussed a possible March release for Euphrates with limited scope
- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-12-22-13.54.html
Dec 15

- Dovetail 1.0.0 (OVP 2018.01) release planning
  - Git branching/versioning update - branch stable/danube updated from master
  - OVP portal home page updates
  - OPNFV installer SUT testing strategy per release
  - OVP docs changes, release notes
- Euphrates: Available HA extensions test-cases
  - Controller Messaging Queue Service- opnfv_yardstick_tc056.rst
  - Controller Cluster Management Service - opnfv_yardstick_tc057.rst
  - Virtual Router Service - opnfv_yardstick_tc058.rst
  - Controller Node Shutdown - opnfv_yardstick_tc025.rst (with reboot possibly)
  - Etherpad from Fuqiao/Georg:
    - https://etherpad.opnfv.org/p/plugfest_portland_reliability_testing
- Euphrates: Audit of available functest test-cases: Ex. snap_smoke
- Euphrates: Dovetail Framework
  - Results, Logging, Test Suite / Framework separation
- Euphrates: discussion if bottlenecks test-cases should be targeted: Ex. VNF scale-up/out
  - Stress testing taxonomy from plugfest: Stability, Overload Robustness, Reliability, Capacity and Scalability, Multi-Dimensional System Performance
- Fraser & beyond: Use-case/performance testing – drafting of test specifications
- Fraser & beyond: ONAP VVP (Heat) / VNF SDF (TOSCA) integration assessment
  - ONAP VVP Repos
- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-12-15-13.55.html

Dec 8
- Reviewed ongoing technical issues
- Requirements for HA extensions discussed during plugfest - will consider a few test cases in Euphrates
- Audit of available functest/yardstick test cases available for integration in short-term
- Use-case/performance testing – start drafting of test specifications
- Release planning
- Minutes:http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-12-08-15.50.html
Dec 1
- Reviewed ongoing technical issues
- Plugfest planning
  - OVP/Dovetail session
    - Discuss how to structure roadmap portion
      - Framework/platform
      - Conformance: VNF onboarding (ONAP VVP collaboration)
      - Use-case: identify robust test VNFs
      - Security: VIM vulnerability scanning, NFVi tenant security
      - Performance: VIM/NFVi scale-out, NFVi forwarding performance
      - Network: IPv6 Extensions, ...
      - HA Extensions
      - Containerized SUT: core cloud capability within current Dovetail scope, K8 lifecycle scenarios
- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-12-01-13.52.html
Nov 24
- Cancelled
Nov 17
- Review post-beta issues
  - HA considerations from Wind River - Stephen/Xudan
- Release plan
  - Packaging and versioning
- Future planning
  - Plugfest content discussion (action from last week) - tutorial and review of 1st release planned
  - Decide and prepare content for roadmap discussion - review a few slides to kick-start (below are ideas)
    - HA extensions, NFVi forwarding performance, VIM vulnerability scanning, VNF onboarding
  - Hands-on portion needs discussion (below are just ideas):
    - Run Dovetail against Euphrates (including containerized version)
    - Execute open-source/OPNFV traffic generators against OVS
    - Setup and run vulnerability scanning tools against VIM elements
    - Execute new HA test-cases
- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-11-17-13.53.html
Nov 10
- Discuss ongoing Beta issues
  - CVP Portal
  - Reviewer role submits results - DOVETAIL-549
  - Result sharing issue by email (instead of user ID) - DOVETAIL-551
  - Multiple primary contacts (for submitting results)
  - Closed issues: DOVETAIL-548 (CentOS issue), DOVETAIL-550
  - osinterop test area taking 7hrs (Wind River) – resolved?
  - Log file consistency / Dovetail log (potential future improvement)
  - General review/approve process
  - CVP Danube Reviewer Guidelines
  - Beta Summary (final day)
- Documentation
  - User guide improvements (action from last week) - DOVETAIL-553
- Dovetail evolution and packaging discussion
  - Will Dovetail Danube test-cases pass for Euphrates?
  - How is alignment achieved between Dovetail and OPNFV releases?
- Minutes:http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-11-10-13.55.html
Nov 3
- C&C committee meeting update from 10/30
  - CVP Review Workflow: CVP Review Workflow v0.3.ppt
- CVP portal updates
  - Demo of owner column (DOVETAIL-545), SUT identification (DOVETAIL-541, DOVETAIL-547)
- Discuss beta issues
  - CentOS issue (DOVETAIL-543)
  - Stephen @ Wind River issues
- Future planning
  - Dovetail Future Release Priority Inputs
- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-11-03-12.56.html
Oct 27
- Updates on Dovetail / CVP Portal 0.8.0, short demo
- Beta status, issues, questions
- Docs-danube update
- Future planning etherpad:
  - https://etherpad.opnfv.org/p/Dovetail_Future_Release_Priority_Inputs
- Minutes:http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-10-27-13.02.html
Oct 20
- Review plan for minor release of Dovetail / CVP Portal during Beta - Eddie / Xudan
- Documentation update - Georg
- Euphrates/Fraser Planning
- Minutes:http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-10-20-13.02.html
Oct 13
- Feedback to questions raised in test WG… (xudan, georg)
- Tutorial : hands on process going through CVP testing (Eddie Arrage)
- Minutes:http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-10-13-13.00.log.html
Oct 6
- Cancelled
Sep 29
- For this week, we have a singular focus to review preparations and to start beta, including 0.7.0 (beta) release, web portal, all relevant docs, and support mechanism.
- Next week we may be impacted by China’s holidays – let’s see if we need to cancel the call and if any alternative support is needed.
- If time permit, Georg, can you update if we are ready to finalize on doc publication plan?

Sep 22
- -Review of status: revision 0.7.0, web portal, remaining doc related tasks (xudan/leo)
- -Doc publication (Georg)
- -Beta process and logistics of organizing and supporting beta tests
- -Review dovetail branching scheme, support-ability
- http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-09-22-13.01.log.html
Sep 15
- - Status update/beta readiness: dovetail software, web portal, docs
  - remaining open docs, doc publication
  - Jira ticket cleanup
  - and beta process
- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-09-15-13.00.log.html
Sep 8
- -Status update on docs for test specs and the cvp progam and web portal
  -The next 0.6.0 release and testing report
  -Finalizing beta test plan
  -Project update (scheduled for 9/12) preparation
- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-09-08-13.05.log.html
Sep 1
- -dovtail v0.5 test case run results/status
  -Test case docs to be merged
  -Status on the portal
  -Tsc update
  -Beta plan timeline
- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-09-01-13.00.log.html
Aug 25
- - Review and merge priority docs to be ready for tsc review.
  - Status update of dovetail software and test suite - currently 0.5.0 - remaining testing and bug fixes
  - Status update of the web portal
- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-08-25-13.00.log.html
Aug 18
- -Current tool+test status
  -dovetail version 0.5
  -Testing pod resources
  -Docs, including the test case requirement patch
  -Overall status review and plan for the remaining milestones.
- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-08-18-13.01.log.html
Aug 11
- - Current tool+test status: (10 min)
  1. dovetail version 0.5
  2. Testing pod resources
  - Docs, including the test case requirement patch
  - Overall status review and plan for the remaining milestones.
- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-08-11-13.00.log.html
Aug 4
- -Review xudan’s patch https://gerrit.opnfv.org/gerrit/#/c/38379/3, and map that with the Addendum requirements and gap analysis results
  -Update on LF meeting and plan for the cvp web portal
  -Dovetail 0.4 draft release. Cvp web portal demo and feedbacks on login, and test result page
  -Tentative release plan discussion.
- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-08-04-13.01.log.html
July 28
- - Review of Gap analysis findings
  -update for the workflow
- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-07-28-13.00.log.html
July 21
- -Update on the most recent Dovetail release 0.3
  -Another round of review on the addendum document
  -Continue to look through the open task list, including docs that still remain in drafts
- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-07-21-13.01.log.html
July 14
- -Determine if everyone is OK to extend an hour to the meeting time… just this once
  -A few minutes to update status and the most recent 0.2 release
  -Review addendum document for test scope
- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-07-14-13.00.log.html
June 30
- - Review the feedbacks from tsc members
  - Examine remaining work items required for first release and decide how to close them
  - Quick new status updates
- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-06-30-13.00.log.html
June 23
- - Openstack Interop WG discussion
  - A 5 min for Hongbo to propose to PTL election using the yardstick/functest model.
  - A 5 min quick #agree on moving https://gerrit.opnfv.org/gerrit/#/c/34343/ forward.
- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-06-23-13.00.log.html
June 2
- -2x one hour slots have been scheduled for design summit – Shall we add an hour or more of dedicated time to ETSI TST, operator/EUAG feedback, and, upstream/openstack-interop if people are available?
  -The questions raised during the TSC discussion (which will continue next Tuesday): scope in terms of considering more projects in Danube, mandatory vs optional, agreement needed from the TSC.
  - Any docs that need an urgent push to complete – give them some concerted effort.
  -Other topics inherited from the last week
- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-06-02-13.00.log.html
May 26
- - Preparation for TSC review on 5/30
  - Review the Danube addendum
  - QA dovetail
  -Tagging / release schemes
  -Invited speakers: openstack interop wg, ETSI TST
  -Design summit topics
- http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-05-26-13.00.log.html
May 19
- -Welcome new committers and where we need immediate new contribution and attention
  -Preparation for tsc review on 5/30
  -Ask – what we need to ask from c&c and board? How should we take on the administrative side of tasks. Also the Danube addendum for 5/22.
  -Naming convention of test cases
  -Vendor lab testing – needs volunteers to sign up beta testers
  -Tagging / releases, offline support
  -Design summit topics
- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-05-19-13.00.log.html
May 12
- -testcase reveiew update: Refstack, IPV6, HA and SDNVPN
  -Documents update
  -dovetail planning for the OPNFV design summit
  -dovetail testing try in vendors environments
- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-05-12-13.01.log.html
May 5
- -Summary of the OPNFV plugfest
  -Sdnvpn test case sample format
  -Refstack test cases
  -Next steps for the test case review
  -Document status
- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-05-05-13.00.log.html
April 21, 2017
- -Review of last meeting's minutes (not in the IRC log)
  -Plugfest planned activities last check:
- Minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-04-21-12.59.log.html
April 14, 2017
- http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-04-14-13.00.log.html
- The IRC minutes were not adequately recorded on this call - I added the following for the record. We can review it in the next call to see if there is any objections.
- Also reviewed the documentation status: Trevor is to start drafting a developer's guide, and Wenjing to draft the tester's guide which would be a part of the user facing doc.
- Wenjing's testing guide draft is here: Dovetail Testing Guide, (a part of the user facing doc to be integrated). Will use plugfest testing to validate this doc's accuracy and completeness etc.
- Trevor's developer guide draft: https://gerrit.opnfv.org/gerrit/#/c/33367/1
- The worksheet of test case requirements: https://gerrit.opnfv.org/gerrit/#/c/33317/
- Reviewed the plugfest meetings related to dovetail. Agreed to add a few other meetings: one to review doc, another to start reviewing test areas such as ha, ipv6, sdnvpn, third for e/future planning.
- Reviewed plugfest testing for dovetail, goals, facilities, time/schedule. A lot more to be done in order to plan logistics. Action item on Hongbo to get more people to assign time/resource, and scenario/installer may need to be pre-installed.
- Uli is tasked with the action item to connect with security wg/infra wg on possible security topics - none identified so far but should get a definitive resolution.
- Discussed the slow progress in functest on testapi login method - Wenjing to email to urge for quicker resolution. If that's not possible, need to have plan B for plugfest testing with a no-login server.
April 7, 2017
- http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-04-07-13.00.log.html
March 31,2017
- http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-03-31-13.00.log.html

March 24,2017
- http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-03-24-13.01.log.html
- Test case requirement wiki reviewed, and agreed to.
- Chris was not available to discuss the test strategy doc, but email response was discussed. Called on everyone to review the patch.
- SDN controller: agreed on Neutron based api testing only in Danube. Other networking features such as bgpvpn, discussed. Tim to follow up.
- Project update reviewed for presentation to TSC. JIRA status/cleanup reviewed.
March 17,2017
- Here is last week’s meeting minutes: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-03-17-13.00.log.html
  We covered all the items in the agenda, except #5. And in addition, we also briefly touched upon the test strategy document draft http://artifacts.opnfv.org/dovetail/review/30811/testing_user_teststrategy/index.html
  Please provide feedback/comment.
  The rest of the Dovetail plan for Danube (draft) is still here: https://wiki.opnfv.org/display/dovetail/Dovetail+Danube+Plan
March 10,2017
- We reviewed the dovetail plan brainstorming inputs and started to summarize into agreements and action items https://wiki.opnfv.org/display/dovetail/Dovetail+Danube+Plan in today’s weekly call. The minutes can be found here:
  http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-03-10-14.00.html
  As part of the action items, the test case requirement criteria will be updated based on inputs collected in the last few weeks on etherpad, wiki pages and mailing list. Dave Neary took this action item to summarize and make the updated wiki page ready for community review. The page is: https://wiki.opnfv.org/display/dovetail/Dovetail+Test+Case+Requirements. Once updated and reviewed, these requirements will then be used as criteria when we start reviewing test cases for inclusion into the dovetail suite.
  Openstack is a major component in opnfv’s stacks and they have developed defcore/refstack for interoperability testing. This part will be incorporated as a whole for dovetail, and this model of upstream collaboration could be extended in the future. Some technical questions are still open but developers are making good progress to close them.
  A draft milestone time table is also in the plan page https://wiki.opnfv.org/display/dovetail/Dovetail+Danube+Plan. We are still working on validation of assumptions and resource assignments; you are welcome to review the milestones and give your inputs.
  As a last note, we are to finalize the plan and present to TSC for review on March 21 call, so if you like to give input please engage now. Next week is the only time we have. Thanks!
March 3,2017
- http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-03-03-14.00.log.html
Feb 24,2017
- http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-02-24-14.00.log.html
Feb.17,2017
- http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-02-17-14.00.log.html
Jan 20, 2017
1. http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-02-10-14.00.html
2. http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-02-10-14.00.log.html
Jan 13, 2017:
-        http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2017/opnfv-meeting.2017-01-13-14.00.log.txt
-        Chris Price had to drop off early and so IRC didn’t capture the second half of minutes: below is manually taken minutes by wenjing, please correct if you find anything not accurate
-        Dovetail test case review: wiki https://wiki.opnfv.org/display/dovetail/Dovetail+Test+Areas+and+Test+Cases
-        Vim operation 5 areas: included
-        Nfvi and mini-use cases: included, need complete more info in wiki to fully understand (action item: fill in more details)
-        HA: included. description from HA project. Comment: we should put info in one place for easier access (action item: gather info and fill in here)
-        Ipv6: included. Same as above to gather info in one place.
-        Vpn or l3vpn: unclear if the l3vpn feature is completed fully in C release (action: to collect definitive answer for next review). Commented that it should be excluded on the ground of not yet mature and have adoption (see test case reqs & cvp description).
-        Fault mgmt.: noted that the current feature has dependency on modules such as ceilometer, congress, vitrage etc. that have not yet maturity. To exclude/postpone.
-        The other test case areas to be reviewed next time.
-        Topic changed to process and time schedule.
-        Documentation to-do: https://etherpad.opnfv.org/p/collabrationofdovetail. High level content agreed. Comment: it should have a self-contained format.
-        Agreed gerrit review and commit process
-        Test suite: compliance_set.yml: patches (one patch per area)
-        Test case: e.g. ipv6_tc001.yml: 1 patch per case
-        Tool: normal software patches
-        Each area/feature: request project rep to review & cc TWG
-        Agreed: report to TSC: next Tuesday
-        Proposed time schedule
November 25, 2016: Minutes
November 18, 2016: Minutes
November 11, 2016: Minutes
November 4, 2016: Minutes
October 25, 2016: Minutes
October 21, 2016: Minutes
October 14, 2016: Minutes
October 7, 2016: Minutes
September 30, 2016: Minutes
September 16, 2016: Minutes
September 9, 2016: Minutes
September 2, 2016: Minutes
August 26, 2016: Minutes
August 19, 2016: Minutes
August 12, 2016: Minutes
August 5, 2016: Minutes
July 29, 2016: Minutes
July 22, 2016: Minutes
July 15, 2016: Minutes
July 8, 2016: Minutes
July 1, 2016: Minutes
May 27, 2016: Minutes
May 20, 2016: Minutes
April 1, 2016
March 18,2016:the meeting has been canseled due to the Hackfest meeting
March 11, 2016: Minutes
March 04, 2016: Minutes
February 26, 2016: Minutes
February 19, 2016: Minutes
January 29, 2016: Minutes
January 21, 2016: Minutes
January 07, 2016: Minutes

Mika Rautakumpu

Review any ongoing technical issues
Dovetail 1.0.0 (OVP 2018.01) release planning

Git branching/versioning update
OVP portal home page updates
Release notes

· OPNFV installer SUT testing strategy per release

Euphrates: Available HA extensions test-cases

Controller Messaging Queue Service- opnfv_yardstick_tc056.rst
Controller Cluster Management Service - opnfv_yardstick_tc057.rst
Virtual Router Service - opnfv_yardstick_tc058.rst
Controller Node Shutdown - opnfv_yardstick_tc025.rst (with reboot possibly)
Etherpad from Fuqiao/Georg:

https://etherpad.opnfv.org/p/plugfest_portland_reliability_testing

Euphrates: Audit of available functest test-cases

Ex. snap_smoke

Euphrates: Dovetail Framework

Results, Logging, Test Suite / Framework separation

Euphrates: discussion if bottlenecks test-cases should be targeted

Ex. VNF scale-up/out
Stress testing taxonomy from plugfest:

Stability, Overload Robustness, Reliability, Capacity and Scalability, Multi-Dimensional System Performance

Fraser & beyond: Use-case/performance testing – drafting of test specifications
Fraser & beyond: ONAP VVP (Heat) / VNF SDF (TOSCA) integration assessment

ONAP VVP Repos

Other - TBD

Show all results

Page tree