BEGIN:VCALENDAR VERSION:2.0 PRODID:-//Pentabarf//Schedule 0.3//EN CALSCALE:GREGORIAN METHOD:PUBLISH X-WR-CALDESC;VALUE=TEXT:Testing and Automation devroom X-WR-CALNAME;VALUE=TEXT:Testing and Automation devroom X-WR-TIMEZONE;VALUE=TEXT:Europe/Brussels BEGIN:VEVENT METHOD:PUBLISH UID:9818@FOSDEM20@fosdem.org TZID:Europe-Brussels DTSTART:20200201T103000 DTEND:20200201T110000 SUMMARY:Improving the culture of automated testing in FOSS DESCRIPTION:
In this talk we will explore some of the FOSS specific mentalities andpractices that may discourage adoption of comprehensive automated testing, andpresent advice for promoting and sustaining automated testing in FOSS projects.
CLASS:PUBLIC STATUS:CONFIRMED CATEGORIES:Testing and Automation URL:https:/fosdem.org/2020/schedule/2020/schedule/event/testing_improving_culture_automated_testing_foss/ LOCATION:UB2.147 ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Alexandros Frantzis":invalid:nomail END:VEVENT BEGIN:VEVENT METHOD:PUBLISH UID:10643@FOSDEM20@fosdem.org TZID:Europe-Brussels DTSTART:20200201T110500 DTEND:20200201T113500 SUMMARY:Welcome to KernelCI DESCRIPTION:KernelCI is a project dedicated to testing the upstream Linux kernel.Originally created by Linaro in 2014, it started a new chapter bybecoming a Linux Foundation project in October 2019. Its future looksbright, with plenty of opportunities for new contributors to join.
CLASS:PUBLIC STATUS:CONFIRMED CATEGORIES:Testing and Automation URL:https:/fosdem.org/2020/schedule/2020/schedule/event/testing_welcome_kernelci/ LOCATION:UB2.147 ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Guillaume Tucker":invalid:nomail END:VEVENT BEGIN:VEVENT METHOD:PUBLISH UID:10271@FOSDEM20@fosdem.org TZID:Europe-Brussels DTSTART:20200201T114000 DTEND:20200201T122000 SUMMARY:Abusing GitLab CI to Test Kernel Patches DESCRIPTION:See how Red Hat’s CKI project uses GitLab CI to test kernel patches as soon as they're posted to maillists.
CLASS:PUBLIC STATUS:CONFIRMED CATEGORIES:Testing and Automation URL:https:/fosdem.org/2020/schedule/2020/schedule/event/testing_abusing_gitlabci_test_kernel/ LOCATION:UB2.147 ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Nikolai Kondrashov":invalid:nomail END:VEVENT BEGIN:VEVENT METHOD:PUBLISH UID:9336@FOSDEM20@fosdem.org TZID:Europe-Brussels DTSTART:20200201T122500 DTEND:20200201T131500 SUMMARY:OpenQA with the JDP data analyses framework DESCRIPTION:Overview of SUSE's Linux kernel testing in OpenQA, how we keep track of known issues, explore test results and other features of JDP. The JDP framework is written in Julia, uses Redis as a distributed data cache and Jupyter for interactive reporting. OpenQA is a large application used for testing operating systems and displaying the results.
CLASS:PUBLIC STATUS:CONFIRMED CATEGORIES:Testing and Automation URL:https:/fosdem.org/2020/schedule/2020/schedule/event/testing_openqa_jdp/ LOCATION:UB2.147 ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Richard Palethorpe":invalid:nomail END:VEVENT BEGIN:VEVENT METHOD:PUBLISH UID:9888@FOSDEM20@fosdem.org TZID:Europe-Brussels DTSTART:20200201T132000 DTEND:20200201T135000 SUMMARY:Automated Performance Testing for Virtualization with MMTests DESCRIPTION:What benchmark? How many VMs? How big each VM is? Are they all equal or are they different? What's the host OS? What are the guest OSes? I.e., when wanting to do virtualization performance testing, the matrix of test cases tends to explode pretty quickly. This talk will show how we enhanced an existing benchmarking suite, MMTests, in order to be able to deal a little bit better with such complexity. And what our further activities and plans are, for even more and better automation.
CLASS:PUBLIC STATUS:CONFIRMED CATEGORIES:Testing and Automation URL:https:/fosdem.org/2020/schedule/2020/schedule/event/testing_automated_performance_testing_virtualization/ LOCATION:UB2.147 ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Dario Faggioli":invalid:nomail END:VEVENT BEGIN:VEVENT METHOD:PUBLISH UID:9136@FOSDEM20@fosdem.org TZID:Europe-Brussels DTSTART:20200201T135500 DTEND:20200201T142000 SUMMARY:Auto-healing cluster through negative testing DESCRIPTION:OCS stands for Openshift Container storage. It provides container-based storage for OCP(Openshift container platform). It’s easily scalable to bare metal, VMs and cloud platforms.Auto healing is a property of OCS cluster that auto heals a cluster component automatically when passes through an unexpected condition. A component can be a node, a network interface, a service, etc. To make sure auto heals just fine, we introduced negative testing.Negative Testing is defined as, a testing type that checks a system for unexpected conditions. In this presentation, We’re going to talk, what role negative testing plays, how to negative test components like node by shutting it down, deploying a heavy workload, etc. Similarly, for the network component, we are going to see what happens when the public network is disconnected along with many more scenarios.
CLASS:PUBLIC STATUS:CONFIRMED CATEGORIES:Testing and Automation URL:https:/fosdem.org/2020/schedule/2020/schedule/event/testing_autohealing_negative_testing/ LOCATION:UB2.147 ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Rajat Singh":invalid:nomail END:VEVENT BEGIN:VEVENT METHOD:PUBLISH UID:10645@FOSDEM20@fosdem.org TZID:Europe-Brussels DTSTART:20200201T142500 DTEND:20200201T145500 SUMMARY:Introducing OpenTAP - Open Test Automation Project DESCRIPTION:OpenTAP is a project aimed at automation in the test and measurement space. It is designed for test and measurement of hardware in R&D and manufacturing, but is moving more towards software testing e.g. with usage in cloud infrastructure testing. The project started as an internal product by Keysight Technologies and is used as the core of many products and solutions deployed around the world. As of 2019, we have released OpenTAP under the Mozilla Public License v2 and are working on building a community around it. The release was influenced by the team attending FOSDEM over the last few years, we will also welcome you for more detailed discussion at our booth on Saturday.
What we want is to grow an environment for people to share, leverage and co-develop test system plugins and solutions.
In this short talk, we will explain the basic concepts of OpenTAP, what it can be used for, and how to get started.
CLASS:PUBLIC STATUS:CONFIRMED CATEGORIES:Testing and Automation URL:https:/fosdem.org/2020/schedule/2020/schedule/event/testing_introducing_opentap/ LOCATION:UB2.147 ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Rolf Madsen":invalid:nomail END:VEVENT BEGIN:VEVENT METHOD:PUBLISH UID:10647@FOSDEM20@fosdem.org TZID:Europe-Brussels DTSTART:20200201T150000 DTEND:20200201T153000 SUMMARY:One test output format to unite them all DESCRIPTION:Since several years, software quality tools have evolved, CI systems are more and more scalable, there are more testing libraries than ever and they are more mature than ever and we have seen the rise of new tools to improve the quality of code we craft.
Unfortunately, most of our CI system still launch a script and check the return code, most of the testing libraries don't allow to select finely which tests to launch and most of CI advanced innovations, parallel running, and remote execution, are not available to developers on their workstation.
Each language community has its own set of tools, libraries, and command-line and visual interfaces increasing the effort for developers to learn or learn again how to write, run and debug tests in each language.
How to improve the situation? In this talk, I will present one of my project LITF (https://github.com/Lothiraldan/litf) a new protocol for test running and test output as well as BALTO (https://github.com/lothiraldan/balto), a test orchestrator using this new format. Thanks to this new format, BALTO can execute several test suites in different languages, remotely on a Kubernetes cluster and all in parallel. In any case, this is the goal of the stable version.
CLASS:PUBLIC STATUS:CONFIRMED CATEGORIES:Testing and Automation URL:https:/fosdem.org/2020/schedule/2020/schedule/event/testing_one_test_output_format/ LOCATION:UB2.147 ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Boris Feld":invalid:nomail END:VEVENT BEGIN:VEVENT METHOD:PUBLISH UID:9205@FOSDEM20@fosdem.org TZID:Europe-Brussels DTSTART:20200201T153500 DTEND:20200201T160500 SUMMARY:Releasing Software with GitOps DESCRIPTION:Overview of the process the OpenStack community uses to manage all software releases through automation around Git commits.
CLASS:PUBLIC STATUS:CONFIRMED CATEGORIES:Testing and Automation URL:https:/fosdem.org/2020/schedule/2020/schedule/event/testing_releasing_software_gitops/ LOCATION:UB2.147 ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Sean McGinnis":invalid:nomail END:VEVENT BEGIN:VEVENT METHOD:PUBLISH UID:10576@FOSDEM20@fosdem.org TZID:Europe-Brussels DTSTART:20200201T161000 DTEND:20200201T165500 SUMMARY:Writing Go(od) Tests DESCRIPTION:Every year we hear great content about how to develop in Go, but rarely do we focus on how to test in Go. Well written tests are critical to the success of a project, and more often than not, they can help drive developers to design features in more simple and concise ways.
CLASS:PUBLIC STATUS:CONFIRMED CATEGORIES:Testing and Automation URL:https:/fosdem.org/2020/schedule/2020/schedule/event/testing_writing_go_tests/ LOCATION:UB2.147 ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Nikki Attea":invalid:nomail END:VEVENT BEGIN:VEVENT METHOD:PUBLISH UID:10639@FOSDEM20@fosdem.org TZID:Europe-Brussels DTSTART:20200201T170000 DTEND:20200201T171000 SUMMARY:CANCELLED Testing apps with third-party API integrations DESCRIPTION:As reliance on third-party services becomes more prevalent in our ecosystem, developers need cost-effective, secure and reliable ways to mock these services. In this talk, we will briefly examine strategies and best practices for testing apps that make heavy use of third-party API integrations.
CLASS:PUBLIC STATUS:CONFIRMED CATEGORIES:Testing and Automation URL:https:/fosdem.org/2020/schedule/2020/schedule/event/testing_apps_with_3rd_party_api/ LOCATION:UB2.147 ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Carolyn Stransky (carostran)":invalid:nomail END:VEVENT BEGIN:VEVENT METHOD:PUBLISH UID:10632@FOSDEM20@fosdem.org TZID:Europe-Brussels DTSTART:20200201T171500 DTEND:20200201T174500 SUMMARY:Testing a large testing software DESCRIPTION:LAVA is an automated validation architecture primarily aimed at testing deployments of systems based around the Linux kernel on ARM devices, specifically ARMv7 and later.LAVA is becoming the de facto standard to test software (bootloader, kernel, userspace) on development boards (rpi, juno, beagle, ...). It's used by many projects to build large testing systems like kernelci.
Testing a testing system like LAVA is sometimes a tricky task. In order to test LAVA we had to develop some specific tools (meta-lava, DummySYS, lavafed, ...) that I will present during this talk.
CLASS:PUBLIC STATUS:CONFIRMED CATEGORIES:Testing and Automation URL:https:/fosdem.org/2020/schedule/2020/schedule/event/testing_large_testing_software/ LOCATION:UB2.147 ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Rémi Duraffort":invalid:nomail END:VEVENT BEGIN:VEVENT METHOD:PUBLISH UID:10584@FOSDEM20@fosdem.org TZID:Europe-Brussels DTSTART:20200201T175000 DTEND:20200201T181000 SUMMARY:Correlation analysis in automated testing DESCRIPTION:Correlation Analysis is a statistical method that is used to discover if thereis a relationship between two variables, and how strong that relationship mightbe. A correlation coefficient is a numerical measure of such correlation.According to the Cauchy–Schwarz inequality it has a value between +1 and −1,where 1 is total positive linear correlation, 0 is no linear correlation, and −1is total negative linear correlation. One of the axioms of automated testing isthat tests are independent and in spite of that correlation coefficient shouldbe equal to 0. But often it isn't. In this work, we are going to presenta method of evaluation of tests suites quality based on correlation coefficientand finding their weak points. Using PC Engines open-source firmware regressiontest results, which are based on over 140 automated tests run with 2 flavors ofsoftware on 4 different platforms, we will show how its quality can be describednumerically, and how that results can be used to optimize test criteria.
CLASS:PUBLIC STATUS:CONFIRMED CATEGORIES:Testing and Automation URL:https:/fosdem.org/2020/schedule/2020/schedule/event/testing_correlation_analysis_automated_testing/ LOCATION:UB2.147 ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Łukasz Wcisło":invalid:nomail END:VEVENT BEGIN:VEVENT METHOD:PUBLISH UID:9358@FOSDEM20@fosdem.org TZID:Europe-Brussels DTSTART:20200201T181500 DTEND:20200201T190000 SUMMARY:How to fail successfully and reliably DESCRIPTION: