BEGIN:VCALENDAR VERSION:2.0 PRODID:-//Pentabarf//Schedule 0.3//EN CALSCALE:GREGORIAN METHOD:PUBLISH X-WR-CALDESC;VALUE=TEXT:Testing and Automation devroom X-WR-CALNAME;VALUE=TEXT:Testing and Automation devroom X-WR-TIMEZONE;VALUE=TEXT:Europe/Brussels BEGIN:VEVENT METHOD:PUBLISH UID:13708@FOSDEM23@fosdem.org TZID:Europe-Brussels DTSTART:20230205T090000 DTEND:20230205T090500 SUMMARY:Welcome to Testing and Automation devroom DESCRIPTION:
Welcome to FOSDEM 2023. This is our 10th anniversary!
CLASS:PUBLIC STATUS:CONFIRMED CATEGORIES:Testing and Automation URL:https:/fosdem.org/2023/schedule/2023/schedule/event/welcome/ LOCATION:UB4.132 ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Alexander Todorov":invalid:nomail ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Cyril Hrubis":invalid:nomail ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Anders Roxell":invalid:nomail ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Zaklina Stojnev":invalid:nomail END:VEVENT BEGIN:VEVENT METHOD:PUBLISH UID:14174@FOSDEM23@fosdem.org TZID:Europe-Brussels DTSTART:20230205T090500 DTEND:20230205T092500 SUMMARY:Linux Kernel Functional Testing DESCRIPTION:The Linux Kernel Functional Testing (LKFT) project is aiming at improving thequality of the Linux kernel by performing functional testing on Arm hardware.
LKFT has built over 1 millions kernel per years other the last two years andran 140 millions tests on both emulation (qemu) and hardware devices.
In this talk I will present the current architecture that is able to build andtest millions of kernels with a really small team of engineers and at areasonable cost.
CLASS:PUBLIC STATUS:CONFIRMED CATEGORIES:Testing and Automation URL:https:/fosdem.org/2023/schedule/2023/schedule/event/linux_kernel_functional_testing/ LOCATION:UB4.132 ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Rémi Duraffort":invalid:nomail END:VEVENT BEGIN:VEVENT METHOD:PUBLISH UID:14556@FOSDEM23@fosdem.org TZID:Europe-Brussels DTSTART:20230205T093000 DTEND:20230205T095500 SUMMARY:Growing a lab for automated upstream testing: challenges and lessons learned DESCRIPTION:With great labs comes great responsibility! Open source CI systems such as KernelCI and MesaCI run hundreds of tests daily on various hardware platforms and require a reliable and diverse lab. In this presentation, we will walk through the challenges of maintaining and growing a LAVA lab focused on upstream testing.
CLASS:PUBLIC STATUS:CONFIRMED CATEGORIES:Testing and Automation URL:https:/fosdem.org/2023/schedule/2023/schedule/event/growing_testing_lab/ LOCATION:UB4.132 ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Laura Nao":invalid:nomail END:VEVENT BEGIN:VEVENT METHOD:PUBLISH UID:14504@FOSDEM23@fosdem.org TZID:Europe-Brussels DTSTART:20230205T100000 DTEND:20230205T102500 SUMMARY:Introducing Vegvisir: An automation framework for testing QUIC application logic DESCRIPTION:For years, the majority of internet applications have used either TCP or UDP as the transport layer protocol of choice. Recently, a new contestant - QUIC, an end-to-end encrypted protocol - has entered the ring. QUIC is being marketed as the successor to TCP and tackles some of its inherent problems. An excellent example is the Head-Of-Line (HOL) blocking issue perceived by, for example, web pages. While QUIC holds many advantages over its predecessor, it still suffers from interoperability challenges and holds a number of open questions. The biggest one is: how do we efficiently test, measure, and debug the performance of applications using QUIC?
Answering the above question is non-trivial and plays a significant part in my research as a Ph.D. candidate. In this talk, we will – from a beginner's perspective – discuss why getting started with optimizing applications using QUIC as a protocol might seem daunting. We will discuss some tools available such as qlog, and why they can be more insightful than solely relying on packet traces. Finally, we will demonstrate our in-house developed automation framework called Vegvisir. Initially designed for analyzing the performance of video streaming over QUIC, it is now generalized for end-to-end testing of any networked applications. The goal of Vegvisir is to help alleviate some of the obstacles mentioned earlier, but also to ensure that developers and researchers can perform tests with QUIC consistently and reliably.
CLASS:PUBLIC STATUS:CONFIRMED CATEGORIES:Testing and Automation URL:https:/fosdem.org/2023/schedule/2023/schedule/event/vegvisir/ LOCATION:UB4.132 ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Joris Herbots":invalid:nomail END:VEVENT BEGIN:VEVENT METHOD:PUBLISH UID:14490@FOSDEM23@fosdem.org TZID:Europe-Brussels DTSTART:20230205T103000 DTEND:20230205T105500 SUMMARY:Observability-driven development with OpenTelemetry DESCRIPTION:Testing large systems with multiple microservices is hard to understand. You need to understand the whole system, all connections, and how the microservices interconnect.
With tracing you get a map of everything which makes your whole system easier to understand.
I want to showcase traditional test-driven development vs the new observability-driven development. I'll use open-source tools like Tracetest and OpenTelemetry to showcase how to use trace-based testing and enrich integration tests with trace data.
CLASS:PUBLIC STATUS:CONFIRMED CATEGORIES:Testing and Automation URL:https:/fosdem.org/2023/schedule/2023/schedule/event/observability_opentelemetry/ LOCATION:UB4.132 ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Adnan Rahic":invalid:nomail END:VEVENT BEGIN:VEVENT METHOD:PUBLISH UID:14115@FOSDEM23@fosdem.org TZID:Europe-Brussels DTSTART:20230205T110000 DTEND:20230205T112500 SUMMARY:Setting up OpenQA testing for GNOME DESCRIPTION:Integration testing of GNOME, a desktop environment built from more than 200 separate components, is tricky. Since 2010 folk have been working towards better testing, and one outcome is the testing-only VM image "GNOME OS", built from the latest "main" and "master" branches of GNOME.
Now we're trialling OpenQA to automatically detect regressions in GNOME OS as soon as they happen. In this talk, I'll speak a bit about how we got here, where we're going and some tips for getting started with your own OpenQA testing.
CLASS:PUBLIC STATUS:CONFIRMED CATEGORIES:Testing and Automation URL:https:/fosdem.org/2023/schedule/2023/schedule/event/openqa_for_gnome/ LOCATION:UB4.132 ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Sam Thursfield":invalid:nomail END:VEVENT BEGIN:VEVENT METHOD:PUBLISH UID:13790@FOSDEM23@fosdem.org TZID:Europe-Brussels DTSTART:20230205T113000 DTEND:20230205T114500 SUMMARY:Console Automation with Termie DESCRIPTION:Termie introduces a new concept in terminal automation: an additional layer of interactivity on top of another interactive terminal session. Modern debuggers and interfaces can overwhelm console users and clutter the screen with stack traces, excessive debugging information, database query details, and more. Docker containers can also remove precious command line histories, which makes the console experience more tedious. Termie allows for persistent histories across sessions, and adds a mechanism for clutter-free interaction. It also provides some of the functionality of the venerable "expect", to further improve automation of interactive consoles.
This talk will be about using termie, and about some aspects of its implementation in the Raku programming language.
CLASS:PUBLIC STATUS:CONFIRMED CATEGORIES:Testing and Automation URL:https:/fosdem.org/2023/schedule/2023/schedule/event/termie/ LOCATION:UB4.132 ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Brian Duggan":invalid:nomail END:VEVENT BEGIN:VEVENT METHOD:PUBLISH UID:14513@FOSDEM23@fosdem.org TZID:Europe-Brussels DTSTART:20230205T115000 DTEND:20230205T125000 SUMMARY:Fear the mutants. Love the mutants. DESCRIPTION:Code coverage (the percentage of your code tested by your tests) is a great metric. However, coverage doesn’t tell you how good your tests are at picking up changes to your codebase - if your tests aren’t well-designed, changes can pass your unit tests but break production.
Mutation testing is a great (and massively underrated) way to quantify how much you can trust your tests. Mutation tests work by changing your code in subtle ways, then applying your unit tests to these new, "mutant" versions of your code. If your tests fail, great! If they pass… that’s a change that might cause a bug in production.
In this talk, I’ll show you how to get started with mutation testing and how to integrate it into your CI/CD pipeline. After the session, you’ll be ready to use mutation testing with wild abandon. Soon, catching mutant code will be a routine part of your release engineering process!
CLASS:PUBLIC STATUS:CONFIRMED CATEGORIES:Testing and Automation URL:https:/fosdem.org/2023/schedule/2023/schedule/event/mutation_testing/ LOCATION:UB4.132 ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Paco van Beckhoven":invalid:nomail ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Max Kahan":invalid:nomail END:VEVENT END:VCALENDAR