Benchmarking for Research Software
High‑quality research software is essential for modern scientific inquiry. Many computational studies rely on complex PDE‑based models, numerical solvers, and parameter estimation methods. Ensuring that these components are implemented correctly and behave reliably is critical for producing trustworthy and reproducible results.
Across disciplines, researchers encounter similar questions:
How can we verify that our software does what it is supposed to do? How do we validate our modeling approaches against data? And how can benchmarks be shared and reused to support transparent and comparable research workflows?
How can we verify that our software does what it is supposed to do? How do we validate our modeling approaches against data? And how can benchmarks be shared and reused to support transparent and comparable research workflows?
About the Workshop
This workshop brings together members of the research‑software community to:
- Assess the current state of verification and validation (V&V) in scientific software
- Identify challenges related to reproducibility, transparency, and workflow execution
- Collect examples of existing benchmarks used across different research domains
- Discuss needs and expectations around testing approaches, CI integration, documentation, and community standards
- Explore what a robust V&V benchmark platform should provide to support trustworthy, comparable, and reusable computational workflows
The session will be informative - featuring an overview of our current developments within the NFDI4ING archetype Betty - and interactive, offering space for discussion, feedback, and shared experiences.
Why Attend?
- Contribute to emerging best practices for verifying and validating research software
- Learn how other scientific communities approach benchmarking and software quality
- Help shape tools designed to support reproducible and trustworthy research workflows
- Connect with researchers facing similar methodological and software‑quality challenges
We welcome your participation — and invite anyone interested in research‑software quality, verification, validation, or benchmarking to join the discussion.
Conference information
Registration
Registration for this event is currently open.