Collaborative Benchmarking Rule-Reasoners with B-Runner - LIRMM - Laboratoire d’Informatique, de Robotique et de Microélectronique de Montpellier Access content directly
Conference Papers Year : 2024

Collaborative Benchmarking Rule-Reasoners with B-Runner

Abstract

Conducting experimental analysis on rule reasoners is a mainstream task for validating novel algorithms and systems. Nevertheless, providing robust, veriable, and reproducible experiments can still raise a sensible challenge. We propose to demonstrate B-Runner, an open library for collaborative benchmarking focusing on the deployment of articulate tests for knowledge and rule-based systems with low cost and high robustness. B-Runner reduces the benchmarking setup time while guaranteeing experiment repeatability. At the same time, it improves the scrutability of experimental protocols thereby enhancing their robustness as well as fairness of system comparisons. This demonstration proposes to show- case the use of the tool for systematically testing a number of systems as well as to introduce its architecture and its extensibility to novel tools and experimental protocols.
Fichier principal
Vignette du fichier
brunner_bda.pdf (3.5 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

lirmm-04646842 , version 1 (12-07-2024)
lirmm-04646842 , version 2 (12-08-2024)

Identifiers

  • HAL Id : lirmm-04646842 , version 1

Cite

Federico Ulliana, Pierre Bisquert, Akira Charoensit, Renaud Colin, Florent Tornil, et al.. Collaborative Benchmarking Rule-Reasoners with B-Runner. BDA 2024 - 40e Conférence sur la Gestion de Données – Principes, Technologies et Applications, Oct 2024, Orleans, France. ⟨lirmm-04646842v1⟩
157 View
28 Download

Share

Gmail Mastodon Facebook X LinkedIn More