Collaborative Benchmarking Rule-Reasoners with B-Runner - LIRMM - Laboratoire d’Informatique, de Robotique et de Microélectronique de Montpellier Access content directly
Conference Papers Year : 2024

Collaborative Benchmarking Rule-Reasoners with B-Runner

Abstract

Conductingexperimentalanalysisonrulereasonersisamain- stream task for validating novel algorithms and systems. Nevertheless, providing robust, verifiable, and reproducible experiments can still raise a sensible challenge. This paper introduces B-Runner, an open library for collaborative benchmarking focusing on the deployment of extended tests for knowledge and rule-based systems with low cost and high robustness. B-Runner reduces the benchmarking setup time while guaranteeing ex- periment repeatability. Also, it improves the scrutability of experimental protocols thereby enhancing the fairness of system comparisons.
Fichier principal
Vignette du fichier
brunner_RuleML24_CAMERA_READY (1).pdf (2.05 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

lirmm-04670543 , version 1 (12-08-2024)

Identifiers

  • HAL Id : lirmm-04670543 , version 1

Cite

Federico Ulliana, Pierre Bisquert, Akira Charoensit, Renaud Colin, Florent Tornil, et al.. Collaborative Benchmarking Rule-Reasoners with B-Runner. RuleML + RR 2024 - 8th International Joint Conference on Rules and Reasoning, Sep 2024, Bucarest, Romania. ⟨lirmm-04670543⟩
0 View
0 Download

Share

Gmail Mastodon Facebook X LinkedIn More