Collaborative Benchmarking Rule-Reasoners with B-Runner - LIRMM - Laboratoire d’Informatique, de Robotique et de Microélectronique de Montpellier
Conference Papers Year : 2024

Collaborative Benchmarking Rule-Reasoners with B-Runner

Abstract

Conductingexperimentalanalysisonrulereasonersisamain- stream task for validating novel algorithms and systems. Nevertheless, providing robust, verifiable, and reproducible experiments can still raise a sensible challenge. This paper introduces B-Runner, an open library for collaborative benchmarking focusing on the deployment of extended tests for knowledge and rule-based systems with low cost and high robustness. B-Runner reduces the benchmarking setup time while guaranteeing ex- periment repeatability. Also, it improves the scrutability of experimental protocols thereby enhancing the fairness of system comparisons.
Fichier principal
Vignette du fichier
brunner_RuleML24_CAMERA_READY (1).pdf (2.05 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

lirmm-04670543 , version 1 (12-08-2024)

Identifiers

Cite

Federico Ulliana, Pierre Bisquert, Akira Charoensit, Renaud Colin, Florent Tornil, et al.. Collaborative Benchmarking Rule-Reasoners with B-Runner. RuleML+RR 2024 - 8th International Joint Conference on Rules and Reasoning, Sep 2024, Bucarest, Romania. pp.21-31, ⟨10.1007/978-3-031-72407-7_3⟩. ⟨lirmm-04670543⟩
72 View
15 Download

Altmetric

Share

More