Collaborative Benchmarking Rule-Reasoners with B-Runner
Résumé
Conductingexperimentalanalysisonrulereasonersisamain- stream task for validating novel algorithms and systems. Nevertheless, providing robust, verifiable, and reproducible experiments can still raise a sensible challenge. This paper introduces B-Runner, an open library for collaborative benchmarking focusing on the deployment of extended tests for knowledge and rule-based systems with low cost and high robustness. B-Runner reduces the benchmarking setup time while guaranteeing ex- periment repeatability. Also, it improves the scrutability of experimental protocols thereby enhancing the fairness of system comparisons.
Domaines
Informatique [cs]| Origine | Fichiers produits par l'(les) auteur(s) |
|---|