Collaborative Benchmarking Rule-Reasoners with B-Runner
Abstract
Conductingexperimentalanalysisonrulereasonersisamain- stream task for validating novel algorithms and systems. Nevertheless, providing robust, verifiable, and reproducible experiments can still raise a sensible challenge. This paper introduces B-Runner, an open library for collaborative benchmarking focusing on the deployment of extended tests for knowledge and rule-based systems with low cost and high robustness. B-Runner reduces the benchmarking setup time while guaranteeing ex- periment repeatability. Also, it improves the scrutability of experimental protocols thereby enhancing the fairness of system comparisons.
| Origin | Files produced by the author(s) |
|---|