20 results for “Experimentation framework”
CS papers onlyHybrid search: Keyword + semantic, ranked by combined score.ⓘ
Want pure semantic search? Try claim verification →
This paper describes the use of a trie data structure to enhance experiment efficiency in comparative pipeline experiments for cascading retrieval pipelines using PyTerrier, observing a 26% reduction…
Yi Gao, Ziyuan Zhang, Xing Hu, Xiaohu Yang +1 more
This paper presents IntentTester, a multi-agent framework for intent-driven test reuse across libraries and languages.
CausalForge is a framework for automated theoretical research in causal inference using Lean proof assistant, including a foundational library and a self-improving agent.
This paper proposes a new formulation of Bayesian experimental design (BED) based on expected future loss (EFL) on downstream actions, which can be optimized using stochastic gradients and does not re…
The paper introduces ARMeta, an LLM-based multi-agent system that automates metamorphic testing for REST APIs documented with OpenAPI, demonstrating its ability to find complementary bugs compared to…
Ray A. O. Sinurat, Yuyang Huang, Nanqinqin Li, Mark Powers +3 more
The authors introduce StorRep, a set of extensible and reproducible storage experiment artifacts.
This paper presents a software ecosystem enabling consistent development environments for running workflows across diverse hardware platforms.
The paper proposes an architecture for sequential statistical procedures that can be used in various applications.
This survey summarizes Conditional Independence (CI) testing methods for constraint-based causal discovery, focusing on assumptions, robustness, and scalability in high-dimensional and mixed-type sett…
Yi Cao, Liaoyaqi Wang, Jieneng Chen, Benjamin Van Durme +2 more
This paper introduces ARIA, a causal-aware framework for materials discovery that mitigates contextual tunneling in Large Language Models.
This paper proposes a change-impact-analysis tool that fuses semantic and structural signals to identify impacted artifacts.
Jiatao Ge, Yanzhou Mu, Yinglong Zou, Yibo Hu +2 more
This paper introduces FlowMuT, a mutation-based testing method for deep learning frameworks that captures runtime tensor states and operator input requirements to identify bugs.
Aditya Kumar, Zhihan Lei, Jerry Yan, Joshua W. Momo +5 more
The paper proposes a modular agent framework and novel learning methods to design and optimize practical, cost-effective, and controllable LLM-based agentic systems.
Scentree is an open-source Python package for constructing scenario trees for multistage stochastic programming from historical data.
Rufeng Chen, Hengcheng Zhu, Wuqi Zhang, Zixu Zhou +1 more
This paper evaluates the effectiveness of test cases in IoT software and identifies challenges in testing IoT software.
The paper demonstrates that tool-augmented agentic AI can learn from prior field experiment data to automatically generate superior, domain-specific interventions, transforming one-shot A/B testing in…
Ashkan Pirmani, Ilse Vermeulen, Goran Vinterhalter, Lotte Geys +6 more
FLKit is an open, community-maintained onboarding toolkit for federated learning that provides a structured place for multidisciplinary teams to begin federated learning projects.