Backend
Action-BED: Task-Driven Bayesian Experimental Design with Singly Intractable Objectives
arXiv stat.ML0 views
arXiv:2606.23662v2 Announce Type: replace Abstract: Bayesian experimental design (BED) has traditionally been based on maximising expected uncertainty reductions from prior to posterior. A major shortfall of this approach is that it leads to doubly intractable objectives that are difficult to optimise, while customising them to particular downstream tasks of interest can also be difficult. Following first principles decision theory, we demonstrate that BED can alternatively be formulated in terms of an expected future loss (EFL) on downstream actions, providing a simple and naturally task-driven framework. Critically, we then show that all such EFLs can be rearranged into singly intractable objectives that can be jointly optimised with respect to both the design policy and a downstream action policy using stochastic gradients, an approach we refer to as ACTION-BED. This formulation further sidesteps the need for any explicit posterior or marginal likelihood estimation and is naturally implicit, requiring only the ability to sample from the joint model over model parameters and data, and evaluate the downstream loss function. It thus allows design policies to be learned more effectively, efficiently, and simply than existing methods, while providing easy customisation to different downstream tasks and losses.
Source:https://arxiv.org/abs/2606.23662PreviousOptimizing Computational-Statistical Runtime for Wasserstein Distance EstimationNextSGD Provably Prioritizes a Shortcut Spurious Feature in the XOR Model
Related posts
# Meshy T2: Native 3D Mesh Generation with Flow Matching
0dev.to Machine Learning
AWS Launches Bedrock Knowledge Bases Multi-Modal RAG: Native Embedding Ingestion for Graphs, Tables, and Charts
0dev.to Machine Learning
Export Your VAT Check History as a CSV for an Audit
0dev.to Tutorial
How to implement async Python that actually works in production
0dev.to Tutorial
The TCM Graduate at Majuqiao: A Day-Labor Story Followed by Feng Ge
0dev.to Career
Your Mentee Wants to Move Into Product Management
0dev.to Career