Backend
DECODE: Decomposable Environments for COntrolled Sequential-Decision Evaluation
arXiv stat.ML0 views
arXiv:2611.18367v1 Announce Type: cross Abstract: When a sequential decision system falls short of an optimum, its score does not reveal which modifications would improve its decisions. DECODE is a benchmark for testing such modifications through controlled experiments on planning and available information. Its consumer-credit collections generator provides five partially observed environments that share known dynamics matrices and vary a memory parameter and process noise. The experiments change selected inputs or planning rules while keeping the rest of the solver fixed. Each comparison specifies the solver's state inputs, response inputs and planning horizon. On the deterministic base environment, which was selected for a large gap between six-month and one-month planning with the hidden state, extending planning from one to six months increases the scores of two gradient-boosted solvers by 15 to 17 percentage points of the exact optimum, computed with the hidden state and borrower traits. Even at this horizon, the best graded solver, whose repayment response is fitted on logs, remains 15.6 points below that optimum. In a specified intervention sequence, three changes to its state inputs and their evaluation during search lower its score by 6.3 points, and replacing its fitted repayment model with the true response, evaluated with hidden borrower traits, then raises it by 15.6, a net recovery of nine of those points. Because the intermediate effects are conditional on the repayment model and the order of the changes, they do not uniquely assign the gap to separate causes. Within these limits, DECODE makes hypotheses about solver performance testable through specified interventions under known dynamics and explicit information conditions.
Source:https://arxiv.org/abs/2611.18367PreviousSmall Is Not Dead: Distance-Aware Cluster Revival for e-meansNextDynamic bigraphical Mat\'ern--Whittle processes: learning dependence graphs among spatial-temporal fields
Related posts
Services
0dev.to
How HTTPS Actually Works: Following One Request from Browser to Server
0dev.to
NonAbbocco, la mia estensione anti-phishing open source, integra ora un secondo parere IA (Liquid AI 600M) locale via WebGPU, zero server. Affianca le regole senza sostituirle: resta un parere, non il
0dev.to
What Is a Face Embedding? How Facial Recognition Turns Faces Into Vectors
0dev.to
NASAspace hackathon
0dev.to
How Much Are Claude Code, Codex & OpenCode Actually Costing You? (Zero-Dependency Local Spend Auditor)
0dev.to