Open Source
Quasipolynomial-Time Planning for Decodable POMDPs
arXiv stat.ML0 views
arXiv:2611.09778v1 Announce Type: cross Abstract: We study planning for finite-horizon partially observable Markov decision processes (POMDPs) with finite state, action, and observation spaces. Both exact and approximate planning are known to be computationally hard in this setting, so prior work has explored natural assumptions that make planning easier. Recent work [Golowich et al., 2022] gave quasipolynomial-time approximate planning algorithms for observable POMDPs. These are POMDPs whose observation channels satisfy an $\ell_1$-observability condition, but notably, no assumptions are required on the transition dynamics. In a similar vein, for every fixed $\rho>0$, we give quasipolynomial-time approximate planning algorithms for $\rho$-decodable POMDPs. We show that decodability is implied by both $\ell_1$- and $\ell_2$-observability and is strictly weaker than observability. Moreover, we show that the optimal decodability constant can be computed in polynomial time, whereas computing the optimal $\ell_1$-observability constant is NP-hard in the worst case. We also show that the fast filter-forgetting guarantee underlying the approach of [Golowich et al., 2022] does not extend directly from $\ell_1$-observability to constant $\ell_2$-observability. Thus, decodability is an easy-to-check, unifying assumption under which quasipolynomial-time approximate planning for POMDPs is possible.
Source:https://arxiv.org/abs/2611.09778PreviousOnline Causal Configuration for Networked Systems via Doubly Robust Steady-State LearningNextIdentifying Drift, Diffusion, and Causal Structure from Temporal Snapshots
Related posts
Texpresso: A True Wysiwyg System for Open-Source LaTeX Design
0Hacker News New
Show HN: I abandoned my AVX2 128-bit fixed-point library
0Hacker News Show
Applying for Government Benefits as a Freelancer: What Income Documents Actually Work
0dev.to Career
Passing Vendor Onboarding: Financial Documents When Big Companies Hire You
0dev.to Career

A longer fin eventually stops helping: checking tanh(mL) saturation with 10 FEM cases
0dev.to Beginners
Stopwatch: How I Built a Sub-Second Transit Schedule Lookup for 123 Systems from Open GTFS Data
0dev.to OpenSource