AI & ML
CausalGrade: Evidence-Guided Causal Graph Scoring with Jev
arXiv stat.ML0 views
arXiv:2610.40692v1 Announce Type: new Abstract: Evaluating the structural quality of candidate causal graphs when the true causal structure is unknown is an important problem in applying causal discovery results. This paper proposes CausalGrade, a causal graph scoring method based on the probabilistic judgment model Jev. The method jointly provides Jev with evidence of association, conditional dependence, and directionality from observational data and edge probabilities produced by the causal discovery foundation model CDFM. Jev produces probabilistic judgments about direct causal edges, and a graph-level score is obtained by measuring the agreement between the adjacency structure of the graph under evaluation and these edge-level judgments. Across 300 synthetic datasets, the score exhibits a relatively strong negative correlation with structural error in all 20 combinations of four causal discovery algorithms and five variable counts, indicating that higher scores generally correspond to smaller structural errors. In 500 synthetic graph selection tasks, CausalGrade achieves a best-candidate hit rate of 54.4\%, exceeding the 48.4\% achieved by the Self-Compatibility metric \(\kappa_G\), further supporting its ability to discriminate the structural quality of graphs under evaluation.
Source:https://arxiv.org/abs/2610.40692PreviousVLA Policies Do Not Know When Not to Act: Unintended Task Execution and Start SuppressionNextINLA for Adaptive UAV Sampling of Radio Environment Maps in IoT Networks: Prior Width Governs Accuracy and Calibration
Related posts
Language models generate maximally activating examples for any residual direction
0dev.to

9 Timeouts in Claude Code, Codex and Gemini CLI That Cut Long Test Runs Short
0dev.to
Where JLPT learners lose points: 36,263 first answers by section
0dev.to
Stripe Billing or Chargebee: The Renewal Decides
0dev.to
Layer Rename & Cleanup: batch rename and delete empty layers in Aseprite (free Lite)
0dev.to

Open-Weight LLM vs Hosted API: What Self-Hosting Gives You That an API Can’t
0dev.to