AI & ML
Auditing LLM Pseudo-Label Distillation for Review Informativeness at E-Commerce Scale
arXiv cs.IR0 views
arXiv:2611.13797v1 Announce Type: new Abstract: We study hard-label distillation from Gemini 3.1 Flash-Lite to compact encoders on 5.34 million Turkish marketplace reviews. A strict new-SKU temporal test measures teacher fidelity; a separate, teacher-label-blind audit by one company annotator measures editorial agreement. An H3 category prefix slightly improves teacher fidelity on the full new-SKU test. On the 16,000-review chronological audit subset, it instead reduces agreement with both Gemini and the annotator, with a clearer paired difference for CORN than for cross entropy. Thus the context effect depends on the evaluation population, and teacher fidelity alone does not establish editorial alignment. Under the measured offline configurations, a single-L4 student pipeline processes reviews 50.2 times faster than the teacher pipeline.
Source:https://arxiv.org/abs/2611.13797PreviousExploiting Feature-invariant Scaling Laws for Efficient A/B Experimentation in Recommendation SystemsNextControlled Knowledge Engineering for Taxonomy Induction with Tool-Grounded LLM Agents and Runtime-Adaptive Policies
Related posts
A useful vocal isolate is not a karaoke track
0dev.to AI
How to Pick the Right AI Development Partner for Your Business
0dev.to AI
DeepSeek R1 vs OpenAI o1-preview: Reasoning Accuracy, Token Economics, and Self-Hosting TCO
0dev.to AI

After the AI Writes, Part 1: Don't Carry Someone Else's Work Into Your Commit
0dev.to AI
My deploy script got my site removed from Bing and ChatGPT search. Seven words got a human to fix it.
0dev.to WebDev
Diluting Poisoned Data Made the Backdoor Stronger: Anthropic's 'Homeopathic Learning' Explained
0dev.to Security