AI & ML
Falcons: Pushing the Speed-Ratio Limits of Lossy Compression for Parallel Scientific Applications
arXiv cs.DC0 views
arXiv:2610.41209v1 Announce Type: new Abstract: The extreme volume of scientific data has become a critical challenge for modern exa-scale scientific computing applications, and error-bounded lossy compression remains indispensable for scientific data management due to its high data reduction rate and controllable data fidelity. However, to ensure sufficient data reduction, existing compressors incur prohibitive computational overheads in real-world parallel scientific computing applications. To overcome the performance bottlenecks of error-bounded lossy compression, we present \textbf{Falcons}, a broadly deployable error-bounded lossy compressor that simultaneously achieves \textbf{high compression ratios with ultra-fast throughput, minimizing the overhead in parallel scientific applications}. Falcons integrates three key designs: memory-regularized interpolation with SIMD (Single Instruction Multiple Data) vectorization, distribution-adaptive lossless coding, and application-oriented optimizations for multiple parallelization schemes. Across our evaluations on cutting-edge supercomputers, Falcons clearly outperforms state-of-the-art compressors, simultaneously achieving up to 29\% compression ratio improvement and 255\% throughput improvement. In case studies of real-world applications, Falcons accelerates large-scale parallel data I/O and remote transfer by up to 44.6\% and 51.5\%, and provides 1.55$\times$ end-to-end speedup for the full WRF (Weather Research \& Forecasting) application workflow.
Source:https://arxiv.org/abs/2610.41209PreviousResource Locks and Fast Unlock for Shared Balances in Certificate-Based Payment SystemsNextAuditFL: A Contract-Backed Clearing Layer for Open Federated Learning
Related posts
bisect2-1794189782819-11
0dev.to GitHub
画質が上がるほど、「片眼ごとの設計」が効いてくる — SteamVRベータ更新と両眼視トレーニング
0dev.to News
OpenAI Posted 722 Math Papers. Who Checks the Checker?
0dev.to News
Florida Layoffs November 2026: WARN Numbers Explained
0dev.to News
The Build Passed. The JSON Didn’t: Testing .NET Serialization After Obfuscation
0dev.to C#
Guia Pratico: Como Baixar Foto do Instagram em 4K e Slides do TikTok (No Watermark & MP3 Audio #3C5)
0dev.to Tutorial