AI & ML
OmniFaceRig: Fully Automatic Inner-Mouth-Aware Face Rigging Across Diverse 3D Character Topologies
arXiv cs.GR0 views
arXiv:2606.08043v3 Announce Type: replace Abstract: Facial rigging--creating Facial Action Coding System (FACS) blendshapes and inner-mouth geometry (teeth, gums, and tongue)--remains a major bottleneck in 3D character production. We present OmniFaceRig, a fully automatic end-to-end pipeline that converts a static surface-only 3D character mesh, with no pre-modeled oral cavity, into an inner-mouth-aware FACS rig with up to 155 blendshapes, procedurally fitted teeth, gums, and tongue, and re-packed UV/texture. It supports humans, humanoids, and long- and short-muzzled animals with no manual landmarks, user-provided templates, or per-asset setup. OmniFaceRig combines a hybrid vision-language and computer vision riggability checker, a four-model face segmentation ensemble, keypoint-driven template registration, procedural inner-mouth construction, and collision-aware blendshape transfer. For non-human characters, it selects topology-specific templates with a nose-landmark-free design and uses as-rigid-as-possible deformation with signed-distance-field constraints to reduce teeth-face intersections. We also introduce Omni-Bench, an open-source benchmark of more than 1,000 biped 3D characters rigged with FACS blendshapes and inner-mouth geometry, spanning humans, humanoids, cats, dogs, and other animals. Experiments show high rigging success, nearly complete face detection recall, low inner-mouth penetration, and 20-30 s end-to-end latency per asset on a single A100 GPU.
Source:https://arxiv.org/abs/2606.08043PreviousHierarchical Incremental Beta Splatting for Online ReconstructionNextLSD-3D: Large-Scale 3D Driving Scene Generation with Geometry Grounding
Related posts

Warhammer 40,000: Dawn of War 4 creative director explains how core 40K tabletop features like ‘Armor of Contempt’ were adapted to the RTS — ‘It’s not the same mechanic, but it does kind of the same t
0TechRadar

'The progress is real': Deloitte report claims some firms are finally seeing return on AI investment — but still lack insight into what actually works
0TechRadar

Hideo Kojima says AI can’t replace human craftsmanship in video games
0TechRadar

Rogue AI tasked with renumbering pages accidentally deletes law professor's entire syllabus, one year of lecture notes
0Tom's Hardware

Nvidia wants to repurpose over 130 old telco buildings as tiny data centers, report claims
0Tom's Hardware

Apple confirms $7.5 billion bond sale following strong investor demand
09to5Mac