AI & ML
FaceRiff: Data-Efficient Unified Text-to-3D Face Asset Synthesis via Geometric Conditioning
arXiv cs.GR0 views
arXiv:2611.21867v1 Announce Type: cross Abstract: High-resolution facial datasets with consistent UV-mapped geometry, albedo, and physically based displacement are scarce, yet such assets are essential for photorealistic digital-human rendering. Existing 3D face generation methods are often slow, single-modality, or require large specialized datasets. Meanwhile, large image diffusion models encode strong facial priors but do not natively produce lighting-independent textures, pore-scale displacement, or UV-aligned geometry. We present FaceRiff, a unified, data- and parameter-efficient framework for generating complete 3D face assets (mesh, albedo, and displacement) directly from text in a shared UV space. FaceRiff adapts a pretrained SDXL backbone with task-specific LoRA adapters and uses UV normal maps as geometric conditioning: per-instance normals guide albedo and displacement synthesis, while a dataset-mean normal provides a canonical spatial anchor for mesh generation. Using only 2,049 scans from approximately 350 identities and training on a single GPU, FaceRiff updates less than 3% of the backbone parameters per task and produces render-ready 3D face assets without per-instance optimization. Compared with FaceG2E and DreamFace, FaceRiff produces greater per-prompt diversity while preserving prompt alignment and fixed-topology UV consistency, and additionally generates lighting-independent albedo suitable for PBR relighting and pore-scale displacement absent from prior text-driven baselines. A blind study with 45 industry professionals shows that FaceRiff achieves substantially higher perceived realism than DreamFace, approaching that of real captures. Overall, FaceRiff demonstrates that pretrained diffusion priors can be adapted to unified 3D face asset synthesis under limited data.
Source:https://arxiv.org/abs/2611.21867PreviousYour Vision Model Works in the Lab. Here's Why It Breaks on the Factory FloorNextDomain-Tuned Diffusion Super-Resolution for 4K Facial Asset Maps
Related posts
New discovery reveals what may be holding back room-temperature superconductors
0Science Daily Tech
NASA pushes Mars helicopter blades beyond the speed of sound
0Science Daily Tech
How to make AI data centres more sustainable
0Nature News

The UK and some other countries don’t get more Siri AI usage with iCloud+
09to5Mac

MacPaw’s Moonlock comes to iPhone, helping users detect potential scams
09to5Mac

Six new Aqara smart lights with Apple Home support and ‘spatial intelligence’
09to5Mac