Machine Learning Mask Removal

224 Views
Published
A couple of months back, our Digital Human Group started exploring the idea of using Charlatan (our proprietary neural renderer) to remove face masks on close-up subjects. Our mask removal results were pretty amazing so we decided to go a step further and create a facial performance underneath the mask using only an audio track!

What you see here is still very much a work in progress but it is exciting to see where this technology is going. There is very little manual artist work in this piece and every time you see maskless Doug everything on his face from his eyes to his mouth is synthetic!
Category
CG VFX & Misc