Rule-based systems for procedural generation of complex environments such as interiors, cities, and landscapes have been around for a while. Here is a novel data-driven approach to not only learn how objects interact with each other in order to be able to produce new arrangements but also perform conversion of 2D floor plans to 3D…Read More
Tag: modelling
Mesoscopic Facial Geometry Inference Using Deep Neural Networks
We present a learning-based approach for synthesizing facial geometry at medium and fine scales from diffusely-lit facial texture maps. When applied to an image sequence, the synthesized detail is temporally coherent. Unlike current state-of-the-art methods, which assume ”dark is deep”, our model is trained with measured facial detail collected using polarized gradient illumination in a…Read More
High-Fidelity Facial Reflectance and Geometry Inference From an Unconstrained Image
We present a deep learning-based technique to infer high-quality facial reflectance and geometry given a single unconstrained image of the sub- ject, which may contain partial occlusions and arbitrary illumination conditions. The reconstructed high-resolution textures, which are generated in only a few seconds, include high-resolution skin surface reflectance maps, representing both the diffuse and specular…Read More
Learning Category-Specific Mesh Reconstruction from Image Collections
Some truly remarkable results given the dataset from which this model was trained. Code on github will be available in the future. We present a learning framework for recovering the 3D shape, camera, and texture of an object from a single image. The shape is represented as a deformable 3D mesh model of an object…Read More
Interactive Example-Based Terrain Authoring with Conditional Generative Adversarial Networks
This is a really great example of not only how data-driven tools of the future might help enhance the creative process but also of how a machine learning problem can be broken down into smaller sub-models in order to aid interactivity and provide greater control. Authoring virtual terrains presents a challenge and there is a…Read More