Of course it’s not all fluid simulations, high-resolution generative models, and real-time mocap. Sometimes you just need a good solution to a simple problem. ColorCheckers are reference standards that professional photographers and filmmakers use to ensure predictable results under every lighting condition. The objective of this work is to propose a new fast and robust…Read More
Tag: 2d
Peeking Behind Objects: Layered Depth Prediction from a Single Image
Here’s a nice approach to depth estimation which combines in-painting to allow simulation of slight camera moves from just a single image. While conventional depth estimation can infer the geometry of a scene from a single RGB image, it fails to estimate scene regions that are occluded by foreground objects. This limits the use of…Read More
Temporally Coherent Video Harmonization Using Adversarial Networks
A over B plus magic equals…..? Compositing is one of the most important editing operations for images and videos. The process of improving the realism of composite results is often called harmonization. Previous approaches for harmonization mainly focus on images. In this work, we take one step further to attack the problem of video harmonization….Read More
Joint Learning of Intrinsic Images and Semantic Segmentation
We’ve previously covered both semantic segmentation and intrinsic image decomposition. Here we see a novel proposal to combine the two tasks under the premise that knowledge of one can assist the other. Models and datasets are coming soon. Semantic segmentation of outdoor scenes is problematic when there are variations in imaging conditions. It is known…Read More
SIGGRAPH 2018
SIGGRAPH 2018 is just around the corner. Starting on Sunday August 12th in Vancouver, British Columbia and ending Thursday August 16th it’s looking like this is going to be a bumper year for presentations which cover applications of deep learning and demonstrate some truly stunning results. The full schedule is here, yet you can see…Read More
Texture Mixing by Interpolating Deep Statistics via Gaussian Models
Here’s an interesting technique which may provide new ways in which to generate and synthesize textures from examples via interpolation and style transfer. Recently, enthusiastic studies have devoted to texture synthesis using deep neural networks, because these networks excel at handling complex patterns in images. In these models, second-order statistics, such as Gram matrix, are…Read More
New kids on the block
Over the last few months we’ve seen two new companies formed around the concept of providing tools based on deep learning for visual effects. The positive responses they’ve received so far already along with the multitude of opportunities in the field are sure to mean that they will be the first of many. Kognat aims…Read More
Direction-aware Spatial Context Features for Shadow Detection and Removal
Shadow detection and shadow removal are fundamental and challenging tasks, requiring an understanding of the global image semantics. This paper presents a novel deep neural network design for shadow detection and removal by analyzing the image context in a direction-aware manner. To achieve this, we first formulate the direction-aware attention mechanism in a spatial recurrent…Read More
Learning to See in the Dark
Imaging in low light is challenging due to low photon count and low SNR. Short-exposure images suffer from noise, while long exposure can induce blur and is often impractical. A variety of denoising, deblurring, and enhancement techniques have been proposed, but their effectiveness is limited in extreme conditions, such as video-rate imaging at night. To…Read More
From Faces to Outdoor Light Probes
Image-based lighting has allowed the creation of photo-realistic computer-generated content. However, it requires the accurate capture of the illumination conditions, a task neither easy nor intuitive, especially to the average digital photography enthusiast. This paper presents an approach to directly estimate an HDR light probe from a single LDR photograph, shot outdoors with a consumer…Read More