DeepWarp: Changing the Gaze of an Image

So you’ve taken what would be the perfect group picture, except that Uncle Roy is staring at your sister-in-law’s bosom. A new technology called DeepWarp can change that part without making Roy look unnatural.

In this work, we consider the task of generating highly-realistic images of a given face with a redirected gaze. We treat this problem as a specific instance of conditional image generation, and suggest a new deep architecture that can handle this task very well as revealed by numerical comparison with prior art and a user study. Our deep architecture performs coarse-to-fine warping with an additional intensity correction of individual pixels. All these operations are performed in a feed-forward manner, and the parameters associated with different operations are learned jointly in the end-to-end fashion. After learning, the resulting neural network can synthesize images with manipulated gaze, while the redirection angle can be selected arbitrarily from a certain range and provided as an input to the network.

I didn’t understand any of that, but that’s not what’s important. What’s really interesting are the examples given on the project page. You can pull up any of 16 pictures of faces and move their eyes around. They can look you up and down, they can shift left and right right, or they can roll around. It’s a shame they can’t move independently of each other, but what you will see is creepy and funny enough as it is. -via Metafilter


Comments (0)

Baby Sleep Sacks -- in the early 80's my mom bought the proto-proto-type of the Snuggie/Slanket/Forever Lazy. It looked like a sleeping bag, but it snapped up the front. You got in, and the top inside corners could fold down over your shoulders and snap at the center front, creating two sleeves. Or, you could unsnap it all the way and use it like a regular blanket. Awesome!
Abusive comment hidden. (Show it anyway.)
I love the "back door."

I used to have something similar to this about 10 years ago but it was just called a "sac" or something. Mostly wore it in the winter or when I was sick, it was warm but I wouldn't ever leave the house
Abusive comment hidden. (Show it anyway.)
Where do people get off wearing something warm and comfortable in the privacy of their own homes? They should always dress as if some anonymous web surfer is watching and judging them.
Abusive comment hidden. (Show it anyway.)
Login to comment.
Email This Post to a Friend
"DeepWarp: Changing the Gaze of an Image"

Separate multiple emails with a comma. Limit 5.

 

Success! Your email has been sent!

close window
X

This website uses cookies.

This website uses cookies to improve user experience. By using this website you consent to all cookies in accordance with our Privacy Policy.

I agree
 
Learn More