skip to content

End-to-end learning of CNN features in in discrete optimization models for motion and stereo

Presented by: 
Thomas Pock
Thursday 7th September 2017 - 09:50 to 10:40
INI Seminar Room 1
Co-authors: Patrick Knöbelreiter (Graz University of Technology), Alexander Shekhovtsov (Technical University of Prague), Gottfried Munda (Graz University of Technology), Christian Reinbacher (Amazon)

For many years, discrete optimization models such as conditional random fields (CRFs) have defined the state-of-the-art for classical correspondence problems such as motion and stereo. One of the most important ingredients in those models is the choice of the feature transform that is used to compute the similarity between images patches. For a long time, hand crafted features such as the celebrated scale invariant feature transform (SIFT) defined the state-of-the-art. Triggered by the recent success of convolutional neural networks (CNNs), it is quite natural to learn such a feature transform from data. In this talk, I will show how to efficiently learn such CNN features from data using an end-to-end learning approach. It turns out that our learned models yields state-of-the-art results on a number of established benchmark databases.

Related Links
The video for this talk should appear here if JavaScript is enabled.
If it doesn't, something may have gone wrong with our embedded player.
We'll get it fixed as soon as possible.
University of Cambridge Research Councils UK
    Clay Mathematics Institute London Mathematical Society NM Rothschild and Sons