SfM-Net: Learning of Structure and Motion from Video — mentioned by Mathnerd314

Tue, 05 Nov 2019 06:30:07 GMT

It seems to do motion transfer alright but the legs in the dancing video get warped instead of moving so there's some frames where they have triangle legs vanishing at the knee. https://youtu.be/8AZBuyEuDqc?t=34 Maybe if you scale up the training data the model is going to learn some better warping, but I think to really get better photorealism there has to be a 3D component, some kind of distance/movement estimation like in https://arxiv.org/pdf/1704.07804.pdf and a shape inference/transfer step.

Paper and discussion history. A mention is not an endorsement.

SfM-Net: Learning of Structure and Motion from Video — mentioned by osdf

Fri, 28 Apr 2017 07:45:49 GMT

There seem to be some nice developments into this direction recently? Something like the SfMNet (https://arxiv.org/abs/1704.07804) or the Correlation Filter Net (http://www.robots.ox.ac.uk/~luca/cfnet.html) for tracking.

Paper and discussion history. A mention is not an endorsement.

SfM-Net: Learning of Structure and Motion from Video · HackerPapers discussions

SfM-Net: Learning of Structure and Motion from Video — mentioned by Mathnerd314

SfM-Net: Learning of Structure and Motion from Video — mentioned by osdf