I am a research scientist in visual computing currently working on markerless motion capture. I am currently excited about combining vision with graphics, and did a few recent projects on AR such as automatically putting water tight clothes onto people in pictures.
Last year I got cought up in the personal assistant / chat bot hype and did a project on animating an autonomous 3D conversation avatar.
While I am doing more vision and machine learning now, my original background is graphics, and games. I spent two years in video games before doing a master's in fluid simulation and a ph.d. on character animation.
Students and Collaborators
Dominik Borer, Ph.D. Student on Motion Models for 3D Computer Animation
Jakob Buhmann, Post-Doc on Motion Capture
Prof. Bob Sumner, Supervisor
Christoph Maurhofer, Master's on Poser and Costumes in AR.
Gökcen Cimen, Ph.D. on Character Motion Models for Interaction in AR and VR.
Victor Cornillere, Autonomous 3D Avatar Chat Bots.
Dominic Lutz, 3D animator on chat bot avatars.
Stelian Coros, Prof. on Synthetising Quadruped Motion.
Ye Yuan, Synthetising Quadruped Motion.
Simone Guggiari, Bachelor's on Interacting with a self-Balancing Character in AR and VR.
Dominik Borer, Master's on Trajectory Optimization for Simulated Character Control
Loïc Ciccone, Ph.D. on Character Animation Authoring.
Renzo Roth, Master's on Animated Music Band.
Marcel Lüdi, Master's on Deep Learning for Character Animation.
Remi Ronfard, Ph.D. co-advisor at INRIA.
Marie-Paule Cani, Ph.D. co-advisor at INRIA.
Richard Egli, Master's advisor at Sherbrooke U.
Publications and Projects
Pose and shape estimation from images and video
Marker-less motion capture for virtual production (multi-view and single view).
We are pushing the limits of pose and shape estimation from video data, leveraging 3D motion capture and special sauces.
Animal pose estimation from a single image.
There are no large datasets of animal poses that are labelled.
We are working on methods to learn from other sources of data.
Control of Digital Avatars, Parametric Character Motion
Authoring Character Motion