Hubert Shum
Edmond S.L. Ho
ABSTRACT
With the advancement of motion tracking hardware such as the Microsoft Kinect, synthesizing human-like characters with real-time captured movements becomes increasingly important. Traditional kinematics and dynamics approaches perform sub-optimally when the captured motion is noisy or even incomplete. In this paper, we proposed a unified framework to control physically simulated characters with live captured motion from Kinect. Our framework can synthesize any posture in a physical environment using external forces and torques computed by a PD controller. The major problem of Kinect is the incompleteness of the captured posture, with some degree of freedom (DOF) missing due to occlusions and noises. We propose to search for a best matched posture from a motion database constructed in a dimensionality reduced space, and substitute the missing DOF to the live captured data. Experimental results show that our method can synthesize realistic character movements from noisy captured motion. The proposed algorithm is computationally efficient and can be applied to a wide variety of interactive virtual reality applications such as motion-based gaming, rehabilitation and sport training.
Supplemental Material
- Y. Abe and J. Popović. Interactive animation of dynamic manipulation. In SCA '06: Proceedings of the 2006 ACM SIGGRAPH/Eurographics symposium on Computer animation, pages 195--204, Aire-la-Ville, Switzerland, Switzerland, 2006. Eurographics Association. Google Scholar
Digital Library
- H. G. Armstrong. Anthropometry and mass distribution for human analogues. volume 1. military male aviators, 1988.Google Scholar
- J. Chai and J. K. Hodgins. Performance animation from low-dimensional control signals. In SIGGRAPH '05: ACM SIGGRAPH 2005 Papers, pages 686--696, New York, NY, USA, 2005. ACM. Google ScholarDigital Library
- K.-J. Choi and H.-S. Ko. On-line motion retargetting. In Proceedings of the 7th Pacific Conference on Computer Graphics and Applications, PG '99, pages 32--, Washington, DC, USA, 1999. IEEE Computer Society. Google ScholarDigital Library
- S. Coros, P. Beaudoin, and M. van de Panne. Generalized biped walking control. ACM Trans. Graph., 29(4):130:1--130:9, July 2010. Google ScholarDigital Library
- M. Gleicher. Retargetting motion to new characters. In Proceedings of the 25th annual conference on Computer graphics and interactive techniques, SIGGRAPH '98, pages 33--42, New York, NY, USA. Google ScholarDigital Library
- J. Hodgins. Biped gait transitions. Robotics and Automation, 1991. Proceedings., 1991 IEEE International Conference on, pages 2092--2097 vol.3, 9--11 Apr 1991.Google ScholarCross Ref
- J. Hodgins and M. Raibert. Adjusting step length for rough terrain locomotion. Robotics and Automation, IEEE Transactions on, (3):289--298, Jun 1991.Google Scholar
- J. K. Hodgins, W. L. Wooten, D. C. Brogan, and J. F. O'Brien. Animating human athletics. In SIGGRAPH '95: Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, pages 71--78, New York, NY, USA, 1995. ACM. Google ScholarDigital Library
- S. Ishigaki, T. White, V. B. Zordan, and C. K. Liu. Performance-based control interface for character animation. ACM Trans. Graph., 28(3):61:1--61:8, July 2009. Google ScholarDigital Library
- L. Kovar, M. Gleicher, and F. H. Pighin. Motion graphs. ACM Trans. Graph., 21(3):473--482, 2002. Google ScholarDigital Library
- J. Lee, J. Chai, P. S. A. Reitsma, J. K. Hodgins, and N. S. Pollard. Interactive control of avatars animated with human motion data. ACM Trans. Graph., 21(3):491--500, 2002. Google ScholarDigital Library
- C. Liu and V. Zordan. Natural user interface for physics-based character animation. In J. Allbeck and P. Faloutsos, editors, Motion in Games, volume 7060 of Lecture Notes in Computer Science, pages 1--14. Springer Berlin Heidelberg, 2011. Google ScholarDigital Library
- H. Liu, X. Wei, J. Chai, I. Ha, and T. Rhee. Realtime human motion control with a small number of inertial sensors. In Symposium on Interactive 3D Graphics and Games, I3D '11, pages 133--140, New York, NY, USA, 2011. ACM. Google ScholarDigital Library
- Microsoft Corporation. Kinect for windows SDK programming guide version 1.5. 2012.Google Scholar
- H. Mitake, K. Asano, T. Aoki, S. Marc, M. Sato, and S. Hasegawa. Physics-driven multi dimensional keyframe animation for artist-directable interactive character. Computer Graphics Forum, 8(2):279--287, 2009.Google ScholarCross Ref
- N. Nguyen, N. Wheatland, D. Brown, B. Parise, C. K. Liu, and V. Zordan. Performance capture with physical interaction. In Proceedings of the 2010 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA '10, pages 189--195, Aire-la-Ville, Switzerland, Switzerland, 2010. Eurographics Association. Google ScholarDigital Library
- R. Playter and M. Raibert. Control of a biped somersault in 3d. Intelligent Robots and Systems, 1992., Proceedings of the 1992 lEEE/RSJ \ International Conference on, 1:582--589, 7--10 Jul 1992.Google ScholarCross Ref
- M. H. Raibert and J. K. Hodgins. Animation of dynamic legged locomotion. SIGGRAPH Comput. Graph., 25(4):349--358, 1991. Google ScholarDigital Library
- A. Safonova, J. K. Hodgins, and N. S. Pollard. Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces. In SIGGRAPH '04: ACM SIGGRAPH 2004 Papers, pages 514--521, New York, NY, USA, 2004. ACM. Google ScholarDigital Library
- H. J. Shin, J. Lee, S. Y. Shin, and M. Gleicher. Computer puppetry: An importance-based approach. ACM Trans. Graph., 20(2):67--94, Apr. 2001. Google ScholarDigital Library
- T. Shiratori and J. K. Hodgins. Accelerometer-based user interfaces for the control of a physically simulated character. In SIGGRAPH Asia '08: ACM SIGGRAPH Asia 2008 papers, pages 1--9, New York, NY, USA, 2008. ACM. Google ScholarDigital Library
- H. P. H. Shum, T. Komura, and S. Takagi. Fast accelerometer-based motion recognition with a dual buffer framework. The International Journal of Virtual Reality, 10(3):17--24, September 2011.Google ScholarCross Ref
- R. Smith. Open dynamics engine, 2008. http://www.ode.org/.Google Scholar
- J. Tautges, A. Zinke, B. Kruger, J. Baumann, A. Weber, T. Helten, M. Muller, H.-P. Seidel, and B. Eberhardt. Motion reconstruction using sparse accelerometer data. ACM Trans. Graph., 30(3):18:1--18:12, May 2011. Google ScholarDigital Library
- M. Van De Panne. Parameterized gait synthesis. Computer Graphics and Applications, IEEE, 16(2):40--49, Mar 1996. Google ScholarDigital Library
- V. B. Zordan and J. K. Hodgins. Motion capture-driven simulations that hit and react. In SCA '02: Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation, pages 89--96, New York, NY, USA, 2002. ACM. \ Google ScholarDigital Library
Index Terms
- Real-time physical modelling of character movements with microsoft kinect
Recommendations
SpaceWalk: Movement and Interaction in Virtual Space with Commodity Hardware
IE2014: Proceedings of the 2014 Conference on Interactive EntertainmentWe introduce SpaceWalk, an experimental approach to allow a person to move around a small room while wearing a Head Mounted Display. The goal is to get immersed users in everyday settings out of their seats and naturally experiencing movement within the ...
The Kinect Versus The Proficio: Measuring Hand Position During Exercise Monitoring
PETRA '16: Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive EnvironmentsMotion capture technology has recently found a new application in physical therapy. The advantages of the Microsoft Kinect and similar devices have motivated researchers to focus on how to leverage the capabilities of motion capture technology to ...
Assessment of Sit-to-Stand Movements Using a Single Kinect Sensor: A Preliminary Study in Healthy Subjects
The aim of this article is to show that the absolute measurement difference between the Kinect-based system and the marker-based system for the sit-to-stand exercise is less important provided that the difference is caused by systematic errors in the ...
Comments