Gesture Recognition

Gesture Recognition (also referred to as Gestural Interfaces) is a technique for tracking or monitoring movement and gestures from a subject (i.e. a person, who is the user of the system; or, a group of users) in order to determine intent of control and decision making in a user interface, application or system.

Tools

• Depth Sensors Comparison: http://wiki.ipisoft.com/Depth_Sensors_Comparison

Resources

• Touch Gesture Reference Guide: http://www.lukew.com/ff/entry.asp?1071
• Interaction Design & Complex Animations (EBOOK): https://www.uxpin.com/studio/ebooks/curated-interaction-design-animations/
• Mobile UI Design Patterns (EBOOK): https://www.uxpin.com/studio/ebooks/mobile-design-patterns/
• iOS Human Interface Guidelines: https://developer.apple.com/ios/human-interface-guidelines/
• Android - User Interface Guidelines: https://developer.android.com/guide/practices/ui_guidelines/index.html
• Google - Material Design for (Mobile Web) Gestures guide: https://material.google.com/patterns/gestures.html
• WindowsPhone - Touch Gestures overview: https://msdn.microsoft.com/en-us/library/windows/desktop/dd940543(v=vs.85).aspx

• OpenNI: https://github.com/OpenNI/OpenNI (aka. Open Natural Interaction)
• PrimeSensor Modules for OpenNI: https://github.com/avin2/SensorKinect
• librekinect: https://github.com/xxorde/librekinect (Depth data from a kinect sensor! Small and fast kernel driver. Also for embedded devices like the raspberry pi!)

Tutorials

• Raspberry Pi with Kinect: http://stackoverflow.com/questions/17743479/raspberry-pi-with-Kinect
• Raspberry Pi and the Kinect: http://jonmacey.blogspot.ca/2012/07/raspberry-pi-and-kinect.html
• Kinect on Raspberry Pi: http://blog.tunpixel.tn/2014/10/27/kinect-rasp/
• Cubieboard Fileserver + Kinect: http://neon-society-electronics.com/?p=62
• Wiring an Xbox Kinect for USB: http://www.instructables.com/id/Wiring-an-Xbox-Kinect-for-USB/step2/Wiring/
• How to implement gestures into your mobile design: http://thenextweb.com/dd/2015/11/09/how-to-implement-gestures-into-your-mobile-design/
• Web Prototyping for Touch Gestures: https://www.sitepoint.com/web-prototyping-for-touch-gestures/
• Touch Events vs. Gestures (on Mobile): http://paultrani.com/2011/02/touch-events-and-gestures-on-mobile/

External Links

• wikipedia: Gesture
• wikipedia: Gesture recognition
• Unleashing Mobile Gesture UX: http://usabilitygeek.com/unleashing-mobile-gesture-ux/
• Experimental Analysis of Touch-Screen Gesture Designs in Mobile Environment: http://research.microsoft.com/en-us/um/people/kenh/All-Published-Papers/Mobile-Touch-Gestures-CHI-2011.pdf
• Gestures & Animations -- The Pillars of Mobile Design: http://uxmag.com/articles/gestures-animations-the-pillars-of-mobile-design
• In-App Gestures And Mobile App User Experience: http://www.smashingmagazine.com/2016/10/in-app-gestures-and-mobile-app-user-experience/
• Beyond The Button -- Embracing The Gesture-Driven Interface: http://www.smashingmagazine.com/2013/05/24/gesture-driven-interface/
• If you see a UI walkthrough, they blew it: http://blog.maxrudberg.com/post/38958984259/if-you-see-a-ui-walkthrough-they-blew-it

See Also

Kinect | Wii | SmartPhone | SmartWatch