Human Computer Interaction (also referred to as Human Computer Interface; commonly abbreviated as HCI) is the platform through which humans can interact with and/or control machines.
- 1 Mouse
- 2 Keyboard
- 3 Touch-Screen
- 4 Oral
- 5 Gesture Interfaces
- 6 Emotion sensing/control
- 7 Mind-Controlled
- 8 Tools
- 9 Resources
- 10 Tutorials
- 11 External Links
- 12 References
- 13 See Also
For roughly 40 years (1972-2009), the ball and track mouse (and later, laser LED light then finally invisible optic light mouse) was the de facto standard for human-computer interaction.
Douglas Engelbart  at the Stanford Research Institute  invented the mouse in 1963 after extensive usability testing . He never received any royalties for it, as his patent ran out before it became widely used in personal computers.
Capturing the mouse position means determining the X and Y co-ordinates of the mouse's pointer. It is typically done when a certain action occurs, for example when the mouse is moved, placed over a specific region, or clicked on a specific object. A class whose primary function is to capture mouse positions and other related mouse events is called a Listener class. A Listener is a coding mechanism designed to listen to events within a given environment. When certain events occur, a given set of computation or pre-set responses will be carried out.
- How to enable right click on websites that have disabled it: https://medium.com/@krupkzcorpbisnis/how-to-enable-right-click-on-websites-that-have-disabled-it-d234ae616f7d
Bill English , finally built Engelbart's original vision for the mouse. The ball-mouse replaced the external wheels with a single ball that could rotate in any direction. It came as part of the hardware package of the Xerox Alto  computer. Perpendicular chopper wheels housed inside the mouse's body chopped beams of light on the way to light sensors, thus detecting in their turn the motion of the ball. This variant of the mouse resembled an inverted  and became the predominant form used with s throughout the 1980s and 1990s. The Xerox PARC group also settled on the modern technique of using both hands to type on a full-size keyboard and grabbing the mouse when required.
The ball mouse utilizes two rollers rolling against two sides of the ball. One roller detects the horizontal motion of the mouse and other the vertical motion. The motion of these two rollers causes two disc-like encoder wheels to rotate, interrupting optical beams to generate electrical signals. The mouse sends these signals to the computer system by means of connecting wires. The driver software in the system converts the signals into motion of the mouse pointer along X and Y axes on the screen.
A prerequisite for "On-Screen Keyboards" mentioned above, Touch-Screen interface technology has been around for quite some time, particularly in industrial applications, however the technology did not receive widespread use in consumer electronics until 21st century innovations in Multi-Touch.
Multi-Touch is quickly emerging as the next best thing in computing. It is essentially a receptive/capacitive surface such as specialized glass, plastic or translucent metals which allow a user to both see an interface and interact with it directly by touching it (as opposed to traditional screens which are displays only, not themselves input devices). Especially since the infamous 2006 TED Talk by Jeff Han and release of the first iPhone and iPod Touch models by Apple, most significant Tablets, SmartPhones and Mobile Devices include some form of touch-screen interface, functionality or features.
- FTIR Multitouch and Display Device- A Guide to build your own -Experiments with Processing, OSC: http://lowres.ch/ftir/
Haptic communication recreates the sense of touch by applying forces, vibrations, or motions to the user. This mechanical stimulation can be used to assist in the creation of virtual objects in a computer simulation, to control such virtual objects, and to enhance the remote control of machines and devices (i.e. Telerobotics). Haptic devices may incorporate tactile sensors that measure forces exerted by the user on the interface. Most researchers distinguish three sensory systems related to sense of touch in humans: cutaneous, kinesthetic & haptic.
Voice controlled (commands).
Speech controlled (natural language and discussions).
The Hand Gesture Interface is a real time gestural interface based on 3D dynamic hand gesture recognition using simple webcams. The application captures and recognizes hand gestures of the user wearing colored gloves, where the hand coordinates are obtained via 3D reconstruction from stereo.
The developed system aims to be a generic interface for Windows based applications, and provides supplementary features such as an interactive training and gesture defining system, a gesture tutor, a self-calibration utility for the cameras and a tool for linking the interface to different applications. The interface can be used by people with disabilities for various tasks, as well as by common users for controlling of desktop applications. The system can be linked to any third party program through generation of windows based mouse and keyboard events.
- Hand Gesture Interface Project: http://www.cmpe.boun.edu.tr/~keskinc/
- Hand Gesture Interface Project Download: http://www.cmpe.boun.edu.tr/~keskinc/download.htm
- Oblong Industries is the developer of the g-speak spatial operating environment: http://oblong.com/
Body Gesture Interfaces use a camera (i.e. webcam) or other tracking mechanism (such as the body suit commonly used in CGI action capture) to recognize movements for the purpose of controlling a user interface (i.e. projection or large-screen display).
- BLITZ hacks Xbox 360 Kinect for Flash/Silverlight/Unity/HTML: http://www.zdnet.com/blog/hardware/blitz-hacks-xbox-360-kinect-for-flashsilverlightunityhtml/10930?tag=nl.e550
- "Affective Computing" Could Change the Future of Computer Interaction: https://www.howtogeek.com/788948/affective-computing-could-change-the-future-of-computer-interaction/
A Brain-Machine Interface (BMI) is any device which uses the fluctuations or patterns in brainwaves and/or human behaviours to control devices, services, applications or other operating systems (such as that of a piece of equipment/machinery).
- Muse - Brain sensing headband: http://www.choosemuse.com/what-does-it-measure/
- Hammacher-Schlemmer - Training Wheels Eliminator: http://www.hammacher.com/Product/11912
The objective of the OpenInterface project is to provide an open source platform for developing interfaces that communicate intelligently through several modalities. OpenInterface focuses on human-human and human-machine natural interaction and the physical or virtual interaction environment.
The platform tools are aimed at designing, implementing and testing natural and easy-to-use multimodal interfaces that:
* handle a rich and extensible set of modalities, * enable quick replication, * enable a focus on innovation (new modalities or forms of multimodality), * support dynamic selection and combination of modalities to fit the ongoing context ofuse, * enable iterative user-centered design.
The idea of the open-source reusable OpenInterface platform seeks for efficient cooperation of consumers from both industry and academia.
- OpenInterface: http://www.openinterface.org/home/index.html
- Hackers backdoor the human brain, successfully extract sensitive data: http://www.extremetech.com/extreme/134682-hackers-backdoor-the-human-brain-successfully-extract-sensitive-data
- Fitts' Law as a Performance Model inHuman-Computer Interaction: http://www.yorku.ca/mack/phd.html
- Fitts's UI Law Applied to the Web: http://msdn.microsoft.com/en-us/library/ms993291.aspx
- Visualizing Fitts' Law: http://www.particletree.com/features/visualizing-fittss-law/
- The Brain-Implant Future Is Almost Here. Are You Up for It?: https://www.howtogeek.com/782668/the-brain-implant-future-is-almost-here.-are-you-up-for-it/
- Brain to the Cloud - Examining the Relationship Between Brain Activity and Video Game Performance: https://dzone.com/articles/brain-to-the-cloud-examining-the-relationship-betw
- wikipedia: Human Computer Interaction
- wikipedia: Fitts's law
- wikipedia: Postel's law
- wikipedia: Brain–computer interface
- wikipedia: Neurodiversity
- wikipedia: Positional tracking
- Electroencephalography (EEGs): http://www.lakewoodranchmedicalcenter.com/hospital-services/electroencephalography-eegs
- Interaxon - MUSE Brain-Sensing Headband: http://interaxon.ca/muse/faq.php
- Reserve a MUSE beta headset: https://www.shoplocket.com/products/PaxCP-reserve-your-muse
- MUSE - The Brain-Sensing Headband that lets you control things with your mind (INDIEGOGO CAMPAIGN): http://www.indiegogo.com/projects/muse-the-brain-sensing-headband-that-lets-you-control-things-with-your-mind
- Muse brain-sensing headband thoughts-on: http://www.engadget.com/2013/01/09/muse-brain-sensing-headband-thoughts-on/
- InteraXon Muse “brain-sensing” headband scores funding for mind-controlled future: http://www.slashgear.com/interaxon-muse-brain-sensing-headband-scores-funding-for-mind-controlled-future-15293905/
- A stylish new brain-sensing headband: http://www.kurzweilai.net/a-stylish-new-brain-sensing-headband
- Xiang Cao PhD - Human-Computer Interaction: http://www.cs.toronto.edu/~caox/research.htm
- Microsoft Kinect (Formerly Natal) Pushes Closer To 'Minority Report' Interface: http://www.mediapost.com/publications/?fa=Articles.showArticle&art_aid=130086
- Making amazing light art with the Kinect (photos): http://www.zdnet.com/photos/making-amazing-light-art-with-the-kinect-photos/6208890?tag=nl.e539
- The Opposite of Fitts' Law: http://www.codinghorror.com/blog/2010/03/the-opposite-of-fitts-law.html
- Postel's Law explained:
- DWIM -- Do What I Mean: http://www.catb.org/~esr/jargon/html/D/DWIM.html (can be dangerous if done incorrectly or in the wrong functional areas)
- Be liberal in what you accept… or not?: https://softwareengineering.stackexchange.com/questions/12401/be-liberal-in-what-you-accept-or-not
- Sifteo's Interactive Cubes - Blocks with Brains: http://www.time.com/time/business/article/0,8599,2089309,00.html
- The first human brain-to-brain interface has been created. In the future, will we all be linked telepathically?: http://www.extremetech.com/extreme/188883-the-first-human-brain-to-brain-interface-has-been-created-in-the-future-will-we-all-be-linked-telepathically
- 8 Examples of Mind Controlled Technology in Action: http://www.wakingtimes.com/2014/01/09/8-examples-of-mind-controlled-technology/
- iSkin -- Flexible, Stretchable and Visually Customizable On-Body Touch Sensors for Mobile Computing (WHITEPAPER): https://embodied.mpi-inf.mpg.de/files/2015/01/2015-iSkin.pdf
- Is "touch" really the future?: http://blogs.jackys.com/2013/04/is-touch-really-future.html (probably not, set to get surpassed by more natural interaction mechanisms)
- A New Device Can Hear Your Thoughts: https://medium.com/s/futurehuman/a-new-device-can-hear-your-thoughts-bab96fe01c9a
- Google Gives Devices 'Social Intelligence,' Enables Non-Verbal Communications: https://www.mediapost.com/publications/article/371654/google-gives-computers-social-intelligence-crea.html
- AI and Human Enhancement - Americans’ Openness Is Tempered by a Range of Concerns: https://www.pewresearch.org/internet/2022/03/17/ai-and-human-enhancement-americans-openness-is-tempered-by-a-range-of-concerns/
- wikipedia: Douglas Engelbart
- wikipedia: Stanford Research Institute
- The Invention of the Computer Mouse: http://web.archive.org/web/20061018141720/http://www.afrlhorizons.com/Briefs/Mar02/OSR0103.html (Retrieved 31 December, 2006)
- wikipedia: usability testing
- Template:Cite news
- wikipedia: Royal Canadian Navy
- wikipedia: trackball
- wikipedia: five-pin bowling
- wikipedia: DATAR
- Ferranti-Packard: Pioneers in Canadian Electrical Manufacturing, Norman R. Ball, John N. Vardalas, McGill-Queen's Press, 1993
- Bill English
- wikipedia:Xerox Alto
- wikipedia: trackball
- wikipedia: personal computer
- Who Invented Touch Screen Technology?: http://inventors.about.com/od/tstartinventions/a/Touch-Screen.htm
- The Evolution of Touchscreen Technology: http://www.makeuseof.com/tag/evolution-touchscreen-technology/
- Jeff Han's first public demo of his innovations in Multi-Touch technology: http://www.ted.com/talks/jeff_han_demos_his_breakthrough_touchscreen
- Jeff Han - Biography by TED: https://www.ted.com/speakers/jeff_han
- How the iPhone's Touchscreen Works: http://electronics.howstuffworks.com/iphone1.htm/printable
- How do touch-screen monitors know where you're touching?: http://computer.howstuffworks.com/question716.htm
- Haptic feedback with the Taptic Engine - WKInterfaceDevice and WKHapticType in WatchKit and watchOS 2: http://www.sneakycrab.com/blog/2015/6/22/haptic-feedback-with-the-taptic-engine-in-watchkit-and-watchos-2-wkinterfacedevice-and-wkhaptic
- Intel calls its AI that detects student emotions a teaching tool. Others call it "morally reprehensible": https://www.protocol.com/enterprise/emotion-ai-school-intel-edutech
- Situational Awareness explained: https://securityadviser.net/situational-awareness-definition/
- Dynamic Removal of Clutter to Improve Situational Awareness in (Air) Traffic Management Systems: https://oied.osu.edu/technologies/dynamic-removal-clutter-improve-situational-awareness-traffic-management-systems
- Using PMU Data to Increase Situational Awareness (in electric power grid): http://overbye.engr.tamu.edu/wp-content/uploads/sites/146/2021/04/Using-PMU-Data-to-Increase-Situational-Awareness.pdf
- An Industrial Control System Situation Awareness Method based on Weighting Algorithm: https://www.atlantis-press.com/article/55917281.pdf
- Study on multimedia network Weibo situational awareness model and emotional algorithm: https://link.springer.com/article/10.1007/s11042-019-07779-8
- Quantitative situational awareness algorithm of land state network based on neutral statistics: https://link.springer.com/article/10.1007/s12652-020-02827-w
- Improving stand-on ship's situational awareness by estimating the intention of the give-way ship: https://www.sciencedirect.com/science/article/abs/pii/S0029801820301761
- Machine learning algorithms promise better situational awareness: https://www.army.mil/article/236647/machine_learning_algorithms_promise_better_situational_awareness
- Robust Coreset Construction for Distributed Machine Learning: https://ieeexplore.ieee.org/document/9109724
- Advances in Artificial Intelligence and Machine Learning for Networking: https://www.comsoc.org/publications/journals/ieee-jsac/cfp/advances-artificial-intelligence-and-machine-learning
- SPACE SITUATIONAL AWARENESS - IT’S NOT JUST ABOUT THE ALGORITHMS: http://iaassconference2013.space-safety.org/wp-content/uploads/sites/19/2013/06/0920_Schonberg.pdf
- Real-time Fault Detection and Situational Awareness for Rovers - Report on the Mars Technology Program Task: http://robots.stanford.edu/papers/Dearden04a.pdf
- Geo maneuver detection for space situational awareness: https://www.researchgate.net/publication/289550326_Geo_maneuver_detection_for_space_situational_awareness
- Evaluation of PNT Situational Awareness Algorithms and Methods: https://www.ion.org/publications/abstract.cfm?articleID=17935
- INGENIOUS situational awareness algorithms for UAVs: https://ingenious-first-responders.eu/ingenious-situational-awareness-algorithms-for-uavs/
- Towards Algorithms for Effective Stabilization and Situational Awareness for Humanoid Robots: https://celebration.tcnj.edu/wp-content/uploads/sites/115/2021/04/Bland-Madison-MUSE-2020-Poster.pdf
- A Brain Implant Helped a Paralyzed Man Turn Thought Into Text: https://www.reviewgeek.com/83180/a-brain-implant-helped-a-paralyzed-man-turn-thought-into-text/
- Fitts' Law: http://www.interaction-design.org/encyclopedia/fitts_law.html
- How to Hack Toy EEGs: https://frontiernerds.com/brain-hack