I made my PC work like Minority Report
A while ago, I was watching YouTube while eating (which I always do) and tried to skip past a video to another one, but couldn’t because of my food-covered hands. I tried in vain to swipe in mid-air hoping for something to happen (nothing did), when I realized with my camera and some AI, I could control my mouse just by waving my hand. Thus, I created an app that makes it possible to control your computer with hand gestures.

Now, instead of continuously holding down the volume key or repeatedly flicking your trackpad, I control the scroll or volume by moving my hand up or down, for example. I can highlight and copy parts of articles and paste them with a simple hand motion. I can even draw without a stylus or my mouse!

Here’s the technical side of what I did: I implemented a point teleportation system for mouse motion, where the mouse would teleport wherever my hand was in relation to the computer screen. Amount of time with my hand in mid-air drastically decreased (after some training to get myself calibrated — it took about 30 minutes to master where my hand was supposed to be to teleport to a location). Many of my users started using it for the same purpose, and the ability to scroll and control the volume was a big hit.

I think it could be used as a platform for further development for PC/Mac/Linux users, like developing command line shortcuts that a keyboard can’t do, etc. It could also be used as a platform for VR gaming, and get rid of those controllers too. It could also work in tablets for airports and kiosks to avoid contact, especially in the middle of a pandemic.

I have made it available for Windows and MacOS, but I’ll be releasing versions for Linux in the next few months! If you have any questions, or would like to request new features and actions, you can reach out to me directly from the contact section of the site.

Visit the Windows Store to try it out yourself, or get the Mac version directly from the website!
[]
['Apps', 'Technology', 'AR', 'Apple', 'AI']