Feel like physical keyboards, desktop monitors and mouses are old news? Apple is taking us all one more step into the future with the Vision Pro, the headset that projects apps and allows you to control them through a series of hand gestures, vocal commands and even eye movements. If you are wondering how this thing will actually be controlled, read on.
A particularly slick part of the device is that it has precision eye tracking. LEDs and infrared cameras monitor where your eyes are looking. This is done by invisible light patterns that are projected onto each eye.
The device can then tell which elements you want to work with just by looking at them.
Hand Movements
The main way the Apple Vision Pro is controlled is through a series of hand movements. These include:
Tapping: Simply look at a virtual element, and tap your thumb and index finger together to tell the headset that you want to tap on that element of the display.
Double tapping: Tap your thumb and index finger together twice while looking at the item you want to control.
Pinching and holding: If you want to mimic tap and hold, you would hold your thumb and index finger together.
Rotating items: Hold your thumb and index finger together on both hands. Rotate them around each other in a circular motion to rotate the image.
Zooming: To narrow in on something, touch your thumb and index finger together on both hands. Move your hands apart or together to zoom in or out. You can also drag the corners of windows to change their size.
Moving windows and scrolling: Called the pinch and drag, hold your thumb and index finger together on one hand, and then move your hand in the direction you want the window or text to go. Moving your hand faster means faster scrolling text or moving windows.
How to Type
The device also supports both physical and virtual keyboards. The virtual keyboard displays and then you type on it with your hands in midair.
You can also use dictation to type. If you don’t like the idea of typing in midair, the device can simply record what you are saying.
Similarly, the device also supports trackpads and game controllers.
Write a Comment