{"id":577743,"date":"2023-06-08T02:30:42","date_gmt":"2023-06-07T23:30:42","guid":{"rendered":"https:\/\/en.buradabiliyorum.com\/every-single-sensor-inside-the-apple-vision-pro-and-what-its-individually-designed-to-do\/"},"modified":"2023-06-08T02:30:42","modified_gmt":"2023-06-07T23:30:42","slug":"every-single-sensor-inside-the-apple-vision-pro-and-what-its-individually-designed-to-do","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/every-single-sensor-inside-the-apple-vision-pro-and-what-its-individually-designed-to-do\/","title":{"rendered":"#Every Single Sensor inside the Apple Vision Pro and What It\u2019s Individually Designed To Do"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_84 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-6a25dbb706ca8\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #dd3333;color:#dd3333\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #dd3333;color:#dd3333\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-6a25dbb706ca8\" checked aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/buradabiliyorum.com\/en\/every-single-sensor-inside-the-apple-vision-pro-and-what-its-individually-designed-to-do\/#What_is_%E2%80%9CSpatial_Computing%E2%80%9D\" >What is \u201cSpatial Computing\u201d?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/buradabiliyorum.com\/en\/every-single-sensor-inside-the-apple-vision-pro-and-what-its-individually-designed-to-do\/#How_the_M2_and_R1_Chips_Handle_Spatial_Computing\" >How the M2 and R1 Chips Handle Spatial Computing<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/buradabiliyorum.com\/en\/every-single-sensor-inside-the-apple-vision-pro-and-what-its-individually-designed-to-do\/#Apple_Engineer_Reveals_the_Scary_Powerful_Capabilities_of_the_R1_Chip\" >Apple Engineer Reveals the (Scary) Powerful Capabilities of the R1 Chip<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/buradabiliyorum.com\/en\/every-single-sensor-inside-the-apple-vision-pro-and-what-its-individually-designed-to-do\/#A_Broad_Look_at_Every_Sensor_on_the_Apple_Vision_Pro\" >A Broad Look at Every Sensor on the Apple Vision Pro<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/buradabiliyorum.com\/en\/every-single-sensor-inside-the-apple-vision-pro-and-what-its-individually-designed-to-do\/#Other_Key_Components\" >Other Key Components<\/a><\/li><\/ul><\/nav><\/div>\n<div class=\"single-box clearfix entry-content\" style=\"max-width:1050px;\">\n<input class=\"jpibfi\" type=\"hidden\"><\/p>\n<p><noscript><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-438786\" src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-designed-to-do\/every_sensor_on_apple_vision_pro_1.jpg\" alt=\"\" width=\"1280\" height=\"853\" data-jpibfi-post-excerpt=\"\" data-jpibfi-post-url=\"https:\/\/www.yankodesign.com\/2023\/06\/07\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/\" data-jpibfi-post-title=\"Every Single Sensor inside the Apple Vision Pro and What It\u2019s Individually Designed To Do\" data-jpibfi-src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-designed-to-do\/every_sensor_on_apple_vision_pro_1.jpg\"><\/noscript><img loading=\"lazy\" decoding=\"async\" class=\"lazyload alignnone size-full wp-image-438786\" src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-designed-to-do\/every_sensor_on_apple_vision_pro_1.jpg\" alt=\"\" width=\"1280\" height=\"853\" data-jpibfi-post-excerpt=\"\" data-jpibfi-post-url=\"https:\/\/www.yankodesign.com\/2023\/06\/07\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/\" data-jpibfi-post-title=\"Every Single Sensor inside the Apple Vision Pro and What It\u2019s Individually Designed To Do\" data-jpibfi-src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-designed-to-do\/every_sensor_on_apple_vision_pro_1.jpg\">For a $3,499 USD device that\u2019s designed to replace your phone, laptop, watch, tablet, television, and even your mouse, you bet that <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/download-scripts-themes-apps\/\" data-internallinksmanager029f6b8e52c=\"9\" title=\"Download Scripts &amp; Themes &amp; Apps\" target=\"_blank\" rel=\"noopener\">App<\/a>le\u2019s Vision Pro is absolutely crammed with sensors that track you, your movements, eyesight, gestures, voice commands, and your position in space. As per Apple\u2019s own announcement, the Vision Pro has as many as 14 cameras on the inside and outside, 1 LiDAR scanner, and multiple IR and invisible LED illuminators to help it get a sense of where you are and what you\u2019re doing. Aside from this, the headset also has a dedicated R1 Apple Silicone chip that crunches data from all these sensors (and a few others) to help create the best representation of Apple\u2019s gradual shift towards \u201cSpatial Computing\u201d.<\/p>\n<p><noscript><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-438789\" src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_2.jpg\" alt=\"\" width=\"1280\" height=\"720\" data-jpibfi-post-excerpt=\"\" data-jpibfi-post-url=\"https:\/\/www.yankodesign.com\/2023\/06\/07\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/\" data-jpibfi-post-title=\"Every Single Sensor inside the Apple Vision Pro and What It\u2019s Individually Designed To Do\" data-jpibfi-src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_2.jpg\"><\/noscript><img loading=\"lazy\" decoding=\"async\" class=\"lazyload alignnone size-full wp-image-438789\" src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_2.jpg\" alt=\"\" width=\"1280\" height=\"720\" data-jpibfi-post-excerpt=\"\" data-jpibfi-post-url=\"https:\/\/www.yankodesign.com\/2023\/06\/07\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/\" data-jpibfi-post-title=\"Every Single Sensor inside the Apple Vision Pro and What It\u2019s Individually Designed To Do\" data-jpibfi-src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_2.jpg\"><\/p>\n<div class=\"code-block code-block-3\" style=\"margin: 8px 0; clear: both;\">\n<amp-ad width=\"100vw\" height=\"320\" type=\"adsense\" data-ad-client=\"ca-pub-0648786275385337\" data-ad-slot=\"6683677248\" data-auto-format=\"rspv\" data-full-width=\"\"><\/p>\n<div overflow=\"\"><\/div>\n<p><\/amp-ad><\/div>\n<div class=\"code-block code-block-1\" style=\"margin: 8px 0; clear: both;\">\n<div style=\"padding: 4px; margin: 18px auto 20px; text-align:center;\"><script async src=\"https:\/\/pagead2.googlesyndication.com\/pagead\/js\/adsbygoogle.js\" type=\"b262d55c40c7d0e915dbbcc1-text\/javascript\"><\/script><br \/>\n<script type=\"b262d55c40c7d0e915dbbcc1-text\/javascript\">\n<\/script><\/div>\n<\/div>\n<h3 style=\"text-align: center;\"><span class=\"ez-toc-section\" id=\"What_is_%E2%80%9CSpatial_Computing%E2%80%9D\"><\/span>What is \u201cSpatial Computing\u201d?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>\u201cVision Pro is a new kind of Computer,\u201d says Tim Cook as he reveals the mixed reality headset for the very first time. \u201cIt\u2019s the first Apple product you look through, and not at,\u201d he adds, marking Apple\u2019s shift to Spatial Computing. What\u2019s Spatial Computing, you ask? Well, the desktop was touted as the world\u2019s first Personal Computer, or PC as we so ubiquitously call it today. The laptop shrank the desktop to a portable format, and the phone shrank it further\u2026 all the way down to the watch, that put your personal computer on your wrist. Spatial Computing marks Apple\u2019s first shift away from Personal Computing, in the sense that you\u2019re now no longer limited by a display \u2013 big or small. \u201cInstead, your surroundings become a canvas,\u201d Tim summarizes, as he hands the stage to VP of Design, Alan Dye.<\/p>\n<p>Spatial Computing marks a new era of computing where the four corners of a traditional display don\u2019t pose any constraints to your working environment. Instead, your real environment becomes your working environment, and just like you\u2019ve got folders, windows, and widgets on a screen, the Vision Pro lets you create folders, windows, and widgets in your 3D space. Dye explains that in Spatial Computing, you don\u2019t have to minimize a window to open a new one. Just simply drag one window to the side and open another one. Apple\u2019s VisionOS turns your room and your visual periphery into an OS, letting you create multiple screens\/windows wherever you want, move them around, and resize them. Think Minority Report or Tony Stark\u2019s holographic computer\u2026 but with a better, classier interface.<\/p>\n<p><noscript><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-438806\" src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_10.jpg\" alt=\"\" width=\"1280\" height=\"853\" data-jpibfi-post-excerpt=\"\" data-jpibfi-post-url=\"https:\/\/www.yankodesign.com\/2023\/06\/07\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/\" data-jpibfi-post-title=\"Every Single Sensor inside the Apple Vision Pro and What It\u2019s Individually Designed To Do\" data-jpibfi-src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_10.jpg\"><\/noscript><img loading=\"lazy\" decoding=\"async\" class=\"lazyload alignnone size-full wp-image-438806\" src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_10.jpg\" alt=\"\" width=\"1280\" height=\"853\" data-jpibfi-post-excerpt=\"\" data-jpibfi-post-url=\"https:\/\/www.yankodesign.com\/2023\/06\/07\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/\" data-jpibfi-post-title=\"Every Single Sensor inside the Apple Vision Pro and What It\u2019s Individually Designed To Do\" data-jpibfi-src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_10.jpg\"><\/p>\n<h3 style=\"text-align: center;\"><span class=\"ez-toc-section\" id=\"How_the_M2_and_R1_Chips_Handle_Spatial_Computing\"><\/span>How the M2 and R1 Chips Handle Spatial Computing<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>At the heart of the Vision Pro headset are two chips that work together to help virtuality and reality combine seamlessly. The Vision Pro is equipped with Apple\u2019s M2 silicon chip to help with computing and handling multitasking, along with a new R1 silicon chip that\u2019s proprietary to the headset, which works with all the sensors inside and outside the headset to track your eyesight, control input, and also help virtual elements exist seamlessly within the real world, doing impressive things like casting shadows on the world around you, changing angles when you move around, or disappearing\/fading when someone walks into your frame.<\/p>\n<p>The R1 chip is pretty much Apple\u2019s secret sauce with the Vision Pro. It handles data from every single sensor on the device, simultaneously tracking your environment, your position in it, your hands, and even your eye movements with stunning accuracy. Your eye movements form the basis of how the Vision Pro knows what elements you\u2019re thinking of interacting with, practically turning them into bonafide cursors. As impressive as that is, the R1 also uses your eye data to know what elements of the screen to render, and what not to. Given that you can only focus on a limited area at any given time, the R1 chip knows to render just that part of your visual periphery with crisp clarity, rather than spending resources rendering out the entire scene. It\u2019s a phenomenally clever way to optimize battery use while providing a brilliantly immersive experience. However, that\u2019s not all\u2026<\/p>\n<p><noscript><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-438792\" src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_5.jpg\" alt=\"\" width=\"1280\" height=\"853\" data-jpibfi-post-excerpt=\"\" data-jpibfi-post-url=\"https:\/\/www.yankodesign.com\/2023\/06\/07\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/\" data-jpibfi-post-title=\"Every Single Sensor inside the Apple Vision Pro and What It\u2019s Individually Designed To Do\" data-jpibfi-src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_5.jpg\"><\/noscript><img loading=\"lazy\" decoding=\"async\" class=\"lazyload alignnone size-full wp-image-438792\" src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_5.jpg\" alt=\"\" width=\"1280\" height=\"853\" data-jpibfi-post-excerpt=\"\" data-jpibfi-post-url=\"https:\/\/www.yankodesign.com\/2023\/06\/07\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/\" data-jpibfi-post-title=\"Every Single Sensor inside the Apple Vision Pro and What It\u2019s Individually Designed To Do\" data-jpibfi-src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_5.jpg\"><\/p>\n<div class=\"code-block code-block-4\" style=\"margin: 8px 0; clear: both;\">\n<amp-ad width=\"100vw\" height=\"320\" type=\"adsense\" data-ad-client=\"ca-pub-0648786275385337\" data-ad-slot=\"1017606968\" data-auto-format=\"rspv\" data-full-width=\"\"><\/p>\n<div overflow=\"\"><\/div>\n<p><\/amp-ad><\/div>\n<div class=\"code-block code-block-2\" style=\"margin: 8px 0; clear: both;\">\n<div style=\"padding: 4px; margin: 18px auto 20px; text-align:center;\"><script async src=\"https:\/\/pagead2.googlesyndication.com\/pagead\/js\/adsbygoogle.js\" type=\"b262d55c40c7d0e915dbbcc1-text\/javascript\"><\/script><br \/>\n<script type=\"b262d55c40c7d0e915dbbcc1-text\/javascript\">\n<\/script><\/div>\n<\/div>\n<h3 style=\"text-align: center;\"><span class=\"ez-toc-section\" id=\"Apple_Engineer_Reveals_the_Scary_Powerful_Capabilities_of_the_R1_Chip\"><\/span>Apple Engineer Reveals the (Scary) Powerful Capabilities of the R1 Chip<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>A neuro<a href=\"https:\/\/buradabiliyorum.com\/en\/category\/technology\/\" data-internallinksmanager029f6b8e52c=\"4\" title=\"Technology\" target=\"_blank\" rel=\"noopener\">technology<\/a> engineer at Apple lifted the veil on exactly how complex and somewhat scary the Vision Pro\u2019s internal tech is. While bound by NDA, Sterling Crispin shared in a <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/twitter.com\/sterlingcrispin\/status\/1665792422914453506\">tweet<\/a> how the Vision Pro tracks your eyesight and knows how you\u2019re navigating its interface so flawlessly. Fundamentally, the R1 chip is engineered to be borderline magical at predicting a user\u2019s eye journey and intent. \u201cOne of the coolest results involved predicting a user was going to click on something before they actually did [\u2026] <strong>Your pupil reacts before you click in part because you expect something will happen after you click<\/strong>,\u201d Crispin mentions. \u201cSo you can create biofeedback with a user\u2019s brain by monitoring their eye behavior, and redesigning the UI in real time to create more of this anticipatory pupil response.\u201d<\/p>\n<p><strong>\u201cOther tricks to infer cognitive state involved quickly flashing visuals or sounds to a user in ways they may not perceive, and then measuring their reaction to it,\u201d<\/strong> Crispin further explains. \u201cAnother patent goes into details about using machine learning and signals from the body and brain to predict how focused, or relaxed you are, or how well you are learning. And then updating virtual environments to enhance those states. So, imagine an adaptive immersive environment that helps you learn, or work, or relax by changing what you\u2019re seeing and hearing in the background.\u201d Here\u2019s a look at Sterling Crispin\u2019s tweet.<\/p>\n<blockquote class=\"twitter-tweet\">\n<p dir=\"ltr\" lang=\"en\">I spent 10% of my life contributing to the development of the <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/twitter.com\/hashtag\/VisionPro?src=hash&amp;ref_src=twsrc%5Etfw\">#VisionPro<\/a> while I worked at Apple as a Neurotechnology Prototyping Researcher in the Technology Development Group. It\u2019s the longest I\u2019ve ever worked on a single effort. I\u2019m proud and relieved that it\u2019s finally\u2026 <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/t.co\/vCdlmiZ5Vm\">pic.twitter.com\/vCdlmiZ5Vm<\/a><\/p>\n<p>\u2014 Sterling Crispin \ud83d\udd4a\ufe0f (@sterlingcrispin) <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/twitter.com\/sterlingcrispin\/status\/1665792422914453506?ref_src=twsrc%5Etfw\">June 5, 2023<\/a><\/p>\n<\/blockquote>\n<p><script async src=\"https:\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\" type=\"b262d55c40c7d0e915dbbcc1-text\/javascript\"><\/script><\/p>\n<p><noscript><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full\" src=\"https:\/\/i.imgur.com\/g4lQP36.gif\" width=\"1280\" height=\"720\" data-jpibfi-post-excerpt=\"\" data-jpibfi-post-url=\"https:\/\/www.yankodesign.com\/2023\/06\/07\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/\" data-jpibfi-post-title=\"Every Single Sensor inside the Apple Vision Pro and What It\u2019s Individually Designed To Do\" data-jpibfi-src=\"https:\/\/i.imgur.com\/g4lQP36.gif\"><\/noscript><img loading=\"lazy\" decoding=\"async\" class=\"lazyload alignnone size-full\" src=\"https:\/\/i.imgur.com\/g4lQP36.gif\" width=\"1280\" height=\"720\" data-jpibfi-post-excerpt=\"\" data-jpibfi-post-url=\"https:\/\/www.yankodesign.com\/2023\/06\/07\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/\" data-jpibfi-post-title=\"Every Single Sensor inside the Apple Vision Pro and What It\u2019s Individually Designed To Do\" data-jpibfi-src=\"https:\/\/i.imgur.com\/g4lQP36.gif\"><\/p>\n<div class=\"code-block code-block-8\" style=\"margin: 8px 0; clear: both;\">\n<amp-ad layout=\"fluid\" height=\"fluid\" type=\"doubleclick\" data-slot=\"\/3847355\/yd-select-amp\"><\/amp-ad><\/div>\n<h3 style=\"text-align: center;\"><span class=\"ez-toc-section\" id=\"A_Broad_Look_at_Every_Sensor_on_the_Apple_Vision_Pro\"><\/span>A Broad Look at Every Sensor on the Apple Vision Pro<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>Sensors dominate the Vision Pro\u2019s spatial computing abilities, and here\u2019s a look at all the sensors Apple highlighted in the keynote, along with a few others that sit under the Vision Pro\u2019s hood. This list isn\u2019t complete, since the Vision Pro isn\u2019t available for a tech teardown, but it includes every sensor mentioned by Apple.<\/p>\n<p><strong>Cameras \u2013<\/strong> The Vision Pro has an estimated 14 cameras that help it capture details inside and outside the headset. Up to 10 cameras (2 main, 4 downward, 2 TrueDepth, and 2 sideways) on the outer part of the headset sense your environment in stereoscopic 3D, while 4 IR cameras inside the headset track your eyes as well as perform 3D scans of your iris, helping the device authenticate the user.<\/p>\n<p><strong>LiDAR Sensor \u2013<\/strong> The purpose of the LiDAR sensor is to use light to measure distances, creating a 3D map of the world around you. It\u2019s used in most self-driving automotive systems, and even on the iPhone\u2019s FaceID system, to scan your face and identify it. On the Vision Pro, the LiDAR sensor sits front and center, right above the nose, capturing a perfect view of the world around you, as well as capturing a 3D model of your face that the headset then uses as an avatar during FaceTime.<\/p>\n<p><strong>IR Camera \u2013<\/strong> The presence of an IR camera on any device plays a key role in being able to do the job of a camera when the camera can\u2019t. IR sensors work in absolute darkness too, giving them a significant edge over conventional cameras. That\u2019s why the headset has 4 IR Cameras on the inside, and an undisclosed number of IR cameras\/sensors on the outside to help the device see despite lighting conditions. The IR cameras inside the headset do a remarkable job of eye-tracking as well as of building a 3D scan of your iris, to perform Apple\u2019s secure OpticID authentication system.<\/p>\n<p><strong>Illuminators \u2013<\/strong> While these aren\u2019t sensors, they play a key role in allowing the sensors to do their job perfectly. The Vision Pro headset has 2 IR illuminators on the outside that flash invisible infrared dot grids to help accurately scan a person\u2019s face (very similar to FaceID). On the inside, however, the headset has invisible LED illuminators surrounding each eye that help the IR cameras track eye movement, reactions, and perform detailed scans of your iris. These illuminators play a crucial role in low-light settings, giving the IR cameras data to work with.<\/p>\n<p><strong>Accelerator &amp; Gyroscope \u2013<\/strong> Although Apple didn\u2019t mention the presence of these in the headset, it\u2019s but obvious that the Vision Pro has multiple accelerators and gyroscopes to help it track movement and tilt. Like any good headset, the Vision Pro enables tracking with 6 degrees of freedom, being able to detect left, right, forward, backward, upward, and downward movement. The accelerator helps the headset capture these movements, while the gyroscope helps the headset understand when you\u2019re tilting your head. These sensors, along with the cameras and scanners, give the R1 chip the data it needs to know where you\u2019re standing, moving, and looking.<\/p>\n<p><strong>Microphones \u2013<\/strong> The Vision Pro has an undisclosed number of microphones built into the headset that perform two broad activities \u2013 voice detection and spatial audio. Voice commands form a core part of how you interact with the headset, which is why the Vision Pro has microphones that let you perform search queries, summon apps\/websites, and talk naturally to Siri. However, the microphones also need to perform an acoustic scan of your room, just the way the cameras need to do a visual scan. They do this so that they can match the sound to the room you\u2019re in, delivering the right amount of reverb, tonal frequencies, etc. Moreover, as you turn your head, sounds still stay in the same place, and the microphones help facilitate that, creating a sonic illusion that allows your ears to believe what your eyes see.<\/p>\n<p><noscript><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-438794\" src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_3.jpg\" alt=\"\" width=\"1280\" height=\"854\" data-jpibfi-post-excerpt=\"\" data-jpibfi-post-url=\"https:\/\/www.yankodesign.com\/2023\/06\/07\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/\" data-jpibfi-post-title=\"Every Single Sensor inside the Apple Vision Pro and What It\u2019s Individually Designed To Do\" data-jpibfi-src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_3.jpg\"><\/noscript><img loading=\"lazy\" decoding=\"async\" class=\"lazyload alignnone size-full wp-image-438794\" src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_3.jpg\" alt=\"\" width=\"1280\" height=\"854\" data-jpibfi-post-excerpt=\"\" data-jpibfi-post-url=\"https:\/\/www.yankodesign.com\/2023\/06\/07\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/\" data-jpibfi-post-title=\"Every Single Sensor inside the Apple Vision Pro and What It\u2019s Individually Designed To Do\" data-jpibfi-src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_3.jpg\"><\/p>\n<h3 style=\"text-align: center;\"><span class=\"ez-toc-section\" id=\"Other_Key_Components\"><\/span>Other Key Components<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>Aside from the sensors, the Vision Pro is filled with a whole slew of tech components, from screens to battery packs. Here\u2019s a look at what else lies underneath the Vision Pro\u2019s hood.<\/p>\n<p><strong>Displays \u2013<\/strong> Given its name, the Vision Pro obviously focuses heavily on your visual sense\u2026 and it does so with some of the most incredible displays ever seen. The Vision Pro has two stamp-sized displays (one for each eye) with each boasting more pixels than a 4K television. This gives the Vision Pro\u2019s main displays a staggering 23 million pixels combined, capable of a 12-millisecond refresh rate (making it roughly 83fps). Meanwhile, the outside of the headset has a display too, which showcases your eyes to people around you. While the quality of this display isn\u2019t known, it is a bent OLED screen with a lenticular film in front of it that creates the impression of a 3D display, so people see depth in your eyes, rather than just a flat image.<\/p>\n<p><strong>Audio Drivers \u2013<\/strong> The headset\u2019s band also has audio drivers built into each temple, firing rich, environmentally-responsive audio into your ears as you wear the headset. Apple mentioned that the Vision Pro has dual audio drivers for each ear, which could possibly indicate quality that rivals the AirPods Max.<\/p>\n<p><strong>Fans \u2013<\/strong> To keep the headset cool, the Vision Pro has an undisclosed number of fans that help maintain optimal temperatures inside the headset. The fans are quiet, yet incredibly powerful, cooling down not one but two chips inside the headset. A grill detail on the bottom helps channel out the hot air.<\/p>\n<p><strong>Digital Crown \u2013<\/strong> Borrowing from the Apple Watch, the Vision Pro has a Digital Crown that rotates to summon the home screen, as well as to toggle the immersive environment that drowns out the world around you for a true VR experience.<\/p>\n<p><strong>Shutter Button \u2013<\/strong> The Digital Crown is also accompanied by a shutter button that allows you to capture 3-dimensional photos and videos, that can be viewed within the Vision Pro headset.<\/p>\n<p><strong>Battery \u2013<\/strong> Lastly, the Vision Pro has an independent battery unit that attaches using a proprietary connector to the headset. The reason the headset has a separate battery pack is to help reduce the weight of the headset itself, which already uses metal and glass. Given how heavy batteries are, an independent battery helps distribute the load. Apple hasn\u2019t shared the milliamp-hour capacity of the battery, but they did mention that it gives you 2 hours of usage on a full charge. How the battery charges hasn\u2019t been mentioned either.<\/p>\n<p><noscript><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-438801\" src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_6.jpg\" alt=\"\" width=\"1280\" height=\"853\" data-jpibfi-post-excerpt=\"\" data-jpibfi-post-url=\"https:\/\/www.yankodesign.com\/2023\/06\/07\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/\" data-jpibfi-post-title=\"Every Single Sensor inside the Apple Vision Pro and What It\u2019s Individually Designed To Do\" data-jpibfi-src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_6.jpg\"><\/noscript><img loading=\"lazy\" decoding=\"async\" class=\"lazyload alignnone size-full wp-image-438801\" src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_6.jpg\" alt=\"\" width=\"1280\" height=\"853\" data-jpibfi-post-excerpt=\"\" data-jpibfi-post-url=\"https:\/\/www.yankodesign.com\/2023\/06\/07\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/\" data-jpibfi-post-title=\"Every Single Sensor inside the Apple Vision Pro and What It\u2019s Individually Designed To Do\" data-jpibfi-src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_6.jpg\"><\/p>\n<p><noscript><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-438802\" src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_7.jpg\" alt=\"\" width=\"1280\" height=\"853\" data-jpibfi-post-excerpt=\"\" data-jpibfi-post-url=\"https:\/\/www.yankodesign.com\/2023\/06\/07\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/\" data-jpibfi-post-title=\"Every Single Sensor inside the Apple Vision Pro and What It\u2019s Individually Designed To Do\" data-jpibfi-src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_7.jpg\"><\/noscript><img loading=\"lazy\" decoding=\"async\" class=\"lazyload alignnone size-full wp-image-438802\" src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_7.jpg\" alt=\"\" width=\"1280\" height=\"853\" data-jpibfi-post-excerpt=\"\" data-jpibfi-post-url=\"https:\/\/www.yankodesign.com\/2023\/06\/07\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/\" data-jpibfi-post-title=\"Every Single Sensor inside the Apple Vision Pro and What It\u2019s Individually Designed To Do\" data-jpibfi-src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_7.jpg\"><\/p>\n<p><noscript><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-438803\" src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_8.jpg\" alt=\"\" width=\"1280\" height=\"853\" data-jpibfi-post-excerpt=\"\" data-jpibfi-post-url=\"https:\/\/www.yankodesign.com\/2023\/06\/07\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/\" data-jpibfi-post-title=\"Every Single Sensor inside the Apple Vision Pro and What It\u2019s Individually Designed To Do\" data-jpibfi-src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_8.jpg\"><\/noscript><img loading=\"lazy\" decoding=\"async\" class=\"lazyload alignnone size-full wp-image-438803\" src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_8.jpg\" alt=\"\" width=\"1280\" height=\"853\" data-jpibfi-post-excerpt=\"\" data-jpibfi-post-url=\"https:\/\/www.yankodesign.com\/2023\/06\/07\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/\" data-jpibfi-post-title=\"Every Single Sensor inside the Apple Vision Pro and What It\u2019s Individually Designed To Do\" data-jpibfi-src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_8.jpg\"><\/p>\n<p><noscript><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-438804\" src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_9.jpg\" alt=\"\" width=\"1280\" height=\"853\" data-jpibfi-post-excerpt=\"\" data-jpibfi-post-url=\"https:\/\/www.yankodesign.com\/2023\/06\/07\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/\" data-jpibfi-post-title=\"Every Single Sensor inside the Apple Vision Pro and What It\u2019s Individually Designed To Do\" data-jpibfi-src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_9.jpg\"><\/noscript><img loading=\"lazy\" decoding=\"async\" class=\"lazyload alignnone size-full wp-image-438804\" src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_9.jpg\" alt=\"\" width=\"1280\" height=\"853\" data-jpibfi-post-excerpt=\"\" data-jpibfi-post-url=\"https:\/\/www.yankodesign.com\/2023\/06\/07\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/\" data-jpibfi-post-title=\"Every Single Sensor inside the Apple Vision Pro and What It\u2019s Individually Designed To Do\" data-jpibfi-src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_9.jpg\"><\/p>\n<p><noscript><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-438799\" src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_4.jpg\" alt=\"\" width=\"1280\" height=\"827\" data-jpibfi-post-excerpt=\"\" data-jpibfi-post-url=\"https:\/\/www.yankodesign.com\/2023\/06\/07\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/\" data-jpibfi-post-title=\"Every Single Sensor inside the Apple Vision Pro and What It\u2019s Individually Designed To Do\" data-jpibfi-src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_4.jpg\"><\/noscript><img loading=\"lazy\" decoding=\"async\" class=\"lazyload alignnone size-full wp-image-438799\" src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_4.jpg\" alt=\"\" width=\"1280\" height=\"827\" data-jpibfi-post-excerpt=\"\" data-jpibfi-post-url=\"https:\/\/www.yankodesign.com\/2023\/06\/07\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/\" data-jpibfi-post-title=\"Every Single Sensor inside the Apple Vision Pro and What It\u2019s Individually Designed To Do\" data-jpibfi-src=\"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/every_sensor_on_apple_vision_pro_4.jpg\"><\/p>\n<div class=\"swp-content-locator\"><\/div>\n<div class=\"code-block code-block-5' style=\" margin: clear: both>\n<amp-ad width=\"100vw\" height=\"320\" type=\"adsense\" data-ad-client=\"ca-pub-0648786275385337\" data-ad-slot=\"9466393889\" data-auto-format=\"rspv\" data-full-width=\"\"><\/p>\n<div overflow=\"\"><\/div>\n<p><\/amp-ad><\/div>\n<\/div>\n<p><span class=\"vcard author\"><br \/>\n<span>By<\/span><\/p>\n<p><span>Sarang Sheth<\/span><\/p>\n<p><\/span><\/p>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMLG0nwswvr63Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\">For forums sites go to <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/forum.buradabiliyorum.com\/\" target=\"_blank\" rel=\"noopener\">Forum.BuradaBiliyorum.Com<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more like this article, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/en.buradabiliyorum.com\/technology\/\" target=\"_blank\" rel=\"noopener\">Technology<\/a><\/span> category.<\/strong><\/p>\n<\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/www.yankodesign.com\/2023\/06\/07\/every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\/?utm_source=rss&#038;utm_medium=rss&#038;utm_campaign=every-single-sensor-in-the-apple-vision-pro-and-what-its-individually-designed-to-do\" target=\"_blank\" rel=\"noopener\">Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>For a $3,499 USD device that\u2019s designed to replace your phone, laptop, watch, tablet, television, and even your mouse, you bet that Apple\u2019s Vision Pro is absolutely crammed with sensors that track you, your movements, eyesight, gestures, voice commands, and your position in space. As per Apple\u2019s own announcement, the Vision Pro has as many&#8230;<\/p>\n","protected":false},"author":1,"featured_media":577744,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/www.yankodesign.com\/images\/design_news\/2023\/06\/every-single-sensor-in-the-apple-vision-pro-and-what-its-designed-to-do\/every_sensor_on_apple_vision_pro_1.jpg","fifu_image_alt":"","footnotes":""},"categories":[18],"tags":[5029,126220,143755,121675,143715],"class_list":["post-577743","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology","tag-apple","tag-sensor","tag-vision-pro","tag-vr-headset","tag-wwdc"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/577743","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=577743"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/577743\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/577744"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=577743"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=577743"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=577743"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}