Augmented Reality (real-time) Patents (Class 345/633)
-
Patent number: 11525695Abstract: There is provided a system for displaying information to a user of a vehicle, including a smart glass for displaying the information as three dimensional (3D) elements, a navigation-assisting component and a central database, wherein the smart glass and the navigation-assisting component are in communication with the central database. This database stores the information and aids in sending and displaying relevant and updated information on the smart glass in real-time, depending on a location through which the vehicle is being maneuvered. Further, the information is displayed on the smart glass through markerless Augmented Reality (AR) technology, thereby eliminating a need for external devices or projectors for displaying the information.Type: GrantFiled: January 6, 2020Date of Patent: December 13, 2022Inventor: Ahmad Suleiman Ahmad Almousa
-
Patent number: 11528198Abstract: Augmented/mixed reality virtual venue pipeline optimization is provided. A method can include acquiring, by a device comprising a processor, information relating to a group of augmented reality applications operating in an area; designating, by the device, an augmented reality application of the group of augmented reality applications as a priority application based on the information relating to the group of augmented reality applications; and granting, by the device, prioritized access to edge network resources in a sub-area comprising at least a portion of the area to the priority application relative to at least one non-priority application of the group of augmented reality applications.Type: GrantFiled: August 31, 2021Date of Patent: December 13, 2022Assignee: AT&T Intellectual Property I, L.P.Inventors: John Oetting, Claude Noshpitz
-
Patent number: 11527044Abstract: A method for providing a personalized augmented reality (AR) display includes obtaining, at an augmented reality apparatus, image data of a camera field of view, the camera field of view covering a field of view of an externally oriented camera of the augmented reality apparatus, identifying a first object in the camera field of view based on the image data, and mapping a position of the first object relative to an augmented reality (AR) field of view. The method further includes determining, based on the identity of the first object, whether the first object is an augmentation target, and responsive to determining that the first object is the augmentation target, displaying, on the internally-facing display, an item of AR content associated with the augmentation target in the AR field of view.Type: GrantFiled: February 12, 2019Date of Patent: December 13, 2022Assignee: Samsung Electronics Co., Ltd.Inventors: Sridhar Kocharlakota, Moiz Sonasath
-
Patent number: 11521026Abstract: In example embodiments, techniques are provided to automatically classify individual elements of an infrastructure model by training one or more machine learning algorithms on classified infrastructure models, producing a classification model that maps features to classification labels, and utilizing the classification model to classify the individual elements of the infrastructure model. The resulting classified elements may then be readily subject to analytics, for example, enabling the display of dashboards for monitoring project performance and the impact of design changes. Such techniques enable classification of elements of new infrastructure models or in updates to existing infrastructure models.Type: GrantFiled: September 28, 2020Date of Patent: December 6, 2022Assignee: Bentley Systems, IncorporatedInventors: Marc-André Lapointe, Karl-Alexandre Jahjah, Hugo Bergeron, Kaustubh Page
-
Patent number: 11522945Abstract: The invention generally relates to managing and sharing augmented reality (AR) content, and, more specifically, to an AR platform providing synchronized sharing of AR content in real time across multiple AR devices.Type: GrantFiled: October 20, 2020Date of Patent: December 6, 2022Assignee: Iris Tech Inc.Inventors: Nicholas Rafkind, Steve Lukas
-
Patent number: 11521349Abstract: A virtual reality (VR) system that includes a three-dimensional (3D) point cloud having a plurality of points, a VR viewer having a current position, a graphics processing unit (GPU), and a central processing unit (CPU). The CPU determines a field-of-view (FOV) based at least in part on the current position of the VR viewer, selects, using occlusion culling, a subset of the points based at least in part on the FOV, and provides them to the GPU. The GPU receives the subset of the plurality of points from the CPU and renders an image for display on the VR viewer based at least in part on the received subset of the plurality of points. The selecting a subset of the plurality of points is at a first frame per second (FPS) rate and the rendering is at a second FPS rate that is faster than the first FPS rate.Type: GrantFiled: September 10, 2018Date of Patent: December 6, 2022Assignee: FARO TECHNOLOGIES, INC.Inventors: Manuel Caputo, Louis Bergmann
-
Patent number: 11521189Abstract: Methods and systems are disclosed for collecting and releasing virtual objects between disparate augmented reality environments. One method comprises receiving user selection to collect an object in a first environment displayed on a user device at a first time. A search request may then be transmitted to a content server from which a virtual object corresponding to the collected object is received in response. The virtual object may be stored in a user library associated with a user identifier of the user. When a second environment is displayed on the user device, the virtual object may be added to the second environment in response to receiving user selection to add the virtual object and determining that the user is associated with the user identifier.Type: GrantFiled: November 15, 2019Date of Patent: December 6, 2022Assignee: Worldpay LimitedInventors: Kevin Gordon, Charlotte Spender
-
Patent number: 11523246Abstract: Provided is an information processing apparatus that includes a determination unit and a display control unit. The determination unit obtains a position of a virtual object relative to a display region and determines whether or not a correction allowable region set in a region different from the virtual object overlaps at least a part of the display region when the virtual object is located outside the display region. The display control unit causes at least a part of a display object showing the virtual object in the display region to be displayed in a case where the determination unit determines that the correction allowable region overlaps at least the part of the display region.Type: GrantFiled: July 1, 2019Date of Patent: December 6, 2022Assignee: SONY CORPORATIONInventors: Yasuyuki Koga, Kei Nitta
-
Patent number: 11516412Abstract: An image processing method, an image processing apparatus, an electronic device and a computer readable storage medium are provided. The image processing method includes the following. A background image and a portrait region image of a current user that a preset parameter of the background image matching the preset parameter of the portrait region image are acquired. The portrait region image and the background image are merged to obtain a merged image.Type: GrantFiled: March 11, 2020Date of Patent: November 29, 2022Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.Inventor: Xueyong Zhang
-
Patent number: 11504609Abstract: A head mounted display (HMD) is provided. The HMD includes a housing and a view port of the housing. The view port has a screen for rendering an augmented reality scene. Included is a communications device for exchanging streaming data over a network. A depth camera integrated in the housing and oriented to capture depth data of an environment in front of the housing is included. A processor is configured to use the depth data captured by the depth camera to identify spatial positioning of real objects in the environment. A real object is rendered into the augmented reality scene, and the real object is tracked such that insertion of augmented reality objects are placed in coordination with movements of the real object shown in the augmented reality scene. The real object captured by the depth camera is the environment where a user wearing the HMD is located.Type: GrantFiled: April 27, 2021Date of Patent: November 22, 2022Assignee: Sony Interactive Entertainment Inc.Inventors: Anton Mikhailov, Xiadong Mao
-
Patent number: 11508098Abstract: A supervisory computer vision (CV) system may include a secondary CV system running in parallel with a native CV system on a mobile device. The secondary CV system is configured to run less frequently than the native CV system. CV algorithms are then run on these less-frequent sample images, generating information for localizing the device to a reference point cloud (e.g., provided over a network) and for transforming between a local point cloud of the native CV system and the reference point cloud. AR content may then be consistently positioned relative to the convergent CV system's coordinate space and visualized on a display of the mobile device. Various related algorithms facilitate the efficient operation of this system.Type: GrantFiled: June 28, 2021Date of Patent: November 22, 2022Assignee: YouAR INC.Inventors: Oliver Clayton Daniels, George Howard Alexander Blikas
-
Patent number: 11504624Abstract: A method and apparatus for controlling a movement of a virtual object in AR, and a terminal are provided. The method includes: a virtual moving area is generated within a current image capture range of a control device; a virtual object is generated in the virtual moving area; and a position of a virtual identifier in the virtual moving area is adjusted according to a real movement of the control device, and the virtual object is guided to virtually move according to the position of the virtual identifier. The present disclosure solves a technical problem in the related art that a joystick-based racing control mode provided in an AR scene is complex and game experience is poor.Type: GrantFiled: February 25, 2019Date of Patent: November 22, 2022Assignee: NETEASE (HANGZHOU) NETWORK CO., LTD.Inventor: Hua Rong
-
Patent number: 11508151Abstract: Systems and methods are provided for depicting information about a vehicle in augmented reality. An exemplary method may include determining identification information of a vehicle based on input received from a client device and obtaining, from an information source, vehicle information based on the identification information. The method may also include analyzing the vehicle information using an artificial intelligence engine and extracting vehicle history data from the vehicle information based on the analysis. The method may also include identifying a portion of the vehicle associated with the vehicle history data and providing instructions, based on the vehicle history data, to an augmented reality-enabled device to superimpose an indicator on a visual representation of the vehicle at a location corresponding to the portion of the vehicle.Type: GrantFiled: April 27, 2021Date of Patent: November 22, 2022Assignee: Capital One Services, LLCInventors: Satish Chikkaveerappa, Liju Mathews, Ponnazhakan Subramanian
-
Patent number: 11507246Abstract: The disclosure provides a method for dynamically showing a virtual boundary, an electronic device and a computer readable storage medium thereof. The method includes: obtaining a virtual scene boundary of a virtual reality (VR) environment; determining a distance threshold based on a moving speed of a specific element of a VR system, wherein the specific distance threshold is positively related to the moving speed of the specific element; monitoring a specific distance between the specific element and the virtual scene boundary of the VR environment; in response to determining that the specific distance is smaller than the distance threshold, showing the virtual scene boundary of the VR environment.Type: GrantFiled: October 7, 2020Date of Patent: November 22, 2022Assignee: HTC CorporationInventors: Yen-Hung Lin, Ying-Jing Wang
-
Patent number: 11500660Abstract: A system is provided for recommending guidance instructions to a user. The system includes a memory having computer readable instructions and a processor for executing the computer readable instructions. The computer readable instructions control the processor to perform operations of monitoring an ongoing task comprising at least one act performed by a user, generating image data depicting the ongoing task, and displaying the ongoing task based on the image data. The system analyzes the ongoing task and generates an augmented image. The augmented image is overlaid on the image data so that the augmented image is displayed simultaneously with the ongoing task to direct the user to progress the ongoing task.Type: GrantFiled: November 20, 2020Date of Patent: November 15, 2022Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Shikhar Kwatra, Sarbajit K. Rakshit, Jeremy R. Fox
-
Patent number: 11500511Abstract: A computer-implemented method of diagnosing a technology environment using augmented reality may include: receiving status information corresponding to the technology environment; generating, based on the status information, a 3D visualization of the technology environment; causing an augmented reality device to display the 3D visualization, the 3D visualization including one or more first level icons; receiving first selection information from the augmented reality device, the first selection information corresponding to a first selection gesture performed by a user of the augmented reality device; and in response to the first selection information, causing the augmented reality device to display one or more second level icons as part of the 3D visualization.Type: GrantFiled: May 25, 2021Date of Patent: November 15, 2022Assignee: Capital One Services, LLCInventors: Arunkumar Natarajan, Omari Felix, Colleen Frank, Venkata Mandali
-
Patent number: 11493988Abstract: In some examples, an electronic device receives selection of a target image relating to an augmented reality presentation, displays, in a display screen of the electronic device, captured visual data of an environment acquired by the electronic device, and displays, in the display screen, guidance information relating to the target image to assist a user in finding a physical target, corresponding to the target image, in the captured visual data of the environment.Type: GrantFiled: April 29, 2016Date of Patent: November 8, 2022Assignee: Hewlett-Packard Development Company, L.P.Inventors: David Clinton Joiner, Marcus Thomas
-
Patent number: 11495001Abstract: A system of properly displaying chroma key content is presented. The system obtains a digital representation of a 3D environment, for example a digital photo, and gathers data from that digital representation. The system renders the digital representation in an environmental model and displays that digital representation upon an output device. Depending upon the context, content anchors of the environmental model are selected which will be altered by suitable chroma key content. The chroma key content takes into consideration the position and orientation of the chroma key content relative to the content anchor and relative to the point of view that the environmental model is displayed from in order to accurately display chroma key content in a realistic manner.Type: GrantFiled: June 30, 2020Date of Patent: November 8, 2022Assignee: NANTMOBILE, LLCInventors: Evgeny Dzhurinskiy, Ludmila Bezyaeva
-
Patent number: 11494960Abstract: A display assembly generates environmentally matched virtual content for an electronic display. The display assembly includes a display controller and a display. The display controller is configured to estimate environmental matching information for a target area within a local area based in part on light information received from a light sensor. The target area is a region for placement of a virtual object. The light information describes light values. The display controller generates display instructions for the target area based in part on a human vision model, the estimated environmental matching information, and rendering information associated with the virtual object. The display is configured to present the virtual object as part of artificial reality content in accordance with the display instructions. The color and brightness of the virtual object is environmentally matched to the portion of the local area surrounding the target area.Type: GrantFiled: June 15, 2021Date of Patent: November 8, 2022Assignee: Meta Platforms Technologies, LLCInventors: Jiangtao Kuang, Edward Buckley, Honghong Peng, Sapna Shroff, Romain Bachy
-
Patent number: 11494988Abstract: Novel tools and techniques are provided for implementing augmented reality (AR)-based assistance within a work environment. In various embodiments, a computing system might receive, from a camera having a field of view of a work environment, first images of at least part of the work environment, the first images overlapping with a field of view of a user wearing an AR headset; might analyze the received first images to identify objects; might query a database(s) to determine a task associated with a first object(s) among the identified objects; might generate an image overlay providing at least one of graphical icon-based, text-based, image-based, and/or highlighting-based instruction(s) each indicative of instructions presented to the user to implement the task associated with the first object(s); and might display, to the user's eyes through the AR headset, the generated first image overlay that overlaps with the field of view of the user's eyes.Type: GrantFiled: May 21, 2019Date of Patent: November 8, 2022Assignee: AGILENT TECHNOLOGIES, INC.Inventors: Amir Ben-Dor, Elad Arbel, Richard Workman, Victor Lim
-
Patent number: 11493764Abstract: The invention provides a method for dynamically displaying real-world scene, an electronic device and a computer readable medium. The method includes: obtaining a virtual scene boundary of a virtual reality environment; monitoring a specific distance between a specific element in a virtual reality system and the virtual scene boundary; in response to determining that the specific distance ranges between a first threshold and a second threshold, displaying a see-through window in a virtual reality content of the virtual reality environment, wherein the see-through window displays a real-world scene.Type: GrantFiled: June 4, 2020Date of Patent: November 8, 2022Assignee: HTC CorporationInventor: Yi-Hsin Chang
-
Patent number: 11494951Abstract: An example method performed by a processing system includes receiving a request from a first user to render an extended reality environment, wherein the request includes a definition of a first policy that governs user behavior within the extended reality environment, rendering the extended reality environment by presenting content contributed by at least one user in the extended reality environment, monitoring the extended reality environment to ensure that the rendering results in a compliance of the extended reality environment with the first policy, detecting that a portion of the content contributed by at least one other user of the extended reality environment results in the extended reality environment failing to comply with the first policy, and modifying a presentation of the portion of content in the extended reality environment in response to the detecting, wherein the modifying results in the compliance of the extended reality environment with the first policy.Type: GrantFiled: July 24, 2020Date of Patent: November 8, 2022Assignees: AT&T Intellectual Property I, L.P., AT&T Mobility II LLCInventors: John Oetting, Eric Zavesky, James Pratt, Jason Decuir, Terrel Lecesne
-
Patent number: 11496691Abstract: A system for illuminating a character for a scene includes a computing platform communicatively coupled to a lighting source and a camera, the computing platform including a hardware processor and a system memory storing a software code. The hardware processor executes the software code to identify a background for the scene, generate, using the lighting source, a simulation of the background on a surface illuminated by the lighting source, and utilize the simulation of the background generated on the surface illuminated by the lighting source to illuminate the character for the scene. The hardware processor also executes the software code to track, using the camera, a plurality of parameters of the camera during recording of an image of the illuminated character and the simulation of the background, and to remove the simulation of the background from the image based on the plurality of parameters of the camera.Type: GrantFiled: December 16, 2019Date of Patent: November 8, 2022Assignee: Disney Enterprises, Inc.Inventors: Steven M. Chapman, Alice Taylor, Joseph Popp
-
Patent number: 11493999Abstract: Some embodiments of a method may include tracking a distance between a local VR device and a remote VR device; selecting an experience-sharing mode from a plurality of experience-sharing modes based on the tracked distance; and providing a different degree of immersive user experience to a user at the local VR device depending on the selected experience-sharing mode, wherein as the distance between the local VR device and the remote VR device decreases, the experience-sharing mode changes and the degree of immersive user experience increases. Some embodiments of another method may include detecting a gesture made by a user; selecting an immersiveness mode from a plurality of immersiveness modes based on the detected gesture; and providing a degree of immersive user experience to a local VR device user depending on the selected immersiveness mode.Type: GrantFiled: April 26, 2019Date of Patent: November 8, 2022Assignee: PMCS HOLDINGS, INC.Inventors: Tatu V. J. Harviainen, Marko Palviainen
-
Patent number: 11487353Abstract: In certain embodiments, a sensing and tracking system detects objects, such as user input devices or peripherals, and user interactions with them. A representation of the objects and user interactions are then injected into the virtual reality environment. The representation can be an actual reality, augmented reality, virtual representation or any combination. For example, an actual keyboard can be injected, but with the keys pressed being enlarged and lighted.Type: GrantFiled: December 31, 2020Date of Patent: November 1, 2022Assignee: Logitech Europe S.A.Inventors: Stephen Harvey, Denis O'Keeffe, Andreas Connellan, Damien O'Sullivan, Aidan Kehoe, Noirin Curran, Thomas Rouvinez, Mario Gutierrez, Olivier Riviere, Remy Zimmermann, Mathieu Meisser, Dennin Onorio, Ciaran Trotman, Pierce O'Bradaigh, Marcel Twohig, Padraig Murphy, Jerry Ahern
-
Patent number: 11487354Abstract: There is provided an information processing apparatus, an information processing method, and a program that make it possible to improve usability in information presentation. The information processing apparatus includes a recognition unit configured to recognize a shift in gaze and a move of a head of a user; and a display controller configured to control display of information on a subject according to the move of the head that is made after the gaze is turned to the subject.Type: GrantFiled: January 10, 2019Date of Patent: November 1, 2022Assignee: SONY CORPORATIONInventor: Kenji Sugihara
-
Patent number: 11481034Abstract: A low-power object tracking system is disclosed that includes an object tracking device that senses one or more magnetic field(s) to determine a position of the object tracking device. The object tracking device includes a magnetic field sensor including one or more receiving coils and position tracking circuitry in communication with the magnetic field sensor. The position tracking circuitry is configured to determine at least one field strength associated with at least one stationary magnetic field sensed at the one or more receiving coils, and to determine position information associated with the housing based at least in part on the at least one field strength. The object tracking device includes a communication interface configured to transmit the position information to at least one remote computing device.Type: GrantFiled: October 24, 2019Date of Patent: October 25, 2022Assignee: GOOGLE LLCInventor: Alejandro Kauffmann
-
Patent number: 11481999Abstract: A maintenance work support system comprising: a database in which support information for supporting maintenance work is registered; a camera-image acquisition unit configured to acquire a camera-image imaged by a camera that is mounted on a terminal possessed by a worker performing the maintenance work; a position/attitude estimation unit configured to estimate a position and attitude of the terminal based on information that is obtained by at least one device mounted on the terminal; a target recognition unit configured to recognize a target of the maintenance work depicted in the camera-image; and a superimposed display unit configured to perform display processing in such a manner that the support information corresponding to the target acquired from the database is superimposed on least part of an image of the target visually recognized by the worker.Type: GrantFiled: November 1, 2019Date of Patent: October 25, 2022Assignees: KABUSHIKI KAISHA TOSHIBA, TOSHIBA ENERGY SYSTEMS & SOLUTIONS CORPORATIONInventors: Tomomi Hishinuma, Kenji Osaki
-
Patent number: 11481965Abstract: An augmented reality (AR) device supporting an AR is provided. The AR device includes a display, a communication circuit, at least one processor operatively connected to the display and the communication circuit, and a memory operatively connected to the at least one processor. The memory stores instructions that, when executed, cause the at least one processor to establish a connection with a user device storing a contact application and a message application, through the communication circuit, detect that the message application is executed, and display a first graphic user interface (GUI) and at least one avatar, which is disposed at a location adjacent to the first GUI and corresponds to at least one contact associated with the contact application or the message application, through the display in the AR.Type: GrantFiled: April 5, 2021Date of Patent: October 25, 2022Assignee: Samsung Electronics Co., Ltd.Inventors: Stephanie Kim Ahn, Aaron Samuel Faucher, Andrew R McHugh, Edgar Charles Evangelista, Jaehyun Kim
-
Patent number: 11483253Abstract: A network resource pushing method, a device, and a storage medium. The method comprises: a server receiving information of a network resource accessed by a user, and information of the environment of the user when the user accessed the network resource (101); the server applying, according to the information of the environment of the user, a pre-established scenario determination model to determine a user scenario (102); the server establishing an association model between the user scenario and the type of network resource accessed by the user (103); and the server receiving information of a current environment of the user, applying the scenario determination model to determine a current scenario corresponding to the information of the current environment of the user, and pushing to the user, according to the association model, a network resource having a type corresponding to the determined current scenario (104).Type: GrantFiled: January 3, 2020Date of Patent: October 25, 2022Assignees: Beijing Jingdong Shangke Information Technology Co., Ltd., Beijing Jingdong Century Trading Co., Ltd.Inventor: Xinming Yao
-
Patent number: 11483156Abstract: A method that includes receiving, via processing circuitry of a server, a unique identifier having encoded data included in a reference patch embedded in displayed data received by an electronic device, the electronic device being instructed to display the displayed data in a first layer of the electronic device, the server being inaccessible by the first layer of the electronic device; identifying an identity of a user based on the unique identifier of the reference patch; upon determining the user is authorized to receive the secondary digital content, transmitting the secondary digital content to the electronic device; and instructing the electronic device to display the secondary digital content in a second layer of the electronic device, the server being accessible by the second layer of the electronic device, the first layer of the electronic device being different from the second layer of the electronic device.Type: GrantFiled: February 18, 2022Date of Patent: October 25, 2022Assignee: Mobeus Industries, Inc.Inventors: Dharmendra Etwaru, David Casper
-
Patent number: 11481963Abstract: Systems, methods, and non-transitory computer readable media configured for enabling content sharing between users of wearable extended reality appliances are provided. In one implementation, the computer readable medium may be configured to contain instructions to cause at least one processor to establish a link between a first wearable extended reality appliance and a second wearable extended reality appliance. The first wearable extended reality appliance may display first virtual content. The second wearable extended reality appliance may obtain a command to display first virtual content via the second wearable extended reality appliance, and in response, this content may be transmitted and displayed via the second extended reality appliance. Additionally, the first wearable extended reality appliance may receive second virtual content from the second wearable extended reality appliance, and display said second virtual content via the first wearable extended reality appliance.Type: GrantFiled: April 5, 2022Date of Patent: October 25, 2022Assignee: MULTINARITY LTDInventors: Tamir Berliner, Tomer Kahan, Orit Dolev
-
Patent number: 11483470Abstract: A control apparatus configured to control an image-capturing apparatus executes focus adjustment of the image-capturing apparatus in response to detection of a specific marker pattern from an image of an area to be focused by the image-capturing apparatus in an image acquired by image-capturing of the image-capturing apparatus.Type: GrantFiled: July 28, 2020Date of Patent: October 25, 2022Assignee: CANON KABUSHIKI KAISHAInventor: Yasushi Shikata
-
Patent number: 11481980Abstract: A system and method for allowing a smooth transition between a public digital reality experience into a private digital reality experience. A cloud server delimitates a public digital zone where interactions with digital reality applications stored in the cloud server and corresponding digital content are viewable to all users in the public digital zone. When users access the public digital zone, the cloud server detects the users and provides digital content from the digital reality to the users via digital reality devices. Upon reaching predetermined levels of interaction, users may access a personal digital reality view, whereby a smooth transition from a public to a personal digital reality experience takes place, prompting a specific portion of computing power from the cloud server to be dedicated to the specific user to enable personal interactions with the digital content. Users may also invite other users to engage in a multi-user private streaming.Type: GrantFiled: August 20, 2019Date of Patent: October 25, 2022Assignee: THE CALANY HOLDING S.Á´ R.L.Inventor: Cevat Yerli
-
Patent number: 11475639Abstract: The disclosed artificial reality system can provide a user self representation in an artificial reality environment based on a self portion from an image of the user. The artificial reality system can generate the self representation by applying a machine learning model to classify the self portion of the image. The machine learning model can be trained to identify self portions in images based on a set of training images, with portions tagged as either depicting a user from a self-perspective or not. The artificial reality system can display the self portion as a self representation in the artificial reality environment by positioning them in the artificial reality environment relative to the user's perspective in the artificial reality environment. The artificial reality system can also identify movements of the user and can adjust the self representation to match the user's movement, providing more accurate self representations.Type: GrantFiled: January 3, 2020Date of Patent: October 18, 2022Assignee: Meta Platforms Technologies, LLCInventors: James Allen Booth, Mahdi Salmani Rahimi, Gioacchino Noris
-
Patent number: 11475636Abstract: Embodiments of the present disclosure relate to techniques for providing an augmented reality experience for virtual desktops. In particular, certain embodiments relate to acquiring, by a computing device one or more images from a client device and determining, by the computing device, that the one or more images contain an artifact to be augmented. Further, certain embodiments involve acquiring, by the computing device, a screen buffer from a virtual desktop or application running on it and applying, by the computing device, a geometric transformation to the screen buffer. Further, certain embodiments relate to augmenting, by the computing device, the one or more images by inserting the screen buffer onto the artifact, resulting in one or more augmented images. Further, certain embodiments relate to providing, by the computing device, the one or more augmented images to the client device in order to provide a user of the client device with the augmented reality experience.Type: GrantFiled: February 5, 2018Date of Patent: October 18, 2022Assignee: VMWARE, INC.Inventor: Shubham Verma
-
Patent number: 11474610Abstract: A system includes one or more sensors configured to detect first motion data of a head mounted display (HMD) and second motion data of a hand device associated with the HMD. The system includes processing circuitry configured to identify one or more obstacles in an environment around the HMD. The processing circuitry is configured to provide, using the HMD, display data representing a warning regarding potential collision with the one or more obstacles in response to at least one of the first motion data or the second motion data and a distance between the HMD and the one or more obstacles or the hand device and the one or more obstacles.Type: GrantFiled: May 20, 2019Date of Patent: October 18, 2022Assignee: Meta Platforms Technologies, LLCInventor: Eugene Lee
-
Patent number: 11475650Abstract: A method for facilitating an environmentally adaptive extended reality display in a physical environment includes virtually displaying content via a wearable extended reality appliance operating in the physical environment, wherein displaying content via the wearable extended reality appliance is associated with at least one adjustable extended reality display parameter. Image data is obtained from the wearable extended reality appliance and a specific environmental change unrelated to the virtually displayed content is detected in the image data. A group of rules associating environmental changes with changes in the at least one adjustable extended reality display parameter is accessed and a specific rule of the group of rules is determined, the specific rule corresponding to the specific environmental change. The specific rule is implemented to adjust the at least one adjustable extended reality display parameter based on the specific environmental change.Type: GrantFiled: April 1, 2022Date of Patent: October 18, 2022Assignee: MULTINARITY LTDInventors: Tamir Berliner, Tomer Kahan, Orit Dolev
-
Patent number: 11475582Abstract: The method performed at an electronic device including one or more processors, a non-transitory memory, and a depth sensor includes: obtaining a task associated with a physical object within a physical environment; obtaining depth information, via the depth sensor, associated with the physical environment; determining one or more measurements for the physical object based at least in part on the depth information; obtaining a graphical overlay based at least in part on the task and the one or more measurements for the physical object; and causing presentation of the graphical overlay adjacent to a representation of the physical object, wherein the representation is obtained using sensor readings of the physical object.Type: GrantFiled: May 18, 2021Date of Patent: October 18, 2022Assignee: APPLE INC.Inventors: Austin Caleb Germer, Vincent Paul Sparacino, Adam James Bolton, Tomas Alvarez Rodriguez, Ryan Steven Bullock, Lori Lenore Smallwood
-
Patent number: 11467247Abstract: An embodiment includes at least one computer readable storage medium comprising instructions that when executed enable a system to: receive (a)(i) first radio signal location data for a first object from a radio sensor; and (a)(ii) first visual signal location data for the first object from a camera sensor; perform feature extraction on (b)(i) the first radio signal location data to determine first extracted radio signal features; and (b)(ii) the first visual signal location data to determine first extracted visual signal features; solve a first association problem between the first extracted radio signal features and the first extracted visual signal features to determine first fused location data; and store the first fused location data in the at least one computer readable storage medium. Other embodiments are described herein.Type: GrantFiled: November 30, 2020Date of Patent: October 11, 2022Assignee: Intel CorporationInventors: Mi S. Park, Lei Yang, Shao-Wen Yang, Myung Hwangbo, Shahrokh Shahidzadeh
-
Patent number: 11468605Abstract: A method is provided for rendering a mixed reality video. The method includes operations for capturing a head mounted display (HMD) game play by a user of a video game that is being executed on a computing system where the HMD game play is being captured from game play point of view (POV). The method further includes operations for identifying, by the computing system, a coordinate location of a camera that has a camera POV used to view the user during the HMD game play. In addition, the method further includes replaying the HMD game play to adjust the game play POV so that it substantially aligns with the camera POV. Moreover, the method includes rendering the mixed reality video by compositing video from the HMD game play after adjusting the game play POV and video from the camera POV. Rendering the mixed reality video also includes removing the background captured in the video from the camera POV so that the user appears partially within a scene of the video game when rendered in the mixed reality video.Type: GrantFiled: December 12, 2019Date of Patent: October 11, 2022Assignee: Sony Interactive Entertainment Inc.Inventor: Greg Corson
-
Patent number: 11468606Abstract: A method for aligning displayed data in an augmented reality (AR) display includes determining a selected location context associated with a piece of equipment, determining a process element associated with the piece of equipment and according to a selected engineering process, determining, according to a digital representation of the equipment, a first location of the process element, receiving meta-sensor location data for one or more meta-sensors in the piece of equipment and indicating a second location for each of the meta-sensors with respect to the selected location context, determining a third location of the AR display with respect to the selected location context, determining overlay data for the process element, determining a display location according to the first location, the third location and the location data of each meta-sensor, and displaying the overlay data at the display location.Type: GrantFiled: August 27, 2020Date of Patent: October 11, 2022Assignee: TEXTRON INNOVATIONS INC.Inventors: Jeremy Robert Chavez, Daniel Wesley Rowe, Michael Eugene Moody, Brian Edward Tucker
-
Patent number: 11467428Abstract: An apparatus to treat refractive error of an eye comprises an electroactive component configured to switch between a light scattering or optical power providing configuration to treat refractive error of the eye and a substantially transparent configuration to allow normal viewing. The electroactive component can be located on the lens away from a central axis of the lens to provide light to a peripheral region of the retina to decrease the progression of myopia. The electroactive component can be located on the lens away from the central axis of the lens in order for the wearer to view objects through an optical zone while the electroactive component scatters light. The electroactive component can be configured to switch to the substantially transparent configuration to allow light to pass through the electroactive component and to allow the lens to refract light to correct vision and allow normal viewing through the lens.Type: GrantFiled: March 29, 2022Date of Patent: October 11, 2022Assignee: ACUCELA INC.Inventors: Ryo Kubota, Amitava Gupta
-
Patent number: 11467180Abstract: A distributed computing system for artificial intelligence in autonomously appreciating a circumstance context of a smart device. Raw context data is detected by sensors associated with the smart device. The raw context data is pre-processed by the smart device and then provided to a cloud based server for further processing. At the cloud based server, various sets of feature data are obtained from the pre-processed context data. The various sets of feature data are compared with corresponding classification parameters to determine a classification of a continuous event and/or a classification of transient event, if any, which occur in the context. The determined classification of the continuous event and the transient event will be used to autonomously configure the smart device or another related smart device to fit the context.Type: GrantFiled: March 19, 2021Date of Patent: October 11, 2022Assignees: STMICROELECTRONICS, INC., STMICROELECTRONICS INTERNATIONAL N.V.Inventors: Mahesh Chowdhary, Arun Kumar, Ghanapriya Singh, Rajendar Bahl
-
Patent number: 11468642Abstract: Aspects of using augment reality for service projects are described. In some implementations, an augmented reality (AR) system receives one or more images of a real-world space, detects a physical object in the real-world space from the one or more images, and identifies the physical object for a service project. The AR system also generates a virtual object associated with the identified physical object and outputs the virtual object for display in an AR environment. The AR system further receives a selection of one or more portions of the virtual object associated with one or more portions of the physical object to be serviced and generates information for performing the service project based on the one or more portions of the physical object.Type: GrantFiled: July 7, 2020Date of Patent: October 11, 2022Assignee: Intuit Inc.Inventors: Yuhua Xie, Amanda Burgmeier, Jin Salil Barai, Athitya Kumar
-
Patent number: 11468644Abstract: The present technology relates to artificial reality systems. Such systems provide projections a user can create to specify object interactions. For example, when a user wishes to interact with an object outside her immediate reach, she can use a projection to select, move, or otherwise interact with the distant object. The present technology also includes object selection techniques for identifying and disambiguating between objects, allowing a user to select objects both near and distant from the user. Yet further aspects of the present technology include techniques for interpreting various bimanual (two-handed) gestures for interacting with objects. The present technology further includes a model for differentiating between global and local modes for, e.g., providing different input modalities or interpretations of user gestures.Type: GrantFiled: September 9, 2020Date of Patent: October 11, 2022Assignee: Meta Platforms Technologies, LLCInventors: Jonathan Ravasz, Etienne Pinchon, Adam Tibor Varga, Jasper Stevens, Robert Ellis, Jonah Jones, Evgenii Krivoruchko
-
Patent number: 11461983Abstract: An augmented reality surgical system includes a head mounted display (HMD) with a see-through display screen, a motion sensor, a camera, and computer equipment. The motion sensor outputs a head motion signal indicating measured movement of the HMD. The computer equipment computes the relative location and orientation of reference markers connected to the HMD and to the patient based on processing a video signal from the camera. The computer equipment generates a three dimensional anatomical model using patient data created by medical imaging equipment, and rotates and scales at least a portion of the three dimensional anatomical model based on the relative location and orientation of the reference markers, and further rotate at least a portion of the three dimensional anatomical model based on the head motion signal to track measured movement of the HMD. The rotated and scaled three dimensional anatomical model is displayed on the display screen.Type: GrantFiled: June 10, 2021Date of Patent: October 4, 2022Assignee: Globus Medical, Inc.Inventors: Kenneth Milton Jones, John Popoolapade, Thomas Calloway, Thierry Lemoine, Christian Jutteau, Christophe Bruzy, Yannick James, Joachim Laguarda, Dong-Mei Pei Xing, Sebastien Gorges, Paul Michael Yarin
-
Patent number: 11455484Abstract: This disclosure describes architectures and techniques to provide information to a user about items with which the user interacts. In some instances, a user may utilize a wearable device that is configured to interact with one or more components of an information discovery system to obtain information about items in the user's environment.Type: GrantFiled: January 23, 2020Date of Patent: September 27, 2022Assignee: Amazon Technologies, Inc.Inventors: Dilip Kumar, William Spencer Worley, III
-
Patent number: 11455486Abstract: An embodiment includes determining an experiential state of a first user participating in a mixed-reality experience. The embodiment also includes creating a first driver model that maps a relationship between the experiential state of the first user and a parameter of the mixed-reality experience. The embodiment also includes aggregating the first driver model with a plurality of driver models associated with experiential states and parameters of respective other users. The embodiment also includes creating a first cohort experience model using the aggregated driver models. The embodiment also includes deriving a first cohort experience parameter for the first cohort experience model. The embodiment also includes initiating an automated remedial action for participants in the mixed-reality system being associated with the first cohort experience model and the first cohort experience parameter.Type: GrantFiled: December 11, 2020Date of Patent: September 27, 2022Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Aaron K. Baughman, Hernan A. Cunico, Martin G. Keen, John M. Ganci, Jr.
-
Patent number: 11450074Abstract: A method for showing objects in an augmented reality environment includes the steps of an Augmented Reality (AR) device obtaining spatial information and object identification (ID) from an anchor device. The AR device obtains parameters of the objects from a cloud system. The parameters of an object include the image of the object, the audio of the object, and a first spatial relationship between the object and an anchor device. The AR device obtains a second spatial relationship between the AR device and the anchor device. A third spatial relationship between the object and the AR device can be obtained according to the first spatial relationship and the second spatial relationship. The image of the object and the audio of the object is displayed or projected in the AR device according to the third spatial relationship.Type: GrantFiled: July 9, 2021Date of Patent: September 20, 2022Assignee: AMBIT MICROSYSTEMS (SHANGHAI) LTD.Inventors: Yu-Hu Yan, Chien-Sheng Wu