Augmented Reality (real-time) Patents (Class 345/633)
-
Patent number: 11620855Abstract: A method, computer system, and a computer program product for memory mapping is provided. The present invention may include identifying an augmented reality device and at least one Internet of Things (IoT) device which observes at least one biometric parameter. The present invention may include defining at least one user attention pattern based on the at least one biometric parameter. The present invention may include predicting an attentiveness of a user based on the at least one attention pattern. The present invention may include recording data from the augmented reality device, based on the attentiveness of the user dropping below a certain point. The present invention may include storing the recorded data.Type: GrantFiled: September 3, 2020Date of Patent: April 4, 2023Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Shikhar Kwatra, Jeremy R. Fox, Sarbajit K. Rakshit, John D. Wilson
-
Patent number: 11615596Abstract: A computer system, while displaying a view of a computer-generated environment, detects movement of a physical object, and in response: in accordance with a determination that a user is within a threshold distance of a first portion of the physical object and that the physical object meets preset criteria, the computer system changes an appearance of virtual content displayed at a position corresponding to a current location of the physical object's first portion, without changing an appearance of virtual content displayed at a position corresponding to the physical object's second portion; and in accordance with a determination that the user is within the threshold distance and that the physical object does not meet the preset criteria, the computer system changes an appearance of virtual content displayed at a position corresponding to a current location of the physical object's first portion.Type: GrantFiled: September 23, 2021Date of Patent: March 28, 2023Assignee: APPLE INC.Inventors: Jeffrey M. Faulkner, Stephen O. Lemay, William A. Sorrentino, III, Jonathan Ive, Kristi E. S. Bauerly
-
Patent number: 11615767Abstract: Even under a situation where an object to be presented has movement, the object can be presented as display information in a more favorable mode.Type: GrantFiled: October 8, 2019Date of Patent: March 28, 2023Assignee: Sony Group CorporationInventor: Mitsuru Nishibe
-
Patent number: 11612358Abstract: A method for providing a thermal feedback, includes executing a virtual reality application providing a virtual space that includes a virtual area to which an area temperature attribute is assigned, and a virtual object to which an object temperature attributed is assigned. An area event that reflects that a player character enters the virtual area is detected. A feedback device is controlled to output thermal feedback associated to the area temperature attribute when the area event is detected, the feedback device outputting the thermal feedback using a thermoelectric element performing a thermoelectric operation. An object event reflecting the player character is influenced by the virtual object is detected. The feedback device is controlled to override the thermal feedback associated to the area temperature attribute and output thermal feedback associated to the object temperature when the object is detected while the player character is in the virtual area.Type: GrantFiled: August 5, 2021Date of Patent: March 28, 2023Assignee: TEGWAY CO., LTD.Inventors: Kyoungsoo Yi, Ockkyun Oh, Jong Ok Ko
-
Patent number: 11609431Abstract: The invention relates to a head-mounted display (HMD) (1), comprising a housing (10) having an interior (11), at least one optical lens (15, 17) having a focal plane (5) located at the focal point (16, 18), which focal plane is arranged within the housing (10); at least one first polarizing filter (21) having a first polarization direction and one second polarizing filter (22) having a second polarization direction, and at least one LCD unit (25), wherein the at least one LCD unit (25) is arranged in the area of the focal plane (5) between the first polarizing filter (21) and the second polarizing filter (22); the first polarizing filter (21) and/or the second polarizing filter (22) is or are arranged at a distance from the focal plane (5). The invention further relates to an amusement device (2), in particular an open-air amusement ride, a roller coaster or a carousel, comprising an HMD (1).Type: GrantFiled: August 30, 2019Date of Patent: March 21, 2023Assignee: VR COASTER GMBH & CO. KGInventor: Thomas Faul
-
Patent number: 11609675Abstract: A system and method may include receiving data defining an augmented reality (AR) environment including a representation of a physical environment, identifying relationships between a plurality of scene elements in the AR environment, and obtaining a set of UI layout patterns for arranging the plurality of scene elements in the AR environment according to one or more relationships between the plurality of scene elements. The system and method may identify, for the at least one scene element, at least one relationship that corresponds to at least one UI layout pattern, generate a modified UI layout pattern for the at least one scene element using different relationships than the identified at least one relationship, and trigger display of the AR content associated with the information and the at least one scene element using the modified UI layout pattern.Type: GrantFiled: December 2, 2019Date of Patent: March 21, 2023Assignee: Google LLCInventors: David Joseph Murphy, Ariel Sachter-Zeltzer, Caroline Hermans
-
Patent number: 11609976Abstract: Provided are a method and system for managing an image based on interaction between a face image and a message account. An image management method may include: storing, in a database, a plurality of face images and a plurality of messenger accounts in association with each other; receiving a target image; recognizing a face image from the received target image; searching, the database for a first face image that matches the recognized face image, among the stored plurality of face images, and identifying a first messenger account corresponding to the first face image, among the stored plurality of messenger accounts; and displaying information of the first messenger account in association with the first face image, in the target image.Type: GrantFiled: November 7, 2019Date of Patent: March 21, 2023Assignee: LINE Plus CorporationInventors: Yuri Jo, Hee Jin Park
-
Patent number: 11610348Abstract: An augmented reality (AR) diagnostic tool embodied as a software application on a portable device employs AR infrastructure to enable a user to locate a failed/malfunctioning node of a cluster and, with minimal interaction, diagnose causes and provide recommendations to repair the node. The portable device may be a computer embodied as visualization technology and configured to execute the software application. Once installed, the AR diagnostic (ARD) tool is ready for use by the user, e.g., a customer service technician, to locate and repair one or more failed cluster nodes. In response to a failure/malfunction, the cluster node sends diagnostic and configuration information (i.e., failure/malfunction information) of the failed node to an analytics service. The failure information informs the technician of the cluster failure. The technician may then activate the ARD tool and AR infrastructure to locate and repair the failed node.Type: GrantFiled: July 21, 2021Date of Patent: March 21, 2023Assignee: NetApp, Inc.Inventor: Michael Keith Nunez
-
Patent number: 11601580Abstract: An integrated computational interface device includes a housing, at least one image sensor, and a foldable protective cover. The housing has a key region and a non-key region, and a keyboard associated with the key region. The foldable protective cover incorporates the at least one image sensor. The protective cover is configured to be manipulated into a plurality of folding configurations, including a first folding configuration, wherein the protective cover is configured to encase the key region and at least a portion of the non-key region, and a second folding configuration, wherein the protective cover is configured to stand in a manner that causes an optical axis of the at least one image sensor to generally face a user of the integrated computational interface device while the user types on the keyboard.Type: GrantFiled: March 30, 2022Date of Patent: March 7, 2023Assignee: MULTINARITY LTDInventors: Tamir Berliner, Tomer Kahan, Orit Dolev, Amit Knaani
-
Patent number: 11599333Abstract: A method for performing voice dictation with an earpiece worn by a user includes receiving as input to the earpiece voice sound information from the user at one or more microphones of the earpiece, receiving as input to the earpiece user control information from one or more sensors within the earpiece independent from the one or more microphones of the earpiece, inserting a machine-generated transcription of the voice sound information from the user into a user input area associated with an application executing on a computing device and manipulating the application executing on the computing device based on the user control information.Type: GrantFiled: March 3, 2021Date of Patent: March 7, 2023Assignee: BRAGI GMBHInventors: Peter Vincent Boesen, Luigi Belverato, Martin Steiner
-
Patent number: 11592871Abstract: An integrated computational interface device may include a portable housing having a key region and a non-key region; a keyboard associated with the key region of the housing; and a holder associated with the non-key region of the housing. The holder may be configured for selective engagement with and disengagement from the wearable extended reality appliance, such that when the wearable extended reality appliance is selectively engaged with the housing via the holder, the wearable extended reality appliance is transportable with the housing.Type: GrantFiled: April 1, 2022Date of Patent: February 28, 2023Assignee: Multinarity LTDInventors: Tamir Berliner, Tomer Kahan, Orit Dolev, Amit Knaani, Doron Assayas Terre
-
Patent number: 11594335Abstract: There is a need to accurately and dynamically evaluate an individual's risk associated with the transmission or contraction of a disease. This need can be addressed, for example, by generation of a real-time or near real-time predicted disease score for an associated user. In one example, a method includes receiving a video stream data object depicting a visual representation of a target user; processing the video stream data object to generate a protective covering indication with respect to the target user; processing the video stream data object to generate a spatial proximity determination score with respect to the target user; processing the protective covering indication and spatial proximity determination score to generate a predicted disease score associated with the target user; and providing an augmented reality video stream data object configured to depict the visual representation of the target user and the predicted disease score.Type: GrantFiled: March 10, 2021Date of Patent: February 28, 2023Assignee: Optum, Inc.Inventors: Geo Min, Kassi Elana Dibert, Tiffany K. Nguyen, Zachary B. Rosen, Samuel Landon Larsen
-
Image generation apparatus and image generation method using frequency lower than display frame rate
Patent number: 11592668Abstract: Methods and apparatus provide for generating an image by way of acquiring information relating to at least one of a position and a rotation of a camera operated by a user. The image is generated for display on a display unit viewed by the user. A rate at which the image is generated is at a first frequency, which is lower than a second frequency corresponding to a frame rate of the display unit.Type: GrantFiled: April 22, 2021Date of Patent: February 28, 2023Assignees: Sony Interactive Entertainment Inc., Sony Interactive Entertainment Europe Ltd.Inventors: Tomohiro Oto, Simon Mark Benson, Ian Henry Bickerstaff -
Patent number: 11595580Abstract: The present disclosure provides systems and methods that use and/or generate image files according to a novel microvideo image format. For example, a microvideo can be a file that contains both a still image and a brief video. The microvideo can include multiple tracks, such as, for example, a separate video track, audio track, and/or one or more metadata tracks. As one example track, the microvideo can include a motion data track that stores motion data that can be used (e.g., at file runtime) to stabilize the video frames. A microvideo generation system included in an image capture device can determine a trimming of the video on-the-fly as the image capture device captures the microvideo.Type: GrantFiled: May 23, 2022Date of Patent: February 28, 2023Assignee: GOOGLE LLCInventors: Wei Hong, Marius Renn, Radford Ray Juang
-
Patent number: 11594075Abstract: An eye tracking device for tracking an eye is described. The eye tracking device comprises: a first diffractive optical element, DOE, arranged in front of the eye, an image module, wherein the image module is configured to capture an image of the eye via the first DOE. The first DOE is adapted to direct a first portion of incident light reflected from the eye, towards the image module. The eye tracking device is characterized in that the first DOE is configured to provide a lens effect.Type: GrantFiled: March 30, 2020Date of Patent: February 28, 2023Assignee: TOBII ABInventor: Daniel Tornéus
-
Patent number: 11587200Abstract: A method, apparatus and computer program product enable multiple timeline support in playback of omnidirectional media content with overlay. The method, apparatus and computer program product receive a visual overlay configured to be rendered as a multi-layer visual content with an omnidirectional media content file (30). The omnidirectional media content file is associated with a first presentation timeline. The visual overlay is associated with a second presentation timeline. The method, apparatus and computer program product construct an overlay behavior definition file associated with the visual overlay (32). The overlay behavior definition file indicates a behavior of the second presentation timeline with respect to the first presentation in an instance that a pre-defined user interaction switch occurs during a playback of the omnidirectional media content file.Type: GrantFiled: September 20, 2019Date of Patent: February 21, 2023Assignee: Nokia Technologies OyInventors: Sujeet Shyamsundar Mate, Igor Curcio, Miska Hannuksela, Emre Aksu, Kashyap Kammachi Sreedhar
-
Patent number: 11587535Abstract: Aspects of the subject disclosure may include, for example, detecting a user operating a cross reality headset, receiving a first location of the cross reality headset, providing image content and audio content to the cross reality headset, and receiving a second location of the cross reality headset. Further embodiments can include determining the cross reality headset is stationary based on the first location and the second location resulting in a determination, and providing instructions to the cross reality headset to adjust positioning the image content on a display of the cross reality headset and to provide the audio content according to the determination resulting in an adjustment of the positioning of the image content. The cross reality headset presents the image content according to the adjustment on the display. The cross reality headset provides the audio content. Other embodiments are disclosed.Type: GrantFiled: October 28, 2021Date of Patent: February 21, 2023Assignee: AT&T Intellectual Property I, L.P.Inventor: Kunwar Handa
-
Patent number: 11586286Abstract: A system receives, from an augmented reality device, a first image of a web application, where the first image shows a first element of the web application. The system receives eye tracking information that indicates eye movements of a user as the user is looking at different elements of the web application. The system determines that the user is looking at a first location coordinate on the first image of the web application. The system determines that the first element is located at the first location coordinate. The system identifies first element attributes associated with the first element. The system generates an augmented reality message comprising the first element attributes. The system generates an augmented reality display in which the augmented reality message is presented as a virtual object. The system transmits the augmented reality display to the augmented reality device.Type: GrantFiled: May 18, 2022Date of Patent: February 21, 2023Assignee: Bank of America CorporationInventor: Shailendra Singh
-
Patent number: 11586336Abstract: Systems, methods, and non-transitory media are provided for generating private control interfaces for extended reality (XR) experiences. An example method can include determining a pose of an XR device within a mapped scene of a physical environment associated with the XR device; detecting a private region in the physical environment and a location of the private region relative to the pose of the XR device, the private region including an area estimated to be within a field of view (FOV) of a user of the XR device and out of a FOV of a person in the physical environment, a recording device in the physical environment, and/or an object in the physical environment; based on the pose of the XR device and the location of the private region, mapping a virtual private control interface to the private region; and rendering the virtual private control interface within the private region.Type: GrantFiled: July 26, 2021Date of Patent: February 21, 2023Assignee: QUALCOMM IncorporatedInventors: Wesley James Holland, Ramesh Chandrasekhar, Daniel James Guest, Sebastien Mounier, Bijan Forutanpour
-
Patent number: 11579757Abstract: Usage metrics for augmented reality content may be identified and analyzed to determine measures of fitness for respective usage metrics. The measures of fitness may indicate a level of correlation with an outcome specified by an augmented reality content creator and an amount of interaction with an augmented reality content item by users of a client application. Recommendations may be provided to augmented reality content creators indicating modifications to augmented reality content items that have at least a threshold probability of increasing the level of interaction between users of the client application and the augmented reality content item.Type: GrantFiled: September 28, 2021Date of Patent: February 14, 2023Assignee: Snap Inc.Inventors: Jean Luo, Per Sandell, Vincent Sung
-
Patent number: 11580733Abstract: Systems, methods and techniques for automatically recognizing two-dimensional real world objects with an augmented reality display device, and augmenting or enhancing the display of such real world objects by superimposing virtual images such as a still or video advertisement, a story or other virtual image presentation. In non-limiting embodiments, the real world object includes visible features including visible security features and a recognition process takes the visible security features into account when recognizing the object and/or displaying superimposed virtual images.Type: GrantFiled: April 13, 2021Date of Patent: February 14, 2023Assignee: AR, LLCInventors: Stefan W. Herzberg, Megan Herzberg
-
Patent number: 11579747Abstract: A head-worn device system includes one or more cameras, one or more display devices and one or more processors. The system also includes a memory storing instructions that, when executed by the one or more processors, configure the system to generate a virtual object, generate a virtual object collider for the virtual object, determine a conic collider for the virtual object, provide the virtual object to a user, detect a landmark on the user's hand in the real-world, generate a landmark collider for the landmark, and determine a selection of the first virtual object by the user based on detecting a collision between the landmark collider with the conic collider and with the virtual object collider.Type: GrantFiled: March 14, 2022Date of Patent: February 14, 2023Assignee: Snap Inc.Inventor: Francis Patrick Sullivan
-
Patent number: 11580714Abstract: Methods and systems are disclosed for displaying an augmented reality virtual object on a multimedia device. One method comprises detecting, in an augmented reality environment displayed using a first device, a virtual object; detecting, within the augmented reality environment, a second device, the second device comprising a physical multimedia device; and generating, at the second device, a display comprising a representation of the virtual object.Type: GrantFiled: December 21, 2021Date of Patent: February 14, 2023Assignee: Worldpay LimitedInventors: Kevin Gordon, Charlotte Spender
-
Patent number: 11580674Abstract: An information distribution apparatus includes an imaging unit configured to capture a captured image including a specific object, an object image acquisition unit configured to acquire an object image of the specific object from the captured image, and a try-on data generation unit configured to generate try-on data based on a registration avatar in a virtual space and the object image.Type: GrantFiled: August 19, 2020Date of Patent: February 14, 2023Assignee: JVCKENWOOD CorporationInventors: Masayuki Nagano, Tatsumi Naganuma, Satoru Hirose
-
Patent number: 11579689Abstract: Systems, methods, and non-transitory computer-readable media are disclosed for selectively rendering augmented reality content based on predictions regarding a user's ability to visually process the augmented reality content. For instance, the disclosed systems can identify eye tracking information for a user at an initial time. Moreover, the disclosed systems can predict a change in an ability of the user to visually process an augmented reality element at a future time based on the eye tracking information. Additionally, the disclosed systems can selectively render the augmented reality element at the future time based on the predicted change in the ability of the user to visually process the augmented reality element.Type: GrantFiled: January 25, 2021Date of Patent: February 14, 2023Assignee: Meta Platforms, Inc.Inventors: Mark Terrano, Ian Erkelens, Kevin James MacKenzie
-
Patent number: 11571168Abstract: Systems and methods for detecting data acquisition conditions using color-based penalties can include a computing device obtaining a sequence of images acquired by a photodetector. The computing device can determine, for each pixel position of a plurality of pixel positions associated with the sequence of images, a respective penalty score indicative of a similarity between a color value of a pixel of the pixel position and a desired color value. The desired color value can represent a color property of light emitted from body parts of users when placed opposite to the photodetector. The computing device can determine, using penalty scores of the plurality of pixel positions, a relative position of a body part of a user with respect to a desired position.Type: GrantFiled: October 27, 2021Date of Patent: February 7, 2023Assignee: BIOSPECTAL SAInventors: Eliott Jones, Jean-Francois Knebel, Urvan Christen, Frederic Frappereau, Patrick Schoettker
-
Patent number: 11573629Abstract: An image processing and displaying method, AR device, image processing device, and a display system are provided. The image processing and displaying method is applied to a display system, wherein the display system includes an Augmented Reality (AR) device and an image processing device, and the image processing and displaying method includes: acquiring, by the AR device, a real-time image of a current view field of a user wearing the AR device in a real environment; sending, by the AR device, the real-time image to the image processing device; receiving, by the AR device, a display direction, an imaging distance, and a target image sent by the image processing device, and displaying, by the AR device, the target image in a virtual display area according to the display direction and the imaging distance.Type: GrantFiled: November 4, 2021Date of Patent: February 7, 2023Assignees: Beijing BOE Optoelectronics Technology Co., Ltd., BOE Technology Group Co., Ltd.Inventors: Xuefeng Wang, Yanqiu Zhao, Qingwen Fan, Jinghua Miao, Lili Chen, Hao Zhang, Xi Li, Longhui Wang
-
Patent number: 11566914Abstract: An information providing apparatus includes an acquisition section that acquires position information from a terminal device, a specifying section that specifies a target publication from plural publications on which maps have been posted, by performing processing with the position information, and a providing section that provides the terminal device with information indicating a correspondence relationship between a map posted on the target publication and a position indicated by the position information.Type: GrantFiled: March 14, 2019Date of Patent: January 31, 2023Assignee: FUJIFILM Business Innovation Corp.Inventors: Yasuhiro Ito, Junko Murakami
-
Patent number: 11567354Abstract: According to an embodiment, a display device comprises a frame defining an opening, a grip extending from the frame, and a display panel which is held by the frame and whose background is visually recognizable. Further, the opening includes a region surrounded by an inner edge of the frame and the display panel.Type: GrantFiled: July 8, 2021Date of Patent: January 31, 2023Assignee: Japan Display Inc.Inventors: Koji Hiramoto, Norika Ikeda, Ken Sugiyama
-
Patent number: 11568613Abstract: A virtual local presence display apparatus, system and method is disclosed.Type: GrantFiled: July 26, 2021Date of Patent: January 31, 2023Inventor: Josh Lehman
-
Patent number: 11568562Abstract: The disclosed system may include a housing dimensioned to secure various components including at least one physical processor and various sensors. The system may also include a camera mounted to the housing, as well as physical memory with computer-executable instructions that, when executed by the physical processor, cause the physical processor to: acquire images of a surrounding environment using the camera mounted to the housing, identify features of the surrounding environment from the acquired images, generate a map using the features identified from the acquired images, access sensor data generated by the sensors, and determine a current pose of the system in the surrounding environment based on the features in the generated map and the accessed sensor data. Various other methods, apparatuses, and computer-readable media are also disclosed.Type: GrantFiled: August 14, 2020Date of Patent: January 31, 2023Assignee: Meta Platforms Technologies, LLCInventor: Samuel Redmond D'Amico
-
Patent number: 11567535Abstract: Systems, methods, and non-transitory computer readable media containing instructions for causing at least one processor to perform operations for changing display of virtual content based on temperature are provided. In one implementation, the processor is configured to perform operations comprising displaying virtual content via a wearable extended reality appliance, wherein during displaying of the virtual content, heat is generated by at least one component of the wearable extended reality appliance; receiving information indicative of a temperature associated with the wearable extended reality appliance; determining a need to change display settings of the virtual content based on the received information; and based on the determination, changing the display settings of the virtual content to achieve a target temperature.Type: GrantFiled: March 30, 2022Date of Patent: January 31, 2023Assignee: MULTINARITY LTDInventors: Oded Noam, Tamir Berliner, Tomer Kahan
-
Patent number: 11562661Abstract: An illustrated view of an absolute teaching device for presenting an image of the patient's medical information to the doctor. The absolute teaching device is useful to aid to educate the patient or to close a mode of a treatment plan. The absolute teaching device removes the blood and gut, that most non-healthcare individuals can be squeamish about by animating with transparencies to see from frontal to supine. The absolute teaching device may highlight, or glow, for areas of concern during a consultation and direct any other areas of concern related to the origin of concern.Type: GrantFiled: January 14, 2021Date of Patent: January 24, 2023Inventor: Sheila Hall
-
Patent number: 11562227Abstract: An interactive troubleshooting assistant and method for troubleshooting a system in real time to repair (fix) one or more problems in a system is disclosed. The interactive troubleshooting assistant and method may include receiving multimodal inputs from sensors, wearable devices, a person, etc. that may be input into a feature extractor including attention layers and pre-processing units of a cloud computing system hosted by one or more servers, such as a private cloud system. A pre-processing unit converts the raw multimodal input into a structed form so that an attention layer can give weights to features provided by the pre-processing unit according to their importance. The weighted extracted features may be provided to an actions predictor. The actions predictor generates the most suitable action based on the weighted extracted features generated by the feature extractor based on the multimodal inputs.Type: GrantFiled: March 13, 2019Date of Patent: January 24, 2023Assignee: Accenture Global Solutions LimitedInventors: Kumar Abhinav, Alpana Dubey, Sakshi Jain, Michael L. Duncan, Nitish Bhardwaj, Niyati Singal
-
Patent number: 11563700Abstract: A head-mounted device (HMD) of a first user has a transparent display. The HMD determines location information of a second user relative to the HMD of the first user. The second user is located within a predefined distance of the HMD. The location information identifies a distance and a direction of the second user relative to the HMD. The HMD receives audio content from the second user, generates augmented reality (AR) content based on the audio content, and displays the AR content in the transparent display based on the location information of the second user. The AR content appears coupled to the second user.Type: GrantFiled: September 3, 2020Date of Patent: January 24, 2023Assignee: Meta Platforms Technologies, LLCInventor: Brian Mullins
-
Patent number: 11562543Abstract: A method for visualizing an image combining an image (Ic) of a real object (200) originating from a video capture system (300) with digital information (In) originating from a three-dimensional model of the equipment, comprising: carrying out a processing operation to superimpose, in real time, a reference point (402) of the three-dimensional model with a reference point (302) of the video capture system and an object reference point (202) of the real object, and displaying at least some of the digital information superimposed on the image captured by the video capture system, further comprising: an initial step (Ei) of recording the reference texture (T200) of the real object, and a step (Ea) of analyzing the images transmitted by the video capture system, the analysis step comprising: generating a synthesis image from the captured image, and from the three-dimensional model of the equipment textured using the recorded texture; a step of calculating a composite image by mixing the synthesis image and the capType: GrantFiled: September 9, 2019Date of Patent: January 24, 2023Assignee: DIOTASOFTInventors: Christophe Montandon, Jean-Baptiste Delhommeau
-
Patent number: 11556169Abstract: In one embodiment, a method includes rendering, for one or more displays of a VR display device, a first output image of a VR environment. The VR environment includes a personal UI associated with a first user. The personal UI has a first form factor and a first pose with respect to the first user, is a virtual object comprising one or more 2D virtual displays, and is operable to execute a plurality of applications. The method includes determining whether to adapt the personal UI based on a detected change in a context of the first user with respect to the VR environment. The method includes rendering a second output image of the VR environment, where the personal UI is adapted to have a second form factor and a second pose with respect to the first user responsive to determining to adapt the personal UI based on the detected change in the context of the first user.Type: GrantFiled: February 11, 2021Date of Patent: January 17, 2023Assignee: Meta Platforms Technologies, LLCInventors: Nicholas Wallen, Matthew Luther, Paulo Melchiori, Amir Mesguich Havilio, Amber Choo, Jesse John Mullen
-
Patent number: 11558551Abstract: A system and method for a master platform includes receiving first pose data associated with an image sensor of a first device, and a first semantic map generated by the first device, the first semantic map including a simplified object representation in a coordinate space of the first device. The master platform also receives second pose data associated with an image sensor of a second device, and a second semantic map generated by the second device, the second semantic map including a simplified object representation in a coordinate space of the second device. A shared simplified object representation common to the first and semantic maps is identified. The master platform further combines the first semantic and second semantic maps based on the first and second pose data. The first pose data, first semantic map, second pose data, and second semantic map are associated with a common time interval.Type: GrantFiled: September 3, 2020Date of Patent: January 17, 2023Assignee: Samsung Electronics Co., Ltd.Inventors: Michael Sapienza, Ankur Gupta, Abhijit Bendale, Fannie Fontanel
-
Patent number: 11550841Abstract: Various embodiments, methods and systems for implementing a distributed computing system scene assembly engine are provided. Initially, a selection of a first synthetic data asset and a selection of a second synthetic data asset are received from a distributed synthetic data as a service (SDaaS) integrated development environment (IDE). A synthetic data asset is associated with asset-variation parameters and scene-variation parameters, the asset-variation parameters and scene-variation parameters are programmable for machine-learning. Values for generating a synthetic data scene are received. The values correspond to asset-variation parameters or scene-variation parameters. Based on the values, the synthetic data scene is generated using the first synthetic data asset and the second synthetic data asset.Type: GrantFiled: May 31, 2018Date of Patent: January 10, 2023Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Kamran Zargahi, Michael John Ebstyne, Pedro Urbina Escos, Stephen Michelotti, Emanuel Shalev
-
Patent number: 11553077Abstract: Systems and methods for providing conversation assistance include receiving from at least one user device of a user, conversation information and determining that the conversation information is associated with a conversation involving the user and a first person that is associated with first conversation assistance information in a non-transitory memory. Body measurement data of the user is retrieved from the at least first user device. A need for conversation assistance in the conversation involving the user and the first person is detected using the body measurement data. First conversation assistance information associated with the first person is retrieved from the non-transitory memory. The first conversation assistance information associated with the first person is provided through the at least one user device.Type: GrantFiled: May 4, 2021Date of Patent: January 10, 2023Assignee: PayPal, Inc.Inventor: Michael Charles Todasco
-
Patent number: 11550445Abstract: A method includes displaying a user interface having a first region with one or more user interface elements and determining whether a shield is in a locked state or an unlocked state. The shield covers the first region when in the locked state and uncovers at least part of the first region when in the unlocked state. The method includes, in response to determining that the shield is in the locked state, displaying the shield covering the first region and disabling the user interface element(s). The method includes, in response to receiving user input on the shield while the shield is in the locked state, changing the shield to the unlocked state. Additionally, the method includes, in response to determining that the shield is in the unlocked state, displaying the first region such that the user interface element(s) is/are not covered by the shield and enabling the user interface element(s).Type: GrantFiled: July 6, 2021Date of Patent: January 10, 2023Assignee: Raytheon CompanyInventors: Richard K. Steinberg, Angelos Erilus, Brian Scarpiniti, Laura Strater, Rimantas T. Meckauskas, Garrett Zabala
-
Patent number: 11544911Abstract: A mobile device is fitted with a camera and an extended reality (XR) software application program executing on a processor within an XR system. Via the XR software application program, techniques are performed for manipulating virtual objects in an XR environment. In one technique, the XR software application program facilitates the movement of a virtual object from a first location to a second location, within a plane parallel to a touchscreen of a mobile device, responsive to a displacement determined based on user input detected via the touchscreen.Type: GrantFiled: February 12, 2021Date of Patent: January 3, 2023Assignee: SPLUNK INC.Inventors: Devin Bhushan, Jesse Chor, Glen Wong, Jim Jiaming Zhu
-
Patent number: 11544914Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for annotation of 3D models with signs of use that are visible in 2D images. In one aspect, methods are performed by data processing apparatus. The methods can include projecting signs of use in a relatively larger field of view image of an instance of an object onto a 3D model of the object based on a pose of the instance in the relatively larger field of view image, and estimating a relative pose of the instance of the object in a relatively smaller field of view image based on matches between the signs of use in the relatively larger field of view image and the same signs of use in the relatively smaller field of view image.Type: GrantFiled: March 3, 2021Date of Patent: January 3, 2023Assignee: INAIT SAInventors: Constantin Cosmin Atanasoaei, Daniel Milan Lütgehetmann, Dimitri Zaganidis, John Rahmon, Michele De Gruttola
-
Patent number: 11544921Abstract: Systems and methods are provided for performing operations including receiving, via a messaging application, a request to scan an image captured by a camera of the user device; determining an attribute of an object depicted in the image; identifying, from a plurality of augmented reality items, an augmented reality item that is associated with the attribute of the object; combining the identified augmented reality item with the image captured by the camera; and displaying, via the messaging application, the image captured by the camera combined with the identified augmented reality item.Type: GrantFiled: December 2, 2019Date of Patent: January 3, 2023Assignee: Snap Inc.Inventors: Kaveh Anvaripour, Nathan Kenneth Boyd, Hao Hu, Celia Nicole Mourkogiannis, Kevin Dechau Tang
-
Patent number: 11538199Abstract: For displaying a window in an augmented reality view, a processor detects a new augmented reality placetime that includes a new augmented reality position and/or a new augmented reality time of an augmented reality device. The processor calculates new window characteristics for a window at the new augmented reality placetime based on previous window characteristics. The processor further displays the window with the new window characteristics.Type: GrantFiled: February 7, 2020Date of Patent: December 27, 2022Assignee: Lenovo (Singapore) Pte. Ltd.Inventors: John Weldon Nicholson, Daryl C. Cromer, Howard Locker
-
Patent number: 11538200Abstract: Various implementations disclosed herein include devices, systems, and methods that enable improved display of virtual content in computer generated reality (CGR) environments. In some implementations, the virtual content includes a reminder associated with a user and the user's physical environment.Type: GrantFiled: September 18, 2020Date of Patent: December 27, 2022Assignee: Apple Inc.Inventors: Pushkar Gupta, Sakshyam Dahal, Hrushikesh N. Kulkarni, Chetna S. Gote
-
Patent number: 11538225Abstract: The subject technology receives, at a client device, a selection of a first selectable graphical item, the first selectable graphical item comprising a first augmented reality content generator corresponding to a particular geolocation. The subject technology causes display, at the client device, of a graphical interface comprising a plurality of selectable augmented reality content items, each selectable augmented reality content item corresponding to a particular activity based at in part on the particular geolocation. The subject technology receives, at the client device, a second selection of a particular selectable augmented reality content item from the plurality of selectable augmented reality content items.Type: GrantFiled: January 12, 2021Date of Patent: December 27, 2022Assignee: Snap Inc.Inventors: Kaveh Anvaripour, Ilteris Kaan Canberk, Virginia Drummond, Jean Luo, Alek Matthiessen, Celia Nicole Mourkogiannis
-
Patent number: 11531960Abstract: An information processing apparatus (2000) acquires a shelf rack image (12) in which a product shelf rack on which a product is displayed is imaged. The information processing apparatus (2000) performs image analysis on the shelf rack image (12), and generates information (actual display information) relevant to a display situation of the product on a product shelf rack (20). The information processing apparatus (2000) acquires reference display information representing a reference for display of the product on the product shelf rack (20). The information processing apparatus (2000) compares the actual display information generated by performing the image analysis on the shelf rack image (12) with the acquired reference display information, and generates comparison information representing a result.Type: GrantFiled: September 11, 2018Date of Patent: December 20, 2022Assignee: NEC CORPORATIONInventors: Yaeko Yonezawa, Kaito Horita, Akira Yajima, Mizuto Sekine, Yoshinori Ehara
-
Patent number: 11531508Abstract: A sensor data providing unit included in a control device provides, when an HMD is connected, detection data acquired by a sensor driver as standard sensor data, and continues an operation of acquiring detection data of a first sensor by the sensor driver, and provides, when the HMD is not connected, detection data acquired by a built-in sensor driver as standard sensor data.Type: GrantFiled: December 23, 2020Date of Patent: December 20, 2022Assignee: SEIKO EPSON CORPORATIONInventor: Shinya Torii
-
Patent number: 11533443Abstract: Some embodiments provide display eyewear with adjustable camera direction. In general, one aspect disclosed features an electronic device, comprising: a structure configured to be worn on the head of a user; a camera movably coupled to the structure and arranged to capture images in a field of view of the user; and a display panel fixedly coupled to the structure and arranged to display, to the user, the images captured by the camera.Type: GrantFiled: June 29, 2020Date of Patent: December 20, 2022Assignee: Innovega, Inc.Inventors: Jerome A. Legerton, Jay Marsh