Viewer Attached Patents (Class 348/53)
  • Patent number: 11947716
    Abstract: A portable device (e.g., a wireless device such as a cell phone) is provided with a flexible keyboard and a flexible display screen. Such flexible components may be stored in the housing of the portable device when not in use. The flexible display screen and flexible keyboard may be expanded from the housing when the flexible components are utilized by a user. Non-flexible display and input components may be provided on the exterior of the portable device such that the device may be used, in some form, while the flexible components are stored. In one embodiment, a portion of the flexible display (or flexible keyboard) may be utilized when the flexible display (or flexible keyboard) is stored in said first housing.
    Type: Grant
    Filed: January 13, 2023
    Date of Patent: April 2, 2024
    Inventor: Jeffrey David Mullen
  • Patent number: 11941163
    Abstract: The technology disclosed relates to a method of realistic simulation of real world interactions as virtual interactions between a control object sensed acting in a three-dimensional (3D) sensory space and the virtual object in a virtual space that the control object interacts with. In particular, it relates to detecting free-form gestures of a control object in a three-dimensional (3D) sensory space and generating for display a 3D solid control object model for the control object during the free-form gestures, including sub-components of the control object and in response to detecting a free-form gesture of the control object in the 3D sensory space in virtual contact with the virtual object, depicting, in the generated display, the virtual contact and resulting motions of the virtual object by the 3D solid control object model.
    Type: Grant
    Filed: January 27, 2022
    Date of Patent: March 26, 2024
    Assignee: Ultrahaptics IP Two Limited
    Inventors: John Adrian Arthur Johnston, Johnathon Scott Selstad, Alex Marcolina
  • Patent number: 11917118
    Abstract: An information processing apparatus (100) includes: a calculation unit (163) that calculates an index value related to display of stereoscopic image content including a stereoscopic image based on a relative position of a viewer with respect to a position of a display unit (150) that displays the stereoscopic image; and a display control unit (164) that controls display processing performed by the display unit (150) based on the index value calculated by the calculation unit (163).
    Type: Grant
    Filed: December 17, 2020
    Date of Patent: February 27, 2024
    Assignee: SONY GROUP CORPORATION
    Inventors: Ryohei Funakoshi, Masato Akao
  • Patent number: 11876947
    Abstract: Provided is a method for creating a virtual reality content, storing the virtual reality content in a transmission buffer, and after that, managing the transmission buffer. A server creates the virtual reality content based on user's motion information, stores the virtual reality content in the transmission buffer and is allowed to modify the virtual reality content stored in the transmission buffer based on subsequently received user's motion information, so that the most recent user's motion information can be appropriately reflected in the virtual reality content. It is possible to provide a more immersive virtual reality service.
    Type: Grant
    Filed: September 1, 2022
    Date of Patent: January 16, 2024
    Assignee: FOUNDATION FOR RESEARCH AND BUSINESS, SEOUL NATIONAL UNIVERSITY OF SCIENCE AND TECHNOLOGY
    Inventor: Ji Hoon Yun
  • Patent number: 11876952
    Abstract: Examples are disclosed that relate to calibration of a stereoscopic display system of an HMD via an optical calibration system comprising a waveguide combiner. One example provides an HMD device comprising a first image projector and a second image projector configured to project a stereoscopic image pair, and an optical calibration system. The optical calibration system comprises a first optical path indicative of an alignment of the first image projector, a second optical path indicative of an alignment of the second image projector, a waveguide combiner in which the first and second optical paths combine into a shared optical path, and one or more boresight sensors configured to detect calibration image light traveling along one or more of the first optical or the second optical path.
    Type: Grant
    Filed: January 24, 2022
    Date of Patent: January 16, 2024
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Dmitriy Churin, Parry Byron Johnson, Dmitry Reshidko, Congshan Wan
  • Patent number: 11747620
    Abstract: Provided a backlight unit including a light source and a light guide structure configured to guide the light emitted from the light source, the light guide structure includes a first coupler layer including a first output coupler configured to expand light in a first direction and output the expanded light in the first direction to the outside of the light guide structure, and a first expansion coupler configured to expand the light in a second direction perpendicular to the first direction and provide the expanded light in the second direction to the first output coupler, and a second coupler layer including a second output coupler configured to expand light in the first direction and output the expanded light to the outside of the light guide structure, and a second expansion coupler configured to expand light in the second direction and provide the expanded light to the second output coupler.
    Type: Grant
    Filed: March 5, 2020
    Date of Patent: September 5, 2023
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Chilsung Choi, Hoon Song, Hongseok Lee
  • Patent number: 11695913
    Abstract: A mixed reality direct retinal projector system that may include a headset that uses a reflective holographic combiner to direct light from a light engine into an eye box corresponding to a user's eye. The light engine may include light sources coupled to projectors that independently project light to the holographic combiner from different projection points. The light sources may be in a unit separate from the headset that may be carried on a user's hip, or otherwise carried or worn separately from the headset. Each projector may include a collimating and focusing element, an active focusing element, and a two-axis scanning mirror to project light from a respective light source to the holographic combiner. The holographic combiner may be recorded with a series of point to point holograms; each projector interacts with multiple holograms to project light onto multiple locations in the eye box.
    Type: Grant
    Filed: September 10, 2021
    Date of Patent: July 4, 2023
    Assignee: Apple, Inc.
    Inventors: Richard J. Topliss, Thomas M. Gregory, Paul J. Gelsinger-Austin, Richard H. Tsai
  • Patent number: 11683460
    Abstract: Provided is a method for creating a virtual reality content, storing the virtual reality content in a transmission buffer, and after that, managing the transmission buffer. A server creates the virtual reality content based on user's motion information, stores the virtual reality content in the transmission buffer and is allowed to modify the virtual reality content stored in the transmission buffer based on subsequently received user's motion information, so that the most recent user's motion information can be appropriately reflected in the virtual reality content. It is possible to provide a more immersive virtual reality service.
    Type: Grant
    Filed: October 5, 2021
    Date of Patent: June 20, 2023
    Assignee: FOUNDATION FOR RESEARCH AND BUSINESS, SEOUL NATIONAL UNIVERSITY OF SCIENCE AND TECHNOLOGY
    Inventor: Ji Hoon Yun
  • Patent number: 11671573
    Abstract: Embodiments of the invention are directed to a computer-implemented method that includes using a reinforcement learning (RL) system to generate a first set of displayed region candidates based on inputs received from online users while watching video. A recommendation system is used to rank the first set of displayed region candidates based on inputs received from a local user watching video. The recommendation system is further used to select a first highest ranked one of the first set of displayed region candidates. Based on the first highest ranked one of the first set of displayed region candidates, a first section of a first raw video frame is fetched that matches the first highest ranked one of the first set of displayed candidate regions, wherein the first section of the first raw video frame includes a first predicted display region of the video frame.
    Type: Grant
    Filed: December 14, 2020
    Date of Patent: June 6, 2023
    Assignee: International Business Machines Corporation
    Inventors: Tao Wang, Shi Lei Zhang, Lingyun Wang, Qing Wang
  • Patent number: 11630508
    Abstract: Apparatuses, methods, and computer program products are provided for securely presenting digital objects. An example method includes receiving a request for digital object review and causing visual presentation of the digital object to a user. The method further includes receiving one or more images of the user's eye captured during presentation of the digital object and determining a focus location represented by the one or more images. The method also includes modifying one or more user parameters associated with the user based on the focus location. In some instances, presentation of the digital object may be rendered in a virtual reality environment or may be overlaid as an augmented reality object in the field of view of the user.
    Type: Grant
    Filed: June 12, 2020
    Date of Patent: April 18, 2023
    Assignee: Wells Fargo Bank, N.A.
    Inventors: Amanda Jean Andres, John Patrick Decker, Jr., Darrell Todd Slawson, Jonathan Paul Sidarous, Melissa Leisse, Chelsea Murphy, Allison Rayfield
  • Patent number: 11601637
    Abstract: An image transmission device of a multifocal display system is described, for transmitting a set of N composite images based on a set of N primary images to an image reception device. N is greater or equal 2, and each of the N primary images has a focus distance associated therewith. The image transmission device includes processing circuitry configured to partition each of the N primary images into image portions and generate the N composite images by placing each image portion of each of the N primary images into one of the N composite images such that each of the N composite images comprises image portions from two or more of the N primary images. A communication interface transmits the N composite images to the image reception device (103).
    Type: Grant
    Filed: January 22, 2021
    Date of Patent: March 7, 2023
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Atanas Boev, Panji Setiawan, Bogdan Cihodariu Ionita
  • Patent number: 11579685
    Abstract: A portable device (e.g., a wireless device such as a cell phone) is provided with a flexible keyboard and a flexible display screen. Such flexible components may be stored in the housing of the portable device when not in use. The flexible display screen and flexible keyboard may be expanded from the housing when the flexible components are utilized by a user. Non-flexible display and input components may be provided on the exterior of the portable device such that the device may be used, in some form, while the flexible components are stored. In one embodiment, a portion of the flexible display (or flexible keyboard) may be utilized when the flexible display (or flexible keyboard) is stored in said first housing.
    Type: Grant
    Filed: March 17, 2022
    Date of Patent: February 14, 2023
    Inventor: Jeffrey David Mullen
  • Patent number: 11568552
    Abstract: An imaging system including visible-light camera(s), pose-tracking means, and processor(s). The processor(s) is/are configured to: control visible-light camera(s) to capture visible-light image, whilst processing pose-tracking data to determine pose of camera(s); obtain three-dimensional model of real-world environment; create occlusion mask, using three-dimensional model; cull part of virtual object(s) to generate culled virtual object(s), wherein virtual object(s) is to be embedded at given position in visible-light image; detect whether width of culled part or remaining part of virtual object(s) is less than predefined percentage of total width of virtual object(s); if width of culled part is less than predefined percentage, determine new position and embed entirety of virtual object(s) at new position to generate extended-reality image; and if width of remaining part is less than predefined percentage, cull entirety of virtual object(s).
    Type: Grant
    Filed: June 28, 2021
    Date of Patent: January 31, 2023
    Assignee: Varjo Technologies Oy
    Inventor: Ari Antti Erik Peuhkurinen
  • Patent number: 11463670
    Abstract: Provided is a method for creating a virtual reality content, storing the virtual reality content in a transmission buffer, and after that, managing the transmission buffer. A server creates the virtual reality content based on user's motion information, stores the virtual reality content in the transmission buffer and is allowed to modify the virtual reality content stored in the transmission buffer based on subsequently received user's motion information, so that the most recent user's motion information can be appropriately reflected in the virtual reality content. It is possible to provide a more immersive virtual reality service.
    Type: Grant
    Filed: November 14, 2020
    Date of Patent: October 4, 2022
    Assignee: FOUNDATION FOR RESEARCH AND BUSINESS, SEOUL NATIONAL UNIVERSITY OF SCIENCE AND TECHNOLOGY
    Inventor: Ji Hoon Yun
  • Patent number: 11402665
    Abstract: An optical attachment for surgical loupe glasses is disclosed. The optical attachment for surgical loupe glasses includes a visor sized to cover at least a portion of a first carrier lens of the surgical loupe glasses. The optical attachment also includes at least one loupe orienting feature defined by the visor.
    Type: Grant
    Filed: September 12, 2019
    Date of Patent: August 2, 2022
    Assignee: LSI Solutions, Inc.
    Inventor: Jude S. Sauer
  • Patent number: 11393431
    Abstract: It is provided that a display system including a HMD and a smartphone connected to the HMD, wherein the HMD configured to visually recognize an external scene and display a first image overlapping the external scene, the smartphone includes a display panel configured to display a second image, a touch sensor arranged at the display panel, a first determination unit configured to determine whether the display panel is facing the HMD, a detection unit configured to detect a position of the display panel with respect to the HMD, a second determination unit configured to determine whether the position of the display panel is included in the first image, and an adjustment unit configured to adjust display of the first image on an image display unit based on a determination result of the first determination unit and a determination result of the second determination unit.
    Type: Grant
    Filed: February 20, 2020
    Date of Patent: July 19, 2022
    Assignee: SEIKO EPSON CORPORATION
    Inventor: Shinichi Kobayashi
  • Patent number: 11330252
    Abstract: Aspects of the subject disclosure may include, for example, transmitting viewpoint information associated with a first portion of a three-dimensional (3D)/volumetric video to a device, wherein the viewpoint information comprises a first coordinate in 3D space associated with a first viewing direction in a playback of the first portion and a first timestamp associated with the first portion, receiving, from the device, a multiplane image (MPI) representation of a second portion of the 3D video responsive to the transmitting of the viewpoint information, and providing an image of the MPI representation to a display device. Other embodiments are disclosed.
    Type: Grant
    Filed: February 12, 2020
    Date of Patent: May 10, 2022
    Assignee: AT&T Intellectual Property I, L.P.
    Inventors: Tan Xu, Bo Han, Eric Zavesky
  • Patent number: 11321934
    Abstract: A method for generating an electro-anatomical map to represent an underlying metric associated with heart tissue it is provided. The method comprises receiving, by a mapping system, point cloud data collected for the underlying metric at various locations within the heart; generating, by the mapping system, a surface mesh to represent the geometry of a heart, said surface mesh comprising a plurality of mesh points arranged as a series of interconnected triangles, wherein each mesh point lies on the surface of the heart, and is generated based on the point cloud data; rendering the surface mesh in a viewer application, comprising coloring the mesh points in the surface mesh based on values of the underlying metric associated with each of the mesh points and a color scale; and allowing a user to dynamically adjust the color scale based on a histogram.
    Type: Grant
    Filed: November 19, 2020
    Date of Patent: May 3, 2022
    Assignee: NEUCURES INC.
    Inventors: Rohit Jain, Padmaja Narsipur
  • Patent number: 11307652
    Abstract: A portable device (e.g., a wireless device such as a cell phone) is provided with a flexible keyboard and a flexible display screen. Such flexible components may be stored in the housing of the portable device when not in use. The flexible display screen and flexible keyboard may be expanded from the housing when the flexible components are utilized by a user. Non-flexible display and input components may be provided on the exterior of the portable device such that the device may be used, in some form, while the flexible components are stored. In one embodiment, a portion of the flexible display (or flexible keyboard) may be utilized when the flexible display (or flexible keyboard) is stored in said first housing.
    Type: Grant
    Filed: September 23, 2020
    Date of Patent: April 19, 2022
    Inventor: Jeffrey David Mullen
  • Patent number: 11301969
    Abstract: Some implementations provide improved user experiences on head mounted devices (HMDs) that provide near eye viewing, e.g., HMDs that display distorted images and provide lenses that undistort the images for the user. The images are produced using distortion that is corrected dynamically based on context to conserve device resources. To do so, a context associated with a state of the user, the HMD, or content being viewed on the HMD is tracked during the user experience. For example, the device may predict pupil position, eye state, eye gaze direction, or eye fixation, content type, connection mode, and other context. The device uses the tracked context to determine how to correct distortion for the images at different points during the user experience. For example, new distortion corrections may be computed and used while the user's gaze is moving and previously-determined distortion corrections may be used while the user's gaze is fixed.
    Type: Grant
    Filed: September 19, 2019
    Date of Patent: April 12, 2022
    Assignee: Apple Inc.
    Inventors: Moinul Khan, Simon Fortin-Deschenes, Yanli Zhang, Bennett S. Wilburn, Sterling G. Orsten, Nan Zhu, James Zhou
  • Patent number: 11270115
    Abstract: In one aspect, a headset may include at least one processor, at least one transparent display accessible to the at least one processor, and storage accessible to the at least one processor. The storage may include instructions executable by the at least one processor to detect an indication accompanying audio video (AV) content, with the indication associated with augmented reality (AR) content. The AR content may be different from the AV content but associated with the AV content. The instructions may also be executable to transmit a request for the AR content, receive the AR content, and present the AR content on the at least one transparent display.
    Type: Grant
    Filed: November 18, 2019
    Date of Patent: March 8, 2022
    Assignee: Lenovo (Singapore) Pte. Ltd.
    Inventor: Allen Wayne Richey
  • Patent number: 11263823
    Abstract: The disclosed subject matter is directed to employing machine learning models configured to predict 3D data from 2D images using deep learning techniques to derive 3D data for the 2D images. In some embodiments, a method is provided that comprises employing, by a system comprising a processor, one or more three-dimensional data from two-dimensional data (3D-from-2D) neural network models to derive three-dimensional data from one or more two-dimensional images captured of an object or environment from a current perspective of the object or environment viewed on or through a display of the device. The method further comprises, determining, by the system, a position for integrating a graphical data object on or within a representation of the object or environment viewed on or through the display based on the current perspective and the three-dimensional data.
    Type: Grant
    Filed: September 25, 2018
    Date of Patent: March 1, 2022
    Assignee: Matterport, Inc.
    Inventors: David Alan Gausebeck, Babak Robert Shakib
  • Patent number: 11256128
    Abstract: A display device includes: a display module including elemental pixel groups, each of the elemental pixel groups being configured to display an elemental image for displaying a reproduced image; an elemental lens array including elemental lenses, the elemental lenses being provided in front of the elemental pixel groups in one-to-one correspondence; a diopter adjustment element array including diopter adjustment elements, the diopter adjustment elements being provided in front of the plurality of elemental lenses in one-to-one correspondence; and a controller. The controller is configured to: control a part of the diopter adjustment elements in accordance with visual acuity of one eye of a user; and control the other part of the diopter adjustment elements in accordance with visual acuity of the other eye of the user.
    Type: Grant
    Filed: September 20, 2018
    Date of Patent: February 22, 2022
    Assignee: TIANMA MICROELECTRONICS CO., LTD.
    Inventors: Masanori Shirokawa, Ken Sumiyoshi
  • Patent number: 11249304
    Abstract: An apparatus such as a head-mounted display (HMD) may have a camera for capturing a visual scene for presentation via the HMD. A user of the apparatus may be operating a second, physical camera for capturing video or still images within the visual scene. The HMD may generate an augmented reality (AR) experience by presenting an AR view frustum representative of the actual view frustum of the physical camera. The field of view of the user viewing the captured visual scene via the AR experience is generally larger that the AR view frustum, allowing the user to avoid unnatural tracking movements and/or hunting for subjects.
    Type: Grant
    Filed: December 2, 2016
    Date of Patent: February 15, 2022
    Assignee: DISNEY ENTERPRISES, INC.
    Inventors: Steven M. Chapman, Joseph Popp
  • Patent number: 11250592
    Abstract: An information processing apparatus acquires, in regard to a subject in a three-dimensional space, unit element information including information regarding a position, in the space, of each of plural unit elements configuring the subject, draws a space image indicative of a state of a virtual space in which the plural unit elements are arranged using the unit element information, and specifies a posture of the subject in the three-dimensional space on the basis of a result obtained by executing a posture estimation process targeting a two-dimensional image for the drawn space image.
    Type: Grant
    Filed: January 30, 2018
    Date of Patent: February 15, 2022
    Assignee: SONY INTERACTIVE ENTERTAINMENT INC.
    Inventors: Tomokazu Kake, Satoshi Nakajima
  • Patent number: 11243433
    Abstract: In an image display device having a backlight including a plurality of light sources, the backlight is divided into a plurality of areas arranged in the same direction as an order of writing to pixels. A backlight drive circuit sets lighting periods separately for each of the areas and causes the brightness of the light sources to rise and drop in a non-step manner during the corresponding lighting period. In a case where first and second areas are adjacent to each other, there is a period of overlap between a lighting period set for the first area and a lighting period set for the second area, and the period of overlap includes a middle portion in which the brightness of light sources corresponding to the first area drops and the brightness of light sources corresponding to the second area rises.
    Type: Grant
    Filed: July 23, 2020
    Date of Patent: February 8, 2022
    Assignee: SHARP KABUSHIKI KAISHA
    Inventor: Masamitsu Kobayashi
  • Patent number: 11237625
    Abstract: The technology disclosed relates to a method of realistic simulation of real world interactions as virtual interactions between a control object sensed acting in a three-dimensional (3D) sensory space and the virtual object in a virtual space that the control object interacts with. In particular, it relates to detecting free-form gestures of a control object in a three-dimensional (3D) sensory space and generating for display a 3D solid control object model for the control object during the free-form gestures, including sub-components of the control object and in response to detecting a free-form gesture of the control object in the 3D sensory space in virtual contact with the virtual object, depicting, in the generated display, the virtual contact and resulting motions of the virtual object by the 3D solid control object model.
    Type: Grant
    Filed: November 24, 2020
    Date of Patent: February 1, 2022
    Assignee: Ultrahaptics IP Two Limited
    Inventors: John Adrian Arthur Johnston, Johnathon Scott Selstad, Alex Marcolina
  • Patent number: 11216095
    Abstract: A head-mounted display system may include a display device and a head-mounted device. The display device includes a touch screen surface exposed to an outside and including an active region which displays an image and senses a user input. The head-mounted device includes a frame, in which a reception space allowing the display device to be mounted therein is defined, and an optical system disposed in the frame. The active region of the display device includes a first active region, which is exposed to the outside and receives the user input for controlling the head-mounted device, when the display device is coupled with the head-mounted device.
    Type: Grant
    Filed: June 15, 2018
    Date of Patent: January 4, 2022
    Assignee: SAMSUNG DISPLAY CO., LTD.
    Inventor: Minsoo Kim
  • Patent number: 11202059
    Abstract: The image processing apparatus acquires image data to be displayed and generates an initial image to output the image to a head-mounted display. Further, the apparatus generates a reference image including an image for a left eye and an image for a right eye and representing an image of an object viewed from two viewpoints spaced apart horizontally. In the case where the inclination angle of the head of the user is other than 0 degrees, the apparatus rotates the image for the left eye and the image for the right eye in reverse to the head inclination, using one point defined on a view screen, as a common axis. The apparatus outputs the image data to the head-mounted display regardless of the presence or absence of rotation. The apparatus repeats the processes until the display ends.
    Type: Grant
    Filed: February 21, 2018
    Date of Patent: December 14, 2021
    Assignee: Sony Interactive Entertainment Inc.
    Inventor: Daisuke Kurata
  • Patent number: 11187895
    Abstract: A content generation system including an image generation unit operable to generate one or more images of a virtual environment for display at a first display device, and an image transmission unit operable to transmit generated images of the virtual environment to each of the first display device and the second display device, where the or each image displayed at one of the first display device and the second display device is a subset of the or each image displayed at the other of the first display device and the second display device, and where the viewpoint of the display device displaying a subset of the or each image is operable to modify the displayed field of view independently of the field of view displayed at the other display device.
    Type: Grant
    Filed: November 2, 2018
    Date of Patent: November 30, 2021
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Jesus Lucas Barcias, Claire Rogers, Douglas Ealey
  • Patent number: 11182958
    Abstract: In various embodiments, computerized methods and systems for rendering near-field objects as perceivable far-field objects within a virtual environment are provided. A determination is made that a near-field object to be rendered is configured for far-field perception within the virtual environment. The virtual environment is operable to include one or more virtualized near-field objects that are stereoscopically rendered utilizing one or more stereoscopic projection transforms generated based at least in part on a position and orientation of a head-mounted display. A harmonize transform is generated for the configured near-field object based at least in part on one of the stereoscopic projection transforms. Based on the determination that the near-field object is configured for far-field perception, the generated harmonize transform is employed to stereoscopically render the configured near-field object as a perceivable far-field object within the virtual environment.
    Type: Grant
    Filed: July 29, 2019
    Date of Patent: November 23, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventor: Patrick W. J. Evans
  • Patent number: 11175490
    Abstract: A shutter-type adaptive three-dimensional (3D) display system based on medical microscopic imaging is provided. In the system, a binocular camera is connected to an operating microscope optical system through a beam splitter, and is configured to acquire binocular image data. A control module is configured to input control instructions, where the control instructions include a first type of control instructions and a second type of control instructions. An image processing module calculates image parallaxes based on the binocular image data under the first type of control instructions, and transmits the image parallaxes to the binocular camera to adjust offsets. A display module is configured to generate display data based on the binocular image data and display the display data through a display device for viewing with 3D glasses. The operating microscope optical system is configured to perform an adjustment based on the control instructions.
    Type: Grant
    Filed: May 18, 2021
    Date of Patent: November 16, 2021
    Assignee: INSTITUTE OF AUTOMATION, CHINESE ACADEMY OF SCIENCES
    Inventors: Guibin Bian, Jinlian Song, Wenhao He, Zhen Li, Haitao Song
  • Patent number: 11166706
    Abstract: A surgical device includes a plurality of cameras integrated therein. The view of each of the plurality of cameras can be integrated together. A surgical tool that includes an integrated camera may be used in conjunction with the surgical device. The image produced by the camera integrated with the surgical tool may be associated with the images generated by the plurality of cameras integrated in the surgical device. The position and orientation of the cameras and/or the surgical tool can be tracked, and the surgical tool can be rendered as at least partially transparent. A surgical device may be powered by a hydraulic system, thereby reducing electromagnetic interference with tracking devices.
    Type: Grant
    Filed: March 18, 2019
    Date of Patent: November 9, 2021
    Assignee: CamPlex, Inc.
    Inventors: Steven T. Charles, John Tesar
  • Patent number: 11143904
    Abstract: A display device includes: a display module including elemental pixel groups, each of the elemental pixel groups being configured to display an elemental image for displaying a reproduced image; an elemental lens array including elemental lenses, the elemental lenses being provided in front of the elemental pixel groups in one-to-one correspondence; a diopter adjustment element array including diopter adjustment elements, the diopter adjustment elements being provided in front of the plurality of elemental lenses in one-to-one correspondence; and a controller. The controller is configured to: control a part of the diopter adjustment elements in accordance with visual acuity of one eye of a user; and control the other part of the diopter adjustment elements in accordance with visual acuity of the other eye of the user.
    Type: Grant
    Filed: September 20, 2018
    Date of Patent: October 12, 2021
    Assignee: TIANMA MICROELECTRONICS CO., LTD.
    Inventors: Masanori Shirokawa, Ken Sumiyoshi
  • Patent number: 11137967
    Abstract: In an exemplary process for interacting with user interface objects using an eye gaze, an affordance associated with a first object is displayed. A gaze direction or a gaze depth is determined. While the gaze direction or the gaze depth is determined to correspond to a gaze at the affordance, a first input representing user instruction to take action on the affordance is received, and the affordance is selected responsive to receiving the first input.
    Type: Grant
    Filed: March 24, 2020
    Date of Patent: October 5, 2021
    Assignee: Apple Inc.
    Inventors: Avi Bar-Zeev, Ryan S. Burgoyne, Devin W. Chalmers, Luis R. Deliz Centeno, Rahul Nair
  • Patent number: 11132827
    Abstract: The disclosure describes a distributed, pluggable architecture for an artificial reality (AR) system that enables concurrent execution and collaborative scene rendering for multiple artificial reality applications. For example, an AR system includes an image capture device configured to capture image data representative of a physical environment. The AR system also includes a head-mounted display (HMD) configured to output artificial reality content. The AR system further includes a plurality of concurrently executing artificial reality client applications. The AR system also includes a concurrent application engine configured to control rendering the artificial reality content as a common scene that include one or more objects from each of the plurality of artificial reality applications.
    Type: Grant
    Filed: September 19, 2019
    Date of Patent: September 28, 2021
    Assignee: Facebook Technologies, LLC
    Inventors: Denis Gladkov, Daniel Lehmann, Paul B. Menage, Clifford Merritt Boyd, Anton Vaneev, Luiz Alfonso Coimbra Barbosa Silva, Mandeep S Baines, Aaron David Lieberman, Rodney Huff, Cyril Daniel Saint Girons
  • Patent number: 11127219
    Abstract: Systems and methods are provided for displaying supplemental content for print media using augmented reality. A user profile for a user of an augmented reality device is determined. Content of the print media is searched to identify a first portion of the print media that matches the user profile and a second portion of the print media that does not match the user profile. Supplemental content is obtained based on content of the first portion of the print media. A display of the supplemental content is positioned over the second portion of the print media.
    Type: Grant
    Filed: January 22, 2020
    Date of Patent: September 21, 2021
    Assignee: Rovi Guides, Inc.
    Inventors: Lucas Waye, Theresa Tokesky, Michael A. Montalto, Kanagasabai Sivanadian
  • Patent number: 11113897
    Abstract: Systems and methods are provided herein for providing supplemental Augmented Reality (AR) content. Media content is provided to a user device located within a viewing area. A determination is made that a supplemental three dimensional (3D) AR content related to the media content is available. 3D characteristics of the supplemental AR content are determined. Such characteristics include a viewing angle and body position of an actor from the supplemental AR content. 3D characteristics of the viewing area are determined. Such characteristics include shape and position of the furniture within the viewing area and a position of a user within the viewing area. A position is determined within the viewing area by comparing the 3D characteristics of the supplemental AR content and the 3D characteristics of the viewing area. The supplemental AR content is then provided for display at the determined position.
    Type: Grant
    Filed: November 5, 2019
    Date of Patent: September 7, 2021
    Assignee: ROVI GUIDES, INC.
    Inventors: Vikram Makam Gupta, Harsha Neerakani, Nimit Dineshbhai Kalaria
  • Patent number: 11113799
    Abstract: A display method and a display device are provided. The display method may be applied to a display device having a lens unit and a display unit for normal display, and may include steps of: detecting a first distance between the lens unit and the display unit; calculating correction information according to the first distance and transmitting the correction information to the display unit; and displaying a corrected image by the display unit according to the correction information, so that the corrected image is converged into eyes of a user via the lens unit, wherein the corrected image is obtained by correcting an original image according to the first distance.
    Type: Grant
    Filed: January 2, 2019
    Date of Patent: September 7, 2021
    Assignees: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD., BOE TECHNOLOGY GROUP CO., LTD.
    Inventors: Yukun Sun, Xuefeng Wang, Jinghua Miao, Wenyu Li, Jinbao Peng, Bin Zhao, Lixin Wang, Xi Li, Qingwen Fan, Jianwen Suo, Yali Liu, Yu Lei, Yakun Wang, Hao Zhang, Lili Chen
  • Patent number: 11086197
    Abstract: The present invention relates to a photographing system. The photographing system may include a photographing device having a lens for capturing image data of a human; a display panel having a screen configured to display the image data of the human; and a semi-transparent mirror disposed between the human and the photographing device and at an angle to the screen of the display panel. The photographing device may capture the image data of the human through the semi-transparent mirror. The semi-transparent mirror may be disposed to reflect the image data of the human on the screen of the display panel so that a reflection of the image data of the human appears on the semi-transparent mirror.
    Type: Grant
    Filed: August 28, 2020
    Date of Patent: August 10, 2021
    Inventors: Yongtong Hu, David Hu
  • Patent number: 11080943
    Abstract: Embodiments of the present invention relate to the field of communications technologies, and disclose a method and an apparatus for displaying with a 3D parallax effect, to generate a relatively good 3D parallax effect. A specific solution is: displaying a graphical user interface, where the graphical user interface includes first content, and the first content includes at least two elements; obtaining a first operation instruction which is used for moving, in an area for displaying the first content, at least one first element of the at least two elements; and moving each of the at least one first element by a different distance along a direction of a first straight line, so that the first content has a 3D parallax effect, where the direction of the first straight line is a direction having a preset included angle with a plane in which the graphical user interface is located.
    Type: Grant
    Filed: April 17, 2020
    Date of Patent: August 3, 2021
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Xin Xin, Yu Gao, Jun Chen
  • Patent number: 10950058
    Abstract: A method for providing XR content includes obtaining a first 2D image representing a user's face, determining whether an object which is not the user's face is included in the first 2D image, in response to determining that the object is included in the acquired first 2D image, generating a second 2D image representing the user's face without the object based on the first 2D image, generating a first 3D image corresponding to the generated second 2D image, generating a mask image representing a difference between the first 2D image and the second 2D image, determining a type of object based on the generated mask image, obtaining a 3D preset including one or more 3D images corresponding to the determined type of object, generating a second 3D by combining at least one of one or more 3D images with the first 3D image and providing XR content including the generated second 3D image.
    Type: Grant
    Filed: August 28, 2019
    Date of Patent: March 16, 2021
    Assignee: LG ELECTRONICS INC.
    Inventors: Dahye Yoon, Seunghoon Lee
  • Patent number: 10901224
    Abstract: A wearable computing device having a main computing element having a center portion and at least two arms and a display element operably connected to arms to enclose a region within which a body part may be inserted. Each arm may include a docking element connectable to the display element and may be configured to slide within the arm to move the display element relative to the center portion of the main computing element. A pivot arm may pivotably connect the display element to the slider arm to permit pivoting of the display element relative to the plane of the main computing element.
    Type: Grant
    Filed: April 28, 2017
    Date of Patent: January 26, 2021
    Assignee: Intel Corporation
    Inventors: Jeff Ku, Gavin Sung, Simon S. Yuan, Lance Lin, Jason Y Jiang
  • Patent number: 10866632
    Abstract: The technology disclosed relates to a method of realistic simulation of real world interactions as virtual interactions between a control object sensed acting in a three-dimensional (3D) sensory space and the virtual object in a virtual space that the control object interacts with. In particular, it relates to detecting free-form gestures of a control object in a three-dimensional (3D) sensory space and generating for display a 3D solid control object model for the control object during the free-form gestures, including sub-components of the control object and in response to detecting a free-form gesture of the control object in the 3D sensory space in virtual contact with the virtual object, depicting, in the generated display, the virtual contact and resulting motions of the virtual object by the 3D solid control object model.
    Type: Grant
    Filed: September 30, 2019
    Date of Patent: December 15, 2020
    Assignee: Ultrahaptics IP Two Limited
    Inventors: John Adrian Arthur Johnston, Johnathon Scott Selstad, Alex Marcolina
  • Patent number: 10869013
    Abstract: Provided is a method for creating a virtual reality content, storing the virtual reality content in a transmission buffer, and after that, managing the transmission buffer. A server creates the virtual reality content based on user's motion information, stores the virtual reality content in the transmission buffer and is allowed to modify the virtual reality content stored in the transmission buffer based on subsequently received user's motion information, so that the most recent user's motion information can be appropriately reflected in the virtual reality content. It is possible to provide a more immersive virtual reality service.
    Type: Grant
    Filed: July 18, 2019
    Date of Patent: December 15, 2020
    Assignee: FOUNDATION FOR RESEARCH AND BUSINESS, SEOUL NATIONAL UNIVERSITY OF SCIENCE AND TECHNOLOGY
    Inventor: Ji Hoon Yun
  • Patent number: 10838210
    Abstract: A display system can include a head-mounted display configured to project light to an eye of a user to display augmented reality image content to the user. The display system can include one or more user sensors configured to sense the user and can include one or more environmental sensors configured to sense surroundings of the user. The display system can also include processing electronics in communication with the display, the one or more user sensors, and the one or more environmental sensors. The processing electronics can be configured to sense a situation involving user focus, determine user intent for the situation, and alter user perception of a real or virtual object within the vision field of the user based at least in part on the user intent and/or sensed situation involving user focus. The processing electronics can be configured to at least one of enhance or de-emphasize the user perception of the real or virtual object within the vision field of the user.
    Type: Grant
    Filed: July 24, 2017
    Date of Patent: November 17, 2020
    Assignee: Magic Leap, Inc.
    Inventors: Nastasja U. Robaina, Nicole Elizabeth Samec, Christopher M. Harrises, Rony Abovitz, Mark Baerenrodt, Brian Lloyd Schmidt
  • Patent number: 10802278
    Abstract: Technology is described for (3D) space carving of a user environment based on movement through the user environment of one or more users wearing a near-eye display (NED) system. One or more sensors of the NED system provide sensor data from which a distance and direction of movement can be determined. Spatial dimensions for a navigable path can be represented based on user height data and user width data of the one or more users who have traversed the path. Space carving data identifying carved out space can be stored in a 3D space carving model of the user environment. The navigable paths can also be related to position data in another kind of 3D mapping like a 3D surface reconstruction mesh model of the user environment generated from depth images.
    Type: Grant
    Filed: January 9, 2019
    Date of Patent: October 13, 2020
    Assignee: Microsoft Technology Licensing LLC
    Inventors: Anthony J. Ambrus, Jea Gon Park, Adam G. Poulos, Justin Avram Clark, Michael Jason Gourlay, Brian J. Mount, Daniel J. McCulloch, Arthur C. Tomlin
  • Patent number: 10803832
    Abstract: A method of coordinating a mixed-reality (MR) configured head-mounted display (HMD) with a separate media device to enable a synchronized user experience. The method includes establishing a communication channel between the HMD and the media device. At least one of the following is performed via the communication channel: accessing content on the media device or executing control commands on the media device based on an interface displayed by the HMD, or detecting media content presented by the media device and synchronizing display of MR content on the HMD and the detected media content.
    Type: Grant
    Filed: June 12, 2018
    Date of Patent: October 13, 2020
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: David H. Chung, Nils Harrison, Brian Nhu Dang, Christopher F. Lee
  • Patent number: 10762691
    Abstract: Examples described herein generally relate to displaying an image on a display device where a motion during a latency between a first time associated with activating a first portion of the display device and a second time associated with activating a second portion of the display device is predicted. At least a second portion of an image, to be displayed at the second time, is distorted based at least in part on a function of the motion and the latency to compensate for the latency. A first portion of the image is displayed at the first time by activating the first portion of the display device. The second portion of the image, as distorted, is displayed at the second time by activating the second portion of the display device.
    Type: Grant
    Filed: February 14, 2018
    Date of Patent: September 1, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Andrew Zicheng Yeung, Brent Michael Wilson, Jack Andrew Elliott, Matthew David Sandy, Michael George Boulton, Yang You
  • Patent number: 10757325
    Abstract: A video server comprises a video encoder to encode video data representing panoramic video content in which the panoramic video content has a greater field of view than a displayable region at a client device, the video encoder being configured to encode spatial regions within the video content at different respective encoding qualities in dependence upon track data indicating, for temporal positions with respect to the panoramic video content, a preferred viewing region within the panoramic video content at those temporal positions, so that the preferred viewing region is encoded at a higher encoding quality than another region of the panoramic video content.
    Type: Grant
    Filed: October 14, 2016
    Date of Patent: August 25, 2020
    Assignee: SONY INTERACTIVE ENTERTAINMENT INC.
    Inventors: Phillip Rogers, Quoc Dat Nguyen, Rohan Pankaj Bangdiwala, David Peter Woodhouse, Anthony Godar