Stereoscopic Patents (Class 348/42)
  • Patent number: 11517992
    Abstract: An assembly apparatus includes a retainer, a position measurement device, and a machining device. The retainer is configured to hold an assembly. The position measurement device is configured to measure a difference between an intended machining position and an actual machining position of a first coupling hole in a first assembly component. The first coupling hole is capable of being coupled to the assembly. The machining device is configured to form a second coupling hole capable of communicating with the first coupling hole in the assembly based on a reference position set on the assembly and the difference.
    Type: Grant
    Filed: October 2, 2020
    Date of Patent: December 6, 2022
    Assignee: SUBARU CORPORATION
    Inventors: Yoichi Sato, Marosuke Kikuchi
  • Patent number: 11510559
    Abstract: An image processing unit includes a shake amount calculation section and a static image-storage control section, and the shake amount calculation section includes a shake amount-calculation processing section and an algorithm switching section. The algorithm switching section applies an algorithm varying for each image, and selects images of which the shake amounts calculated by the shake amount-calculation processing section are small. A first image and a second image, which are selected as the images of which the shake amounts are small, are stored in a static image-storage unit. A display control unit displays static images for storage.
    Type: Grant
    Filed: May 6, 2020
    Date of Patent: November 29, 2022
    Assignee: FUJIFILM Corporation
    Inventor: Masahiro Kubo
  • Patent number: 11516454
    Abstract: Provided is a method for transmitting metadata for omnidirectional content including a plurality of viewpoints. The method comprises identifying the metadata for the omnidirectional content including the plurality of viewpoints; and transmitting the identified metadata, wherein the metadata includes information about an identifier (ID) of a viewpoint group including at least one viewpoint of the plurality of viewpoints, and wherein the at least one viewpoint in the viewpoint group shares a common reference coordinate system.
    Type: Grant
    Filed: April 2, 2019
    Date of Patent: November 29, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Eric Yip, Hyunkoo Yang, Youngwan So, Jaehyeon Bae
  • Patent number: 11507193
    Abstract: Configurations are disclosed for presenting virtual reality and augmented reality experiences to users. The system may comprise an image capturing device to capture one or more images, the one or more images corresponding to a field of the view of a user of a head-mounted augmented reality device, and a processor communicatively coupled to the image capturing device to extract a set of map points from the set of images, to identify a set of sparse points and a set of dense points from the extracted set of map points, and to perform a normalization on the set of map points.
    Type: Grant
    Filed: October 19, 2020
    Date of Patent: November 22, 2022
    Assignee: Magic Leap, Inc.
    Inventors: Gary R. Bradski, Samuel A. Miller, Rony Abovitz
  • Patent number: 11501571
    Abstract: A method comprising the steps of obtaining at least one frame of input data from at least one sensor, the frame of input data representative of a real-world environment at a given time. The frame is analysed to determine at least a foveal region within the frame, and at least a method for generating depth information associated with the real-world environment based on the frame of input data is selected. The method is applied to the foveal region to generate depth information associated with the foveal region, and at least the depth information associated with the foveal region is outputted.
    Type: Grant
    Filed: October 2, 2020
    Date of Patent: November 15, 2022
    Assignee: Arm Limited
    Inventor: Ozgur Tasdizen
  • Patent number: 11496724
    Abstract: A display processor and computer-implemented method are provided for processing three-dimensional [3D] image data for display on a 3D display. The 3D display is arranged for emitting a series of views of the 3D image data which enables stereoscopic viewing of the 3D image data at multiple viewing positions. The series of views may be displayed on the 3D display using overscan. The degree of overscan may be determined as a function of one or more depth range parameters, the one or more depth range parameters characterizing, at least in part, a degree of depth perceived by a viewer when the series of views is displayed on the 3D display.
    Type: Grant
    Filed: January 23, 2019
    Date of Patent: November 8, 2022
    Assignee: ULTRA-D COÖPERATIEF U.A.
    Inventors: Bart Gerard Bernard Barenbrug, Peter Roelen
  • Patent number: 11496541
    Abstract: Various concepts for media content streaming are described. Some allow for streaming spatial scene content in a spatially unequal manner so that the visible quality for the user is increased, or the processing complexity or used bandwidth at the streaming retrieval site is decreased. Others allow for streaming spatial scene content in a manner enlarging the applicability to further application scenarios.
    Type: Grant
    Filed: February 10, 2022
    Date of Patent: November 8, 2022
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Robert Skupin, Cornelius Hellge, Thomas Schierl, Yago Sánchez De La Fuente, Thomas Wiegand, Dimitri Podborski
  • Patent number: 11490105
    Abstract: From a bit stream, at least the following are decoded: a stereoscopic image of first and second views; a maximum positive disparity between the first and second views; and a minimum negative disparity between the first and second views. In response to the maximum positive disparity violating a limit on positive disparity, a convergence plane of the stereoscopic image is adjusted to comply with the limit on positive disparity. In response to the minimum negative disparity violating a limit on negative disparity, the convergence plane is adjusted to comply with the limit on negative disparity.
    Type: Grant
    Filed: September 11, 2020
    Date of Patent: November 1, 2022
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventors: Veeramanikandan Raju, Wei Hong, Minhua Zhou
  • Patent number: 11483512
    Abstract: Provided are a display apparatus and an operation method thereof for preventing image flicker when displaying mixed images: generating a first image corresponding to video content on a first plane, generating, on a second plane, a second image, outputting a mixed image that is a mixture of the first image and the second image, generating a third image on a third plane corresponding to the mixed image, and displaying the third image based on removal of the first image from the display.
    Type: Grant
    Filed: December 11, 2020
    Date of Patent: October 25, 2022
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Taehwan Kim, Sungjin Son, Seungjin Park, Kwangsub Byun, Junghwan Choi, Byungkwon Kang, Seokjae Lee
  • Patent number: 11483531
    Abstract: A system for generating three-dimensional (3D) images from captured images of a target when executing digital magnification. A controller executes a digital magnification on the first image of the target captured by the first image sensor and on the second image captured by the second image sensor of the target. The controller crops the first image and the second image to overlap a first portion of the target captured by the first image sensor with a second portion of the target captured by the second image sensor. The controller adjusts the cropping of the first image and the second image to provide binocular overlap of the first portion of the target with the second portion of target. The displayed cropped first image and the cropped second image display the 3D image at the digital magnification to the user.
    Type: Grant
    Filed: January 4, 2022
    Date of Patent: October 25, 2022
    Assignee: Unify Medical, Inc.
    Inventors: Yang Liu, Maziyar Askari Karchegani
  • Patent number: 11477480
    Abstract: An encoding device evaluates a plurality of processing and/or post-processing algorithms and/or methods to be applied to a video stream, and signals a selected method, algorithm, class or category of methods/algorithms either in an encoded bitstream or as side information related to the encoded bitstream. A decoding device or post-processor utilizes the signaled algorithm or selects an algorithm/method based on the signaled method or algorithm. The selection is based, for example, on availability of the algorithm/method at the decoder/post-processor and/or cost of implementation. The video stream may comprise, for example, downsampled multiplexed stereoscopic images and the selected algorithm may include any of upconversion and/or error correction techniques that contribute to a restoration of the downsampled images.
    Type: Grant
    Filed: March 26, 2020
    Date of Patent: October 18, 2022
    Assignee: DOLBY LABORATORIES LICENSING CORPORATION
    Inventors: Alexandros Tourapis, Athanasios Leontaris, Peshala V. Pahalawatta, Kevin J. Stec
  • Patent number: 11463628
    Abstract: This disclosure describes systems, methods, and devices related to the synchronization of image sensors with different exposure durations. In some embodiments, a system may include multiple image sensors, such as cameras, that have differing exposure durations. A data management component may be configured to receive sensor data from the image sensors. In addition, a synchronization component may be configured to transmit a shutter synchronization pulse to the image sensors. Finally, a tracking component may be configured to temporally center, based at least in part on the shutter synchronization pulse, the differing exposure durations of the image sensors. Various other systems and methods are also disclosed.
    Type: Grant
    Filed: September 14, 2020
    Date of Patent: October 4, 2022
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Gaurav Aggarwal, Pravin Sajan Tamkhane
  • Patent number: 11455705
    Abstract: The present disclosure relates to methods and apparatus for graphics processing. In some aspects, the apparatus may receive, by a first device from a second device, first position information corresponding to a first orientation of the second device. The apparatus can also generate, by the first device, first graphical content based on the first position information. Further, the apparatus can also generate, by the first device, motion information for warping the first graphical content. The apparatus can also encode, by the first device, the first graphical content. Additionally, the apparatus can provide, by the first device to the second device, the motion information and the encoded first graphical content.
    Type: Grant
    Filed: May 20, 2019
    Date of Patent: September 27, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Sudipto Banerjee, Vinay Melkote Krishnaprasad, Pawan Kumar Baheti, Ajit Venkat Rao
  • Patent number: 11443445
    Abstract: A method and apparatus for depth estimation of a monocular image, and a storage medium are provided. The method includes: obtaining, through a depth estimation neural network, a global feature of a monocular image according to absolute features of preset regions and relative features among the preset regions in the monocular image; and obtaining a predicted depth map of the monocular image according to the global feature, and the absolute features of preset regions and relative features among the preset regions in the monocular image.
    Type: Grant
    Filed: March 26, 2020
    Date of Patent: September 13, 2022
    Assignee: SHENZHEN SENSETIME TECHNOLOGY CO., LTD.
    Inventors: Yukang Gan, Xiangyu Xu, Wenxiu Sun, Liang Lin
  • Patent number: 11425352
    Abstract: A method for synthesizing an image of a view from images of N (N>2), implemented by an image synthesis device. The method includes: projecting, to a position corresponding to the image of the view to be synthesized, N depth maps associated with the N views, respectively; for at least one given pixel of at least one projected depth map, for which a depth value has been associated on completion of projection, modifying the depth value of the at least one given pixel if an item of reliability information associated with the depth value is at a certain value, the modification using the depth value of a pixel whose position corresponds to that of the at least one given pixel, in at least one other projected depth map, which generates at least one modified projected depth map.
    Type: Grant
    Filed: October 22, 2019
    Date of Patent: August 23, 2022
    Assignee: ORANGE
    Inventors: Patrick Boissonade, Joël Jung
  • Patent number: 11423599
    Abstract: An image rendering method comprises receiving 3D model data for a 3D model and processing the 3D model data to render image data for a hogel view to a render target. Processing the 3D model data to render the image data comprises defining a frustum having an origin at an image plane and rendering multiple sides of the frustum in a single pass without duplicating geometric shapes that pass through the image plane. The frustum comprises a plurality of side planes and having a top portion of the frustum and a bottom portion of the frustum, the plurality of side planes having a set of side plane edges that pass through the origin.
    Type: Grant
    Filed: March 1, 2021
    Date of Patent: August 23, 2022
    Assignee: 3D Patents, LLC
    Inventors: Thomas Lawrence Burnett, III, Kendall Heath James, Ronald Craig Larcom
  • Patent number: 11412233
    Abstract: Methods and systems for light field image encoding and decoding are disclosed. According to some embodiments, scene metadata and input light field images associated with a scene are received. A first encoding operation is performed on the scene metadata and input light field images to generate reference images, reference disparity information, and an order of reference views. A second encoding operation is performed based on the reference images and reference disparity information to output light field encoded data. The light field encoded data includes the encoded reference images, the encoded reference disparity information, and the order of reference views. The light field encoded data is transmitted.
    Type: Grant
    Filed: February 22, 2021
    Date of Patent: August 9, 2022
    Assignee: Ostendo Technologies, Inc.
    Inventors: Wankai Liu, Zahir Y. Alpaslan, Hussein S. El-Ghoroury
  • Patent number: 11412123
    Abstract: A display system for a vehicle comprises an imager configured to capture image data in a field of view rearward relative the vehicle. The system further comprises a display device and a controller. The display device comprises a screen disposed in a passenger compartment of the vehicle. The controller is in communication with the imager and the display device. The controller is operable to process the image data to identify at least one feature. Based on a position or orientation of the at least one feature in the image data, the controller adjusts at least one of a position and an orientation of a desired view of the image data for display on the screen.
    Type: Grant
    Filed: March 17, 2016
    Date of Patent: August 9, 2022
    Assignee: GENTEX CORPORATION
    Inventors: Tom B. Sherman, Daniel G. McMillan, Gregory S. Bush
  • Patent number: 11410338
    Abstract: A measuring device and a measuring system. The measuring device includes circuitry to obtain at least one pair of stereo captured images captured by a stereo camera, detect two or more feature points from each one of the at least one pair of stereo captured images, and measure a disparity error using a distance between a pair of feature points of the two or more feature points on each one of the at least one pair of stereo captured images, where an equation S img > ? ? ? S E da ? d is satisfied. In the equation, Simg denotes the distance, ? denotes a detection error between the pair of imaging devices. Moreover, Eda denotes precision of measurement of a disparity error in disparity between a pair of images of the at least one pair of stereo captured images, and d denotes the disparity. The stereo camera including a pair of imaging devices.
    Type: Grant
    Filed: April 28, 2020
    Date of Patent: August 9, 2022
    Assignee: RICOH COMPANY, LTD.
    Inventors: Hiroki Mima, Seiya Amano
  • Patent number: 11403742
    Abstract: An image processing device includes: a solid object extraction unit that divides each of a plurality of captured images into a foreground image part occupied by an existent object and a background image part; a background complementing unit that complements each background image part; a background image synthesis unit that generates a background bird's eye synthetic image by performing bird's eye transformation and combining together the background image parts after undergoing the bird's eye transformation; a solid object recognition unit that acquires posture information on the existent object; a solid object projection unit that acquires a three-dimensional virtual object by using the posture information; a three-dimensional space superimposition unit that generates a three-dimensional space image by superimposing the three-dimensional, virtual object on the background bird's eye synthetic image; and a display image output unit that outputs a bird's eye synthetic image generated based on the three-dimension
    Type: Grant
    Filed: September 22, 2020
    Date of Patent: August 2, 2022
    Assignee: Mitsubishi Electric Corporation
    Inventors: Tsukasa Fukasawa, Kohei Okahara, Ichiro Furuki
  • Patent number: 11405699
    Abstract: An example device for accessing media data includes a memory configured to store media data; and one or more processors implemented in circuitry and configured to: receive a scene description of a GL Transmission Format 2.0 (glTF2) bitstream including a timed media object; determine a position of the timed media object in a presentation environment using the scene description; retrieve current timed media data for the timed media object for a current presentation time; and present the current timed media data according to the position of the timed media object at the current presentation time.
    Type: Grant
    Filed: September 30, 2020
    Date of Patent: August 2, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Imed Bouazizi, Thomas Stockhammer, Nils Günther Peters
  • Patent number: 11405645
    Abstract: Transform kernel candidates including a vertical transform type associated with a vertical motion and a horizontal transform type associated with a horizontal motion can be encoded or decoded. During an encoding operation, a residual block of a current block is transformed according to a selected transform kernel candidate to produce a transform block. A probability model for encoding the selected transform kernel candidate is then identified based on neighbor transform blocks of the transform block. The selected transform kernel candidate is then encoded according to the probability model. During a decoding operation, the encoded transform kernel candidate is decoded using the probability model. The encoded transform block is then decoded by inverse transforming dequantized transform coefficients thereof according to the decoded transform kernel candidate.
    Type: Grant
    Filed: June 22, 2017
    Date of Patent: August 2, 2022
    Assignee: GOOGLE LLC
    Inventors: Jingning Han, Yaowu Xu, Ching-Han Chiang
  • Patent number: 11397333
    Abstract: An optical display system and an AR/VR display device are provided. The optical display system includes: a display screen; a first optical structure, disposed on a light emitting side of the display screen, and configured to divide light from the display screen into different types of polarized light; and a second optical structure, disposed on an emitting path of the different types of polarized light to an image forming side, and configured to form a plurality of virtual image planes corresponding to at least two focal lengths.
    Type: Grant
    Filed: September 9, 2019
    Date of Patent: July 26, 2022
    Assignees: Beijing BOE Optoelectronics Technology Co., Ltd., BOE Technology Group Co., Ltd.
    Inventors: Chenru Wang, Hao Zhang, Lili Chen, Ruijun Dong, Yali Liu, Ke Li
  • Patent number: 11372419
    Abstract: A method for shortening a waiting time for human-robot interaction, a device and a storage medium are provided. A robot acquires a to-be-executed task, plans an optimal navigation path according to a task location of the to-be-executed task, and goes to a first location according to the planned optimal navigation path to execute a task corresponding to the first location. The robot determines whether there is a worker, capable of performing human-robot cooperation, at the first location. In a case where there is a worker, capable of performing human-robot cooperation, at the first location, the robot sends prompt information and waits, at the first location, for the worker to cooperatively complete the task corresponding to the first location. In a case where there is no worker, capable of performing human-robot cooperation, at the first location, the robot goes to a next location according to the optimal navigation path.
    Type: Grant
    Filed: December 20, 2021
    Date of Patent: June 28, 2022
    Assignee: SYRIUS ROBOTICS CO., LTD.
    Inventor: Hua Huang
  • Patent number: 11366319
    Abstract: This patent provides a novel set of stereoscopic imaging techniques. Such techniques allow extremely large field of view datasets capable of stereoscopic display, such as greater than 270° horizontal field of view and 180° vertical field of view. Thus it is possible to record data in a way that is larger than a user could visualize. A user can thus select which subset of the dataset he/she wants to view. Then, allow the user to view naturally via head tracking and eye tracking to allow one to see and inspect a scene as if one were naturally there viewing it in real time.
    Type: Grant
    Filed: April 8, 2021
    Date of Patent: June 21, 2022
    Assignee: DOUGLAS LABS, INC.
    Inventors: Robert Edwin Douglas, Kathleen Mary Douglas, David Byron Douglas
  • Patent number: 11367197
    Abstract: Systems and methods of the present disclosure can facilitate determining a three-dimensional surface representation of an object. In some embodiments, the system includes a computer, a calibration module, which is configured to determine a camera geometry of a set of cameras, and an imaging module, which is configured to capture spatial images using the cameras. The computer is configured to determine epipolar lines in the spatial images, transform the spatial images with a collineation transformation, determine second derivative spatial images with a second derivative filter, construct epipolar plane edge images based on zero crossings of second derivative epipolar planes image based on the epipolar lines, select edges and compute depth estimates, sequence the edges based on contours in a spatial edge image, filter the depth estimates, and create a three-dimensional surface representation based on the filtered depth estimates and the original spatial images.
    Type: Grant
    Filed: January 6, 2020
    Date of Patent: June 21, 2022
    Inventor: Henry Harlyn Baker
  • Patent number: 11361737
    Abstract: In a normal state, a video input interface receives video data. In a setup state, a control input interface receives graphics data for an On Screen Display (OSD) function. In the setup state, an encoder encodes the graphics data, and stores compressed image data S6 thus encoded in memory. In the normal state, a decoder reads one item of the compressed image data from the memory according to an instruction signal, and decodes the compressed image data thus read so as to reproduce the original graphics data. A multiplexer superimposes graphics data on frame data, and outputs the superimposed graphics data.
    Type: Grant
    Filed: July 23, 2020
    Date of Patent: June 14, 2022
    Assignee: ROHM CO., LTD.
    Inventor: Hiroharu Endo
  • Patent number: 11360588
    Abstract: The present disclosure related to a method for playing a multidimensional reaction-type image. The method includes at least: receiving, by a computer, input manipulation to an object from a user; and extracting, by the computer, an image frame matched to a detailed cell corresponding to location information and depth information in a reaction-type image, depending on the location information and the depth information of the input manipulation received at each playback time point. The depth information is information about pressure strength of the input manipulation applied to the reaction-type image or time length to which the input manipulation is applied. The location information is information about a location of a two-dimensional space in which the input manipulation is applied to the reaction-type image.
    Type: Grant
    Filed: June 2, 2020
    Date of Patent: June 14, 2022
    Inventor: Chui Woo Lee
  • Patent number: 11360375
    Abstract: A system and method for calibrating stereoscopic cameras in an aircraft utilizes a plurality of lasers aimed at a desired convergence point, such as at a point on a runway or other ground facility or projection surface. Each of the stereoscopic cameras are adjusted in terms of pitch, yaw, and roll to align the convergence point in each camera. Misalignments are iteratively corrected, as required. An alignment crosshair is applied, physically or electronically, and the convergence point aligned to the alignment crosshair.
    Type: Grant
    Filed: March 10, 2020
    Date of Patent: June 14, 2022
    Assignee: Rockwell Collins, Inc.
    Inventors: Daniel J. Henry, Nathan A. Vaughn
  • Patent number: 11356646
    Abstract: A device for projecting an image on a surface of an object includes an extracting unit configured to extract information about a plurality of lines from an image of the object based on depth information and color information extracted from the image of the object; an image projection distortion information deriving unit configured to derive image projection distortion information about the surface of the object based on the information about the plurality of lines; and a projecting unit configured to project a content image on the surface of the object based on the derived image projection distortion information.
    Type: Grant
    Filed: January 29, 2021
    Date of Patent: June 7, 2022
    Assignee: FOUNDATION FOR RESEARCH AND BUSINESS, SEOUL NATIONAL UNIVERSITY OF SCIENCE AND TECHNOLOGY
    Inventors: Goo Man Park, Sang Joon Kim, Yu Jin Lee
  • Patent number: 11341976
    Abstract: A voice output corresponding to a fixed position of a wide viewing angle image is easily obtained. A transmission unit configured to transmit spatial voice data and information regarding a predetermined number of registered viewpoints is included. For example, the spatial voice data is data of scene-based audio. Then, for example, the data of the scene-based audio is each component of an HoA format. For example, the information regarding a viewpoint includes information regarding an azimuth angle (azimuth information) and an elevation angle (elevation angle information) that indicate a position of this viewpoint. For example, the data of the scene-based audio and the information regarding the predetermined number of registered viewpoints are transmitted with being included in a packet of object audio.
    Type: Grant
    Filed: January 28, 2019
    Date of Patent: May 24, 2022
    Assignee: SONY CORPORATION
    Inventor: Ikuo Tsukagoshi
  • Patent number: 11330172
    Abstract: The present application discloses a method and apparatus for generating a panoramic image. A cuboid three-dimensional image of each local space is determined according to an original two-dimensional image of each local space in the overall space and a preset cuboid model corresponding to each local space, and then a three-dimensional panoramic image of the overall space is generated according to all determined cuboid three-dimensional images. Since the three-dimensional panoramic image of the overall space is generated according to the cuboid three-dimensional images of all local spaces, the overall space may be visually viewed at a three-dimensional angle of view to achieve the three-dimensional real-scene effect.
    Type: Grant
    Filed: October 17, 2017
    Date of Patent: May 10, 2022
    Assignee: Hangzhou Hikvision Digital Technology Co., Ltd.
    Inventors: Yaodong Lin, Jie Chen, Xin Zhang
  • Patent number: 11328380
    Abstract: The present disclosure generally relates to machine vision systems, illumination sources for use in machine vision systems, and components for use in the illumination sources. More specifically, the present disclosure relates to machine vision systems incorporating multi-function illumination sources, multi-function illumination sources, and components for use in multi-function illumination sources.
    Type: Grant
    Filed: October 26, 2019
    Date of Patent: May 10, 2022
    Inventors: Gilbert Pinter, Edward Brandel, Jeremy Brodersen
  • Patent number: 11330304
    Abstract: A video stream protection device is for protecting a video stream to be decoded. The video stream contains one or more data units each having a header section and a body section, and the header section contains header information indicative of a data type of the corresponding body section. The video stream protection device comprises: an identification module for identifying the one or more data units based on respective start positions of the one or more data units; a data type detection module for obtaining the header information of the identified data units, and determining the data type of the body section of each identified data unit based on the header information of the identified data unit; and a control module for determining whether to prohibit decoding of data of each data unit based on the data type of the body section of the data unit.
    Type: Grant
    Filed: September 18, 2020
    Date of Patent: May 10, 2022
    Assignee: Montage LZ Technologies (Chengdu) Co., Ltd.
    Inventors: Youyuan Huang, Zhimin Qiu, Chengqiang Liu
  • Patent number: 11328479
    Abstract: A generation device includes: a communication interface via which two-dimensional (2D) images are to be received, the 2D images having been generated by photographing a space from different viewpoints with at least one camera; and a processor connected to the communication interface and configured to determine, according to the 2D images, a matching pattern to match feature points included in two pictures among the 2D images, match the feature points according to the matching pattern in order to generate first three-dimensional (3D) points, the first 3D points indicating respective first positions in the space, generate second 3D point based on the 2D images, the second 3D point indicating a second position in the space, and generate a 3D model of the space based on the first 3D points and the second 3D point.
    Type: Grant
    Filed: April 22, 2020
    Date of Patent: May 10, 2022
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Zhen Peng Bian, Pongsak Lasang, Toshiyasu Sugio, Toru Matsunobu, Satoshi Yoshikawa, Tatsuya Koyama
  • Patent number: 11323675
    Abstract: A method for generating a mask and a projection apparatus for performing the method are provided. The method includes: projecting a first pattern onto a projection surface, wherein the projection surface includes a non-planar region, and the first pattern includes multiple first straight lines; shooting a first image of the projection surface on which the first pattern is rendered; finding at least one first specific line segment in the first image, wherein each first specific line segment includes at least one first inflection point; delineating a first contour based on the at least one first inflection point in a case of determining that the at least one first inflection point in the first image is suitable for delineating the first contour; and generating a first mask pattern based on the first contour in a case of determining that the first contour matches a region contour of the non-planar region.
    Type: Grant
    Filed: March 30, 2021
    Date of Patent: May 3, 2022
    Assignee: Coretronic Corporation
    Inventors: Chi-Wei Lin, Chien-Chun Peng, Hsun-Cheng Tu
  • Patent number: 11317075
    Abstract: Video data is received in 2D or 3D format from different channels as a user scrolls through an electronic guide. The video data may be displayed in a portion of the on: screen display along with graphic and text associated with the EPG data. The received video data may be converted to a suitable format (e.g., a 2D format, or a 3D format) to be displayed with the Electronic Program Guide (EPG). The selection of converting the received video data can be based on a display format of a previously viewed channel prior to requesting the EPG to be displayed.
    Type: Grant
    Filed: July 15, 2016
    Date of Patent: April 26, 2022
    Assignee: Google Technology Holdings LLC
    Inventors: Ajay K. Luthra, Arjun Ramamurthy
  • Patent number: 11308682
    Abstract: A method comprising the steps of generating a first representation and a second representation, where the first representation represents a first view of a computer-generated scene obtained from a first virtual camera and the second representation represents a second view of the computer-generated scene obtained from a second virtual camera. Each of the first and second representation comprises a plurality of rays which intersect with objects of the scene. A relationship is determined between a ray of the first representation and a ray of the second representation; which are grouped based on the relationship, to form a group of substantially similar rays. One or more of the groups of substantially similar rays are processed substantially simultaneously to produce a first a second rendered view of the computer-generated scene. The first the second rendered view are output to one or more display devices.
    Type: Grant
    Filed: October 28, 2019
    Date of Patent: April 19, 2022
    Assignees: Apical Limited, Arm Limited
    Inventors: Daren Croxford, Mathieu Jean Joseph Robart
  • Patent number: 11310487
    Abstract: A system, method or compute program product for restricting convergence and divergence when viewing stereo 3D imagery. The technique includes receiving data representing a 3D virtual scene, receiving data indicating an eyepoint and a three-dimensional frustum rendering region with the three dimensional frustum rendering region identifying a position and orientation of a render plane, receiving data indicating a user stereo comfort region, rendering virtual objects in a first portion of the 3D virtual scene that is in the three-dimensional frustum rendering region and within the user stereo comfort region onto the render plane according to a first type of projection, and rendering virtual objects in a second portion of the 3D virtual scene that is in the three-dimensional frustum rendering region and outside the user stereo comfort region onto the render plane according to a different second type of projection.
    Type: Grant
    Filed: May 4, 2020
    Date of Patent: April 19, 2022
    Assignee: Tanzle, Inc.
    Inventors: Nancy L. Clemens, Michael A. Vesely
  • Patent number: 11290638
    Abstract: A system for consistently imaging objects may include an imaging device that presents a visual guide on a display for aligning with a target object, and that uses sensors of the imaging device to provide exact direction for correctly aligning the visual guide with the target object prior to capturing an image of the target object. The system may include a device that receives a particular image of a particular object, selects a model that defines positional commonality or visual characteristic commonality between a set of images of the particular object or a particular object type that includes the particular object, and that generates an edited image by correcting one or more deviations between positioning of the particular object in the particular image and the positional commonality specified in the model, or between visual characteristics of the particular image and the visual characteristic commonality specified in the model.
    Type: Grant
    Filed: March 17, 2021
    Date of Patent: March 29, 2022
    Assignee: Photon Ventures Inc.
    Inventor: Peter Anthony Duffy
  • Patent number: 11275352
    Abstract: A system and method for automatically manufacturing custom parts for use in a prefabricated construction site includes scanning a room under construction. The method also includes determining, based on the scan of the room, an image of an installation location in the room. The method also includes calculating, based on the image of the installation location, alteration dimensions for a prefab part. The alteration dimensions comprise alterations to the prefab part to match spatial dimensions of the installation location in the room. The method additionally includes transmitting, via a network, the alteration dimensions to a factory. The factory fabricates a custom prefab part according to the alteration dimensions.
    Type: Grant
    Filed: December 13, 2019
    Date of Patent: March 15, 2022
    Assignee: GRUBB PROPERTIES, LLC
    Inventor: Dae Young Huh
  • Patent number: 11252432
    Abstract: In the present disclosure, a method of decoding a video signal and a device therefor are disclosed. Specifically, a method of decoding an image based on an inter prediction mode includes deriving a motion vector of an available spatial neighboring block around a current block; deriving a collocated block of the current block based on the motion vector of the spatial neighboring block; deriving a motion vector in a sub-block unit in the current block based on a motion vector of the collocated block; and generating a prediction block of the current block using the motion vector derived in the sub-block unit, wherein the collocated block may be specified by the motion vector of the spatial neighboring block in one pre-defined reference picture.
    Type: Grant
    Filed: October 1, 2020
    Date of Patent: February 15, 2022
    Assignee: LG ELECTRONICS INC.
    Inventors: Hyeongmoon Jang, Junghak Nam, Naeri Park
  • Patent number: 11243612
    Abstract: Embodiments of display control based on dynamic user interactions generally include capturing a plurality of temporally sequential images of the user, or a body part or other control object manipulated by the user, and computationally analyzing the images to recognize a gesture performed by the user. In some embodiments, a scale indicative of an actual gesture distance traversed in performance of the gesture is identified, and a movement or action is displayed on the device based, at least in part, on a ratio between the identified scale and the scale of the displayed movement. In some embodiments, a degree of completion of the recognized gesture is determined, and the display contents are modified in accordance therewith. In some embodiments, a dominant gesture is computationally determined from among a plurality of user gestures, and an action displayed on the device is based on the dominant gesture.
    Type: Grant
    Filed: November 19, 2018
    Date of Patent: February 8, 2022
    Assignee: Ultrahaptics IP Two Limited
    Inventors: Raffi Bedikian, Jonathan Marsden, Keith Mertens, David Holz, Maxwell Sills, Matias Perez, Gabriel Hare, Ryan Julian
  • Patent number: 11240477
    Abstract: The present invention provides a method and a device for image rectification, which are applied in the field of image processing. The method includes: receiving two images, the two images are images of a target object captured from different viewpoints; performing an epipolar rectification on the two images; rectifying the two images after the epipolar rectification based on the image contents; and splicing the two images after the rectification based on the image contents. The method can rectify the images captured from different viewpoints, thereby ensuring the pixel alignment, and avoiding visual discomfort to the viewer.
    Type: Grant
    Filed: November 13, 2018
    Date of Patent: February 1, 2022
    Assignee: ArcSoft Corporation Limited
    Inventors: Wang Miao, Li Yu, Xin Fan
  • Patent number: 11233995
    Abstract: Devices, systems and methods for temporal prediction of parameters in non-linear adaptive loop filtering are described. In an exemplary aspect, a method for visual media processing includes configuring, for a current video block, one or more parameters of a clipping operation that is part of a non-linear filtering operation; and performing, based on the one or more parameters, a conversion between the current video block and a bitstream representation of the current video block, wherein the one or more parameters is coded in accordance with a rule.
    Type: Grant
    Filed: August 3, 2021
    Date of Patent: January 25, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11223764
    Abstract: A method for determining bias in an inertial measurement unit of an image acquisition device comprises mapping at least one reference point within an image frame into a 3D spherical space based on a lens projection model for the image acquisition device to provide a respective anchor point in 3D space for each reference point.
    Type: Grant
    Filed: August 24, 2020
    Date of Patent: January 11, 2022
    Assignee: FotoNation Limited
    Inventor: Piotr Stec
  • Patent number: 11210814
    Abstract: A three-dimensional data encoding method includes: generating encoded data by encoding third point cloud data that is a combination of first point cloud data and second point cloud data; and generating a bitstream including the encoded data and control information. The encoded data includes a piece of geometry information and pieces of attribute information of each of three-dimensional points included in the third point cloud data. One of the pieces of attribute information includes first information indicating whether a corresponding one of the three-dimensional points belongs to the first point cloud data or the second point cloud data. The control information includes second information indicating, among the pieces of attribute information, a piece of attribute information including the first information.
    Type: Grant
    Filed: January 22, 2021
    Date of Patent: December 28, 2021
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Noritaka Iguchi, Toshiyasu Sugio
  • Patent number: 11205281
    Abstract: The present invention provides a method and a device for image rectification, which is applied to the field of image processing. The method includes: receiving two images, wherein the two images are images of a target object captured at different viewpoints, and an image capturing device configured to capture the two images, includes a first image capturing device and a second image capturing device; determining positions of corresponding feature point pairs in the two images; and aligning the two images according to the positions of the feature point pairs and parameters of the first image capturing device and the second image capturing device. The above-mentioned method can rectify the images captured at different viewpoints, thereby ensuring the alignment of pixels, and avoiding visual discomfort of the viewer.
    Type: Grant
    Filed: November 13, 2018
    Date of Patent: December 21, 2021
    Assignee: ArcSoft Corporation Limited
    Inventors: Li Yu, Wang Miao, Xin Fan
  • Patent number: 11199706
    Abstract: A Head-Mounted Display system together with associated techniques for performing accurate and automatic inside-out positional, user body and environment tracking for virtual or mixed reality are disclosed. The system uses computer vision methods and data fusion from multiple sensors to achieve real-time tracking. High frame rate and low latency is achieved by performing part of the processing on the HMD itself.
    Type: Grant
    Filed: September 25, 2020
    Date of Patent: December 14, 2021
    Assignee: APPLE INC.
    Inventors: Simon Fortin-Deschênes, Vincent Chapdelaine-Couture, Yan Côté, Anthony Ghannoum
  • Patent number: 11172190
    Abstract: Systems and methods are described for determining a tracked position associated with viewing an emitting interface of a display device, generating, using the tracked position, a first mask representing a first set of values associated with the emitting interface of the display device, generating, using the tracked position, a second mask representing a second set of values associated with the emitting interface of the display device, and generating an output image using the first mask and the second mask.
    Type: Grant
    Filed: January 16, 2019
    Date of Patent: November 9, 2021
    Assignee: GOOGLE LLC
    Inventor: Andrew Ian Russell