Multiple Cameras Patents (Class 348/47)
  • Patent number: 11966793
    Abstract: Systems and methods to extend an interactive experience across multiple platforms are presented herein. The interactive experience may take place in an interactive space. The interactive space as experienced by a user of a host device (e.g., headset) may be extended to one or more mobile computing platforms. The host device may present views of virtual content perceived to be present within the real world. A given mobile computing platform may be positioned at or near the host device. The mobile computing platform may take images/video of the user of the host device. The mobile computing platform may superimpose views of the virtual content onto the images/video from the perspective of the mobile computing platform. The virtual content presented at the mobile computing platform may be perceived to be in the real world.
    Type: Grant
    Filed: October 18, 2017
    Date of Patent: April 23, 2024
    Assignee: Campfire 3D, Inc.
    Inventors: Paulo Jansen, Benjamin Lucas, Forest Rouse, Mayan Shay May-Raz, Joshua Hernandez
  • Patent number: 11966981
    Abstract: Provided is a method and apparatus for assessing an insured loss, a computer device, and a storage medium. The method includes: S1: building up a database, and conducting model training on big data using a deep learning model or machine learning model to improve a recognition effect; S2: capturing a photo of a roof of a house to be assessed for damage according to needs, and transmitting collected image data to a background; S3: automatically recognizing the image data by the background according to needs, and feeding back a recognition result; S4: marking out a damage point, a suspected damage point, and a non-damage point according to the recognition result; and S5: formulating a loss assessment report using the marked results according to needs. The apparatus, computer device, and storage medium each correspond to the above method.
    Type: Grant
    Filed: November 29, 2021
    Date of Patent: April 23, 2024
    Assignee: SHENZHEN JU FENG TECHNOLOGY COMPANY
    Inventors: Kun Liu, Xiaoqing Wu
  • Patent number: 11965968
    Abstract: An optical sensing system comprising: a processing circuit; an optical sensor, configured to sense first optical data respectively in first sensing time intervals; and a TOF (Time of Flight) optical sensor, configured to sense second optical data respectively in second sensing time intervals. The processing circuit computes a distance between a first object and the optical sensing system according to the second optical data. The first sensing time intervals do not overlap with the second sensing time intervals.
    Type: Grant
    Filed: December 3, 2020
    Date of Patent: April 23, 2024
    Assignee: PixArt Imaging Inc.
    Inventors: Zi Hao Tan, Joon Chok Lee, Keen-Hun Leong, Sai Mun Lee
  • Patent number: 11961307
    Abstract: An external environment recognition device includes: a plurality of external environment recognition sensors each having an information detection unit that detects information of an object outside a vehicle, the plurality of external environment recognition sensors being arranged such that a detection range of the information detection unit includes an overlapping region where at least part of the detection range of the information detection unit overlaps with at least part of the detection range of another one of the information detection units; and a synchronous processing unit that extracts identical objects in the overlapping region from detection results of the external environment recognition sensors, and performs synchronous processing to synchronize the plurality of external environment recognition sensors if there is a deviation in position between the identical objects in the overlapping region.
    Type: Grant
    Filed: March 13, 2020
    Date of Patent: April 16, 2024
    Assignee: MAZDA MOTOR CORPORATION
    Inventor: Daisuke Hamano
  • Patent number: 11948304
    Abstract: A method of determining volumetric data of a predetermined anatomical feature is described. The method comprising determining volumetric data of one or more anatomical features present in a field of view of a depth sensing camera apparatus, identifying a predetermined anatomical feature as being present in the field of view of the depth sensing camera apparatus, associating the volumetric data of one of the one or more anatomical features with the identified predetermined anatomical feature, and outputting the volumetric data of the predetermined anatomical feature. An apparatus is also described.
    Type: Grant
    Filed: March 2, 2023
    Date of Patent: April 2, 2024
    Assignee: HEARTFELT TECHNOLOGIES LIMITED
    Inventor: Shamus Husheer
  • Patent number: 11949808
    Abstract: Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for a wearable multimedia device and, in some implementations, a cloud computing platform. In some implementations, in a method for presentation of a home screen. In response to determining that a waking condition of a mobile device is satisfied, an environment of the mobile device is sensed using one or more sensors of the mobile device. Based at least on the sensing, a current context of the mobile device is determined. In response to determining the current context of the mobile device, a particular content is selected from among a plurality of content, the particular content being relevant to a user of the mobile device based on the current context of the mobile device. The particular content is presented as a home screen of the mobile device upon waking the mobile device.
    Type: Grant
    Filed: March 4, 2022
    Date of Patent: April 2, 2024
    Assignee: Humane, Inc.
    Inventors: Kenneth Luke Kocienda, Imran A. Chaudhri
  • Patent number: 11945479
    Abstract: In a method for detecting obstacles for a rail vehicle, 3D sensor data is detected from a surrounding region, 3D image data is generated from the 3D sensor data, and 2D image data is generated on the basis of the 3D image data. A 2D anomaly mask is ascertained or generated by comparing the 2D image data with reference image data which is free of a collision obstacle. In the process, image regions are identified as mask regions in the 2D image data which differ from the corresponding image regions in the reference image data. By fusing the 2D anomaly mask with the 3D image data, a 3D anomaly mask is generated in the 3D image data. Finally, the 3D image data which is part of the 3D anomaly mask is interpreted as a possible collision obstacle. There is also described an obstacle detection device and a rail vehicle.
    Type: Grant
    Filed: December 20, 2021
    Date of Patent: April 2, 2024
    Assignee: Siemens Mobility GmbH
    Inventor: Albi Sema
  • Patent number: 11943532
    Abstract: Disclosed are techniques that provide a “best” picture taken within a few seconds of the moment when a capture command is received (e.g., when the “shutter” button is pressed). In some situations, several still images are automatically (that is, without the user's input) captured. These images are compared to find a “best” image that is presented to the photographer for consideration. Video is also captured automatically and analyzed to see if there is an action scene or other motion content around the time of the capture command. If the analysis reveals anything interesting, then the video clip is presented to the photographer. The video clip may be cropped to match the still-capture scene and to remove transitory parts. Higher-precision horizon detection may be provided based on motion analysis and on pixel-data analysis.
    Type: Grant
    Filed: February 2, 2023
    Date of Patent: March 26, 2024
    Assignee: Google Technology Holdings LLC
    Inventors: Doina I. Petrescu, Thomas T. Lay, Steven R. Petrie, Bill Ryan, Snigdha Sinha, Jeffrey S. Vanhoof
  • Patent number: 11943423
    Abstract: Provided is a method of calibrating a stereoscopic display device. The device includes a motor and a display panel, and the display panel is driven by the motor to rotate to realize a stereoscopic display. The method includes acquiring a control strategy of the motor and display parameters of the display panel matching the control strategy, wherein the control strategy indicates that each time the motor runs for a preset period of time, the motor is restarted; controlling the motor to run according to the control strategy, to calibrate the motor by restarting; and driving the display panel to display according to the display parameters in the rotation process of the motor.
    Type: Grant
    Filed: April 4, 2023
    Date of Patent: March 26, 2024
    Assignees: Beijing BOE Optoelectronics Technology Co., Ltd., BOE Technology Group Co., Ltd.
    Inventors: Jiyang Shao, Yuxin Bi, Feng Zi, Bingxin Liu, Binhua Sun
  • Patent number: 11934174
    Abstract: Computer-implemented method for determining a tension value of a limb of a person, the tension value of the limb being used along with a skin value of the limb for production of a custom-tailored compression garment for the limb, the skin value describing the circumference of the limb without any applied compression and the tension value describing the circumference of the limb with the compression garment applying a desired compression, wherein the skin value of the limb is received and the tension value of the limb is calculated from the skin value according to a calculation instruction parametrized by at least one parameter, the parameter being derived from a dataset comprising multiple associated tuples of skin values and tension values.
    Type: Grant
    Filed: January 14, 2020
    Date of Patent: March 19, 2024
    Assignee: MEDI GMBH & CO. KG
    Inventor: Maximilian Schaumberg
  • Patent number: 11935262
    Abstract: A method where one or more objects of a three-dimensional scene are determined in accordance with provided raw data of the three-dimensional scene representing a predefined environment inside and/or outside the vehicle. A two-dimensional image is determined in accordance with the provided raw data of the three-dimensional scene such that the two-dimensional image depicts the determined objects of the three-dimensional scene on a curved plane. The two-dimensional image has a quantity of pixels, each representing at least one part or several of the determined objects of the three-dimensional scene. Data is provided which represents at least one determined field of view of the driver. For at least one of the determined objects, the probability with which the at least one object will be located in the field of view of the driver is determined in accordance with the provided data and the two-dimensional image.
    Type: Grant
    Filed: February 20, 2020
    Date of Patent: March 19, 2024
    Assignee: Bayerische Motoren Werke Aktiengesellschaft
    Inventors: Florian Bade, Moritz Blume, Martin Buchner, Carsten Isert, Julia Niemann, Michael Wolfram, Joris Wolters
  • Patent number: 11931134
    Abstract: The present invention relates to a device, system and method for improved non-invasive and objective detection of pulse of a subject. The device comprises an input unit (2a) configured to obtain a series of images of a skin region of the subject and a processing unit (2b) for processing said series of images by detecting pulse-related motion of the skin within the skin region from the series of images, generating a motion map of the skin region from the detected pulse-related motion, comparing the generated motion map with an expected motion map of the skin region, and determining the presence of pulse within the skin region based on the comparison.
    Type: Grant
    Filed: July 23, 2019
    Date of Patent: March 19, 2024
    Assignee: Koninklijke Philips N.V.
    Inventors: Kiran Hamilton J. Dellimore, Mukul Julius Rocque, Ralph Wilhelm Christianus Gemma Rosa Wijshoff, Jens Muehlsteff
  • Patent number: 11922673
    Abstract: Disclosed are a product inspection method and device, producing system and a computer storage medium. The method comprises: conducting image acquisition on a product assembly line to obtain a production line image; extracting a product image including a product to be inspected from the production line image; extracting an inspection point image in a part inspection area in the product image; inputting the inspection point image into an inspection model to obtain an inspection result; and determining that the product to be inspected in the product image has defects under the condition that the inspection result meets any of the following conditions.
    Type: Grant
    Filed: June 22, 2021
    Date of Patent: March 5, 2024
    Assignee: BOE TECHNOLOGY GROUP CO., LTD.
    Inventor: Tong Liu
  • Patent number: 11922655
    Abstract: Techniques for aligning images generated by an integrated camera physically mounted to an HMD with images generated by a detached camera physically unmounted from the HMD are disclosed. A 3D feature map is generated and shared with the detached camera. Both the integrated camera and the detached camera use the 3D feature map to relocalize themselves and to determine their respective 6 DOF poses. The HMD receives the detached camera's image of the environment and the 6 DOF pose of the detached camera. A depth map of the environment is accessed. An overlaid image is generated by reprojecting a perspective of the detached camera's image to align with a perspective of the integrated camera and by overlaying the reprojected detached camera's image onto the integrated camera's image.
    Type: Grant
    Filed: September 9, 2022
    Date of Patent: March 5, 2024
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Raymond Kirk Price, Michael Bleyer, Christopher Douglas Edmonds
  • Patent number: 11922575
    Abstract: Approaches described and suggested herein relate to generating three-dimensional representations of objects to be used to render virtual reality and augmented reality effects on personal devices such as smartphones and personal computers, for example. An initial surface mesh of an object is obtained. A plurality of silhouette masks of the object taken from a plurality of viewpoints is also obtained. A plurality of depth maps are generated from the initial surface mesh. Specifically, the plurality of depth maps are taken from the same plurality of viewpoints from which the silhouette images are taken. A volume including the object is discretized into a plurality of voxels. Each voxel is then determined to be either inside the object or outside of the object based on the silhouette masks and the depth data. A final mesh is then generated from the voxels that are determined to be inside the object.
    Type: Grant
    Filed: March 12, 2021
    Date of Patent: March 5, 2024
    Assignee: A9.com, Inc.
    Inventors: Himanshu Arora, Divyansh Agarwal, Arnab Dhua, Chun Kai Wang
  • Patent number: 11908194
    Abstract: A modular tracking system is described comprising of the network of independent tracking units optionally accompanied by a LIDAR scanner and/or (one or more) elevated cameras. Tracking units are combining panoramic and zoomed cameras to imitate the working principle of the human eye. Markerless computer vision algorithms are executed directly on the units and provide feedback to motorized mirror placed in front of the zoomed camera to keep tracked objects/people in its field of view. Microphones are used to detect and localize sound events. Inference from different sensor is fused in real time to reconstruct high-level events and full skeleton representation for each participant.
    Type: Grant
    Filed: March 16, 2021
    Date of Patent: February 20, 2024
    Assignee: New York University
    Inventors: Yurii S. Piadyk, Carlos Augusto Dietrich, Claudio T Silva
  • Patent number: 11898848
    Abstract: A visual positioning system for mobile devices includes at least one infrared camera, at least one infrared illumination source, and a processor that coordinates operation of the at least one camera and illumination sources. A flood IR infrared illumination source illuminates environmental objects for localization of the mobile device during a first camera exposure window, and a structured IR illumination source illuminate environmental objects for detection and mapping of obstacles during a second camera exposure window. A visual SLAM map is constructed with images obtained from a first camera, with a single map being useable for positioning and navigation across a variety of environmental lighting conditions.
    Type: Grant
    Filed: March 24, 2022
    Date of Patent: February 13, 2024
    Assignee: Labrador Systems, Inc.
    Inventors: Michael Dooley, Nikolai Romanov, James Philip Case
  • Patent number: 11889047
    Abstract: An image processing device includes a detector, a setting unit, a calculator, an estimator, and a determining unit. The detector sets a three-dimensional object region by detecting a three-dimensional object. The setting unit sets a first image region corresponding to the three-dimensional object region, a second image region including a left end of and partly overlapping the first image region, and a third image region including a right end of and partly overlapping the first image region. The calculator calculates representative values of parallax-related values in pixel columns in the image regions, and calculates an approximate line of the representative values in each of the image regions. The estimator estimates a continuous structure degree, from a slope value of the approximate line of each of the image regions. The determining unit determines whether the three-dimensional object is a vehicle, from the continuous structure degree.
    Type: Grant
    Filed: April 1, 2021
    Date of Patent: January 30, 2024
    Assignee: SUBARU CORPORATION
    Inventor: Minoru Kuraoka
  • Patent number: 11882262
    Abstract: A system and method of stereoscopic image processing by at least one processor may include receiving, from a first imaging device, having a first field of view (FOV), and located at a first, initially unknown position, a first image of a scene; receiving, from a second imaging device, having a second, different FOV, and located at a second, initially unknown position, a second image of the scene; calculating a plurality of flow lines in the first image, wherein each flow line represents an optical flow between a pixel of the first image and a corresponding pixel of the second image; and calibrating the imaging devices by determining at least one parameter of relative position between the first imaging device and second imaging device, based on the calculated flow lines.
    Type: Grant
    Filed: November 8, 2022
    Date of Patent: January 23, 2024
    Assignee: FORESIGHT AUTOMOTIVE LTD.
    Inventors: Omri Danziger, Ron Katzir, Ivgeny Kopilevich, Eliav Elul
  • Patent number: 11877105
    Abstract: An imaging device includes an image sensor and an image processor. The image sensor includes an array of pixels. At least one pixel in the array of pixels includes an array of phase disparity subpixels. The array of pixels includes a set of filter elements arranged in a filter pattern, with different subsets of pixels receiving light through different types of filter elements in the set of filter elements. The image processor is configured to receive values measured by at least the phase disparity subpixels; estimate phase disparities between the received values; generate, using the estimated phase disparities, a set of corrected values for the phase disparity subpixels; and generate, using the set of corrected values for the phase disparity subpixels, a set of demosaiced values for each image plane in a set of image planes. Each image plane is associated with a different type of filter element in the set of filter elements.
    Type: Grant
    Filed: March 11, 2021
    Date of Patent: January 16, 2024
    Assignee: Apple Inc.
    Inventor: Gennady A. Manokhin
  • Patent number: 11872469
    Abstract: A smart mirror can show live or recorded streaming video of an instructor performing a workout in a package that is attractive and unobtrusive enough to hang in a living room. The smart mirror includes a mirror surface with a fully reflecting section and a partially reflecting section. A display behind the partially reflecting section shows the video when the smart mirror is on and is almost invisible when the smart mirror is off. The smart mirror also has a speaker, a microphone, and a camera to enable a user to view the video content and interact with the instructor. The smart mirror may connect to the user's smart phone, a peripheral device (e.g., a Bluetooth speaker) to augment user experience, a biometric sensor to provide biometric data to assess user performance, and/or a network router to connect the smart mirror to a content provider, an instructor, and/or other users.
    Type: Grant
    Filed: December 8, 2022
    Date of Patent: January 16, 2024
    Assignee: Curiouser Products Inc.
    Inventor: Brynn Putnam
  • Patent number: 11867817
    Abstract: A camera device according to one embodiment of the present disclosure, comprises: a light output unit which outputs an output-light signal irradiated on an object; a lens unit which comprises an infrared (IR) filter and at least one lens arranged on the IR filter, and condenses an input-light signal reflected from the object; an image sensor which generates an electrical signal from the input-light signal condensed by the lens unit; a tilting unit which shifts the optical path of the input-light signal according to a predetermined rule; and an image control unit which acquires depth information of the object by using a phase difference between the output-light signal and the input-light signal received at the image sensor, wherein the image control unit acquires the depth information of the object by using data extracted during a plurality of periods during which the optical path of the input-light signal is repeatedly shifted according to the predetermined rule, and the image control unit corrects the differ
    Type: Grant
    Filed: September 26, 2019
    Date of Patent: January 9, 2024
    Assignee: LG INNOTEK CO., LTD.
    Inventors: Eun Song Kim, Chang Hyuck Lee
  • Patent number: 11858011
    Abstract: A device capable of determining whether or not to clean a work area of a machine tool with higher accuracy. The device includes an imaging device configured to capture first image data of the work area before machining, and configured to capture second image data of the work area after machining, an image data generation section configured to generate third image data indicating a degree of change between brightness of a pixel of the first image data and brightness of a pixel of the second image data, and a determination section configured to determine whether or not to clean the work area based on a histogram indicating a relationship between the brightness of the pixel of the third image data and the number of pixels of the third image data.
    Type: Grant
    Filed: October 26, 2020
    Date of Patent: January 2, 2024
    Assignee: Fanuc Corporation
    Inventor: Masanao Miyawaki
  • Patent number: 11863730
    Abstract: An optical display system has an optical waveguide combiner and one or more cameras. The one or more camera(s) is optically coupled to the optical waveguide combiner and have a field of view of at least one real object and at least one virtual object displayable by the optical display system. The one or more camera(s), which may be for example wafer level waveguide camera(s), may be disposed outside the usable field of view of an output coupler. The one or more camera(s) may be self-calibrated electronically using images captured by the cameras of one or more virtual object(s) displayable by the optical display system. AR/VR/MR registration of devices and/or displayed virtual objects with real objects may be implemented using the images captured by the one or more camera(s) of the displayed virtual objects and real world objects. Real object distance and/or spatial location relative to the optical waveguide combiners may be determined or estimated from the captured images.
    Type: Grant
    Filed: December 7, 2021
    Date of Patent: January 2, 2024
    Assignee: Snap Inc.
    Inventor: James Raymond Leighton
  • Patent number: 11856299
    Abstract: A bowl-shaped photographic stage and photographic system is provided that produces consistent diffused lighting of an object or subject that is virtually shadow free for obtaining rotational views of the object in a time efficient manner. The bowl-shaped photographic stage may be used with a camera array, or a single camera may be moved around the circumference of the photographic stage to obtain a series of images needed to form a rotational view of an object or subject. Alternatively, the bowl-shaped photographic stage may be rotated to pass by a single fixed camera to obtain a series of images needed to form a rotational view of an object or subject.
    Type: Grant
    Filed: August 8, 2022
    Date of Patent: December 26, 2023
    Assignee: Carvana, LLC
    Inventor: Davo Scheich
  • Patent number: 11847198
    Abstract: An information processing apparatus includes: an acquisition unit that acquires a two-dimensional image of a person, and a registered image group including two-dimensional registered images and three-dimensional registered images of a plurality of registrants; and a selection unit that selects a type of a registered image to be used for matching from one of the two-dimensional registered images and the three-dimensional registered images based on the two-dimensional image, prior to the matching the two-dimensional image with the registered image group.
    Type: Grant
    Filed: December 24, 2019
    Date of Patent: December 19, 2023
    Assignee: NEC CORPORATION
    Inventors: Junichi Fukuda, Ryosuke Nakamura, Yasushi Hamada
  • Patent number: 11842515
    Abstract: Provided is an information processing device that includes a movement estimation unit that estimates position and posture movement by using corresponding-point information obtained based on image capturing, and a corresponding-point information selection unit that selects the corresponding-point information to be used by the movement estimation unit from among a plurality of pieces of corresponding-point information. The plurality of pieces of corresponding-point information includes first corresponding-point information obtained based on image capturing by a first camera set including a first camera and a second camera, and second corresponding-point information obtained based on image capturing by a second camera set including a third camera and a fourth camera. The first camera set has a wider view angle than that of the second camera set. The first camera set and the second camera set have image capturing ranges that are at least partially identical to each other.
    Type: Grant
    Filed: February 4, 2022
    Date of Patent: December 12, 2023
    Assignee: SONY GROUP CORPORATION
    Inventor: Jun Gomita
  • Patent number: 11843951
    Abstract: This disclosure relates to improved systems and methods for providing and using wearable electronic accessories. A wearable electronic necklace accessory can include a support structure that permits the wearable electronic accessory to be worn in a user's neck region. The wearable electronic necklace accessory can include an electronic pendant coupled to the support structure, the electronic pendant can comprise a housing that includes a first wall, a second wall, and one or more side walls configured to couple the first wall to the second wall. The wearable electronic necklace accessory can include a display device and an audio device positioned within the pendant housing and configured to output electronic media and audio content. Other embodiments are disclosed.
    Type: Grant
    Filed: November 9, 2022
    Date of Patent: December 12, 2023
    Assignee: AUDEO LLC
    Inventors: Carolyn Ann Bankston, Jordan Gardinal
  • Patent number: 11833410
    Abstract: A smart mirror can show live or recorded streaming video of an instructor performing a workout in a package that is attractive and unobtrusive enough to hang in a living room. The smart mirror includes a mirror surface with a fully reflecting section and a partially reflecting section. A display behind the partially reflecting section shows the video when the smart mirror is on and is almost invisible when the smart mirror is off. The smart mirror also has a speaker, a microphone, and a camera to enable a user to view the video content and interact with the instructor. The smart mirror may connect to the user's smart phone, a peripheral device (e.g., a Bluetooth speaker) to augment user experience, a biometric sensor to provide biometric data to assess user performance, and/or a network router to connect the smart mirror to a content provider, an instructor, and/or other users.
    Type: Grant
    Filed: August 1, 2022
    Date of Patent: December 5, 2023
    Assignee: Curiouser Products Inc.
    Inventor: Brynn Putnam
  • Patent number: 11836295
    Abstract: A free space input standard is instantiated on a processor. Free space input is sensed and communicated to the processor. If the free space input satisfies the free space input standard, a touch screen input response is invoked in an operating system. The free space input may be sensed using continuous implicit, discrete implicit, active explicit, or passive explicit approaches. The touch screen input response may be invoked through communicating virtual touch screen input, a virtual input event, or a virtual command to or within the operating system. In this manner free space gestures may control existing touch screen interfaces and devices, without modifying those interfaces and devices directly to accept free space gestures.
    Type: Grant
    Filed: February 14, 2023
    Date of Patent: December 5, 2023
    Assignee: West Texas Technology Partners, LLC
    Inventors: Shashwat Kandadai, Nathan Abercrombie, Yu-Hsiang Chen, Sleiman Itani
  • Patent number: 11834038
    Abstract: An automated vehicle assistance system is provided for supervised or unsupervised vehicle movement. The system includes a control system and a first sensor system. The first sensor system may receive first image data of a scene and may output a first disparity map and a first confidence map based on the first image data. The control system may output a video stream based on the first disparity map and the first confidence map. The vehicle assistance system also may include a second sensor system that receives second image data of at least a portion of the scene that outputs a second confidence map based on second image data. The video stream may include super-frames, with each super-frame including a 2D image of the scene, a depth map corresponding to the 2D image, and a certainty map corresponding to the depth map.
    Type: Grant
    Filed: August 15, 2022
    Date of Patent: December 5, 2023
    Assignee: NODAR Inc.
    Inventors: Leaf Alden Jiang, Carsten Louis Boers
  • Patent number: 11836852
    Abstract: A method includes receiving data including a plurality of data items, each data item of the plurality of data items including a three-dimensional (3D) radar heat map of an object and a corresponding two-dimensional (2D) image of the object captured by a stereo camera, inputting the training dataset into a machine learning model including a neural network (NN) that generates, from the 3D radar heat map, a 2D depth map for the object and outputs a probability that the 2D depth map is the corresponding 2D image of the object, and training the machine learning model based on a training dataset to generate a trained machine learning model that iteratively learns to generate an updated 2D depth map that approximates the corresponding 2D image. The training dataset includes the plurality of data items, the 2D depth map and the probability.
    Type: Grant
    Filed: December 17, 2020
    Date of Patent: December 5, 2023
    Assignee: Board of Trustees of the University of Illinois
    Inventors: Junfeng Guan, Seyedsohrab Madani, Suraj S. Jog, Haitham Al Hassanieh, Saurabh Gupta
  • Patent number: 11831852
    Abstract: An information processing apparatus for generating a virtual camera path by interpolation using a plurality of key frames to be a reference in the virtual camera path that indicates a path of a position of a virtual camera, comprising: a designation unit configured to accept a key frame designation operation in accordance with a user operation; a specifying unit configured to specify the number of frames between a first key frame that has already been set and a second key frame designated by the user operation; a change amount specifying unit configured to specify an amount of change per unit of time of a virtual camera parameter between the first and second key frames based on the number of frames specified by the specifying unit; and a notification unit configured to notify, to a user, the specified amount of change.
    Type: Grant
    Filed: June 28, 2021
    Date of Patent: November 28, 2023
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Eito Sakakima
  • Patent number: 11823397
    Abstract: A system includes sensors and a tracking subsystem. The subsystem receives a first image feed from a first sensor and a second image feed from a second sensor. The field-of view of the second sensor at least partially overlaps with that of the first sensor. The subsystem detects an object in a frame from the first feed. The subsystem determines a first pixel position of the object. The subsystem determines a second pixel position of the object. Based on the first pixel position and the second pixel position, a global position for the object is determined in a space.
    Type: Grant
    Filed: August 30, 2021
    Date of Patent: November 21, 2023
    Assignee: 7-ELEVEN, INC.
    Inventors: Shahmeer Ali Mirza, Sailesh Bharathwaaj Krishnamurthy
  • Patent number: 11825063
    Abstract: An image processing apparatus comprising: an identifying unit that identifies, from multiple image capture apparatuses that capture images of an image capture space from multiple directions, two or more image capture apparatuses that capture images of a predetermined position in the image capture space; a camera path setting unit that sets multiple viewpoints that are based on the two or more image capture apparatuses identified by the identifying unit; a virtual viewpoint image generating unit that generates multiple viewpoint images corresponding to the multiple viewpoints based on three-dimensional shape data generated using multiple images captured by the multiple image capture apparatuses; and an image capture apparatus selecting unit that selects, from the two or more image capture apparatuses identified by the identifying unit, an image capture apparatus close to the position of the viewpoint corresponding to a viewpoint image designated by a user from the multiple viewpoint images.
    Type: Grant
    Filed: March 25, 2022
    Date of Patent: November 21, 2023
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Michio Aizawa
  • Patent number: 11809623
    Abstract: A head-mounted display device includes an eye tracking sensor configured to obtain eye information by tracking both eyes of a user, a depth sensor configured to obtain depth information about one or more objects, and a processor configured to obtain information about a gaze point based on the eye information, and determine a measurement parameter of the depth sensor based on the information about the gaze point.
    Type: Grant
    Filed: November 11, 2022
    Date of Patent: November 7, 2023
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Bonkon Koo, Jaewoo Ko, Wonwoo Lee
  • Patent number: 11804509
    Abstract: A fingerprint detection apparatus includes a plurality of fingerprint detection units distributed in an array or disposed alternately, and each of the plurality of fingerprint detection units includes: one micro-lens configured to be disposed under the display screen; a plurality of optical sensing pixels, a center position of a photosensitive region of each of the plurality of optical sensing pixels being offset relative to a center position of the same optical sensing pixel; and at least one light shielding layer disposed between the one micro-lens and the plurality of optical sensing pixels, each of the at least one light shielding layer being provided with a hole corresponding to the plurality of optical sensing pixels. By offsetting photosensitive regions of the optical sensing pixels, the thickness of an optical fingerprint module can be reduced on the basis of improving a fingerprint identification effect on a dry finger.
    Type: Grant
    Filed: June 24, 2021
    Date of Patent: October 31, 2023
    Assignee: SHENZHEN GOODIX TECHNOLOGY CO., LTD.
    Inventors: Peng Jiang, Ming Ma
  • Patent number: 11798192
    Abstract: A system includes sensors onboard an autonomous vehicle, a processor, and a memory. The memory stores instructions for the processor to receive a first image pair from the sensors at a first time and a second image pair from the sensors at a second time. Each image pair includes at least one static feature in an environment of the autonomous vehicle. The memory also stores instructions to determine a distance travelled by the autonomous vehicle between the first and second times, and to determine a correction to a disparity map based on (1) a first disparity associated with the static feature(s) and the first image pair, (2) a second disparity associated with the static feature(s) and the second image pair, and (3) the distance travelled. The memory also stores instructions to cause the correction to be applied to the disparity map.
    Type: Grant
    Filed: June 30, 2022
    Date of Patent: October 24, 2023
    Assignee: PlusAI, Inc.
    Inventor: Timothy P. Daly, Jr.
  • Patent number: 11792382
    Abstract: A stereo pair camera system for depth estimation, including: a first camera disposed in a first position along a longitudinal axis, a lateral axis, and a vertical axis and having a first field of view; and a second camera disposed in a second position along the longitudinal axis, the lateral axis, and the vertical axis and having a second field of view; wherein the first camera is a of a first type and the second camera is of a second type that is different from the first type; and wherein the first field of view overlaps with the second field of view. Optionally, the first position is spaced apart from the second position along one or more of the longitudinal axis and the vertical axis. The depth estimation is used by one or more of a driver assist system and an autonomous driving system of a vehicle.
    Type: Grant
    Filed: July 6, 2021
    Date of Patent: October 17, 2023
    Assignee: Volvo Car Corporation
    Inventor: Sihao Ding
  • Patent number: 11790665
    Abstract: In some examples, a system may receive, from at least one camera of a vehicle, at least one image including a road. The system may further receive vehicle location information including an indication of a location of the vehicle. In addition, the system may receive at least one of historical information from a historical database, or road anomaly information, where the road anomaly information is determined from at least one of a road anomaly database or real-time road anomaly detection. Based on the at least one image, the indication of the location of the vehicle, and the at least one of the historical information or the road anomaly information, the system may generate at least one of a disparity map or a disparity image.
    Type: Grant
    Filed: April 29, 2021
    Date of Patent: October 17, 2023
    Assignee: HITACHI ASTEMO, LTD.
    Inventors: Naveen Kumar Bangalore Ramaiah, Subrata Kumar Kundu
  • Patent number: 11790482
    Abstract: A computer implemented method for warping virtual content includes receiving rendered virtual content data, the rendered virtual content data including a far depth. The method also includes receiving movement data indicating a user movement in a direction orthogonal to an optical axis. The method further includes generating warped rendered virtual content data based on the rendered virtual content data, the far depth, and the movement data.
    Type: Grant
    Filed: April 14, 2022
    Date of Patent: October 17, 2023
    Assignee: Magic Leap, Inc.
    Inventors: Reza Nourai, Robert Blake Taylor, Michael Harold Liebenow, Gilles Cadet
  • Patent number: 11790438
    Abstract: A reference object is used in measurement capturing features of the invention to calibrate a camera taking pictures of a user. The position of the reference object in the pictures of the user helps correct for rotations of the reference object that is held by the user. Once user measurements are captured, a total weighted variance is defined to identify correct size of apparel to the user. In addition to the variance, overall fit quality is determined by adding user body shape and fit anomalies of the apparel to the variance.
    Type: Grant
    Filed: December 2, 2020
    Date of Patent: October 17, 2023
    Inventor: Sherwin Brandford
  • Patent number: 11785329
    Abstract: Embodiments relate to the field of terminals and disclose a camera switching method for a terminal, and the terminal. In those embodiments, when the terminal is installed with a plurality of cameras, automatic and dynamic switching between the cameras may be implemented based on a to-be-photographed object, thereby improving a photographing effect of the to-be-photographed object. In those embodiment, the terminal may display, in response to a first operation of enabling a photographing function by a user, a first photographing picture captured by a first camera, where the first photographing picture includes a to-be-photographed object. If the to-be-photographed object cannot be displayed completely in the first photographing picture, the terminal may switch from the first photographing picture to a second photographing picture captured by the second camera, and disabling the first camera, where an FOV of the second camera is larger than an FOV of the first camera.
    Type: Grant
    Filed: February 1, 2023
    Date of Patent: October 10, 2023
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Chao Qin, Yuanyou Li, Zhiping Jia
  • Patent number: 11768075
    Abstract: A visual positioning system for mobile devices includes at least one infrared camera, at least one infrared illumination source, and a processor that coordinates operation of the at least one camera and illumination sources. A flood IR infrared illumination source illuminates environmental objects for localization of the mobile device during a first camera exposure window, and a structured IR illumination source illuminate environmental objects for detection and mapping of obstacles during a second camera exposure window. A visual SLAM map is constructed with images obtained from a first camera, with a single map being useable for positioning and navigation across a variety of environmental lighting conditions.
    Type: Grant
    Filed: March 24, 2022
    Date of Patent: September 26, 2023
    Assignee: Labrador Systems, Inc.
    Inventors: Michael Dooley, Nikolai Romanov, James Philip Case
  • Patent number: 11763473
    Abstract: The multi-line laser three-dimensional imaging method and system is based on a random lattice. A multi-line laser is used and combined with a rotating mechanism to realize a large-view-field rapid scanning effect, such that the working efficiency is improved by orders of magnitude, and the deployment difficulty of the system is reduced. Due to the fact that within an imaging range, pattern features of the random lattice of each local area have uniqueness, a plurality of laser lines are extracted, position sequence numbers are distinguished, and noise points are reduced through mutual verification of the pattern features of the random lattice between adjacent images, such that the quality of three-dimensional point cloud data is greatly improved. The method and the system can be applied to industrial applications, such as disorderly grabbing, feeding and discharging, unstacking and stacking, logistics sorting and the like.
    Type: Grant
    Filed: July 30, 2021
    Date of Patent: September 19, 2023
    Assignee: Zhejiang Hanchine AI Tech. Co., Ltd.
    Inventors: Gui Chen, Qin Li
  • Patent number: 11762390
    Abstract: An autonomous robot system to enable flexible, safe, efficient, and automated movement of goods and materials in a dynamic environment including one or more dynamic objects (e.g., humans). The autonomous robot system includes a modular autonomous ground vehicle (AGV) including a vehicle management system having a safety management system. The safety management system includes one or more safety management controllers to perform safety functions to enable the modular AGV to operate safely and efficiently alongside humans in a dynamic environment (e.g., a warehouse or fulfillment facility).
    Type: Grant
    Filed: January 24, 2020
    Date of Patent: September 19, 2023
    Assignee: Amazon Technologies, Inc.
    Inventors: Fahrudin Alagic, Stephen Charles Paschall, Anatoly Mitlin
  • Patent number: 11758110
    Abstract: A camera calibration information acquisition device acquires captured images of a camera calibration target from two or more cameras, detects, from each image, a coordinate of a feature point in the image, calculates—an internal parameter for each camera by using the feature point, calculates, for each camera, a magnitude of error in the coordinate of the feature point, calculates a value for an external parameter of the cameras by using the magnitude of the error, the coordinate of the feature point, and an error function set so that a penalty for error in calculating the external parameter decreases as the magnitude of the error in the coordinate of the feature point in the image increases.
    Type: Grant
    Filed: February 27, 2020
    Date of Patent: September 12, 2023
    Assignees: NEC CORPORATION, TOKYO INSTITUTE OF TECHNOLOGY
    Inventors: Takashi Shibata, Masatoshi Okutomi, Masayuki Tanaka, Thapanapong Rukkanchanunt
  • Patent number: 11750791
    Abstract: Implementations are disclosed for automatic commissioning, configuring, calibrating, and/or coordinating sensor-equipped modular edge computing devices that are mountable on agricultural vehicles. In various implementations, neighbor modular edge computing device(s) that are mounted on a vehicle nearest a given modular edge computing device may be detected based on sensor signal(s) generated by contactless sensor(s) of the given modular edge computing device. Based on the detected neighbor modular edge computing device(s), an ordinal position of the given modular edge computing device may be determined relative to a plurality of modular edge computing devices mounted on the agricultural vehicle. Based on the sensor signal(s), distance(s) to the neighbor modular edge computing device(s) may be determined. Extrinsic parameters of the given modular edge computing device may be determined based on the ordinal position of the given modular edge computing device and the distance(s).
    Type: Grant
    Filed: October 19, 2021
    Date of Patent: September 5, 2023
    Assignee: Mineral Earth Sciences LLC
    Inventors: Elliott Grant, Sergey Yaroshenko, Gabriella Levine
  • Patent number: 11750794
    Abstract: Apparatus, including a retaining structure (54), positioned near a subject's eye that has a pupil with a diameter, an optical combiner (52A) mounted on the structure before the eye, and a pixelated screen (60A) having an array of variably transparent pixels coating the combiner. There is an image capturing device (68A) mounted on the structure to capture an image of a scene viewed by the eye, and a projector (64A) is mounted on the structure to project at least one of a portion of the captured image and a stored image onto a section of the screen at a selected location thereof. A processor (26) renders the screen section at least partially opaque, selects the section location in response to a region of interest in the scene identified by analysis of the captured image, and determines a dimension of the section in response to the pupil diameter.
    Type: Grant
    Filed: May 22, 2019
    Date of Patent: September 5, 2023
    Assignee: Augmedics Ltd.
    Inventors: Nessi Benishti, Nissan Elimelech, Stuart Wolf, Elazar Gerland
  • Patent number: 11747542
    Abstract: When an optical element is transparent, an observer is enabled to visually recognize a stereoscopic image having a stereoscopic effect. A display method for a stereoscopic image, using a display device provided with a transparent light guide plate, includes: emitting light to be recognized by the observer as a stereoscopic image (I1) from an optical element; and displaying the stereoscopic image (I1) on a stereoscopic image forming plane (P1) not parallel to an outgoing surface (21) of the optical element. In the display method, the observer is able to visually recognize a rear surface side of the display device through the optical element.
    Type: Grant
    Filed: February 24, 2021
    Date of Patent: September 5, 2023
    Assignee: Omron Corporation
    Inventors: Masayuki Shinohara, Yasuhiro Tanoue, Norikazu Kitamura, Mitsuru Okuda