Object Or Scene Measurement Patents (Class 348/135)
  • Patent number: 11995860
    Abstract: A bubble measurement system includes a bubble detector including a vessel having a flow path configured to receive a flow of fluid including air bubbles from a bubble generator and an imaging system. The imaging system includes an imaging device for imaging the fluid and air bubbles in the flow path of the vessel of the bubble detector. The imaging system has an imaging controller coupled to the imaging device and receiving images from the imaging device. The imaging controller processes the images to measure bubble size of each air bubble passing through the bubble detector. The imaging controller includes a pairing module comparing successive images and the air bubbles in successive images to measure all bubbles flowing through the vessel.
    Type: Grant
    Filed: January 4, 2022
    Date of Patent: May 28, 2024
    Assignee: TE Connectivity Solutions GmbH
    Inventors: Shu Wang, Du Wen, Roberto Francisco-Yi Lu, Jiankun Zhou
  • Patent number: 11995546
    Abstract: A vehicle device may execute one or more neural networks (and/or other artificial intelligence), based on input from one or more of the cameras and/or other sensors, to intelligently detect safety events in real-time. The one or more neural networks may be an ensemble neural network that includes neural networks for detecting a head and hand of a user, neural networks for detecting hand actions of the user, neural networks for detecting the head pose of the user, neural networks for predicting an occurrence of an event, and neural networks for predicting a start time and end time of the event. Further, the neural networks can be segmented into a modular neural network based on metadata. The segmentation of the neural network can define a thin layer of the modular neural network to enable independent tuning of the thin layer of the modular neural network.
    Type: Grant
    Filed: July 8, 2022
    Date of Patent: May 28, 2024
    Assignee: Samsara Inc.
    Inventors: Sharan Srinivasan, Brian Tuan, John Bicket, Jing Wang, Muhammad Ali Akhtar, Abner Ayala Acevedo, Bruce Kellerman, Vincent Shieh
  • Patent number: 11989860
    Abstract: Generally described, one or more aspects of the present application correspond to systems and techniques for spectral imaging using a multi-aperture system with curved multi-bandpass filters positioned over each aperture. The present disclosure further relates to techniques for implementing spectral unmixing and image registration to generate a spectral datacube using image information received from such imaging systems. Aspects of the present disclosure relate to using such a datacube to analyze the imaged object, for example to analyze tissue in a clinical setting, perform biometric recognition, or perform materials analysis.
    Type: Grant
    Filed: March 6, 2023
    Date of Patent: May 21, 2024
    Assignee: Spectral MD, Inc.
    Inventors: Brian McCall, Wensheng Fan, Jason Dwight, Zhicun Gao, Jeffrey E. Thatcher, John Michael DiMaio
  • Patent number: 11989901
    Abstract: An object detection processing section 21 detects an object region, using at least one of multiple viewpoint images (e.g., left-viewpoint image) with different viewpoint positions on the basis of information learned through prior learning. A distance measuring section 23 performs ellipse fitting on the object region detected by the object detection processing section 21 to set a distance measurement point arrangement region, and sets multiple distance measurement points in the distance measurement point arrangement region. The distance measuring section 22 performs a stereo matching process using the multiple viewpoint images to calculate a parallax with sub-pixel accuracy for each of the distance measurement points corresponding to the object indicated by an image of the object region and, on the basis of the calculated parallaxes, generates distance measurement information regarding the object.
    Type: Grant
    Filed: June 4, 2019
    Date of Patent: May 21, 2024
    Assignee: SONY CORPORATION
    Inventors: Nobuhiro Tsunashima, Noribumi Shibayama
  • Patent number: 11983897
    Abstract: A method for adjusting camera intrinsic parameters of a single camera visual tracking device is described. In one aspect, a method includes accessing a temperature of a camera of the visual tracking system, detecting that the temperature of the camera exceeds a threshold, in response identifying one or more feature points that are located in a central region of an initial image, generating a graphical user interface element that instructs a user of the visual tracking system to move the visual tracking system towards a border region of the initial image, and determining intrinsic parameters of the camera based on matching pairs of the one or more detected feature points in the border region and one or more projected feature points in the border region.
    Type: Grant
    Filed: November 17, 2021
    Date of Patent: May 14, 2024
    Assignee: SNAP INC.
    Inventor: Kai Zhou
  • Patent number: 11978164
    Abstract: The present invention relates to a method for determining display features of an augmented reality element, the method comprising the steps of receiving an image depicting a visual marker on a support surface, obtaining correspondence data between the augmented reality element and the visual marker, calculating the distance and a viewing angle relative to the visual marker and the user, correcting the viewing angle calculated as a function of features relating to a support plane containing the support surface, to obtain a corrected viewing angle, and determining display features of the augmented reality element based on the correspondence data, a rotation of the visual marker relative to a reference, the calculated distance and the corrected viewing angle.
    Type: Grant
    Filed: February 22, 2022
    Date of Patent: May 7, 2024
    Assignee: TotalEnergies SE
    Inventors: Arnaud Gonguet, Grégory Tetard
  • Patent number: 11959749
    Abstract: Embodiments of systems and methods for a mobile mapping system are described. In an embodiment, a method includes capturing a plurality of images of an object point using a mobile computing platform. The method may also include determining an initial set of orientation parameters in response to one or more orientation sensors on the mobile computing platform. Additionally, the method may include calculating a corrected set of orientation parameters by matching object points in the plurality of images. Further, the method may include estimating a three-dimensional ground coordinate associated with the captured images in response to the corrected set of orientation parameters.
    Type: Grant
    Filed: June 22, 2015
    Date of Patent: April 16, 2024
    Assignee: Profound Positioning Inc.
    Inventors: Naser El-Sheimy, Amr Al-Hamad
  • Patent number: 11960276
    Abstract: An example method for performing multi-sensor collaborative calibration on a vehicle includes obtaining, from at least two sensors located on a vehicle, sensor data items of an area that comprises a plurality of calibration objects; determining, from the sensor data items, attributes of the plurality of calibration objects; determining, for the at least two sensors, an initial matrix that describes a first set of extrinsic parameters between the at least two sensors based at least on the attributes of the plurality of calibration objects; determining an updated matrix that describes a second set of extrinsic parameters between the at least two sensors based at least on the initial matrix and a location of at least one calibration object; and performing autonomous operation of the vehicle using the second set of extrinsic parameters and additional sensor data received from the at least two sensors.
    Type: Grant
    Filed: November 19, 2020
    Date of Patent: April 16, 2024
    Assignee: TUSIMPLE, INC.
    Inventors: Chenzhe Qian, Chenghao Gong, Fuheng Deng
  • Patent number: 11950003
    Abstract: Provided are a vision sensor, an image processing device including the vision sensor, and an operating method of the vision sensor. The vision sensor includes a plurality of pixels arranged in a matrix form, wherein each of the plurality of pixels includes: a sensing circuit configured to output an output voltage by sensing a change of light; a comparison circuit configured to output a comparison signal indicating whether an event has occurred by comparing the output voltage to an event threshold; and an event detection circuit configured to generate internal event signals by sampling the comparison signal at each of a plurality of sampling time points, and configured to output a valid event signal based on the internal event signals.
    Type: Grant
    Filed: May 31, 2022
    Date of Patent: April 2, 2024
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Yunjae Suh, Jongwoo Bong, Seungnam Choi, Junseok Kim
  • Patent number: 11947013
    Abstract: Described herein is a detector for identifying at least one material property m. The detector includes at least one sensor element including a matrix of optical sensors, the optical sensors each having a light-sensitive area. The sensor element is configured for recording at least one reflection image of a light beam originating from at least one object. The detector includes at least one evaluation device configured for determining the material property by evaluation of at least one beam profile of the reflection image.
    Type: Grant
    Filed: March 13, 2020
    Date of Patent: April 2, 2024
    Assignee: TRINAMIX GMBH
    Inventors: Friedrich Schick, Peter Schillen, Patrick Schindler, Andre Schmidt, Michael Eberspach, Christian Lennartz, Robert Send, Lars Diesselberg, Heiko Hengen, Ingmar Bruder, Jakob Unger, Christian Bonsignore
  • Patent number: 11943542
    Abstract: An imaging device may include single-photon avalanche diodes (SPADs). To improve the sensitivity and signal-to-noise ratio of the SPADs, photon detection efficiency (PDE) may be increased. However increased photon detection efficiency may result in a decreased saturation rate and lower than desired dynamic range. To increase the dynamic range, a SPAD-based semiconductor device may operate with multiple sub-exposures. During the first sub-exposure, an over-bias voltage may be set to a first voltage level so that the SPADs have a first photon detection efficiency. During the second sub-exposure, the over-bias voltage may be set to a second voltage level so that the SPADs have a second photon detection efficiency that is different than the first photon detection efficiency. Image data from the first and second sub-exposures may then be combined into a single high dynamic range depth map.
    Type: Grant
    Filed: September 23, 2021
    Date of Patent: March 26, 2024
    Assignee: SEMICONDUCTOR COMPONENTS INDUSTRIES, LLC
    Inventor: Salvatore Gnecchi
  • Patent number: 11933616
    Abstract: Systems, methods, and apparatuses for vehicle localization. The vehicle can include a data processing system (“DPS”) including one or more processors and memory. The DPS can receive sensor data from sensors of the vehicle. The DPS can identify a historical road profile of the ground for a first location of the vehicle. The DPS can generate a current road profile of the ground. The DPS can determine a lateral deviation of the vehicle. The DPS can determine a match between the historical road profile and the current road profile at a second location that aligns with the lateral deviation. The DPS can provide an indication of a current location of the vehicle as the second location.
    Type: Grant
    Filed: April 6, 2023
    Date of Patent: March 19, 2024
    Assignee: Shenzhen Gudsen Technology Co., LTD
    Inventors: Chenyong Guan, Yu Jiang
  • Patent number: 11935250
    Abstract: A method, a device and a computer-readable storage medium with instructions for processing sensor data. In a first step, camera images are taken by a camera. Additionally, 3D-checkpoints are detected by at least one 3D-sensor. Optionally, at least one of the camera images can be segmented. The camera images are then merged with the 3D-checkpoints by a data fusion circuit to form data of a virtual sensor. The resulting data are finally output for further processing.
    Type: Grant
    Filed: March 27, 2019
    Date of Patent: March 19, 2024
    Assignee: VOLKSWAGEN AKTIENGESELLSCHAFT
    Inventors: Simon Steinmeyer, Marek Musial, Carsten Deeg, Thorsten Bagdonat, Thorsten Graf
  • Patent number: 11928874
    Abstract: A camera (10) for detecting objects (48) moving relative to the camera (10) in a direction of movement (50), comprising an image sensor (18) for recording image data of the objects (48) in a camera field of view (14, 56), an optoelectronic distance sensor (24) using a time-of-flight method having a plurality of measurement zones (30a) for measuring a plurality of distance values to the objects (48) in a distance measurement field of view (58), and a control and evaluation unit (38) configured to find, by measuring distance values over a configuration time and evaluating the distance values and/or their change, a region where objects (48) move, and to automatically set a region of interest (60) for the distance sensor (24) within the distance measurement field of view (58) by determining an object region as the region where objects (48) move.
    Type: Grant
    Filed: May 14, 2021
    Date of Patent: March 12, 2024
    Assignee: SICK AG
    Inventors: Romain Müller, Dirk Strohmeier
  • Patent number: 11920913
    Abstract: A conversion parameter calculation method includes: obtaining, from an image capturing device, image data obtained by the image capturing device capturing an image of an object having attached thereto a marker with which specific coordinates are detectable; obtaining displacement direction information indicating a direction of a displacement of the object, the direction crossing an image capturing surface of the image capturing device; detecting specific coordinates, based on the marker included in the image data; estimating a position of the image capturing device, based on a result of the detection; calculating distance data indicating a distance from the image capturing device to the object, based on the position of the image capturing device; and calculating, using the distance data and the displacement direction information, a conversion parameter for converting a pixel displacement amount of the object into an actual displacement amount.
    Type: Grant
    Filed: March 21, 2022
    Date of Patent: March 5, 2024
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Akihiro Noda, Taro Imagawa, Yuki Maruyama, Hiroya Kusaka
  • Patent number: 11914028
    Abstract: The present invention provides a object detection device for vehicle capable of performing distance measurement more reliably than in the past and having high compatibility for distance measurement. The present invention provides an object detection device 100 for vehicle including a first detection unit 10, a second detection unit 20, an error quantity calculation unit 30, a correction quantity calculation unit 40, and a distance correction unit 50. The error quantity calculation unit 30 compares the distances D1 and D1? of the same object detected by the first detection unit 10 and the second detection unit 20 to calculate the error quantity ?D. The correction quantity calculation unit 40 calculates the correction quantity CAt based on the error quantity ?D. The distance correction unit 50 corrects the distances D1? and D2? of the object detected by the second detection unit 20 based on the correction quantity CAt.
    Type: Grant
    Filed: May 15, 2019
    Date of Patent: February 27, 2024
    Assignee: HITACHI ASTEMO, LTD.
    Inventors: Masanori Ichinose, Shigenori Hayase, Akira Kuriyama
  • Patent number: 11908161
    Abstract: An electronic device and a method for generating an augmented reality (AR) content in an electronic device are provided. The method includes determining a posture and an action of each object of the plurality of the objects in the scene displayed on a field of view of the electronic device, classifying the posture and the action of each object of the plurality of the objects in the scene, identifying an intent and an interaction of each object from the plurality of objects in the scene based on at least one of the classified posture and the classified action, and generating the AR content for the at least one object in the scene of at least one of the identified intent and the identified interaction of the at least one object.
    Type: Grant
    Filed: December 7, 2021
    Date of Patent: February 20, 2024
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Ramasamy Kannan, Lokesh Rayasandra Boregowda
  • Patent number: 11900782
    Abstract: A system and method for detecting, recording and communicating events involved in the care and treatment of cognitively impaired persons through detection, video recording, storage and communication. The system includes video cameras that typically begin recording upon detecting motion, a local computing unit at the care location that detects alerts, and a cloud or other remote computing and transmission unit. The local computing unit aggregates, stores, processes, and transmits data including performing event detection through an artificial intelligence technique and generating appropriate alerts. The cloud computing aggregates data from many managed care communities, trains new convolutional neural networks from this data, distributes these networks to the local computing units to perform event detection, and provides a platform for various stakeholders to view the collected video data and generated alerts.
    Type: Grant
    Filed: December 20, 2021
    Date of Patent: February 13, 2024
    Assignee: Safely You Inc.
    Inventors: George Netscher, Julien Jacquemot, Pulkit Agrawal, Alexandre Bayen
  • Patent number: 11893716
    Abstract: An image processing apparatus comprises: an acquisition unit that acquires a first image obtained through shooting and distance information of the first image; a detection unit that detects a main subject from the first image; an extraction unit that extracts another subject from the first image based on the distance information of the main subject; a setting unit that sets parameters of one or more virtual light sources that emit virtual light to the main subject and the extracted other subject; and a processing unit that generates from the first image a second image in which the main subject and the other subject are illuminated with the virtual light using the parameters set by the setting unit.
    Type: Grant
    Filed: July 6, 2021
    Date of Patent: February 6, 2024
    Assignee: Canon Kabushiki Kaisha
    Inventor: Naoko Watazawa
  • Patent number: 11883957
    Abstract: The invention relates to a vehicle chassis (6) for checking and/or counting stock (4) in a warehouse (3) and configured for attaching to an autonomous indoor vehicle (9), with an extendable mast (11) comprising a first end (12) mounted onto the chassis (6) and an opposite second end (13) arrangeable at different distances above the chassis (6), and at least one scanner (2) arranged at the second end (13) and configured for checking and/or counting stock (4) in a shelve (5) of the warehouse (3) lateral to the vehicle (1). The invention further relates to an autonomous robot vehicle (1) comprising the vehicle chassis (6) and the autonomous indoor vehicle (9), whereby the chassis (6) is mounted onto the autonomous indoor vehicle (9) such that the autonomous indoor vehicle (9) and the chassis (6) are configured for autonomously moving the vehicle (1) in the warehouse (3).
    Type: Grant
    Filed: May 14, 2019
    Date of Patent: January 30, 2024
    Assignee: Deutsche Post AG
    Inventors: Kent Rogers, Karl Brooks
  • Patent number: 11880207
    Abstract: A pool cleaning system for cleaning debris from a submerged surface of a swimming pool includes a self-propelled pool cleaner having rotatably-mounted supports for supporting and guiding the cleaner on the pool surface; an electric motor for enabling the rotation of the rotatably-mounted supports on the pool surface; at least one camera to capture imagery of the pool surface; a controller, in electronic communication with the at least one camera, to determine a cleanliness characteristic of the pool surface on which the cleaner has passed based on the camera imagery and generate a control signal to direct movement of the cleaner based on the cleanliness characteristic of the pool surface, and a portable electronic device configured to present a graphic on a display, the graphic depicting the submerged surface of the pool and those portions of the surface that remain uncleaned as the cleaner traverses the pool surface.
    Type: Grant
    Filed: January 10, 2022
    Date of Patent: January 23, 2024
    Assignee: ZODIAC POOL SYSTEMS LLC
    Inventors: Kameshwar Durvasula, William Londono Correa
  • Patent number: 11876843
    Abstract: The present disclosure provides a method, an apparatus, a medium and an electronic device for generating a round-table video conference. In the present disclosure, in response to the head instruction information of the participant, the scrolling starting number is determined from the round-table seat number sequence through the video of the current presenter, and the scrolling ending number is determined from the round-table seat number sequence through the video of the current speaker, thereby the scrolling sequence of the target seat numbers is obtained. According to the scrolling sequence, a manner of the virtual camera in the center of the round table being rotated and shooting is simulated, and the images of the participants queued between two points are scrolled and displayed, so that a virtual round-table conference scene is created in the video conference.
    Type: Grant
    Filed: November 10, 2021
    Date of Patent: January 16, 2024
    Assignee: OOOK (BEIJING) EDUCATION AND TECHNOLOGY CO., LTD
    Inventors: Kesheng Wang, Jin Huang, Gang Huang, Qiaoling Xu, Minglu Cao
  • Patent number: 11872336
    Abstract: The present invention relates to a dialysis machine having a dialyzer, an extracorporeal blood circuit, a dialysis solution circuit, and a control unit, wherein a blood leak sensor is arranged downstream of the dialyzer in the dialysis solution circuit, wherein the control unit is configured to initiate an error routine when the signal of the blood leak sensor shows an indication of a presumed blood leak, and wherein a further sensor is furthermore arranged downstream of the dialyzer in the dialysis solution circuit, wherein the control unit is configured to use the signal of the further sensor correlated in time with the signal of the blood leak sensor as a suppression criterion for the initiation of the error routine.
    Type: Grant
    Filed: April 17, 2019
    Date of Patent: January 16, 2024
    Assignee: FRESENIUS MEDICAL CARE DEUTSCHLAND GMBH
    Inventor: Reiner Spickermann
  • Patent number: 11874374
    Abstract: The invention pertains to a system for characterizing surroundings of a vehicle, the system comprising: projection means (210) arranged for projecting a pattern of laser light towards said surroundings in a sequence of pulses; a detector (220) comprising a plurality of pixels, said detector (220) being configured for detecting light representing said pattern of laser light as reflected by said surroundings in synchronization with said sequence of pulses; and processing means (240) configured to calculate distances to objects (99) in said surroundings as a function of exposure values generated by said pixels in response to said detected light; wherein said detector (220) is further configured for detecting light forming a two-dimensional image of said surroundings at points in time that do not coincide with said sequence of pulses or at pixels that do not receive said light representing said pattern of laser light as reflected by said surroundings.
    Type: Grant
    Filed: January 2, 2018
    Date of Patent: January 16, 2024
    Assignee: Xenomatix NV
    Inventor: Filip Geuens
  • Patent number: 11869273
    Abstract: An object recognition system of the present disclosure includes: a light source section that irradiates a subject with dot light having a predetermined pattern; an event detection sensor that receives the dot light having the predetermined pattern reflected by the subject and detects, as an event, that a change in luminance of a pixel exceeds a predetermined threshold; and a signal processor that performs, in a case where a plurality of successive pixels in a pixel array section of the event detection sensor detects occurrence of an event in a certain period, processing of removing the event as noise, the plurality of successive pixels being equal to or greater than a predetermined number of pixels.
    Type: Grant
    Filed: August 4, 2020
    Date of Patent: January 9, 2024
    Assignee: Sony Group Corporation
    Inventor: Kenta Endo
  • Patent number: 11870969
    Abstract: An imaging apparatus includes a first camera, a second camera, a first imaging condition setting portion, and a second imaging condition setting portion. The first camera includes a color filter portion and a first light receiving portion receiving light transmitted through the color filter portion, and which captures a color imaged. The second camera includes a spectroscopic element to disperse light having a predetermined spectral wavelength from incident light and to change the spectral wavelength to four or more wavelengths, and a second light receiving portion to receive the light dispersed by the spectroscopic element and capture a spectroscopic image of each wavelength dispersed by the spectroscopic element; The first imaging condition setting portion sets a first imaging condition for the first camera. The second imaging condition setting portion sets a second imaging condition for the second camera based on the first imaging condition.
    Type: Grant
    Filed: May 25, 2021
    Date of Patent: January 9, 2024
    Assignee: SEIKO EPSON CORPORATION
    Inventor: Teruyuki Nishimura
  • Patent number: 11841226
    Abstract: The invention relates to an inertial measuring device, having an inertial measuring unit for determining a north direction and for determining position angles, having a battery, and having a wireless interface, which inertial measuring device has a housing, in which the inertial measuring unit, the battery and the interface are housed. A carrying handle is provided on the housing, which carrying handle is designed as a one-hand carrying handle such that the inertial measuring device can be carried with only one hand during normal use.
    Type: Grant
    Filed: April 27, 2018
    Date of Patent: December 12, 2023
    Assignee: NORTHROP GRUMMAN LITEF GMBH
    Inventors: Andrea Dahlhoff, Claus Kühne, Christian Spannagel
  • Patent number: 11842510
    Abstract: A method includes identifying an image captured by an image capture device set at a first angle about an axis, the image corresponding to a time at which the image was captured, identifying within the image, a region of interest including an object to be used for calibration, determining, an image coordinate at which the object is displayed within the image, determining a camera angle corresponding to a position of the image capture system relative to the axis when the image was captured, identifying a bearing of the object relative to the reference direction, the bearing of the object determined using a geolocation of the image capture system and the time at which the image was captured, and determining, using the image coordinate, the camera angle, and the bearing of the object, an angular offset between the first angle and the reference direction to determine a second angle.
    Type: Grant
    Filed: May 5, 2023
    Date of Patent: December 12, 2023
    Assignee: PANO AI, INC.
    Inventors: Sonia Kastner, John Royero, Seva Safris, Nicholas Reid, Kira Greco
  • Patent number: 11837068
    Abstract: The present invention relates to a computer-implemented system and method for preventing users from bending their necks too far forward or past thirty degrees away from vertical during viewing of a handheld electronic device. The system uses a computer-implemented application installed in the device that determines flexion of the user's neck and compares with a threshold to determine a ‘tech neck’ condition. The application generates an alert displayed on the screen of the device to indicate the ‘tech neck’ condition and further, can pause or hang the display when the ‘tech neck’ condition is continued to be determined. The system and method assist in preventing injuries, strains and disabilities to both children and adults that use electronic devices for extended periods of time.
    Type: Grant
    Filed: April 25, 2022
    Date of Patent: December 5, 2023
    Inventors: Saaya Felder, Rajyn Jarrod Felder, Fred J. Felder, Nisha K. Sharma-Felder
  • Patent number: 11835997
    Abstract: A system for determining a location of a lighting fixture in a venue includes a camera and a controller. The camera captures images of the lighting fixture. The controller is operatively coupled to the camera. The controller designates a first position of the camera, receives a first image of the lighting fixture from the camera in the first position, determines a first distance vector between the first position and the lighting fixture based on the first image, designates a second position of the camera, receives a second image of the lighting fixture from the camera in the second position, determines a second distance vector between the second position and the lighting fixture based on the second image, determines a vector relationship location to be a location nearest both the first distance vector and the second distance vector, and designates the vector relationship location as the location of the lighting fixture.
    Type: Grant
    Filed: September 22, 2020
    Date of Patent: December 5, 2023
    Assignee: Electronic Theatre Controls, Inc.
    Inventors: Matt Halberstadt, Josh Jordan, Zoe Wolter, Dennis Varian, Lowell Olcott
  • Patent number: 11832015
    Abstract: Systems and methods herein describe a method for capturing a video in real-time by an image capture device. The system provides a plurality of visual pose hints, identifies first pose information in the video while capturing the video, applies a first series of virtual effects to the video, identifies second pose information, and applies a second series of virtual effects to the video, the second series of virtual effects based on the first series of virtual effects.
    Type: Grant
    Filed: August 13, 2021
    Date of Patent: November 28, 2023
    Assignee: Snap Inc.
    Inventors: Amir Alavi, Olha Rykhliuk, Xintong Shi, Jonathan Solichin, Olesia Voronova, Artem Yagodin
  • Patent number: 11830203
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for associating a new measurement of an object surrounding a vehicle with a maintained track. One of the methods includes receiving an object track for a particular object, receiving a new measurement characterizing a new object at a new time step, and determining whether the new object is the same as the particular object, comprising: generating a representation of the new object at the new and preceding time steps; generating a representation of the particular object at the new and preceding time steps; processing a first network input comprising the representations using a first neural network to generate an embedding of the first network input; and processing the embedding of the first network input using a second neural network to generate a predicted likelihood that the new object and the particular object are the same.
    Type: Grant
    Filed: April 25, 2022
    Date of Patent: November 28, 2023
    Assignee: Waymo LLC
    Inventors: Ruichi Yu, Sachithra Madhawa Hemachandra, Ian James Mahon, Congcong Li
  • Patent number: 11830251
    Abstract: According to the present invention, switching of the monitoring images matching the intention of the observer can be automatically performed for images from a plurality of image capturing apparatus, and the load about the job of the observer can be reduced. The image monitoring apparatus includes an estimating unit configured to estimate attention degrees of a user for a plurality of images acquired from the plurality of image capturing apparatuses, a designating unit configured to designate one of the acquired images as an image to be displayed in accordance with an instruction from the user, a learning unit configured to cause the estimating unit to learn so as to increase an attention degree of the designated image, and a selecting unit configured to select one of the plurality of images based on an attention degree of each estimated image.
    Type: Grant
    Filed: May 21, 2021
    Date of Patent: November 28, 2023
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Kotaro Yano, Tomoaki Kawai
  • Patent number: 11815397
    Abstract: A compact handheld optical coherence tomography (OCT) spectrometer according to an embodiment of the present disclosure includes: a spectrometer optical module; a sensor board coupled to one side of the spectrometer optical module and including a sensor that converts light received from the spectrometer optical module into an electrical signal; and a connector configured to supply, to the sensor board, a control signal and a power signal received from another circuit outside the spectrometer and to transmit a signal received from the sensor board to another external circuit, and the sensor board is packaged with the spectrometer optical module, and the sensor is not indented but is formed to protrude from the surface of the sensor board, and a light receiving portion of the sensor is configured to face the inside of the packaged component and collect light from the spectrometer optical module.
    Type: Grant
    Filed: February 22, 2022
    Date of Patent: November 14, 2023
    Assignee: PHILOPHOS, INC.
    Inventor: Jung-Ho Chung
  • Patent number: 11807257
    Abstract: Systems, methods, and other embodiments described herein relate to sensing interactions of a passenger with components within a vehicle. In one embodiment, a method includes acquiring, from a radar of a vehicle, radar data about a passenger cabin of the vehicle. The method includes determining a current state of the passenger cabin according to the radar data. The method includes, responsive to identifying that the current state indicates that a passenger satisfies a threshold in relation to an unpermitted action, generating a response that counters the unpermitted action.
    Type: Grant
    Filed: June 7, 2021
    Date of Patent: November 7, 2023
    Assignees: Toyota Connected North America, Inc., Toyota Motor North America, Inc.
    Inventors: Simon P. Roberts, Yang Ding, Daniel W. Reaser, Christopher J. Macpherson, Keaton Khonsari, Derek A. Thompson, Sergei I. Gage
  • Patent number: 11797601
    Abstract: Systems and methods for identifying trends in image data using image classification is disclosed. An image is processed to detect an object in the image by performing foreground detection on the image. The object is classified in accordance with an object category, and one or more attributes of the object are determined. A visual token is generated that comprises information including the object category and the one or more attributes of the object. A trend is identified in at least one of the object and an attribute of the object by analyzing a database storing a plurality of visual tokens.
    Type: Grant
    Filed: November 9, 2020
    Date of Patent: October 24, 2023
    Assignee: Incogna Inc.
    Inventors: Kris Woodbeck, Huiqiong Chen
  • Patent number: 11798514
    Abstract: Embodiments of the present invention provide a novel solution that uses subjective end-user input to generate optimal image quality settings for an application. Embodiments of the present invention enable end-users to rank and/or select various adjustable application parameter settings in a manner that allows them to specify which application parameters and/or settings are most desirable to them for a given application. Based on the feedback received from end-users, embodiments of the present invention may generate optimal settings for whatever performance level the end-user desires. Furthermore, embodiments of the present invention may generate optimal settings that may be benchmarked either on a server farm or on an end-user's client device.
    Type: Grant
    Filed: November 20, 2020
    Date of Patent: October 24, 2023
    Assignee: NVIDIA Corporation
    Inventors: John Spitzer, Rev Lebaredian, Tony Tamasi
  • Patent number: 11798057
    Abstract: A computer system and the computer-implemented method of generating and providing haircare product recommendations to a subject. The method comprises determining, by a computing device, an exposure amount of light impacting a subject's hair; determining, by the computing device, a damage assessment of the subject's hair based on the type of light and amount of light exposure; and providing, by the computing device, at least one haircare product recommendation to the subject, wherein the recommendation is directed to repair damage to the hair provided in the damage assessment.
    Type: Grant
    Filed: October 29, 2020
    Date of Patent: October 24, 2023
    Assignee: L'Oreal
    Inventor: David B. Kosecoff
  • Patent number: 11790572
    Abstract: Depiction of a physical whiteboard may be captured by an image capture device. The depiction of the physical whiteboard may be detected and used to generate a virtual whiteboard. A change in the depiction of the physical whiteboard may be detected and used to change the virtual whiteboard. A virtual change to the virtual whiteboard may be received and used to change the virtual whiteboard. The change to the virtual whiteboard based on the virtual change may be projected on top of the physical whiteboard.
    Type: Grant
    Filed: December 21, 2021
    Date of Patent: October 17, 2023
    Assignee: GoPro, Inc.
    Inventors: Guillaume Oulès, Daryl Stimm
  • Patent number: 11792538
    Abstract: Systems and methods for implementing array cameras configured to perform super-resolution processing to generate higher resolution super-resolved images using a plurality of captured images and lens stack arrays that can be utilized in array cameras are disclosed. An imaging device in accordance with one embodiment of the invention includes at least one imager array, and each imager in the array comprises a plurality of light sensing elements and a lens stack including at least one lens surface, where the lens stack is configured to form an image on the light sensing elements, control circuitry configured to capture images formed on the light sensing elements of each of the imagers, and a super-resolution processing module configured to generate at least one higher resolution super-resolved image using a plurality of the captured images.
    Type: Grant
    Filed: August 5, 2022
    Date of Patent: October 17, 2023
    Assignee: Adeia Imaging LLC
    Inventors: Kartik Venkataraman, Amandeep S. Jabbi, Robert H. Mullis, Jacques Duparre, Shane Ching-Feng Hu
  • Patent number: 11783289
    Abstract: A system and method are disclosed for a mixed-reality visualization system having a computer configured to render a mixed-reality three-dimensional surface, identify one or more current demand regions, identify one or more potential demand regions; map the one or more current demand regions and the one or more potential demand regions on the rendered three-dimensional surface, model a free body coupled with demand centers of each of the one or more demand regions and each of the one or more potential demand regions using a spring model, calculate a location on the rendered three-dimensional surface representing an equilibrium position between the demand centers of the one or more demand regions and the one or more potential demand regions using the spring model, and render, for display on a rendering device, a visual indicator within the area corresponding to the location of the calculated equilibrium position.
    Type: Grant
    Filed: December 19, 2019
    Date of Patent: October 10, 2023
    Assignee: Blue Yonder Group, Inc.
    Inventor: Tushar Shekhar
  • Patent number: 11783580
    Abstract: An input apparatus for inputting a diagnosis result of a diagnosis target detectable for a structure includes circuitry configured to display a spherical image captured for the structure on a screen, receive an input of a position of the diagnosis target in the spherical image, store position information indicating the received position of the diagnosis target in the spherical image in a memory, display, on the screen, the spherical image and a diagnosis information input field used for inputting diagnosis information of the diagnosis target, receive an input of the diagnosis information of the diagnosis target input via the diagnosis information input field, and store the diagnosis information and the position information indicating the received position of the diagnosis target in the spherical image, in the memory in association with each other.
    Type: Grant
    Filed: July 15, 2020
    Date of Patent: October 10, 2023
    Assignee: RICOH COMPANY, LTD.
    Inventor: Yasuhiro Kajiwara
  • Patent number: 11756165
    Abstract: The technique of the present disclosure can add a gloss to image data according to the hair flow of a subject. An image data obtaining unit obtains input image data, and a characteristic amount calculating unit calculates characteristic amounts for the input image data. The characteristic amount calculating unit obtains a degree to which directions of hair flow are concentrated to a predetermined direction (a degree of alignment) in a predetermined range based on the directions of hair flow, and sets this as a characteristic amount indicative of the degree of alignment of the directions of hair flow. A determining unit estimates the state of the hair flow of the entire input image data based on the characteristic amounts thus calculated, and determines whether to correct the input image data. A correcting unit performs a gloss adding correction to the input image data.
    Type: Grant
    Filed: June 30, 2022
    Date of Patent: September 12, 2023
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Chiaki Kaneko, Daiki Nakagawa
  • Patent number: 11754718
    Abstract: Examples are disclosed that relate to time of flight imaging using long-exposure and short-exposure storage nodes for each pixel tap of a pixel in an image sensor. One example provides a time-of-flight camera, comprising an image sensor comprising a plurality of pixels, each pixel of the plurality of pixels comprising one or more taps, each tap comprising a photogate, a short-exposure storage node configured to receive charge during a short-exposure interval of an integration period, a long-exposure storage node configured to receive charge during a long-exposure interval of the integration period, a short-exposure switch gate configured to direct charge generated during the short-exposure interval to the short-exposure storage node, a long-exposure switch gate configured to direct charge generated during the long-exposure period to the long-exposure storage node, and a readout mechanism comprising one or more floating diffusion capacitors.
    Type: Grant
    Filed: July 30, 2020
    Date of Patent: September 12, 2023
    Assignee: Microsoft Technology Licensing, LLC
    Inventor: Minseok Oh
  • Patent number: 11740077
    Abstract: Systems and methods for optically measuring a position of a measurement surface relative to a reference position. The system is a wireless network comprising a centrally located data acquisition computer and a multiplicity of remotely located sensor modules mounted at different locations within wireless communication range of a central receiver. Each sensor module is mounted to a clamp that is made specific to a control surface location and embedded with an RFID tag to denote clamp location. The optical components of the sensor modules are selected to enable indication of the linear position of a measurement surface relative to a reference position and then broadcast the measurement results. The broadcast results are received by the central receiver and processed by the data acquisition computer, which hosts human interface software that displays measurement data.
    Type: Grant
    Filed: January 28, 2023
    Date of Patent: August 29, 2023
    Assignee: The Boeing Company
    Inventors: David M. Konyndyk, Mark Douglas Fuller, Jerry A. James, Timothy P. Huang
  • Patent number: 11733229
    Abstract: In some embodiments, apparatuses, systems, and methods are provided herein useful to assessing products. In some embodiments, an enclosure for use in assessing products comprises a housing including a door configured to allow placement of a product within the housing, a product holding surface located within the housing allowing pictures to be taken through the product holding surface and configured to support the product, a first image capture device configured to capture an image of the product from a first perspective, a second image capture device configured to capture an image of the product from a second perspective, and wherein the image of the product from the second perspective is captured through the product holding surface, and a lighting element, wherein the lighting element is located within the housing, and wherein the lighting element is configured to provide lighting within the housing.
    Type: Grant
    Filed: March 16, 2022
    Date of Patent: August 22, 2023
    Assignee: Walmart Apollo, LLC
    Inventors: Joshua T. Bohling, Chuck E. Tilmon, Emily Moneka Francis Xavier, Daniel J. Pumford, Brian J. A. Schardt, Issac Mathew, Venkataraja Nellore, Gaurav Savlani, Viraj C. Patel, Rahul Agarwal, Pushkar Pushp, Jennifer McTeer
  • Patent number: 11725933
    Abstract: An imaging unit includes a light source and a pixel array. The light source projects a line of light that is scanned in a first direction across a field of view of the light source. The line of light oriented in a second direction that is substantially perpendicular to the first direction. The pixel array is arranged in at least one row of pixels that extends in a direction that is substantially parallel to the second direction. At least one pixel in a row is capable of generating two-dimensional color information of an object in the field of view based on a first light reflected from the object and is capable of generating three-dimensional (3D) depth information of the object based on the line of light reflecting from the object. The 3D-depth information includes time-of-flight information.
    Type: Grant
    Filed: May 10, 2021
    Date of Patent: August 15, 2023
    Inventors: Yibing Michelle Wang, Kwang Oh Kim
  • Patent number: 11715308
    Abstract: A vision system for determining an identity of an individual animal in a population of animals with known identity is provided. A first image sensor arrangement is configured to capture three-dimensional or thermographic images of the individual animal. A second image sensor arrangement is configured to capture two-dimensional images of the individual animal. Control circuitry is configured to obtain a first image of the individual animal captured by the first image sensor arrangement and to detect a body part in the first image, and in response to detecting the body part, obtain a second image of the individual animal captured using the second image sensor arrangement, and to identify the individual animal by comparing metrics of the second image with the reference data in a data storage.
    Type: Grant
    Filed: October 7, 2019
    Date of Patent: August 1, 2023
    Assignee: DeLaval Holding AB
    Inventor: Bohao Liao
  • Patent number: 11709046
    Abstract: A method for computing dimensions of an object in a scene includes: controlling, by a processor, a depth camera system to capture at least a frame of the scene, the frame including a color image and a depth image arranged in a plurality of pixels; detecting, by the processor, an object in the frame; determining, by the processor, a ground plane in the frame, the object resting on the ground plane; computing, by the processor, a rectangular outline bounding a projection of a plurality of pixels of the object onto the ground plane; computing, by the processor, a height of the object above the ground plane; and outputting, by the processor, computed dimensions of the object in accordance with a length and a width of the rectangular outline and the height.
    Type: Grant
    Filed: April 22, 2022
    Date of Patent: July 25, 2023
    Assignee: PACKSIZE LLC
    Inventors: Francesco Peruch, Giuliano Pasqualotto, Giridhar Murali, Ethan Cheng, Kinh Tieu
  • Patent number: 11703321
    Abstract: A retrographic sensor includes a transparent structure, a transparent elastomeric pad, and an at least partially reflective layer. One or more light sources emit light into a side surface of the transparent structure. The light undergoes internal reflection in the transparent structure and is reflected toward a camera oriented toward the transparent structure. The at least partially reflective layer may be semi-specular in some embodiments.
    Type: Grant
    Filed: October 15, 2020
    Date of Patent: July 18, 2023
    Assignee: Massachusetts Institute of Technology
    Inventors: Edward Adelson, Branden Romero, Filipe Fernandes Veiga