Object Or Scene Measurement Patents (Class 348/135)
  • Patent number: 11562497
    Abstract: Implementations are described herein for analyzing a sequence of digital images captured by a mobile vision sensor (e.g., integral with a robot), in conjunction with information (e.g., ground truth) known about movement of the vision sensor, to determine spatial dimensions of object(s) and/or an area captured in a field of view of the mobile vision sensor. Techniques avoid the use of visual indicia of known dimensions and/or other conventional tools for determining spatial dimensions, such as checkerboards. Instead, techniques described herein allow spatial dimensions to be determined using less resources, and are more scalable than conventional techniques.
    Type: Grant
    Filed: September 22, 2021
    Date of Patent: January 24, 2023
    Inventor: Yueqi Li
  • Patent number: 11562472
    Abstract: A method and system are provided for estimating tire tread depth, the method comprising: obtaining an image of the tire informative of tread and grooves embedded therein, wherein the image is acquired by an imaging device from a first angle relative to a horizontal direction perpendicular to tread surface, and the tire is illuminated by an illumination device from a second angle relative to the horizontal direction, causing a shadow section and an illuminated section at the bottom and/or sidewall of a groove, the first angle being smaller than the second angle, such that the image captures the illuminated section and at least part of the shadow section; performing segmentation on the image to obtain image segments corresponding to the illuminated section and the at least part of the shadow section; and estimating the tread depth based on the image segments, the groove width, and the second angle.
    Type: Grant
    Filed: September 30, 2020
    Date of Patent: January 24, 2023
    Assignee: UVEYE LTD.
    Inventors: Danny Grossman, Roman Shklyar, Ilya Grinshpoun
  • Patent number: 11554727
    Abstract: A vehicular vision system includes a plurality of cameras disposed at a vehicle and having respective exterior fields of view. Each camera includes an image sensor and a microcontroller having memory, and each camera is in communication with a vehicle controller. Image data captured by the image sensor of each camera is communicated to the vehicle controller. The vehicle controller communicates control data to each camera, and the communicated control data is stored in memory of each camera. With the communicated control data stored in the memory of each camera, the vehicle controller communicates a trigger signal to each camera during operation of the vehicle and vision system. Responsive to the communicated trigger signal, the microcontroller of each camera loads parameters of the control data stored in the respective memory into the respective image sensor so that the parameters of the image sensors of all of the cameras are synchronized.
    Type: Grant
    Filed: November 1, 2018
    Date of Patent: January 17, 2023
    Inventors: Vivek Vaid, Yuesheng Lu
  • Patent number: 11554718
    Abstract: For driver assistance for a combination (8) with a motor vehicle (9) and a trailer (10), a first camera image (19) and a second camera image (20) are generated. A combined image (21) is generated by means of a computing unit (13) by superimposing the camera images (19, 20) such that the second camera image (20) covers a subsection of the first camera image (19), wherein a hitch angle (14) of the combination (8) is determined by means of the computing unit (13). State data of the combination (8) are determined by means of a sensor system (17) and it is determined whether the combination (8) moves forward or backward. The hitch angle (14) is determined based on the state data, if the combination (8) moves forward and based on a change of time-dependent image data, if the combination moves backward. A position of the subsection is determined depending on the hitch angle (14).
    Type: Grant
    Filed: July 30, 2020
    Date of Patent: January 17, 2023
    Assignee: Connaught Electronics Ltd.
    Inventors: Naveen Kuruba, Alan Murphy, Alan Hanniffy
  • Patent number: 11557099
    Abstract: A system form localizing an electronic device with dynamic buffering identifies, from the buffer, a first set of features that is extracted from a first image captured by the electronic device and receives, at the system, a second set of features that is extracted from a second image captured by the electronic device. The system further determines a first characteristic for the first set of features and a second characteristic for the second set of features and determines whether a triggering condition for dynamically changing a size of the buffer is satisfied based at least in part upon the first characteristic for the first set of features and the second characteristic for the second set of features.
    Type: Grant
    Filed: February 25, 2021
    Date of Patent: January 17, 2023
    Assignee: Magic Leap, Inc.
    Inventors: Ali Shahrokni, Keng-Sheng Lin, Xuan Zhao, Christian Ivan Robert Moore, Ashwin Swaminathan
  • Patent number: 11556098
    Abstract: Logical boundaries enclosing a physical area are defined. A segment of the logical boundaries is defined as a directional gate, wherein traversing the gate into the physical area is defined as an ingress and traversing the gate out of the physical area is defined as an egress. The directional gate is monitored, and ingresses and egresses are detected. An occupancy count of the physical area is maintained, based on monitoring the gate and detecting ingresses and egresses. One or more conditions are tracked in addition to the occupancy count. Artificial intelligence (AI) processing is applied to the maintained occupancy count and the additional tracked condition(s), in real-time as the monitoring, maintaining and tracking are occurring. One or more responsive actions are automatically taken as a result of applying the AI processing to the maintained occupancy count and the additional tracked condition(s).
    Type: Grant
    Filed: February 28, 2020
    Date of Patent: January 17, 2023
    Assignee: RICOH COMPANY, LTD.
    Inventor: Manuel Martinello
  • Patent number: 11555913
    Abstract: In this object recognition device, an association between a first object detection result and a second object detection result is taken in a region excluding an occlusion area. When the first object detection result and the second object detection result are determined to be detection results for an identical object, a recognition result of the surrounding object is calculated from the first object detection result and the second object detection result. Thus, occurrences of erroneous recognition of an object can be decreased as compared to a conventional object recognition device of a vehicle.
    Type: Grant
    Filed: November 13, 2017
    Date of Patent: January 17, 2023
    Assignee: Mitsubishi Electric Corporation
    Inventor: Tomohiro Akiyama
  • Patent number: 11540800
    Abstract: The invention provides for a medical apparatus (100, 300, 400) comprising a subject support (102) configured for moving a subject (106) from a first position (124) to a second position (130) along a linear path (134). The subject support comprises a support surface (108) for receiving the subject. The subject support is further configured for positioning the subject support in at least one intermediate position (128). The subject support is configured for measuring a displacement (132) along the linear path between the first position and the at least one intermediate position. Each of the at least one intermediate position is located between the first position and the second position. The medical apparatus further comprises a camera (110) configured for imaging the support surface in the first position.
    Type: Grant
    Filed: October 12, 2018
    Date of Patent: January 3, 2023
    Assignee: Koninklijke Philips N.V.
    Inventors: Peter Koken, Julien Senegas, Martin Bergtholdt
  • Patent number: 11538180
    Abstract: A method for determining residue length within a field includes receiving, with a computing system, a captured image depicting an imaged portion of the field from one or more imaging devices. Furthermore, the method includes determining, with the computing system, an image gradient orientation at each of a plurality of pixels within the captured image. Additionally, the method includes identifying, with the computing system, a residue piece present within the image portion of the field based at least in part on the determined image gradient orientations. Moreover, the method includes determining, with the computing system, a length of the identified residue piece.
    Type: Grant
    Filed: February 12, 2021
    Date of Patent: December 27, 2022
    Assignee: CNH Industrial Canada, Ltd.
    Inventors: James W. Henry, Christopher Nicholas Warwick, David John Powell
  • Patent number: 11540045
    Abstract: An audio transducer device includes an audio transducer, a controller and a direction adjusting mechanism. The audio transducer has a sound receiving surface formed with multiple sound collecting holes, and multiple microphones corresponding in position to the sound collecting holes. The controller is detachably mounted to an electronic device, and controls the microphones to cooperatively perform directional sound reception to obtain audio data. The direction adjusting mechanism interconnects an audio transducer shell and the controller such that the sound receiving surface can be rotated to a position where a normal direction thereof and an image capturing direction of the electronic device forming a desired angle therebetween.
    Type: Grant
    Filed: June 29, 2021
    Date of Patent: December 27, 2022
    Inventor: Hsiao-Han Chen
  • Patent number: 11532151
    Abstract: A vision-LiDAR fusion method and system based on deep canonical correlation analysis are provided. The method comprises: collecting RGB images and point cloud data of a road surface synchronously; extracting features of the RGB images to obtain RGB features; performing coordinate system conversion and rasterization on the point cloud data in turn, and then extracting features to obtain point cloud features; inputting point cloud features and RGB features into a pre-established and well-trained fusion model at the same time, to output feature-enhanced fused point cloud features, wherein the fusion model fuses RGB features to point cloud features by using correlation analysis and in combination with a deep neural network; and inputting the fused point cloud features into a pre-established object detection network to achieve object detection. A similarity calculation matrix is utilized to fuse two different modal features.
    Type: Grant
    Filed: April 29, 2022
    Date of Patent: December 20, 2022
    Inventors: Xinyu Zhang, Li Wang, Jun Li, Lijun Zhao, Zhiwei Li, Shiyan Zhang, Lei Yang, Xingang Wu, Hanwen Gao, Lei Zhu, Tianlei Zhang
  • Patent number: 11524630
    Abstract: A display control device displays, on an electronic inner mirror, a composite image composited by performing image processing on a rear image captured by a rear camera and rear lateral images captured by an outer camera unit such that the rear image and the rear lateral images become a continuous image. A subject vehicle virtual image superimposition display unit of the display control device generates a virtual image of a subject vehicle virtually showing a subject vehicle and displays the virtual image of the subject vehicle superimposed on the composite image. A subject vehicle travel trajectory superimposition display unit of the display control device generates a virtual image of travel trajectory, which extends from left and right rear wheels toward the rear of the vehicle in the composite image, and displays the virtual image of travel trajectory superimposed on the composite image.
    Type: Grant
    Filed: October 12, 2020
    Date of Patent: December 13, 2022
    Inventors: Tomoaki Iida, Yuki Takahashi
  • Patent number: 11519846
    Abstract: Disclosed is an apparatus and method of forming, including a supporting structure, a sensor on the supporting structure, a pair of columns on the supporting structure at opposite sides of the sensor, the pair of columns having a column height relative to a top surface of the supporting structure, the column height being higher than a height of the active surface of the sensor relative to the top surface of the supporting structure, and a lidding layer on the pair of columns and over the active surface, the lidding layer being supported at opposite ends by the pair of columns. The active surface of the sensor, the lidding layer and the pair of columns form an opening above at least more than about half of the active surface of the sensor, and the supporting structure, the sensor, the lidding layer and the pair of columns together form a flow cell.
    Type: Grant
    Filed: January 29, 2019
    Date of Patent: December 6, 2022
    Assignee: ILLUMINA, INC.
    Inventors: Donglai Lu, Xiuyu Cai, Wenyi Feng, Hai Tran
  • Patent number: 11519997
    Abstract: A laser-strike detection system includes an imaging sensor mounted on a platform, and a computing device. The imaging sensor outputs image frames that are each representative of a portion of the platform at a different time, during which a laser may be striking the platform. The computing device receives the image frames, and computes a delay map that indicates time-of-arrival delays of the laser beam at points on the portion of the platform. The computing device converts the delay map to a path-length variation map by multiplying the delay map by the propagation speed of light. The computing device fits a plane to the path-length variation map constrained by a topological model of the platform. The computing device computes angular deflections in x- and y-directions based upon the fit, which angular deflections define a direction from the platform to an emitter of the laser beam.
    Type: Grant
    Filed: June 3, 2021
    Date of Patent: December 6, 2022
    Assignee: National Technology & Engineering Solutions of Sandia, LLC
    Inventor: John Sandusky
  • Patent number: 11505189
    Abstract: A smart cruise control (SCC) system based on complex information and a method of controlling the same. The method includes setting an SCC user-setting speed as a vehicle speed when an SCC function is turned on, driving a vehicle at the set vehicle speed, deriving vehicle speed limit information of a road section in which the vehicle is travelling from navigation speed limit information, road sign speed limit information, and surrounding vehicle speed information of the road section, and controlling the vehicle speed on the basis of the derived vehicle speed limit information.
    Type: Grant
    Filed: May 6, 2020
    Date of Patent: November 22, 2022
    Assignee: Hyundai Mobis Co., Ltd.
    Inventor: Jung Gue Lee
  • Patent number: 11506769
    Abstract: Embodiments of the present disclosure provide a method and a device for detecting a precision of an internal parameter of a laser radar, a related apparatus and a medium. The method may include the following steps. Point cloud data collected by the laser radar arranged on an autonomous mobile carrier travelling on a flat road is obtained. A three-dimensional scene reconstruction is performed based on the point cloud data collected to obtain a point cloud model of a three-dimensional scene. The point cloud model of the three-dimensional scene is divided to obtain the road. A thickness of the road is determined based on the point cloud data of the road. It is determined whether the internal parameter of the laser radar is precise based on the thickness of the road.
    Type: Grant
    Filed: September 5, 2019
    Date of Patent: November 22, 2022
    Assignee: Apollo Intelligent Driving Technology (Beijing) Co., Ltd.
    Inventors: Xun Zhou, Yuanfan Xie, Shirui Li, Liang Wang
  • Patent number: 11503202
    Abstract: An imaging system including: first camera and second camera; depth-mapping means; gaze-tracking means; and processor configured to: generate depth map of real-world scene; determine gaze directions of first eye and second eye; identify line of sight and conical region of interest; determine optical depths of first object and second object present in conical region; when first and second objects are placed horizontally opposite, adjust optical focuses of first and second cameras to focus on respective objects on same side as them; when first and second objects are placed vertically opposite, adjust optical focus of one camera corresponding to dominant eye to focus on object having greater optical depth, and adjust optical focus of another camera to focus on another object; and capture first image(s) and second image(s) using adjusted optical focuses of cameras.
    Type: Grant
    Filed: January 3, 2022
    Date of Patent: November 15, 2022
    Assignee: Varjo Technologies Oy
    Inventor: Mikko Ollila
  • Patent number: 11492856
    Abstract: A method and system for conducting a subterranean operation that can include storing, via a rig controller, pre-determined characteristics of a piece of equipment, for supporting the subterranean operation, in a unique data record associated with the piece of equipment; scanning, via one or more sensors, the piece of equipment on a rig; determining, via the rig controller, actual characteristics of the piece of equipment in response to the scanning via the one or more sensors; comparing, via the rig controller, the actual characteristics to the pre-determined characteristics; and verifying whether or not the piece of equipment is an expected piece of equipment needed to support the subterranean operation based on the comparing.
    Type: Grant
    Filed: November 17, 2020
    Date of Patent: November 8, 2022
    Assignee: Canrig Robotic Technologies AS
    Inventors: Roald Valen, Stian Lode, Markus Buchholz
  • Patent number: 11490785
    Abstract: A measurement support device including a head configured to emit measurement auxiliary light, an imaging unit to capture an image of a subject on which a spot is formed by the measurement auxiliary light via an imaging optical system, a measurement unit to measure a position of the spot in the image, and a display control unit to display an indicator figure, and information indicating a trajectory along which the spot moves on the image when an imaging distance of the image is changed, wherein, in a case where an optical axis of the measurement auxiliary light is projected on a plane including an optical axis of the imaging optical system, the head emits the measurement auxiliary light that has an inclination angle, which is not 0 degrees with respect to the optical axis of the imaging optical system, and crosses an angle of view of the imaging optical system.
    Type: Grant
    Filed: August 19, 2019
    Date of Patent: November 8, 2022
    Assignee: FUJIFILM Corporation
    Inventors: Takeichi Tatsuta, Shinichiro Sonoda, Issei Suzuki
  • Patent number: 11490021
    Abstract: An image capturing device comprising an image sensor. The image sensor comprises: a first sensing region, having a first sensing threshold; and a second sensing region, having a second sensing threshold lower than the first sensing threshold. At least one object image is determined to be invalid when the object image captured by the first sensing region has brightness formation lower the first sensing threshold. At least one the object image is determined to be invalid when the object image captured by the second sensing region has brightness formation lower the second sensing threshold. The present invention also discloses a distance measuring device using the image sensor.
    Type: Grant
    Filed: February 25, 2020
    Date of Patent: November 1, 2022
    Assignee: PixArt Imaging Inc.
    Inventor: Guo-Zhen Wang
  • Patent number: 11486689
    Abstract: Apparatuses, systems and methods associated with a metrology system for high-speed, non-contact coordinate measurements of parts are disclosed herein. In embodiments, the metrology system includes a metrology bridge to be coupled to a measurement assembly. The measurement assembly may include a stage moveable across multiple independent axes. The bridge may include a housing, mounting members coupled to the housing, and a plurality of sensors mounted within the housing. The mounting members may rotatably couple the housing to the measurement assembly. Further, sensor elements of the plurality of sensor devices may be aligned along a length of the housing and may be directed out of the housing.
    Type: Grant
    Filed: February 4, 2020
    Date of Patent: November 1, 2022
    Assignee: DWFritz Automation, Inc.
    Inventors: Derek Aqui, Mark Baker, Chris Barns, Robert Batten, Shawn Boling, Jared Greco, Garrett Headrick, Clint Vandergiessen
  • Patent number: 11480786
    Abstract: An apparatus for generating view images for a scene comprises a store (101) which stores three dimensional scene data representing the scene from a viewing region. The three dimensional scene data may e.g. be images and depth maps captured from capture positions within the viewing region. A movement processor (105) receives motion data, such as head or eye tracking data, for a user and determines an observer viewing position and an observer viewing orientation from the motion data. A change processor (109) determines an orientation change measure for the observer viewing orientation and an adapter (111) is arranged to reduce a distance from the observer viewing position relative to the viewing region in response to the orientation change measure. An image generator (103) generates view images for the observer viewing position and the observer viewing orientation from the scene data.
    Type: Grant
    Filed: December 29, 2018
    Date of Patent: October 25, 2022
    Assignee: Koninklijke Philips N.V.
    Inventors: Wilhelmus Hendrikus Alfonsus Bruls, Christian Varekamp
  • Patent number: 11465559
    Abstract: One aspect of the present disclosure is a display processing device including an acquisition unit, a synthesis unit, and a display unit. The acquisition unit is configured to acquire a plurality of images captured by a plurality of cameras provided at a plurality of different positions on a vehicle, the captured images having an overlapping part in which imaging areas of the cameras partially overlap with each other. The synthesis unit combines the captured images acquired by the acquisition unit at the overlapping part of the captured images. The display unit displays the image synthesized by the synthesis unit on a display device mounted on the vehicle. The synthesis unit changes a position of a synthetic boundary, which is a boundary used when combining the captured images, as time passes.
    Type: Grant
    Filed: June 25, 2020
    Date of Patent: October 11, 2022
    Inventor: Syunsuke Usui
  • Patent number: 11465646
    Abstract: A vehicle traveling control apparatus is configured to: acquire peripheral environment information around a vehicle; store road map information; estimate a vehicle position; acquire information of a road surface on which the vehicle travels; set a target travel path of the vehicle during automatic driving, referring to the road map information, based on the estimated vehicle position and input destination information; estimate lateral position information of a peripheral vehicle when the road surface is snow-covered and lane markers cannot be recognized; determine whether the peripheral vehicle deviates relative to the traveling lane based on the estimated lateral position information; and, when the peripheral vehicle deviates, set a deviation amount to deviate the vehicle toward a lane marker on a road shoulder side, correct a lateral position of the set target travel path set with the deviation amount, and set a new target travel path.
    Type: Grant
    Filed: June 2, 2020
    Date of Patent: October 11, 2022
    Inventor: Hajime Oyama
  • Patent number: 11468538
    Abstract: Computer vision based systems, and methods are provided for generating plume analysis data from a plurality of input image frames as captured by a camera. Image data associated with a plume of gas is received and provided as inputs to a predictive model used to determine plume analysis data including a plume prediction segmentation mask associated with the plume of gas. Other attributes of the plume are also estimated from the prediction segmentation mask such as cross-sectional area, cross-sectional velocity, leak source pixel and volumetric leak rates. The plume analysis data can be provided as an overlay atop the image data. The plume analysis data overlaid atop the image data can be transmitted by and/or to one or more computing devices.
    Type: Grant
    Filed: April 3, 2020
    Date of Patent: October 11, 2022
    Inventors: Ozge Can Whiting, Rajeev Bhatt, Mustafa Gokhan Uzunbas, Thai Hoang, Vladimir Shapiro, John Passarelli, Weiwei Qian, John Hare, Taufiq Dhanani, Matthias Odisio, Edvardas Kairiukstis
  • Patent number: 11461921
    Abstract: The present invention provides a program that makes it possible to recognize a three-dimensional shape from a single image. The present invention is a program for recognizing a three-dimensional object present in a real space and constituted of a plurality of predefined components. The program is executed by an electronic device provided with an image capture device for capturing an image of the three-dimensional object. The program causes the electronic device to execute an image recognition step, a query generation step, a data retrieving step, a component arrangement step, a consistency determination step, and in the case where it is determined that there is consistency, a three-dimensional object recognition step, and in the case where it is determined that there is no consistency, a database storage step, a query regeneration determination step, and a query regeneration step.
    Type: Grant
    Filed: June 18, 2020
    Date of Patent: October 4, 2022
    Assignee: CYGAMES, INC.
    Inventors: Hiroki Hanaoka, Shuichi Kurabayashi
  • Patent number: 11453401
    Abstract: A closed eye determination device includes an eye opening degree detection unit that detects a degree of eye opening of a driver from each of a series of face images of a driver in time series in a latest certain period of time being acquired by a driver monitor camera, a local minimum value extraction unit that extracts a local minimum value of the degree of eye opening from a change in time series of the degree of eye opening in the certain period of time, a reference lower limit value-setting unit that sets, as a reference lower limit value of the degree of eye opening, a local minimum value in order corresponding to a blinking number of the driver in the certain period of time in order from the smallest local minimum value among local minimum values of the degree of eye opening in the certain period of time, a threshold value setting unit that sets a closed eye determination threshold value, based on the reference lower limit value, and a closed eye determination unit that determines that an eye of the dr
    Type: Grant
    Filed: August 31, 2020
    Date of Patent: September 27, 2022
    Inventors: Koichiro Yamauchi, Takuya Sakata, Taku Mitsumori, Kimimasa Tamura, Masataka Sano, Yosuke Morino
  • Patent number: 11455742
    Abstract: Imaging systems that automatically calculate, in real time, relative locations of acquired targets relative to datum targets. In some embodiments, an imaging system of this disclosure can be instantiated as a handheld imaging device having a live-view imaging system or a thermal imaging system, or both. Some embodiments include a ranging system that fires upon the release of a hard button to minimize movement of the imaging system during target acquisition. Some embodiments include speed estimating and/or time of arrival estimating features. Some embodiments can communicate with an external device, such as a central controller device. A central controller device of this disclosure may include triangulation, speed estimating, and/or time of arrival estimating features. Some embodiments of a central control device may allow users to set up and make mission assignments. Some embodiments allow sharing of data among devices, in some cases only on a mission-by-mission basis.
    Type: Grant
    Filed: April 16, 2020
    Date of Patent: September 27, 2022
    Assignee: Thermoteknix Systems Ltd.
    Inventors: Richard Sydney Salisbury, Mark Gatenby
  • Patent number: 11448483
    Abstract: Techniques for tracing back a projectile to the projectile origin are described. A method includes detecting projectile track(s) in image(s). Each projectile track crosses multiple pixels in each image. The projectile track(s) correspond to projectile(s). The projectile track(s) in the image(s) are translated to traceback path(s). The traceback path includes a known location and a projectile origin (e.g. the location at which the projectile originated, also termed the shooter's location).
    Type: Grant
    Filed: April 23, 2020
    Date of Patent: September 20, 2022
    Assignee: Cyan Systems
    Inventors: Jon Paul Curzan, John Caulfield
  • Patent number: 11450040
    Abstract: A display control device includes a front image acquiring portion configured to acquire front images by a front camera that images a front of a vehicle traveling on a traveling lane, a lane line position calculation portion configured to calculate a position of a lane line separating the traveling lane and an adjacent lane adjacent to the traveling lane based on movement of the vehicle in a period from a point at which the front image is acquired by the front camera, a movement track calculation portion configured to calculate a movement track of the vehicle, a map creating portion configured to create a map, and a display control portion configured to display, a synthesized image in which a pseudo lane line image corresponding to the lane line is superimposed onto a rear side image acquired after the movement of the vehicle by a rear side camera based on the map.
    Type: Grant
    Filed: October 1, 2018
    Date of Patent: September 20, 2022
    Assignee: CLARION CO., LTD.
    Inventor: Daisuke Fukuda
  • Patent number: 11443415
    Abstract: An inspection method for inspecting a counting function of an imaging system that captures an image of a phase object includes: capturing an image of a reference standard plate that includes a base region and a plurality of counting target regions having a phase amount in a thickness direction different from a phase amount of the base region, under a condition where the number of counting target regions positioned within a field of view of the imaging system is specified among the plurality of counting target regions; counting the counting target regions included in the captured image of the reference standard plate; and outputting at least a counted result of the counting target regions.
    Type: Grant
    Filed: January 6, 2021
    Date of Patent: September 13, 2022
    Inventor: Masaru Mizunaka
  • Patent number: 11445124
    Abstract: A vision system for a motor vehicle includes an optical image capture device configured to capture images of objects in its field of vision. A lighting device includes a plurality of lighting elements forming a lighting matrix configured to illuminate the field of vision of the optical device. A control device associated with the optical device and the lighting device is configured to determine the nature of each image of an object captured by the optical device. The control device is configured to locate the object, select the lighting elements of the lighting matrix capable of illuminating the object relative to the location of the object, and individually control at least one lighting characteristic of each selected lighting element so as to be able to determine the nature of the image of the object captured by the optical device.
    Type: Grant
    Filed: April 14, 2020
    Date of Patent: September 13, 2022
    Inventors: Cyril Roumier, Guillaume Tournabien
  • Patent number: 11435229
    Abstract: Shortwave infrared (SWIR) hyperspectral imaging (HSI) systems comprise a supercontinuum laser source configured to illuminate objects and a receiver comprising a spectrometer configured to receive light reflected from the objects. In some cases, hyperspectral images can be created by raster scanning of the source/receiver across a scene. The supercontinuum laser source provides active illumination to allow collection of hyperspectral imagery during day (including overcast conditions) and night. Additionally, the hyperspectral imaging systems can use range-gated imaging.
    Type: Grant
    Filed: October 24, 2019
    Date of Patent: September 6, 2022
    Inventors: James F. Coward, David Alan Pechner, Gregory Mitchell, Ji Li
  • Patent number: 11438570
    Abstract: The present technology relates to a data processing apparatus, a data processing method, and a program that are capable of generating calibration data for performing appropriate image processing. The data processing apparatus performs interpolation to generate calibration data for a predetermined focus position by using calibration data for a plurality of focus positions. The calibration data for the plurality of focus positions is generated from a calibration image captured at the plurality of focus positions. The calibration image is obtained by capturing an image of a known object in the plurality of focus positions with a multi-lens camera that captures an image from two or more viewpoints. The present technology is applicable, for example, to a multi-lens camera that captures an image from two or more viewpoints.
    Type: Grant
    Filed: April 25, 2019
    Date of Patent: September 6, 2022
    Inventors: Kengo Hayasaka, Katsuhisa Ito
  • Patent number: 11430043
    Abstract: Novel system, methods, which include machine learning, and device for providing color and fashion recommendations, including for persons with visual impairment such as color blindness or complete blindness.
    Type: Grant
    Filed: December 22, 2021
    Date of Patent: August 30, 2022
    Assignee: Color Butler, Inc.
    Inventors: Robert Penner, David Fogel, Gary Fogel, Yuval Shenkal, James Vaccaro, Christine Woodward
  • Patent number: 11428783
    Abstract: An optical apparatus includes a deflector configured to deflect illumination light from a light source unit to scan an object and to deflect reflected light from the object, and a controller configured to control the deflector. A first divergence angle of the illumination light in a first cross section is larger than a second divergence angle in a second cross section orthogonal to the first section. The controller controls the deflector so that the illumination light moves in the first cross section at a first speed and moves in the second cross section at a second speed higher than the first speed.
    Type: Grant
    Filed: July 9, 2020
    Date of Patent: August 30, 2022
    Inventor: Tomoaki Kawakami
  • Patent number: 11430133
    Abstract: This invention provides a video analyzing apparatus which comprises an acquisition unit configured to acquire an image captured by an image capturing unit, a determining unit configured to determine a degree of congestion of persons in the image captured by the image capturing unit, and a deciding unit configured to decide a threshold to be used to determine a moving state of a person in the image based on the degree of congestion determined by the determining unit.
    Type: Grant
    Filed: June 1, 2020
    Date of Patent: August 30, 2022
    Inventor: Ritsuko Otake
  • Patent number: 11422053
    Abstract: A fluid leakage data management apparatus includes an input unit to which data on fluid leak portions collected through a fluid leak diagnosis of a plant is input; a display unit on which the data input to the input unit is displayed; and a data processing unit that displays, on the display unit, a leak portion display image in which, with respect to positional data indicating positions, in the plant, of the respective fluid leak portions input to the input unit, indicators representing the respective fluid leak portions are displayed superimposed on a configuration diagram image of the plant at locations corresponding to the positional data of the respective fluid leak portions on the configuration diagram image.
    Type: Grant
    Filed: August 7, 2015
    Date of Patent: August 23, 2022
    Assignee: TLV Co., Ltd.
    Inventor: Tomoaki Yokono
  • Patent number: 11416004
    Abstract: This disclosure relates to method and system for validating readings of orientation sensor mounted on autonomous ground vehicle (AGV). The method may include receiving distances and angles of observation of at least two fixed objects with respect to AGV at a first position and then at a second position, calculating a first orientation and a second orientation of AGV at the first position and at the second position respectively based on the distances, the angles of observation, and coordinate positions of each of the at least two fixed objects, determining an actual change in orientation of AGV based on the first orientation and the second orientation, and validating the readings of the orientation sensor based on the actual change in orientation. The at least two fixed objects are objects with pre-identified properties in a field of view of a vision sensor mounted on AGV and on both sides of AGV.
    Type: Grant
    Filed: December 18, 2019
    Date of Patent: August 16, 2022
    Assignee: Wipro Limited
    Inventors: Manas Sarkar, Balaji Sunil Kumar
  • Patent number: 11416001
    Abstract: A materials handling vehicle includes a camera, an odometry module to generate odometry data, a processor, and a drive mechanism. The camera captures images of an identifier for a racking system aisle and at least a rack leg portion positioned in the aisle. The processor uses the identifier to generate information indicative of an initial rack leg position and rack leg spacing in the aisle, generate an initial vehicle position using the initial rack leg position, generate a vehicle odometry-based position in the aisle using odometry data and the initial vehicle position, detect a subsequent rack leg using a captured image, correlate the detected subsequent rack leg with an expected vehicle position using rack leg spacing, generate an odometry error signal based on a difference between the expected vehicle position and the vehicle odometry-based position, and update the vehicle odometry-based position using the odometry error signal.
    Type: Grant
    Filed: July 17, 2019
    Date of Patent: August 16, 2022
    Assignee: Crown Equipment Corporation
    Inventors: Justin Forbes Thode, Grace Da-In Lee
  • Patent number: 11408738
    Abstract: Techniques are described for using computing devices to perform automated operations to generate mapping information using inter-connected images of a defined area, and for using the generated mapping information in further automated manners. In at least some situations, the defined area includes an interior of a multi-room building, and the generated information includes a floor map of the building, such as from an automated analysis of multiple panorama images or other images acquired at various viewing locations within the building—in at least some such situations, the generating is further performed without having detailed information about distances from the images' viewing locations to walls or other objects in the surrounding building. The generated floor map and other mapping-related information may be used in various manners, including for controlling navigation of devices (e.g., autonomous vehicles), for display on one or more client devices in corresponding graphical user interfaces, etc.
    Type: Grant
    Filed: September 12, 2020
    Date of Patent: August 9, 2022
    Assignee: Zillow, Inc.
    Inventors: Alex Colburn, Qi Shan, Ramin Mehran, Li Guan
  • Patent number: 11412118
    Abstract: An electromagnetic wave phase/amplitude generation device includes a radiation unit configured to radiate electromagnetic waves of a random radiation pattern on a spatial frequency in which a state of the electromagnetic waves to be radiated for each divided region is determined to an imaging object, an imaging unit configured to generate a captured image by imaging scattered electromagnetic waves that are electromagnetic waves generated when the imaging object scatters the electromagnetic waves of the radiation pattern radiated by the radiation unit, and a generation unit configured to generate information indicating at least a phase and amplitude of the electromagnetic waves from the imaging object by performing an arithmetic sparsity constraint operation according to sparsity of the imaging object on the basis of the captured image generated by the imaging unit, information indicating the radiation pattern, and information indicating a signal of the imaging object.
    Type: Grant
    Filed: November 4, 2020
    Date of Patent: August 9, 2022
    Assignee: Osaka University
    Inventors: Ryoichi Horisaki, Jun Tanida, Riki Egami
  • Patent number: 11396352
    Abstract: Novel techniques and equipment for anchoring a boat include sensing and measuring the real time rate and length of rode release based on detecting real time changes in the angular position of a windlass by computer vision using a portable computing device. Rode release is also detected using novel methods based on sensing sound, rode chain movement, and sensing acceleration and/or motion. The apparatus can include software operable to provide safe anchoring based on monitoring real times values of the rate and length of rode release, comparing these values to the speed and position of the boat, and providing local and remote status and alarm information to crew members.
    Type: Grant
    Filed: April 13, 2021
    Date of Patent: July 26, 2022
    Inventors: Eric R. Sirkin, Xavier Alexandre
  • Patent number: 11399139
    Abstract: A camera assembly for generating high dynamic range images. The camera assembly includes a sensor that images a portion of a local area, and a controller. The sensor includes a plurality of augmented pixels, each augmented pixel having a plurality of gates and at least some of the gates have a respective local storage location. An exposure interval of each augmented pixel is divided into intervals associated with the gates, and each local storage location stores image data during a respective interval. The controller reads out, after the exposure interval of each augmented pixel, the image data stored in the respective local storage locations of each augmented pixel to form intermediate images that each have a dynamic range. The controller then generates an image for the portion of the local area using the intermediate images, the image having a higher dynamic range than each of the intermediate images.
    Type: Grant
    Filed: August 24, 2020
    Date of Patent: July 26, 2022
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Fengqiang Li, Michael Hall
  • Patent number: 11398215
    Abstract: A system and method for providing aural guidance in imaging a document is disclosed. Visually impaired people may have difficulty when imaging a document with a mobile computing device. The system and method may analyze the image of the document in the imaging device, and output one or more aural directions in order for the user to move the document and/or camera for proper imaging of the document. In that regard, those with visual impairments may be assisted in imaging documents using a mobile computing device.
    Type: Grant
    Filed: September 23, 2020
    Date of Patent: July 26, 2022
    Assignee: United Services Automobile Association (USAA)
    Inventor: Harmony Jane Clauer Salyers
  • Patent number: 11398051
    Abstract: A vehicle camera calibration apparatus and method are provided. The vehicle camera calibration apparatus includes a camera module configured to acquire an image representing a road from a plurality of cameras installed in a vehicle, an input/output module configured to receive, as an input, the acquired image from the camera module, or output a corrected image, a lane detection module configured to detect a lane and extract a feature point of the lane from an image received from the input/output module, and a camera correction module configured to estimate a new external parameter using a lane equation and a lane width based on initial camera information and external parameter information in the image received from the input/output module, and to correct the image.
    Type: Grant
    Filed: August 8, 2018
    Date of Patent: July 26, 2022
    Assignee: VADAS CO., LTD.
    Inventors: Jun-Seok Lee, Byeong-Chan Jeon, Jeong-mok Ha, Hee-soo Kim
  • Patent number: 11391840
    Abstract: A distance-measuring apparatus, a mobile object, a distance-measuring method, and a distance-measuring system. The distance-measuring apparatus and the distance-measuring method include performing matching for a plurality of images obtained by a plurality of imaging devices to convert the plurality of images into first distance information on a pixel-by-pixel basis, emitting a laser beam where at least one of a laser-beam resolution in a horizontal direction and a laser-beam resolution in a vertical direction exceeds two degrees, obtaining a reflected signal obtained when the laser beam is reflected by an object, detecting a peak that corresponds to reflection from the object from the reflected signal, calculating second distance information based on a length of time taken to observe the peak after the laser beam is emitted in the emitting, and integrating the first distance information and the second distance information with each other. The mobile object includes the distance-measuring apparatus.
    Type: Grant
    Filed: June 17, 2019
    Date of Patent: July 19, 2022
    Assignee: Ricoh Company, Ltd.
    Inventors: Hiroyoshi Sekiguchi, Jun Kishiwada, Soichiro Yokota, Tadashi Nakamura, Seiya Amano, Kazuma Matsuura
  • Patent number: 11394903
    Abstract: A first pixel group disposed in a first direction is read in the first direction. A second pixel group adjacent to the first pixel group is read in a second direction, which is opposite to the first direction.
    Type: Grant
    Filed: September 21, 2018
    Date of Patent: July 19, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventor: Hideo Kobayashi
  • Patent number: 11391952
    Abstract: In one implementation, a method involves obtaining light intensity data from a stream of pixel events output by an event camera of a head-mounted device (“HMD”). Each pixel event is generated in response to a pixel sensor of the event camera detecting a change in light intensity that exceeds a comparator threshold. A set of optical sources disposed on a secondary device that are visible to the event camera are identified by recognizing defined illumination parameters associated with the optical sources using the light intensity data. Location data is generated for the optical sources in an HMD reference frame using the light intensity data. A correspondence between the secondary device and the HMD is determined by mapping the location data in the HMD reference frame to respective known locations of the optical sources relative to the secondary device reference frame.
    Type: Grant
    Filed: October 16, 2020
    Date of Patent: July 19, 2022
    Assignee: Apple Inc.
    Inventor: Peter Meier
  • Patent number: 11394949
    Abstract: The disclosure is directed to providing operator visibility through an object that occludes the view of the operator by using a HMD system in communication with one or more imaging devices. A method of doing so may include: using one or more imaging devices coupled to an exterior of an object to capture image data of a real-world environment surrounding the object: calculating an orientation of a HMD positioned in an interior of the object; using at least the calculated orientation of the HMD, synthesizing a FOV of the image data with a FOV of the HMD; and rendering the synthesized FOV of the image data to the HMD. In some instances, the captured image data is used to create a three-dimensional model of the real-world environment, and synthesizing the FOV of the image data includes synthesizing a FOV of the 3D model with the FOV of the HMD.
    Type: Grant
    Filed: June 12, 2018
    Date of Patent: July 19, 2022
    Assignee: Disney Enterprises, Inc.
    Inventors: Steven Chapman, Mark Arana, Michael Goslin, Joseph Popp, Mehul Patel