Vehicle Or Traffic Control (e.g., Auto, Bus, Or Train) Patents (Class 382/104)
  • Patent number: 11997418
    Abstract: An indirect viewing system for a vehicle has at least one image capture device (2) having an image sensor (3) for continuously taking images at a first frame rate, an image memory (4) that temporarily stores images for processing that is temporally after the images are captured, and an image processing device (6) adapted to continuously compute at least one new image from at least two successively taken images, the computed new images having a second frame rate different from the first frame rate, and an image output device (5) for outputting the continuously computed new images at the second frame rate.
    Type: Grant
    Filed: November 9, 2021
    Date of Patent: May 28, 2024
    Assignee: MEKRA LANG GMBH & CO. KG
    Inventors: Werner Lang, Peter Geißendörfer, Andreas Redlingshöfer
  • Patent number: 11995599
    Abstract: Customized navigation maps of an area are generated for autonomous vehicles based on a baseline map of the area, transportation systems within the area, and attributes of the autonomous vehicles. The customized navigation maps include a plurality of paths, and two or more of the paths may form an optimal route for performing a task by an autonomous vehicle. Customized navigation maps may be generated for outdoor spaces or indoor spaces, and include specific infrastructure or features on which a specific autonomous vehicle may be configured for travel. Routes may be determined based on access points at destinations such as buildings, and the access points may be manually selected by a user or automatically selected on any basis. The autonomous vehicles may be guided by GPS systems when traveling outdoors, and by imaging devices or other systems when traveling indoors.
    Type: Grant
    Filed: January 3, 2022
    Date of Patent: May 28, 2024
    Assignee: Amazon Technologies, Inc.
    Inventors: Uriah John Baalke, Stav Braun, Sonia Jin, Jia Hao Lim
  • Patent number: 11997426
    Abstract: A system for conducting a video conference and methods for making and utilizing the same. The system can generate a first virtual stage for a first participant in the video conference by selecting one or more items of personal information associated with the first conference participant and disposing the selected personal information items in a predetermined arrangement. The first virtual stage can be transmitted with a first visual image of the first conference participant to a computer system associated with a second conference participant for visual presentation during the video conference. The system advantageously can enable the computer system associated with each conference participate to visually present a visual image with an associated virtual stage for each of the other conference participants.
    Type: Grant
    Filed: July 18, 2022
    Date of Patent: May 28, 2024
    Assignee: Warmly, Inc.
    Inventors: Max Greenwald, Carina Boo, Alan Zhao, Valeria Yermakova, Scott O'Connor, Zack Zeyu
  • Patent number: 11995900
    Abstract: A method and system for performing indicia recognition includes obtaining, at an image sensor, an image of an object of interest and identifying at least one region of interest in the image. The region of interest contains one or more indicia indicative of the object of interest. The processor then determines positions of each region of interest and further determines a geometric shape based on the positions of each of the regions of interest. An orientation classification is identified for each region of interest is based on a respective position relative to the geometric shape for reach region of interest. The processor then identifies and performs one or more transformations for each region of interest, with each transformation determined by each regions respective orientation classification. The processor then performs indicia recognition on each of the one or more transformed regions of interest.
    Type: Grant
    Filed: November 12, 2021
    Date of Patent: May 28, 2024
    Assignee: Zebra Technologies Corporation
    Inventors: Yan Zhang, Denghui Xiao
  • Patent number: 11991940
    Abstract: A method for detecting real lateral locations of target plants includes: recording an image of a ground area at a camera; detecting a target plant in the image; accessing a lateral pixel location of the target plant in the image; for each tool module in a set of tool modules arranged behind the camera and in contact with a plant bed: recording an extension distance of the tool module; and recording a lateral position of the tool module relative to the camera; estimating a depth profile of the plant bed proximal the target plant based on the extension distance and the lateral position of each tool module; estimating a lateral location of the target plant based on the lateral pixel location of the target plant and the depth profile of the plant bed surface proximal the target plant; and driving a tool module to a lateral position aligned with the lateral location of the target plant.
    Type: Grant
    Filed: October 19, 2020
    Date of Patent: May 28, 2024
    Assignee: FarmWise Labs, Inc.
    Inventors: Arthur Flajolet, Eric Stahl-David, Sébastien Boyer, Thomas Palomares
  • Patent number: 11987181
    Abstract: A driver assistance system for coupling a trailer to a towing vehicle is described, including a video camera attached to the towing vehicle and an associated display device in the driver's field of vision, in whose video image a static guide marking is displayed along which a coupling mouth arranged on the towing vehicle can be contacted with a drawbar eye held on the trailer by a drawbar. Providing a driver assistance system which helps the driver estimating the three-dimensional position of the drawbar eye in relation to the towing vehicle while rearwards approaching a trailer. The video camera is arranged at a vertical distance from the coupling and the guide marking is formed by two beam corridors arranged on both sides of the vehicle's longitudinal axis converging towards one another in the rearward direction of the towing vehicle.
    Type: Grant
    Filed: May 7, 2021
    Date of Patent: May 21, 2024
    Assignee: Jost-Werke Deutschland GmbH
    Inventors: Benjamin Kaufhold, Swen Saupe
  • Patent number: 11989952
    Abstract: Systems and methods for predicting a location of a target vehicle are disclosed. A processor receives trajectory information for the target vehicle and determines a trajectory feature based on the trajectory information. The processor further determines a lane feature of a lane within a threshold vicinity of the target vehicle, and determines a probability associated with the lane based on the trajectory feature and the lane feature. The lane that the vehicle may enter is identified based on the probability. The processor may also generate interactive features of interactions between the target vehicle and other vehicles. The processor predicts a location of the target vehicle in an upcoming time period based on the lane feature and the trajectory feature. In some embodiments, the interactive features are also used for the prediction.
    Type: Grant
    Filed: November 20, 2020
    Date of Patent: May 21, 2024
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Lin Sun, Chenxu Luo, Dariush Dabiri
  • Patent number: 11987272
    Abstract: Systems and methods for predicting user interaction with vehicles. A computing device receives an image and a video segment of a road scene, the first at least one of an image and a video segment being taken from a perspective of a participant in the road scene and then generates stimulus data based on the image and the video segment. Stimulus data is transmitted to a user interface and response data is received, which includes at least one of an action and a likelihood of the action corresponding to another participant in the road scene. The computing device aggregates a subset of the plurality of response data to form statistical data and a model is created based on the statistical data. The model is applied to another image or video segment and a prediction of user behavior in the another image or video segment is generated.
    Type: Grant
    Filed: March 3, 2021
    Date of Patent: May 21, 2024
    Assignee: Perceptive Automata, Inc.
    Inventors: Samuel English Anthony, Kshitij Misra, Avery Wagner Faller
  • Patent number: 11989031
    Abstract: A method for assisting an autonomous motor vehicle includes using an autonomous motor vehicle equipped with an automatic driving device which is adapted to decide driving actions to be carried out in order to autonomously circulate on a route, connecting the automatic driving device to a computer server of a remote control center through a wireless communication network, determining the geographical position of the vehicle. The method also includes predictive detection of a critical event on the route upstream of the position of the vehicle, which results in said operator takes control of the remote vehicle and decides driving actions, predictive detection of the critical event resulting from the combined analysis of data that includes, data on the state of the traffic lanes taken on the route upstream, the road conditions, the meteorological conditions, data coming from sensors installed on the vehicle.
    Type: Grant
    Filed: December 24, 2019
    Date of Patent: May 21, 2024
    Assignee: VULOG
    Inventor: François Colon
  • Patent number: 11989861
    Abstract: A mechanism is described for facilitating deep learning-based real-time detection and correction of compromised sensors in autonomous machines according to one embodiment. An apparatus of embodiments, as described herein, includes detection and capturing logic to facilitate one or more sensors to capture one or more images of a scene, where an image of the one or more images is determined to be unclear, where the one or more sensors include one or more cameras. The apparatus further comprises classification and prediction logic to facilitate a deep learning model to identify, in real-time, a sensor associated with the image.
    Type: Grant
    Filed: November 28, 2017
    Date of Patent: May 21, 2024
    Assignee: INTEL CORPORATION
    Inventors: Wenlong Yang, Tomer Rider, Xiaopei Zhang
  • Patent number: 11989957
    Abstract: An apparatus for controlling object tracking and a method therefor are provided. The apparatus includes an object detector configured to detect an object in an image, an object tracker configured to track the object, a learning device configured to learn whether to enable the object detector based on features of the object and tracking results of the object tracker, and a controller configured to determine whether to enable the object detector by interworking with the learning device.
    Type: Grant
    Filed: May 5, 2021
    Date of Patent: May 21, 2024
    Assignees: Hyundai Motor Company, Kia Corporation, INCHEON NATIONAL UNIVERSITY RESEARCH & BUSINESS FOUNDATION
    Inventors: Young Hyun Kim, Seung Hwan Bae, Seong Ho Lee
  • Patent number: 11983938
    Abstract: Systems and methods for curating video and other driving-related data for use in driver coaching, which may include selecting or ranking driving behaviors for coaching, selecting or ranking drivers for coaching, selecting or ranking video and other data to be used in coaching, preparing for, scheduling, and summarizing coaching sessions, matching the format of coaching to the behavior or person being coached, preventing unsafe driving situations, influencing job dispatch decisions based on safety scores, and/or reducing data bandwidth usage based on a determined coaching effectiveness of video data.
    Type: Grant
    Filed: November 20, 2020
    Date of Patent: May 14, 2024
    Assignee: NETRADYNE, INC.
    Inventors: Adam David Kahn, Venkat Ramanan Venkatachalam Jayaraman, Stephan Franklin Dunn, Matthew Karl Drake, Venkata Sreekanta Reddy Annapureddy, Pratik Verma, Aravind P (Padmasanan), Vinay Kumar Rai, Hemanth Roy Badugu, Michael Campos, David Jonathan Julian, Avneesh Agrawal
  • Patent number: 11981336
    Abstract: A vehicle row follow system may include a vehicle comprising at least one sensor to output signals serving as a basis for a three-dimensional (3D) point cloud and to output signals corresponding to a two-dimensional (2D) image of a region forward the vehicle. The system may further include a non-transitory computer readable medium containing instructions to direct a processor to: determine plan row lines in a 2D image; determine a yaw of the vehicle based upon a slope of a heading line relative to a centerline between the plant row lines in the 2D image; determine a lateral offset of the vehicle from the centerline between the consecutive plant rows based upon an identity of the consecutive plant rows in the 3D point cloud; and output steering control signals based upon the determined yaw and lateral offset of the vehicle.
    Type: Grant
    Filed: September 30, 2021
    Date of Patent: May 14, 2024
    Assignee: Zimeno Inc.
    Inventors: Rama Venkata Surya Kumar Varma Bhupatiraju, Deepak Rajasekhar Karishetti, Benjamin M. Gatten, Sanket Goyal
  • Patent number: 11981352
    Abstract: Systems and methods for predicting user interaction with vehicles. A computing device receives an image and a video segment of a road scene, the first at least one of an image and a video segment being taken from a perspective of a participant in the road scene and then generates stimulus data based on the image and the video segment. Stimulus data is transmitted to a user interface and response data is received, which includes at least one of an action and a likelihood of the action corresponding to another participant in the road scene. The computing device aggregates a subset of the plurality of response data to form statistical data and a model is created based on the statistical data. The model is applied to another image or video segment and a prediction of user behavior in the another image or video segment is generated.
    Type: Grant
    Filed: March 3, 2021
    Date of Patent: May 14, 2024
    Assignee: Perceptive Automata, Inc.
    Inventors: Samuel English Anthony, Kshitij Misra, Avery Wagner Faller
  • Patent number: 11975612
    Abstract: A vehicle includes a first wheel, a second wheel, and a controller. The first and second of wheels have first and second tires, respectively. The controller is programmed to receive inputs indicative of tire tread wear of the first and second wheels. The controller is further programmed to, in response to a command to adjust torques of the first and second wheels to first and second desired torque values, respectively, and a difference between a tire tread wear of the first wheel and a tire tread wear of the second wheel exceeding a threshold, adjust the torque of the first electric machine to less than the first desired torque value and adjust the torque of the second electric machine to greater than the second desired torque value.
    Type: Grant
    Filed: September 25, 2020
    Date of Patent: May 7, 2024
    Assignee: Ford Global Technologies, LLC
    Inventor: Brendan F. Diamond
  • Patent number: 11976936
    Abstract: Techniques are provided for foreground extraction from a point cloud (e.g., a LiDAR point cloud) using surface fitting. In an embodiment, one or more processors of a vehicle can receive point cloud data from one or more vehicle sensors. The one or more processors can identify points in the point cloud data as foreground points or ground points using a spatial Kalman filter to capture changes in the terrain. A route or trajectory in a driving area for the vehicle can be generated using the identified foreground points and ground points. A vehicle controller can control the vehicle while the vehicle is traveling on the route or trajectory in the driving area.
    Type: Grant
    Filed: October 5, 2021
    Date of Patent: May 7, 2024
    Assignee: Motional AD LLC
    Inventors: Abbas Shikari, Jiaxin Li, Thomas Koelbaek Jespersen
  • Patent number: 11977188
    Abstract: A method for calibrating a vehicle sensor of a motor vehicle. The method includes the steps: ascertaining, by way of the vehicle sensor, sensor data at a plurality of measurement times, the motor vehicle moving in relation to objects in surroundings of the motor vehicle; computing object positions of the objects on the basis of the ascertained sensor data; computing a Hough transformation on the basis of the computed object positions; ascertaining an alignment of the vehicle sensor in relation to a driving axis of the motor vehicle on the basis of the computed Hough transformation; and calibrating the vehicle sensor on the basis of the ascertained alignment of the vehicle sensor in relation to the driving axis of the motor vehicle.
    Type: Grant
    Filed: September 2, 2020
    Date of Patent: May 7, 2024
    Assignee: ROBERT BOSCH GMBH
    Inventors: David Ziegler, Stephan Dorenkamp
  • Patent number: 11972602
    Abstract: Provided is a method for performing accurate object recognition in a stable manner in consideration of changes in a shooting environment. In such a method, a camera captures an image of a shooting location where an object is to be placed and an object included in an image of the shooting location is recognized utilizing a machine learning model for object recognition. The method further involves: determining necessity of an update operation on the machine learning model for object recognition at a predetermined time; when the update operation is necessary, causing the camera to capture an image of the shooting location where no object is placed to thereby re-acquire a background image for training; and causing the machine learning model to be trained using a composite image of a backgroundless object image and the re-acquired background image for training as training data.
    Type: Grant
    Filed: September 10, 2020
    Date of Patent: April 30, 2024
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Makoto Shinzaki, Yuichi Matsumoto
  • Patent number: 11965371
    Abstract: A vehicle that can effectively prevent a collision between the tail gate and an obstacle in the situation where the tail gate is automatically opened or closed includes: a tail gate; a driving unit engaged to the tail gate and configured to open or close the tail gate; a UWB module configured to communicate with a smart key according to an authentication signal transmitted from the smart key in a first mode, and transmit a detection signal to an object and detect the object according to the detection signal reflected from the object in a second mode; and a controller connected to the UWB module and configured to operate the UWB module in the second mode when the driving unit operates, and stop the operation of the driving unit when the object is detected from the UWB module operating in the second mode during operation of the driving unit.
    Type: Grant
    Filed: June 2, 2021
    Date of Patent: April 23, 2024
    Assignees: Hyundai Motor Company, Kia Corporation
    Inventor: Daeyun An
  • Patent number: 11959828
    Abstract: A tire state estimation system (10) is provided with a crack shape acquisition unit (240) for acquiring the shape of a crack on the outer surface of a tire, a crack information DB (230) for holding a correspondence relationship in which at least either degree of opening or deviation width of the crack based on the shape of the crack is associated with the depth of the crack, and a crack depth estimation unit (250) for estimating the depth of the crack based on the acquired crack shape and the correspondence relationship.
    Type: Grant
    Filed: April 15, 2019
    Date of Patent: April 16, 2024
    Assignee: BRIDGESTONE CORPORATION
    Inventors: Kei Tsuchiya, Masafumi Daifuku, Teppei Mori
  • Patent number: 11958358
    Abstract: Configuration, in which images output to a display unit are switched and displayed in accordance with the behavior of a driver, such as movements of the head of the driver, is achieved. Driver information indicating the behavior of the driver of a moving apparatus and images captured by a plurality of cameras that images a situation around the moving apparatus from different viewpoints are input. The images output to the display unit are switched in accordance with the driver information. The plurality of cameras is, for example, a plurality of rear cameras installed in the rear of the moving apparatus. For example, a direction of the face or line-of-sight of the driver is detected. An image in a direction corresponding to the detected direction of the face or line-of-sight of the driver is selected as an output image, and displayed on the display unit. Alternatively, an image in a direction indicated by a gesture of the driver is selected, and displayed on the display unit.
    Type: Grant
    Filed: April 9, 2019
    Date of Patent: April 16, 2024
    Assignee: Sony Semiconductor Solutions Corporation
    Inventors: Eiji Oba, Mitsuharu Ohki, Shigeyuki Baba, Yoshikuni Nomura
  • Patent number: 11961313
    Abstract: Systems and methods for using image analysis techniques to assess unsafe driving conditions by a vehicle operator are discloses. According to aspects, a computing device may access and analyze image data depicting the vehicle operator. In analyzing the image, the computing device may measure certain visible metrics as depicted in the image data and compare the metrics to corresponding threshold values, and may accordingly determine whether the vehicle operator is exhibiting an unsafe driving condition. The computing device may generate and present alerts that indicate any determined unsafe driving condition.
    Type: Grant
    Filed: January 31, 2023
    Date of Patent: April 16, 2024
    Assignee: State Farm Mutual Automobile Insurance Company
    Inventors: Dingchao Zhang, Yuntao Li, Jeffrey S. Myers
  • Patent number: 11961243
    Abstract: A geometric approach may be used to detect objects on a road surface. A set of points within a region of interest between a first frame and a second frame are captured and tracked to determine a difference in location between the set of points in two frames. The first frame may be aligned with the second frame and the first pixel values of the first frame may be compared with the second pixel values of the second frame to generate a disparity image including third pixels. One or more subsets of the third pixels that have a value above a first threshold may be combined, and the third pixels may be scored and associated with disparity values for each pixel of the one or more subsets of the third pixels. A bounding shape may be generated based on the scoring.
    Type: Grant
    Filed: February 26, 2021
    Date of Patent: April 16, 2024
    Assignee: NVIDIA Corporation
    Inventors: Dong Zhang, Sangmin Oh, Junghyun Kwon, Baris Evrim Demiroz, Tae Eun Choe, Minwoo Park, Chethan Ningaraju, Hao Tsui, Eric Viscito, Jagadeesh Sankaran, Yongqing Liang
  • Patent number: 11960027
    Abstract: A LIDAR data based object recognition apparatus merges segments over-segmented in a LIDAR data based segmentation process. The apparatus includes a segment generator generating a plurality of segments by grouping points acquired from a LIDAR sensor. A target segment selector selects a target segment that is a base for merging from the plurality of segments and a segment merging determination unit checks whether segments other than the target segment are mergeable segments and determines whether to merge the target segment and the mergeable segments based on attribute information of the target segment and the mergeable segments. A segment merger merges the target segment and the mergeable segments and outputs a merged segment.
    Type: Grant
    Filed: October 19, 2020
    Date of Patent: April 16, 2024
    Assignees: Hyundai Motor Company, Kia Motors Corporation
    Inventor: Mu Gwan Jeong
  • Patent number: 11961279
    Abstract: A system and method of identifying and tracking objects comprises registering an identity of a person who visits an area designated for holding objects, capturing an image of the area designated for holding objects, submitting a version of the image to a deep neural network trained to detect and recognize objects in images like those objects held in the designated area, detecting an object in the version of the image, associating the registered identity of the person with the detected object, retraining the deep neural network using the version of the image if the deep neural network is unable to recognize the detected object, and tracking a location of the detected object while the detected object is in the area designated for holding objects.
    Type: Grant
    Filed: June 13, 2022
    Date of Patent: April 16, 2024
    Assignee: Position Imaging, Inc.
    Inventors: Narasimhachary Nallana Chakravarty, Guohua Min, Edward L. Hill, Brett Bilbrey
  • Patent number: 11959769
    Abstract: An information processing device includes processing circuitry configured to acquire feature measurement information indicating locations of features including a road having a boundary and trajectory information indicating a trajectory along the road. Additionally, the processing circuitry is further configured to generate candidate location information indicating locations of candidate elements for the boundary, based on the acquired feature measurement information. Further, the processing circuitry is configured to select candidate elements from among the candidate elements indicated by the generated candidate location information, based on the acquired trajectory information. Finally, the processing circuitry is configured to generate boundary location information indicating determined locations of the boundary, using the selected candidate elements.
    Type: Grant
    Filed: October 1, 2019
    Date of Patent: April 16, 2024
    Assignee: MITSUBISHI ELECTRIC CORPORATION
    Inventors: Masashi Watanabe, Yukako Takahashi, Takuma Kadoya
  • Patent number: 11962664
    Abstract: Context-based data valuation and transmission, including: acquiring sensor data from a plurality of sensors of the autonomous vehicle, wherein the sensor data comprises a plurality of portions and the plurality of sensors comprises at least two cameras; determining, for each portion of the sensor data, a value based on one or more conditions under which the sensor data was captured; determining, based on the values for the sensor data, an upload policy; and transmitting, based on the upload policy, one or more portions of the sensor data to a server.
    Type: Grant
    Filed: January 16, 2023
    Date of Patent: April 16, 2024
    Assignee: GHOST AUTONOMY INC.
    Inventors: John Hayes, Volkmar Uhlig
  • Patent number: 11952022
    Abstract: Generally, a system including an imaging device and a processing unit is disclosed. The imaging device may be configured to acquire a plurality of datasets of corresponding plurality of image frames by performing corresponding plurality of image frame handling cycles. The processing unit may be configured to define a special region of interest (SROI) in each of at least some of the plurality of the image frames acquired by the imaging device, based on the datasets of the respective image frames. The imaging device may be further configured to acquire at least one partial dataset of the SROI, during each of at least some of the plurality of image frame handling cycles and within a residual time between an end of an image frame acquiring time and an end of the respective image frame handling cycle.
    Type: Grant
    Filed: May 1, 2019
    Date of Patent: April 9, 2024
    Assignee: RAIL VISION LTD.
    Inventor: Shahar Hania
  • Patent number: 11954894
    Abstract: A system for determining blockage of a vehicle camera is configured to apply a partition grid having a plurality of locations to a sequence of images to form a plurality of regions. The system determines at least one spatial feature corresponding to the partition grid and at least one temporal feature corresponding to the partition grid. The system generates a sequence of classifications for each location of the plurality of locations based on the at least one spatial feature, the at least one temporal feature, and reference information. The system applies a smoothing technique to determine a subset of regions that are blocked among the sequence of classifications, and generates an output signal based on the subset of regions. The output may be provided to an output system to wash the camera lens, notify the user or the vehicle of the blockage, or modify image processing.
    Type: Grant
    Filed: April 8, 2021
    Date of Patent: April 9, 2024
    Assignee: Rivian IP Holdings, LLC
    Inventors: Utkarsh Deshmukh, Vikram Appia, Vishwas Venkatachalapathy, Martin Mueller
  • Patent number: 11953340
    Abstract: A navigation system may include a processor programmed to analyze a first image to identify a non-semantic road feature; identify a first image location, in the first image, of one point associated with the non-semantic road feature; analyze a second image to identify a representation of the non-semantic road feature in the second image; identify a second image location, in the second image, of the one point associated with the non-semantic road feature; determine, based on a difference between the first and second image locations and based on motion information for a vehicle between a capture of the first image and a capture of the second image, three-dimensional coordinates for the one point associated with the non-semantic road feature; and send the three-dimensional coordinates for the one point associated with the non-semantic road feature to a server for use in updating a road navigation model.
    Type: Grant
    Filed: August 12, 2021
    Date of Patent: April 9, 2024
    Assignee: Mobileye Vision Technologies Ltd.
    Inventors: Yoav Taieb, Itai Ben Shalom
  • Patent number: 11948310
    Abstract: Systems and methods described herein relate to jointly training a machine-learning-based monocular optical flow, depth, and scene flow estimator. One embodiment processes a pair of temporally adjacent monocular image frames using a first neural network structure to produce a first optical flow estimate; processes the pair of temporally adjacent monocular image frames using a second neural network structure to produce an estimated depth map and an estimated scene flow; processes the estimated depth map and the estimated scene flow using the second neural network structure to produce a second optical flow estimate; and imposes a consistency loss between the first optical flow estimate and the second optical flow estimate that minimizes a difference between the first optical flow estimate and the second optical flow estimate to improve performance of the first neural network structure in estimating optical flow and the second neural network structure in estimating depth and scene flow.
    Type: Grant
    Filed: September 29, 2021
    Date of Patent: April 2, 2024
    Assignee: Toyota Research Institute, Inc.
    Inventors: Vitor Guizilini, Rares A. Ambrus, Kuan-Hui Lee, Adrien David Gaidon
  • Patent number: 11945334
    Abstract: A method for determining a maximum value for a parameter range of a driving operation parameter of a motor vehicle. The motor vehicle includes a control device, at least one electric traction motor, an electric energy storage device which can be operated in an operating temperature range for operating the traction motor, and at least one temperature sensor for determining a temperature of the energy storage device. The control device determines the maximum value as a function of a current temperature of the energy storage device determined by the temperature sensor in such a manner that, after the approach of a destination known to the control device and/or after a journey over a predetermined distance with the driving operation parameter restricted by the maximum value of the parameter range, a predicted temperature of the energy storage device lies within a charging temperature range.
    Type: Grant
    Filed: July 26, 2021
    Date of Patent: April 2, 2024
    Assignee: AUDI AG
    Inventors: Florian Bock, Michael Grabowski
  • Patent number: 11948371
    Abstract: The present technique relates to an information processing apparatus, an information processing method, a program, and a mobile body which enable accuracy of detection processing related to a passage around a mobile body to be improved. The information processing apparatus includes: a transforming unit configured to respectively transform a plurality of photographed images with partially overlapping photographing ranges into bird's eye images; a compositing unit configured to generate a composite image by compositing a plurality of the bird's eye images; and a detecting unit configured to perform detection processing related to a passage around a mobile body based on the composite image. For example, the present technique can be applied to an apparatus that detects a lane marking of a road.
    Type: Grant
    Filed: May 23, 2019
    Date of Patent: April 2, 2024
    Assignee: SONY CORPORATION
    Inventor: Masahiko Toyoshi
  • Patent number: 11940285
    Abstract: Methods and apparatus for route selection to a destination may include receiving a starting point and one or more destinations, and transmitting a request to a server for routes associated with the starting point and the one or more destinations. Additionally, the methods and apparatus may include receiving, from the server, a plurality of routes to the one or more destinations. Furthermore, the methods and apparatus may include selecting a route from the plurality of routes based at least on one or more reliability parameters associated with each route of the plurality of routes, the one or more reliability parameters comprising a likelihood of determining a position location along each route, the likelihood being based at least on detectability of features in each route by one or more object detection modalities.
    Type: Grant
    Filed: January 19, 2022
    Date of Patent: March 26, 2024
    Assignee: QUALCOMM Incorporated
    Inventors: Sai Pradeep Venkatraman, Meghna Agrawal, Weihua Gao
  • Patent number: 11940290
    Abstract: A navigation system may include a processor programmed to receive, from a camera of the host vehicle, one or more images captured from an environment of the host vehicle, and analyze the one or more images to detect an indicator of an intersection. The processor may also be programmed to determine, based on output received from at least one sensor of the host vehicle, a stopping location of the host vehicle relative to the detected intersection, and analyze the one or more images to determine an indicator of whether one or more other vehicles are in front of the host vehicle. The processor may further be programmed to send the stopping location of the host vehicle and the indicator of whether one or more other vehicles are in front of the host vehicle to a server for use in updating a road navigation model.
    Type: Grant
    Filed: August 10, 2021
    Date of Patent: March 26, 2024
    Assignee: Mobileye Vision Technologies Ltd.
    Inventors: Tomer Eshet, Daniel Braunstein
  • Patent number: 11940265
    Abstract: A distance measurement device includes an imaging unit which captures a subject image formed by an imaging optical system, an emission unit which emits directional light as light having directivity along an optical axis direction of the imaging optical system, a light receiving unit which receives reflected light of the directional light from the subject, a derivation unit which derives a distance to the subject based on the timing at which the directional light is emitted and the timing at which the reflected light is received, a display unit which displays the subject image, and a control unit which performs control such that, in a case of performing a distance measurement, the display unit displays the subject image as a motion image and transition is made to a state where actual exposure by the imaging unit is possible at the timing of the end of the distance measurement.
    Type: Grant
    Filed: December 2, 2021
    Date of Patent: March 26, 2024
    Assignee: FUJIFILM CORPORATION
    Inventors: Tomonori Masuda, Hiroshi Tamayama
  • Patent number: 11934962
    Abstract: Systems, methods, tangible non-transitory computer-readable media, and devices for associating objects are provided. For example, the disclosed technology can receive sensor data associated with the detection of objects over time. An association dataset can be generated and can include information associated with object detections of the objects at a most recent time interval and object tracks of the objects at time intervals in the past. A subset of the association dataset including the object detections that satisfy some association subset criteria can be determined. Association scores for the object detections in the subset of the association dataset can be determined. Further, the object detections can be associated with the object tracks based on the association scores for each of the object detections in the subset of the association dataset that satisfy some association criteria.
    Type: Grant
    Filed: April 10, 2023
    Date of Patent: March 19, 2024
    Assignee: UATC, LLC
    Inventors: Carlos Vallespi-Gonzalez, Abhishek Sen, Shivam Gautam
  • Patent number: 11931900
    Abstract: A method of predicting occupancy of unseen areas in a region of interest (ROI) includes obtaining a depth image of the ROI, the depth image being captured from a first height; generating an occupancy map based on the obtained depth image, the occupancy map comprising an array of cells corresponding to locations in the ROI; and generating an inpainted map by inputting the occupancy map into a trained inpainting network, the inpainted map comprising an array of cells corresponding to the ROI, and wherein the inpainting network is trained by comparing an output of the inpainting network, based on inputting a training depth image taken from the first height, to a ground truth map, the ground truth map being based on a combination of the training depth image and a depth image taken at a height different than the first height.
    Type: Grant
    Filed: December 22, 2020
    Date of Patent: March 19, 2024
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Minghan Wei, Dae Won Lee, Ibrahim Volkan Isler, Daniel Dongyuel Lee
  • Patent number: 11932245
    Abstract: Systems, methods, and other embodiments described herein relate to improving identification of a path for an ego vehicle on a roadway. In one embodiment, a method includes, in response to acquiring sensor data from at least one sensor of the ego vehicle about a surrounding environment, identifying roadway elements from the sensor data as cues about the path. The roadway elements include one or more of lane markers of the roadway and surrounding vehicles. The method includes grouping the roadway elements into two or more groups according to characteristics of roadway elements indicating common curvatures. The method includes analyzing the two or more groups according to a confidence heuristic to determine a priority group from the two or more groups that corresponds with a trajectory of the ego vehicle. The method includes providing an identifier for the priority group to facilitate at least path planning for the ego vehicle.
    Type: Grant
    Filed: September 1, 2020
    Date of Patent: March 19, 2024
    Assignees: Toyota Motor Engineering & Manufacturing North America, Inc., Toyota Jidosha Kabushiki Kaisha
    Inventors: Rohit Pandita, Ruiko Miyano
  • Patent number: 11934955
    Abstract: Systems and methods for more accurate and robust determination of subject characteristics from an image of the subject. One or more machine learning models receive as input an image of a subject, and output both facial landmarks and associated confidence values. Confidence values represent the degrees to which portions of the subject's face corresponding to those landmarks are occluded, i.e., the amount of uncertainty in the position of each landmark location. These landmark points and their associated confidence values, and/or associated information, may then be input to another set of one or more machine learning models which may output any facial analysis quantity or quantities, such as the subject's gaze direction, head pose, drowsiness state, cognitive load, or distraction state.
    Type: Grant
    Filed: October 31, 2022
    Date of Patent: March 19, 2024
    Assignee: NVIDIA Corporation
    Inventors: Nuri Murat Arar, Niranjan Avadhanam, Nishant Puri, Shagan Sah, Rajath Shetty, Sujay Yadawadkar, Pavlo Molchanov
  • Patent number: 11926335
    Abstract: Methods, systems, and non-transitory computer-readable media are configured to perform operations comprising determining a symmetric scenario for a scenario; training a first machine learning model for the scenario based on first training data generated from second training data for the symmetric scenario; and generating a prediction for the scenario based on the first machine learning model.
    Type: Grant
    Filed: June 26, 2023
    Date of Patent: March 12, 2024
    Assignee: PlusAI, Inc.
    Inventors: Yu Wang, Yongzuan Wu
  • Patent number: 11919438
    Abstract: A vehicle headlight device capable of improving overlooking of pedestrians by a driver. The device includes: a left-side photoirradiator (left-side pattern irradiation lamp) which irradiates light on a left-side light distribution region (irradiation pattern light distribution region) on a left side of a travel roadway of a vehicle in an irradiation pattern in which a bright region a1 and a dark region are alternately repeated; and a right-side photoirradiator (right-side pattern irradiation lamp) which irradiates light on a right-side light distribution region (irradiation pattern light distribution region) on a right side of a travel roadway of the vehicle in an irradiation pattern in which a bright region a1 and a dark region are alternately repeated. In this embodiment, the left-side photoirradiator (left-side pattern irradiation lamp) is illuminated during left turn of the vehicle, and the right-side photoirradiator (right-side pattern irradiation lamp) is illuminated during right turn of the vehicle.
    Type: Grant
    Filed: February 7, 2023
    Date of Patent: March 5, 2024
    Assignee: HONDA MOTOR CO., LTD.
    Inventors: Masayoshi Takori, Yuji Tsuchiya
  • Patent number: 11912269
    Abstract: A collision avoidance assist apparatus executes an emergency steering control including processes to determine a target steering torque used to change a steering angle to avoid a collision of a vehicle with an obstacle so as not to move the vehicle out of a moving lane when the vehicle has a high probability of colliding with the obstacle, and the moving lane is a straight lane, and applies a steering torque corresponding to the determined target steering torque to a steering mechanism. The collision avoidance assist apparatus stops executing the emergency steering control when determining that the moving lane is a curved lane, based on only one of left and right lane markings at an avoidance side of the obstacle which is the left or the right side of the obstacle which the vehicle passes over while executing the emergency steering control.
    Type: Grant
    Filed: July 1, 2021
    Date of Patent: February 27, 2024
    Assignees: TOYOTA JIDOSHA KABUSHIKI KAISHA, CONTINENTAL AUTONOMOUS MOBILITY GERMANY GMBH
    Inventors: Mafune Kakeshita, Takashi Moriya, Sho Hashimoto, Akshay Rajendra, Michael Patzelt
  • Patent number: 11915433
    Abstract: An object tracking system according to the present disclosure includes: object position detection means for detecting a position of an object by using a sensor; object tracking parameter storage means for storing a parameter related to an erroneous detection or a non-detection caused by a detection characteristic of the sensor; object tracking means for performing tracking based on the position obtained by the object position detection means and the parameter stored in the object tracking parameter storage means; object tracking result evaluation means for calculating an evaluation index based on a result obtained by the object tracking means; and object tracking parameter updating means for determining the parameter based on the evaluation index calculated by the object tracking result evaluation means and updating the parameter stored in the object tracking parameter storage means.
    Type: Grant
    Filed: December 20, 2019
    Date of Patent: February 27, 2024
    Assignee: NEC CORPORATION
    Inventor: Yusuke Konishi
  • Patent number: 11914614
    Abstract: A system for generating approximately coordinated region maps (RM), the system comprising a processing resource configured to: provide a data repository comprising one or more RMs, each mapping a corresponding region, and each including information of a relative location of synchronization objects (SOs) located within the corresponding region with respect to a coordinate-system (CS) origin of a CS of the corresponding RM; obtain a given RM including information of relative locations of given SOs located within the given region with respect to a given CS origin of a given CS of the given RM; retrieve, from the data repository, reference RMs that meet a criteria; identify the reference RMs associated with at least one SO that match at least one of the given SO, giving rise to optimization RMs; and determine, utilizing an optimization scheme, an approximate transformation between the given CS and the CSs of the optimization RMs.
    Type: Grant
    Filed: August 1, 2019
    Date of Patent: February 27, 2024
    Assignee: RESIGHT LTD.
    Inventors: Eran Segal, Ari Zigler, Omri Yaakov Stein
  • Patent number: 11914851
    Abstract: Provided is an object detection device or the like which efficiently generates good-quality training data. This object detection device is provided with: a detection unit which uses a dictionary to detect objects from an input image; a reception unit which displays, on a display device, the input image accompanied by a display emphasizing partial areas of detected objects, and receives, from one operation of an input device, a selection of a partial area and an input of the class of the selected partial area; a generation unit which generates training data from the image of the selected partial area and the inputted class; and a learning unit which uses the training data to learn the dictionary.
    Type: Grant
    Filed: May 24, 2022
    Date of Patent: February 27, 2024
    Assignee: NEC CORPORATION
    Inventor: Yusuke Takahashi
  • Patent number: 11908197
    Abstract: An information processing apparatus that detects an object from an image, includes a determination unit configured to determine a boundary at which a movement of the object between partial regions in the image is estimated, the partial regions each including a plurality of objects, and an estimation unit configured to estimate movement information indicating a number of objects that have passed the boundary determined by the determination unit.
    Type: Grant
    Filed: July 8, 2021
    Date of Patent: February 20, 2024
    Assignee: Canon Kabushiki Kaisha
    Inventor: Shunsuke Sato
  • Patent number: 11900692
    Abstract: A vehicle includes one or more cameras that capture a plurality of two-dimensional images of a three-dimensional object. A light detector and/or a semantic classifier search within those images for lights of the three-dimensional object. A vehicle signal detection module fuses information from the light detector and/or the semantic classifier to produce a semantic meaning for the lights. The vehicle can be controlled based on the semantic meaning. Further, the vehicle can include a depth sensor and an object projector. The object projector can determine regions of interest within the two-dimensional images, based on the depth sensor. The light detector and/or the semantic classifier can use these regions of interest to efficiently perform the search for the lights.
    Type: Grant
    Filed: December 29, 2021
    Date of Patent: February 13, 2024
    Assignee: GM Cruise Holdings LLC
    Inventors: Clement Creusot, Divya Thuremella, Na Yu, Jia Pu
  • Patent number: 11898871
    Abstract: An apparatus, method and computer program product provide a map layer of one or more temporary dynamic obstructions. For example, the apparatus is configured to receive vehicle/driver behavior data associated with a vehicle at a portion of a road, determine a likelihood of a temporary dynamic obstruction existing proximate to the portion based on the vehicle behavior data, and update a datapoint of a map layer based on the likelihood. The datapoint indicates a state of existence of the temporary dynamic obstruction at the portion.
    Type: Grant
    Filed: September 15, 2021
    Date of Patent: February 13, 2024
    Assignee: HERE GLOBAL B.V.
    Inventors: Donta White, Leon Stenneth
  • Patent number: 11900550
    Abstract: A method of providing an interactive personal mobility system, performed by one or more processors, comprises determining an initial pose by visual-inertial odometry performed on images and inertial measurement unit (IMU) data generated by a wearable augmented reality device. Sensor data transmitted from a personal mobility system is received, and sensor fusion is performed on the data received from the personal mobility system to provide an updated pose. Augmented reality effects are displayed on the wearable augmented reality device based on the updated pose.
    Type: Grant
    Filed: December 23, 2021
    Date of Patent: February 13, 2024
    Assignee: SNAP INC.
    Inventors: Edmund Graves Brown, Benjamin Lucas, Jonathan M. Rodriguez, II, Richard Zhuang