Patents Assigned to Toyota Research Institute, Inc.
-
Publication number: 20250074476Abstract: A method for a shared control, dynamic driving system is described. The method includes determining a vehicle command requested by a vehicle operator of an ego vehicle. The method also includes predicting the ego vehicle entering an unstable, controllable operating range if the vehicle command is performed. The method further includes adjusting the vehicle command to maintain control of the ego vehicle in the unstable, controllable operating range. The method also includes performing an adjusted vehicle command to operate the ego vehicle in the unstable, controllable operating range while maintaining recovery stability to transition to a safe operating range.Type: ApplicationFiled: September 1, 2023Publication date: March 6, 2025Applicants: TOYOTA RESEARCH INSTITUTE, INC., TOYOTA JIDOSHA KABUSHIKI KAISHAInventors: Izumi KARINO, Yan Ming Jonathan GOH, James Andrew DALLAS, Michael THOMPSON, Minoru Brandon ARAKI
-
Publication number: 20250077783Abstract: Systems and methods disclosed include identifying a topic and a perspective of an input text to be sent to a receiver, determining a receiver perspective based on the topic of the input text and a receiver persona associated with the receiver, determining, by comparing the perspective of the input text and the perspective of the receiver, whether the input text includes a language having an offensive probability beyond an offensive probability threshold, after determining that the input text includes the language having the offensive probability beyond the offensive probability threshold, providing an option to modify the input text on a user interface of the sender, and modifying the input text to have the offensive probability below the offensive probability threshold when the option is selected.Type: ApplicationFiled: August 29, 2023Publication date: March 6, 2025Applicants: Toyota Research Institute, Inc., Toyota Jidosha Kabushiki KaishaInventors: Francine R. Chen, Matthew Lee, Scott Carter, Tatiana Lau
-
Publication number: 20250077730Abstract: Methods and systems disclosed are directed to a virtual simulation of chargers in a real-world environment having a wiring system using, a camera, an augmented reality (AR) interface, and a processor operable to generate a virtual charger representing a charger superimposed on the real-world environment, receive data responsive to a user interaction using the AR interface to operate the virtual charger, update the virtual charger superimposed on the real-world environment based on the operation, and wherein the virtual charger includes a connector and a charging cable including a first end and a second end, the first end operable to be connected to the connector, and the second end operable to be connected to the wiring system.Type: ApplicationFiled: August 29, 2023Publication date: March 6, 2025Applicants: Toyota Research Institute, Inc., Toyota Jidosha Kabushiki KaishaInventors: Scott Carter, Emily Sumner, Monica PhuongThao Van, Yin-Ying Chen
-
Publication number: 20250078431Abstract: Systems, methods, and other embodiments described herein relate to organizing and altering selected images from a style map with learning models through factoring style dimensions. In one embodiment, a method includes generating a style map by transforming and clustering information from an image dataset with a visualization model within a computation space having reduced dimensionality, and the style map includes style features derived from the image dataset. The method also includes comparing images selected from the style map using scores for dimensions associated with semantic attributes to form a comparison map. The method also includes mixing visual styles of the images from the comparison map with a generative model that computes representation interpolations within a latent space, the generative model outputting stylized images in an array. The method also includes communicating the array to a development system.Type: ApplicationFiled: December 14, 2023Publication date: March 6, 2025Applicants: Toyota Research Institute, Inc., Toyota Jidosha Kabushiki KaishaInventors: Youngseung Jeon, Matthew K. Hong, Yin-Ying Chen, Shabnam Hakimi
-
Patent number: 12240471Abstract: System, methods, and other embodiments described herein relate to coordinating and optimizing prediction by a model using intermediate data and vehicle-to-vehicle (V2V) communications that improves bandwidth utilization. In one embodiment, a method includes processing acquired data, by a subject vehicle using a prediction model, to execute a vehicle task associated with navigating a driving scene. The method also includes extracting processed data according to the acquired data from intermediate activations of layers within the prediction model according to a cooperation model. The method also includes quantifying relevancy of the processed data, for a target vehicle, to select a subset using the cooperation model. The method also includes communicating the subset to a selected vehicle having the prediction model for additional prediction according to the relevancy and available resources to transmit the subset.Type: GrantFiled: August 8, 2022Date of Patent: March 4, 2025Assignees: Toyota Research Institute, Inc., Toyota Jidosha Kabushiki KaishaInventors: Guy Rosman, Stephen G. McGill, Jr., Paul Drews
-
Patent number: 12243325Abstract: A method for self-calibrating alignment between image data and point cloud data utilizing a machine learning model includes receiving, with an electronic control unit, image data from a vision sensor and point cloud data from a depth sensor, implementing, with the electronic control unit, a machine learning model trained to: align the point cloud data and the image data based on a current calibration, detect a difference in alignment of the point cloud data and the image data, adjust the current calibration based on the difference in alignment, and output a calibrated embedding feature map based on adjustments to the current calibration.Type: GrantFiled: April 29, 2022Date of Patent: March 4, 2025Assignees: Toyota Research Institute, Inc., Toyota Jidosha Kabushiki KaishaInventors: Jie Li, Vitor Guizilini, Adrien Gaidon
-
Patent number: 12241754Abstract: Systems and methods are provided for verifying the accuracy of a map. Information regarding objects, such as roadway or roadway-related elements may be encoded into a map to be used for navigation and/or control of a vehicle, such as an autonomous vehicle. In order to verify that the map accurately reflects the roadway or roadway-related elements making up a section of roadway, the vehicle may be driven/ridden along the same section of roadway. A camera feed can be captured of this subsequent traversal of the section of roadway to check if the map includes the requisite roadway or roadway-related elements. The known roadway or roadway-related elements can be occluded from view in the camera feed. Accordingly, if any roadway or roadway-related elements do appear in the camera feed, they can be more easily detected by a verifier, and the processor verification is simplified.Type: GrantFiled: August 4, 2020Date of Patent: March 4, 2025Assignee: TOYOTA RESEARCH INSTITUTE, INC.Inventor: Andrew Patrikalakis
-
Patent number: 12240432Abstract: Systems and methods are provided for variable actuation and release of a vehicle's brake hold mechanism/function. A brake hold device may be implemented as a “tuner” or controller that can connect to and override, e.g., the default functionality of an existing brake hold mechanism of a vehicle. Delays in exiting a brake hold state, repetitive actuation of an accelerator to exit a brake hold state, and other shortcomings associated with the conventional operation of brake hold mechanisms may be avoided by taking into account relevant vehicle operating conditions or environmental/road/traffic conditions.Type: GrantFiled: April 26, 2022Date of Patent: March 4, 2025Assignees: TOYOTA RESEARCH INSTITUTE, INC., TOYOTA JIDOSHA KABUSHIKI KAISHAInventors: Yiting Liu, Hirofumi Yamamoto, Chen Bao
-
Patent number: 12240501Abstract: A vehicle system includes one or more sensors configured to capture aspects of an environment and a computing device. The computing device is configured to receive information about the environment captured by the one or more sensors, determine one or more structures within the environment based on the received information, select a kernel that is parameterized for predicting a vehicle trajectory based on the one or more structures determined within the environment, and perform a convolution of the selected kernel and an array defining the environment, wherein the convolution predicts a future trajectory of a vehicle within the environment.Type: GrantFiled: June 24, 2020Date of Patent: March 4, 2025Assignee: Toyota Research Institute, Inc.Inventors: Stephen G. McGill, Paul Drews, Guy Rosman
-
Patent number: 12241746Abstract: Systems and methods are provided for validating a map via automatic test generation for multiple test route subsections. Autonomous vehicles required accurate maps. As such, new maps may be added and/or maps map be updated frequently. Verifying these maps requires testing. Maps may be validated via automatic test generation by obtaining route information identifying a route in the map for an autonomous vehicle. The route may be segmented into multiple test route subsections. Features corresponding to one or more of the test route subsections may be identified. One or more validation tests corresponding to the test route subsections may be generated based on a simulated autonomous vehicle traversing the one or more road features. For example, multiple validation tests for corresponding test route subsections may be generated and executed in parallel.Type: GrantFiled: May 12, 2020Date of Patent: March 4, 2025Assignee: TOYOTA RESEARCH INSTITUTE, INC.Inventor: Chien-Liang Fok
-
Patent number: 12242931Abstract: Systems and methods are provided for implementing soft model assertions (SMA) system and techniques designed to monitor and improve Machine Learning (ML) model quality by to detecting errors within the one or more ML models. SMA techniques and systems are distinctly designed to leverage: 1) a user's ability to specify features over data; and 2) large, existing datasets of organizations, in a manner that can improve the accuracy and quality of predicting potential errors in Machine Learning (ML) models. A SMA system can include a controller device receiving predictions generated based on the ML models and output from the SMA system. The controller performs autonomous operations of the system in response to determining that the one or more detected errors within the one or more ML models yield a high certainty of errors in the predictions. The SMA system also includes a domain specific language and a severity score module.Type: GrantFiled: May 10, 2021Date of Patent: March 4, 2025Assignee: TOYOTA RESEARCH INSTITUTE, INC.Inventors: Daniel D. Kang, Nikos Arechiga Gonzalez, Sudeep Pillai
-
Patent number: 12243260Abstract: A system for producing a depth map can include a processor and a memory. The memory can store a neural network. The neural network can include an encoding portion module, a multi-frame feature matching portion module, and a decoding portion module. The encoding portion module can include instructions that, when executed by the processor, cause the processor to encode an image to produce single-frame features. The multi-frame feature matching portion module can include instructions that, when executed by the processor, cause the processor to process the single-frame features to produce information. The decoding portion module can include instructions that, when executed by the processor, cause the processor to decode the information to produce the depth map. A first training dataset, used to train the multi-frame feature matching portion module, can be different from a second training dataset used to train the encoding portion module and the decoding portion module.Type: GrantFiled: August 2, 2022Date of Patent: March 4, 2025Assignees: Toyota Research Institute, Inc., Toyota Jidosha Kabushiki KaishaInventors: Vitor Guizilini, Rares A. Ambrus, Dian Chen, Adrien David Gaidon, Sergey Zakharov
-
Publication number: 20250071393Abstract: Systems and methods described herein relate to adjusting presentation of media content in a vehicular environment. In one embodiment, a system for adjusting presentation of media content in a vehicular environment estimates a time at which an operational design domain (ODD) boundary will occur for a vehicle that is operating in an at least semi-autonomous driving mode. The system also processes automatically a media-content item presented to an occupant of the vehicle to generate a modified media-content item, the modified media-content item having a duration that results in presentation of the modified media-content item concluding at a predetermined time not later than the estimated time.Type: ApplicationFiled: August 25, 2023Publication date: February 27, 2025Applicants: Toyota Research Institute, Inc., Toyota Jidosha Kabushiki KaishaInventor: Hiroshi Yasuda
-
Publication number: 20250065926Abstract: A method for managing operation of a vehicle includes detecting, while the vehicle is operating, an assistance condition that triggers activation of one or more assistance components of a set of assistance components associated with a driver assistance system, the vehicle having been retrofitted to include an autonomous driving system. The method also includes determining whether the autonomous driving system satisfies a respective safety condition associated with each of the one or more assistance components without activation of the one or more assistance components. The method further includes preventing the one or more assistance components from activating in accordance with determining the autonomous driving system satisfies the safety condition.Type: ApplicationFiled: November 11, 2024Publication date: February 27, 2025Applicant: TOYOTA RESEARCH INSTITUTE, INC.Inventors: Yiting LIU, Hirofumi YAMAMOTO, Chen BAO, Thomas JOHNSTON, Kazunori NIMURA
-
Patent number: 12233970Abstract: Systems, methods, and other embodiments described herein relate to steering a vehicle based on an intended yaw rate during loss of traction. In one arrangement, a method for steering a vehicle during loss of traction is disclosed. The method includes detecting a slipping tire of a vehicle losing traction with a road. The method also includes decoupling control of a pair of front tires of the vehicle by a steering wheel of the vehicle. The method also includes identifying an intended yaw rate for controlling the vehicle by detecting an angle of the steering wheel while the slipping tire does not have traction. The method further includes steering the vehicle separately from an input of a steering wheel of the vehicle to cause intended yaw rate.Type: GrantFiled: January 24, 2023Date of Patent: February 25, 2025Assignees: Toyota Research Institute, Inc., Toyota Jidosha Kabushiki KaishaInventors: Hiroshi Yasuda, Manuel Ludwig Kuehner, Yan Ming Jonathan Goh
-
Patent number: 12234137Abstract: Robots for lifting objects are disclosed. In one embodiment, a robot includes a rail system, a body structure coupled to the rail system, a first arm coupled to a first side of the body structure, one or more first arm actuators providing the first arm with multiple degrees of freedom, a second arm coupled to a second side of the body structure, one or more second arm actuators providing the second arm with multiple degrees of freedom, and a lift actuator operable to move the body structure along the rail system. The one or more first arm actuators and the one or more second arm actuators are operable to wrap the first arm and the second arm around an object and hold the object against the body structure. The lift actuator is operable to move the body structure such that the object is lifted on the rail system.Type: GrantFiled: May 31, 2022Date of Patent: February 25, 2025Assignees: TOYOTA RESEARCH INSTITUTE, INC., TOYOTA JIDOSHA KABUSHIKI KAISHAInventors: Alexander Alspach, Andrew M. Beaulieu, Aimee S. Goncalves
-
Patent number: 12233899Abstract: System, methods, and other embodiments described herein relate to generating a response of a vehicle to a virtual rumble strip. In one embodiment, a method includes determine that a virtual boundary corresponding to a real-world location in proximity of a vehicle has been crossed as the vehicle travels based upon first sensor data generated by the vehicle. The method further includes determine information about an environment of the vehicle as the virtual boundary is crossed based upon second sensor data generated by the vehicle. The method also includes activate an actuator of a seat of the vehicle such that haptic feedback is delivered to the seat, wherein the haptic feedback is based upon the information about the environment and a type of a virtual rumble strip.Type: GrantFiled: March 29, 2022Date of Patent: February 25, 2025Assignee: Toyota Research Institute, Inc.Inventors: Manuel Ludwig Kuehner, Hiroshi Yasuda, Jaime S. Camhi
-
Patent number: 12236688Abstract: A method for tracking occluded objects includes encoding locations of a plurality of objects in an environment, determining a target object, receiving a first end point corresponding to a position of the target object before occlusion behind an occlusion object, distributing a hypothesis between both sides of the occlusion object during occlusion from a subsequent frame of the sequence of frames, receiving a second end point corresponding to a position of the target object after emerging from occlusion from another subsequent frame of the sequence of frames, and determining a trajectory of the target object when occluded by the occlusion object by performing inferences using a spatio-temporal probabilistic graph based on the current frame and the subsequent frames of the sequence of frames. The trajectory of the target object when occluded is used as a learning model for future target objects that are occluded by the occlusion object.Type: GrantFiled: May 6, 2022Date of Patent: February 25, 2025Assignees: Toyota Research Institute, Inc., The Regents of the University of California, Toyota Jidosha Kabushiki KaishaInventors: Pavel Tokmakov, Allan Jabri, Adrien D. Gaidon
-
Patent number: 12236660Abstract: A method for 2D semantic keypoint detection and tracking is described. The method includes learning embedded descriptors of salient object keypoints detected in previous images according to a descriptor embedding space model. The method also includes predicting, using a shared image encoder backbone, salient object keypoints within a current image of a video stream. The method further includes inferring an object represented by the predicted, salient object keypoints within the current image of the video stream. The method also includes tracking the inferred object by matching embedded descriptors of the predicted, salient object keypoints representing the inferred object within the previous images of the video stream based on the descriptor embedding space model.Type: GrantFiled: July 30, 2021Date of Patent: February 25, 2025Assignee: TOYOTA RESEARCH INSTITUTE, INC.Inventors: Haofeng Chen, Arjun Bhargava, Rares Andrei Ambrus, Sudeep Pillai
-
Patent number: 12226893Abstract: A gripping assembly includes a gripping mechanism for engaging an object and an adhesive assembly coupled to the gripping mechanism. The adhesive assembly includes an adhesive sheet and an engagement mechanism operable between an active state and an inactive state. The engagement mechanism deforms the adhesive sheet to contact the object when operated in the active state.Type: GrantFiled: March 10, 2023Date of Patent: February 18, 2025Assignee: Toyota Research Institute, Inc.Inventors: Lukas S. Kaul, Amar Hajj-Ahmad