Patents by Inventor Frank Permenter
Frank Permenter has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240378348Abstract: Systems and methods described herein relate to estimating vehicle physical-design parameters from image data. In one embodiment, a system that estimates vehicle physical-design parameters receives one or more images representing a physical design of a vehicle. The system also processes the one or more images using a machine-learning-based model that includes a pre-trained feature extractor whose output layer has been replaced with a regression layer. The regression layer, after the regression layer has replaced the output layer, is trained to output an estimate of a physical-design parameter of the vehicle whose physical design is represented by the one or more images. The physical design of the vehicle is modified based, at least in part, on the estimate of the physical-design parameter.Type: ApplicationFiled: August 9, 2023Publication date: November 14, 2024Applicants: Toyota Research Institute, Inc., Toyota Jidosha Kabushiki KaishaInventors: Chenyang Yuan, Nikos Arechiga Gonzalez, Frank Permenter
-
Publication number: 20240378797Abstract: Systems, methods, and other embodiments described herein relate to altering an image and propagating changes to other images of the same object using a diffusion model. In one embodiment, a method includes acquiring object images depicting an object. The method includes, responsive to altering one of the object images into an edited image, adapting the object images to reflect changes in the edited image by iteratively applying a diffusion model to the object images until satisfying a consistency threshold. The method includes providing the object images to represent an edited version of the object.Type: ApplicationFiled: September 28, 2023Publication date: November 14, 2024Applicants: Toyota Research Institute, Inc., Toyota Jidosha Kabushiki KaishaInventors: Chenyang Yuan, Nikos Arechiga Gonzalez, Frank Permenter
-
Publication number: 20240378349Abstract: Systems, methods, and other embodiments described herein relate to generating vehicle design using a diffusion model. In one embodiment, a method includes generating an image based on a reference image and a text description of the reference image using a diffusion model. The method includes, based on whether the image meets a predetermined constraint, generating an intermediate image based on the image and the predetermined constraint using an analysis model such that the intermediate image is incrementally closer to meeting the predetermined constraint than the image, regenerating the image based on the intermediate image using the diffusion model, and outputting the image.Type: ApplicationFiled: August 17, 2023Publication date: November 14, 2024Applicants: Toyota Research Institute, Inc., Toyota Jidosha Kabushiki KaishaInventors: Chenyang Yuan, Nikos Arechiga Gonzalez, Frank Permenter
-
Publication number: 20240378350Abstract: Systems, methods, and other embodiments described herein relate to generating vehicle design using a diffusion model. In one embodiment, a method includes generating a plurality of images based on a textual artistic guidance and a numerical constraint using a diffusion model.Type: ApplicationFiled: August 17, 2023Publication date: November 14, 2024Applicants: Toyota Research Institute, Inc., Toyota Jidosha Kabushiki KaishaInventors: Chenyang Yuan, Nikos Arechiga Gonzalez, Frank Permenter
-
Publication number: 20240378351Abstract: Systems, methods, and other embodiments described herein relate to shape optimization using a diffusion model. In one embodiment, a method includes optimizing a parameter of a shape in an image based on a predetermined constraint using a diffusion model. The parameter is a pixel value for each pixel forming the shape.Type: ApplicationFiled: August 17, 2023Publication date: November 14, 2024Applicants: Toyota Research Institute, Inc., Toyota Jidosha Kabushiki KaishaInventors: Chenyang Yuan, Nikos Arechiga Gonzalez, Frank Permenter
-
Patent number: 11918535Abstract: Systems and methods for a powered, robotic exoskeleton, or exosuit, for a user's limbs and body are provided. The exosuit may be equipped with airbag devices mounted at various locations on the suit. The exosuit may include on-board computing equipment that can sense, compute control commands in real-time, and actuate limbs and airbags to restore stability (fall prevention) and minimize injuries due to falls, should they happen (fall protection).Type: GrantFiled: April 13, 2020Date of Patent: March 5, 2024Assignee: TOYOTA RESEARCH INSTITUTE, INC.Inventors: Jonathan Decastro, Soon Ho Kong, Nikos Arechiga Gonzalez, Frank Permenter, Dennis Park
-
Patent number: 11801852Abstract: A method performed by an autonomous vehicle includes identifying a condition preventing the autonomous vehicle from proceeding along an intended route. The method also includes prompting a passenger of the autonomous vehicle to interact with a driver of a first vehicle in response to identifying the condition. The method further includes receiving, from the passenger, an input at an interface of the autonomous vehicle indicating a successful interaction or an unsuccessful interaction with the driver. The method also includes controlling the autonomous vehicle to proceed along the intended route based on the input indicating the successful interaction with the driver.Type: GrantFiled: June 23, 2021Date of Patent: October 31, 2023Assignee: TOYOTA RESEARCH INSTITUTE, INC.Inventors: Soonho Kong, Jonathan Decastro, Nikos Arechiga, Frank Permenter
-
Patent number: 11543258Abstract: A personalized notification method for a mobility as a service (MaaS) vehicle includes receiving conditional personalized notification features from a passenger of the MaaS vehicle. The method also includes monitoring current driving environment of the MaaS vehicle to determine whether a condition of the conditional personalized notification features is satisfied. The method further includes notifying the passenger when the condition is satisfied via at least one localized output device in a compartment of the MaaS vehicle.Type: GrantFiled: May 15, 2019Date of Patent: January 3, 2023Assignee: TOYOTA RESEARCH INSTITUTE, INC.Inventors: Soon Ho Kong, Jonathan Decastro, Nikos Arechiga Gonzalez, Frank Permenter
-
Patent number: 11518408Abstract: A driver monitor system and method for predicting impairment of a user of a vehicle. The system includes video cameras, an input device for inputting a list of medications being taken by the driver. Processing circuitry predicts side effects of the medications based on the half-life of the medication, detecting eye gaze movement, eye lid position, and facial expression of the user using images from the video camera, predicting whether the user is transitioning into an impaired physical state that is a side effect of the medications, verifying the side effect of the medications, determining whether the user is fit to drive using the verified side effects of the medications, and outputting to the vehicle an instruction to operate the vehicle in a level of automation that makes up for the at least one side effect or to perform a safe pull over operation of the vehicle.Type: GrantFiled: November 13, 2020Date of Patent: December 6, 2022Assignee: TOYOTA RESEARCH INSTITUTE, INC.Inventors: Nikos Arechiga-Gonzalez, Soonho Kong, Jonathan Decastro, Frank Permenter, Dennis Park
-
Patent number: 11479239Abstract: Aspects of the disclosure provide a parking method and system for a vehicle. For example, the parking system can include a processor and an output circuit. As another example, the parking system can include the processor and a compelling unit. The processor can be configured to determine whether a first weather condition, such as snowing, raining, icing and hailing, at a first parking location meets a first criterion, and identify, when the first weather condition meets the first criterion, a second parking location at which a second weather condition meets a second criterion different from the first criterion. The output unit can be configured to output an alert to the vehicle parked at the first parking location indicating that the vehicle is to be moved to the second parking location. The compelling unit can be configured to compel the vehicle to move to the second parking location.Type: GrantFiled: November 13, 2020Date of Patent: October 25, 2022Assignee: TOYOTA RESEARCH INSTITUTE, INC.Inventors: Nikos Arechiga-Gonzalez, Soonho Kong, Jonathan Decastro, Frank Permenter, Dennis Park
-
Patent number: 11256611Abstract: A method for synthesizing parameters for control of a closed loop system based on a differentiable simulation model of the closed loop system includes determining requirements/specifications for the closed loop system in signal temporal logic (STL). The method also includes selecting a parametric control law having a differentiable parameter control function. The method also includes converting the requirements in signal temporal logic into differentiable computational graph. The method further includes building the differentiable simulation model as a differentiable computational graph. Furthermore, the method includes automatically learning values of parameters for the differentiable parameter control function of the closed loop system by backpropagating an error.Type: GrantFiled: May 29, 2019Date of Patent: February 22, 2022Assignees: TOYOTA RESEARCH INSTITUTE, INC., THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITYInventors: Nikos Arechiga Gonzalez, Karen Y. Leung, Soon Ho Kong, Jonathan Decastro, Frank Permenter
-
Patent number: 11072342Abstract: A method for controlling an autonomous vehicle includes navigating the autonomous vehicle based on a set of rules. The method also includes identifying an abnormality in a current driving situation. The method further includes prompting a passenger of the autonomous vehicle to interact with a driver of a first vehicle in response to identifying the abnormality. The method still further includes controlling the autonomous vehicle to violate one or more rules of the set of rules in response to an indication of a successful interaction with the driver.Type: GrantFiled: February 19, 2019Date of Patent: July 27, 2021Assignee: TOYOTA RESEARCH INSTITUTE, INC.Inventors: Soonho Kong, Jonathan DeCastro, Nikos Arechiga, Frank Permenter
-
Publication number: 20200363229Abstract: A personalized notification method for a mobility as a service (MaaS) vehicle includes receiving conditional personalized notification features from a passenger of the MaaS vehicle. The method also includes monitoring current driving environment of the MaaS vehicle to determine whether a condition of the conditional personalized notification features is satisfied. The method further includes notifying the passenger when the condition is satisfied via at least one localized output device in a compartment of the MaaS vehicle.Type: ApplicationFiled: May 15, 2019Publication date: November 19, 2020Inventors: Soon Ho Kong, Jonathan Decastro, Nikos Arechiga Gonzalez, Frank Permenter
-
Patent number: 10621858Abstract: System, methods, and other embodiments described herein relate to improving situational awareness of a user. In one embodiment, a method includes, in response to acquiring, in a personal device, sensor data from a set of sensors that perceive a surrounding environment of the user, identifying from the sensor data one or more objects in the surrounding environment relative to the user. The method includes determining a threat to the user from the one or more objects according to at least trajectories of the one or more objects embodied in the sensor data. The method includes generating, via the personal device, an indicator to inform the user of the one or more objects according to the threat.Type: GrantFiled: February 6, 2019Date of Patent: April 14, 2020Assignee: Toyota Research Institute, Inc.Inventors: Jonathan DeCastro, Frank Permenter, Soonho Kong, Nikos Arechiga Gonzalez
-
Publication number: 20150066780Abstract: Among other things, contributors (also called teammates) can form teams to cooperatively create original media using electronic communication with a server. The cooperative creation of the original media occurs as a project and as working sessions within a project, defined within a user interface accessible to each of the contributors of the team. The contributors can communicate through the user interface. Security is provided against access by any other party to the original media and the process of cooperatively creating it.Type: ApplicationFiled: September 24, 2013Publication date: March 5, 2015Inventors: Philip James Cohen, James Christopher Dorsey, Frank Permenter