Patents by Inventor Kuan-Hsin Lee
Kuan-Hsin Lee has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 12159465Abstract: A method for an end-to-end boundary lane detection system is described. The method includes gridding a red-green-blue (RGB) image captured by a camera sensor mounted on an ego vehicle into a plurality of image patches. The method also includes generating different image patch embeddings to provide correlations between the plurality of image patches and the RGB image. The method further includes encoding the different image patch embeddings into predetermined categories, grid offsets, and instance identifications. The method also includes generating lane boundary keypoints of the RGB image based on the encoding of the different image patch embeddings.Type: GrantFiled: April 14, 2022Date of Patent: December 3, 2024Assignees: TOYOTA JIDOSHA KABUSHIKI KAISHAInventors: Kun-Hsin Chen, Shunsho Kaku, Jie Li, Steven Parkison, Jeffrey M. Walls, Kuan-Hui Lee
-
Patent number: 12148223Abstract: A method for generating a dense light detection and ranging (LiDAR) representation by a vision system includes receiving, at a sparse depth network, one or more sparse representations of an environment. The method also includes generating a depth estimate of the environment depicted in an image captured by an image capturing sensor. The method further includes generating, via the sparse depth network, one or more sparse depth estimates based on receiving the one or more sparse representations. The method also includes fusing the depth estimate and the one or more sparse depth estimates to generate a dense depth estimate. The method further includes generating the dense LiDAR representation based on the dense depth estimate and controlling an action of the vehicle based on identifying a three-dimensional object in the dense LiDAR representation.Type: GrantFiled: April 28, 2022Date of Patent: November 19, 2024Assignees: TOYOTA RESEARCH INSTITUTE, INC., TOYOTA JIDOSHA KABUSHIKI KAISHAInventors: Arjun Bhargava, Chao Fang, Charles Christopher Ochoa, Kun-Hsin Chen, Kuan-Hui Lee, Vitor Guizilini
-
Publication number: 20240363000Abstract: A method for vehicle prediction, planning, and control is described. The method includes separately encoding traffic state information at an intersection into corresponding traffic state latent spaces. The method also includes aggregating the corresponding traffic state latent spaces to form a generalized traffic geometry latent space. The method further includes interpreting the generalized traffic geometry latent space to form a traffic flow map including current and future vehicle trajectories. The method also includes decoding the generalized traffic geometry latent space to predict a vehicle behavior according to the traffic flow map based on the current and future vehicle trajectories.Type: ApplicationFiled: July 11, 2024Publication date: October 31, 2024Applicants: TOYOTA RESEARCH INSTITUTE, INC., TOYOTA JIDOSHA KABUSHIKI KAISHAInventors: Kuan-Hui LEE, Charles Christopher OCHOA, Arun BHARGAVA, Chao FANG, Kun-Hsin CHEN
-
Patent number: 12087063Abstract: System, methods, and other embodiments described herein relate to detection of traffic lights corresponding to a driving lane from views captured by multiple cameras. In one embodiment, a method includes estimating, by a first model using images from multiple cameras, positions and state confidences of traffic lights corresponding to a driving lane of a vehicle. The method also includes aggregating, by a second model, the state confidences and a multi-view stereo composition from geometric representations associated with the positions of the traffic lights. The method also includes assigning, by the second model according to the aggregating, a relevancy score computed for a candidate traffic light of the traffic lights to the driving lane. The method also includes executing a task by the vehicle according to the relevancy score.Type: GrantFiled: April 28, 2022Date of Patent: September 10, 2024Assignees: Toyota Research Institute, Inc., Toyota Jidosha Kabushiki KaishaInventors: Kun-Hsin Chen, Kuan-Hui Lee, Chao Fang, Charles Christopher Ochoa
-
Patent number: 12087579Abstract: A method for forming a semiconductor device includes receiving a substrate having a first opening and a second opening formed thereon, wherein the first opening has a first width, and the second opening has a second width less than the first width; forming a protecting layer to cover the first opening and expose the second opening; performing a wet etching to widen the second opening with an etchant, wherein the second opening has a third width after the performing of the wet etching, and the third width of the second opening is substantially equal to the first width of the first opening; and performing a photolithography to transfer the first opening and the second opening to a target layer.Type: GrantFiled: May 4, 2021Date of Patent: September 10, 2024Assignee: TAIWAN SEMICONDUCTOR MANUFACTURING COMPANY LTD.Inventors: Chung-Yang Huang, Hao-Ming Chang, Ming Che Li, Yu-Hsin Hsu, Po-Cheng Lai, Kuan-Shien Lee, Wei-Hsin Lin, Yi-Hsuan Lin, Wang Cheng Shih, Cheng-Ming Lin
-
Patent number: 12085866Abstract: A photolithographic apparatus includes a particle removing cassette, a pump and a compressor. The particle removing cassette includes a first slit that includes an array of parallel wind blade nozzles arranged along a length of the first slit, protruding from the first slit, and configured to eject and direct pressurized cleaning material to a patterning surface of a mask to remove debris particles on the patterning surface. The pump and the compressor are controlled by a controller to adjust a flow rate and a pressure of the pressurized cleaning material based on an amount of debris particles on the patterning surface of the mask.Type: GrantFiled: May 23, 2023Date of Patent: September 10, 2024Assignee: TAIWAN SEMICONDUCTOR MANUFACTURING COMPANY, LTD.Inventors: Chen-Yang Lin, Da-Wei Yu, Li-Hsin Wang, Kuan-Wen Lin, Chia-Jen Chen, Hsin-Chang Lee
-
Patent number: 12080161Abstract: A method for vehicle prediction, planning, and control is described. The method includes separately encoding traffic state information at an intersection into corresponding traffic state latent spaces. The method also includes aggregating the corresponding traffic state latent spaces to form a generalized traffic geometry latent space. The method further includes interpreting the generalized traffic geometry latent space to form a traffic flow map including current and future vehicle trajectories. The method also includes decoding the generalized traffic geometry latent space to predict a vehicle behavior according to the traffic flow map based on the current and future vehicle trajectories.Type: GrantFiled: April 28, 2022Date of Patent: September 3, 2024Assignees: TOYOTA RESEARCH INSTITUTE, INC., TOYOTA JIDOSHA KABUSHIKI KAISHAInventors: Kuan-Hui Lee, Charles Christopher Ochoa, Arjun Bhargava, Chao Fang, Kun-Hsin Chen
-
Systems and methods for detecting traffic lights of driving lanes using a camera and multiple models
Patent number: 12073633Abstract: System, methods, and other embodiments described herein relate to improving the detection of traffic lights associated with a driving lane using a camera instead of map data. In one embodiment, a method includes estimating, from an image using a first model, depth and orientation information of traffic lights relative to a driving lane of a vehicle. The method also includes computing, using a second model, relevancy scores for the traffic lights according to geometric inferences between the depth and the orientation information. The method also includes assigning, using the second model, a primary relevancy score for a light of the traffic lights associated with the driving lane according to the depth and the orientation information. The method also includes executing a control task by the vehicle according to the primary relevancy score and a state confidence, computed by the first model, for the light.Type: GrantFiled: April 22, 2022Date of Patent: August 27, 2024Assignees: Toyota Research Institute, Inc., Toyota Jidosha Kabushiki KaishaInventors: Kun-Hsin Chen, Kuan-Hui Lee, Chao Fang, Charles Christopher Ochoa -
Patent number: 12046050Abstract: System, methods, and other embodiments described herein relate to accurately distinguishing a traffic light from other illuminated objects in the traffic scene and detecting states using hierarchical modeling. In one embodiment, a method includes detecting, using a machine learning (ML) model, two-dimensional (2D) coordinates of illuminated objects identified from a monocular image of a traffic scene for control adaptation by a control model. The method also includes assigning, using the ML model, computed probabilities to the illuminated objects for categories within a hierarchical ontology of environmental lights associated with the traffic scene, wherein one of the probabilities indicates existence of a traffic light instead of a brake light in the traffic scene. The method also includes executing a task by the control model for a vehicle according to the 2D coordinates and the computed probabilities.Type: GrantFiled: April 15, 2022Date of Patent: July 23, 2024Assignee: Toyota Research Institute, Inc.Inventors: Kun-Hsin Chen, Kuan-Hui Lee, Chao Fang, Charles Christopher Ochoa
-
Patent number: 11144155Abstract: An electronic device adapted to connect to an external device is provided. The electronic device includes an input/output module, a control module, and a touch screen. The control module is electrically connected to the input/output module, and the control module is configured to send a request signal through the input/output module and receive set information corresponding to the request signal through the input/output module. The touch screen is electrically connected to the control module. When the touch screen generates a touch signal in response to a touch behavior, the control module converts the touch signal to a control signal based on the set information, and sends the control signal through the input/output module.Type: GrantFiled: November 15, 2019Date of Patent: October 12, 2021Assignee: ASUSTEK COMPUTER INC.Inventors: Yu-Sheng Lin, Kuan-Hsin Lee
-
Publication number: 20200174615Abstract: An electronic device adapted to connect to an external device is provided. The electronic device includes an input/output module, a control module, and a touch screen. The control module is electrically connected to the input/output module, and the control module is configured to send a request signal through the input/output module and receive set information corresponding to the request signal through the input/output module. The touch screen is electrically connected to the control module. When the touch screen generates a touch signal in response to a touch behavior, the control module converts the touch signal to a control signal based on the set information, and sends the control signal through the input/output module.Type: ApplicationFiled: November 15, 2019Publication date: June 4, 2020Inventors: Yu-Sheng Lin, Kuan-Hsin Lee