Patents by Inventor Magnus GYLLENHAMMAR

Magnus GYLLENHAMMAR has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11983918
    Abstract: The present invention relates to methods and systems that utilize the production vehicles to develop new perception features related to new sensor hardware as well as new algorithms for existing sensors by using federated learning. To achieve this, the production vehicle's own worldview is post-processed and used as a reference, towards which the output of the software (SW) or hardware (HW) under development is compared. In case of a large discrepancy between the baseline worldview and perceived worldview by the module-under-test, the data is weakly annotated by the baseline worldview. Such weakly annotated data may subsequently be used to update the SW parameters of the “perception model” in the module-under-test in each individual vehicle, or to be transmitted to the “back-office” for off-board processing or more accurate annotations.
    Type: Grant
    Filed: February 16, 2022
    Date of Patent: May 14, 2024
    Assignee: ZENSEACT AB
    Inventors: Magnus Gyllenhammar, Carl Zandén, Majid Khorsand Vakilzadeh
  • Publication number: 20240140486
    Abstract: A method for closed-loop evaluation of path planning modules for a vehicle equipped with an Automated Driving System (ADS) is disclosed. The method includes obtaining a candidate path from each of a plurality of path planning modules of the ADS. The method further includes determining a fulfilment of convergence criteria by the obtained candidate paths by comparing the obtained candidate paths with each other and determining a level of convergence between the candidate paths. If the convergence criteria is fulfilled, one of the obtained candidate paths is selected and the vehicle is controlled so to execute the selected candidate path. If the convergence criteria is not fulfilled, determining an exposure need of each path planning module in view of a predicted scene or scenario in the surrounding environment of the vehicle that the vehicle is expected to be exposed to while executing any one of the obtained candidate paths.
    Type: Application
    Filed: October 26, 2023
    Publication date: May 2, 2024
    Inventors: Magnus GYLLENHAMMAR, Carl ZANDÉN, Majid KHORSAND VAKILZADEH
  • Publication number: 20240132106
    Abstract: A method performed by an Automated Driving Systems (ADS) development system for supporting proving fulfilment of safety requirements imposed on ADSs. The ADS development system derives a corresponding set of parameter-specific ADS safe driving policies, each safe driving policy exhibiting a respective uncertainty. The ADS development system identifies at least a first parameter-specific ADS safe driving policy inflicted with an uncertainty fulfilling predeterminable criteria, which criteria filters out uncertainties indicating, respectively, that the corresponding operational parameter needs to be further observed in order to relax the ADS's currently allowed safety requirements-fulfilled ADS safe driving policy. The ADS development system identifies at least a first geographical location exhibiting conditions allowing the operational parameter(s) in need of further observance, to be observed.
    Type: Application
    Filed: October 19, 2023
    Publication date: April 25, 2024
    Inventors: Magnus GYLLENHAMMAR, Fredrik SANDBLOM, Gabriel RODRIGUES DE CAMPOS
  • Publication number: 20240062553
    Abstract: A method for updating a perception function of a vehicle having an Automated Driving System (ADS) is disclosed. The ADS has a self-supervised machine-learning (ML) algorithm for reconstructing an ingested image and a ML algorithm for an in-vehicle perception module for detecting one or more objects or free-space areas depicted in an ingested image. At first, an image of a scene in a surrounding environment of the vehicle is obtained. The obtained image is processed to obtain an output image with one or more detected objects or free-space areas. Then, an evaluation dataset is formed accordingly. The evaluation dataset and the obtained image is processed to obtain a reconstruction error value for each evaluation image and an evaluation image with highest reconstruction error value is selected among plurality of evaluation images. Using the obtained image and the selected evaluation image, the ML algorithm for the in-vehicle perception module is updated.
    Type: Application
    Filed: August 18, 2023
    Publication date: February 22, 2024
    Inventors: Magnus GYLLENHAMMAR, Adam TONDERSKI
  • Patent number: 11897501
    Abstract: An assessment system for performance evaluation and updating of a PMUD of an ego-vehicle. The assessment system obtains world view data from a perception module configured to generate the world view data based on sensor data obtained from vehicle-mounted sensors; obtains other world view data generated by another perception module; forms a joint world view by matching the world view data the other world view data; and obtains perception data based on a perception model and sensor data obtained from one or more vehicle-mounted sensors. The assessment system further matches the perception data to the formed joint world view; evaluates the obtained perception data in reference to the joint world view to determine an estimation deviation in an identified match between the perceptive parameter of the perception data and a corresponding perceptive parameter in the joint world view; and updates parameters of the perception model based on the estimation deviation.
    Type: Grant
    Filed: May 11, 2022
    Date of Patent: February 13, 2024
    Inventors: Magnus Gyllenhammar, Carl Zandén, Majid Khorsand Vakilzadeh
  • Publication number: 20240046790
    Abstract: The present disclosure relates to a method for augmenting capabilities of an Automated Driving System (ADS) of a vehicle. The method includes locally processing, by means of a perception module of the ADS, sensor data obtained from one or more sensors of the vehicle in order to generate a local world-view of the ADS. The sensor data is associated with a time period and includes information about a surrounding environment of the vehicle during the time period. The method further includes generating a local candidate path to be executed by the ADS based on the generated local world-view of the ADS, and transmitting a first set of data to a remote system. The first set of data is associated with the time period and including information about the surrounding environment of the vehicle during the time period.
    Type: Application
    Filed: November 26, 2020
    Publication date: February 8, 2024
    Inventors: Magnus GYLLENHAMMAR, Carl ZANDÉN, Majid KHORSAND VAKILZADEH
  • Publication number: 20240043036
    Abstract: The present disclosure relates to a method for augmenting capabilities of an Automated Driving System (ADS) of a vehicle. The method includes locally processing, by means of a perception module of the ADS, sensor data obtained from one or more sensors of the vehicle in order to generate a local world-view of the ADS, wherein the sensor data includes information about a surrounding environment of the vehicle. The method further includes transmitting sensor data including information about the surrounding environment of the vehicle to a remote system, and receiving off-board processed data from the remote system, the off-board processed data being indicative of a supplementary world-view of the ADS. Furthermore, the method includes forming an augmented world-view of the ADS based on the generated local world-view and the supplementary world-view.
    Type: Application
    Filed: November 26, 2020
    Publication date: February 8, 2024
    Inventors: Magnus GYLLENHAMMAR, Carl ZANDÉN, Majid KHORSAND VAKILZADEH
  • Publication number: 20240010227
    Abstract: A computer-implemented method for updating a perception function of a vehicle having an Automated Driving System (ADS) is disclosed. The ADS has a machine-learning algorithm for: generating an attention map or a feature map based on one or more ingested images and for providing one or more in-vehicle perception functions based on one or more ingested images. The method comprises obtaining one or more images of a scene in a surrounding environment of the vehicle, and updating one or more model parameters of the self-supervised machine-learning algorithm in accordance with a self-supervised machine learning process based on the obtained one or more images. The method further comprises generating a first output comprising an attention map or a feature map by processing the obtained one or more images by using the self-supervised machine-learning algorithm, and generating a supervisory signal for a supervised learning process based on the first output.
    Type: Application
    Filed: July 7, 2023
    Publication date: January 11, 2024
    Inventors: Magnus GYLLENHAMMAR, Adam TONDERSKI
  • Publication number: 20240003704
    Abstract: A method performed by a locations mapping system for supporting identifying locations crucial to a vehicle equipped with an Automated Driving System, ADS. The locations mapping system obtains data of crucial locations of past vehicle situations identified as critical and/or challenging; extracts from the crucial locations data, for at least a first past vehicle situation, static road features and operating conditions pertaining to the at least first past vehicle situation; identifies road segments exhibiting road features to a predeterminable extent matching the static road features pertaining to the at least first past vehicle situation; and generates a mapping associating the identified road segments with said operating conditions. The disclosure also relates to a locations mapping system in accordance with the foregoing, an arrangement, e.g., an offboard system and/or a vehicle comprising such a locations mapping system, and a respective corresponding non-volatile computer readable storage medium.
    Type: Application
    Filed: June 29, 2023
    Publication date: January 4, 2024
    Inventors: Magnus GYLLENHAMMAR, Majid Khorsand VAKILZADEH, Mina ALIBEIGI
  • Publication number: 20230303093
    Abstract: The present disclosure relates to a method performed by a buffer resources prioritizing system for storage prioritization in an event buffer configured to continuously collect operational data of an Automated Driving System, ADS, of a vehicle. The buffer resources prioritizing system obtains sensor data of one or more sensors onboard the vehicle. The buffer resources prioritizing system further determines, at least partly based on the sensor data, current ADS-related operational conditions at least comprising states of vehicle surroundings and internal states of the vehicle. Moreover, the buffer resources prioritizing system determines an upcoming scene predicted to evolve from the current operational conditions. Furthermore, the buffer resources prioritizing system deduces based on assessment of the predicted scene, a storage priority score thereof reflecting predicted relevance of freezing event data of the predicted scene in the event buffer.
    Type: Application
    Filed: March 15, 2023
    Publication date: September 28, 2023
    Inventors: Magnus GYLLENHAMMAR, Majid Khorsand VAKILZADEH
  • Publication number: 20230297845
    Abstract: A computer implemented method and related aspects for updating a perception function of a plurality of vehicles having an Automated Driving System (ADS) are disclosed. The method includes obtaining one or more locally updated model parameters of a self-supervised machine-learning algorithm from a plurality of remote vehicles, and updating one or more model parameters of a global self-supervised machine-learning algorithm based on the obtained one or more locally updated model parameters. Further, the method includes fine-tuning the global self-supervised machine-learning algorithm based on an annotated dataset in order to generate a fine-tuned global machine-learning algorithm comprising one or more fine-tuned model parameters.
    Type: Application
    Filed: March 13, 2023
    Publication date: September 21, 2023
    Inventors: Magnus GYLLENHAMMAR, Adam TONDERSKI
  • Publication number: 20230290199
    Abstract: A method performed by a buffer segment length adjusting system for dynamically adjusting an event segment length of data stored in an event recording buffer of an Automated Driving System, ADS, of a vehicle. The buffer segment length adjusting system obtains sensor data of one or more sensors onboard the vehicle. The buffer segment length adjusting system further identifies, upon the sensor data rendering fulfilment – and/or a state of a software of the ADS rendering fulfilment – of event recording triggering criteria, conditions of a triggering event underlying the fulfilment. The buffer segment length adjusting system determines at least a first current ADS-related operational condition. The buffer segment length adjusting system sets a respective start time point and end time point of - e.g. an event segment length of - the event recording buffer based on the triggering event conditions and the at least first current ADS-related operational condition.
    Type: Application
    Filed: March 6, 2023
    Publication date: September 14, 2023
    Inventors: Magnus GYLLENHAMMAR, Majid Khorsand VAKILZADEH
  • Publication number: 20230286543
    Abstract: The present invention relates to methods and systems for safety and/or performance monitoring of an Automated Driving System (ADS). The method comprises obtaining a plurality of Performance Indicators (PIs) generated by each of a plurality of ADS-equipped vehicles based one or more driving sessions, wherein the plurality of PIs are of at least one PI-type. The method further comprises modelling each PI-type of the obtained PIs based on an Extreme Value Theory (EVT) model, wherein each modelled PI-type is indicative of a probability for exceeding a PI-value for that PI-type, and evaluating each modelled PI-type against a corresponding predefined requirement. Then, if the evaluation fails, determining that the ADS has violated one or more safety or quality requirements, and transmitting a first signal indicative of the violated one or more safety or quality requirements to an ADS management system and/or a second signal to the plurality of ADS-equipped vehicles.
    Type: Application
    Filed: March 10, 2023
    Publication date: September 14, 2023
    Inventors: Magnus GYLLENHAMMAR, Daniel ÅSLJUNG
  • Patent number: 11738776
    Abstract: An apparatus and method performed by a perception comparing system of a vehicle for perception performance evaluation of an ADAS or ADS. The perception comparing system establishes communication with a secondary vehicle determined and/or estimated to be positioned within a potential range of surrounding detecting sensors on-board the vehicle. The system derives perception data from a perception system of the ADAS or ADS. The system receives secondary perception data from a secondary perception system of a secondary ADAS or ADS of the secondary vehicle and determines a discrepancy output based on comparison of at least a portion of the both of perception data and the secondary perception data. The system communicates acknowledgement data when at least a portion of the discrepancy output fulfils discrepancy exceedance criteria and/or when the vehicle is perceivable in the secondary perception data but the secondary vehicle not is locatable in the perception data.
    Type: Grant
    Filed: January 21, 2021
    Date of Patent: August 29, 2023
    Assignee: Zenuity AB
    Inventors: Magnus Gyllenhammar, Majid Khorsand Vakilzadeh, Carl Zandén, Andreas Valencia Falkovén
  • Publication number: 20230090338
    Abstract: The present invention relates to methods and systems for prioritized activation of sensor hardware of a vehicle for development, evaluation, and/or testing of ADS features. The method comprises obtaining data indicative of a set of platform constraints of the vehicle, set of requirements for each of a plurality of ADS features, and a priority scheme for the plurality of ADS features. The method further comprises obtaining data indicative of a predicted scene or scenario in the surrounding environment of the vehicle that the vehicle is expected to be exposed to at a future moment in time. Then, the method comprises generating, based on the platform constraints, the set of requirements, the priority scheme and the predicted scene or scenario, an arbitration signal indicative of a sensor hardware activation and a resource allocation of the platform of the vehicle for at least one of the plurality of ADS features.
    Type: Application
    Filed: September 19, 2022
    Publication date: March 23, 2023
    Inventors: Magnus GYLLENHAMMAR, Carl ZANDÉN, Majid KHORSAND VAKILZADEH
  • Publication number: 20230091986
    Abstract: The present invention relates to methods and systems for allocating platform resources in a vehicle for development, evaluation, and/or testing of ADS features. The method comprises storing, during a time period, sensor data indicative of a surrounding environment of the vehicle in a data storage device of the vehicle, and obtaining data indicative of a set of platform constraints of the vehicle, a set of requirements for each of a plurality of ADS features, a priority scheme for the plurality of ADS features, and a current scene or scenario in the surrounding environment of the vehicle. Furthermore, the method comprises generating, based on the platform constraints, the set of requirements, the priority scheme and the current scene or scenario, an arbitration signal indicative of a resource allocation of the platform of the vehicle to at least one of the plurality of ADS features.
    Type: Application
    Filed: September 19, 2022
    Publication date: March 23, 2023
    Inventors: Magnus GYLLENHAMMAR, Carl ZANDÉN, Majid KHORSAND VAKILZADEH
  • Publication number: 20230071569
    Abstract: The present disclosure describes a method for monitoring operations of an automated driving system (ADS) of a vehicle. For each monitored operation the method includes: determining a geographical position of the vehicle; determining an intended path of the vehicle; and determining one or more intended parameters associated with performing a driving manoeuvre of said vehicle from the determined geographical position along the intended path. For each monitored operation the method further includes: obtaining one or more parameters associated with performing the driving manoeuvre of said vehicle from said determined geographical position; and retrieving, from a statistical model, data indicative of a statistical distribution related to one or more corresponding intended and/or obtained parameters for said intended path.
    Type: Application
    Filed: September 1, 2022
    Publication date: March 9, 2023
    Inventors: Magnus GYLLENHAMMAR, Carl ZANDÉN, Majid KHORSAND VAKILZADEH
  • Publication number: 20220371614
    Abstract: An assessment system for performance evaluation and updating of a PMUD of an ego-vehicle. The assessment system obtains world view data from a perception module configured to generate the world view data based on sensor data obtained from vehicle-mounted sensors; obtains other world view data generated by another perception module; forms a joint world view by matching the world view data the other world view data; and obtains perception data based on a perception model and sensor data obtained from one or more vehicle-mounted sensors. The assessment system further matches the perception data to the formed joint world view; evaluates the obtained perception data in reference to the joint world view to determine an estimation deviation in an identified match between the perceptive parameter of the perception data and a corresponding perceptive parameter in the joint world view; and updates parameters of the perception model based on the estimation deviation.
    Type: Application
    Filed: May 11, 2022
    Publication date: November 24, 2022
    Inventors: Magnus GYLLENHAMMAR, Carl ZANDÉN, Majid Khorsand VAKILZADEH
  • Publication number: 20220350338
    Abstract: The present invention relates to a method and apparatus that utilize production vehicles to develop new path planning features for Automated Driving Systems (ADSs) by using federated learning. To achieve this the “under-test” path planning module's output is evaluated in open-loop in order to produce a cost-function that is subsequently used to update or train a path planning model of the path planning module.
    Type: Application
    Filed: April 26, 2022
    Publication date: November 3, 2022
    Inventors: Magnus GYLLENHAMMAR, Carl ZANDÉN, Majid KHORSAND VAKILZADEH
  • Publication number: 20220350336
    Abstract: The present invention relates to a method and apparatus that utilize production vehicles to develop new path planning features for Automated Driving Systems (ADSs) by using federated learning. To achieve this the “under-test” path planning module's output is evaluated in closed-loop in order to produce a cost-function that is subsequently used to update or train a path planning model of the path planning development-module.
    Type: Application
    Filed: April 26, 2022
    Publication date: November 3, 2022
    Inventors: Magnus GYLLENHAMMAR, Carl ZANDÉN, Majid KHORSAND VAKILZADEH