Abstract: An annotation pipeline may be used to produce 2D and/or 3D ground truth data for deep neural networks, such as autonomous or semi-autonomous vehicle perception networks. Initially, sensor data may be captured with different types of sensors and synchronized to align frames of sensor data that represent a similar world state. The aligned frames may be sampled and packaged into a sequence of annotation scenes to be annotated. An annotation project may be decomposed into modular tasks and encoded into a labeling tool, which assigns tasks to labelers and arranges the order of inputs using a wizard that steps through the tasks. During the tasks, each type of sensor data in an annotation scene may be simultaneously presented, and information may be projected across sensor modalities to provide useful contextual information. After all annotation tasks have been completed, the resulting ground truth data may be exported in any suitable format.

Abstract: An annotation pipeline may be used to produce 2D and/or 3D ground truth data for deep neural networks, such as autonomous or semi-autonomous vehicle perception networks. Initially, sensor data may be captured with different types of sensors and synchronized to align frames of sensor data that represent a similar world state. The aligned frames may be sampled and packaged into a sequence of annotation scenes to be annotated. An annotation project may be decomposed into modular tasks and encoded into a labeling tool, which assigns tasks to labelers and arranges the order of inputs using a wizard that steps through the tasks. During the tasks, each type of sensor data in an annotation scene may be simultaneously presented, and information may be projected across sensor modalities to provide useful contextual information. After all annotation tasks have been completed, the resulting ground truth data may be exported in any suitable format.

Abstract: An annotation pipeline may be used to produce 2D and/or 3D ground truth data for deep neural networks, such as autonomous or semi-autonomous vehicle perception networks. Initially, sensor data may be captured with different types of sensors and synchronized to align frames of sensor data that represent a similar world state. The aligned frames may be sampled and packaged into a sequence of annotation scenes to be annotated. An annotation project may be decomposed into modular tasks and encoded into a labeling tool, which assigns tasks to labelers and arranges the order of inputs using a wizard that steps through the tasks. During the tasks, each type of sensor data in an annotation scene may be simultaneously presented, and information may be projected across sensor modalities to provide useful contextual information. After all annotation tasks have been completed, the resulting ground truth data may be exported in any suitable format.

Abstract: An annotation pipeline may be used to produce 2D and/or 3D ground truth data for deep neural networks, such as autonomous or semi-autonomous vehicle perception networks. Initially, sensor data may be captured with different types of sensors and synchronized to align frames of sensor data that represent a similar world state. The aligned frames may be sampled and packaged into a sequence of annotation scenes to be annotated. An annotation project may be decomposed into modular tasks and encoded into a labeling tool, which assigns tasks to labelers and arranges the order of inputs using a wizard that steps through the tasks. During the tasks, each type of sensor data in an annotation scene may be simultaneously presented, and information may be projected across sensor modalities to provide useful contextual information. After all annotation tasks have been completed, the resulting ground truth data may be exported in any suitable format.

Abstract: A method for using an in-message application. The method includes: receiving a broadcast message; identifying, in the broadcast message, a reference to an external data provider; obtaining an identifier of the in-message application from the external data provider; using the identifier to identify a set of components of the in-message application, where placement of the set of components is defined by a visual structure of the in-message application, and where each of the set of components is a user interface (UI) element; associating data obtained from the external data provider with a component of the set of components; and serving the broadcast message and the data to a consumer client, where the consumer client renders the in-message application based on the visual structure.

Abstract: Various embodiments disclose an in-message application facilitating the use of third-party application programming interfaces (APIs). In particular, these in-message applications (referred to as “cards”) may be designed by a developer to access third-party API functionality. A user may then create a message referencing, e.g., a web address associated with the developer's card. The system may receive the user's message and recognize the reference. The system may then distribute an instantiation of the card to various recipients, the instantiation including elements generated using, or providing the user access to, the third party functionality.

Abstract: A method for using an in-message application. The method includes: receiving a broadcast message; identifying, in the broadcast message, a reference to an external data provider; obtaining an identifier of the in-message application from the external data provider; using the identifier to identify a set of components of the in-message application, where placement of the set of components is defined by a visual structure of the in-message application, and where each of the set of components is a user interface (UI) element; associating data obtained from the external data provider with a component of the set of components; and serving the broadcast message and the data to a consumer client, where the consumer client renders the in-message application based on the visual structure.

Abstract: Various embodiments disclose an in-message application facilitating the use of third-party application programming interfaces (APIs). In particular, these in-message applications (referred to as “cards”) may be designed by a developer to access third-party API functionality. A user may then create a message referencing, e.g., a web address associated with the developer's card. The system may receive the user's message and recognize the reference. The system may then distribute an instantiation of the card to various recipients, the instantiation including elements generated using, or providing the user access to, the third party functionality.

Abstract: Various embodiments disclose an in-message application facilitating the use of third-party application programming interfaces (APIs). In particular, these in-message applications (referred to as “cards”) may be designed by a developer to access third-party API functionality. A user may then create a message referencing, e.g., a web address associated with the developer's card. The system may receive the user's message and recognize the reference. The system may then distribute an instantiation of the card to various recipients, the instantiation including elements generated using, or providing the user access to, the third party functionality.

Abstract: A method for using an in-message application. The method includes: receiving a broadcast message; identifying, in the broadcast message, a reference to an external data provider; obtaining an identifier of the in-message application from the external data provider; using the identifier to identify a set of components of the in-message application, where placement of the set of components is defined by a visual structure of the in-message application, and where each of the set of components is a user interface (UI) element; associating data obtained from the external data provider with a component of the set of components; and serving the broadcast message and the data to a consumer client, where the consumer client renders the in-message application based on the visual structure.