Abstract: A system includes processing hardware and a memory storing software code. When executed, the software code receives first skeleton data including a first location of each of multiple skeletal key-points from the perspective of a first camera, receives second skeleton data including a second location of each of the skeletal key-points from the perspective of a second camera, correlates first and second locations of some or all of the multiple skeletal key-points to produce correlated skeletal key-point location data for each of at least some skeletal key-points. The software code further merges the correlated skeletal key-point location data for each of those at least some skeletal key-points to provide merged location data, and generates, using the merged location data and the locations of the first, second, and third cameras, a mapping of the 3D pose of a skeleton.

Abstract: A system includes a computing platform having processing hardware, one or more sensor(s), and a memory storing perception software and animation software, as well as an augmented reality (AR) headset including another processing hardware. The computing platform is configured to obtain an environmental data using the sensor(s), determine the location and orientation of the AR headset using the perception software and the environmental data, identify an action for execution by the computing platform, using the animation software and the location and orientation of the AR headset, and transmit performative data corresponding to the identified action to the AR headset. The AR headset is configured to receive, from the computing platform, the performative data, and to render at least one AR effect corresponding to the identified action using the performative data.

Abstract: A system for performing automated multi-persona response generation includes processing hardware, a display, and a memory storing a software code. The processing hardware executes the software code to receive input data describing an action and identifying a multiple interaction profiles corresponding respectively to multiple participants in the action, obtain the interaction profiles, and simulate execution of the action with respect to each of the participants. The processing hardware is further configured to execute the software code to generate, using the interaction profiles, a respective response to the action for each of the participants to provide multiple responses. In various implementations, one or more of those multiple responses may be used to train additional artificial intelligence (AI) systems, or may be rendered to an output device in the form of one or more of a display, an audio output device, or a robot, for example.

Abstract: A method to project content from a moving projector. The method includes analyzing an object to identify a projection surface; determining a first position of a projector relative to the projection surface; modifying a first frame of a content for projection onto the projection surface based on the projection surface and the first position of the projector; projecting the first frame of the content from the projector onto the projection surface; determining a second position of the projector relative to the projection surface; modifying a second frame of the content based on the projection surface and the second position; and projecting the second frame of the content from the projector onto the projection surface.

Abstract: A system includes a computing platform having processing hardware, one or more sensor(s), and a memory storing perception software and animation software, as well as an augmented reality (AR) headset including another processing hardware. The computing platform is configured to obtain an environmental data using the sensor(s), determine the location and orientation of the AR headset using the perception software and the environmental data, identify an action for execution by the computing platform, using the animation software and the location and orientation of the AR headset, and transmit performative data corresponding to the identified action to the AR headset. The AR headset is configured to receive, from the computing platform, the performative data, and to render at least one AR effect corresponding to the identified action using the performative data.

Abstract: A method to project content from a moving projector. The method includes analyzing an object to identify a projection surface; determining a first position of a projector relative to the projection surface; modifying a first frame of a content for projection onto the projection surface based on the projection surface and the first position of the projector; projecting the first frame of the content from the projector onto the projection surface; determining a second position of the projector relative to the projection surface; modifying a second frame of the content based on the projection surface and the second position; and projecting the second frame of the content from the projector onto the projection surface.

Abstract: An interactive autonomous robot is configured for deployment within a social environment. The disclosed robot includes a show subsystem configured to select between different in-character behaviors depending on robot status, thereby allowing the robot to appear in-character despite technical failures. The disclosed robot further includes a safety subsystem configured to intervene with in-character behavior when necessary to enforce safety protocols. The disclosed robot is also configured with a social subsystem that interprets social behaviors of humans and then initiates specific behavior sequences in response.

Abstract: A system includes processing hardware and a memory storing software code. When executed, the software code receives first skeleton data including a first location of each of multiple skeletal key-points from the perspective of a first camera, receives second skeleton data including a second location of each of the skeletal key-points from the perspective of a second camera, correlates first and second locations of some or all of the multiple skeletal key-points to produce correlated skeletal key-point location data for each of at least some skeletal key-points. The software code further merges the correlated skeletal key-point location data for each of those at least some skeletal key-points to provide merged location data, and generates, using the merged location data and the locations of the first, second, and third cameras, a mapping of the 3D pose of a skeleton.

Abstract: A system for providing a situationally aware social agent includes processing hardware and a memory storing a software code. The processing hardware executes the software code to receive radar data and audio data, process the radar data and the audio data to obtain radar-based location data and audio-based location data each corresponding to a location of one or more user(s), and process the radar data and the audio data to obtain radar-based venue data and audio-based venue data each corresponding to an environment surrounding the user(s). The software code further determines, using the radar-based location data and the audio-based location data, the location of the user(s), determines, using the radar-based venue data and the microphone-based venue data, the environment surrounding the user(s), and identifies, based on the location and the environment, an interactive expression for use by the situationally aware social agent to interact with the user(s).

Abstract: A transparent face mask for enhancing communications while controlling release of respiratory droplets. The mask includes a body formed from a thin flexible plastic material such as polypropylene. The mask body has a center diamond shaped segment that cantilevers the mask body from the bridge of a wearer's nose. The body includes right and left side segments, which each extend outward from one of the four sides of a diamond-shaped center segment to form a segment-to-segment joint between adjacent side segment pairs that flexibly conforms the side portions to the wearer's face. The face mask includes risers formed of an elongate strip of flexible material with a cloth covering for comfort and ease of fit, and the risers each provides a contact point between the mask and the wearer's face adjacent to and inward of the ear from which the mask body is cantilevered away from the wearer's face.

Abstract: Embodiments provide for perceptual data association from at least a first and a second sensor disposed at different positions in an environment, in respective series of local scene graphs that identify characteristics of objects in the environment that are updated asynchronously and merging the series of local scene graphs to form a coherent image of the environment from multiple perspectives.

Abstract: Embodiments provide for perceptual data association from at least a first and a second sensor disposed at different positions in an environment, in respective series of local scene graphs that identify characteristics of objects in the environment that are updated asynchronously and merging the series of local scene graphs to form a coherent image of the environment from multiple perspectives.

Abstract: Embodiments provide for perceptual data association received from at least a first and a second sensor disposed at different positions in an environment, in respective time series of local scene graphs that identify several characteristics of at least one object in the environment that are updated different rates; merging, at an output rate, characteristics for each given object from the several time series of local scene graphs that are updated at the output rate; merging, at the output rate, characteristics for each given object from the time series of local scene graphs that are updated at rates other than the output rate; and outputting, at the output rate, a time series of global scene graphs including the merged characteristics.

Abstract: An interactive autonomous robot is configured for deployment within a social environment. The disclosed robot includes a show subsystem configured to select between different in-character behaviors depending on robot status, thereby allowing the robot to appear in-character despite technical failures. The disclosed robot further includes a safety subsystem configured to intervene with in-character behavior when necessary to enforce safety protocols. The disclosed robot is also configured with a social subsystem that interprets social behaviors of humans and then initiates specific behavior sequences in response.