Abstract: Described are examples for providing stream augmenting components. A stream augmenting component having an augmentation function indicating a plurality of interfaces to one or more devices and an output stream can be initialized. At least a portion of the plurality of interfaces for the one or more devices can be accessed to at least one of obtain stream output from the one or more devices or control the one or more devices. A plurality of stream outputs from the one or more devices can be virtualized to the output stream at least in part by modifying or correlating data received over the plurality of stream outputs. The stream augmenting component can output the output stream to one or more other stream augmenting components or applications via at least another portion of the one or more interfaces.

Abstract: In one aspect, a request is sent to a device for a device descriptor that describes custom interfaces. The custom interfaces may be expressed according to a defined data structure. The device descriptor that describes the custom interfaces is received at a gateway. An interface agnostic application is executed to translate the device descriptor to the custom interfaces for consumption of the data described by the custom interfaces.

Abstract: Described are examples for obtaining data from a single stream output. An indication of requested data from multiple stream sources can be received from an application. A single stream output including one or more output frames can be received from a stream server where at least one output frame includes at least data from each of the multiple stream sources. The requested data can be extracted from the single stream output and provided to the application.

Abstract: Described are examples for providing stream augmenting components. A stream augmenting component having an augmentation function indicating a plurality of interfaces to one or more devices and an output stream can be initialized. At least a portion of the plurality of interfaces for the one or more devices can be accessed to at least one of obtain stream output from the one or more devices or control the one or more devices. A plurality of stream outputs from the one or more devices can be virtualized to the output stream at least in part by modifying or correlating data received over the plurality of stream outputs. The stream augmenting component can output the output stream to one or more other stream augmenting components or applications via at least another portion of the one or more interfaces.

Abstract: A computing device includes one or more camera systems, each camera system including software and/or hardware to provide various different camera-related capabilities. The camera system maintains one or more profiles, each profile identifying different capabilities of the camera system that the computing device is configured to use concurrently. The one or more profiles are provided to a program on the computing device, allowing the program to know which capabilities the computing device is configured to use concurrently. If a profile provided by the camera system indicates that the computing device is configured to use certain capabilities concurrently (e.g., capturing images and recording video at certain resolutions), then the program allows a user to select options for using those capabilities concurrently. However, if no such profile exists, the program does not allow a user to select options for using those capabilities concurrently.

Abstract: Aspects of the present disclosure relate to systems and methods for agnostically interpreting data. In one example, a request is sent to a device for a device descriptor that describes custom interfaces. The custom interfaces may be expressed according to a defined data structure. The device descriptor that describes the custom interfaces is received at a gateway. An interface agnostic application is executed to translate the device descriptor to the custom interfaces for consumption of the data described by the custom interfaces.

Abstract: Described are examples for securing stream data received from a stream source. A secure mode can be enabled, based on a request from an application, for storing the stream data captured from the stream source in a secured buffer. The secured buffer can be allocated in a secure memory based at least in part on enabling the secure mode. A secured buffer identifier of the secured buffer can be provided to a driver of a device providing the stream source for storing the stream data captured from the stream source in the secured buffer. The secured buffer identifier of the secured buffer can also be provided to the application for accessing the stream data stored in the secured buffer.

Abstract: Described are examples for providing stream augmenting components. A stream augmenting component having an augmentation function indicating a plurality of interfaces to one or more devices and an output stream can be initialized. One or more functions for the one or more devices to at least one of obtain stream output from the one or more devices or control the one or more devices can be accessed. A plurality of stream outputs from the one or more devices can be virtualized to the output stream at least in part by modifying or correlating data received over the plurality of stream outputs. The output stream can be output to one or more other stream augmenting components or applications.

Abstract: Described are examples for obtaining data from a single stream output. An indication of requested data from multiple stream sources can be received from an application. A single stream output including one or more output frames can be received from a stream server where at least one output frame includes at least data from each of the multiple stream sources. The requested data can be extracted from the single stream output and provided to the application.

Abstract: Memory descriptor list caching and pipeline processing techniques are described. In one or more examples, a method is configured to increase efficiency of buffer usage within a pipeline of a computing device. The method includes creation of a buffer in memory of the computing device and caching of a memory descriptor list by the computing device that describes the buffer in a buffer information cache and has associated therewith a handle that acts as a lookup to the memory descriptor list. The method also includes passing the handle through the pipeline of the computing device for processing of data within the buffer by one or more stages of the pipeline such that access to the data is obtained by the one or more stages by using the handle as the lookup as part of a call to obtain the memory descriptor list for the buffer from the buffer information cache.

Abstract: Described are examples for allocating buffers for multiple components. A stream server can provide an interface to a centralized memory allocator for allocating at least one buffer in a memory to each of the multiple components. The stream server can initialize an instance of the centralized memory allocator based at least in part on a request received from a component of the multiple components via the interface. The stream server can allocate, via the instance of the centralized memory allocator, the at least one buffer for the component in the memory. The stream server can receive, via the instance of the centralized memory allocator, data for storing in the at least one buffer. The stream server can modify the data to generate modified data stored in the at least one buffer.

Abstract: Described are examples for obtaining data from a single stream output. An indication of requested data from multiple stream sources can be received from an application. A single stream output including one or more output frames can be received from a stream server where at least one output frame includes at least data from each of the multiple stream sources. The requested data can be extracted from the single stream output and provided to the application.

Abstract: A computing device includes one or more camera systems, each camera system including software and/or hardware to provide various different camera-related capabilities. The camera system maintains one or more profiles, each profile identifying different capabilities of the camera system that the computing device is configured to use concurrently. The one or more profiles are provided to a program on the computing device, allowing the program to know which capabilities the computing device is configured to use concurrently. If a profile provided by the camera system indicates that the computing device is configured to use certain capabilities concurrently (e.g., capturing images and recording video at certain resolutions), then the program allows a user to select options for using those capabilities concurrently. However, if no such profile exists, the program does not allow a user to select options for using those capabilities concurrently.

Abstract: Described are examples for securing stream data received from a stream source. A secure mode can be enabled, based on a request from an application, for storing the stream data captured from the stream source in a secured buffer. The secured buffer can be allocated in a secure memory based at least in part on enabling the secure mode. A secured buffer identifier of the secured buffer can be provided to a driver of a device providing the stream source for storing the stream data captured from the stream source in the secured buffer. The secured buffer identifier of the secured buffer can also be provided to the application for accessing the stream data stored in the secured buffer.

Abstract: Described are examples for outputting stream data from a plurality of stream sources. A first data stream output for a first stream source and a second data stream output for a second stream source can be received. First data of the first data stream output can be correlated, in time, with second data of the second data stream output. One or more output frames can be output including the first data and the second data as correlated in time.

Abstract: A computing device includes one or more camera systems, each camera system including software and/or hardware to provide various different camera-related capabilities. The camera system maintains one or more profiles, each profile identifying different capabilities of the camera system that the computing device is configured to use concurrently. The one or more profiles are provided to a program on the computing device, allowing the program to know which capabilities the computing device is configured to use concurrently. If a profile provided by the camera system indicates that the computing device is configured to use certain capabilities concurrently (e.g., capturing images and recording video at certain resolutions), then the program allows a user to select options for using those capabilities concurrently. However, if no such profile exists, the program does not allow a user to select options for using those capabilities concurrently.

Abstract: Described are examples for securing stream data received from a stream source. A secure mode can be enabled, based on a request from an application, for storing the stream data captured from the stream source in a secured buffer. The secured buffer can be allocated in a secure memory based at least in part on enabling the secure mode. A secured buffer identifier of the secured buffer can be provided to a driver of a device providing the stream source for storing the stream data captured from the stream source in the secured buffer. The secured buffer identifier of the secured buffer can also be provided to the application for accessing the stream data stored in the secured buffer.

Abstract: Methods and devices for providing notifications for camera resource availability may include receiving requests from a plurality of applications for control of a camera resource. The methods and devices may include providing control of the camera resource to a selected application from the plurality of applications when another application does not have control of the camera resource. The methods and devices may include sending a control notification to one or more applications, including at least one of the plurality of applications indicating that the selected application has control of the camera resource. The methods and devices may include sending an availability notification to the one or more applications, including the at least one of the plurality of applications indicating that the selected application has released the control of the camera resource.

Abstract: Described are examples for allocating buffers for multiple components. A stream server can provide an interface to a centralized memory allocator for allocating at least one buffer in a memory to each of the multiple components. The stream server can initialize an instance of the centralized memory allocator based at least in part on a request received from a component of the multiple components via the interface. The stream server can allocate, via the instance of the centralized memory allocator, the at least one buffer for the component in the memory. The stream server can receive, via the instance of the centralized memory allocator, data for storing in the at least one buffer. The stream server can modify the data to generate modified data stored in the at least one buffer.

Abstract: Memory descriptor list caching and pipeline processing techniques are described. In one or more examples, a method is configured to increase efficiency of buffer usage within a pipeline of a computing device. The method includes creation of a buffer in memory of the computing device and caching of a memory descriptor list by the computing device that describes the buffer in a buffer information cache and has associated therewith a handle that acts as a lookup to the memory descriptor list. The method also includes passing the handle through the pipeline of the computing device for processing of data within the buffer by one or more stages of the pipeline such that access to the data is obtained by the one or more stages by using the handle as the lookup as part of a call to obtain the memory descriptor list for the buffer from the buffer information cache.