Abstract: An electronic device may receive, at a first system routine from a client application, a provisioning request indicating that the application includes code for evaluating a machine learning model, wherein the first system routine executes in user space of memory on the device. The device may provision the code for execution on one or more of the circuit engines. The device may receive, at a second system routine from the application, an inference request for evaluating the machine learning model containing input data, wherein the second system routine executes in kernel space of memory on the device. The device may receive, at the second system routine, information about the circuit engines. The device may assign the inference request to one or more of the circuit engines where the request is evaluated. The device may provide a result of the inference request to the application.

Abstract: A data stream format for transmission of data frames between a computer and a video client via an interface, the data stream being a plurality of data frames transmitted sequentially, each data frame comprising: a frame header; video data, the video data following the frame header; and audio data, the audio data following the video data.

Abstract: Systems, methods, and devices for dual processing of raw image data by main image processing and alternative image processing capabilities of an electronic device are provided. According to an embodiment, alternative image processing may analyze a first copy of a frame of raw image data before a second copy of the frame of raw image data is processed by main image processing. Thereafter, the main image processing may process the second copy of the frame of raw image. The main image processing may be calibrated based at least in part on the analysis of the first copy of the frame of raw image data.

Abstract: Methods and apparatus that enable a community of devices having differing underlying protocols to stream media data such as video or audio data. In one exemplary embodiment, this invention enables IEEE 1394-compliant (“FireWire” enabled) devices to communicate across an Ethernet infrastructure, such as one enabled by the Ethernet AVB Standard(s). This enhances connectivity, and also supports obviating one or more physical ports within the device(s). In another embodiment, or more wireless transports are utilized.

Abstract: Some embodiments provide a method of processing images for a first camera and a second camera of a mobile device using a shared pipeline. A method receives a first set of images captured by the first camera of the mobile device. The method processes the first set of images using a first configuration of the shared pipeline. The method also receives a second set of images captured by the second camera of the mobile device, and processes the second set of images using a second configuration of the shared pipeline different from the first configuration.

Abstract: Some embodiments provide a method for allowing a first device that is in a video conference with a second mobile device to remotely control the second mobile device. The method sends images captured by a camera of the first device to the second device. The method receives images captured by a camera of the second device. The method sends a command through a communication channel of a real-time communication session to the second device. The command is for instructing the second device to perform an operation that modifies the images captured by the camera of the second device.

Abstract: Methods and apparatus that enable a community of devices having differing underlying protocols to stream media data such as video or audio data. In one exemplary embodiment, this invention enables IEEE 1394-compliant (“FireWire” enabled) devices to communicate across an Ethernet infrastructure, such as one enabled by the Ethernet AVB Standard(s). This enhances connectivity, and also supports obviating one or more physical ports within the device(s). In another embodiment, or more wireless transports are utilized.

Abstract: A method for controlling data transmission between a computer and a video client via an interface, the method comprising: the computer polling the interface a first time to determine the size of the buffer on the interface; receiving a first buffer size value from the interface; sending a plurality of frames of video and audio data to the buffer on the interface such that a delay period exists between the sending of each frame; the computer polling the interface a second time to determine buffer size after the frames are sent to the interface; receiving a second buffer size value from the interface; and modifying the amount of time between the transmission of frames.

Abstract: Methods and apparatus that enable a community of devices having differing underlying protocols to stream media data such as video or audio data. In one exemplary embodiment, this invention enables IEEE 1394-compliant (“FireWire” enabled) devices to communicate across an Ethernet infrastructure, such as one enabled by the Ethernet AVB Standard(s). This enhances connectivity, and also supports obviating one or more physical ports within the device(s). In another embodiment, or more wireless transports are utilized.

Abstract: Methods and apparatus that enable a community of devices having differing underlying protocols to stream media data such as video or audio data. In one exemplary embodiment, this invention enables IEEE 1394-compliant (“FireWire” enabled) devices to communicate across an Ethernet infrastructure, such as one enabled by the Ethernet AVB Standard(s). This enhances connectivity, and also supports obviating one or more physical ports within the device(s). In another embodiment, or more wireless transports are utilized.

Abstract: Systems, methods, and devices for dual processing of raw image data by main image processing and alternative image processing capabilities of an electronic device are provided. According to an embodiment, alternative image processing may analyze a first copy of a frame of raw image data before a second copy of the frame of raw image data is processed by main image processing. Thereafter, the main image processing may process the second copy of the frame of raw image. The main image processing may be calibrated based at least in part on the analysis of the first copy of the frame of raw image data.

Abstract: A technique for applying black level compensation to image data is provided. In one embodiment, an image processing system includes a first image processing pipeline configured to receive frames of image data generated by an image sensor and to alter the frames of image data to compensate for black level shift. The image processing system may also include a feed-forward loop having a second image processing pipeline configured to receive at least one of the frames of image data, to process the at least one frame, and to adjust a black level compensation parameter of the first image processing pipeline. Additional methods, systems, and devices relating to black level compensation are also disclosed.

Abstract: Systems, methods and a computer readable mediums for reducing run-time bandwidth requirements within digital image capture devices are disclosed herein. As the resolution of digital image capture devices increase, the bandwidth needed to support this increased resolution is becoming increasingly difficult to support. To reduce the problems associated with run-time bandwidth requirements, it may be beneficial to obtain full-resolution and display-resolution images at the same time from the image capture circuitry—writing both to memory at virtually the same time. The display resolution image may then be delivered to a display unit directly without the need for additional memory operations on the full-resolution image. Only when a user indicates they wish to capture an image need additional memory operations on the full-resolution image be performed.

Abstract: A technique for applying black level compensation to image data is provided. In one embodiment, an image processing system includes a first image processing pipeline configured to receive frames of image data generated by an image sensor and to alter the frames of image data to compensate for black level shift. The image processing system may also include a feed-forward loop having a second image processing pipeline configured to receive at least one of the frames of image data, to process the at least one frame, and to adjust a black level compensation parameter of the first image processing pipeline. Additional methods, systems, and devices relating to black level compensation are also disclosed.

Abstract: Systems, methods, and devices for dual processing of raw image data by main image processing and alternative image processing capabilities of an electronic device are provided. According to an embodiment, alternative image processing may analyze a first copy of a frame of raw image data before a second copy of the frame of raw image data is processed by main image processing. Thereafter, the main image processing may process the second copy of the frame of raw image. The main image processing may be calibrated based at least in part on the analysis of the first copy of the frame of raw image data.

Abstract: A method for controlling data transmission between a computer and a video client via an interface, the method comprising: the computer polling the interface a first time to determine the size of the buffer on the interface; receiving a first buffer size value from the interface; sending a plurality of frames of video and audio data to the buffer on the interface such that a delay period exists between the sending of each frame; the computer polling the interface a second time to determine buffer size after the frames are sent to the interface; receiving a second buffer size value from the interface; and modifying the amount of time between the transmission of frames.

Abstract: Some embodiments provide a method of processing images for a first camera and a second camera of a mobile device using a shared pipeline. A method receives a first set of images captured by the first camera of the mobile device. The method processes the first set of images using a first configuration of the shared pipeline. The method also receives a second set of images captured by the second camera of the mobile device, and processes the second set of images using a second configuration of the shared pipeline different from the first configuration.

Abstract: Some embodiments provide a method for allowing a first device that is in a video conference with a second mobile device to remotely control the second mobile device. The method sends images captured by a camera of the first device to the second device. The method receives images captured by a camera of the second device. The method sends a command through a communication channel of a real-time communication session to the second device. The command is for instructing the second device to perform an operation that modifies the images captured by the camera of the second device.

Abstract: A method for controlling data transmission between a computer and a video client via an interface, the method comprising: the computer polling the interface a first time to determine the size of the buffer on the interface; receiving a first buffer size value from the interface; sending a plurality of frames of video and audio data to the buffer on the interface such that a delay period exists between the sending of each frame; the computer polling the interface a second time to determine buffer size after the frames are sent to the interface; receiving a second buffer size value from the interface; and modifying the amount of time between the transmission of frames.

Abstract: A method of controlling transmission of data from a computer to a video client via an interface device, comprising: reading a register on the interface device to obtain a value indicating temporal proximity to an occurrence of a vertical blanking interval occurs, the value increased incrementally until a vertical blanking interval occurs, and then being reset; deriving a time value, the time value indicating the occurrence of a vertical blanking interval; sending an interrupt to a processor on the computer at the occurrence of the vertical blanking interval; and invoking code in response to an occurrence of the video blanking interval.