Abstract: Systems and methods for sensor-agnostic representation of human presence information are described. An operating system of a computing device with a display screen is configured to receive, from a sensor system, human presence information representing the position and posture of one or more persons detected by a sensor of the sensor system, where the human presence information is determined based on a coordinate system associated with the display screen. The human presence information has the same format regardless of the sensor technology. The human presence information includes an elevation angle, an azimuth angle, a face pitch, a face roll, and/or a face yaw of the person relative to the sensor and/or display screen. The operating system may use the human presence information to implement privacy-related features and/or may provide the human presence information to one or more applications via an API.

Abstract: A device receives a sensor payload at a sensor service. The sensor payload includes a data field that comprises a first value that corresponds to a reading by a sensor device. The device sends the sensor payload to a broker process that is separate from the sensor service and that hosts plug-in logic. The device receives a sensor payload update from the broker process. The sensor payload update includes a second value for the data field that is different from the first value. The second value was determined by the plug-in logic. The device creates a modified sensor payload from the sensor payload, including updating the data field to comprise the second value. The device initiates an operating system action based on the modified sensor payload.

Abstract: A device receives a sensor payload at a sensor service. The sensor payload includes a data field that comprises a first value that corresponds to a reading by a sensor device. The device sends the sensor payload to a broker process that is separate from the sensor service and that hosts plug-in logic. The device receives a sensor payload update from the broker process. The sensor payload update includes a second value for the data field that is different from the first value. The second value was determined by the plug-in logic. The device creates a modified sensor payload from the sensor payload, including updating the data field to comprise the second value. The device initiates an operating system action based on the modified sensor payload.

Abstract: A computer system receives a sensor payload from a human presence sensor that is associated with the computer system. The computer system determines, based on an arbitration policy, that the computer system is enabled to perform a particular action based on the priority of the human presence sensor. The arbitration policy determines the priority of the human presence sensor among a plurality of human presence sensors that are associated with the computer system. The computer system triggers the particular action based on the computer system being enabled to perform the particular action based on the content of the sensor payload.

Abstract: The techniques disclosed herein enable systems to perform automatic camera rotation for multi-posture devices (e.g., tablet devices, foldable devices, external displays with built-in webcams) irrespective of a current posture of the computing device. This is accomplished by reformatting an image captured by an image sensor using an image signal processer prior to encoding for output. To reformat the image, the computing device determines an angle of rotation for the computing device relative to a default posture. The image is then rotated based on the angle of rotation such that the image appears right side up for the current posture. Subsequently, the image is cropped from its original aspect ratio to a predetermined aspect ratio. Finally, the image is encoded to generate an output stream that can be received by an application. In this way, the system maintains visual consistency even as a user rotates the device.

Abstract: A method of providing environmental information to an electronic device includes, at the electronic device, receiving ambient light from a surrounding environment of the electronic device with one or more camera sensors in data communication with a processor and capturing a raw pattern with the camera sensor, wherein the raw pattern includes light intensity information and light spectrum information. The method further includes deriving at least one ambient light value from the light intensity information and light spectrum information and providing the ambient light value to the processor of the electronic device.

Abstract: A method of providing environmental information to an electronic device includes, at the electronic device, receiving ambient light from a surrounding environment of the electronic device with one or more camera sensors in data communication with a processor and capturing a raw pattern with the camera sensor, wherein the raw pattern includes light intensity information and light spectrum information. The method further includes deriving at least one ambient light value from the light intensity information and light spectrum information and providing the ambient light value to the processor of the electronic device.