Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for using differential privacy device bounded contributions. One of the methods includes maintaining, for each time period from a set of time periods, action data for a device; determining whether a current time period satisfies a time period criterion; selecting, using a result of the determination whether the time period criteria is satisfied and from a set of two or more bound generation processes, a bound generation process for the device; computing, using the bound generation process, a bound on an amount of data from the action data and for the device to transmit to a downstream system; selecting, using the action data for the device, a responsive data set with a size defined by the bound; and transmitting, to the downstream system, the responsive data set with the size defined by the bound.
Abstract: A key-value cache management system processes inference requests of a generative model. An inference request requests a starting virtual memory address and a number of layers in the generative model. In response to receiving an inference request, contiguous virtual memory space is reserved for the key-value cache in accordance with the inference request by assigning the starting virtual memory address in the key-value cache and calculating memory pointers for each layer in the model and each block so that the one or more blocks are written sequentially. The generated memory pointers are outputted to the generative model so that each self-attention layer writes computed key-value pairs at physical addresses in the key-value cache specified by the memory pointers.
Abstract: Implementations of camera architectures for combined eye-tracking and outward-tracking are provided. One example includes a near-eye device comprising: a frame comprising an arm; an eye illuminator disposed on the arm of the frame, wherein the eye illuminator is configured to project light to an eye of a user; an imaging system disposed on the arm of the frame, wherein the imaging system comprises: an image sensor; and a color filter array comprising: a first set of filters for allowing the projected light from the eye illuminator to pass; and a second set of filters for allowing visible light to pass; and a lens comprising an optical element for: directing the projected light from the eye illuminator to the eye of the user; and directing light reflected off the eye of the user to the imaging system.