Abstract: A deep neural network may be trained on the data of one or more entities, also know as Alices. An outside computing entity, also known as a Bob, may assist in these computations, without receiving access to Alices' data. Data privacy may be preserved by employing a “split” neural network. The network may comprise an Alice part and a Bob part. The Alice part may comprise at least three neural layers, and the Bob part may comprise at least two neural layers. When training on data of an Alice, that Alice may input her data into the Alice part, perform forward propagation though the Alice part, and then pass output activations for the final layer of the Alice part to Bob. Bob may then forward propagate through the Bob part. Similarly, backpropagation may proceed backwards through the Bob part, and then through the Alice part of the network.

Abstract: In one embodiment, a method includes determining if notifications to be sent to user would benefit from being delivered by haptic stimulation under a current context. This determination may be made by accessing historical notification data of how the user previously responded to notifications in a similar context, and ranking conversion scores for each of one or more haptic-enabled delivery channels, wherein a conversion score indicates a probability of the user interacting with the notification. The most appropriate haptic message-delivery channel is selected based on the scores and historical data, and the notification is sent accordingly.

Abstract: A video camera captures images of retroreflection from the retina of an eye. These images are captured while the eye rotates. Thus, different images are captured in different rotational positions of the eye. A computer calculates, for each image, the eye's direction of gaze. In turn, the direction of gaze is used to calculate the precise location of a small region of the retina at which the retroflection occurs. A computer calculates a digital image of a portion of the retina by summing data from multiple retroreflection images. The digital image of the retina may be used for many practical applications, including medical diagnosis and biometric identification. In some scenarios, the video camera captures detailed images of the retina of a subject, while the subject is so far away that the rest of the subject's face is below the diffraction limit of the camera.

Abstract: A sensor may measure light reflecting from a multi-layered object at different times. A digital time-domain signal may encode the measurements. Peaks in the signal may be identified. Each identified peak may correspond to a layer in the object. For each identified peak, a short time window may be selected, such that the time window includes a time at which the identified peak occurs. A discrete Fourier transform of that window of the signal may be computed. A frequency frame may be computed for each frequency in a set of frequencies in the transform. Kurtosis for each frequency frame may be computed. A set of high kurtosis frequency frames may be averaged, on a pixel-by-pixel basis, to produce a frequency image. Text characters that are printed on a layer of the object may be recognized in the frequency image, even though the layer is occluded.

Abstract: A deep neural network may be trained on the data of one or more entities, also know as Alices. An outside computing entity, also known as a Bob, may assist in these computations, without receiving access to Alices' data. Data privacy may be preserved by employing a “split” neural network. The network may comprise an Alice part and a Bob part. The Alice part may comprise at least three neural layers, and the Bob part may comprise at least two neural layers. When training on data of an Alice, that Alice may input her data into the Alice part, perform forward propagation though the Alice part, and then pass output activations for the final layer of the Alice part to Bob. Bob may then forward propagate through the Bob part. Similarly, backpropagation may proceed backwards through the Bob part, and then through the Alice part of the network.

Abstract: A pulsed laser may illuminate a scene that is obscured by dense, dynamic and heterogeneous fog. Light may reflect back to a time-resolved camera. Each pixel of the camera may detect a single photon during each frame. The imaging system may accurately determine reflectance and depth of the fog-obscured target, without any calibration or prior knowledge of the scene depth. The imaging system may perform a probabilistic algorithm that exploits the fact that times of arrival of photons reflected from fog have a Gamma distribution that is different than the Gaussian distribution of times of arrival of photons reflected from the target. The probabilistic algorithm may take into account times of arrival of all types of measured photons, including scattered and un-scattered photons.

Abstract: In one embodiment, a method includes receiving, from a sender node associated with a mesh network, a request to send a message to one or more recipient nodes, the wireless mesh network comprising a plurality of nodes, detecting a triggering condition associated with the wireless mesh network, predicting a routing path from the sender node to each of the one or more recipient nodes via the wireless mesh network through one or more relay nodes of the plurality of nodes based on proximity information and network information associated with the mesh network, and sending the message to the one or more recipient nodes via the one or more relay nodes of the wireless mesh network.

Abstract: In one embodiment, a method includes determining if notifications to be sent to user would benefit from being delivered by haptic stimulation under a current context. This determination may be made by accessing historical notification data of how the user previously responded to notifications in a similar context, and ranking conversion scores for each of one or more haptic-enabled delivery channels, wherein a conversion score indicates a probability of the user interacting with the notification. The most appropriate haptic message-delivery channel is selected based on the scores and historical data, and the notification is sent accordingly.

Abstract: In one embodiment, a method includes receiving a first location of a first client system of a first user and a second location of a second client system of a second user; determining that the first location and the second location are within a threshold proximity; accessing information associated with the first user and the second user to determine a first-user-specific context associated with the first user and a second-user-specific context associated with the second user; determining, based on the first location and the second location and further based on the first-user-specific context and the second-user-specific context, a potential mesh network for connecting the first client system to the second client system; and initiating an agent that is configured to send a communication prompt to the first client system for initiating a communication between the first client system and the second client system.

Abstract: A method includes detecting a proximity event associated with a first user and a second user, wherein the proximity event includes the second user being in geographic proximity to the first user and calculating an influence score associated with the proximity event, wherein the influence score is based at least in part on a social gravity of the second user and a duration of the proximity event. The method further includes, upon determining that the influence score is greater than a threshold score, identifying, based at least in part on a geographic location of the first user, a content object associated with the second user for provision to the first user and sending the content object to a client system associated with the first user for display.

Abstract: A near-eye display (NED) comprises an electronic display, an optical assembly, a scanning assembly, and a controller. The controller generates display instructions based in part on content. The display instructions describe a resolution within an adjustable range of resolutions and a frame rate within adjustable range of frame rates. The electronic display emits a plurality of light rays at the frame rate based on the display instructions. The scanning assembly shifts a direction of at least one of the plurality of light rays in accordance with the display instructions. The optical assembly controls a field of view at an eye box and directs the plurality of light rays including the at least one shifted light ray toward the eye box. The plurality of light rays form a virtual display that displays the content at the resolution and the frame rate.

Abstract: An otoscope may project a temporal sequence of phase-shifted fringe patterns onto an eardrum, while a camera in the otoscope captures images. A computer may calculate a global component of these images. Based on this global component, the computer may output an image of the middle ear and eardrum. This image may show middle ear structures, such as the stapes and incus. Thus, the otoscope may “see through” the eardrum to visualize the middle ear. The otoscope may project another temporal sequence of phase-shifted fringe patterns onto the eardrum, while the camera captures additional images. The computer may subtract a fraction of the global component from each of these additional images. Based on the resulting direct-component images, the computer may calculate a 3D map of the eardrum.

Abstract: A self-reset ADC may take a set of temporally equidistant, modulo samples of a bandlimited, analog signal, at a sampling rate that is greater than ?e samples per second, where ? is Archimedes' constant and is Euler's number. The bandlimited signal may have a bandwidth of 1 Hertz and a maximum frequency of 0.5 Hertz. These conditions of sampling rate, bandwidth and maximum frequency may ensure that an estimated signal may be recovered from the set of modulo samples. This estimated signal may be equal to the bandlimited signal plus a constant. The constant may be equal to an integer multiple of the modulus of the centered modulo operation employed to take the modulo samples.

Abstract: In one embodiment, the artificial reality system determines that a performance metric of an eye tracking system is below a first performance threshold. The eye tracking system is associated with a head-mounted display worn by a user. The artificial reality system receives first inputs associated with the body of a user and determines a region that the user is looking at within a field of view of a head-mounted display based on the received first inputs. The system determines a vergence distance of the user based at least on the first inputs associated with the body of the user, the region that the user is looking at, and locations of one or more objects in a scene displayed by the head-mounted display. The system adjusts one or more configurations of the head-mounted display based on the determined vergence distance of the user.

Abstract: Systems and methods for compensating for at least one optical aberration in a vision system of a viewer viewing a display. Image data for an image to be displayed is received, at least one parameter related to at least one optical aberration in the vision system of a viewer is received and an aberration compensated image to be displayed is computed based on the at least one received parameter related to the vision system of a viewer and on at least one characteristic of the light field element. The aberration compensated image is displayed on the display medium, such that when a viewer whose vision system has the at least one optical aberration views the aberration compensated image displayed on the display medium through a light field element, the aberration compensated image appears to the viewer with the at least one aberration reduced or eliminated.

Abstract: In one embodiment, the artificial reality system determines that a performance metric of an eye tracking system is below a first performance threshold. The eye tracking system is associated with a head-mounted display worn by a user. The artificial reality system receives first inputs associated with the body of a user and determines a region that the user is looking at within a field of view of a head-mounted display based on the received first inputs. The system determines a vergence distance of the user based at least on the first inputs associated with the body of the user, the region that the user is looking at, and locations of one or more objects in a scene displayed by the head-mounted display. The system adjusts one or more configurations of the head-mounted display based on the determined vergence distance of the user.

Abstract: An otoscope may project a temporal sequence of phase-shifted fringe patterns onto an eardrum, while a camera in the otoscope captures images. A computer may calculate a global component of these images. Based on this global component, the computer may output an image of the middle ear and eardrum. This image may show middle ear structures, such as the stapes and incus. Thus, the otoscope may “see through” the eardrum to visualize the middle ear. The otoscope may project another temporal sequence of phase-shifted fringe patterns onto the eardrum, while the camera captures additional images. The computer may subtract a fraction of the global component from each of these additional images. Based on the resulting direct-component images, the computer may calculate a 3D map of the eardrum.

Abstract: A 3D imaging system uses a depth sensor to produce a coarse depth map, and then uses the coarse depth map as a constraint in order to correct ambiguous surface normals computed from polarization cues. The imaging system outputs an enhanced depth map that has a greater depth resolution than the coarse depth map. The enhanced depth map is also much more accurate than could be obtained from the depth sensor alone. In many cases, the imaging system extracts the polarization cues from three polarized images. Thus, in many implementations, the system takes only three extra images—in addition to data used to generate the coarse depth map—in order to dramatically enhance the coarse depth map.

Abstract: Systems and methods for compensating for at least one optical aberration in a vision system of a viewer viewing a display. Image data for an image to be displayed is received, at least one parameter related to at least one optical aberration in the vision system of a viewer is received and an aberration compensated image to be displayed is computed based on the at least one received parameter related to the vision system of a viewer and on at least one characteristic of the light field element. The aberration compensated image is displayed on the display medium, such that when a viewer whose vision system has the at least one optical aberration views the aberration compensated image displayed on the display medium through a light field element, the aberration compensated image appears to the viewer with the at least one aberration reduced or eliminated.

Abstract: For each X-ray path through a tissue, numerous trials are conducted. In each trial, X-ray photons are emitted along the path until a Geiger-mode avalanche photodiode “clicks”. A temporal average—i.e., the average amount of time elapsed before a “click” occurs—is calculated. This temporal average is, in turn, used to estimate a causal intensity of X-ray light that passes through the tissue along the path and reaches the diode. Based on the causal intensities for multiple paths, a computer generates computed tomography (CT) images or 2D digital radiographic images. The causal intensities used to create the images are estimated from temporal statistics, and not from conventional measurements of intensity at a pixel. X-ray dosage needed for imaging is dramatically reduced as follows: a “click” of the photodiode triggers negative feedback that causes the system to halt irradiation of the tissue along a path, until the next trial begins.