Abstract: A depth camera assembly is used to obtain depth information describing a local area. The depth camera assembly includes a sensor having a plurality of pixels. Some or all of the pixels are divided into groups that are coupled to respective multi-purpose time-to-digital converters. Each multi-purpose time-to-digital converter comprises an oscillator and a counter. Each pixel in a group is associated with a multiplexer that is configured to select between inputs coupled to the pixel, the oscillator, or a counter associated with a different pixel. The multiplexer outputs the signal to the counter for the time-to-digital converter associated with the pixel. A time-of-flight measurement is taken during a first portion of an image frame. During a second portion of the image frame, the sensor may be used as an intensity counter. During a third portion of the image frame, the depth sensor may be calibrated.

Abstract: To manufacture a device by picking and placing semiconductor devices from a carrier substrate to a target substrate using touch down sensors, a pick-up head including touch down sensors and the semiconductor devices on the carrier substrate are moved relative to each other to contact the carrier substrate with the touch down sensors. Signals from each touch down sensor indicating a degree of deformation of each touch down sensor caused by the contact with the carrier substrate are used to determine an orientation of the pick-up head by processing the signals, and adjust the orientation of the pick-up head based on the determined orientation to attach the semiconductor devices onto the pick-up head. In some embodiments, the touch down sensors are piezoelectric benders.

Abstract: Determination of an acoustic filter for incorporating local effects of room modes within a target area is presented herein. A model of the target area is determined based in part on a three-dimensional virtual representation of the target area. In some embodiments, the model is selected from a group of candidate models. Room modes of the target area are determined based on a shape and/or dimensions of the model. The room mode parameters are determined based on at least one of the room modes and the position of a user within the target area. The room mode parameters describe an acoustic filter that as applied to audio content, simulates acoustic distortion at the position of the user and at frequencies associated with the at least one room mode. The acoustic filter is generated at a headset based on the room mode parameter and is used to present audio content.

Abstract: A method for providing augmented reality contents to a wearer using a head-mounted display device that includes an eye tracking sensor, a light projector, a beam steerer, and a combiner includes determining, with the eye tracking sensor, a position of a pupil of an eye of the wearer. The method also includes projecting, with the light projector, light for rendering images based at least on the augmented reality contents, and changing, with the beam steerer, a direction of the light from the light projector based on the position of the pupil. The light from the beam steerer is directed toward the combiner and the light from the beam steerer and light from an outside of the head-mounted display device are combined, by the combiner, to provide an overlap of a rendered image and a real image that corresponds to the light from the outside of the head-mounted display device.

Abstract: An optical waveplate is provided. The optical waveplate includes a plurality of liquid crystal (“LC”) layers stacked together. At least one of the plurality of LC layers includes LC molecules that are in-plane switchable by an external field to switch the optical waveplate between states of different phase retardances.

Abstract: The disclosure describes artificial reality systems and techniques for providing artificial reality content to a user. For example, an artificial reality system includes a head-mounted display (HMD) configured to output artificial reality content, the HMD including a set of second image capture devices configured to capture image data indicative of a focal point of a gaze of the user and a varifocal display having a focal length that is modifiable based on the focal point of the user. Additionally, the system includes a depth engine configured to generate, based on the real-world image data and depth data associated with the real-world image data, a three-dimensional (3D) scene of the physical environment of the user and generate artificial reality content as an overlay to the 3D scene of the physical environment for display on the varifocal display of the HMD based on the focal point of the user.

Abstract: In one embodiment, a computing system may determine degradation levels for an array of light emitting elements of a display. The system may determine, based on the degradation levels, a scaling factor for each light emitting element of the array of light emitting elements. The system may access pixel values of an image to be output by the array of light emitting elements of the display. The system may adjust a luminance of each of the pixel values according to the scaling factor associated with the light emitting element configured to output that pixel value. The system may output the adjusted pixel values of the image using the array of light emitting elements.

Abstract: An avatar personalization engine can generate personalized avatars for a user by creating a 3D user model based on one or more images of the user. The avatar personalization engine can compute a delta between the 3D user model and an average person model, which is a model created based on the average measurements from multiple people. The avatar personalization engine can then apply the delta to a generic avatar model by changing measurements of particular features of the generic avatar model by amounts specified for corresponding features identified in the delta. This personalizes the generic avatar model to resemble the user. Additional features matching characteristics of the user can be added to further personalize the avatar model, such as a hairstyle, eyebrow geometry, facial hair, glasses, etc.

Abstract: A method includes a computing system receiving a first-person image that captures an artificial-reality environment from a first-person perspective of a user of a head-mounted device, wherein the first-person image is rendered based on a pose of the head-mounted device. Based on the pose of the head-mounted device, the computing system determines a spectator perspective wherein the spectator perspective and the first-person perspective are co-located in a three-dimensional space and the spectator perspective has a predetermined rotational orientation about a view axis. The computing system generates a spectator image that captures the first-person image from the spectator perspective, and causes the first-person image to be displayed by the head-mounted device and the spectator image to be displayed on a device separate from the head-mounted device.

Abstract: A system for content upsampling comprises a console and a head-mounted display (HMD). The console can select content for presentation and provide the content at a first frame rate. The HMD outputs fast calibration data comprising one or more intermediate estimated positions of a reference point on the HMD. The HMD estimates future positions of the HMD using the fast calibration data, and generates synthetic frames using frames from the content and the future positions of the HMD. The HMD then upsamples the content from the first frame rate to a second frame using the synthetic frames to generate augmented content, wherein the second frame rate is faster than the first frame rate. The HMD presents the augmented content at the second frame rate via an electronic display.

Abstract: Systems and methods are disclosed for implanting a dual-kite aerial vehicle including a first kite apparatus, a second kite apparatus, and a tether extending between the first and second kite apparatuses. In particular, the disclosed systems include a first kite apparatus including a first flight controller that maintains flight at a first altitude. The disclosed system further includes a second kite apparatus including a second flight controller that maintains flight at a second altitude. The flight controllers can cooperatively maintain a gradient air movement between the first and second altitudes by extending or retracting the tether to modify a difference in the air movements between the first and second kite apparatuses. The systems described herein additionally include components for generating electrical energy from the gradient air movement to extend a flight time of the dual-kite aerial vehicle.

Abstract: Systems and techniques are described that enable users to capture and share content through a social network application and/or service with other users. A device associated with a first account may display a camera capture interface including a control associated with a second account and may receive a selection of the control associated with the second account. The device may capture content responsive to the selection and present a preview screen of captured content. The device may receive an indication (e.g., a swipe gesture, selection of a send control, etc.) to perform an action with respect to the captured content, such as sending the captured content to the second account.

Abstract: A head mounted display (HMD) includes an electronic display and a light director assembly. The electronic display includes a region of subpixels that are configured to emit light. The light director assembly is coupled to receive the light and to direct the light to an optical assembly of the HMD. The light director assembly includes a plurality of light directors configured to reduce an angular distribution of the light emitted from corresponding subpixels included in the region of subpixels.

Abstract: The disclosed computer-implemented method may include providing test signals from a panel test board included in a fixture to a device under test included in a carrier including providing interface signals from the panel test board to a connector included on a fixture interposer block included in the fixture, interfacing the connector on the fixture interposer block with one or more pogo pins included on a panel interposer board included in the carrier, the interfacing providing the interface signals as inputs to a re-timer circuit included on the panel interposer board, generating, by the re-timer circuit, output interface signals whose signal strength is greater than a signal strength of the interface signals input to the re-timer circuit, and providing the interface signals output from the re-timer circuit to the device under test. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: This disclosure is directed to enabling access to a game instance through a social network system. A client-side player component facilitates communication between a game instance on the client device and a backend server of a social networking system. The communication information can be stored in or retrieved from a social graph of the social networking system. The game instance can be initialized from a social platform of the social networking system, and the game can be played without leaving a social network application.

Abstract: A media device may include (i) a display device having a front side including a display surface, (ii) a support housing for supporting the display device in each of a plurality of alternative orientations on an external surface, the support housing extending from a back side of the display device between a mounting surface of the support housing abutting the back side of the display device and a distal end of the support housing, (iii) a coupling member disposed at the mounting surface of the support housing and mounted to the display device, and (iv) a battery power supply disposed within the support housing and electrically coupled to the display device via an electrical path extending through the coupling member. Various other systems, devices, assemblies, and methods are also disclosed.

Abstract: Systems, methods, and non-transitory computer readable media can align face images, classify face images, and verify face images by employing a deep neural network (DNN). A 3D-aligned face image can be generated from a 2D face image. An identity of the 2D face image can be classified based on provision of the 3D-aligned face image to the DNN. The identity of the 2D face image can comprise a feature vector.

Abstract: Systems, methods, and non-transitory computer readable media can determine a placement in a camera view for displaying an augmented reality (AR) advertisement, where the camera view is associated with a computing device. An AR advertisement for a user associated with the computing device can be determined based on attributes associated with the user. Display of the AR advertisement can be caused at the determined placement in the camera view.

Abstract: An optical assembly is configured to receive visible scene light at a backside of the optical assembly and to direct the visible scene light on an optical path toward the eyeward side. The optical assembly also includes a dimming layer disposed on the optical path, where the dimming layer includes a photochromic material that is configured to darken in response to exposure to a range of light wavelengths. An activation layer, included in the optical assembly, is also disposed on the optical path and includes an in-field dimmer. The in-field dimmer is configured to selectively emit an activation light within the range of light wavelengths to activate a darkening of a region of the dimming layer to dim the visible scene light within the region.

Abstract: The present disclosure describes methods and systems for handling personally identifiable information. In some implementations, the information is collected during the authentication of identification (ID) documents. The system includes a one-way hashing function that converts unique personal identifiable information into a unique digest. The system can store the digest without having to store the personal identifiable information. Because the hashing function generates the same digest when given the same input, the digests can be used as anonymized identifiers in place of the personal identifiable information.

Abstract: A method including determining a maximum luminance location of a display based on a field of view of an eye of a user of the display, and driving a plurality of light sources in the display based on locations of the plurality of light sources with respect to the maximum luminance location of the display. The plurality of light sources is controlled to have different luminance levels in different display zones corresponding to different zones on the retina of the eye of the user. In some examples, the display zones of the display system that have higher luminance levels can be dynamically changed based on the field of view or the gaze direction of the eye of the user.

Abstract: The disclosed optical lens assemblies may include a deformable optical element including a substantially transparent transducer configured to deform, and thus change at least one optical property of, the deformable optical element. At least a portion of the substantially transparent transducer may be positioned within a substantially transparent optical aperture of the optical lens assembly. Various head-mounted displays incorporating such an optical lens assembly, and methods of fabricating the same, are also disclosed.

Abstract: An optical system includes a substrate and a polarization volume hologram (PVH) composite film formed over the substrate. The PVH composite film includes a first PVH layer formed over the substrate and having a helix twist of a first handedness, and a second PVH layer coupled to the first PVH layer and having a helix twist of a second handedness orthogonal to the first handedness. The first PVH layer is configured to reflect and converge circularly polarized light having the first handedness. The second PVH layer is configured to reflect and converge circularly polarized light having the second handedness.

Abstract: A pupil expander spatially modulates decoupling efficiency of light for pupil steering. The pupil expander can be used in a waveguide display, such as part of an artificial-reality display, to reduce power consumption of an optical source.

Abstract: A computing system may compute estimated depth measurements of at least one physical object in a physical environment surrounding a user. The system may generate, based on the estimated depth measurements, a first model of the at least one physical object. The system may render, based on the first model and a second model of a virtual object, an image depicting the physical object and the virtual object from a perspective of the user. At least one pixel of the image has a blended color corresponding to a portion of the physical object and a portion of the virtual object. The blended color is computed in response to a determination that a relative depth between a portion of the first model corresponding to the portion of the physical object and a portion of the second model corresponding to the portion of the virtual object is within a threshold.

Abstract: Systems and methods for creating and providing transient contextual queues of music through a music service may include (1) providing a user of a device with a music service, (2) detecting a current context of the user, the current context including a characteristic of the user's environment, (3) creating a transient contextual queue of music including music compositions that are tailored to the current context, and (4) playing, via the device one or more music compositions from the transient contextual queue of music while the user is detected to be within the current context. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: An audio system for a headset includes a plurality of speakers and an audio controller. The plurality of speakers may be in a dipole configuration that cancel sound leakage into a local area of the headset. The controller filters audio content presented by the plurality of speakers to further mitigate leakage of audio content into the local area. The audio determines sound filters based on environmental conditions, such as ambient noise levels, as well as based on the audio content being presented.

Abstract: In one embodiment, a computing system may access data samples associated with an access point of a communication network. The data samples may be collected at an application level from client devices associated with the access point and aggregated into data points correlating a first network metric to a traffic-volume metric. The system may partition the data points into a first and second set of data points using a first network metric threshold. The system may determine trends of the traffic-volume metric with respect to the first network metric based on regression analysis on the first and second sets of data points. The system may predict, based on the trends of the traffic-volume metric with respect to the first network metric, an amount of time until a network-capacity metric of the access point meets a traffic-loss threshold. The network-capacity metric may be determined based on the traffic-volume metric.

Abstract: By tiling multiple waveguide displays in an artificial-reality system, and/or using multiple projectors per waveguide display, a large field of view for the artificial-reality system can be achieved using waveguide displays. By using waveguide displays, a form factor for a virtual-reality system can be reduced compared to conventional virtual-reality systems.

Abstract: A method includes placing an optical substrate onto a vacuum mold having a bent contact surface characterized by a surface roughness. The method further includes bending, by an applied bending force, the optical substrate and the protective sheet to cause the protective sheet to come into contact with the bent contact surface of the vacuum mold, generating a vacuum-induced holding force to hold the protective sheet against the bent contact surface of the vacuum mold. After a holding time period, the vacuum-induced holding force is released. During molding, a protective sheet provides a buffer layer between the bent contact surface of the vacuum mold and an optical surface of the optical substrate thereby mitigating against transfer of the surface roughness of the bent contact surface onto the optical surface.

Abstract: A method for providing images to a wearer using a head-mounted display device that includes a light projector and a beam shifter includes projecting, with the light projector, light for rendering images based at least on virtual reality contents and/or augmented reality contents. The method also includes changing, with a beam shifter, a path of the light projected from the light projector based on a position of a pupil of an eye of the wearer.

Abstract: In one embodiment, a computing system may access a first image that is generated at a first frame rate. The system may determine whether a change of a user viewpoint with respect to one or more display contents satisfies a threshold criterion. The system may select an operation mode from a first operation mode and a second operation mode based on the determination whether the change of the user viewpoint satisfies the threshold criterion. The system may generate a number of second images at a second frame rate higher than the first frame rate. When the selected operation mode is the first operation mode, the second images may be generated using a resampling process. When the selected operation mode is the second operation mode, the second images may be generated by transforming one or more previously generated second images that are generated based on the first image.

Abstract: In one embodiment, a computing system may determine network metrics for geographic regions connected by a communication network. The geographic regions may include a geographic region of interest impacted by a network deployment. The system may identify candidate control regions by clustering geographic regions of into a first group based on metric feature of network metric shared by the geographic regions. The system may select control regions by identifying a second group of geographic regions from the first group of geographic regions based on a comparison between the region of interest and each of the first group of geographic regions. The system may compare a first network metric of the geographic region of interest to first a metric baseline determined based on the one or more control regions. The system may determine whether the first network metric has a change greater than a threshold after the network deployment.

Abstract: Disclosed herein are related to a system and a method of authenticating a device. In one aspect, a first challenge is identified from first challenges, where each of the first challenges has a consistent response with a stability above a first threshold across a variation of the device. In one aspect, a first response to the first challenge is received from the device. In one aspect, whether the first response matches the consistent response of the first challenge is determined. In one aspect, a second challenge from second challenges is identified, where each of the second challenges has an inconsistent response with a stability under a second threshold across the variation. In one aspect, a second response to the second challenge is received from the device. In one aspect, the device is authenticated responsive to determining that the first response matches the consistent response of the first challenge.

Abstract: Disclosed herein includes a system, a method, and a device for prioritizing packet retransmission. A transmitting device can insert, for each packet of a plurality of packets of a video frame, a sequence number indicative of an order of the corresponding packet among the plurality of packets, into a header of the corresponding packet according to an application layer protocol. The transmitting device can transmit to the receiving device, at a first level of priority, the plurality of packets including the corresponding inserted sequence numbers. The transmitting device can receive an identification of one or more packets to be retransmitted to the receiving device, the identification based on at least the inserted sequence numbers of the one or more packets. The transmitting device can retransmit the one or more packets at a second level of priority that is higher than the first level of priority.

Abstract: The disclosed head-mounted display assemblies may include a first eyecup and a second eyecup that are configured for positioning in front of intended locations of a user's eyes. The first eyecup and the second eyecup may be movable relative to each other to adjust for an interpupillary distance of the user's eyes. The head-mounted display assemblies may also include a single near-eye display screen configured for displaying an image to the user through the first eyecup and the second eyecup. A flexible shroud may be positioned to provide a seal between a first interior volume of the first eyecup, a second interior volume of the second eyecup, and the single near-eye display screen. Various other methods, devices, systems, and assemblies are also disclosed.

Abstract: The present disclosure relates to systems, non-transitory computer-readable media, and methods for generating and maintaining group messaging threads associated with ephemeral content. For instance, the disclosed systems can facilitate the creation of ephemeral content including a customizable group messaging graphical element associated with the ephemeral content the enables users to join a group messaging thread associated with the ephemeral content. In addition, the disclosed systems can generate user requests to join the group messaging thread based on user interaction with a group messaging graphical element within ephemeral content and can present the requests to the creator of the ephemeral content. Accordingly, in various embodiments, the disclosed systems can facilitate group messaging threads between creators of ephemeral content and users that view the ephemeral content via associated group messaging graphical elements.

Abstract: The present disclosure is directed toward systems and methods for ranking media effects. For example, systems and methods described herein enable a user to select and apply one or more media effects to a media communication such as a digital photograph or video. Systems and methods described herein identify and rank media effects based on characteristics associated with the user and the user's client-computing device. Furthermore, systems and methods described herein automatically present the top-ranked media effects to the user such that the user can easily select and apply one or more media effects that are tailored specifically to the user.

Abstract: In general, this disclosure describes an artificial reality system that provides asymmetric user experiences to users associated with user devices that operate according to different modes of engagement with the artificial reality system. Different user devices may have different capabilities, be used by users having different roles for an artificial reality application, or otherwise be configured to interact in a variety of ways with an artificial reality system.

Abstract: A fluidic device comprises a channel, a gate, and one or more additional elements. The channel is configured to transport a fluid from a source to a drain. The gate includes a chamber with an adjustable volume that affects fluid flow within the channel by displacing a wall of the channel toward an opposite wall of the channel based in part on fluid pressure within the chamber exceeding a threshold pressure. A high pressure state of the gate corresponds to a first chamber size and a first flow rate of the fluid. A low pressure state of the gate corresponds to a second chamber size that is smaller than the first chamber size and a second flow rate that is greater than the first flow rate. The additional elements are configured to reduce the threshold pressure past which the chamber decreases the cross-sectional area of the channel.

Abstract: This disclosure describes a video co-watching system that can efficiently, flexibly, and securely provide access to, and synchronize, co-watching digital video content across multiple participant devices while providing live digital video chat streams between the participant devices. For example, the video co-watching system can enable the participant devices to simultaneously present co-watching digital video content together with a presentation of a video chat. In addition, the video co-watching system can synchronize the co-watching digital video content at each participant device while also facilitating video chatting between the participant devices by transmitting a playback modifier signal to cause one participant device to perform a modification to the playback made at another participant device.

Abstract: Systems, methods, and non-transitory computer-readable media can determine that broadcasting of a live content stream has concluded. The concluded live content stream is converted to a post live media content item. The post live media content item corresponding to the concluded live content stream is published through the social networking system. The post live media content item remains accessible through the social networking system for a pre-determined period of time.

Abstract: A hybrid cornea and pupil eye-tracking technique includes receiving iris-backscattered light from an eye and determining a pupil-position of the eye based on the iris-backscattered light. Cornea-reflected light is received from the eye and an eye-tracking position of the eye is determined based on the cornea-reflected light and the pupil-position.

Abstract: A haptic-jamming device may include (1) a first haptic-jamming member having a polarizable first element rotatable about an axis and a first elongated extension outwardly disposed from the first element in a first direction, (2) a second haptic-jamming member having a second element rotatable about the axis and a second elongated extension outwardly disposed from the second element in a second direction, and (3) a variable voltage source for at least one of the first haptic-jamming member or the second haptic-jamming member that, when energized, generates an electrostatic field encompassing at least one of the first or second elements. A level of separation of the first and second elements may be related to a strength of the electrostatic field. Various other methods, systems, and wearable articles are also disclosed.

Abstract: A system trains models to generate embeddings that represent likelihoods associated with features. For example, an embedding may be generated for users and pages such that a user's embedding represents how likely a user is to comment on a given page. Initially, memory space for storing each embedding may be overprovisioned. The system monitors the embeddings for a feature as they are generated and recalculated over time. If the system detects that a particular index value is never updated for embeddings of that feature, then the system may remove that value from the feature embeddings. This allows the array lengths of embeddings to be customized to the particular features they represent, saving memory space. The system may further use related information to identify pooling functions that are most effective for particular features, to identify similarities between entities, and to provide insight into how the feature data influences neural network layers.

Abstract: A system for providing context sensitive display overlays to a mobile device via a network comprising an overlay datastore, a processor, coupled to the datastore and programmed to receive a request from a mobile device via the network for a list of overlays, determine user context information, search the datastore for overlays matching the user context and provide the list of overlays to the mobile device via the network.

Abstract: The present invention relates to a method for encoding/decoding a quantization coefficient, and to an apparatus using same. The decoding method can include the steps of: decoding initial quantization parameter information and quantization parameter range information of a slice; and obtaining a quantization parameter limitation range applied to an encoding unit included in the slice using the initial quantization parameter information and the quantization parameter range information. Accordingly, the efficiency of encoding and decoding an image can be improved during encoding/decoding.

Abstract: The disclosed microfluidic valves may include a valve body having at least one cavity therein, a gate transmission element separating the cavity into an input gate terminal and an output gate terminal, a gate port configured to convey drive fluid into the input gate terminal, and a fluid channel. The gate transmission element may include a flexible membrane and a plunger coupled to the flexible membrane. The gate transmission element may be configured to move within the cavity to inhibit a subject fluid flow from an inlet port to an outlet port of the fluid channel upon pressurization of the input gate terminal, and to allow subject fluid flow from the inlet port to the outlet port upon depressurization of the input gate terminal. Various other related systems and methods are also disclosed.