Abstract: The present disclosure includes systems and methods for touch sensing. An electronic device includes a resistive sheet that is optically transmissive, a number of electrodes electrically coupled to the resistive sheet, the electrodes disposed at an edge of the resistive sheet and spaced apart at predetermined intervals, and a processor coupled to the number of electrodes. The processor is configured to generate, at a first of the electrodes, a first drive signal, generate, at a second of the electrodes, a second drive signal, each drive signal having a different frequency, measure an output of at least one of the electrodes, and determine, based on the output, a location of a touch input on the resistive sheet.

Abstract: In one embodiment, a method includes presenting to a user, on a display of a head-worn client computing device, a three-dimensional video including images of a real-life scene that is remote from the user's physical environment. The method also includes presenting to the user, on the display of the head-worn client computing device, a graphical object including an image of the user's physical environment or a virtual graphical object.

Abstract: An apparatus and method for a user-aware remote control for a shared device, such as a computing device, is provided herein. The computing device includes a transceiver and a processor. The transceiver is configured to communicate with a remote control. The processor is configured to: receive, from the remote control, identification data for a user of the computing device, the identification data for the user being generated at the remote control based on biometric information associated with the user received at the remote control; identify, based on the identification data, at least one application associated with the user; retrieve, based on the identification data, personalized application information associated with the user and applicable to the at least one application; and apply the personalized application information to the at least one application.

Abstract: In one embodiment, an electrical device may inject one or more first electrical signals into a resistive layer of a touch sensor. The device may receive one or more second electrical signals each corresponding to a first electrical signal injected by a first electrode. The device may determine, based on the one or more second electrical signals, a vector with each element of the vector corresponding to a value associated with a particular second electrical signal. Each element may depend at least on: a relative location between the first electrode injecting the first electrical signal and a second electrode receiving the second electrical signal, the signal frequency, and a user touch location on the touch sensor. The device may determine the user touch location based on the vector using at least one of a lookup table, a curve-fitting coefficient set, or a machine-learning model.

Abstract: In one embodiment, a method includes generating, at a multi-view display, a first content to be viewed at a first angle and a second content to be viewed at a second angle. The first content and the second content are displayed simultaneously. The method also includes receiving, at a touch-screen panel coupled to the multi-view display, a first plurality of capacitive signals. The method then generates, by the touch-screen panel, a first touch-screen panel heatmap based on the received first plurality of capacitive signals. The method afterwards determines, based on the first touch-screen panel heatmap, whether a first user input is received with respect to the first content or the second content. The method then assigns, based on determining the first user input corresponds to either the first content or the second content, the first user input to the first content or the second content.

Abstract: A system and method enable an electronic device to perform gaze or focal tracking operations. The electronic device includes a processor and a display screen. The processor is configured to in response to determining at least one of: a gaze of the user or a focal point of the eye of the user, control at least one of: an operation of the electronic device, or a focal point of an adjustable lens. The display screen is coupled to the processor, and configured to present an image of an object based on at least one of the gaze of the user or the focal point of the eye.

Abstract: In one embodiment, a method includes generating, at a multi-view display, a first content to be viewed at a first angle and a second content to be viewed at a second angle. The first content and the second content are displayed simultaneously. The method also includes receiving, at a touch-screen panel coupled to the multi-view display, a first plurality of capacitive signals. The method then generates, by the touch-screen panel, a first touch-screen panel heatmap based on the received first plurality of capacitive signals. The method afterwards determines, based on the first touch-screen panel heatmap, whether a first user input is received with respect to the first content or the second content. The method then assigns, based on determining the first user input corresponds to either the first content or the second content, the first user input to the first content or the second content.

Abstract: In one embodiment, an electrical device may inject one or more first electrical signals into a resistive layer of a touch sensor. The device may receive one or more second electrical signals each corresponding to a first electrical signal injected by a first electrode. The device may determine, based on the one or more second electrical signals, a vector with each element of the vector corresponding to a value associated with a particular second electrical signal. Each element may depend at least on: a relative location between the first electrode injecting the first electrical signal and a second electrode receiving the second electrical signal, the signal frequency, and a user touch location on the touch sensor. The device may determine the user touch location based on the vector using at least one of a lookup table, a curve-fitting coefficient set, or a machine-learning model.

Abstract: A system and method for a hybrid multimode input device includes a multimode input device capable of a two-dimensional (2D) mode of operation and a three-dimensional (3D) mode of operation. The device includes a two-dimensional (2D) position sensor, a three-dimensional (3D) position sensor, and a processor. The processor is configured to enter a 3D input mode when the processor detects that the input device is in a first orientation, and enter a 2D input mode when the processor detects that the input device is in a second orientation. The 2D input mode is configured to provide 2D position data to a connected computer system, and wherein the 3D input mode is configured to provide 3D position data to the connected computer system.

Abstract: A method for controlling content rendering by a multi-view, directionally dependent display includes defining a first display as a first pixel of a pixelated array of the multi-view display, the first display associated with a first viewing angle relative to a first axis; and defining a second display as a second pixel of the pixelated array, the second display. The method includes controlling chromatic properties of the first pixel by applying a filter based on a rendering of first content to be displayed. The method also includes controlling chromatic properties of the second pixel by applying a filter based on a rendering of second content to be displayed; and controlling points of incidence of light from the first and second pixel relative to an optical multiplexer thereby changing the directionality of the multi-view, directionally dependent display.

Abstract: An electronic device, method, and computer readable medium for high efficiency input in virtual reality and augmented reality are provided. The electronic device includes a (wired or wireless) transceiver, and a processor coupled to the transceiver. The processor receives, using the transceiver, information from at least one of a sensing element on an input element of a physical device or a tracking element on the physical device; provides, in a virtual environment and based on the information received from the at least one of the sensing element or the tracking element, a virtual device corresponding to the physical device; detects, based on the information received from the at least one of the sensing element or the tracking element, an interaction with the physical device; and provides, in association with the virtual device in the virtual environment, an indication of the interaction with the physical device.

Abstract: An electronic device, method, and computer readable medium for augmented reality system is provided. The electronic device includes a light source that emits a light towards an eye of a user of the device, an adjustable lens having an adjustable focal point, a light sensor, configured to detect a reflected light that is reflected from the eye of the user, a processor, and a display screen. The processor determines a first distance corresponding to a focal point of the eye based on one or more positions of the reflected light, and adjusts the focal point of the lens unit based on the focal point of the eye. The display screen is configured to present an image of the object at a second distance based on the focal point of the lens unit to create a perception for the user that the image is placed at the first distance.

Abstract: The present disclosure includes methods and devices for generation and control of virtual displays in a virtual environment. A method includes receiving a trigger input from a user of a computing device, the computing device including a physical display that displays first content, initiating at least one virtual display based on the trigger input from the user, providing the at least one virtual display in association with the physical display, and displaying second content via the at least one virtual display in association with the first content displayed via the physical display.

Abstract: A method includes determining one or more controlled viewpoints of a multi-user display which includes a pixelated array and a directional multiplexer, and for each viewpoint of the one or more controlled viewpoints, determining first content to be displayed to the controlled viewpoint according to a visibility criterion. The method further includes, for each viewpoint of the one or more controlled viewpoints, determining a first subset of pixels of the pixelated array whose visibility from the controlled viewpoint satisfies the visibility criterion, and rendering the first content to be displayed on the first subset of pixels of the pixelated array.

Abstract: The present disclosure includes a system and method for creating a modifiable shader layer associated with a lens of a head-mountable device (HMD). The method includes providing a modifiable shader layer associated with a lens of a head-mountable display (HMD), where the modifiable shader layer is provided in a first state, and includes at least one of Liquid Crystal Smectic-A (LCSMA), liquid crystal polymer composites (LCPC), electro-wetting display (EWD), electro-dispersive display (ELDD), or electrochromic display (ECD). The method further includes causing the modifiable shader layer to transition from the first state to a second state that is different from the first state, and determining, based on whether the modifiable shader layer is in the first state or the second state, content to present via the lens of the HMD. The first state and the second state are one of a transparent state, an opaque state, or a partially opaque state.

Abstract: A method of rendering content for display on a multi-view display includes assigning a first display to a first pixel of a pixelated array, with a plurality of pixels periodically spaced along a first axis, the first display associated with a first viewing angle relative to the first axis. The method includes assigning a second display to a second pixel of the pixelated array, display associated with a second viewing angle relative to the first axis. The method further includes controlling a filter value of the first pixel based on a rendering of first content for display, and controlling a filter value of the second pixel based on a rendering of second content for display. The first viewing angle belongs to a first range of viewing angles of an optical multiplexer disposed in front of the pixelated array.

Abstract: In one embodiment, a computing system may access one or more frames of media content with each frame corresponding to at least part of an image. The computing system may automatically detect at least one object in at least one of the one or more frames. The computing system may automatically identify the at least one object. For each of the identified objects, the computing system may automatically determine an annotation corresponding to that object and each annotation may include one or more graphical elements. For each annotation, the computing system may automatically associate that annotation for display with its corresponding object.

Abstract: In one embodiment, an apparatus includes a processor and multiple pairs of cameras, where each camera of a first pair of cameras is separated from each other by one camera of a second pair of cameras. Each camera of the first pair of cameras has a first orientation, and each camera of the second pair of cameras has a second orientation that is different from the first orientation.

Abstract: The present disclosure includes systems and methods for touch sensing. An electronic device includes a resistive sheet that is optically transmissive, a number of electrodes electrically coupled to the resistive sheet, the electrodes disposed at an edge of the resistive sheet and spaced apart at predetermined intervals, and a processor coupled to the number of electrodes. The processor is configured to generate, at a first of the electrodes, a first drive signal, generate, at a second of the electrodes, a second drive signal, each drive signal having a different frequency, measure an output of at least one of the electrodes, and determine, based on the output, a location of a touch input on the resistive sheet.

Abstract: An apparatus includes a backlight, a color filter disposed in front of the backlight along a viewing direction, wherein the color filter includes a plurality of pixels repeating at a first spacing along a first axis. The apparatus further includes a lenticular layer disposed in front of the backlight, the lenticular layer including a section of material having a first index of refraction, a first, substantially flat side, and a second side defining a lenticularly patterned cross section along the first axis, the lenticularly patterned cross section including lens elements repeating at a second spacing and directing light originating from the backlight in two or more directions.