Abstract: One example device for dynamic context-sensitive virtual backgrounds for video conferences includes a communications interface; a non-transitory computer-readable medium; and one or more processors configured to execute processor-executable instructions stored in the non-transitory computer-readable medium to join a video conference hosted by a video conference provider; select a virtual background from a plurality of virtual backgrounds based on a characteristic of the virtual background and at least one of a characteristic of the video conference or a characteristic of a user of the client device; receive, from a camera, a video stream, the video stream including video images of the user; generate a video feed comprising the video images of the user superimposed over the selected virtual background; and provide the video feed to the video conference provider.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media relate to a method for extracting a user representation from a video stream to a virtual environment. The system may provide a video conference session in a virtual environment. The system may receive a video stream of a video conference participant. The system may extract a portion of the video stream depicting the video conference participant and generate a digital representation of the video conference participant based on the extracted video portion. The digital representation may comprise 2D or 3D representations. The system may provide the digital representation in the virtual environment.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for displaying augmented reality content. The program and method provide for receiving, from a first application running on a device, a request to switch to a second application on the device, the request identifying augmented reality content to display with image data captured by a camera of the device; providing, in response to receiving the request, for switching from the first application to the second application; providing for the second application to activate the camera to capture the image data; and providing for the second application to display the image data captured by the camera with the augmented reality content.

Abstract: Methods and systems of the present disclosure are directed to providing dental treatment utilizing a mixed reality device. A patient's physical arch is scanned to produce a virtual arch that is then rendered in a computing environment for analysis and manipulation. Virtual targets, e.g., brackets, implants, etc., and/or a grid, are applied to the virtual arch to produce a virtual dental treatment template. The virtual dental treatment template is rendered in the mixed reality device and aligned the template with the physical arch of the patient in the mixed reality device. A practitioner is thus provided with this template and the patient within the same field of view, so that installation of dental apparatus can be simply a matter of aligning physical dental apparatus with the corresponding virtual dental apparatus.

Abstract: An example method, apparatus, and computer-readable storage medium are provided to predict high-dynamic range (HDR) lighting from low-dynamic range (LDR) background images. In an example implementation, a method may include receiving low-dynamic range (LDR) background images of scenes, each LDR background image captured with appearance of one or more reference objects with different reflectance properties; and training a lighting estimation model based at least on the received LDR background images to predict high-dynamic range (HDR) lighting based at least on the trained model. In another example implementation, a method may include capturing a low-dynamic range (LDR) background image of a scene from an LDR video captured by a camera of the electronic computing device; predicting high-dynamic range (HDR) lighting for the image, the predicting, using a trained model, based at least on the LDR background image; and rendering a virtual object based at least on the predicted HDR lighting.

Abstract: The subject technology displays first augmented reality content on a computing device, the first augmented reality content comprising a first output media content. The subject technology provides for display a plurality of selectable graphical items, each of the selectable graphical items corresponding to a different augmented reality content including a set of media content modified utilizing facial synthesis. The subject technology receives a selection of one of the plurality of selectable graphical items. The subject technology, based at least in part on the selection, identifies second augmented reality content. The subject technology provides the second augmented reality content for display on the computing device.

Abstract: Provided are a system and a method for displaying a high-resolution liver cancer pathological image based on an image pyramid. The system includes a data source processing module and an image display module. The data source processing module is configured to acquire original images in various states, process the original images, acquire an image pyramid, name image blocks in the image pyramid, and store the image blocks in a folder set for the image pyramid in a server. The image display module is configured to acquire the image blocks in the folder set for the image pyramid in the server, acquire the image blocks according to a user's request, and splice and display the image blocks in an image display area. For the spliced image blocks, enlargement, reduction and translation operations are supported.

Abstract: A computer implemented method of creating a simulated realistic virtual model of a geographical area for training an autonomous driving system, comprising obtaining geographic map data of a geographical area, obtaining visual imagery data of the geographical area, classifying static objects identified in the visual imagery data to corresponding labels to designate labeled objects, superimposing the labeled objects over the geographic map data, generating a virtual 3D realistic model emulating the geographical area by synthesizing a corresponding visual texture for each of the labeled objects and injecting synthetic 3D imaging feed of the realistic model to imaging sensor(s) input(s) of the autonomous driving system controlling movement of an emulated vehicle in the realistic model where the synthetic 3D imaging feed is generated to depict the realistic model from a point of view of emulated imaging sensor(s) mounted on the emulated vehicle.

Abstract: According to one embodiment, a display device includes a transparent display including a display area including a plurality of pixels, a first surface including a display surface, and a second surface at an opposite side to the first surface and a first optical element provided at a second surface side of the transparent display, and the first optical element is configured to refract entering light and to diverge the entering light.

Abstract: A product modeling system and method are provided. On one embodiment, the product modeling system is used to model a piece of apparel, such as a shirt, with a design wherein the model with the design is used to display the piece of apparel with the design to a consumer.

Abstract: Provided are a method and system for controlling interactive live streaming co-hosting, a device, and a medium. The method for controlling interactive live streaming co-hosting includes acquiring a first interactive image and receiving a mirror interactive image of a second terminal by a first terminal, where the first terminal and the second terminal are in a live streaming co-hosting state, and the mirror interactive image of the second terminal is obtained by performing mirror processing on a second interactive image of the second terminal; and combining the first interactive image and the mirror interactive image by the first terminal to obtain a target interactive image.

Abstract: A location-based, multiuser, collaborative augmented reality (AR) system employs individual AR devices for viewing real-world anchors, that is, physical models that are recognizable to the camera and image processing module of the AR device. To mitigate ambiguous configurations when used in the collaborative mode, each anchor is registered with a server to ensure that only uniquely recognizable anchors are simultaneously active at a particular location. The system permits collaborative AR to span multiple sites, by associating a portal with an anchor at each site. Using the location of their corresponding AR device as a proxy for their position, AR renditions of the other participating users are provided. This AR system is particularly well suited for games.

Abstract: A method of generating a correction plan for correcting a deformed bone includes inputting to a computer system a first image of the deformed bone in a first plane and inputting to the computer system a second image of the deformed bone in a second plane. Image processing techniques are employed to identify a plurality of anatomical landmarks of the deformed bone in the first image. The first image of the deformed bone is displayed on a display device. A graphical of the deformed bone is autonomously generated and graphically overlaid on the first image of the deformed bone on the display device, the graphical template including a plurality of lines, each line connected at each end to a landmark point corresponding to one of the anatomical landmarks. A model of the deformed bone may be autonomously generated based on the graphical template.

Abstract: Systems and methods for digital avatars, specifically for fashion and consumer goods, are provided. This system is useful with an identified avatar, environment, and objects that a user may author, edit, and place. A user may deploy an avatar that resembles themselves via augmented reality, virtual reality, and other types of media. These systems include a user interface, administrative interface, economic systems and means of managing assets and protecting users' data. The systems incorporate mechanisms of controlling the avatar, means of integrating physical sensor data that interoperates with the virtual, and means of predicting related trends, choices, and behavior. Various features are employed for increased efficiency, accuracy, and believability.

Abstract: A method for processing a 3D scene, and corresponding device, system and computer program are disclosed. In an example embodiment, the disclosed method includes: obtaining an image comprising at least a nadir view of a 3D scene, captured by at least one camera; detecting, in the image, at least one shadow cast by at least one object of the 3D scene acting as a support for the at least one camera; and determining a direction of at least one real light source from the at least one detected shadow and at least information representative of the object.

Abstract: Various embodiments of the present disclosure are directed to a raw diagnostic machine for a medical diagnosis of raw medical imaging data generated by a medical imaging machine as opposed to a medical diagnosis of a medical image conventionally reconstructed from the raw medical imaging data. In operation, the raw diagnostic engine includes a medical imaging diagnostic controller implementing a dimension reduction pre-processor for selecting or extracting one or more dimension reduced feature vectors from the raw medical imaging data, and further implementing a raw diagnostic artificial intelligence engine for rendering a diagnostic assessment of the raw medical imaging data as represented by the dimension reduced feature vector(s). The medical imaging diagnostic controller may further control a communication of the diagnostic assessment of the raw medical imaging data (e.g., a display, a printing, an emailing, a texting, etc.).

Abstract: Apparatus and methods are described including tracking a tool portion and a patient marker from a first line of sight, using a first tracking device disposed upon a first head-mounted device that includes a display. The tool portion and the patient marker are tracked from a second line of sight, using a second tracking device. When a portion of the patient marker and the tool portion are both within the first line of sight, an augmented reality image is generated upon the first display based upon data received from the first tracking device and without using data from the second tracking device. When at least the patient marker portion and the tool portion are not both within the first line of sight, a virtual image of the tool and anatomy of the patient is generated using data received from the second tracking device. Other applications are also described.

Abstract: Biological digital imaging systems and methods are disclosed herein for analyzing pixel data of one or more digital images depicting absorbent articles or portions of absorbent articles. A digital image comprising pixel data is obtained depicting an absorbent article or a portion of an absorbent article, the digital image. An imaging application (app) analyzes the digital image to detect a biological feature depicted within the pixel data of the digital image of the absorbent article or the portion of the absorbent article. The imaging app generates an individual-specific biological prediction value corresponding to at least one of: (a) the absorbent article; (b) the portion of the absorbent article; or (c) an individual associated with the absorbent article or portion of the absorbent article. The individual-specific biological prediction value is based on the biological feature depicted within the pixel data of the digital image of the absorbent article or the portion of the absorbent article.

Abstract: Provided herein are exemplary embodiments directed to a method for creating digital media, including the placing the digital media in a computer graphics environment, the computer graphics environment further comprising visually perceptible elements appearing as real objects placed in a real world setting, and viewing the digital media when at the real world setting. Various exemplary systems include an augmented reality and virtual reality server connected to a network, and a client device connected to the network, the client device having an augmented reality and virtual reality application. Further exemplary systems include a body or motion sensor connected to the client device and/or an augmented reality and virtual reality interface connected to the client device.

Abstract: Interference-based augmented reality hosting platforms are presented. Hosting platforms can include networking nodes capable of analyzing a digital representation of scene to derive interference among elements of the scene. The hosting platform utilizes the interference to adjust the presence of augmented reality objects within an augmented reality experience. Elements of a scene can constructively interfere, enhancing presence of augmented reality objects; or destructively interfere, suppressing presence of augmented reality objects.

Abstract: An image generation apparatus generates an image whose background region on which a virtual object appearing in the real space is not superimposed is drawn in a background color having a predetermined luminance so as to make a region of a shadow of the virtual object look relatively dark. A rendering section renders the shadow of the virtual object appearing in a mesh structure in the real space by rendering not only the virtual object but also the mesh structure in the real space. A pixel value conversion section heightens colors of all pixels such that the background region uniformly takes on a background color having a predetermined luminance. A shadow/background processing section identifies the region of the shadow of the virtual object, sets the background region other than the shadow to the background color, and sets the shadow region to a color whose luminance is equal to or lower than that of the background color.

Abstract: Systems and methods are described for generating an AR image are described herein. A physical camera is used to capture a video of a physical object in front of a physical background. The system then accesses data defining a virtual environment and selects a first position of a virtual camera in the virtual environment. While capturing the video, the system displays captured video of the physical object, such that the physical background is replaced with a view of the virtual environment from the first position of the virtual camera. In response to detecting a movement of the physical camera, the system selects a second position of the virtual camera in the virtual environment based on the detected movement. The system then displays the captured video of the physical object, wherein the view of the physical background is replaced with a view of the virtual environment from the second position of the virtual camera.

Abstract: Systems, methods, and computer readable media directed to multi-user visual experiences such as interactive gaming experiences and artistic media experiences. A viewing electronic device includes a camera configured to capture images, a display, and a processor coupled to the camera and the display. The processor is configured to capture, with the camera, images of a rotating marker where the rotating marker is presented on a monitor of a remote device and to present, on the display, a visual experience where the visual experience has an adjustable feature. The processor detects a parameter of the rotating marker from the captured images that corresponds to the adjustable feature and updates the visual experience responsive to the detected parameter. The parameter may be one or more of an angle, speed of rotation, direction of rotation, color, or pattern of the rotating marker.

Abstract: The present disclosure generally relates to capturing and displaying video with multiple focal planes. The video includes a subject with a predefined portion of the subject identified in a first focal region. When a set of one or more conditions is met, the video is displayed with a focal plane of the video selected to be outside of the first focal region. When the set of one or more conditions is met is no longer met; and the video is displayed with the focal plane of the video selected to be inside of the first focal region.

Abstract: The invention relates to a method of generating a media file, the method comprising: generating a first data structure assigning a subset of samples or subsamples of a track to one or more sample groups; generating a second data structure comprising data for describing each of the one or more sample groups, the first data structure comprising a first grouping type and the second data structure comprising a second grouping type, wherein the second data structure comprises data for indicating whether the data for describing each of the one or more sample groups is invariant along time or not; and generating a media file including the samples, and the first and second data structures

Abstract: Interference-based augmented reality hosting platforms are presented. Hosting platforms can include networking nodes capable of analyzing a digital representation of scene to derive interference among elements of the scene. The hosting platform utilizes the interference to adjust the presence of augmented reality objects within an augmented reality experience. Elements of a scene can constructively interfere, enhancing presence of augmented reality objects; or destructively interfere, suppressing presence of augmented reality objects.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating composite images. One of the methods includes maintaining first data associating each location within an environment with a particular time; obtaining an image depicting the environment from a point of view of a display device; obtaining second data characterizing one or more virtual objects; and processing the obtained image and the second data to generate a composite image depicting the one or more virtual objects at respective locations in the environment from the point of view of the display device, wherein the composite image depicts each virtual object according to the particular time that the first data associates with the location of the virtual object in the environment.

Abstract: An augmented reality visualization system is disclosed for viewing non-destructive inspection (NDI) data of a component. The system comprises a component camera configured to capture a real time image of the component, a component display configured to display an AR image of the component, and an AR controller including an augmented reality processor and a non-transitory tangible storage medium. The storage medium includes processor-executable instructions for controlling the AR processor when the instructions are executed by the AR processor. The instructions access the NDI data of the component and implement a component AR engine to generate the AR image in real time by overlaying the NDI data on the real time image. The AR engine is configured to detect one or more three-dimensional (3D) features of the component in the real-time image and generate the AR image based on the detected one or more features.

Abstract: The subject technology displays first augmented reality content on a computing device, the first augmented reality content comprising a first output media content. The subject technology provides for display a plurality of selectable graphical items, each of the selectable graphical items corresponding to a different augmented reality content including a set of media content modified utilizing facial synthesis. The subject technology receives a selection of one of the plurality of selectable graphical items. The subject technology, based at least in part on the selection, identifies second augmented reality content. The subject technology provides the second augmented reality content for display on the computing device.

Abstract: A method includes: acquiring an image of first piece of clothing to be collocated; determining information of one or more second piece of clothing for collocation with the first piece of clothing; determining clothing collocation images containing the information of the one or more second piece of clothing in the collocation image library; and selecting clothing collocation images matched with the image of the first piece of clothing from the determined clothing collocation images. The information of the one or more second piece of clothing is pre-marked clothing category information of clothing collocation images in a collocation image library.

Abstract: Systems and methods for rendering one or more different types of datasets is described. An exemplar method includes: (i) obtaining a first type of dataset, wherein each first data value within the first type of dataset is associated with one or more three-dimensional coordinates, which define a location or region in real space; (ii) obtaining a second type of dataset, wherein each second data value within the second type of dataset is associated with one or more of the three-dimensional coordinates; (iii) spatializing the first type of dataset to create a first type of spatialized dataset; (iv) spatializing the second type of dataset to create a second type of spatialized dataset; (v) aligning the first type of spatialized dataset with the second type of spatialized dataset to create an enhanced three-dimensional spatialized environment; and (vi) rendering the enhanced three-dimensional spatialized environment on a display component.

Abstract: The present disclosure provides systems and methods for image editing. Embodiments of the present disclosure provide an image editing system for perform image object replacement or image region replacement (e.g., an image editing system for replacing an object or region of an image with an object or region from another image). For example, the image editing system may replace a sky portion of an image with a more desirable sky portion from a different replacement image. The original image and the replacement image (e.g., the image including a desirable object or region) include layers of masks. A sky from the replacement image may replace the sky of the image to produce an aesthetically pleasing composite image.

Abstract: A system for play by play wagering on a live sporting event through an augmented reality or virtual reality device. Users of a play by play wagering network can place wagers on the outcome of individual plays in a live sporting event that are displayed based on the players or elements of the live event that are in the point of view of the user's virtual or augmented reality device. Selected wagers can be augmented with multipliers based on user's manipulation of the augmented or virtual reality environment, such as running a path through the virtual field that they believe a player will take.

Abstract: A method, system, apparatus, and/or device that may include a first optic located a first distance from an optical receiver, the first optic being adapted to: receive environment content from a location in front of the first optic relative to the optical receiver; and alter a focal vergence of the environment content. The method, system, apparatus, and/or device may include a display located a second distance from the optical receiver, the display being is adapted to: receive the environment content from the first optic; and deliver the environment content and display content to a second optic. The method, system, apparatus, and/or device may include the second optic located a third distance from the optical receiver, the second optic being is adapted to: receive the environment content and the display content from the display; alter the focal vergence of the environment content; and alter a focal vergence of the display content.

Abstract: A dipole group quantification method includes quantitating a dipole group that are sources of signals based on positions of dipoles.

Abstract: The present disclosure relates to systems, non-transitory computer-readable media, and methods that utilize hemispherical clamping for importance sampling of an image-based light (IBL) to generate a digital image of a virtual environment. For example, the disclosed systems identify a hemispherical portion of an IBL image that corresponds to a reflective surface location on a virtual object. The disclosed systems can then clamp the IBL image using one or more importance sampling algorithms to exclude portions of the IBL image outside of the hemispherical portion that do not contribute direct lighting onto the reflective surface location. The disclosed systems can further utilize the one or more importance sampling algorithms to efficiently sample a ray direction between the reflective surface location and the hemispherical portion of the IBL image. In certain embodiments, the disclosed systems use the sampled ray direction to generate a digital image rendering portraying the virtual object.

Abstract: A radio frequency (RF) imaging device comprising a display receives a three-dimensional (3D) image that is a superposition of two or more images having different image types, which may include at least a 3D RF image of a space disposed behind a surface. A plurality of input control devices receive a user input for manipulating the display of the 3D image. Alternatively or additionally, the radio frequency (RF) imaging device may receive a three-dimensional (3D) image that is a weighted combination of a plurality of images, which may include a 3D RF image of a space disposed behind a surface, an infrared (IR) image of the surface, and a visible light image of the surface. A user input may specify changes to the weighted combination. In another embodiment, the RF imaging device may include an output device that produces a physical output indicating a detected type of material of an object in the space.

Abstract: The present invention relates to a blood vessel image processing method, a blood vessel image processing apparatus, a computer storage medium, and an imaging device. The method includes: obtaining blood vessel geometric structure information of a blood vessel segment of interest; obtaining vital feature information of the blood vessel segment; establishing an association relationship between the blood vessel geometric structure information and the vital feature information; and displaying the blood vessel geometric structure information and the vital feature information in the same image in a mutual fusion manner by using the association relationship as a reference. In this way, work efficiency of users can be improved by the solution.

Abstract: A camera agnostic core monitor for an enhanced flight vision system (EFVS) is disclosed. In embodiments, a structured light projector (SLP) generates and projects a precise geometric pattern or other like artifact, which is reflected by collimating elements into the EFVS optical path. Within the optical path, the EFVS focal plane array is illuminated by, and detects, the projected artifacts within the scene imagery captured for display by the EFVS. Image processors assess the presentation of the detected artifacts (e.g., position/orientation relative to the expected presentation of the detected artifact within the scene imagery) to verify that the displayed EFVS imagery is not misleading.

Abstract: A multiuser, collaborative augmented reality (AR) system employs individual AR devices for viewing real-world anchors, that is, physical models that are recognizable to the camera and image processing module of the AR device. To mitigate ambiguous configurations when used in the collaborative mode, each anchor is registered with a server to ensure that only uniquely recognizable anchors are simultaneously active at a particular location. The system permits collaborative AR to span multiple sites, by associating a portal with an anchor at each site. Using the location of their corresponding AR device as a proxy for their position, AR renditions of the other participating users are provided. This AR system is particularly well suited for games.

Abstract: Superimposed-image display devices and programs display a guide image providing a guidance of information to a driver of a vehicle such that the guide image is superimposed on a view ahead of the vehicle and is visually recognized. The systems and programs obtain three-dimensional map information that specifies a three-dimensional shape of a road and a structure nearby the road and arrange the guide image in the three-dimensional map information, based on the three-dimensional shape of the road and the structure nearby the road. The systems and programs obtain a shape of the guide image that is visually recognized from a position of the driver in the three-dimensional map information and display the guide image having the obtained shape.

Abstract: Interference-based augmented reality hosting platforms are presented. Hosting platforms can include networking nodes capable of analyzing a digital representation of scene to derive interference among elements of the scene. The hosting platform utilizes the interference to adjust the presence of augmented reality objects within an augmented reality experience. Elements of a scene can constructively interfere, enhancing presence of augmented reality objects; or destructively interfere, suppressing presence of augmented reality objects.

Abstract: The present disclosure relates to systems, computer-implemented methods, and non-transitory computer readable medium for automatically transferring makeup from a reference face image to a target face image using a neural network trained using semi-supervised learning. For example, the disclosed systems can receive, at a neural network, a target face image and a reference face image, where the target face image is selected by a user via a graphical user interface (GUI) and the reference face image has makeup. The systems transfer, by the neural network, the makeup from the reference face image to the target face image, where the neural network is trained to transfer the makeup from the reference face image to the target face image using semi-supervised learning. The systems output for display the makeup on the target face image.

Abstract: Methods and systems are disclosed for creating a shared augmented reality (AR) session. The methods and systems perform operations comprising: receiving, by a second device, a request to join an AR session initialized by a first device; in response to receiving the request, detecting a body corresponding to a user of the first device in one or more images captured by a camera of the second device; identifying a body part of the detected body corresponding to the user of the first device; determining, by the second device, a transformation in the AR session between the first device and the second device using the identified body part; and causing the AR session to be displayed by the second device based on the determined transformation.

Abstract: An augmented reality AR device may be communicatively connected to a remote network management platform configured to support a managed network. The AR device may capture an image of a real object in the field of view of an imaging component of the AR device. The real object may be recognized as a known managed object of the managed network. The AR device may also concurrently determine context information indicating a location or physical environment. The AR device may then transmit an identifier of the known managed object and the context information in a message to the management platform. In response, the AR device may receive data associated with the known managed. The AR device may then display a virtual object in a virtual space superimposed on the captured image of the real object, where the virtual object and the virtual space are based on the received management data.

Abstract: The present disclosure relates to a clothes treating apparatus that operates by executing an artificial intelligence (AI) algorithm and/or a machine learning algorithm in a 5G environment connected for Internet of Things, and a method for operating the clothes treating apparatus. The method for operating the clothes treating apparatus includes acquiring a clothing image by using a camera to photograph a user wearing clothes and standing in front of a mirror display placed on a front surface of the clothes treating apparatus, analyzing the clothing image, setting an operation mode of the clothes treating apparatus according to the result of analyzing the clothing image, and causing the clothes treating apparatus to operate according to the set operation mode. It is possible to improve user satisfaction by automatically setting and activating an operation mode of a clothes treating apparatus based on clothing image information.

Abstract: Disclosed herein is a system for facilitating real pilots in real aircraft using augmented and virtual reality to meet in a virtual piece of airspace, in accordance with some embodiments. Accordingly, the system may include a communication device configured for receiving at least one first sensor data corresponding to at least one first sensor associated with a first vehicle (and receiving at least one second sensor data corresponding to at least one second sensor associated with a second vehicle). Further, the communication device may be configured for transmitting at least one second presentation data to at least one second presentation device associated with the second vehicle. Further, the system may include a processing device configured for generating the at least one second presentation data based on the at least one first sensor data and the at least one second sensor data.

Abstract: The present application contemplates a method of providing a participant with traversable access to a local environmental context of a target. In preferred embodiments, a context engine accesses multiple views of the local environmental context and stitches together the multiple views to produce a digital, walkabout reality of the local environmental context. Upon a participant/recipient accessing a communication from a sender, the participant is able to use a portal during a viewing session to traverse the digital, walkabout reality associated with a target. It is contemplated that the target is physically located within the local environmental context.

Abstract: The present disclosure relates to providing a computer-generated reality (CGR) platform for generating CGR environments including virtual and augmented reality environments. In some embodiments, the platform includes an operating-system-level (OS-level) process that simulates and renders content in the CGR environment, and one or more application-level processes that provide information related to the content to be simulated and rendered to the OS-level process.

Abstract: A method, system, and computer program product for motion-based user interfaces are provided. The method identifies a navigation mode indication. A navigation interface is generated at a display device and configured based on the navigation mode indication to include a first graphical content. At least a portion of the navigation interface is modified based on one or more movements of the mobile computing device. A portion of the navigation interface is selected based on detecting a pressure change on at least a portion of a mobile computing device. The method presents a second graphical content on the display device based on the selected portion of the navigation interface.