Abstract: An image encoding method for encoding a multi-view image captured from a plurality of capturing views includes: generating a plurality of view identification information items each for identifying a plurality of display views that are a plurality of views used for display in an image decoding apparatus, by corresponding to each of a plurality of screen sizes used in the image decoding apparatus; and encoding the view identification information items.

Abstract: A drawing processing program executed in a computer apparatus causes the computer apparatus to function as: a virtual box setter that sets plural rectangular parallelepiped virtual boxes in a predetermined region having a rectangular parallelepiped shape in a virtual space; an object placer that places an object having the same shape and size as those of each virtual box in at least a part of the plural virtual boxes; an influence degree setter that sets, before a straight line that extends from a light source intersects the placed object, a baseline influence degree which is a baseline with respect to a first virtual box that can be intersected and sets an influence degree of a second virtual box based on the baseline influence degree; and a drawing processor that executes a drawing process in the virtual space based on the set influence degree.

Abstract: A system, method, and computer program product are provided for rendering at variable sampling rates. Vertex coordinates for 3D primitive are received from a shader execution unit, and an arithmetic operation is performed on the vertex coordinates by fixed operation circuitry to produce modified vertex coordinates in homogeneous coordinate space. The modified vertex coordinates are transformed from homogeneous coordinate space into screen-space to produce screen-space vertex coordinates of a transformed 3D primitive and the transformed 3D primitive is rasterized in screen-space using the screen-space vertex coordinates to produce an image for display.

Abstract: A method is disclosed that includes receiving an instruction to generate a virtual place-located anchor at a virtual location that is world-locked. Data items from a target data source are received. A subset of the data items is linked to the virtual place-located anchor. A first display device is caused to display virtual content of the subset of data items at the virtual place-located anchor. If a condition under which a second user is authorized to view the virtual content is satisfied, a second display device is caused to display the virtual content at the virtual place-located anchor.

Abstract: The present invention is directed to a system and method for providing an advertising offer that is configured to relocate an avatar within the virtual environment. The system is configured to ascertain one or more advertisements for display based on at least one of: an inventory analysis of an avatar, a historical teleportation analysis of the avatar, a motion analysis of the avatar, a social network analysis of the avatar, and a ratings analysis of the one or more advertisements within a virtual universe. The system also includes an advertisement display system structured to display the one or more advertisements to the avatar.

Abstract: Examples are described for overlaying circular images onto a three-dimensional mesh model to generated respective portions of image content for 360-degree viewable content, where each of the portions is a sub-capsule that is larger than half of the sphere. The portions are rendered and then blended based on overlapping portions of the image content from the 360-degree viewable content.

Abstract: Methods, systems, and computer-readable media for graphics library virtualization for virtualized graphics processing are disclosed. An application is executed on a virtual compute instance with a virtual GPU attached over a network. The virtual compute instance is implemented using a physical compute instance, and the virtual GPU is implemented using a physical GPU. The virtual compute instance comprises a first graphics library and an intermediate driver configured to translate calls from the first graphics library to a second graphics library. One or more calls by the application to the first graphics library are translated, using the intermediate driver, to one or more equivalent calls to the second graphics library. The one or more equivalent calls are executed on the virtual GPU using a driver associated with the second graphics library, and output is generated based (at least in part) on execution of the one or more equivalent calls.

Abstract: The embodiments relate to a method and to technical equipment for implementing the method. The method includes receiving an image with location information from a client; requesting processed region data from a media server based on the location information, said processed region data including one or more images with the corresponding location information; applying a first process for determining a pose of a device for the received image by means of the processed region data; if the first process fails to result the pose of the device, applying a second process for determining a pose of a device for the received image by means of the processed region data; saving the image with the determined pose of the device to the media server; providing the image and the pose of the device to a client for client rendering.

Abstract: Under an embodiment of the invention, an image capturing and processing system creates 3D image-based rendering (IBR) for real estate. The system provides image-based rendering of real property, the computer system including a user interface for visually presenting an image-based rendering of a real property to a user; and a processor to obtain two or more photorealistic viewpoints from ground truth image data capture locations; combine and process two or more instances of ground truth image data to create a plurality of synthesized viewpoints; and visually present a viewpoint in a virtual model of the real property on the user interface, the virtual model including photorealistic viewpoints and synthesized viewpoints.

Abstract: An embodiment provides an optical image measuring apparatus capable of acquiring images with high lateral resolution and global sharpness. An optical image measuring apparatus of an embodiment includes an optical system, image forming part, controller and composite-cross-sectional-image forming part. The optical system includes a scanner that changes an irradiation position of signal light on an object and a focus position changing part that changes a focus position of the signal light. The optical system detects interference light of returned light of the respective signal light from the object and reference light. The image forming part forms a cross-sectional image based on detection results of a plurality of interference light corresponding to a plurality of irradiation positions of the signal light. The controller controls the optical system to irradiate the signal light onto the plurality of irradiation positions repeatedly while changing the focus position.

Abstract: A security device has: an array of focusing elements on a grid; and an array of image elements overlapping the focusing elements array and arranged based on a repeating unit cell defining image element positions. The unit cell periodicity is substantially the same as the grid's. Each position is assigned to carry an image element of a respective corresponding image. Dependent on angle, the focusing elements array directs light from selected positions, as the device is tilted different ones of the respective images are displayed by the elements at the selected positions in combination, sequentially. Each unit cell center area, larger than each outer area, is assigned to carry element(s) of a corresponding center image, the outer areas assigned to carry element(s) of other respective images, such that the range of viewing angles over which the center image is displayed is greater than that over which each other image is.

Abstract: A system and method for receiving an ordered set of images and analyzing the images to determine at least one position in space and at least one motion vector in space and time for at least one object represented in the images is disclosed. Using these vectors, a four dimensional model of at least a portion of the information represented in the images is formulated. This model generally obeys the laws of physics, though aberrations may be imposed. The model is then exercised with an input parameter, which, for example, may represent a different perspective than the original set of images. The four dimensional model is then used to produce a modified set of ordered images in dependence on the input parameter and optionally the set of images, e.g., if only a portion of the data represented in the images is modeled. The set of images may then be rendered on a display device.

Abstract: A forward direction line is set on a course, in a virtual game world, on which a player object is allowed to move. An advancing direction at a current position of the player object is determined based on the forward direction line. The advancing direction is determined as a direction in which the player object advances so as to control a movement of a player character in accordance with an acceleration instruction, and a leftward-rightward movement instruction from a player. Consequently, it is possible to assist the player in controlling a direction in which an object operated by the player moves.

Abstract: The present disclosure relates to methods and systems for calculating dimensions of objects on loaded or partially loaded pallets for purposes of billing in shipping and transportation applications using depth-sensing imaging devices. A plurality of depth maps of an object are retrieved from one or more imaging devices. The depth maps are filtered and transformed into a world co-ordinate system based on calibration of the imaging devices. A point cloud is generated and a minimum volume bounding box is determined. The edge lengths and height of the object are calculated, and a volume may be determined to associate a volume with the object.

Abstract: A system includes a first device configured to cause a virtual reality image to be output by a display. The system also includes a second device communicatively coupled with the first device. The second device is configured to detect a user input associated with an action capable of being displayed in the virtual reality image. The second device is also configured to cause the first device to cause an object to be displayed in the virtual reality image based on the user input. The object at least partially includes a graphic representative of one or more of the second device, a user movement with respect to the second device, or the user input.

Abstract: An image device for determining an invalid depth information of a depth image includes a first sensor, a second sensor, a pre-processing module, a depth map engine, and an error determination unit. The first sensor captures first images and the second sensor captures second images. The pre-processing module generates a reference image according to each first image of the first images and a target image corresponding to the reference image according to a second image of the second images. The depth map engine generates a first depth image according to the reference image and the target image. The error determination unit sets gray level values of pixels of invalid areas of the first depth image to be a predetermined value to generate a second depth image, wherein pixels of the second depth image with the predetermined value have the invalid depth information.

Abstract: Techniques are disclosed for stabilizing a stream of spherical images captured by an image capture device to produce a stabilized spherical video sequence. The rotation of the image capture device during capture may be corrected in one or more desired axial directions in a way that is agnostic to the translation of the image capture device. The rotation of the image capture device may also be corrected in one or more desired axial directions in a way that is aware of the translation of the image capture device. For example, the assembled output spherical video sequence may be corrected to maintain the horizon of the scene at a constant location, regardless of the translation of the image capture device (i.e., a ‘translation-agnostic’ correction), while simultaneously being corrected to maintain the yaw of the scene in the direction of the image capture device's translation through three-dimensional space (i.e., a ‘translation-aware’ correction).

Abstract: A system and method of controlling a cursor (120) in a surface (100) by measurements of attitude of a pointer (110). The measurements can be provided by inertial, optical, magnetic, ultrasound, radiofrequency or video means and appropriate processing means. The method includes a step of computing the displacements of the intersection of a vector tied to the pointer with a projection surface. The projection surface can be predetermined on the basis of the measurements of the attitude and/or of the angular velocity of the pointer. The pointed-at surfaces can be planes, cylinders or spheres. The pointing can be performed in limited fashion or by sliding. The control of the cursor, in absolute mode or in relative mode, can allow the triggering of functions controlled by the orientation of the cursor on the pointed-at surface.

Abstract: What is disclosed is an object holder for retaining an object in a direct-to-object print system and a direct-to-object print system configured to use various embodiments of the object holder of the present invention. The object holder comprises a shuttle mount configured to slideably traverse a support member positioned parallel to a plane formed by at least one printhead of a direct-to-object print system. An expandable bladder attached to either the shuttle mount or a restraint. The bladder is inserted in a cavity of an object to be printed. A pump then fills the bladder with either a gas or a liquid to cause the bladder to expand. The expanded bladder in the object's cavity enables a surface of the object to be printed. In one embodiment, the filled bladder substantially conforms to a shape of a human foot, and the object being printed is footwear.

Abstract: An automated pallet inspection and repair apparatus comprises an inspection station and a repair station. The inspection station comprises a laser that illuminates a pallet, a camera that collects the reflected light and a computer system. The computer system analyzes the output of the camera and acquires the pallet's geometry and topography. The design of the pallet is determined by the computer software. A decision to repair the pallet is made by comparing acquired pallet data against the design criteria. If the pallet needs repair, a recipe of repair steps is constructed by inspecting each of the pallet's elements. The recipe is transmitted to the automated repair station.

Abstract: The present disclosure discloses a media content rendering method. The method is applied in a user equipment (UE) in a rendering system. The method includes determining, according to a rendering requirement of to-be-rendered media content, that a part of the to-be-rendered media content is to be rendered by a cloud device; sending, to the cloud device, a rendering indication message and first media content that needs to be rendered by the cloud device, where the rendering indication message is used to instruct the cloud device to render the first media content; and receiving a cloud processing result returned by the cloud device for the first media content. The UE can perform collaboratively rendering with the cloud device for the to-be-rendered media content, so that rendering resources of the UE and the cloud device are effectively used, and media content rendering efficiency is improved.

Abstract: A method for determining an orientation of a photosensor of a controller with respect to a projector is described. The method includes generating, by a beam generator of the projector, a beam. The method further includes modifying a direction of travel of the beam using a micro-electro-mechanical systems (MEMS) mirror that moves in a pattern, detecting the beam, calculating a time at which the beam is detected, and determining based on the pattern and the time an orientation of the beam to determine the orientation of the photosensor.

Abstract: The present disclosure provides a challenge-response testing systems for distinguishing between human users and bots. When a user requests to access an electronic resource on a computing device, the computing device identifies a challenge-response test for the user to complete. As part of the test, the computing device renders a first view of a 3D environment on a digital display. The computing device notifies the user of a test condition to complete. To satisfy the test condition, the user has to provide input that will effect a specified change to the view of the 3D environment seen on the display. Once the user provides electronic input, the computing device updates the viewing perspective of the 3D environment and renders an updated view on the digital display. When the user submits an indication that the test has been completed, the computing device verifies whether the test condition has been satisfied.

Abstract: A method for segmenting bone in spectral image data is described herein. The spectral image data includes at least a first set of image data corresponding to a first energy and second set of image data corresponding to a second different energy. The method includes obtaining the spectral image data. The method further includes extracting a set of features for each voxel in spectral image data. The method further includes determining, for each voxel, a probability that each voxel represents bone structure based on the set of features. The method further includes extracting bone structure from the spectral image data based on the probabilities.

Abstract: Among other things, a world model is maintained of an environment of a vehicle. A hypothetical object in the environment that cannot be perceived by sensors of the vehicle is included in the world model.

Abstract: A medical imaging apparatus includes a scanner configured to acquire projection data of an object in a plurality of directions, and a data processor configured to generate a volume of interest based on the projection data, generate a two-dimensional (2D) reprojection image by reprojecting the volume of interest in at least one direction, and extract feature information from the 2D reprojection image.

Abstract: Described are systems and methods for surveying a destination as an unmanned aerial vehicle (“UAV”) descends toward the destination. To confirm that the destination is clear of objects and includes a safe landing or delivery location, such as a substantially planar surface, the UAV may capture and process images at different altitudes during the descent. Feature points of a first image captured at a first altitude may be paired with feature points of a second image captured at a second, different altitude. A homography may be computed to confirm that the paired feature points lie in the same plane and then the two images may be registered based on the paired feature points. The registered images may then be processed to determine depth information and determine if descent of the UAV is to continue or be aborted.

Abstract: Cameras having wide fields of view are placed at each of the front left, front right, rear left, and rear right corners of a nominally rectangular-shaped vehicle, thereby providing a continuous region of overlapping fields of view completely surrounding the vehicle, and enabling complete 360° stereoscopic vision detection around the vehicle. In an embodiment the regions of overlapping fields of view completely surround the vehicle. The cameras are first individually calibrated, then collectively calibrated considering errors in overlapping viewing areas to develop one or more calibration corrections according to an optimization method that adjusts imaging parameters including homography values for each of the cameras, to reduce the overall error in the 360° surround view image of the continuous region surrounding the vehicle.

Abstract: An HMD device identifies a pose of the device and identifies a subset of a plurality of camera viewpoints of a light-field based on the pose. The HMD device interpolates image data of the light-field based on the pose and the subset of the plurality of camera viewpoints to generate an interpolated view; and displays at the HMD device an image based on the interpolated view. By interpolating based on the subset of camera viewpoints, the HMD device can reduce processing overhead and improve the user experience.

Abstract: In one general aspect, a method can include combining a partition polygon and a generated texture map to form a model of a scene for rendering in three dimensions in a virtual reality space. The generating of the texture map can include projecting a Layered Depth Image sample in a partition polygon to a point in a source camera window space, projecting the point back into the partition polygon as a surface element (surfel), projecting the surfel to a surfel footprint in a target camera window space, projecting from the target camera window space to the partition polygon, sub-pixel samples included in pixels covered by the surfel footprint, projecting the sub-pixel samples from the partition polygon and into the source camera window space, and applying a color weight to each sub-pixel sample based on the location of the sample in the source camera window space.

Abstract: An information processing apparatus includes a display, a sensor, and a controller. The display has a screen. The sensor is configured to detect an inclination. The controller is configured to display a first object on the screen and display a second object associated with the first object on the screen in accordance with the inclination detected by the sensor.

Abstract: The disclosure provides an approach for image segmentation from an uncalibrated camera array. In one aspect, a segmentation application computes a pseudo depth map for each frame of a video sequence recorded with a camera array based on dense correspondences between cameras in the array. The segmentation application then fuses such pseudo depth maps computed for satellite cameras of the camera array to obtain a pseudo depth map at a central camera. Further, the segmentation application interpolates virtual green screen positions for an entire frame based on user input which provides control points and pseudo depth thresholds at the control points. The segmentation application then computes an initial segmentation based on a thresholding using the virtual green screen positions, and refines the initial segmentation by solving a binary labeling problem in a Markov random field to better align the segmentation with image edges and provide temporal coherency for the segmentation.

Abstract: The present disclosure relates to systems, devices, and methods for calibrating a light field projection system. One example system includes a projection unit operable to project a scanning sequence toward a screen having convex reflective elements. The scanning sequence is modulated according to a baseline intensity profile. The system also includes a calibration device disposed such that a portion of the scanning sequence is intercepted by the calibration device. The calibration device includes a first light detector arranged to detect an intercepted intensity profile. The calibration device also includes a second light detector arranged to detect a reflected portion of the scanning sequence as a measured intensity profile. The system further includes a control system. The control system is configured to determine an expected intensity profile and to modify operation of the light field projection system based on a comparison of the measured intensity profile to the expected intensity profile.

Abstract: Methods, computer-readable media, and specially configured machines are described for hosting an instance of a cross-realm zone that manages interaction among characters from different instances of a virtual world in a massively multiplayer online game. Different zones of the virtual world may support different numbers of realms or different combinations of realms, and some zones of the virtual world may remain as single-realm zones. When a character enters a zone, the character may be added to an instance of a cross-realm zone based on the virtual world for which the character is a member. A single cross-realm zone may handle all characters that enter the zone from a subset of realms, but not characters that enter the zone from other realms that are not in the subset of realms. Characters in a cross-realm zone might not have any affiliation or prior social connection or interaction with each other.

Abstract: Disclosed are methods and systems for moving and manipulating graphical objects on a device that may include one or more pointing device, such as a mouse, a touchpad, or a touch screen, some of which may be multi-touch enabled. In some embodiments, a method may include, concurrent with and in response to user input from a pointing device: moving a first graphical object, determining a plurality of alternative target orientations for that first graphical object, selecting one of the target orientations, and gradually changing certain display characteristics of the first object based on characteristics of the selected target orientation.

Abstract: An image processing apparatus includes an acquisition unit configured to acquire information for identifying a position of a plane in a captured image, where the captured image includes a structure composed of a plurality of planes as an object, a determination unit configured to determine a correspondence relationship between a region corresponding to the plane in the captured image and a region in an overhead image to be created, according to the information acquired by the acquisition unit, and a generation unit configured to correct an image of the region corresponding to the plane in the captured image so that the corrected image corresponds to the region in the overhead image to be created, according to the correspondence relationship determined by the determination unit, and generate an overhead image composed of a plurality of corrected images that are combined with each other.

Abstract: A video monitoring system and method comprises a first camera at a first camera location configured to video record a first monitored area, wherein a georeference location of the first monitored area is known, and a virtual 3D model of the monitored zone that includes the first camera location and the first monitored area, wherein the virtual 3D model is georeferenced to a physical location. The system further comprises a processor configured to receive the video recording of the first monitored area and to overlay the video recording of the first monitored area onto a part of the virtual 3D model that corresponds to the georeference location of the first monitored area. A display is also connected to the processor and configured to display the virtual 3D model of the monitored zone overlaid with the video recording of the first monitored area.

Abstract: Embodiments are described herein for determining a stabilization plane to reduce errors that occur when a homographic transformation is applied to a scene including 3D geometry and/or multiple non-coplanar planes. Such embodiments can be used, e.g., when displaying an image on a head mounted display (HMD) device, but are not limited thereto. In an embodiment, a rendered image is generated, a gaze location of a user is determined, and a stabilization plane, associated with a homographic transformation, is determined based on the determined gaze location. This can involve determining, based on the user's gaze location, variables of the homographic transformation that define the stabilization plane. The homographic transformation is applied to the rendered image to thereby generate an updated image, and at least a portion of the updated image is then displayed.

Abstract: The present disclosure relates to a method for calibrating a projector. The method includes projecting a test pattern onto a scene or an object within the scene and capturing the test pattern using a camera. Once the test pattern image has been captured by the camera, the method further includes estimating by a processing element a perspective projection matrix, warping the estimated projection matrix based on a non-linear distortion function, and modifying the projector to project light based on the distortion function. The present disclosure also relates to a presentation or projection system including two types of projectors for projecting an output presentation having a second image overlaid on a first image.

Abstract: An apparatus includes an imaging unit for capturing a subject image; a setting unit setting initial posture of the imaging unit; a detector pirate for detecting posture information indicating a change in posture from the initial posture of the imaging unit; a corrector for correcting a posture of a preset virtual object arranged in a virtual three-dimensional space depending on the posture information; a projector for generating, based on a conversion function for projecting the virtual object on a device coordinate in a display screen of the captured image, an object image on the device coordinate, of the virtual object whose posture is corrected; a synthesizer for generating a synthetic image of the object and the captured images; a display for displaying the synthetic image; an image recording unit for recording the captured image; and a posture recording unit for recording the posture information in synchronization with the captured image.

Abstract: A method for processing of motion images based on a first set of motion image frames for a first eye view and at least one image frame for a second eye view. One embodiment of the method can include: identifying an object in a first image frame from the first eye view at a given time t; using a planar tracker, generating a homography relating to apparent movement of the object between the first image frame from the first eye view at the given time to a first image frame from the second eye view at a similar time t?; and using the homography to enhance processing of image(s) in the first and/or the second eye view. Thus, the homography can be used to define the relationship between two views taken at a similar time from two different locations.

Abstract: Inertial sensors within a head mounted display are used to track movement of the head mounted display. The tracked movement of the head mounted display is correlated to an action within a virtual reality scene that is currently displayed to a user wearing the head mounted display. The action within the virtual reality scene is based on a context of the virtual reality scene that is currently displayed. The detected movement of the head mounted display can be combined with other sensor data, such as gaze detection data, to determine the action within the virtual reality scene. In this manner, movements of the user as detected using the inertial sensors within the head mounted display are used as inputs to cause actions within the current context of the virtual reality scene as displayed within the head mounted display to the user.

Abstract: Aspects relate to a method of generating a high-resolution image containing depth information of an object. In one aspect, the method includes downsampling a first reference image and a second reference image from a first resolution to a second resolution, wherein the first resolution is higher than the second resolution, and wherein the first reference image and the second reference image comprising a stereo image pair. The method further includes generating a depth map at the second resolution based on global minimization techniques, using the downsampled stereo image pair. The method also includes upsampling the depth map from the second resolution to the first resolution and using a guided filter to align contours of the upsampled depth map to contours of the first reference image.

Abstract: A method of processing an image in a display apparatus includes receiving an image from an external source, processing the received image by applying depth information to at least one pixel among pixels constituting the received image according to occurrence of a preset event, and displaying the processed image.

Abstract: Methods and apparatus for using selective resolution reduction on images to be transmitted and/or used by a playback device are described. Prior to transmission one or more images of an environment are captured. Based on image content, motion detection and/or user input a resolution reduction operation is selected and performed. The reduced resolution image is communicated to a playback device along with information indicating a UV map corresponding to the selected resolution allocation that should be used by the playback device for rendering the communicated image. By changing the resolution allocation used and which UV map is used by the playback device different resolution allocations can be made with respect to different portions of the environment while allowing the number of pixels in transmitted images to remain constant. The playback device renders the individual images with the UV map corresponding to the resolution allocation used to generate the individual images.

Abstract: A system and method for coordinating session replay of spatiotemporal data and presentation of a graphical representation of said data. A disclosed video display system is capable of providing, in a displayed image, i) a diagrammatic representation and ii) a first graphical representation. The graphical elements in the first graphical representation can be dependent on the geolocations of one or more tracked objects, such as wireless terminals, that are represented in the spatiotemporal data and that are presented in the displayed image. The video display system can provide, for example, a map of a geographic area as the diagrammatic representation and a pie chart as the first graphical representation. A user of the system is able to control playback of the spatiotemporal data that are being presented on the map and to observe the pie chart being updated over time by the system during playback of the data.

Abstract: The precise touchscreen control allows a user to rapidly choose a point on a touchscreen, confirm that they've touched the point they intended, then perform a pan gesture to a new location, all without their fingertip obscuring any fine details on the screen.

Abstract: In one embodiment, a technique is provided for using a fixed cursor input interface to interact with a model of a computer aided design (CAD) application on an electronic device having a touch screen display. A view of the model is displayed within a workspace of the CAD application on the touch screen display. A fixed cursor and a toolbar are also displayed on the touch screen display. In response to the touch input within the workspace, a pan or move may be performed within model space to change the view of the model, while the fixed cursor is maintained at a designated position (e.g., the center of the touch screen display). In response to input upon an interface element of the toolbar that represents an input type, an action is performed related to a position in model space superposed by the fixed cursor.

Abstract: A method photo-based positioning includes obtaining a positioning photo taken by a mobile device within a predetermined space; comparing multiple feature elements exacted from sampling photos taken within the predetermined space in advance with the positioning photo to determine each feature element existing in the positioning photo; obtaining a first position coordinate of each feature element which is determined to exist in the positioning photo in a sampling photo corresponding to the positioning photo, and a second position coordinate of each feature element which is determined to exist in the positioning photo in the positioning photo; and calculating position parameters of the mobile device by using each of the obtained first position coordinate and second position coordinate, wherein the least number of feature elements existing in the positioning photo is determined according to the number of the position parameters.

Abstract: One variation of a method for dynamically displaying multiple virtual and augmented reality scenes on a single display includes determining a set of global transform parameters from a combination of user-defined inputs, user-measured inputs, and device orientation and position derived from sensor inputs; calculating a projection from a configurable function of the global transform parameters, context provided by the user and context specific to a virtual and augmented reality scene; rendering a virtual and augmented reality scene with the calculated projection on a subframe of the display; and repeating the previous two steps to render additional virtual and augmented reality scenes.