Abstract: Systems, apparatuses, and methods for implementing graphics pipeline optimizations are disclosed. A user interface (UI) is generated to allow a user to analyze shaders and determine resource utilization on any of multiple different target graphic devices. The UI allows the user to manipulate the state associated with the target graphics device for a given graphics pipeline. After being edited by the user, the state of the graphics pipeline is converted into a textual representation and input into a meta-app. The meta-app creates an application programming interface (API) construct from the shader source code and textual representation of the state which is compiled by a driver component into machine-level instructions. Also, resource usage statistics are generated for a simulated run of the graphics pipeline on the target graphics device. Then, the machine-level instructions and resource usage statistics are displayed in the UI for the user to analyze.

Abstract: Disclosed is an image display method of displaying a first image and a second image in a display area, the second image being adjacent to the first image. The image display method includes: performing display with switching between a first display mode and a second display mode. The first display mode is a mode in which the first image displayed as a three-dimensional image and the second image displayed as a three-dimensional image are displayed. The second display mode is a mode in which the first image displayed as a two-dimensional image and the second image displayed as a two-dimensional image are displayed.

Abstract: One embodiment of the present application sets forth a method for simulating an audio output of a three-dimensional object that includes a resonant cavity. The method includes receiving an input mesh of a three-dimensional shape and a hole configuration. The input mesh has an outer surface and an internal cavity, and the hole configuration includes one or more holes. The method further includes adding the one or more holes to the three-dimensional shape based on the hole configuration to generate a modified three-dimensional shape having a resonant cavity. The resonant cavity includes the one or more holes and the internal cavity. The method further includes determining an air pressure coefficient matrix for the resonant cavity. The method further includes computing a minimum non-zero eigenvalue for the air pressure coefficient matrix. The method further includes determining an output resonant frequency for the resonant cavity based on the minimum non-zero eigenvalue.

Abstract: In some implementations, a method includes obtaining a virtual object kit that includes a set of virtual object templates of a particular virtual object type. In some implementations, the virtual object kit includes a plurality of groups of components. In some implementations, each of the plurality of groups of components is associated with a particular portion of a virtual object. In some implementations, the method includes receiving a request to assemble a virtual object. In some implementations, the request includes a selection of components from at least some of the plurality of groups of components. In some implementations, the method includes synthesizing the virtual object in accordance with the request.

Abstract: Systems and methods are disclosed for displaying available or recommended electronic multimedia content to a user, including electronic media content on the Internet. According to one implementation, a method is provided that includes receiving a request from a user, the request specifying electronic media content desired by the user; analyzing an indexed web history of a plurality of other users, based on the request for desired content; and selecting and sorting a subset of available content groups, based on the request for desired content and the indexed web history. The method also includes selecting and sorting, for each selected and sorted content group, a subset of available content; providing instructions to display, to a user, the selected and sorted content groups along a first axis of a two-dimensional grid; and further providing instructions to display, to the user, the selected available content for each content group along a second axis of the two-dimensional grid.

Abstract: An orthogonal or multi-dimensional fabric user interface is described herein. A remote server executes an operating system that provides a multi-dimensional fabric for storing content for a particular user. The user can access select content by manipulating the multi-dimensional fabric through a graphical user interface displayed on a display device. In this way, the user experiences and manipulates various data dimensions around the specific content they are accessing, rather than selecting a particular file structure location.

Abstract: In some implementations, a method includes obtaining a virtual object kit that includes a set of virtual object templates of a particular virtual object type. In some implementations, the virtual object kit includes a plurality of groups of components. In some implementations, each of the plurality of groups of components is associated with a particular portion of a virtual object. In some implementations, the method includes receiving a request to assemble a virtual object. In some implementations, the request includes a selection of components from at least some of the plurality of groups of components. In some implementations, the method includes synthesizing the virtual object in accordance with the request.

Abstract: A communication apparatus includes at least one processor executing instructions to operate as an obtaining unit to obtain first video data including repetition of an effective interval in which frame image data of a first video is input and an interval in which image data is not input, second video data comprising repetition of an effective interval in which frame image data of a second video is input and an interval in which frame image data is not input, and communication data other than the video data. Instructions are also executed to operate as a setting unit to set a method of multiplexation of the first video data, the second video data, and the communication data in accordance with the effective interval of the first video data and the effective interval of the second video data, and a transmission unit to transmit data multiplexed in accordance with the set method of multiplexation.

Abstract: A display device includes a first display panel, a second display panel opposite the first display panel, a frame positioned between the first display panel and the second display panel, a first opening formed on the frame and positioned on a lower back side of the first display panel, a second opening formed on the frame and positioned on an upper back side of the second display panel, a first printed circuit board (PCB) electrically connected to the first display panel and positioned in the first opening, and a second PCB electrically connected to the second display panel and positioned in the second opening.

Abstract: A communication load is reduced in a virtual-reality-space sharing system. An image generation device for generating a virtual reality space image includes a memory for storing an instruction and a processor coupled to the memory for executing the instruction. The instruction, when executed by the processor, causes the processor to acquire, from a second terminal sharing a virtual reality space with a first terminal used by a first user, line-of-sight information including a position and a line-of-sight direction of a second user using the second terminal in the virtual reality space, generate a virtual reality space image to be displayed on the first terminal based on the line-of-sight information acquired from the second terminal, and supply the generated virtual reality space image to the first terminal.

Abstract: A Three-Dimensional (3D) display method is provided, and includes displaying a 3D screen including a plurality of objects having different depth perceptions, and displaying the 3D screen with a unified depth perception through adjustment of the depth perceptions of the plurality of objects to one depth perception, when a 3D display apparatus moves to a first state. Accordingly, it is possible to effectively control the operation of the display apparatus while viewing the 3D screen.

Abstract: Segmenting a three dimensional (3D) model of a structure may involve distinguishing vertically oriented surface elements from horizontally oriented surface elements of a three 3D surface representing a geographic area. The geographic area involves at least one structure. Segmenting a 3D model may also involve distinguishing ground surface elements from rooftop surface elements of the horizontally oriented surface elements of the 3D surface. Segmenting a 3D model may then involve associating the vertically oriented surface elements with the rooftop surface elements to form at least one segmented model of the at least one structure.

Abstract: A user interface includes a virtual object having an appearance in context with a real environment of a user using a see-through, near-eye augmented reality display device system. A virtual type of object and at least one real world object are selected based on compatibility criteria for forming a physical connection like attachment, supporting or integration of the virtual object with the at least one real object. Other appearance characteristics, e.g. color, size or shape, of the virtual object are selected for satisfying compatibility criteria with the selected at least one real object. Additionally, a virtual object type and appearance characteristics of the virtual object may be selected based on a social context of the user, a personal context of the user or both.

Abstract: There is provided a display control device including a display controller configured to place a virtual object within an augmented reality space corresponding to a real space in accordance with a recognition result of a real object shown in an image captured by an imaging part, and an operation acquisition part configured to acquire a user operation. When the user operation is a first operation, the display controller causes the virtual object to move within the augmented reality space.

Abstract: An apparatus including an image processor configured to receive a video, superimpose an object on the video at a distance from a reference point, and modify a location of the object based on a distance between the object and the reference point in a later frame.

Abstract: Systems and methods are described for a distributed data processing method, including, but not limited to: receiving, by a backend device, source data; partitioning, by the backend device, the source data into a plurality of data threads; sending, by the backend device, at least one of the plurality of data threads to each of a plurality of user devices; and determining, by the backend device, a job outcome for the source data based on a plurality of data thread results, each of the plurality of data thread results is determined by one of the plurality of user devices based on the at least one of the plurality of data threads.

Abstract: It is provided a computer-implemented method for designing a CAD modeled object. The method comprises displaying three-dimensional parametric shapes; user-interacting with a screen; defining on a support at least one stroke corresponding to the user-interacting; determining, for each shape, a projection of the shape on the support; selecting at least one shape, the selected shape having a projection with a smallest distance to the stroke. Such a method makes the design of a CAD modeled object easier.

Abstract: A method and apparatus for applying a rotational transform to a portion of a three-dimensional representation of an appliance for a living body is disclosed. The representation is defined by an input plurality of coordinates stored in a processor circuit memory, the input plurality of coordinates representing a general shape of the appliance. The method involves applying the rotational transform to the portion of the representation of the appliance within the transform volume to produce an output plurality of coordinates representing a modified shape of the appliance such that the general shape of portions of the appliance outside the transform volume remain un-modified by the rotational transform, and storing the output plurality of coordinates in the processor circuit memory.

Abstract: generating an image data for cross sectional layers of the three-dimensional object, wherein the image data includes a first set of data for selectively printing building material at a first print resolution and a second set of data for printing one or more colored additives at a higher resolution and selectively depositing the building material and the one or more additives on successive layers based on the 2D image data to produce the three-dimensional object.

Abstract: A method of generating a geodetic reference database product is disclosed The method comprises acquiring mobile mapping data captured by means of digital cameras, range sensors and position determination means including GPS and IMU mounted to a vehicle driving across the earth surface, the mobile mapping data comprising simultaneously captured image data, range data and associated position data in a geographic coordinate system. Linear stationary earth surface features are derived from the mobile mapping data by processing the image data, range data and associated position data. 3D-models are generated for the linear stationary earth surface features in the geographic coordinate system from the image data, range data and associated position data and stored in a database to obtain the geodetic reference database product. A 3D-model could include an image representing the colors of the surface of the 3D model or a set of smaller images representing photo-identifiable objects along the model.

Abstract: An information processing apparatus including a detector that detects movement of a manipulation body in a vertical direction in relation to a display, and a processor that determines a speed of movement of the manipulation body based on an output of the detector, and determines a process to be executed based on the determined speed of movement.

Abstract: An interactive 3-D drawing method supports 3-D modeling of real-world scenes captured in the form of multiple images taken from different locations and angles. The method enables the user manipulate a 3-D drawing primitive without changing its appearance on a selected input image.

Abstract: Stereoscopic image capture is provided. A blur value expected for multiple pixels in left and right images is predicted. The blur value is predicted based on designated capture settings. A disparity value expected for multiple pixels in the left and right images is predicted. The disparity value is predicted based on the designated capture settings. Stressed pixels are identified by comparing the predicted disparity value to a lower bound of disparity value determined from the predicted blur value using a predetermined model. A pixel with predicted disparity value less than the lower bound is identified as a stressed pixel. The predicted disparity is adjusted by modifying the designated capture settings to reduce the number of stressed pixels, or an alert to the presence of stressed pixels is given to the user.

Abstract: An image acquisition unit acquires an image captured by a first imaging device provided in a HMD for presenting an image observed when a three-dimensional image in a virtual three-dimensional space is projected onto a real-world setting, the first imaging device being configured to visualize an area including a field of view of a user wearing the HMD. A marker detection unit detects a marker included in the image captured by the first imaging device and acquired by the image acquisition unit. The image acquisition unit acquires an image captured by a second imaging device having an angle of view that at least partially overlaps an angle of view of the first imaging device. If the marker is not captured in the image captured by the first imaging device, the marker detection unit detects the marker in an image captured by the second imaging device.

Abstract: Embodiments are provided for digital dental modeling. One method embodiment includes receiving a three-dimensional data set including a first jaw and a second jaw of a three-dimensional digital dental model and receiving a two-dimensional data set corresponding to at least a portion of the first jaw and the second jaw. The method includes mapping two-dimensional data of the two-dimensional data set to the three-dimensional digital dental model by transforming a coordinate system of the two-dimensional data to a coordinate system of the three-dimensional data set. The method includes positioning the first jaw with respect to the second jaw based on the two-dimensional data mapped to the three-dimensional data set. The method includes using at least a portion of the two-dimensional data mapped to the three-dimensional data set as a target of movement of the first jaw with respect to the second jaw in the three-dimensional digital dental model.

Abstract: For example, display image input units 131R, 131L detect additional information indicating left and right directionality from images for display. Then, in a stereoscopic display device having a display device for the right eye and a display device for the left eye, a switcher 132 capable of switching the connections between input and output input-output is controlled so that the correct image for display is provided to the correct display device. With such a configuration, even when the cables are connected incorrectly, it is still possible to input stereoscopic images to the stereoscopic display device so that such images are always displayed in the correct left-right relation.

Abstract: A three-dimensional (3D) display apparatus is provided, including an image input device which receives an image and depth information, a multi-view image generator which generates a multi-view foreground image having depth information which is less than a preset depth value, and a multi-view rear ground image having depth information which is equal to or greater than the preset depth value, using the received image and depth information, a multi-view image renderer which performs rendering by arranging the multi-view foreground image according to a first arrangement pattern and the multi-view rear ground image according to a second arrangement pattern, and a display which outputs the rendered multi-view image.

Abstract: A real-time three-dimensional (3D) real environment reconstruction apparatus and method are provided. The real-time 3D real environment reconstruction apparatus reconstructs a 3D real environment in real-time, or processes data input through RGB-D cameras in real-time using a plurality of GPUs so as to reconstruct a wide ranging 3D real environment.

Abstract: A method and system for operating a remote-controlled device using a gesture-enabled remote control (RC) includes activating a communication link between the RC and the remote-controlled device. The remote-controlled device may implement a remote control context accommodating gesture commands generated by the RC. The RC may enable a user to generate gesture commands by performing gesture motions with the RC. Command data corresponding to gesture commands, along with selection commands from selection control inputs on the RC, may be sent to the remote-controlled device.

Abstract: In exemplary implementations of this invention, an automultiscopic display device includes (1) one or more spatially addressable, light attenuating layers, and (2) a controller which is configured to perform calculations to control the device. In these calculations, tensors provide sparse, memory-efficient representations of a light field. The calculations include using weighted nonnegative tensor factorization (NTF) to solve an optimization problem. The NTF calculations can be sufficiently efficient to achieve interactive refresh rates. Either a directional backlight or a uniform backlight may be used. For example, the device may have (1) a high resolution LCD in front, and (2) a low resolution directional backlight. Or, for example, the device may have a uniform backlight and three or more LCD panels. In these examples, all of the LCDs and the directional backlight (if applicable) may be time-multiplexed.

Abstract: An interactive 3-dimensional object-oriented database patient specific information storage system includes an input device, a database containing 3-dimensional meshes of objects each with an object identifier and a symptom list with each symptom having associated ones of the object identifiers of the 3-dimensional meshes of objects. An interface connected to interact with the database and the input device. The interface including a symptom input form for entering symptoms from the symptom list. The interface is designed to select 3-dimensional meshes of objects having ones of object identifiers associated with the entered symptoms and display the selected 3-dimensional meshes of objects on a symptom template. A record of the entered symptoms and the object identifiers of the associated ones of the 3-dimensional meshes of objects is created and stored.

Abstract: A method and system for displaying one or more products includes displaying a virtual, three-dimensional view of at least one product on a display system, selecting at least one action with the virtual, three-dimensional view of the product, and displaying a three-dimensional animation of the selected action with the product on the display system.

Abstract: A three-dimensional (3D) display apparatus is provided, including an image input device which receives an image and depth information, a multi-view image generator which generates a multi-view foreground image having depth information which is less than a preset depth value, and a multi-view rear ground image having depth information which is equal to or greater than the preset depth value, using the received image and depth information, a multi-view image renderer which performs rendering by arranging the multi-view foreground image according to a first arrangement pattern and the multi-view rear ground image according to a second arrangement pattern, and a display which outputs the rendered multi-view image.

Abstract: A mobile telecommunication/computing device that can print to a printer, the device having a sensor therein that determines the physical orientation of the device and the device displaying documents on a display in accordance with the orientation of the device. The device sends information to a printer that directs the printer to print the document in the orientation that the document is displayed on the device. The display orientation and print orientation may be portrait or landscape. Similar methods can be used to control other printer variables or, more generally, variables on other peripheral devices.

Abstract: An information processing apparatus including a detector that detects movement of a manipulation body in a vertical direction in relation to a display, and a processor that determines a speed of movement of the manipulation body based on an output of the detector, and determines a process to be executed based on the determined speed of movement.

Abstract: A three-dimensional display device is provided in the present disclosure. The three-dimensional display device includes an image displaying device, an optical control element, a direction sensor and a control unit. The optical control element is positioned on a surface of the image displaying device, the direction sensor measures and inclination angle of the display panel, and the control unit adjusts images displayed by the image displaying device according to the inclination angle. The three-dimensional display device of the present disclosure has the advantages of fast tracking speed, high tracking precision and low cost. A mobile terminal and a three-dimensional display tracking method are also provided in the present disclosure.

Abstract: A method for processing a selected item in a GUI of a multimedia application is provided. The method includes receiving a hot key input that specifies a function that is to be applied to the selected item and displaying a set of control guidelines associated with the hot key input. The set of control guidelines indicates cursor movement inputs needed to specify particular aspects of the function. A method for transforming a received cursor movement in a first coordinate system to a transformed cursor movement in a second coordinate system is provided. The received cursor movement specifies a particular manner (e.g., aspect and extent) of a function to be applied to an item in a workspace of a multimedia application. The first coordinate system displays a particular view of the workspace.

Abstract: A mobile terminal including a display unit configured to display at least a first 3D object at a first 3D depth level and a second 3D object at a second 3D depth level that is different than the first 3D depth level; and a controller configured to receive a first selection action on the first 3D object and a second selection action on the second 3D object image, to convert the second 3D depth level of the second 3D object to match the first 3D depth level of the first 3D object based on the first and second selection actions, and to control the display unit to display the first and second 3D objects at the first 3D depth level.

Abstract: Methods for a joy-stick graphical control in 3D space are disclosed. 3D data are rendered with a certain orientation in a 3D rendering space within a region of a 2D screen. One or more cross sectional views of the 3D data are rendered in the 3D rendering space where the cross sectional views are derived based on corresponding one or more 3D planes cutting through the 3D data at a 3D location. On one 3D plane, a joy-stick control is rendered in the 3D space at a pose determined based on the joy stick.

Abstract: A system and method are disclosed for converting a region of a Fish-Eye or other wide-angle image into a rectilinear image. According to an illustrative embodiment of the present disclosure, a Fish-Eye to rectilinear image conversion block is defined for use in a block diagram of a diagrammatic programming environment. The Fish-Eye to rectilinear image conversion block may use any of a variety of models for Fish-Eye systems, and thus is “model-independent.” Further, intuitive zoom, pan, tilt, and attitude adjustment parameters may be used with the image conversion block, to allow control of the conversion by users lacking advanced understanding of optics.

Abstract: Systems and methods for 3D shape retrieval are described herein. An embodiment includes obtaining a query 3D model, determining a similarity between the query 3D model and one or more 3D models based on a plurality of features of the query 3D model and corresponding features of the one or more 3D models, retrieving one or more similar 3D models based on the determining step and ranking the one or more similar 3D models based on the similarity. The embodiment further includes computing a feature distance between the query 3D model and the one or more 3D models for each feature, from a first set of features, associated with the query 3D model and the one or more 3D models and evaluating a first composite distance function using each feature distance.

Abstract: Disclosed herein are a stereoscopic image generation method of background terrain scenes, a system using the same, and a recording medium for the same. The stereoscopic image generation method of background terrain scenes includes an initial mesh creation step of creating an initial mesh using terrain geometry based on image sequences, a geometry error correction step of generating a projection map, detecting error regions of the initial mesh using the generated projection map, generating a vector map of the detected error regions, and generating a corrected mesh, error of which is corrected, and a stereo conversion step of generating a stereoscopic image using the corrected mesh. Since the stereoscopic image is generated based on the mesh, the mesh fits the terrain shape even though the geometry is complex. Further, time coherence can be enforced, the mesh can be edited easily, and new elements can be unseamingly composed into the terrain.

Abstract: A method and system for operating a remote-controlled device using a gesture-enabled remote control (RC) includes activating a communication link between the RC and the remote-controlled device. The remote-controlled device may implement a remote control context accommodating gesture commands generated by the RC. The RC may enable a user to generate gesture commands by performing gesture motions with the RC. Command data corresponding to gesture commands, along with selection commands from selection control inputs on the RC, may be sent to the remote-controlled device.

Abstract: A method for determining interior coordinates is disclosed. The method includes receiving information specifying an object having a plurality of sites and a boundary. Interior coordinates associated with each of the plurality of sites are determined based on the boundary. The interior coordinate associated with each of the plurality of sites represent a system of coordinates that satisfy several properties, including non-negativity and interior locality. At least one value associated with the plurality of sites is then interpolated using the interior coordinates.

Abstract: A method for receiving, via a computer, a selection of a drawing line is provided. The drawing line has a first end point and a second end point. The drawing line is displayed in a display area of a display device. The computer receives a selection of a change to the first end point and the second end point. The drawing line and a line end tool are then redisplayed in the display area of the display device based on an orientation of the drawing line.

Abstract: An apparatus and method are disclosed for state sharing. A change module detects a change of a configuration state for at least one of a base and a detachable device. A connection module detects a connection between the base and the detachable device. The detachable device provides a display and a network connection for the base if the base and detachable device are connected. A synchronize module synchronizes the configuration state of the detachable device with the configuration state of the base in response to detecting the connection and detecting the change of configuration state.

Abstract: A device, system and method are provided for creation, accessing, and management of data items on a computing device, such as a mobile device, using physically-defined spatial relationships between the data items and the user. At least one of a tracking user interface and a kinetic user interface is used to determine the physical location of the mobile device with respect to the user, rather than with reference to a geographic location. Using one or both of these interfaces, individual data items may be associated with a location in the physical space surrounding the user. Data items may also be associated with a particular characteristic, such as a category or tag, based on its associated location. Data items may be subsequently retrieved by holding the mobile device in the physical space surrounding the user, then identifying those data items having an associated location proximate to the mobile device location.

Abstract: An image control device includes a display control section that performs a normal display control process that controls an image based on a first designation position, and controls the image based on a second designation position, and performs a special display control process that controls the image based on the first designation position and the second designation position based on a given condition.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for receiving a baseline resource and one or more candidate change resources at a computing device, the baseline resource and the one or more candidate resources being displayable on a display, rendering the baseline resource as an image to provide an image file including corresponding image data, rendering the one or more candidate change resources as respective images to provide one or more image files each including corresponding image data, processing the image files using the computing device to determine one or more statistics of interest, the one or more statistics of interest reflecting a user behavior in interacting with a resource.

Abstract: An input processing device comprises a display screen and a pointing device for inputting corresponding 2-dimensional coordinates on the display screen. A 3-dimensional space is displayed on the display screen and the 2-dimensional coordinates inputted from the pointing device are detected. Next, shift amounts, per unit of time, of the detected 2-dimensional coordinates are calculated based on a predetermined calculation start condition. And the calculated shift amounts are converted to 3-dimensional coordinate shift amounts in the 3-dimensional space.