Abstract: Camera and/or lens calibration information is generated as part of a calibration process in video systems including 3-dimensional (3D) immersive content systems. The calibration information can be used to correct for distortions associated with the source camera and/or lens. A calibration profile can include information sufficient to allow the system to correct for camera and/or lens distortion/variation. This can be accomplished by capturing a calibration image of a physical 3D object corresponding to the simulated 3D environment, and creating the calibration profile by processing the calibration image. The calibration profile can then be used to project the source content directly into the 3D viewing space while also accounting for distortion/variation, and without first translating into an intermediate space (e.g., a rectilinear space) to account for lens distortion.

Abstract: Aspects of the disclosure generally relate to computer generated environments, and may be generally directed to devices, systems, methods, and/or applications for learning an avatar's or an application's operating while being at least partially operated by a user and causing an avatar or an application to operate autonomously resembling the user's consciousness or methodology of avatar or application operating. Aspects of the disclosure also generally relate to other disclosed embodiments.

Abstract: Described are methods and systems for generating a video stream of a scene including one or more objects. A sensor captures images of objects in a scene. A server coupled to the sensor, for each image, generates an initial 3D model for the objects and an initial 3D model of the scene. The server, for each image, captures pose information of the sensor as the sensor moves in relation to the scene or as the objects move in relation to the sensor. A viewing device receives the models and the pose information from the server. The viewing device captures pose information of the viewing device as the viewing device moves in relation to the scene. The viewing device renders a video stream on a display element using the received 3D models and at least one of the pose information of the sensor or the pose information of the viewing device.

Abstract: A method is disclosed for displaying patient ECG data. The method includes receiving ECG data including an ECG waveform; receiving analyzed ECG data including arrhythmic events; generating an indicia of the detected arrhythmic event; and displaying the indicia of the detected arrhythmic event in relation to the ECG waveform at a position associated with a time of the detected arrhythmic event. A system for displaying patient ECG data is also disclosed.

Abstract: Systems and methods are disclosed for enhancing and developing a damage scene virtual reality (VR) visualization. Annotated immersive multimedia image(s) may be received from a first user, where the annotated immersive multimedia image(s) can be associated with a damage scene. A VR visualization of the annotated immersive multimedia image(s) may be rendered using a VR device associated with a second user. The VR visualization may be used to determine a damage amount, where the damage amount is determined from one or more damaged items identifiable in the annotated immersive multimedia image(s).

Abstract: An electronic device including a display; and a controller configured to display a playback screen of virtual reality content on the display, in response to a capture command while displaying the playback screen of the virtual reality content, display a virtual icon on the playback screen, and in response to a touch input applied to the virtual icon, capture an image of a virtual space of the virtual reality content based on a position of a user in the virtual space and corresponding to a touch level of the touch input.

Abstract: Dense light-field data can be generated from image data that does not include light-field data, or from image data that includes sparse light-field data. In at least one embodiment, the source light-field data may include one or more sub-aperture images that may be used to reconstruct the light-field in denser form. In other embodiments, the source data can take other forms. Examples include data derived from or ancillary to a set of sub-aperture images, synthetic data, or captured image data that does not include full light-field data. Interpolation, back-projection, and/or other techniques are used in connection with source sub-aperture images or their equivalents, to generate dense light-field data.

Abstract: A virtual cinema interactive system includes a server and at least two user terminals. The user terminals communicate with the server. An host can invite his friends to watch film together on a virtual cinema displayed on each user terminal, and distribution of virtual cinema seating, talking between film watchers, and film watcher reactions to the film can be recognized and facilitated. A virtual cinema interactive method is also disclosed.

Abstract: A control method according to the present disclosure causes a computer of an information apparatus to: display on a display, a display screen representing a floor plan of one floor including at least two or more rooms; display each device icon representing each of one or more target devices in a region of each room, the one or more target devices including a specific target device that stores a set content when power has been previously turned off; and when selection of the device icon that represents the specific target device in any region of the at least two or more rooms is sensed, and selection of any region in the room, in which the selection of the device icon has been sensed, is sensed, output an on-off control command for controlling an on-off state of power of the specific target device corresponding to the room.

Abstract: A system generates and displays to a user of a digital magazine a list of candidate topics. The system first receives a package name list from a user device of the user, and the package name list indicates computer applications installed on the user device. The system retrieves a package name-topic matrix generated based on information associated with a set of existing users of the system. The system compares package names included in the received package name list and package names included in the package name-topic matrix, and identifies known topics in the package name-topic matrix based on the comparison. The system generates a list of candidate topics for the user based on the identified known topics, and provides the list for display to the user. In response to candidate topics selected by the user, the system provides to the user content relevant to the selected candidate topics.

Abstract: A method for making available a user interface, in particular in a vehicle, in which one or more graphic objects are displayed on a display with a touch-sensitive surface, an operator controlled intention which can be assigned to an operator controlled area of the display is determined in a contactless fashion in a space in the viewing direction in front of the display, and an operator controlled action is implemented by touching one of the graphic objects in the operator-controlled area of the display. Three-dimensional graphics data are calculated for a graphic object in the operator-controlled area of the display, and that when the operator-controlled intention has been determined, the graphic object in the operator-controlled area is emphasized visually in that the display of the graphic object which can be perceived over an area in the plane of the display is changed into a display which can be perceived spatially.

Abstract: Methods, systems, and computer programs are presented for online game cooperation. One method includes an operation for receiving a first request from a first user to place a game asset in a first game board of the first user. The game asset is associated with a task to be performed in the game. Further, the method includes an operation for receiving a second request from a second user to place the game asset in a second game board of the second user. The first user and the second user make progress by interacting with the game asset in their respective game boards. When the first user or the second user receives a transactional reward for interacting with the game asset, the transactional reward is also given to the other user. A final reward is given to the first user and to the second user upon completion of the task.

Abstract: A new approach is proposed that contemplates systems and methods to allow real time manipulation of objects within multiple dynamic and augmented video streams/feeds synchronized in an augmented reality (AR) or multi-dimensional space. Under such an approach, a participant/user of a first AR system would be able to connect with participants/users of a second same, similar or different AR system and to share their initial and/or augmented video streams with those users to enhance the AR experience from one participant to many. Through real time synchronization of augmented video streams in the AR systems, the users of both the first and the second AR system can see, share, manipulate and interact with the augmented content/objects either in his/her own augmented video streams or in the augmented video streams of another user.

Abstract: A method includes receiving from a shopping device an image of a shopping target corresponding to a product for sale, identifying a virtual model of the product, obtaining the virtual model of the product, and displaying the virtual model of the product on the shopping device.

Abstract: According to one embodiment, a plurality of spatial publishing objects (SPOs) is provided in a multidimensional space in a user interface. Each of the plurality of spatial publishing objects is associated with digital media data from at least one digital media source. The user interface has a field for the digital media data. A user is provided via the user interface with a user presence that is optionally capable of being represented in the user interface relative to the plurality of spatial publishing objects. The digital media data associated with the at least one spatial publishing object are combined to generate a media output corresponding to the combined digital media data.

Abstract: A method and system for influencing a virtual environment establishes a machine application interface which utilizes an application interaction layer to allow multitasking of applications within a single virtual environment, the method and system also allow for the use of two-dimensional legacy applications within the virtual environment. The method and system receives requests from outside applications and mediates control of spaces within the virtual environment depending on the user's security preferences.

Abstract: Provided is an information processing device including: a display unit configured to display a screen including an operation target to be subjected to a contact operation; a first detection unit configured to detect an object on the display unit; a second detection unit configured to detect an operation unavailable region among display regions of the screen based on a detection result obtained by the first detection unit, the operation unavailable region being a region in which an operation using the operation target is unable to be performed; and a change processing unit configured to change a configuration of the screen based on priority that is set for each operation target and to allow the operation target to be displayed in an operation available region, the operation available region being a region other than the operation unavailable region.

Abstract: Systems and methods for capturing participant likeness for a video game character are disclosed. In some embodiments, a method comprises receiving, at a pose generation system, multiple videos of one or more live events, the multiple videos recorded from a plurality of camera angles. A target participant may be identified, at the pose generation system, in the multiple videos. A set of poses may be generated, at the pose generation system, of the target participant from the multiple videos, the set of poses associated with a movement type or game stimulus. The set of poses may be received, at a model processing system, from the pose generation system. The method may further comprise generating, at the model processing system, a graphic dataset based on the set of poses, and storing, at the model processing system, the graphic dataset to assist in rendering gameplay of a video game.

Abstract: Systems, methods and articles of manufacture are disclosed for recording events occurring in a virtual world. In one embodiment, properties of events previously recorded and/or attended by a user may be identified. Recording criteria for the user may be derived from the identified properties. Upon identifying an event satisfying the recording criteria, the event may be recorded. The recorded event may be played back at the convenience of the user.

Abstract: Designating applications for public access or private access on a computing device is disclosed. An application on the computing device is designated for private functionality or public functionality. A security wall is enforced with respect to the application if the application is designated for private functionality, wherein enforcing the security wall includes preventing access to the application until a security input is received. Access to the application is provided if the application is designated for public functionality, wherein providing access to the application includes allowing a user to access the application without receiving the security input from the user.

Abstract: Systems and methods for authenticating an avatar are provided. This system is useful with an avatar having an identifier, virtual environments, and a user who uses the avatar in the virtual environments. Transoms are generated, each with a unique identifier configured to exist in a specific location, and registered with an identity provider. The transom initiates a request. An offer is conveyed that includes the transom identifier, the location and the avatar identifier. The avatar is then authenticated by a shared secret. The identity provider then responds to the offer with avatar identification information, including reputation information. Reputation information is for the avatar and the user, and is compiled from external avatar data sources by using a trust matrix. An avatar gallery is generated by linking each avatar owned by each user to the account and compiling avatar profiles from the account, and the reputation information. The avatar profiles are searchable, and include micro formats.

Abstract: A system and method for providing a virtual space determines a representation of the virtual space based on information defining a personality of a character within the virtual space and/or information indicating a user's personality. The system and method may also determine the information defining the character's personality based on information regarding the user and/or information regarding the character. In some examples, the system and method may further determine information to facilitate a development of the user based on the information describing the user's personality. The system and method may also determine the user's personality based on information indicating user's personality. In some examples, the user's personality may be determined based on user's experiences within the virtual space. In some other examples, the user's personality may be determined based on information regarding the user that is acquired from sources external to the virtual space.

Abstract: A virtual cinema interactive system includes a server and at least two user terminals. The user terminals communicate with the server. An inviter can invite his friends to watch film together on a virtual cinema displayed on each user terminal, and distribution of virtual cinema seating, talking between film watchers, and film watcher reactions to the film can be recognized and facilitated. A virtual cinema interactive method is also disclosed.

Abstract: In one embodiment, a method includes receiving first information about a proximity of a first user, the first information comprising one or more images or one or more sounds of at least a portion of the proximity, the first information having been obtained from the proximity by a client computing device of the first user automatically and with one or more sensors of the client computing device; identifying a second user within the proximity of the first user based at least in part on the first information; retrieving second information about the second user from a graph of a social-networking system, the graph comprising a plurality of nodes and edges connecting the nodes, at least one node in the graph corresponding to the first user, at least one node in the graph corresponding to the second user; and sending the second information about the second user to the first user.

Abstract: A terminal receives contents to be written on a note by a user, a server stores and manages print data generated by a plurality of users and outputs the print data to an image forming apparatus which outputs the print data in the form of an adhesive note. The image forming apparatus includes a de-curl unit for correcting the curl of a recording medium and causes the recording medium on which printing is performed to be popped out through an outlet. The server communicates with a plurality of terminals and includes a control unit which generates a virtual conference space by assigning a storage address to the virtual conference space when a request of generating a virtual conference space and identification information on an image forming apparatus to be used in the virtual conference space from among the plurality of terminals is received.

Abstract: A system for multi-client control of a common avatar is provided herein. The system includes, for example, a cloud game engine and a cooperative play engine associated with the cloud game engine and configured to multicast a video stream from the cloud game engine to multiple players, combine separate response streams from the multiple players into a joint response stream based on avatar functions contained therein and provide the joint response stream to the cloud game engine.

Abstract: An exemplary virtual reality media provider system (“system”) manages data representative of an immersive virtual reality world (“world”) and receives a request from a media player device (“device”) for the device to receive a pixel data transmission representative of a particular scene of the world by way of a network. The device includes a head-mounted display screen worn by a user to view the particular scene as the user experiences the world. The system identifies pixel data representative of a set of pixels that constitute the particular scene and provides a minimized pixel data transmission representative of the particular scene to the device by transmitting a viewable pixel data subset corresponding to regions of the display screen predetermined to be viewable by the user and abstaining from transmitting an unviewable pixel data subset corresponding to regions of the display screen predetermined to be unviewable by the user.

Abstract: A system and method for capturing a location based experience at an event including a plurality of mobile devices having a camera employed near a point of interest to capture random, crowdsourced images and associated metadata near said point of interest. In a preferred form, the images include depth camera information from prepositioned devices around the point of interest during the event. A network communicates images, depth information, and metadata to build a 3D model of the region, preferably with the location of contributors known. Users connect to this experience platform to view the 3D model from a user selected location and orientation and to participate in experiences with, for example, a social network.

Abstract: Techniques are proposed for animating a deformable object. A geometric mesh comprising a plurality of vertices is retrieved, where the geometric mesh is related to a first rest state configuration corresponding to the deformable object. A motion goal associated with the deformable object is then retrieved. The motion goal is translated into a function of one or more state variables associated with the deformable object. A second rest state configuration corresponding to the deformable object is computed by adjusting the position of at least one vertex in the plurality of vertices based at least in part on the function.

Abstract: A method including causing, at least in part, rendering of a perspective view showing one or more objects in a field of view. The method further including retrieving content associated with an object of the one or more objects in the field of view, and causing, at least in part, rendering of a graphic representation relating to the content on a surface of the object visible in the perspective view in a user interface for a location-based service of a mobile device.

Abstract: In a display input apparatus, a display control section allows a display to display a setting item list of setting items lined up in a first direction and a first setting candidate list of setting candidates lined up in a second direction for one of the setting items, one list across the other, and provide, when a gesture receiving section receives a scroll gesture in the first direction via a touch panel, a scrolling display of the setting item list and a display of the first setting candidate list for the setting item presented in an intersecting region thereof with the setting item list, and provide, when the gesture receiving section receives a scroll gesture in the second direction via the touch panel, a scrolling display of the first setting candidate list. A setting receiving section receives as a changed setting the setting candidate presented in the intersecting region.

Abstract: Disclosed is a system for authoring and providing augmented reality contents, which includes a database storing a plurality of place models expressing an inherent physical place, a positioning unit for determining a current position of a user, a place model processing unit for searching and loading a place model corresponding to the current position of the user from the database, and a virtual object processing unit for disposing a virtual object expressed through a HTML document at a predetermined location in the loaded place model, wherein the plurality of place models is hierarchically stored so that at least one place model has at least one another place model of a subordinate concept.

Abstract: A method of displaying a three-dimensional (3D) graphical user interface (GUI) on a mobile phone, including controlling, by a processor of the mobile phone, a display of the mobile device to display a first face of a 3D GUI, the first face comprising a GUI menu of the GUI, and a second face of the 3D GUI, the second face comprising image information of the GUI; detecting, by a sensor of the mobile phone, a physical slanting of the mobile phone; and displaying the image information of second face of the 3D GUI as being slanted to correspond to the physical slanting.

Abstract: A system comprises a memory operable to store a customer account, a first float account, and a second float account. The system further comprises a processor communicatively coupled to the memory. The processor may receive an electronic request for a currency exchange and determine exchange rates for exchanging a first currency for a second currency. The processor may also determine an optimal exchange rate. In response to determining the optimal exchange rate, the processor may determine a first amount of the first currency and associate the first amount with the customer account. The processor may also transfer the first amount of the first currency into the first float account and determine a second amount of the second currency. The processor is further able to associate the second amount with the second float account and transfer the second amount of the second currency to the customer.

Abstract: Methods and apparatus for determining location of objects surrounding a user of a 3D rendering and display system and indicating the objects to the user while the user views a simulated environment, e.g., on a headmounted display, are described. A sensor, e.g. camera, captures images or senses the physical environment where the user of the system is located. One or more objects in the physical environment are identified, e.g., by recognizing predetermined symbols on the objects and based on stored information indicating a mapping between different symbols and objects. The location of the objects relative to the user's location in the physical environment is determined. A simulated environment, including content corresponding to a scene and visual representations of the one or more objects, is displayed. In some embodiments visual representation are displayed in the simulated environment at locations determined based on the location of the objects relative to the user.

Abstract: A web browser interface for visualizing realtime network communications in spatial communication environments allows communicants to interact with other communicants in an immersive spatial communication environment without having to install any specialized communication software and without requiring special proxies or firewall additions or exceptions.

Abstract: A method of executing a virtual conference among a plurality of nodes including a first node, wherein there is a display device associated with the first node that is configured to display a virtual conference window containing images of participants at other nodes of the plurality of nodes, is presented. The method entails activating the virtual conference window in response to receiving a selection in the virtual conference window, wherein the activating of the virtual conference window triggers a process of identifying one of the nodes as an attention recipient and displaying the attention recipient's image differently than images of other nodes. Where private chat function is available, attention recipient may be identified based on who the participant at the first node is chatting with. Images may be augmented to add an illusion of space and distance.

Abstract: Increasing a number of advertising impressions in a system configured to facilitate user interaction with an interactive environment containing one or more advertising targets is described. A scene of a portion of the simulated environment is displayed from a camera point of view (camera POV) on a video display. The scene may change as the camera POV changes in response to movement of the camera POV along a camera path during the user's interaction with the simulated environment. Modifying the camera path or a camera field of view can place more of an advertising target within the scene displayed on the video display to increase a likelihood of generating an advertising impression compared to a likelihood of generating an advertising impression without the modification.

Abstract: To orient a user within a map display, a portable device displays a panoramic view representative of the user's real-world surroundings. The portable device also displays a map representation of an adjacent area above the panoramic view so that the area displayed in the map representation appears further away than the real-world surroundings depicted in the panoramic view. The portable device may also display an intersection which includes a commonly shared boundary between the panoramic view and the map representation so that the user can identify the relationship between the two displays.

Abstract: Embodiments of the invention are directed to a computer-implemented interactive virtual banking system and method for connecting a user environment with a banking environment for facilitating banking transactions. The system may include a computer memory storing a plurality of banking application programs and an interactive virtual environment generator for generating an interactive virtual banking environment, the environment including visual and audio components. The system may additionally include a user input sensing mechanism for accepting and interpreting user voice input received in the interactive virtual banking environment and computer processing components for accessing the stored banking application programs and executing the stored banking programs within the generated interactive virtual banking environment enabling the user to perform banking tasks through voice input to the interactive virtual banking environment.

Abstract: Embodiments of the present invention split game processing and rendering between a client and a game server. A rendered video game image is received from a game server and combined with a rendered image generated by the game client to form a single video game image that is presented to a user. Game play may be controlled using a rich sensory input, such as three-dimensional image data and audio data. The three-dimensional image data describes the shape, size and orientation of objects present in a play space. The rich sensory input is communicated to a game server, potentially with some preprocessing, and is also consumed locally on the client, at least in part. In one embodiment, latency sensitive features are the only features processed on the client and rendered on the client.

Abstract: Provided is an information provision apparatus (10) including: a feature quantity storage unit (11) in which a feature quantity of print content that is printed on a printed material is stored; a relevant information storage unit (12) in which relevant information that is associated with the print content is stored; a captured image obtainment unit (13) that obtains a captured image that is captured by an imaging unit; a specification unit (14) that specifies the print content that is included in the captured image by using the feature quantity of the print content that is stored in the feature quantity storage unit (11); and a relevant information output unit (15) that obtains from the relevant information storage unit (12) the relevant information that is associated with the print content that is specified by the specification unit (14) and outputs the obtained relevant information.

Abstract: Examples of associating user information from social network sites with a conference call application may include a series of operations. One example operation may provide receiving a command to share at least one social networking application with a scheduled conference call and accessing an application programming interface (API) of the social networking application, and sharing user profile information with a graphical user interface (GUI) application of the scheduled conference call corresponding to the command to share the social networking application.

Abstract: Systems and methods enabling users to interact with an augmented reality environment are disclosed. Real-world objects may have unique markers which are recognized by mobile devices. A mobile device recognizes the markers and generates a set of virtual objects associated with the markers in the augmented reality environment. Mobile devices employ virtual pointers and virtual control buttons to enable users to interact with the virtual objects. Users may aim the virtual pointer to a virtual object, select the virtual object, and then drag-and-drop the virtual object to a new location. Embodiments enable users to select, move, transform, create and delete virtual objects with the virtual pointer. The mobile device provides users with a means of drawing lines and geometrically-shaped virtual objects.

Abstract: A server notifies another user that a virtual item of the user has been registered when the virtual item of the user has been registered, receives a registration request for the virtual item of the user from the terminal of the other user, and registers the virtual item of the user in association with the identification information of the other user as a virtual item of the other user when the registration request for the virtual item of the user from the terminal of the other user has been received.

Abstract: A display apparatus and method for creating and displaying configured virtual environments based on real world source environments. A mixed reality environment includes real and virtual objects, and a set of one or more virtual objects may be associated with a source environment and stored as a configured environment for later rendering by the display apparatus. Configured environments may be associated with users, environments or locations.

Abstract: Methods, systems, and computer programs are presented for online game cooperation. One method includes an operation for receiving a first request from a first user to place a game asset in a first game board of the first user. The game asset is associated with a task to be performed in the game. Further, the method includes an operation for receiving a second request from a second user to place the game asset in a second game board of the second user. The first user and the second user make progress by interacting with the game asset in their respective game boards. When the first user or the second user receives a transactional reward for interacting with the game asset, the transactional reward is also given to the other user. A final reward is given to the first user and to the second user upon completion of the task.

Abstract: Provided is a method for authentication and verification of a user in a virtual world (VU) based upon such criteria as the physical location of a user in the real world and the logical location of the user's avatar in the VU. The disclosed technology combines physical and application aspects of security to enhance security options within virtual environments. In addition to traditional credential-based authentication, physical constraints corresponding to the real world and logical locations in a VU are employed, wherein an authentication server requires each component to be in the proper association state, location or proximity before authenticating a user. Further, the disclosed technology provides for the termination of a user's authentication if the user moves from an approved physical or VU location to an unapproved location. Techniques are provided to track a user's credentials and real-time physical and logical location of a user.

Abstract: A system, a method, and a computer program product for providing an application object framework are disclosed. In response to a request, an application object of a software application is obtained from an application object framework. The application object framework loads a metadata corresponding to the requested application object. The metadata contains at least one metadata schema definition. The application object framework generates a runtime interface for execution of the requested application object based on the loaded metadata.

Abstract: Disclosed are various embodiments for synchronizing application state information across devices. More specifically, embodiments of the disclosure are related to facilitating idempotency of application state information. Idempotency is maintained by using a timestamp embedded within application state information and/or by determining that the application state information is associated with an accumulating value.