Abstract: In graphics processing data is received representing one or more vertices for a scene in a virtual space. A projection of the vertices onto a screen space of a display device is performed. A density of the vertices is adjusted for selected portions of the screen space, such that a lower density of vertices is present in selected portions of the screen space. Primitive assembly is performed on the vertices to generate a one or more primitives in screen space from the projection of the vertices onto the screen space. A finished frame is then generated by performing pixel processing to assign pixel values to the pixel or pixels that are part of the corresponding primitives. In some implementations, the finished frame can be stored in the memory or displayed on the display device.

Abstract: In device having at least one microphone and one or more speakers, environmental sound may be recorded using the microphone, classified and mixed with source media sound to produce a mixed sound depending on the classification. The mixed sound may then be played over the one or more speakers.

Abstract: Management of user-generated game play advice is disclosed. The present invention allows for management of game play advice that is complete and up-to-date regardless of when a particular interactive gaming title is released. Game play advice is pervasive and easily accessible to game players in addition to being accurate and credible such that game players can trust or rely upon the rendered advice.

Abstract: Methods and apparatus provide for acquiring information relating to at least one of a position and a rotation of a user's head wearing a head-mounted display; generating an image for the head-mounted display using information relating to at least one of a position and a rotation acquired at a certain point of time; and a correcting process includes receiving updated information relating to at least one of a position and a rotation at a different point of time and correcting the image generated using the updated information. The generating the image includes using the information relating to at least one of the position and the rotation in a first frequency; and the correcting includes receiving updated information relating to at least one of a position and a rotation in a second frequency corresponding to a frame rate of the head-mounted display.

Abstract: A position and rotation information acquisition unit 730 acquires information relating to a position and a rotation of the head of a user who wears a head-mounted display unit 100. A coordinate transformation unit 740 and a panorama image processing unit 750 generate an image to be displayed on the head-mounted display unit using the information relating to the position and the rotation acquired at a certain point of time by the position and rotation information acquisition unit 730. A correction processing unit 780 corrects the generated image using updated information relating to the position and the rotation at a different point of time.

Abstract: A hand-held electronic device has a processor that is operably coupled to the visual display and touch interface. The hand held electronic device includes instructions executable by the processor configured to present an image on the visual display containing one or more active elements; perform a tessellation that divides the image into one or more regions that fill the display, each region corresponds to a different active element, a size of each region depends on a corresponding probability of use of the corresponding active element within a given time frame; correlate one or more active portions of the touch interface to a corresponding one or more of the regions; and activate a particular active element in response to a touch on a corresponding active portion.

Abstract: A proximity device, a computer-implemented method, and proximity system are described. Generally, the proximity device can be wearable or non-wearable. A wearable proximity device is configured to be worn by a user. As the user moves within a physical environment, the wearable proximity devices monitors the user's proximity to objects. Proximity indications are accordingly generated and presented to the user. A non-wearable proximity device is configured to monitor the user's proximity relative to a perimeter of an area. If the user approaches or overruns the perimeter, a proximity indication is generated and presented to the user.

Abstract: A video game console, a video game system, and a computer-implemented method are described. Generally, a video game and video game assistance are adapted to a player. For example, a narrative of the video game is personalized to an experience level of the player. Similarly, assistance in interacting with a particular context of the video game is also personalized. The personalization learns from historical interactions of players with the video game and, optionally, other video games. In an example, a deep learning neural network is implemented to generate knowledge from the historical interactions. The personalization is set according to the knowledge.

Abstract: A virtual reality (VR) head-mounted display (HMD), a computer-implemented method, and a VR tracking system are described. Generally, a VR HMD includes an inertial measurement unit (IMU) and an optical sensor. When a second VR HMD is located in a same physical environment, the VR HMD can be operated to track a motion of the second VR HMD in the physical environment. For example, image data captured by the VR HMD in addition to inertial data of both VR HMDs are used to determine a three dimensional (3D) physical position of the second VR HMD and to track the 3D physical position over time. Three degrees of freedom (DOF) or six DOF for the motion are derived from the tracking.

Abstract: A reconfigurable imaging apparatus, a computer-implemented method, and an imaging system are described. Generally, the apparatus includes platforms. Each platform houses one or more optical sensors. A pivotal connector is connected with at least two platforms and supports a relative movement of such platforms with respect to one another. Hence, the platforms can be arranged and switched between different arrangements based on the pivotal connector, thereby allowing a reconfiguration of the apparatus. In an example, arrangement, the optical sensors are pointed in different directions to cover different fields of views, thereby supporting monoscopic imagery. In another example arrangement, the optical sensors are pointed in substantially a same direction to cover substantially a same field of view, thereby supporting stereoscopic imagery.

Abstract: A method of incorporating an augmented reality video image into a virtual environment comprises detecting a state of a real-world control object captured in a video image and augmenting the video image responsive to the state of the control object. The method further includes calculating trajectory parameters for an action with respect to a local coordinate system of the video image, responsive to the state of the control object, and embedding the augmented video image within a 3D virtual environment. The method also includes calculating the trajectory parameters for the action with respect to a local co-ordinate system of the 3D virtual environment, and rendering a graphical effect corresponding to the action within the 3D virtual environment.

Abstract: A head mountable display (HMD) is operable to detect the HMD's overall motion relative to its current orientation, and to display extra image material so that the extra image material moves in the same general direction as real objects would be seen by the user to move if the user were not wearing the HMD.

Abstract: A method generates a three-dimensional map of a region from successive images captured from different camera poses. The method includes a camera capturing images of the region; designating a subset of captured images as a set of keyframes each having respective sets of image position data representing image positions of landmark points detected as feature points in that image; for a newly captured image, generating a camera pose prediction; selecting an ordering of the landmark points; detecting whether an image region of the new image approximately matches an expected image position of a landmark point based on the predicted camera pose by detecting whether the image region is substantially identical to the image information associated with that landmark point; and refining the pose prediction from the detecting step. The selecting includes performing a statistical test on the landmark points and selecting the ordering according to the statistical test results.

Abstract: Provided is a portable electronic device including a signal processing unit, a controller that supplies a control signal to the signal processing unit, and a power generation unit that generates an electrical signal as power and supplies the generated electrical signal to the signal processing unit.

Abstract: A method generates a three-dimensional map of a region from successive images of that region captured from different positions. The method includes detecting feature points within the captured images; designating a subset of the captured images as a set of keyframes each having respective sets of measurement data representing image positions of landmark points detected as feature points in that image, where each keyframe is connected to at least one other keyframe in the set; and detecting whether candidate measurement data associated with a keyframe may be removed from the set of measurement data for that keyframe by detecting whether each keyframe, in the set of keyframes without the candidate measurement data, is still directly or indirectly connected to all of the other keyframes in the set of keyframes by a sequence of one or more connections. And in this case, the method includes removing that candidate measurement data.

Abstract: A method of assisting a first player of a videogame is provided. The method includes making a game state of the first player accessible to a second player. The game state describes a state of the videogame as played by the first player. The method also includes executing the videogame for the second player using the game state of the first player to define the initial state of the videogame for the second player, allowing the second player to play the videogame based upon the game state of the first player until a first predetermined criterion is met, and providing to the first player data for updating their game state in response to the play of the second player.

Abstract: A head mountable display (HMD) system comprises an eye position detector comprising one or more cameras configured to detect the position of each of the HMD user's eyes; a dominant eye detector configured to detect a dominant eye of the HMD user; and an image generator configured to generate images for display by the HMD in dependence upon the HMD user's eye positions, the image generator being configured to apply a greater weight to the detected position of the dominant eye than to the detected position of the non-dominant eye.

Abstract: A portable electronic device comprises a video camera for capturing a sequence of video images and an image processor operable to compress a first region of a current video image to a first extent and a second region of the current video image to a second, greater, extent to generate a processed current video image. The device includes a network communications interface operable to send processed video images to a server, and to receive control data from the server. The image processor is operable to augment the current video image with one or more computer graphic elements. Control data received from the server comprises image region information indicating a region of a video image estimated to comprise a predetermined marker and optionally augmentation instructions. Furthermore, the image processor is operable to define the first region of the current video image responsive to the image region information from the server.