Abstract: An information processing section of a game apparatus executes a program for implementing a step S100 of acquiring a camera image; a step S200 of detecting a marker; a step S400 of calculating a position and an orientation of a virtual camera; a step S600 of generating an animation in which a hexahedron is caused to appear on the marker when the start of a game is requested; a step S800 of generating an animation in which the hexahedron is unfolded so as to position thereon virtual objects representing targets; a step S900 of mapping the photographed image on objects; a step S1000 of taking an image of the objects by means of the virtual camera; and a step S1100, S1200 of displaying the camera image and an object image which is superimposed on the camera image.
Type:
Grant
Filed:
October 29, 2010
Date of Patent:
June 10, 2014
Assignees:
Nintendo Co., Ltd., Hal Laboratory Inc.
Abstract: A real camera image of a real space that is captured by a real camera is obtained. Color information about a plurality of sampling points in the real camera image is obtained. Next, an average color is calculated based on the obtained color information about the plurality of sampling points. Based on the calculated average color, parameters relating to the color and brightness of a light source set in a virtual space are set. A virtual object image is generated by capturing, with a virtual camera, an image of a virtual object existing in the virtual space, which virtual object is illuminated by the light source whose parameters have been set. Then, a superimposed image, in which the virtual object image is superimposed on the real camera image, is generated and displayed on a display device.
Type:
Grant
Filed:
March 22, 2011
Date of Patent:
April 15, 2014
Assignees:
Nintendo Co., Ltd., HAL Laboratory Inc.
Abstract: A storage medium having stored thereon a game program executable by a computer 21 of a game apparatus 1 including touch coordinate pair input means for outputting coordinate information based on a predetermined coordinate system in accordance with a touch operation performed by a player. A first object P1 and a second object P2 are displayed on a display screen based on first object position data DC3 and second object position data DC5. While input coordinate pairs are being detected, the first object position data DC3 is updated based on the input coordinate pairs. The second object position data DC5 is updated based on the first object position data DC3.
Type:
Grant
Filed:
February 13, 2006
Date of Patent:
April 1, 2014
Assignees:
Nintendo Co., Ltd., Hal Laboratory Inc.
Abstract: An input provided by a user is received from an input apparatus, and in accordance with the input, a current display position of an operation handler image to be displayed on the display apparatus is set. In accordance with the current display position of the operation handler image, a setting of information regarding an operation target to be operated by the user is changed, and a display position of the operation handler image used when the setting has been changed is retained. Then, the operation handler image is displayed on the display apparatus at the set current display position, and a past position image indicating at least one of the retained past display positions is displayed on the display apparatus.
Type:
Application
Filed:
March 5, 2013
Publication date:
February 13, 2014
Applicants:
HAL Laboratory, Inc., Nintendo Co., Ltd.
Abstract: An information processing section of a game apparatus executes a program for implementing a step S100 of acquiring a camera image; a step S200 of detecting a marker; a step S400 of calculating a position and an orientation of a virtual camera; a step S600 of generating an animation in which layed-flat surfaces of a hexahedron appear, and the hexahedron is folded so as to confine virtual objects representing targets therein when a stage is cleared; a step S800 of generating an animation in which the folded hexahedron is unfolded so as to position different virtual objects thereon; a step S900 of mapping the photographed image on objects; a step S1000 of taking an image of the objects by means of the virtual camera; and a step S1100, S1200 of displaying the camera image and an object image which is superimposed on the camera image.
Type:
Grant
Filed:
October 28, 2010
Date of Patent:
February 11, 2014
Assignees:
Nintendo Co., Ltd., HAL Laboratory Inc.
Abstract: An example information processing device displays a partial area of a panoramic video on a display device. A display range of the panoramic video to be displayed on the display device is determined based on an input made on a predetermined input device. The information processing device accepts an input of additional information for the panoramic video being displayed on the display device. Moreover, input information is stored in a storage unit, the input information including the additional information and input range information with which it is possible to identify a display range when the additional information was accepted and/or a position within the display range. The information processing device outputs the additional information together with the panoramic video based on the input range information when the panoramic video is played with the additional information having been stored.
Type:
Application
Filed:
April 29, 2013
Publication date:
December 5, 2013
Applicants:
HAL Laboratory, Inc., NINTENDO CO., LTD.
Abstract: A computer readable storage medium storing an information processing program causes a computer to function as display control means, coordinate detecting means, and object selecting means. The display control means displays on a display device at least a portion of a virtual world in which a plurality of objects are provided. The coordinate detecting means detects input coordinates input by the pointing device. The object selecting means, when the input coordinates indicate any of the plurality of objects, selects the indicated object as a target to be operated, and when the input coordinates indicate none of the plurality of objects, selects at least one object satisfying a predetermined condition of the plurality of objects as a target to be operated.
Type:
Grant
Filed:
October 2, 2009
Date of Patent:
September 11, 2012
Assignees:
Nintendo Co., Ltd., Hal Laboratory Inc.
Abstract: A moving character and a background image are displayed on a display screen with a touch panel thereon. When the player operates the touch panel to draw a line in an intended path extending between a start point and an end point along which the player wishes to guide the moving character, an operation trace image having the shape of the line drawn is displayed on the display screen. Then, the moving character moves along or in parallel to the operation trace image. The operation trace image is gradually erased after a predetermined amount of time elapses. Thus, it is possible to provide a video game device and a video game program in which the player can influence the moving path or the moving direction of the player (moving) character based on the shape and/or the direction of the line drawn by the player.
Type:
Grant
Filed:
October 2, 2009
Date of Patent:
May 1, 2012
Assignees:
Nintendo Co., Ltd., HAL Laboratory Inc.
Abstract: A game apparatus includes a CPU, and the CPU executes a game process. When a player character encounters an enemy character in a game world, a battle screen is displayed on a monitor. On the battle screen, an input pattern is displayed, and background music (BGM) is output from a speaker. A player determines an operation timing based on the input pattern and the BGM (drum part). If there is a high level of coincidence between the operation timing by the player and a timing of the music pattern, damage which the player character applies to the enemy character and experienced obtained by the player character increases.
Type:
Grant
Filed:
April 22, 2004
Date of Patent:
April 3, 2012
Assignees:
HAL Laboratory, Inc., Nintendo Co., Ltd.
Abstract: A real camera image of a real space that is captured by a real camera is obtained. Color information about a plurality of sampling points in the real camera image is obtained. Next, an average color is calculated based on the obtained color information about the plurality of sampling points. Based on the calculated average color, parameters relating to the color and brightness of a light source set in a virtual space are set. A virtual object image is generated by capturing, with a virtual camera, an image of a virtual object existing in the virtual space, which virtual object is illuminated by the light source whose parameters have been set. Then, a superimposed image, in which the virtual object image is superimposed on the real camera image, is generated and displayed on a display device.
Type:
Application
Filed:
March 22, 2011
Publication date:
March 29, 2012
Applicants:
HAL Laboratory Inc., NINTENDO CO., LTD.
Abstract: A marker present in a real space is detected from each of a real image for a left eye and a real image for a right eye. The position and the orientation of each of imaging sections relative to the marker are calculated. A left virtual camera and a right virtual camera are set in accordance with the positions and the orientations of the imaging sections. A virtual model having a planar shape is placed in a marker coordinate system, and areas in the real image for a left eye and the real image for a right eye that correspond to the virtual model are set as a left texture area and a right texture area, respectively. Each of images included in a left texture area and a right texture area is applied, as a texture, to a deformation object into which the virtual model is deformed.
Type:
Application
Filed:
September 23, 2011
Publication date:
March 29, 2012
Applicants:
HAL Laboratory Inc., NINTENDO CO., LTD.
Abstract: An information processing apparatus has upper and lower LCDs different in width and an inputter such as a touch panel, or the like. A computer of the information processing apparatus displays, out of information being made up of plurality of pages, information of a predetermined page on the upper and lower LCDs so as to be fit into the width of the lower LCD, and displays, when there is a previous or next page previous or next to the predetermined page, a part of the previous or next page at blank potions on both sides of the upper LCD. Then, in response to an input from the inputter, the information of the page displayed on the upper and lower LCDs is switched to the information corresponding to the previous or next page displayed at the blank potions on the upper LCD.
Type:
Application
Filed:
December 28, 2010
Publication date:
March 29, 2012
Applicants:
Hal Laboratory, Inc., NINTENDO CO., LTD.
Inventors:
Yasushi MATSUBARA, Yumi Todo, Shinichi Kawaji
Abstract: A game apparatus obtains a real world image (71L, 71R) taken with an imaging device, and detects a marker (60) from the real world image (71L, 71R). The game apparatus calculates a relative position of the imaging device and the marker (60) on the basis of the detection result of the marker (60), and sets a virtual camera in a virtual space on the basis of the calculation result. The game apparatus locates a selection object (01) that is associated with a menu item selectable by a user and is to be selected by the user, as a virtual object at a predetermined position in the virtual space that is based on the position of the marker (60). The game apparatus takes an image of the virtual space with the virtual camera, generates an object image of the selection object (01), and generates a superimposed image in which the object image is superimposed on the real world image (71L, 71R).
Type:
Application
Filed:
April 15, 2011
Publication date:
March 29, 2012
Applicants:
HAL Laboratory Inc., NINTENDO CO., LTD.
Abstract: A part of a content 61 is displayed on a display screen. Display switching means discontinuously switches the part to another part at least partially different from the part. When the switching is performed, a scrolling indicator 57 that indicates the position of the part in the entirety of the content 61 is displayed.
Type:
Application
Filed:
December 23, 2010
Publication date:
March 29, 2012
Applicants:
HAL Laboratory Inc., NINTENDO CO., LTD.
Inventors:
Shohei Mizutani, Tsubasa Sakaguchi, Yumi Todo, Takashi Saito
Abstract: For generating a destination image (a left-eye image) from an original image and a height map thereof, the height of the height map of the original image is compared with the height of the height map of the destination image, and if a pixel of the original image is higher, the pixel of the original image is copied to a pixel of the destination image. After the pixel of the original image is copied to the pixel of the destination image, the height of the pixel of the original image is decremented. The pixel of the original image is copied in the rightward direction to pixels of the destination image until the height of the pixel of the original image becomes 0 or until a height of the pixel of the destination image becomes lower than that of the pixel of the original image. The same processes are performed on each pixel of the original image, and thereby the left-eye image is generated.
Type:
Application
Filed:
June 9, 2011
Publication date:
January 26, 2012
Applicants:
HAL Laboratory Inc., NINTENDO CO., LTD.
Abstract: In accordance with a size of a drawing area and a character size, the number of characters arrangeable in the drawing area is calculated. Based on the calculated number of characters, whether a character string in the obtained character size is arranged in the drawing area or the character string in a character size different from the obtained character size is arranged in the drawing area is selected, and the character string is arranged in the drawing area by using the determined character size. The arranged character string is displayed on the display apparatus.
Type:
Grant
Filed:
February 15, 2008
Date of Patent:
December 20, 2011
Assignees:
Nintendo Co., Ltd., Hal Laboratory Inc.
Abstract: A game device 10 sets a reference distance for a distance from a real camera in an image-capturing direction, and displays a right captured image and a left captured image in a display area so that a reference point, which is a point that is away from the real camera by the reference distance, is displayed at a center in the display area. Thus, where an image produced by using an augmented reality technique is stereoscopically displayed, it is possible to display a virtual image in a manner easy to view.
Type:
Application
Filed:
June 7, 2011
Publication date:
December 15, 2011
Applicants:
HAL Laboratory, Inc., NINTENDO CO., LTD.
Abstract: A game device 10 displays an image on an upper LCD 22 capable of producing stereoscopic display using two images. The game device 10 determines a shift amount from a reference position for a frame 62 of a predetermined size representing a display area of each captured image. Here, for at least one of the frames, if the frame 62 moved by the shift amount protrudes out of a captured image 55, the size of each frame is changed so that the frame 62 does not protrude out of the captured image 55. The game device 10 displays an image in the frame of each of two captured images in a predetermined area on a screen of a stereoscopic display device.
Type:
Application
Filed:
June 7, 2011
Publication date:
December 15, 2011
Applicants:
HAL Laboratory, Inc., NINTENDO CO., LTD
Abstract: A game device 10 calculates, for each of two real cameras, position/orientation information representing a relative position and orientation with respect to a predetermined image-capture object, and based on this calculates a camera interval in the predetermined coordinate system. Then, it calculates correspondence information between a unit length in the predetermined coordinate system and a unit length in a real space by using the calculated distance in the predetermined coordinate system and the camera interval in the real world.
Type:
Application
Filed:
June 7, 2011
Publication date:
December 15, 2011
Applicants:
HAL Laboratory, Inc., NINTENDO CO., LTD.
Abstract: An information processing section of a game apparatus executes a program which includes: acquiring a real world image; setting the most recent view matrix of a virtual camera based on a detected marker S204; reading the previous view matrix S206; calculating correction view matrixes so as to change a blending ratio at which the most recent view matrix is blended depending on a distance S208 to S210; selecting the correction view matrix such that the longer the distance between an object and the marker is, the lower the blending ratio is; and rendering a virtual object in a frame buffer in a superimposed manner by using the selected correction view matrix.
Type:
Application
Filed:
January 5, 2011
Publication date:
December 15, 2011
Applicants:
HAL Laboratory Inc., NINTENDO CO., LTD.