Abstract: A more endearing robot includes an operation unit that causes the robot to operate, a viewing direction determiner that determines whether a viewing direction of a predetermined target is toward the robot or not, and an operation controller that controls the operation unit based on a result of determination by the viewing direction determiner.

Abstract: A mobile apparatus according to the present embodiment includes a voice input unit configured to detect a signal from a user. In a case where the voice input unit detects a signal from the user and as a detection result of the signal from the user, it is determined that there is a signal from the user, the mobile apparatus performs sound source localization and specifies a location or direction in which the detected signal from the user is given. In a case where it is determined that the mobile apparatus is not able to move to the location where the signal from the user is given, a voice output unit configured to output a voice signal, a driving unit configured to move the mobile apparatus, and a light emitting unit configured to emit light performs predetermined control.

Abstract: The present invention is to reduce the time required to detect an object after completion of the rotation of a head or a body of a robot. A robot 100 includes a camera 111, and a control unit 127 which determines an overlapping area between a first image captured with the camera 111 at first timing and a second image captured with the camera 111 at second timing later than the first timing to detect an object included in an area of the second image other than the determined overlapping area.

Abstract: A robot determines whether a voice is a voice emanated directly from an actual person or is a voice output from a speaker of an electronic device. A controller of a robot detects a voice by means of microphones, determines whether or not a voice generating source of the detected voice is a specific voice generating source, and controls, based on a result of the determination, the robot by means of a neck joint and a chassis.

Abstract: An information processing apparatus comprises a learner and a processing unit. The learner learns a phoneme sequence generated from a voice as an emotion phoneme sequence, in accordance with relevance between the phoneme sequence and an emotion of a user. The processing unit executes processing pertaining to emotion recognition in accordance with a result of learning by the learner. The information processing apparatus suppresses execution of a process that does not conform to an emotion of a user.

Abstract: A feature extractor extracts feature quantities from a digitized speech signal and outputs the feature quantities to a likelihood calculator. A distance determiner determines the distance between a user providing speech and a speech input unit. The likelihood calculator selects registered expressions for speech recognition from a recognition target table based on the determined distance, to be used in calculation of likelihoods at the likelihood calculator. The likelihood calculator calculates likelihoods for the selected registered expressions based on the feature quantities extracted by the feature extractor, and outputs one of the registered expressions having the maximum likelihood as a result of speech recognition.

Abstract: A speech determiner determines whether or not a target individual is speaking when facial images of the target individual are captured. An emotion estimator estimates the emotion of the target individual using the facial images of the target individual, on the basis of the determination results of the speech determiner.

Abstract: An imaging apparatus generates a 3D model using a photographed image of a subject and generates a 3D image based on the 3D model. When a corresponding point corresponding to a point forming the 3D model does not form a 3D model generated using a photographed image photographed at a different photographing position, the imaging apparatus determines that the point is noise, and removes the point determined as noise from the 3D model. The imaging apparatus generates a 3D image based on the 3D model from which the point determined as noise is removed.

Abstract: The matching processor acquires the key information such as position information and/or the like by the key information acquirer, and notifies to an external apparatus via the communicator. The matching processor stores the acquired key information in the storer corresponding to the identification information which is acquired from the external apparatus. When the acquired identification information does not exist in a AR data management table, the matching processor acquires the AR data by notifying the identification information to the external apparatus. When there is no empty record in a key information management table, key information of which usage date and time is old is considered as a deletion target. Moreover, when there is no empty record in the AR data management table, the AR data of which usage date and time is old is considered as the deletion target.

Abstract: The utility of a service using AR is improved. The information display apparatus which applies an information display according to augmented reality (AR) acquires a reference image for matching with a subject in a captured image and scale information which shows a scale of the subject in the reference image from an information provision apparatus. Then, an inputter-outputter of the information display apparatus displays the captured image as well as a distribution of the reference images by a scale of the subject. On this distribution display, a guide display according to the scale of the subject in the captured image is performed. This guide display moves on the distribution display corresponding to a change of an angle of view. Accordingly, it is easily set the angle of view by which the matching using the acquired reference image can be performed appropriately, and the convenience improves.

Abstract: In three-dimensional modeling apparatus, an image obtaining section obtains image sets picked up by stereoscopic camera. A generating section generates three-dimensional models. A three-dimensional model selecting section selects a first three-dimensional model and a second three-dimensional model to be superimposed on the first three-dimensional model among generated three-dimensional models. A extracting section extracts first and second feature points from the selected first and second three-dimensional model. A feature-point selecting section selects feature points having a closer distance to stereoscopic camera from the extracted first and second feature points. A parameter obtaining section obtains a transformation parameter for transforming a coordinate of the second three-dimensional model into a coordinate system of the first three-dimensional model. A transforming section transforms the coordinate of the second three-dimensional model into the coordinate system of the first three-dimensional model.

Abstract: An imaging apparatus generates a 3D model using a photographed image of a subject and generates a 3D image based on the 3D model. When a corresponding point corresponding to a point forming the 3D model does not form a 3D model generated using a photographed image photographed at a different photographing position, the imaging apparatus determines that the point is noise, and removes the point determined as noise from the 3D model. The imaging apparatus generates a 3D image based on the 3D model from which the point determined as noise is removed.

Abstract: An imaging apparatus generates a 3D model using a photographed image of a subject and generates a 3D image based on the 3D model. When a corresponding point corresponding to a point forming the 3D model does not form a 3D model generated using a photographed image photographed at a different photographing position, the imaging apparatus determines that the point is noise, and removes the point determined as noise from the 3D model. The imaging apparatus generates a 3D image based on the 3D model from which the point determined as noise is removed.

Abstract: A server sends to a client a message instructing movement of a display apparatus so that cameras comprising a view for creating a three-dimensional model can shoot a screen of a display apparatus. After movement is complete, the server causes an imaging parameter computation pattern image to be displayed on the screen of the display apparatus and instructs the client to cause the displayed pattern image to be shot by cameras. The server acquires images shot by the cameras from the client and seeks imaging parameters of the cameras on the basis of the pattern image included in the acquired images.

Abstract: A 3D modeling apparatus includes: a generator configured to generate 3D models of a subject based on pairs of images; a selector configured to select a first 3D model and a second 3D model from the 3D models, wherein the second 3D model is to be superimposed on the first 3D model; an extracting unit configured to extract first feature points from the first 3D model and extract second feature points from the second 3D model; an acquiring unit configured to acquire coordinate transformation parameters based on the first and second feature points; a transformation unit configured to transform coordinates of the second 3D model into coordinates in a coordinate system of the first 3D model, based on the coordinate transformation parameters; and a combining unit configured to superimpose the second 3D model having the transformed coordinates on the first 3D model.

Abstract: A three-dimensional modeling unit creates a three-dimensional model from a pair of images stored in a keyframe storage in every several frame periods. A feature point detection unit detects feature points in images stored in the keyframe storage. Then, a positional change estimate unit estimates positional change of the detected feature points in a latest image and calculates conversion parameters for converting the created three-dimensional model to a three-dimensional model corresponding to the latest image based on the estimation results. Then, a reconstruction unit reconstructs the created three-dimensional model using the calculated conversion parameters and a image output unit outputs it to a display device on a frame period basis.

Abstract: A three-dimensional model creation system stores view information and camera information for cameras with which each client is provided, in a server for each client. Furthermore, when a three-dimensional model is created from a captured pair of images, each client sends the pair images to the server, and the server creates a three-dimensional model on the basis of camera information stored in advance and the received pair images.

Abstract: A server sends to a client a message instructing movement of a display apparatus so that cameras comprising a view for creating a three-dimensional model can shoot a screen of a display apparatus. After movement is complete, the server causes an imaging parameter computation pattern image to be displayed on the screen of the display apparatus and instructs the client to cause the displayed pattern image to be shot by cameras. The server acquires images shot by the cameras from the client and seeks imaging parameters of the cameras on the basis of the pattern image included in the acquired images.

Abstract: The matching processor acquires the key information such as position information and/or the like by the key information acquirer, and notifies to an external apparatus via the communicator. The matching processor stores the acquired key information in the storer corresponding to the identification information which is acquired from the external apparatus. When the acquired identification information does not exist in a AR data management table, the matching processor acquires the AR data by notifying the identification information to the external apparatus. When there is no empty record in a key information management table, key information of which usage date and time is old is considered as a deletion target. Moreover, when there is no empty record in the AR data management table, the AR data of which usage date and time is old is considered as the deletion target.

Abstract: The utility of a service using AR is improved. The information display apparatus which applies an information display according to augmented reality (AR) acquires a reference image for matching with a subject in a captured image and scale information which shows a scale of the subject in the reference image from an information provision apparatus. Then, an inputter-outputter of the information display apparatus displays the captured image as well as a distribution of the reference images by a scale of the subject. On this distribution display, a guide display according to the scale of the subject in the captured image is performed. This guide display moves on the distribution display corresponding to a change of an angle of view. Accordingly, it is easily set the angle of view by which the matching using the acquired reference image can be performed appropriately, and the convenience improves.