INFORMATION PROCESSING APPARATUS AND INFORMATION PROCESSING METHOD
An information processing apparatus may include an obtaining unit to obtain a number of users from information on detection of a face region including a face in a captured image provided at the apparatus. The apparatus also may include a setting unit to set a display region for content and a display region for a captured image in a display screen; and a display image generation unit to generate a display image to be displayed in the display region for a captured image, in accordance with the information on the detection, the number of users, and the display region set for a captured image.
Latest SONY CORPORATION Patents:
- POROUS CARBON MATERIAL COMPOSITES AND THEIR PRODUCTION PROCESS, ADSORBENTS, COSMETICS, PURIFICATION AGENTS, AND COMPOSITE PHOTOCATALYST MATERIALS
- POSITIONING APPARATUS, POSITIONING METHOD, AND PROGRAM
- Electronic device and method for spatial synchronization of videos
- Surgical support system, data processing apparatus and method
- Information processing apparatus for responding to finger and hand operation inputs
The present application is a continuation of U.S. patent application Ser. No. 13/235,609, filed on Sep. 19, 2011, which claims priority from Japanese Patent Application No. 2010-221550 filed in the Japan Patent Office on Sep. 30, 2010 and Japanese Patent Application No. 2010-289780 filed in the Japan Patent Office on Dec. 27, 2010, the entire contents of which are hereby incorporated by reference.
BACKGROUNDThe present disclosure relates to information processing apparatus and an information processing method.
In general, as devices used for communication between users being in different locations, telephones, so-called videophones, and video conference systems have been used. In addition, text chat and video chat including video images and audio have also been performed through the Internet using personal computers.
Therefore, electronic devices and like devices have been offering high functionalities and an increasing range of functions. For example, a television receiver includes a network communication function which enables not only reception of video and audio content of a program from a broadcasting station and display of the content but also transmission of various information to and reception of various information from another receiver.
For example, Japanese Unexamined Patent Application Publication No. 2006-50370 discloses a technique of displaying, when a user views program content of television broadcasting using a television receiver, information on registered other users (such as thumbnail images of the other users, and names, channels, and video images of content viewed by the other users) together with the program content.
Here, when display of content and display of an image externally received through network communication (hereinafter referred to as a “communication image”) are performed in parallel in a display device such as a television receiver, a PIP (Picture in Picture) display method or a POP (Picture on Picture) display method is generally used.
However, there arises a problem in that, when the PIP display method or the POP display method is used, a portion of the displayed content is hidden by the displayed communication image, and accordingly, it is difficult to view the content. Furthermore, in general, since a region for displaying the communication image is limited in a display screen, a size of the communication image is reduced in the display screen. Therefore, there arises a problem in that sizes of images of other users included in the communication image become small, and accordingly, it is difficult to identify the users and image quality of the communication image is deteriorated.
Accordingly, it is desirable to provide an improved information processing apparatus and an improved information processing method which have novelty and which are capable of appropriately performing display of content and display of a communication image when the content and the communication image are displayed in parallel.
SUMMARYIn accordance with one aspect of the embodiments, an information processing apparatus may include an obtaining unit to obtain a number of users from information on detection of a face region including a face in a captured image provided at the apparatus. The apparatus also may include a setting unit to set a display region for content and a display region for a captured image in a display screen. Further, the apparatus may include a display image generation unit to generate a display image to be displayed in the display region for a captured image, in accordance with the information on the detection, the number of users, and the display region set for a captured image.
In accordance with another aspect of the embodiments, a method may include obtaining a number of users from information on detection of a face region including a face in a captured image; setting a display region for content and a display region for a captured image in a display screen; and generating a display image to be displayed in the display region for a captured image, in accordance with the information on the detection, the number of users, and the display region set for a captured image. In such method, at least one of the obtaining, the setting and the generating may be by a processor.
In accordance with another aspect of the embodiments, a non-transitory recording medium may be recorded with a computer-readable program having instructions executable by a processor. The program may include obtaining a number of users from information on detection of a face region including a face in a captured image; setting a display region for content and a display region for a captured image in a display screen; and generating a display image to be displayed in the display region for a captured image, in accordance with the information on the detection, the number of users, and the display region set for a captured image.
As described above, display of content and display of a communication image may be appropriately performed in parallel.
Embodiments of the present disclosure will be described with reference to the accompanying drawings. Note that, in this specification and the drawings, components having substantially the same functions are denoted by the same reference numerals so that redundant descriptions are avoided.
Note that a description will be made in the following order.
1. Display System
2. Functional Configuration of Information Processing Apparatus (First Embodiment)
3. Hardware Configuration of Information Processing Apparatus
4. Display Process
5. Examples
6. Functional Configuration of Information Processing Apparatus (Second Embodiment)
1. DISPLAY SYSTEMFirst, a display system according to an embodiment of the present disclosure will be described.
In
The display device 102 is an example of a display device of the present disclosure, and displays still images or moving images in accordance with driving signals. For example, the display device 102 displays a still image or a moving image using liquid crystal. Note that the display device 102 may display a still image or a moving image using self-luminous display device such as an organic EL (Electroluminescence).
The image pickup device 104 which is an example of an image pickup device according to the present disclosure is disposed in an upper center portion of the display device 102 and captures a subject located in a display direction of the display device 102. The image pickup device 104 may take still images or moving images using a CCD (Charge Coupled Device) image sensor or may take still images or moving images using a CMOS (Complementary Metal Oxide Semiconductor) image sensor.
Note that, although the image pickup device 104 is disposed in the upper center portion of the display device 102 in this embodiment, a location where the image pickup device 104 is disposed is not limited to the upper center portion of the display device 102. For example, the image pickup device 104 may be disposed in a lower center portion of the display device 102. Furthermore, although the single image pickup device 104 is disposed in this embodiment, the number of image pickup devices 104 is not limited to one. For example, two or more image pickup devices 104 may be disposed. Furthermore, although the display device 102 and the image pickup device 104 are integrally configured in this embodiment, the display device 102 and the image pickup device 104 may be separately configured.
Note that the display system 100 may include a sensor (not shown) which detects presence or absence of a user positioned in front of the display device 102 and a signal reception unit (not shown) capable of receiving a control signal through an infrared communication or a wireless communication from a remote controller (not shown). Furthermore, the sensor may detect a distance between the display device 102 and the user positioned in front of the display device 102.
The display device 102 of this embodiment may display content corresponding to a still image or a moving image and images captured by other information processing apparatuses 500 and 700 shown in
Furthermore, the image pickup device 104 of this embodiment may capture a still image and a moving image regarding a user A who is watching the display screen of the display device 102 shown in
Next, a functional configuration of an information processing apparatus according to a first embodiment of the present disclosure will be described.
In
The input unit 202 receives a captured image which is generated by the image pickup device 104 through image capturing. The captured image generated by the image pickup device 104 through the image capturing is an example of another captured image according to the present disclosure. Then, the input unit 202 transmits the received (input) captured image to the communication unit 212. Note that the input unit 202 may transmit the received captured image to the detection unit 204 and the display image generation unit 210. Furthermore, the input unit 202 accepts an input for a setting of a display ratio of a display region for content to a display region for captured images supplied from the information processing apparatuses 500 and 700 in a display screen of the display device 102 performed by the user A, for example. Note that the input unit 202 may accept an input for a setting of a display ratio of a display region for content to a display region for captured images supplied from the information processing apparatus 200, 500, and 700 in the display screen of the display device 102 performed by the user A. Then, the input unit 202 transmits information on the received input for a setting of a display ratio to the setting unit 208. The display region for captured images supplied from the information processing apparatuses 200, 500, and 700 is an example of a second display region according to the present disclosure.
The detection unit 204 which is an example of a detection unit according to the present disclosure receives captured images which are supplied from the information processing apparatuses 500 and 700 and which are received by the communication unit 212 and detects face regions including faces of the users B, C, and D in the received captured images. Then, the detection unit 204 transmits information on the face regions as results of the detection to the head-count obtaining unit 206 and the display image generation unit 210. Note that the detection unit 204 may receive a captured image supplied from the input unit 202 and detect a face region including a face of the user A in the received captured image. Then, the detection unit 204 may transmit information on the face region including the face of the user A as a result of the detection to the head-count obtaining unit 206, the display image generation unit 210, and the communication unit 212. A technique disclosed in Japanese Unexamined Patent Application Publication No. 2007-65766 and a technique disclosed in Japanese Unexamined Patent Application Publication No. 2005-44330 may be used for the detection of a face region performed on a captured image by the detection unit 204. Hereinafter, the detection of a face region will be briefly described.
To detect the face of the user A in the captured image, for example, a face position, a face size, and a face direction are individually detected in the received captured image. When the face position and the face size are detected, a portion corresponding to a face image may be extracted from the image. Then, in accordance with the extracted face image and information on the face direction, characteristic portions of the face (face feature positions) such as eye blows, eyes, a nose, and a mouth are detected. A method referred to as an AAM (Active Appearance Models) method, for example, may be used for the detection of the face feature positions.
After the face feature positions are detected, local feature values of the detected face feature positions are individually calculated. When the local feature values are calculated and the calculated local feature values are stored along with the face image, a face is identified in the image captured by the image pickup device 104. A technique disclosed in Japanese Unexamined Patent Application Publication No. 2007-65766 or a technique disclosed in Japanese Unexamined Patent Application Publication No. 2005-44330 may be used as a method for identifying a face, and therefore, a detailed description thereof is omitted here. Furthermore, in accordance with the face image and the face feature positions, a gender and an age of a face included in the received captured image may be determined. Moreover, by storing information on faces in advance, the face of the user included in the received captured image may be obtained from among the stored faces so as to specify the user.
The head-count obtaining unit 206 which is an example of an obtaining unit according to the present disclosure receives information on the face regions including the faces of the users B, C, and D detected by the detection unit 204. Then, the head-count obtaining unit 206 obtains the number of users who use the information processing apparatuses 500 and 700 in accordance with the received information on the face regions. Thereafter, the head-count obtaining unit 206 transmits a result of the obtainment of the number of users who use the information processing apparatuses 500 and 700 to the display image generation unit 210. Note that the head-count obtaining unit 206 may receive information on a face region including the face of the user A detected by the detection unit 204 and obtain the number of users who use the information processing apparatus 200 in accordance with received information on the face region including the face of the user A. Then, the head-count obtaining unit 206 may transmit a result of the obtainment of the number of users who use the information processing apparatus 200 to the display image generation unit 210 and the display controller 216. Furthermore, when the communication unit 212 receives the information on the face regions including the faces of the users B and C detected in the image captured using the display system 400 and information on the face region including the face of the user D detected in the image captured using the display system 600, the head-count obtaining unit 206 may receive the information on the face regions and obtain the number of users who use the information processing apparatuses 500 and 700 in accordance with the received information on the face regions. In this case, the detection unit 204 described above may not detect the face regions including the faces of the users B, C and D in the captured images supplied from the information processing apparatuses 500 and 700.
The setting unit 208 which is an example of a setting unit according to the present disclosure receives information on the input for the setting of the display ratio from the input unit 202 and sets the display region for content and a display region for captured images supplied from the information processing apparatuses 500 and 700 in the display screen of the display device 102 in accordance with the received information on the input for the setting of the display ratio. Furthermore, the setting unit 208 may set a display region for content and a display region for captured images supplied from the information processing apparatuses 200, 500, and 700 in the display screen of the display device 102 in accordance with the received information on the input for the setting of the display ratio. Then, the setting unit 208 transmits information on the set display region for captured images to the display image generation unit 210 and the display controller 216 and transmits information on the set display region for content to the display controller 216. For example, the setting unit 208 sets a size of the display region for content and a size of the display region for captured images supplied from the information processing apparatuses 500 and 700 in the display screen of the display device 102 and transmits information on the set size of the display region for content and information on the set size of the display region for captured images.
The display image generation unit 210 which is an example of a generation unit according to the present disclosure receives information on the face regions including the faces of the users B, C, and D from the detection unit 204, receives the result of the obtainment of the number of users who use the information processing apparatuses 500 and 700 from the head-count obtaining unit 206, receives the information on the display region for captured images supplied from the information processing apparatuses 500 and 700 from the setting unit 208, and receives the image captured using the display system 400 and the image captured using the display system 600 which are received by the communication unit 212. Then, in accordance with the received information on the face regions including the faces of the users B, and C and D, the received result of the obtainment of the number of users who use the information processing apparatuses 500 and 700, and the information on the display region for captured images supplied from the information processing apparatuses 500 and 700, the display image generation unit 210 generates a display image to be displayed in the display region for captured images supplied from the information processing apparatuses 500 and 700 included in the display screen of the display device 102 using the image captured by the display system 400 and the image captured by the display system 600. Thereafter, the display image generation unit 210 transmits the generated display image to the display controller 216.
For example, the display image generation unit 210 extracts a portion of the image captured by the display system 400 corresponding to one third of the display region for captured images such that at least face feature portions of the user B are included in the portion in accordance with the information on the face region including the face of the user B, the result of the obtainment of the number of users who use the information processing apparatuses 500 and 700, that is, information representing that the number of users is three, and the information on the display region for captured images supplied from the information processing apparatuses 500 and 700 such as information on the size of the display region. Furthermore, the display image generation unit 210 extracts a portion of the image captured by the display system 400 corresponding to one third of the display region for captured images such that at least face feature portions of the user C are included in the portion in accordance with the information on the face region including the face of the user C, the information representing that the number of users who use the information processing apparatuses 500 and 700 is three, and the information on the size of the display region for captured images supplied from the information processing apparatuses 500 and 700. Moreover, the display image generation unit 210 extracts a portion of the image captured by the display system 600 corresponding to one third of the display region for captured images such that at least face feature portions of the user D are included in the portion in accordance with the information on the face region including the face of the user D, the information representing that the number of users who use the information processing apparatuses 500 and 700 is three, and the information on the size of the display region for captured images supplied from the information processing apparatuses 500 and 700. Then, the display image generation unit 210 arranges the extracted captured images in the display region for captured images supplied from the information processing apparatuses 500 and 700 included in the display screen of the display device 102 such that the faces of the users who use the information processing apparatuses 500 and 700 are arranged in a horizontal direction, in a vertical direction, or in a matrix so that the display image described above is generated.
When receiving the image captured by the display system 100 from the input unit 202, receiving the information on the face region including the face of the user A and the information on the face regions including the faces of the users B, C, and D from the detection unit 204, receiving the result of the obtainment of the number of users who use the information processing apparatus 200 and the result of the obtainment of the number of users who use the information processing apparatuses 500 and 700 from the head-count obtaining unit 206, receiving the information on the display regions for captured images of the information processing apparatuses 200, 500, and 700 from the setting unit 208, and receiving the image captured by the display system 400 and the image captured by the display system 600 which are received by the communication unit 212, the display image generation unit 210 may generate a display image to be displayed in the display region for captured images supplied from the information processing apparatuses 200, 500, and 700 included in the display screen of the display device 102 using the image captured by the display system 100, the image captured by the display system 400, and the image captured by the display system 600 in accordance with the received information on the face region including the face of the user A, the received information on the face region including the faces of the users B and C, the received information on the face region including the face of the user D, the received result of the obtainment of the number of users who use the information processing apparatus 200, the received result of the obtainment of the number of users who use the information processing apparatuses 500 and 700, and the information on the display region for captured images supplied from the information processing apparatuses 200, 500, and 700.
In this case, the display image generation unit 210 extracts a portion of the image captured by the display system 100 corresponding to a quarter of the display region for captured images such that at least face feature portions of the user A are included in the portion in accordance with the information on the face region including the face of the user A, the result of the obtainment of the number of users who use the information processing apparatuses 200, 500, and 700, that is, information representing that the number of users is four, and the information on the display region for captured images supplied from the information processing apparatuses 200, 500, and 700 such as the information on the size of the display region. Furthermore, the display image generation unit 210 extracts a portion of the image captured by the display system 400 corresponding to a quarter of the display region for captured images such that at least face feature portions of the user B are included in the portion in accordance with the information on the face region including the face of the user B, the information representing that the number of users who use the information processing apparatuses 200, 500, and 700 is four, and the information on the size of the display region for the captured images supplied from the information processing apparatuses 500 and 700. Moreover, the display image generation unit 210 extracts a portion of the image captured by the display system 400 corresponding to a quarter of the display region for captured images such that at least face feature portions of the user C are included in the portion in accordance with the information on the face region including the face of the user C, the information representing that the number of users who use the information processing apparatuses 200, 500, and 700 is four, and the information on the size of the display region for captured images supplied from the information processing apparatuses 200, 500, and 700. Furthermore, the display image generation unit 210 extracts a portion of the image captured by the display system 600 corresponding to a quarter of the display region for captured images such that at least face feature portions of the user D are included in the portion in accordance with the information on the face region including the face of the user D, the information representing that the number of users who use the information processing apparatuses 200, 500, and 700 is four, and the information on the size of the display region for captured images supplied from the information processing apparatuses 200, 500, and 700. Then, the display image generation unit 210 arranges the extracted captured images in the display region for captured images supplied from the information processing apparatuses 200, 500, and 700 included in the display screen of the display device 102 such that the faces of the users who use the information processing apparatuses 200, 500, and 700 are arranged in the horizontal direction, in the vertical direction, or in a matrix to thereby generate the display image described above.
Note that, when the communication unit 212 receives the information on the face regions including the faces of the users B and C detected in the image captured by the display system 400 or the information on the face region including the face of the user D detected in the image captured by the display system 600, the display image generation unit 210 may receive the information on the face images and generate a display image in accordance with the information on the face regions received by the communication unit 212 instead of the information on the face regions detected by the detection unit 204.
Furthermore, the display image generation unit 210 may extract portions of the captured images such that invalid regions which are wasted regions are not included in the display image in accordance with the received information on the face regions to thereby generate the display image. Moreover, the display image generation unit 210 may extract portions of the captured images such that the same portions which display the same images are not included in the display image to thereby generate the display image. In addition, the display image generation unit 210 may generate a display image regarding a plurality of users as a single user when the users are positioned near one another in a captured image in accordance with received information on face regions.
The communication unit 212 which is an example of a reception unit according to the present disclosure receives an image captured using the display system 400 from the communication server 300 through the communication network 800. Furthermore, the communication unit 212 receives an image captured by the display system 600 from the communication server 300 through the communication network 800. Note that the communication unit 212 may directly receive an image captured by the display system 400 from the information processing apparatus 500 through the communication network 800. Similarly, the communication unit 212 may directly receive an image captured by the display system 600 from the information processing apparatus 700 through the communication network 800.
Moreover, the communication unit 212 may receive a captured image supplied from the input unit 202 and transmit the received captured image to the communication server 300 through the communication network 800. Furthermore, the communication unit 212 may receive the information on the face region including the user A detected in the image captured using the display system 100 by the detection unit 204 and transmit the received information on the face region to the communication server 300 through the communication network 800. Note that the communication unit 212 may directly transmit the received captured image and the information on the face region to the information processing apparatuses 500 and 700 through the communication network 800.
Furthermore, the communication unit 212 may receive the information on the face regions including the faces of the users B and C detected in the image captured using the display system 400 and the information on the face region including the face of the user D detected in the image captured using the display system 600 from the communication server 300 through the communication network 800. Note that the communication unit 212 may directly receive the information on the face regions including the faces of the users B and C detected in the image captured using the display system 400 from the information processing apparatus 500 through the communication network 800. Similarly, the communication unit 212 may directly receive the information on the face region including the face of the user D detected in the image captured using the display system 600 from the information processing apparatus 700 through the communication network 800.
The output unit 214 receives a signal used to drive the display device 102 from the display controller 216 and transmits the received signal to the display device 102.
The display controller 216 which is an example of a controller according to the present disclosure receives information on the display region for content from the setting unit 208 and the information on the display region for captured images supplied from the information processing apparatuses 500 and 700. Furthermore, the display controller 216 receives content corresponding to a still image or a moving image. Then, the display controller 216 transmits a signal for displaying the display image generated by the display image generation unit 210 in the display region for captured images supplied from the information processing apparatuses 500 and 700 included in the display screen of the display device 102 to the output unit 214. Moreover, the display controller 216 transmits a signal for displaying content having a reduced image size in the display region for content in the display screen of the display device 102 to the output unit 214.
Note that, when receiving the information on the display region for content and the information on the display region for captured images supplied from the information processing apparatuses, 200, 500, and 700 from the setting unit 208 and receiving the display image from the display image generation unit 210, the display controller 216 may transmit to the output unit 214 a signal for displaying the display image generated by the display image generation unit 210 in the display region for captured images supplied from the information processing apparatuses 200, 500, and 700 included in the display screen of the display device 102.
3. HARDWARE CONFIGURATION OF INFORMATION PROCESSING APPARATUSNext, a hardware configuration of the information processing apparatus 200 shown in
In
The MPU 230 includes an MPU (Micro Processing Unit) and an integrated circuit in which a plurality of circuits are integrated to realize various functions such as image processing and functions as a controller (not shown) which controls the entire information processing apparatus 200. Furthermore, in the information processing apparatus 200, the MPU 230 functions as the detection unit 204, the head-count obtaining unit 206, the setting unit 208, the display image generation unit 210, and the display controller 216.
The ROM 232 stores programs and control data such as calculation parameters used by the MPU 230. The RAM 234 temporarily stores programs executed by the MPU 230, for example.
The recording medium 236 stores applications, for example. Here, examples of the recording medium 236 include a magnetic recording medium such as a hard disk and a nonvolatile memory such as an EEPROM (Electrically Erasable and Programmable Read Only Memory), a flash memory, an MRAM (Magnetoresistive Random Access Memory), an FeRAM (Ferroelectric Random Access Memory), or a PRAM (Phase change Random Access Memory). Furthermore, the information processing apparatus 200 may include a recording medium 236 which is detachable from the information processing apparatus 200.
The input/output interface 238 is connected to the operation input device 240 and the display device 242, for example. Furthermore, the input/output interface 238 functions as the input unit 202 and the output unit 214. The operation input device 240 functions as an operation unit (not shown), and the display device 242 functions as a display unit 254 which will be described with reference to
The communication interface 244 which is a communication unit included in the information processing apparatus 200 functions as the communication unit 212 which performs communication with an external apparatuses including the server 300 and the information processing apparatuses 500 and 700 through the network 800 (or directly) in a wireless/wired manner. Note that examples of the communication interface 244 include a combination of a communication antenna and an RF circuit (wireless communication), a combination of an IEEE802.15.1 port and a transmission/reception circuit (wireless communication), a combination of an IEEE802.11b port and a transmission/reception circuit (wireless communication), and a combination of a LAN terminal and a transmission/reception circuit (wired communication).
Note that the hardware configuration of the information processing apparatus 200 according to this embodiment is not limited to the configuration shown in
Furthermore, the information processing apparatus 200 may include an image pickup device which serves as an image pickup unit 252 shown in
Moreover, the information processing apparatus 200 may not include the operation input device 240 and the display device 242 shown in
Next, a display process executed by the information processing apparatus 200 shown in
In
Next, when the user A inputs an instruction for connection to the users B, C, and D through the network using the information processing apparatus 200, the communication unit 212 enters a state in which the communication unit 212 may communicate with the communication server 300 through the communication network 800 (in step S102). Note that, in step S102, the communication unit 212 may enter a state in which the communication unit 212 may directly communicate with the information processing apparatuses 500 and 700 through the communication network 800.
Next, the communication unit 212 transmits a captured image which is generated through image capturing performed by the image pickup device 104 included in the display system 100 and which is received through the input unit 202 to the communication server 300 through the communication network 800 (in step S104). Note that, in step S104, the communication unit 212 may transmit information on a face region including the face of the user A transmitted from the detection unit 204 to the communication server 300 through the communication network 800. Furthermore, in step S104, the communication unit 212 may directly transmit the captured image or the information on the face region to the information processing apparatuses 500 and 700 through the communication network 800.
Subsequently, the communication unit 212 receives an image which is captured by the display system 400 and which is transmitted from the information processing apparatus 500 through the communication server 300. Furthermore, the communication unit 212 receives an image which is captured by the display system 600 and which is transmitted from the information processing apparatus 700 through the communication server 300 (in step S106). Note that, in step S106, the information on the face regions including the faces of the users B and C detected in the image which is captured by the display system 400 and which is transmitted from the information processing apparatus 500 and the information on the face region including the face of the user D detected in the image which is captured by the display system 600 and which is transmitted from the information processing apparatus 700 may be received from the communication server 300. Furthermore, in step S106, the communication unit 212 may directly receive the captured images and the information on the face regions from the information processing apparatuses 500 and 700 through the communication network 800.
Subsequently, the information processing apparatus 200 executes a parallel display process which will be described with reference to
In
Next, the setting unit 208 sets a display region for content and a display region for captured images supplied from the information processing apparatuses 500 and 700 in the display screen of the display device 102 in accordance with information on an input performed by the user A to set the display ratio of the display region for content to the display region for captured images supplied from the information processing apparatuses 500 and 700 in the display screen of the display device 102 (in step S202). Note that, in step S202, the setting unit 208 may set the display region for content and the display region for captured images supplied from the information processing apparatuses 200, 500, and 700 in the display screen of the display device 102 in accordance with the information on an input performed by the user to set the display ratio of the display region for content to the display region for captured images supplied from the information processing apparatuses 200, 500, and 700 in the display screen of the display device 102.
Subsequently, the display image generation unit 210 extracts portions of the image which is captured by the display system 400 and which is received by the communication unit 212 and a portion of the image which is captured by the display system 600 and which is received by the communication unit 212 in accordance with the information on the face regions including the faces of the users B, C, and D transmitted from the detection unit 204, a result of the obtainment of the number of users who use the information processing apparatuses 500 and 700 which is supplied from the head-count obtaining unit 206, and the information on the display region for captured images supplied from the information processing apparatuses 500 and 700 which is supplied from the setting unit 208 (in step S204), and generates a display image to be displayed in the display region for captured images supplied from the information processing apparatuses 500 and 700 in the display screen of the display device 102 (in step S206).
Note that, in step S204 and step S206, the display image generation unit 210 may extract a portion of the image which is captured by the display system 100, portions of the image captured by the display system 400, and a portion of the image captured by the display system 600 in accordance with the information on the face region including the face of the user A transmitted from the detection unit 204, the information on the face regions including the faces of the users B, C, and D transmitted from the detection unit 204, a result of the obtainment of the number of users who use the information processing apparatus 200 which is supplied from the head-count obtaining unit 206, a result of the obtainment of the number of users who use the information processing apparatuses 500 and 700 which is supplied from the head-count obtaining unit 206, and the information on the display region for captured images supplied from the information processing apparatuses 200, 500, and 700 which is supplied from the setting unit 208, and generate a display image to be displayed in the display region for captured images supplied from the information processing apparatuses 200, 500, and 700 in the display screen of the display device 102.
Furthermore, in step S204 and step S206, when the communication unit 212 receives the information on the face regions including the faces of the users B and C detected in the image captured by the display system 400 and the information on the face region including the face of the user D detected by in the image captured by the display system 600, the display image generation unit 210 may generate a display image in accordance with the information on the face regions supplied from the communication unit 212 instead of the information on the face regions detected by the detection unit 204.
Next, the display controller 216 transmits a signal for displaying the content which is desired by the user A and which has a reduced size in the display region for content included in the display screen of the display device 102 to the output unit 214 in accordance with the information on the display region for content supplied from the setting unit 208. By this, the content desired by the user A which corresponds to the image having the reduced size is displayed in the display region for content in the display screen of the display device 102 (in step S208).
Next, the display controller 216 transmits a signal for displaying the display image generated by the display image generation unit 210 in the display region for captured images supplied from the information processing apparatuses 500 and 700 included in the display screen of the display device 102 to the output unit 214 in accordance with the information on the display region for the captured images supplied from the information processing apparatuses 500 and 700 which is received from the setting unit 208. By this, in the display screen of the display device 102, the display image generated by the display image generation unit 210 is displayed in the display region for captured images, and accordingly, the content desired by the user A and the captured images supplied from the information processing apparatuses 500 and 700 are displayed in parallel (in step S210). Then, this process is terminated.
Note that, in step S210, the display controller 216 may transmit a signal for displaying the display image generated by the display image generation unit 210 in the display region for captured images supplied from the information processing apparatuses 200, 500, and 700 included in the display screen of the display device 102 to the output unit 214 in accordance with the information on the display region for captured images supplied from the information processing apparatuses 200, 500, and 700 which is supplied from the setting unit 208. In this case, in the display screen of the display device 102, the display image generated by the display image generation unit 210 is displayed in the display region for captured image, and accordingly, the content desired by the user A and the captured images supplied from the information processing apparatuses 200, 500, and 700 are displayed in parallel.
According to the display process shown in
Next, examples of the present disclosure will be described.
As shown in
As shown in
Note that, as shown in
As shown in
Note that, even in a case where two users use the display system 400 and a single user uses the display system 600 as shown in
Furthermore, similarly, as shown in
As shown in
As shown in
Therefore, in the fourth example, when the user is included in the end portion of the captured image, the portion of the captured image IM23 is extracted so that the invalid region R1 is not displayed in the display region for captured images whereby a display image IM26 is generated. For example, when the user is included in a right end portion of the captured image as shown in
As shown in
As shown in
Therefore, in the fifth example, when the two users are positioned close to each other in the captured image, a display image IM31 is generated by extracting portions of the captured images IM28 such that the overlapping region R2 is not displayed in the display region for captured images. In this case, as shown in
Furthermore, in the fifth example, when the two users are positioned close to each other in the captured image, it may be determined that a single user uses the display system 400 and a display image IM33 may be generated by extracting a portion of the captured image IM28 so that at least face feature portions of the two users are included in the display image IM33. Also in this case, as shown in
In the sixth example, in a captured image IM35, extraction region CA1, CA2, and CA3 are set using a vertical axis VA which passes the center of a face of a user as a reference as shown in
Furthermore, in the sixth example, in the captured image IM35, extraction regions CA4, CA5, and CA6 may be set using the vertical line VA which passes the center of the face of the user and a horizontal axis HA which passes eyes in the face of the user, for example, as references as shown in
A functional configuration of an information processing apparatus according to a second embodiment of the present disclosure will now be described.
Note that, in
In
The image pickup unit 252 is an example of an image pickup unit according to the present disclosure and may capture a still image or a moving image of a user A who watches a display screen of the display unit 254. Then, the image pickup unit 252 may transmit a captured image generated through image capturing to the communication unit 212, the detection unit 204, and display image generation unit 210.
The display unit 254 is an example of a display unit of the present disclosure and may display content of a still image or a moving image and captured images supplied from the information processing apparatuses 550 and 750 in parallel. For example, the display unit 254 may display content of a still image or a moving image in a display region for content and display captured images supplied from the information processing apparatuses 550 and 750 in a display region for captured images supplied from the information processing apparatuses 550 and 750 in the display screen.
According to this embodiment, when the information processing apparatus 250 executes the display process described with reference to
Furthermore, an object of the present disclosure may be achieved by supplying a storage medium, such as a non-transitory storage medium, which stores a program code of software which realizes functions of the foregoing embodiments to a system or an apparatus and reading and executing the program code stored in the storage medium using a computer (or a CPU, an MPU, or the like) of the system or the apparatus.
In this case, the program code which is read from the storage medium realizes the functions of the foregoing embodiments, and the program code and the storage medium which stores the program code are included in the present disclosure.
Furthermore, examples of the storage medium to which the program code is supplied include a floppy (registered trademark) disk, a hard disk, a magneto-optical disc, an optical disc such as an CD-ROM, a CD-R, a CD-RW, a DVD-ROM, a DVD-RAM, a DVD-RW, or a DVD+RW, a magnetic tape, a nonvolatile memory card, and a ROM. Alternatively, the program code may be downloaded through a network.
Furthermore, the present disclosure includes, in addition to the case where the functions of the foregoing embodiments are realized by executing the program code read by the computer, a case where an OS (Operating System) operating in a computer performs a part of or entire actual process in accordance with an instruction of the program code and the functions of the foregoing embodiments are realized by the process.
The present disclosure further includes a case where, after the program code read from the storage medium is written to a memory included in a function expansion board inserted into the computer or a function expansion unit connected to the computer, a CPU or the like included in the expansion board or the expansion unit executes a part of or entire actual process in accordance with an instruction of the program code and the functions of the foregoing embodiments are realized by the process.
Although the embodiments of the present disclosure have been described hereinabove with reference to the accompanying drawings, the present disclosure is not limited to the examples. It is apparent to those who skilled in the art that various modifications and variations may be made within the scope of the present disclosure and these modifications and the variations also belong to the scope of the present disclosure.
For example, the communication server 300 may detect face regions including faces of users who use the information processing apparatuses 500 and 700 in captured images supplied from the information processing apparatuses 500 and 700.
Furthermore, the information processing apparatus 200 may transmit content desired by the user A to the information processing apparatuses 500 and 700 so that the content is shared by the users.
It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and alterations may occur depending on design requirements and other factors insofar as they are within the scope of the appended claims or the equivalents thereof.
Claims
1. (canceled)
2. An information processing apparatus comprising:
- a processor to: specify a number of users based on detection of at least one captured image provided at the apparatus; set a first display region for content and a second display region for the at least one captured image in a display screen; and generate at least one display image to be displayed in the second display region for the at least one captured image, in accordance with the detection, the number of users and the second display region set for the at least one captured image,
- wherein said processor is configured to change a display ratio of the first display region for content to the second display region for the least one captured image or direction of each image displayed in the second display region according to the number of users.
3. The apparatus of claim 2 further comprising:
- an image pick-up device fixed in the apparatus configured to capture an image in front of the apparatus.
4. The apparatus of claim 2, wherein at least one of the at least one captured image is transmitted from another information processing apparatus.
5. The apparatus of claim 3, wherein the at least one display image displayed in the second display region includes an image captured by the apparatus and at least one image transmitted from another information processing apparatus.
6. The apparatus of claim 2, wherein the faces of the respective users are arranged in a matrix.
7. The apparatus of claim 2, wherein the second display region includes an invalid region other than a region in which the at least one captured image is displayed.
8. The apparatus of claim 2, wherein, when a distance between the faces from the detection of the at least one captured image is under a predetermined value, said faces are treated as a single face.
9. The apparatus of claim 2, wherein the display ratio is decreased when the number of users is increased.
10. The apparatus of claim 2, wherein the display ratio is changed according to the number of users.
11. The apparatus of claim 2, wherein content is displayed reduced in size in the first display region for content.
12. The apparatus of claim 11, wherein the content is content indicated by a user of the apparatus.
13. The apparatus of claim 2, wherein the processor is to detect a face region including a face in the at least one captured image.
14. The apparatus of claim 2, wherein the second display region for the at least one captured image includes at least a face feature portion of the face of each user of the number of users.
15. An information processing method comprising:
- specifying a number of users based on detection of at least one captured image provided at the apparatus;
- setting a first display region for content and a second display region for the at least one captured image in a display screen; and
- generating at least one display image to be displayed in the second display region for the at least one captured image, in accordance with the detection, the number of users and the second display region set for the at least one captured image,
- wherein a display ratio of the first display region for content to the second display region for the least one captured image or direction of each image displayed in the second display region is changed according to the number of users,
- wherein at least one of the specifying, the setting and the generating is by a processor.
16. A non-transitory recording medium recorded with a computer-readable program having instructions executable by a processing, the program comprising:
- specifying a number of users based on detection of at least one captured image provided at the apparatus;
- setting a first display region for content and a second display region for the at least one captured image in a display screen; and
- generating at least one display image to be displayed in the second display region for the at least one captured image, in accordance with the detection, the number of users and the second display region set for the at least one captured image,
- wherein a display ratio of the first display region for content to the second display region for the least one captured
Type: Application
Filed: Dec 16, 2014
Publication Date: Apr 9, 2015
Applicant: SONY CORPORATION (Tokyo)
Inventors: Yusuke Sakai (Kanagawa), Masao Kondo (Kanagawa)
Application Number: 14/571,473
International Classification: H04N 7/15 (20060101); G06K 9/00 (20060101); H04L 12/18 (20060101);