GRAPHICAL USER INTERFACE DEVICE

Abstract

In one embodiment, a graphical user interface device comprises an image display device configured to display an operation window including a first operation area which corresponds to a first area and a second operation area which corresponds to a second area. An allocation unit is configured to allocate the graphical user interface device to the first operation area, and to allocate one of a plurality of participant devices to the second operation area. A controller is configured to control a projector to display the combined image in which a first image, that corresponds to the image display device of the graphical user interface device, is displayed in the first area and in which a second image, that corresponds to a participant device allocated to the second operation area, is displayed in the second area.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a continuation application of U.S. patent application Ser. No. 12/186,955 filed on Aug. 6, 2008, which claims priority from Japanese Patent Application No. 2007-205653 filed on Aug. 7, 2007, which are hereby incorporated by reference in their entirety.

BACKGROUND

Recently, a conference system that connects plural personal computers and a projector has been developed. Such a conference system enables simultaneous projection of display screens of plural personal computers by split display. This is convenient for a conference or a lesson where users want to have a discussion while comparing reference data saved in plural personal computers. For example, conference systems disclosed in Japanese Patent Publication Nos. JP-A-2004-54134 and JP-A-2003-330436 are known.

JP-A-2004-54134 discloses a technique in which a projector combines captured images on the screens of plural terminals connected via a network and projects these images on one split display screen. In this split display, which terminal image should be allocated to which of split areas that form the split display screen, is decided in accordance with a priority order of terminals inputted by the user using a remote controller or the like.

Inputting the priority order of terminals and allocating terminal images to the split areas in this manner may be a troublesome operation for the user. In the case where there are a large number of images to be candidates for split display and the allocation is changed many times, the operation may become even more troublesome. Moreover, the user must remember the position of split areas corresponding to the priority order. The challenges of such operation is not limited to the case of using the priority order. Challenges may similarly occur in the case of allocating terminal images by designating split areas that form a split display screen.

SUMMARY

In certain embodiments, an operation such as allocating a predetermined image to each of split screen forming areas that form a split screen in an image display apparatus capable of displaying images on a split screen may be easily carried out.

According to at least one embodiment, a graphical user interface device that allocates, in an image display apparatus capable of displaying images on a split screen, a predetermined image to each of split screen forming areas that form the split screen, includes a unit that displays an operation window having the same number of operation areas as the number of splits of the split screen, each of the operation areas being univocally associated with each of the split screen forming areas.

In the graphical user interface device having such a configuration, the operation window having operation areas, each of which may be univocally associated with each of the split screen forming areas that from the split screen, may be displayed. As such, if an operation is carried out by using an operation area corresponding to a split screen forming area where the user wants to carry out the operation, it is not necessary to carry out an operation to select a split screen forming area in which the operation should be carried out. Thus, an operation with respect to the split screen forming areas may be more easily carried out.

In the graphical user interface device, the operation areas may be arranged in the same positional relation as the layout of the split screen forming areas.

In the graphical user interface device having such a configuration, since the operation areas are arranged in the same positional relation as the layout of the split screen forming areas, which operation area is associated with which split screen forming area may be understood visually and more easily. Therefore, an operation with respect to the split screen forming areas may be more easily carried out.

In the graphical user interface device, each of the operation areas may have a unit that allocates a predetermined image to the corresponding split screen forming area.

In the graphical user interface device having such a configuration, since each of the operation areas has a unit that allocates a predetermined image to the corresponding split screen forming area, allocation of an image may be more easily carried out by fewer operations, using the operation area corresponding to the split screen forming area to which the user wants to allocate an image.

In the graphical user interface device, each of the operation areas may have a unit that switches display of the split screen and full-screen display for displaying one of the split screen forming areas on a single non-split screen.

In the graphical user interface device having such a configuration, since each of the operation areas has a unit that switches display of the split screen and full-screen display, if an instruction to switch from split screen display to full-screen display is carried out in the operation area corresponding to the image which the user wants to see by full-screen display, it is not necessary to carry out an operation to select the image which the user wants to see by full-screen display. As such, the form of display may be more easily switched to full-screen display by fewer operations.

In the graphical user interface device, each of the operation areas may have an allocation unit that allocates a predetermined image to the corresponding split screen forming area, and a switching unit that switches display of the split screen and full-screen display for displaying one of the split screen forming areas on a single non-split screen. The allocation unit is capable of allocating a predetermined image while the switching unit is switching from the display of the split screen to the full-screen display to display an image of the full-screen display on the display apparatus.

In the graphical user interface device having such a configuration, the allocation unit can allocate a predetermined image while the switching unit is switching from the display of the split screen to the full-screen display to display an image of the full-screen display on the display apparatus. Therefore, at the time of switching the image from the full-screen display to the display of the split screen, no waiting time is generated in the operation to allocate images to the split screen forming areas. As such, it is possible to more smoothly switch the display of the split screen and the full-screen display.

In the graphical user interface device, each of the operation areas may have a unit that displays in the operation area a thumbnail of an image displayed in the split screen forming area corresponding to the operation area.

In the graphical user interface device having such a configuration, in each of the operation areas, the thumbnail of the image displayed in the split screen forming area corresponding to the operation area may be displayed. As such, the corresponding relation between the split screen forming areas and the operation areas may be more easily understood and an operation with respect to the split screen forming areas may be more easily carried out.

The graphical user interface device may further include a unit that changes the number of splits in the split screen and/or layout of the split screen forming areas, and a unit that changes the number of splits in the operation window and/or its layout in accordance with the changed number of splits and/or layout.

In the graphical user interface device having such a configuration, if the number of splits in the split screen and/or the layout of the split screen forming areas is changed, the number of splits in the operation window and/or its layout may be changed in accordance with that change. As such, whatever number of splits and layout in the split screen is set, an operation with respect to the split screen forming areas may be more easily carried out. Moreover, even if the number of splits and layout in the split screen is changed in the course of processing, an operation with respect to the split screen forming areas may be more easily carried out.

According to at least one embodiment, a graphical user interface device that allocates, in an image display apparatus capable of displaying images on a split screen, a predetermined image to each of split screen forming areas that form the split screen, includes a unit that displays an operation window including plural operation areas having a visually recognizable corresponding relation with each of the split screen forming areas.

In the graphical user interface device having such a configuration, an operation may be carried out by using the operation window including operation areas having a visually recognizable corresponding relation with each of the split screen forming areas. As such, by operating the operation area corresponding to a desired split screen forming area, it is possible to more easily carry out an operation with respect to the split screen forming areas.

BRIEF DESCRIPTION OF THE DRAWINGS

Various embodiments of the disclosure are described with reference to the accompanying drawings, wherein like numbers refer to like elements.

FIG. 1 illustrates the configuration of a conference system.

FIG. 2 illustrates the schematic configuration of participant computers.

FIG. 3 illustrates the schematic configuration of a moderator computer.

FIG. 4 illustrates the schematic configuration of a projector.

FIG. 5 is a flowchart illustrating a flow diagram on the side of the participant computers, of connection processing between the participant computers and the moderator computer.

FIG. 6 is a flowchart illustrating a flow diagram on the side of the moderator computer, of connection processing between the participant computers and the moderator computer.

FIG. 7 illustrates a specific example of an hourly profile.

FIG. 8A and FIG. 8B illustrate a specific example of an hourly profile and a class makeup profile.

FIG. 9 illustrates an exemplary flow diagram of split display screen switching processing to switch a display image by using the conference system in accordance with certain embodiments.

FIG. 10 illustrates an exemplary flow diagram of split display screen switching processing to switch a display image by using the conference system in accordance with certain embodiments.

FIG. 11 illustrates an example of a projector selection window to carry out setting of a projector and a screen display.

FIG. 12 illustrates an example of a projector projection operation window to perform a projector projection operation.

FIG. 13 illustrates an exemplary display where the projector projection operation window is being used.

DESCRIPTION OF EMBODIMENTS

In the following description, reference is made to the accompanying drawings which form a part hereof, and in which are shown, by way of illustration, specific embodiments in which the disclosure may be practiced. It is to be understood that other embodiments may be utilized and structural or logical changes may be made without departing from the scope of the present disclosure. Therefore, the following detailed description is not to be taken in a limiting sense, and the scope of the present disclosure is defined by the appended claims and their equivalents.

Throughout the specification and claims, the following terms take at least the meanings explicitly associated herein, unless the context clearly dictates otherwise. The meanings identified below are not intended to limit the terms, but merely provide illustrative examples for use of the terms. The meaning of “a,” “an,” “one,” and “the” may include reference to both the singular and the plural. Reference in the specification to “one embodiment” or “an embodiment” means that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment of the disclosure. The meaning of “in” may include “in” and “on.” The appearances of the phrases “in one embodiment” or “in an embodiment” in various places in the specification do not necessarily all refer to the same embodiment, but it may.

Several embodiments will sequentially be described under corresponding section headings below. Section headings are merely employed to improve readability, and they are not to be construed to restrict or narrow the present disclosure. For example, the order of description headings should not necessarily be construed so as to imply that these operations are necessarily order dependent or to imply the relative importance of an embodiment. Moreover, the scope of a disclosure under one section heading should not be construed to restrict or to limit the disclosure to that particular embodiment, rather the disclosure should indicate that a particular feature, structure, or characteristic described in connection with a section heading is included in at least one embodiment of the disclosure, but it may also be used in connection with other embodiments.

Various operations will be described as multiple discrete steps performed in turn in a manner that is most helpful in understanding the principles described herein. However, the order of description should not necessarily be construed so as to imply that these operations are necessarily order dependent. In particular, these operations may not need to be performed in the order of presentation, but they may.

Many of the functional units described in this specification have been labeled as units in order to more particularly emphasize their implementation independence. For example, a unit may be implemented as a hardware circuit comprising custom VLSI circuits or gate arrays, off-the-shelf semiconductors such as logic chips, transistors, or other discrete components. A unit may also be implemented in programmable hardware devices such as field programmable gate arrays, programmable array logic, programmable logic devices or the like.

Units may also be implemented in software for execution by various types of processors. An identified unit of executable code may, for instance, comprise one or more physical or logical blocks of computer instructions which may, for instance, be organized as an object, procedure, or function. Nevertheless, the executables of an identified unit need not be physically located together, but may comprise disparate instructions stored in different locations which, when joined logically together, comprise the unit and achieve the stated purpose for the unit.

Indeed, a unit of executable code may be a single instruction, or many instructions, and may even be distributed over several different code segments, among different programs, and across several memory devices. Similarly, operational data may be identified and illustrated herein within units, and may be embodied in any suitable form and organized within any suitable type of data structure. The operational data may be collected as a single data set, or may be distributed over different locations including over different storage devices, and may exist, at least partially, merely as electronic signals on a system or network.

A. Configuration of Conference System

A-1. Schematic Configuration of System

FIG. 1 illustrates the configuration of a conference system 10 according to at least one embodiment. The conference system 10 is an image display system that enables a projector to simultaneously display an image on the display screens of plural terminals. The conference system 10 includes computers PC1 to PC5, a moderator computer PCm and a projector PR1 connected via a network. In at least one embodiment, the computers PC1 to PC5, the moderator computer PCm and the projector PR1 are connected via a local area network LAN. Although not shown, other devices equivalent to the moderator computer PCm and the projector PR1 are installed on the local area network LAN.

The method of connecting the computers PC1 to PC5, the moderator computer PCm and the projector PR1 is not, however, limited to the above form. Various connection methods can be set in accordance with the environment where these devices are used, required communication speed, and so on. For example, the moderator computer PCm and the projector PR1 can be locally connected by a D-sub cable or USB cable. Moreover, these connections are not limited to wired connections but may be wireless connections. Furthermore, these devices can be connected via the Internet.

As will be described in more detail later, the projector PR1 can project and image on a screen SC1 and the moderator computer PCm can display a combined image formed as a result of combining four difference images into one screen image. Hereinafter, the areas corresponding to quadrisected displays on the screen SC1 are referred to as split screen forming areas SC11 to SC14, as shown in FIG. 1.

A-2. Schematic Configuration of Computers

The computer PC1 of the conference system 10 is a personal computer having a predetermined program installed therein and is provided to be used by a student A. FIG. 2 shows a schematic configuration of the computer PC1. The computers PC2 to PC5 provided to be used by students B to E have a configuration similar to that of the computer PC1 and therefore will not be described further in more detail. As shown in FIG. 2, the computer PC1 has a CPU 20, a hard disk drive 30, a ROM 36, a RAM 38, a network interface 41, an input system 51, a VRAM 61, a graphic controller 63, and a display 65, which are connected to each other by a bus.

The CPU 20 expands firmware and OS stored in the hard disk drive 30 and the ROM 36 into the RAM 38 and executes these, thereby controlling the computer PC1. The CPU 20 also executes a program stored in the hard disk drive 30 and as such functions as a data transmitting unit 21 and a communication unit 22. This functional part will be described in more detail later.

In the hard disk drive 30, the IP address of the computer PC1 is stored and also storage areas for storing an address/server name management table 31, a server name profile 32 and an hourly profile 33 are secured. These parts will be described in more detail later. These storage areas are not limited to the hard disk drive 30 and can be secured in an EEPROM, which is a rewritable non-volatile memory.

The network interface 41 is an interface for connection to the local area network LAN. The computer PC1 is connected to the local area network LAN via the network interface 41.

The input system 51 includes a keyboard and a pointing device (here, a mouse). The graphic controller 63 displays an image to be displayed on the display 65 by using the VRAM 61 as a buffer.

A-3. Schematic Configuration of Moderator Computer

The moderator computer PCm is a personal computer having a predetermined program installed therein and is provided to be used by a teacher M. In at least one embodiment, this moderator computer PCm is equivalent to a server. FIG. 3 illustrates a schematic configuration of the moderator computer PCm. As depicted in FIG. 3, the moderator computer PCm has a CPU 70, a hard disk drive 80, a ROM 86, a RAM 88, a network interface 91, a USB interface 93, an input system 101, a VRAM 111, a graphic controller 113, and a display 115, which are connected to each other by a bus.

The CPU 70 executes a program stored on the hard disk drive 80 and thus functions as a data communication control unit 71, an image combining unit 72, a combined image accepting unit 73, an image switching accepting unit 74, a GUI control unit 75, and a communication unit 76.

In the hard disk drive 80, the IP address of the moderator computer PCm is stored and also storage areas for storing an address/client name management table 81, a client name profile 82, an hourly profile 83 and a class makeup profile 84 are secured. Also plural GUI programs are stored, which will be described later. These parts will be described in more detail later. These storage areas are not limited to the hard disk drive 80 and can be secured in an EEPROM, which is a rewritable non-volatile memory.

The USB interface 93 is a USB-style interface for connection to the projector PR1. The moderator computer PCm can be connected to the projector PR1 via a USB cable.

The ROM 86, the RAM 88, the network interface 91, the input system 101, the VRAM 111, the graphic controller 113 and the display 115 have the same configuration as in the computers PC1 to PC5 and therefore will not be described in further detail.

A-4. Schematic Configuration of Projector

The projector PR1 of the conference system 10, is a versatile projector without having any special function for split screen display. FIG. 4 illustrates a schematic configuration of the projector PR1. As depicted in FIG. 4, the projector PR1 has a CPU 120, a ROM 136, a RAM 138, a network interface 141, a USB interface 143, a VRAM 151, a graphic controller 153, and a projecting unit 155, which are connected to each other by a bus.

The CPU 120 expands a program stored in the ROM 136 into the RAM 138 and executes the program, thereby functioning as a data receiving unit 121. This functional part will be described in further detail later.

The network interface 141 is an interface for connection to the local area network LAN. The projector PR1 is connected to the local area network LAN via the network interface 141. The USB interface 143 is a USB-style interface for connection to the moderator computer PCm. The projector PR1 can also be connected to the moderator computer PCm via a USB cable.

The graphic controller 153 causes the projecting unit 155 to display an image by using the VRAM 151 as a buffer. The projecting unit 155 is a liquid crystal projection mechanism. By projecting light transmitted through a liquid crystal panel for RGB, the projecting unit 155 displays an image on the screen SC1. Although a liquid crystal system is disclosed in this embodiment, it is not limited to such as various other systems may be used such as a CRT system, DLP system, LCOS system or GLV system.

B. Method of Using Conference System

At least one method of using the conference system 10 will be described in more detail based on the conference system 10 being used for a lesson at a school. In the following example, it is assumed that a teacher M, who is a facilitator of the lesson, carries out a lesson by operating the moderator computer PCm to carry out full-screen display of one of display screen images PCT1 to PCT5 displayed on the displays 65 of the computers PC1 to PC5 used by students A to E and a display screen image PCTm displayed on the display 115 of the moderator computer PCm, or split screen display of selected display screen images of the display screen images PCT1 to PCT5 and PCTm, onto the screen SC1 via the projector PR1. The display screen images PCT1 to PCT5 and PCTm may be images showing reference materials prepared by each of the students A to E and the teacher M. The students A to E and the teacher M may explain their own prepared reference materials in accordance with the lesson.

B-1. Initial Setting for Use

Initial setting for using the conference system 10 will now be described. Initial setting in this embodiment is for the computers PC1 to PC5 and the moderator computer PCm to carry out communications. This initial setting processing is started when the teacher M first starts up predetermined software in the moderator computer PCm, and then the students A to E start up predetermined software in the computers PC1 to PC5, respectively.

When the above software has started up, the CPU 20 of the computers PC1 to PC5 issues a search command and simultaneously communicates the search command in the local area network LAN. Meanwhile, the CPU 70 of the moderator computer PCm, having received the search command, sends back the computer name (e.g., teacher name) and IP address of the moderator computer PCm to the computers PC1 to PC5. The CPU 20 of the computers PC1 to PC5 receives this computer name and IP address and registers this data to address/server name management table 31.

The CPU 20 of the computers PC1 to PC5 transmits the computer names (e.g., student names) and IP addresses of the computers PC1 to PC5 to the moderator computer PCm. The CPU 70 of the moderator computer PCm receives these computer names and IP addresses and registers this data to the address/client name management table 81.

The computers PC1 to PC5 specify the IP address of the moderator computer PCm by referring to the server name profile 32 in which the teacher name has been registered and the above address/server name management table 31, and carry out communications. Similarly, the moderator computer PCm specifies the IP addresses of the computers PC1 to PC5 by referring to the client name profile 82 and the address/client name management table 81, and carries out communications. In at least one embodiment, such initial setting is carried out every time the above software is started up in order to address the case where a new student is added or an IP address is changed. However, the update of this initial setting may be omitted in the case where there is no change in registration contents for a predetermined period. Moreover, the above initial setting may also be input by the teacher M and the students A to E using the input system 51 and the input system 101.

In at least one embodiment, it is assumed that the IP addresses of the computers PC1 to PC5 and of the moderator computer PCm are stored on the hard disk drives 30 and 80, respectively, through prior setting by the students A to E and the teacher M. However, the IP addresses are not limited to such a configuration. For example, before the above initial setting, a DHCP server on the local area network LAN may allocate an IP address to each of the computers PC1 to PC5 and the moderator computer PCm in response to an IP address request that is simultaneously communicated from the computers PC1 to PC5 and the moderator computer PCm.

B-2. Connection Processing

FIG. 5 and FIG. 6 show flow diagrams of connection processing between the computers PC1 to PC5 and the moderator computer PCm. FIG. 5 shows processing on the side of the computers PC1 to PC5, which is carried out by the CPU 20 as the processing at the communication unit 22. FIG. 6 shows processing on the side of the moderator computer PCm, which is carried out by the CPU 70 as the processing at the communication unit 76. In the following example, it is assumed that the students A to E have their respective exclusive-use computers PC1 to PC5 allocated. These flow diagrams of processing are started when the above software has started up and initial setting is complete.

As the connection processing is started, first, the CPU 20 of the computers PC1 to PC5 read the hourly profile 33 stored on the hard disk drive 30 as shown in FIG. 5 (step S200).

Turning now to FIG. 7, and with continued reference to FIG. 5, a specific example of this hourly profile 33 is illustrated. The hourly profile 33 is a profile in which a connection destination is set by time. As illustrated, each of the lessons in the first to fourth periods on Monday through Friday is associated with the name of the teacher in charge of the lesson which the students are to attend. As such, the hourly profile 33 is a lesson timetable for the students A to E. For example, the first period on Monday is defined as a lesson of the teacher M, the third period on Tuesday is a lesson of the teacher N, and so on. This hourly profile 33 is inputted in advance by the students A to E using the input system 51 and so on, and is stored on the hard disk drive 30.

Having read the hourly profile 33, the CPU 20 compares the present time with the hourly profile 33 and determines whether there is profile data corresponding to the present time (step S201).

If there is corresponding profile data as a result of the determination (YES in step S201), a lesson to attend is scheduled in that time period. As such, the CPU 20 requests connection to the computer (in this embodiment, the moderator computer PCm) of the teacher (in this embodiment, the teacher M) corresponding to this time period (step S202). Although not shown in FIG. 1, each of the teachers N to Q shown in FIG. 7 utilizes a moderator computer connected to the local area network LAN, like teacher M. In time periods when other lessons are scheduled, a connection request is made to the computers of the teachers N to Q. Alternatively, if there is no corresponding profile data (NO in step S201), no lesson is scheduled in that time period, and the processing ends.

In the moderator computer PCm, when the connection processing is started, the CPU 70 reads the hourly profile 83 and the class makeup profile 84 stored on the hard disk drive 80, as illustrated in FIG. 6 (step S221).

Turning now to FIG. 8A, and with continued reference to FIG. 6, a specific example of the hourly profile 83 is depicted. The hourly profile 83 is a profile in which a connection destination is set by time. As illustrated, each of the lessons in the first to fourth periods on Monday through Friday is associated with the name of the class where the teacher gives a lesson in the time period. As such, the hourly profile 83 is a timetable of lessons that the teacher M is to give. For example, the first period on Monday is defined as a lesson for a class 1, the second period on Monday is a lesson for a class 2, and so on.

FIG. 8B shows a specific example of the class makeup profile 84. The class makeup profile 84 is a profile in which the makeup of the class as a lesson attendance unit is set. Here, each of the classes 1 to 7 is associated with the names of students who make up the class.

The hourly profile 83 and the class makeup profile 84 are inputted in advance by the teacher M using, for example, the input system 101, and is stored on the hard disk drive 80.

Having read the hourly profile 83 and the class makeup profile 84, the CPU 70 continuously determines whether there is a connection request from the students A to E, that is, the computers PC1 to PC5 (step S222).

If there is no connection request as a result of the determination (NO in step S222), the CPU waits until a connection request comes. Alternatively, if it is determined that there is a connection request (YES in step S222), the CPU 70 determines whether the student who has sent the connection request is a student belonging to the class corresponding to the present time defined in the hourly profile 83, by referring to the hourly profile 83 and the class makeup profile 84 (step S223).

If the student belongs to the class as a result of the determination (YES in step S223), the CPU 70 permits connection in response to the connection request from the student and establishes connection (step S224). Alternatively, if the student does not belong to the class, this student is not entitled to attend the lesson of this time period. As such, the CPU 70 rejects connection in response to the connection request from the student (step S225) and returns the processing to step S222 to stand by for a new connection request from another student. In this manner, the connection between the computers PC1 to PC5 and the moderator computer PCm may be established via the local area network LAN.

In this embodiment, it is assumed that the students A to E have their own exclusive-use computers PC1 to PC5. However, in the case where multiple students share a computer, the CPU 20 may allow the students to input their individual student names before the above step S200, and the student names may be transmitted together with a connection request to the moderator computer PCm in the above step S202.

In this embodiment, the profile associating time conditions with connection destinations is stored in both the computers PC1 to PC5 as terminals, and the moderator computer PCm as a server. However, in alternative embodiments, the profile may be stored only in the computers PC1 to PC5 or in the moderator computer PCm. Even in the embodiment(s) where the profile is stored only in the moderator computer PCm, if the computers PC1 to PC5 are configured to automatically and simultaneously communicate a connection request onto the local area network LAN, the moderator computer PCm refers to the hourly profile 83 and the class makeup profile 84 and gives connection permission only to the computers PC1 to PC5 that match these profiles. As such, it is possible to automatically establish connection between the computers PC1 to PC5 and the moderator computer PCm.

In the case of rejecting connection in the above step S225, the moderator computer PCm may be configured to send a notification that the connection is rejected to the appropriate computers PC1 to PC5 from which the connection is rejected. In this manner, the students A to E may quickly learn they are not entitled to attend the particular lesson.

B-3. Split Display Screen Switching Processing

FIG. 9 and FIG. 10 illustrate, in accordance with at least one embodiment, an exemplary flow diagram of split display screen switching processing in which split display images on the display screens of the computers PC1 to PC5 are projected on the screen SC1 and the display images are switched using the conference system 10. As illustrated, the right column in FIG. 9 and FIG. 10 shows an operation by the teacher M to designate a display image to be projected on the screen SC1 by using the moderator computer PCm. The middle columns in FIG. 9 and FIG. 10 show processing by the moderator computer PCm in response to the operation by the teacher M shown in the right column, and processing by the computers PC1 to PC5 and the projector PR1 in response to the processing by the moderator computer PCm. The left column in FIG. 9 and FIG. 10 shows an image projected on the screen SC1 at each stage of the middle columns.

This processing is started as the teacher M carries out an operation to designate a projection image to the moderator computer PCm. In at least one embodiment, this is a designation operation to cause the projector PR1 to project an image of quadrisected display including the display screen images PCT1 to PCT4 of the computers PC1 to PC4 (operation O360).

The designation of the operation O360 may be carried out using the input system 101 of the moderator computer PCm and a GUI (graphical user interface) displayed on the display 115. Hereinafter, this GUI will be described with reference to a specific example. In the moderator computer PCm, when the above software is started up, the CPU 70 causes the display 115 to display a window for selecting a projector and for setting the screen display, by using the graphic controller 113. As an example of this window, FIG. 11 depicts a projector selection window W400. The projector selection window W400 may include a projector selection sub-window W410 and a screen display setting sub-window W420.

In the projector selection sub-window W410, a list of projectors connected to the moderator computer PCm may be shown. The projectors, as shown, have their connections to the moderator computer PCm automatically recognized by plug-and-play. FIG. 11 depicts the state where the projector PR1, of the connected projectors PR1 and PR2, is selected as the projector to be used. Although the projector PR2 is not shown in FIG. 1, this example depicts the embodiment(s) where there is another projector on the local area network LAN connected by the same configuration as the projector PR1. In the projector selection sub-window W410, if there are projectors on the local area network LAN, the CPU 70 searches for the projectors at the time of start-up of the above software and the result of the search is displayed in the above list of projectors. However, it may also be possible to re-search for the connected projectors by, for example, clicking a search button B412.

In the screen display setting sub-window W420, options for display method of an image that the projector PR1 should project onto the screen SC1 are shown. In the example of FIG. 11, full-screen display, two-screen display, and four-screen display are shown as options, and of these, the four-screen display is selected. The two-screen display and the four-screen display are display methods for providing simultaneous split display of different images. When one of these display methods is selected, the split display and the full-screen display may be easily switched, as will be described in more detail later. The options of split screen display are not limited to the two-screen display and the four-screen display shown as examples. For example, the split screen display may include a three-screen display or a display of five or more screens. In the two-screen display, various formats of the split screen may be selected at the same time, such as the layout of the split screen such as whether two screens are to be arrayed laterally or longitudinally, and the size of each split screen.

As illustrated, when the projector PR1 and the four-screen display are selected and an OK button B422 is clicked, the CPU 70, in the form of processing at the GUI control unit 75, reads a GUI program corresponding to the selected four-screen display from plural types of GUI programs stored on the hard disk drive 80, and causes the display 115 to display a projector projection operation window by using the graphic controller 113. As an example of this window, FIG. 12 shows a projector projection operation window W500. The projector projection operation window W500 may include a moderator display sub-window W510, a participant display sub-window W520, a projection operation sub-window W600, and a preview sub-window W700.

In the moderator display sub-window W510, the name of the predetermined user of the moderator computer PCm may be shown as the moderator name. In embodiments where multiple users share the moderator computer PCm, the moderator name may be inputted when the software is started up.

In the participant display sub-window W520, a list of computers that are projectable by the projector PR1 is shown together with their status. The projectable computers include the moderator computer PCm and computers having connection established with the moderator computer PCm in the above step S224. As illustrated, for ease in identification, the user names of the computers are shown as the list of computers. The status in this embodiment refers to information about whether the computer is now being projected or not. In the example of FIG. 12, the moderator name “teacher M” is shown in W510 and “teacher M” and “students A to E” of the computers PC1 to PC5 are shown in the participant display sub-window W520. The displays in the moderator display sub-window W510 and the participant display sub-window W520 may contain any information that enables univocal identification of the moderator or participants. Computer names, machine type names and so on may also be used for these displays.

The projection operation sub-window W600 has a top left screen sub-window W610, a top right screen sub-window W620, a bottom right screen sub-window W630, and a bottom left screen sub-window W640. The four screen sub-windows are provided because “four-screen display” is selected in the screen display setting sub-window W420. If “two-screen display” is selected, the number of screen sub-windows is two. If “full-screen display” is selected, the number of screen sub-windows is one. That is, the number and layout of screen sub-windows provided in the projection operation sub-window W600 correspond to the split display screen displayed on the screen SC1. In at least one embodiment, the screen sub-windows correspond to the number of splits and layout of the split display screen. However, the screen sub-windows are not limited to such a configuration and may correspond to various display forms of the split display screen. For example, in the embodiment (s) where the split screen forming areas that constitute the split display screen have a screen frame in different colors from each other, the color of the screen sub-windows may correspond to the color of the screen frames. In another example, where the split screen forming areas have different shapes and sizes from each other, the shape and size of the screen sub-windows may correspond to the shape and size of the split screen forming areas.

The top left screen sub-window W610 has a projection user display part D611, a projection button B613, a stop button B614, and a full-screen display button B615. The projection user display part D611 is an area to display the user of the computer corresponding to the image displayed in the top left split screen forming area (split screen forming area SC11). The projection button B613 and the stop button B614 are operation buttons that give instructions to project a predetermined image in the top left split screen forming area independently of the other split screen forming areas, and to stop the projection. For example, as illustrated in FIG. 12, if “student A” is selected in the participant display sub-window W520 and then the projection button B613 is clicked in the top left screen sub-window W610, “student A” is displayed in the projection user display part D611 and the display screen image PCT1 of the computer PC1 used by the student A can be displayed in the split screen forming area SC11, which is the top left screen part of the screen SC1. If the stop button B614 is clicked, the display of “student A” vanishes from the projection user display part D611 and the display screen image PCT1 vanishes from the split screen forming area SC11. The operation to select “student A” in the participant display sub-window W520 and to allocate the display screen image PCT1 to the split screen forming area SC11 in the projection operation sub-window W600 may also be carried out by drag and drop of “student A” from the participant display sub-window W520 into W610, instead of clicking the projection button B613.

The full-screen display button B615 is a button to switch the quadrisected display screen and the full-screen display. For example, if the full-screen display button B615 is clicked in the embodiment where the quadrisected display screen is shown on the screen SC1, the image displayed in the top left split screen forming area can be switched to the full-screen display. Then, as the full-screen display button B615 is clicked again, the full-screen display can be switched to the previous quadrisected display screen. The top right, bottom right and bottom left screen sub-windows W620 to W640 are configured similarly to the top left screen sub-window W610 and therefore will not be described in further detail.

The projection operation sub-window W600 also has a PLAY button B601, a STOP button B602, and a PAUSE button B603 to operate projection by the projector PR1. These buttons are for collectively operating images sent to the projector PR1 from the moderator computer PCm. These buttons can collectively carry out projection of images by the projector PR1, stop the projection, or pause the images, regardless of whether the display on the screen SC1 is split display or full-screen display.

The preview sub-window W700 is an area where, when the students A to E displayed in the participant display sub-window W520 are selected, preview of the display screen images PCT1 to PCT5 corresponding to the selected students A to E is shown regardless of the projected image by the projector PR1. It is also possible to enlarge or reduce the display by using an enlargement button B701 and a reduction button B702. In this preview, for example, image data with a reduced data size are used which are received from the computers PC1 to PC5 in response to a data transmission request sent from the moderator computer PCm to the computers PC1 to PC5 when the students A to E are selected in the participant display sub-window W520.

The projector projection operation window W500 having these sub-windows also has a projector selection button B501 and a configuration button B502. The projector selection button B501 is a button to carry out selection of a projector and setting of the screen display again. When this button is clicked, the projector selection window W400 is displayed. Therefore, while using the conference system 10, the teacher M can click the projector selection button B501 to have the projector selection window W400 shown, and can select a projector or change the setting of the screen display. The configuration button B502 is a button to carryout setting with respect to whether input history to the projector PR1 is used or not.

When the projection selection button B501 is clicked as described above to have the projector selection window W400 shown and the setting of the display screen is changed, the subsequently shown projector projection operation window W500 is changed in accordance with that change. For example, if an operation to change from the four-screen display to the two-screen display is carried out in the projector selection window W400, the CPU 70 reads a GUI program corresponding to the two-screen display from the plural GUI programs stored on the hard disk drive 80 and causes the projector projection operation window W500 having the projection operation sub-window W600 including two screen sub-windows to be displayed, as the processing at the GUI control unit 75. As described above, in the embodiment(s) where the screen sub-windows are caused to correspond to display forms such as color, shape and size of the split display screen, the projection operation sub-window W600 may be changed in accordance with the change in the display form.

The screen sub-windows W610 to W640 constituting the projection operation sub-window W600 may be configured to display a thumbnail prepared by the CPU 70 on the basis of image data to be displayed in the corresponding split screen forming areas, stored in the RAM 88. For example, in the screen sub-windows W610 to W640, a display part to show a thumbnail may be provided at a position that does not obstruct the various buttons, or a translucent thumbnail prepared by reduction of luminance signals may be superimposed on the various buttons. Thus, the correspondence between the split screen forming areas and the screen sub-windows W610 to W640 may be easier to recognize and operations may be carried out more easily.

Now, the operation O360 will be described again. The teacher M selects “student A” in the participant display sub-window W520 by using the above GUI, then confirms the content of the display screen image PCT1 displayed in the preview sub-window W700, and clicks the projection button B613 in the top left screen sub-window W610. Similarly, the teacher M selects the students B to D, then confirms the contents of the display screen images PCT2 to PCT4 displayed in the preview sub-window W700, and clicks the projection buttons B623 to B643 in the top right, bottom right and bottom left screen sub-windows W620 to W640. These operations are instruction operations to cause the projector PR1 to project a quadrisected image including the display screen images PCT1 to PCT4 of the computers PC1 to PC4. These instructions are accepted by the CPU 70 as the processing at the combined image accepting unit 73.

When a split display instruction is accepted, the CPU 70 of the moderator computer PCm sequentially sends a data transmission request to the computers PC1 to PC4 (step S300).

As the CPU 20 of the computers PC1 to PC4 receives the data transmission request sent from the moderator computer PCm (S320), the CPU 20 sends image data of the display screen images PCT1 to PCT4 displayed in the display 65 of each computer to the moderator computer PCm, as the processing at the data transmitting unit 21 (step S321). The image data of the display screen images PCT1 to PCT4 are image data (for example, here, RGB image data) recorded in the VRAM 61 of the computers PC1 to PC4 when the data transmission request is received. The image data is sent together with setting information of the graphic controller 63 that is necessary to display the image data as an image. In the embodiment(s), however, where the graphic controller 63 of the computers PC1 to PC4, the graphic controller 113 of the moderator computer PCm and the graphic controller 153 of the projector PR1 have a uniform setting, the setting information of the graphic controller 63 does not have to be sent.

Having received the transmission from the computers PC1 to PC4, the CPU 70 of the moderator computer PCm receives the image data of the display screen images PCT1 to PCT4 sent from each of the computers PC1 to PC4 and stores the image data in association with the computer names into the RAM 85, as the processing at the data communication control unit 71 (step S301). Then, the CPU 70 generates combined image data that represents a combined image of the display screen images PCT1 to PCT4 in the RAM 85, as the processing at the image combining unit 72 (step S302).

After generating the combined image data, the CPU 70 sends the combined image data of the display screen images PCT1 to PCT4 to the projector PR1, as the processing at the data communication control unit 71 (step S304).

In the projector PR1, the CPU 120 receives the combined image data of the display screen images PCT1 to PCT4 sent from the moderator computer PCm and stores the combined image data into VRAM 151, as the processing at the data receiving unit 121. The graphic controller 153 reads the image data in the VRAM 151 and projects an image on the screen SC1 by using the projecting unit 155 (step S340). Thus, a quadrisected screen showing the display screen images PCT1 to PCT4 in the split screen forming areas SC11 to SC14, respectively, is displayed on the screen SC1, as illustrated in the left column in FIG. 9.

In at least one embodiment, the projector projection operation window W500 is in a state as illustrated in FIG. 13. As illustrated in FIG. 13, “projecting” is shown in the participant display sub-window W520 as the status of the students A to D. In the projection operation sub-window W600, “students A to D” are shown in the projection user display parts D611, D621, D631, and D641, respectively. In the preview sub-window W700, the display screen image PCT4 corresponding to the student D is shown, who is the last to be selected in the participant display sub-window W520.

In step S302 and step S304, the CPU 70 receives image data from all of the computers PC1 to PC4, generates combined image data, and then sends the combined image data. However, the CPU 70 may generate and send combined image data at predetermined timing. In the former embodiment, an image of quadrisected display is immediately displayed on the screen SC1. In the latter embodiment, images in the process of generating the quadrisected display image are sequentially displayed as well.

In order to let the student A explain the display screen image PCT1 in more detail, the teacher M may operate the input system 101 to give an instruction to switch the display form of the image projected on the screen SC1 from the quadrisected screen of the display screen images PCT1 to PCT4 to the full-screen display of the display screen image PCT1 of the computer PC1 (operation O361). Specifically, the teacher M clicks the full-screen display button B615 in the top left screen sub-window W610 in the projector projection operation window W500 displayed on the display 115 of the moderator computer PCm.

In response to this instruction, in the moderator computer PCm, the CPU 70 accepts the instruction, as the processing at the image switching accepting unit 74, and sends the image data of the display screen image PCT1 recorded in the RAM 85 in association with the name of the computer PC1, to the projector PR1, as the processing at the data communication control unit 71 (step S305).

In the projector PR1, the CPU 120 receives the image data of the display screen image PCT1 sent from the moderator computer PCm and projects an image on the screen SC1 as in the above step S340, as the processing at the data receiving unit 121 (step S341). As such, the display screen image PCT1 is displayed as a full-screen image on the screen SC1, as illustrated in the left column in FIG. 9. In this manner, the student A using the computer PC1 may show, for example, the display screen image PCT1 displayed as a full-screen image on the screen SC1 to the other students and may give a detailed explanation about the display screen image PCT1 while confirming its content on the display 65 of the computer PC1.

While the display screen image PCT1 is projected in the full-screen display on the screen SC1 and the student A is explaining the display screen image PCT1, the teacher M may operate the input system 101 to give an instruction to prepare combined image data by replacing the display screen image PCT2 of the combined image data including the display screen images PCT1 to PCT4, with the display screen image PCT5 (operation O362). Specifically, the teacher M clicks the stop button B624 in the top right screen sub-window W620 corresponding to the split display area of the display screen image PCT2, in the projector projection operation window W500 displayed on the display 115 of the moderator computer PCm, and then selects “student E” in the participant display sub-window W520 and clicks the projection button B823 in the top right screen sub-window W620. This operation is in preparation for split display of the display screen images PCT1, PCT5, PCT3 and PCT4 after the explanation of the display screen image PCT1 is completed.

In response to this instruction, in the moderator computer PCm, the CPU 70 accepts the instruction as the processing at the combined image accepting unit 73, then specifies the IP address of the counterpart with reference to the client name profile 82 and the hourly profile 83, and sends a data transmission request to the computer PC5 (step S306).

As the CPU 20 of the computer PC5 receives the data transmission request sent from the moderator computer PCm (step S322), the CPU 20 sends the image data of the display screen image PCT5 displayed on the display 65 to the moderator computer PCm, as the processing at the data transmitting unit 21 (step S323). The transmission of image data in this step S323 and in the above step S321 may be carried out in a compressed image format such as, for example, JPEG in consideration of the communication load on the local area network LAN.

In response to the transmission from the computer PC5, the CPU 70 of the moderator computer PCm receives the image data of the display screen image PCT5 sent from the computer PC5 and stores the image data into the RAM 85 in association with the computer name, as the processing at the data communication control unit 71 (step S307). Then, from the image data of the display screen images PCT1, PCT5, PCT3 and PCT4 stored in the RAM 85, the CPU 70 generates combined image data representing a combined image of the display screen images PCT1, PCT5, PCT3 and PCT4 in the RAM 85, as the processing at the image combining unit 72 (step S308).

When the explanation of the display screen image PCT1 by the student A is finished, the teacher M may operate the input system 101 to give an instruction to switch the display form of the image projected on the screen SC1 from the full-screen display of the display screen image PCT1 to the split screen (operation O363). Specifically, the teacher M clicks the full-screen display button B615 in the top left screen sub-window W610 in the projector projection operation window W500 displayed on the display 115 of the moderator computer PCm.

In response to this instruction, in the moderator computer PCm, the CPU 70 accepts the instruction as the processing at the image switching accepting unit 74, and sends the combined image data of the display screen images PCT1, PCT5, PCT3 and PCT4 recorded in the RAM 85 to the projector PR1, as the processing at the data communication control unit 71 (step S310).

In the projector PR1, the CPU 120 receives the combined image data of the display screen images PCT1, PCT5, PCT3 and PCT4 sent from the moderator computer PCm, as the processing at the data receiving unit 121, and projects an image on the screen SC1 as in the above steps S340 and S341 (step S342). As such, on the screen SC1, a quadrisected screen showing the display screen images PCT1, PCT5, PCT3 and PCT4 in the split screen forming areas SC11 to SC14, respectively, is displayed as shown in the left column in FIG. 10. Thus, the screen switching processing according to at least one embodiment is complete.

In at least one embodiment, in response to a data transmission request from the moderator computer PCm, the computers PC1 to PC5 send image data recorded in the VRAM 61 at the time of receiving the transmission request, to the moderator computer PCm. However, the computers PC1 to PC5 are not limited to such a configuration. For example, the computers PC1 to PC5 may send image data recorded in the VRAM 61 to the moderator computer PCm at periodic timing intervals. Alternatively, as another example, the computers PC1 to PC5 may send image data to the moderator computer PCm every time data in the VRAM 61 is rewritten. With such configurations, every time the moderator computer PCm receives image data, the image displayed on the screen SC1 may be updated to the latest image by the method in at least one previously described embodiment. Thus, even in the embodiment where there is a change in the display screen images PCT1 to PCT5 of the computers PC1 to PC5 or in the embodiment where the display screen images PCT1 to PCT5 are dynamic images, the display screen images PCT1 to PCT5 may be displayed on the screen SC1 while the change in the display screen images PCT1 to PCT5 is followed. When such configurations are employed, if the computers PC1 to PC5 sends only the rewritten data part, the communication load on the local area network LAN may be reduced.

In certain previously described embodiment(s), the display screen images PCT1 to PCT5 are projected on the screen SC1. However, it is also possible to project the display screen image PCTm of the moderator computer PCm by selecting the teacher M in the participant display sub-window W520 in the projector projection operation window W500. In this embodiment, the teacher M can display desired image data on the display 115 and then minimize the projector projection operation window W500.

In certain previously described embodiment(s), the images projected on the screen SC1 are the display screen images PCT1 to PCT5 of the computers PC1 to PC5. However, the images to be projected are not limited to these and can be any image that is handled by the computers PC1 to PC5. For example, in an embodiment where the computers PC1 to PC5 are equipped with a web camera, images shot by the web camera may be projected. Alternatively, designated image data, of image data stored in each of the computers PC1 to PC5, may be projected without being displayed on the display 65 of the computers PC1 to PC5.

In certain previously described embodiment(s), a projector is used as the image display apparatus in conference system 10. However, various display devices such as, for example, a plasma display, liquid crystal display and organic EL display may be used. Moreover, though the computers PC1 to PC5 are used as exemplary terminals in the conference system 10, various communication terminals such as, for example, a mobile phone and PDA (personal digital assistant) may be used.

In certain previously described embodiment(s), the moderator computer PCm functions as a server that receives image data from the computers PC1 to PC5, carries out processing such as generating a combined image and sends the combined image to the projector PR1. However, the moderator computer PCm operated by the teacher M and a server may be separately installed. As such, the load on the moderator computer PCm may be reduced and the performance of the moderator computer PCm may be enhanced. Moreover, in such embodiment, the hourly profile 33 stored on the hard disk drive 30 of the computers PC1 to PC5, and the hourly profile 83 and the class makeup profile 84 stored on the hard disk drive 80 of the moderator computer PCm may be collectively managed by the server. The computers PC1 to PC5 and the moderator computer PCm may access the server every time the connection processing shown in FIG. 5 and FIG. 6 is carried out, and then read a necessary profile. Of course, in the embodiment where the moderator computer PCm functions as a server, the moderator computer PCm may collectively manage the profiles. As such, the timetables for the teacher M and the students A to E, the makeup of each class and the like may be collectively managed and may be easier to manage.

The graphical user interface device used in the conference system 10 of various previously described embodiments causes the display 115 to display the projection operation sub-window W600 having the same number and layout of screen sub-windows as the split screen forming areas that constitute the split display screen displayed on the screen SC1. As such, by carrying out an operation using a screen sub-window corresponding to a split screen forming area where the user wants to carry out the operation, it is no longer necessary to carry out an operation to select the split screen forming area where the operation is to be carried out. Moreover, which screen sub-window is associated with which split screen forming area may be visually grasped more easily. Thus, operations such as allocation of images to the split screen forming areas SC11 to SC14 of the screen SC1 may be more easily carried out.

The graphical user interface device used in the conference system 10 of certain previously described embodiments also causes the display 115 to display the projection operation sub-window W600 in which each of the screen sub-windows W610 to W640 has the full-screen display button to switch between split screen display and full-screen display. As such, by clicking the button in a screen sub-window corresponding to an image that is to be shown in full-screen display and thus giving an instruction to switch the display on the screen SC1 from split screen display to full-screen display, it is no longer necessary to carry out an operation to select the image that is to be shown in full-screen display. As such, the display form may be more easily switched to full-screen display with fewer operations.

The graphical user interface device used in the conference system 10 of certain previously described embodiments also causes the display 115 to display the projection operation sub-window W600 in which each of the screen sub-windows has the projection button to allocate a predetermined image to the corresponding split screen forming area and the full-screen display button to switch between split screen display and full-screen display. As such, it is possible to allocate a predetermined image to the split screen forming areas SC11 to SC14 while an image of full-screen display is shown on the screen SC1 as a result of clicking the full-screen display button to switch the display on the screen SC1 from split screen display to full-screen display. As such, at the time of switching again from full-screen display to split screen display, relatively little or no waiting time is required due to an operation to allocate an image to the split screen forming areas. As such, it is possible to more smoothly switch between split screen display and full-screen display.

Moreover, in the graphical user interface device used in the conference system 10 of certain previously described embodiments, when the number of splits, layout or the like for the screen display on the screen SC1 is changed by using the projector selection window W400, the number of screen sub-windows, their layout or the like in the subsequently displayed projector projection operation window W500 is changed in accordance with that change. As such, no matter what split screen has its number of splits and layout changed, or even when the number of splits and layout are changed while the conference system 10 is being used, the correspondence between the screen sub-windows and the split screen forming areas of the screen SC1 may be visually maintained, and operations such as allocation of an image to the split screen forming areas may be more easily carried out.

Although certain embodiments have been described above, the disclosure is not limited to such embodiments. Various changes and modifications may be made without departing from the scope and spirit of the disclosure. For example, while the moderator computer PCm is equipped with the graphical user interface device in certain previously described embodiments, the graphical user interface device may also be installed in a display device such as the projector PR1. Accordingly, those with skill in the art will readily appreciate that embodiments in accordance with the present disclosure may be implemented in a very wide variety of ways. This disclosure is intended to cover any adaptations or variations of the embodiments discussed herein. Therefore, it is manifestly intended that embodiments in accordance with the present disclosure be limited only by the claims and the equivalents thereof.

Claims

1. A graphical user interface device configured to control a projector which displays a combined image including a first area and a second area, the graphical user interface device comprising:

an image display device configured to display an operation window including a first operation area which corresponds to the first area and a second operation area which corresponds to the second area;

an allocation unit configured to allocate the graphical user interface device to the first operation area, and to allocate one of a plurality of participant devices to the second operation area; and

a controller configured to control the projector to display the combined image in which a first image, that corresponds to the image display device of the graphical user interface device, is displayed in the first area and in which a second image, that corresponds to a participant device allocated to the second operation area, is displayed in the second area.

2. The graphical user interface device according to claim 1, wherein the first operation area and the second operation area are arranged in a same positional relation as a layout of the first area and the second area.

3. The graphical user interface device according to claim 1, further comprising a switching unit configured to switch at least one of the first image associated with the first operation area and the second image associated with the second operation area from being displayed on one of the first area and the second area in a split screen display to being displayed in a full-screen display.

4. The graphical user interface device according to claim 3, wherein the allocation unit is configured to permit selective association of a new image to the first operation area or the second operation area while the switching unit is switching from displaying at least one of the first image or the second image in the split screen display to displaying the first image or the second image in the full-screen display.

5. The graphical user interface device according to claim 1, further comprising a unit configured to display a thumbnail of the first image in the first operation area, and displays a thumbnail of the second image in the second operation area.

6. The graphical user interface device according to claim 1, further comprising:

a unit configured to change at least one of a number of split screen forming areas that includes the first area and the second area and a layout of the number of split screen forming areas; and

a unit configured to change a number of operation areas that includes the first operation area and the second operation area in accordance with the changed number of the split screen forming areas and change a layout of the number of operation areas in accordance with the changed layout of the split screen forming areas.

7. The graphical user interface device according to claim 1, further configured to:

read a predefined data set;

upon receiving a connection request from a participant device, permit a connection if the participant device belongs to the predefined data set;

select at least two participant devices for display on the image display device and assigning each of these participant devices to one of the first and second operation areas;

receive image data from each of the at least two participant devices;

combine the image data from the at least two participant devices to form the first and second images; and

provide the first and second images for display on the first and second areas.

8. The graphical user interface device according to claim 1, wherein the graphical user interface device is implemented within a personal computer.

9. A conference system including:

the graphical user interface device of claim 1; and

the projector displaying the combined image including the first area and the second area.

10. The graphical user interface device according to claim 1, further configured to display to a user a list of participant devices that are connected to the graphical user interface device and a status of whether image data from each of the participant devices is being transmitted to the projector.

11. The graphical user interface device according to claim 1, further configured to receive a selection of a projector for displaying the first and second images on the image display device, and receiving a selection of a screen display setting for configuring the number of first and second areas of the image display device.

12. The graphical user interface device according to claim 1, wherein each of the first and second operation areas have a colored window and each of the first and second areas include a screen frame having a distinguishing color, each of the windows of the first and second operation areas having a same color as the color of the screen frame of the first or second area associated with the first or second operation area.

13. A method for controlling a projector which displays a combined image including a first area and a second area by a graphical user interface device, the method comprising:

displaying, on an image display device of the graphical user interface device, an operation window including a first operation area which corresponds to the first area and a second operation area which corresponds to the second area;

allocating the graphical user interface device to the first operation area;

allocating one of a plurality of participant devices to the second operation area; and

controlling the projector to display the combined image in which a first image, that corresponds to the graphical user interface device, is displayed in the first area and in which a second image, corresponds to a participant device allocated to the second operation area, is displayed in the second area.

14. The method according to claim 13, wherein the first operation area and the second operation area are arranged in a same positional relation as a layout of the first area and the second area.

15. The method according to claim 13, further comprising:

switching at least one of the first image associated with the first operation area and the second image associated with the second operation area from being displayed on one of the first area and the second area in a split screen display to being displayed in a full-screen display.

16. The method according to claim 15, further comprising:

permitting selective association of a new image to the first operation area or the second operation area while the switching unit is switching from displaying at least one of the first image and the second image in the split screen display to displaying the first image or the second image in the full-screen display.

17. The method according to claim 13, further comprising:

displaying a thumbnail of the first image in the first operation area; and

displaying a thumbnail of the second image in the second operation area.

18. The method according to claim 13, further comprising:

changing at least one of a number of split screen forming areas that includes the first area and the second area and a layout of the number of split screen forming areas;

changing a number of operation areas that includes the first operation area and the second operation area in accordance with the changed number of the split screen forming areas; and

changing a layout of the number of operation areas in accordance with the changed layout of the split screen forming areas.

19. The method according to claim 13, further comprising:

reading a predefined data set;

upon receiving a connection request from a participant device, permitting a connection if the participant device belongs to the predefined data set;

selecting at least two participant devices for display on the image display device and assigning each of these participant devices to one of the first and second operation areas;

receiving image data from each of the at least two participant devices;

combining the image data from the at least two participant devices to form the first and second images; and

providing the first and second images for display on the first and second areas.

20. The method according to claim 13, further comprising:

displaying to a user a list of participant devices that are connected to the graphical user interface device and a status of whether image data from each of the participant devices is being transmitted to the projector.

21. The method according to claim 13, further comprising:

receiving a selection of a projector for displaying the first and second images on the image display device; and

receiving a selection of a screen display setting for configuring the number of first and second areas of the image display device.

22. The method according to claim 13, wherein each of the first and second operation areas have a colored window and each of the first and second areas include a screen frame having a distinguishing color, each of the windows of the first and second operation areas having a same color as the color of the screen frame of the first or second area associated with the first or second operation area.

23. The method according to claim 13, wherein the first image and the second image are not displayed in the operation window.

24. The method according to claim 13, further comprising:

displaying, on the image display device, a preview window that is separate from the operation window, the preview window including at least one of the first image and the second image.

25. A computer program product comprising instructions recorded on at least one non-transitory computer-readable storage medium and executable by a computer to control a projector which displays a combined image including a first area and a second area, the instructions executable to perform:

displaying, on an image display device of the computer, an operation window including a first operation area which corresponds to the first area and a second operation area which corresponds to the second area;

allocating the computer to the first operation area;

allocating one of a plurality of participant devices to the second operation area; and

controlling the projector to display the combined image in which a first image, that corresponds to the image display device of the computer, is displayed in the first area and in which a second image, that corresponds to a participant device allocated to the second operation area, is displayed in the second area.

26. The computer program product according to claim 25, wherein the first operation area and the second operation area are arranged in a same positional relation as a layout of the first area and the second area.

27. The computer program product according to claim 25, wherein the instructions are executable to further perform:

switching at least one of the first image associated with the first operation area and the second image associated with the second operation area from being displayed on one of the first area and second areas in a split screen display to being displayed in a full-screen display;

28. The computer program product according to claim 27, wherein the instructions are executable to further perform:

permitting selective association of a new image to the first operation area or the second operation area while the switching unit is switching from displaying at least one of the first image or the second image in the split screen display to displaying the first image or the second image in the full-screen display.

29. The computer program product according to claim 25, wherein the instructions are executable to further perform:

displaying a thumbnail of the first image in the first operation area; and

displaying a thumbnail of the second image in the second operation area.

30. The computer program product according to claim 25, wherein the instructions are executable to further perform:

changing at least one of a number of split screen forming areas that includes the first area and the second area and a layout of the number of split screen forming areas;

changing a number of operation areas that includes the first operation area and the second operation area in accordance with the changed number of the split screen forming areas; and

changing a layout of the number of operation areas in accordance with the changed layout of the split screen forming areas.

31. The computer program product according to claim 25, wherein the instructions are executable to further perform:

reading a predefined data set;

upon receiving a connection request from a participant device, permitting a connection if the participant device belongs to the predefined data set;

selecting at least two participant devices for display on the image display device and assigning each of these participant devices to one of the first and second operation areas;

receiving image data from each of the at least two participant devices;

combining the image data from the at least two participant devices to form the first and second images; and

providing the first and second images for display on the first and second areas.

32. The computer program product according to claim 25, wherein the computer program product is implemented within a personal computer.

33. A conference system including:

the computer program product according to claim 25; and

the projector displaying the combined image including the first area and the second area.

34. The computer program product according to claim 25, wherein the instructions are executable to further perform:

displaying to a user a list of participant devices that are connected to the graphical user interface device and a status of whether image data from each of the participant devices is being transmitted to the projector.

35. The computer program product according to claim 25, wherein the instructions are executable to further perform:

receiving a selection of a projector for displaying the first and second images on the image display device; and

receiving a selection of a screen display setting for configuring the number of first and second areas of the image display device.

36. The computer program product according to claim 25, wherein each of the first and second operation areas have a colored window and each of the first and second areas include a screen frame having a distinguishing color, each of the windows of the first and second operation areas having a same color as the color of the screen frame of the first or second area associated with the first or second operation area.

37. The computer program product according to claim 25, wherein the first image and the second image are not displayed in the operation window.

38. The computer program product according to claim 25, wherein the instructions are executable to further perform:

displaying, on the image display device, a preview window that is separate from the operation window, the preview window including at least one of the first image and the second image.