Method of managing and viewing image data
In a conventional method of organizing image data taken by a digital camera, only information on the date and time and position are attached to each data, without acquiring information related to the content of the data. Therefore, positional information is obtained and attached to the data of image or text, and when storing the data, information related to the position is acquired based on the positional information and stored in association with the data. Related information is also acquired when the data is viewed. The size of a data file is reduced with a decreased size of information attached to the file. Acquiring the latest information as well as previous information upon viewing the data is possible, since information related to the position of data creation is available in addition to information on the date and time and position, when storing and viewing the data. The acquired information enables detailed categorizing, searching and rendering of data.
The present invention relates to a method of obtaining additional information associated with data created by a user.
Recently, the opportunities to take a picture with a digital camera and a mobile camera, or the built-in camera of a mobile phone, have increased. Since taking a picture using these information processing devices is easy, a large number of image files can accumulate quickly, so that the user is faced with the difficulty of organizing and sorting out such a large number of image files.
To deal with this problem, a method of attaching information, such as a date and time, to image data when the image data is captured has been proposed. As to digital cameras, there is a widely used data format called Exif, which makes it possible to store various types of information, such as shutter speed and date and time. Further, some image formats are configured to be able to store additional information, such as a comment.
In addition, there is a known method according to which positional information indicative of the degrees of latitude and longitude of a location where image data is captured is obtained by using the GPS system, and such positional information can be attached to the image data as well. Such a method is disclosed in JP-A-2001-211364, for instance.
There is also another known method according to which positional information is attached to an image file at the point of the image taking operation, and other information, such as vicinity information and advertisement information, is obtained on the basis of information specifying the person who took the image or information obtained by using the GPS or via a base station of a mobile phone, and this information is included in the image file or is provided to the user. For example, JP-A-2002-344867 discloses such a method.
According to the method disclosed in JP-A-2002-344867, when a taken image is viewed, regional information obtained at the time of taking the image is provided, and, therefore, only previous or obsolete information included in the image file is available, so that it is impossible to access the latest information at the time of viewing the image data.
In addition, the conventional art has suffered from a drawback in that an information processing device having a memory area of relatively small size, such as a mobile phone or a digital camera, can not store a large volume of image data, particularly in a case where the regional information obtained at the time of taking images is detailed and the amount of data representative of the regional information becomes enormous.
SUMMARY OF THE INVENTIONTherefore, it is an object of the present invention to provide a method and a system that are capable of attaching only a minimum of required information to a file, such as an image data file, when creating the file, and providing a user with other information based on the attached information.
According to this invention, additional information, such as positional information, is attached to data such as an image and a note created with an information processing terminal, which may be a mobile phone or a digital camera. When the data is stored and viewed, information related to the position or place at which the data is created can be obtained on the basis of the additional information.
Thus, the invention makes it possible to obtain the latest information related to a data, based on previous information concerning the data, which has been obtained upon creation of the data.
BRIEF DESCRIPTION OF THE DRAWINGS
Initially, a user operates an information processing device, such as a digital camera or a mobile phone, to take a picture or to create a document, so as to generate or create data in the form of a picture or a document. Additional information, such as positional information indicative of where the data is created, and the date and time when the data is created, is obtained and added or attached to the data. Then, the data to which the additional information is attached is sent to a server to be stored therein. The term “server” refers to an information processing device for storing the data. For instance, the additional information is written in a comment section of the data in Exif format or other image formats. As a means for obtaining the positional information, positional-information obtaining equipment, such as the GPS system or a base station of a mobile phone may be employed. Thus, geographic information concerning the position at which the person creating the data is currently actually present can be obtained and attached to the data.
Hereinafter, information indicative of the geographic position at which the data is created will be called “location information”, which may consist of degrees of latitude and longitude.
In addition, a short range communication, such as that carried out through a wireless LAN or infrared data communication may be used as a means for obtaining the positional information. In this case, by short range radio transmission, a communication is established between the information processing device of the user and another information processing device, which functions as an access point and is located near the user at the time of creating the data. The information processing device, which serves as the access point, may be located at various places including: public institutions, such as commercial facilities, a community center and library, buildings in a leisure facility, such as an amusement park, and tourist sites, such as a shrine and a temple. From the information processing device functioning as the access point, there is obtained positional information, such as location information indicative of an actual location of each place or establishment where the access point is placed, or positional information in the form of a URL (Uniform Resource Locator) and a URI (Uniform Resource Identifier), each of which uniquely identifies each place or establishment in a wide area communications network, such as the Internet. For instance, where the positional information is obtained through a wireless LAN, the information processing device functioning as the access point emits electric waves of the wireless LAN. In this case, the information processing device of the user merely needs to receive and process the electric waves of the wireless LAN; and, when the user comes within reach of the electric waves, it is possible to connect his or her information processing device to the wireless LAN, so as to establish communication therethrough. In another case, where the positional information is obtained when the user passes through a particular place, such as an entrance gate of an amusement park, transmission of the positional information is enabled by communication using a RFID (Radio Frequency Identification) system or by infrared data communication. Further, the positional information may be obtained by reading a two-dimensional code, such as a bar code, from a terminal that the user carries.
Hereinafter, the positional information which identifies the position of the information processing device as the access point in a wide area communications network will be referred to as “network position information”. Where short range communication is available, the information indicating the location of the establishment can be obtained through the short range communication, in addition to the network position information.
Further, in the case where short range communication is used to obtain the positional information, when an information processing device serving as a sender of the positional information (which device will be referred to as “information providing equipment”) and the information processing device of the user are connected to the same network, it is possible for the information providing equipment to transmit the positional information to the information processing terminal of the user by broadcasting without identifying the user's terminal. In such a case, the information providing equipment may deliver other information than the positional information, e.g., publicity information, such as regional information and an advertisement, to the information processing device of the user. The information providing equipment includes a device, apparatus, facility, establishment or other equipment which provides the information, and it may be a school, concert hall or tourist spot, for instance.
Thus, the information processing device of the user can obtain location information in the case where the positional-information obtaining equipment, such as the GPS, is used, and it can obtain network position information in the case where short range communication with the information providing equipment is possible through a wireless LAN, for instance. When utilization of both the positional-information obtaining equipment and short range communication is possible, or when the information providing equipment holds location information too, the location information and network position information are both available. For instance, when the network position information can be obtained through a LAN and the information providing equipment holds location information also, the location information can be provided to the user's information processing device through the LAN. In addition, since data of large volume representative of regional information, e.g. a map, is not attached to the created data, the size of the data to which the location and/or network position information is attached is made relatively small.
The created data is stored in the server by being sent through, for instance, a wide area communications network, such as the Internet, or a short range communications network, such as a wireless LAN or an infrared communication link. Alternatively, the data may be stored in the server by first being stored in an external memory device, e.g., a flash memory, and then the external memory device is connected to the server to send the data to the server in which the data is stored. When storing the data, the server identifies the information providing equipment based on the location information or network position information attached to the data, collects information related to the position or place at which the data is created, and stores the data while associating the related information with the data. With the data, date-and-time information and positional information, i.e., location information and/or network position information, are stored. The user selects whether to store information other than the above-indicated information with the data; for example, it may be set up prior to the data creation, such that storing the other information is restricted as desired. Further, when the data is stored, information related to the positional information (e.g., Web information obtained on the basis of the URL) of the data is obtained and stored with the data. According to this arrangement, when the data is viewed later, the information related to the positional information, which has been obtained at the time of storing the data, can be viewed. The identification of the information providing equipment based on the positional information is performed by an information providing equipment identifier 90 to be described later.
In the case where the network position information is available as positional information, it is easy to identify the information providing equipment, and, in turn, it is easy to obtain information related to the position or place at which the data is created (which will be referred to as “information related to the positional information” hereinafter). The information related to the positional information may be information on stores in the vicinity of the position or a place at which the data is created, an advertisement of such stores, the weather at the time when the data is created, etc.
On the other hand, in the case where only the location information is available as the positional information, a system or function for converting the location information into network position information is utilized. More specifically, since the degrees of latitude and longitude of the position or place where the data is created are obtained as location information, the system or function provides network position information corresponding to an establishment located at the position represented by the degrees of latitude and longitude.
When the data is viewed, the information related to the positional information is also displayed, thereby providing the user the detailed information on the position or place at which the data has been created. When the user stores the data in the server, the information related to the positional data may be obtained and returned to the information processing terminal of the user, so as to make it possible to deliver information on the position or place at which the data has just been created.
As described above, according to the invention, location information and/or network position information is obtained when creating data; and, when data is stored in the server, information related to the positional information is obtained. The information related to the positional information is stored or displayed while being associated with the created data. When the data is viewed, the data is displayed together with the information related to the positional information and the latest information on the position or place at which the data has been created, as obtained on the basis of the location information or network position information. Thus, it is possible to provide advertisements or the latest information related to the time or position when or where the data has been created.
One embodiment of the present invention will be described in detail. It is to be understood that the invention is not limited to the details of the embodiment as described below.
Description of the embodiment will be generally constituted in two parts, namely, one part regarding processing implemented when data is created and stored, and the other part regarding processing implemented when the data is viewed.
The following is a description of the processing for obtaining location information and network position information implemented when data is created.
When the user creates data, for instance, takes a picture or makes a note, using the information processing terminal 10, the terminal 10 communicates with the positional information transmitter, such as the GPS system (or satellites thereof) or base station of a mobile phone, or with the information providing equipment 60, or alternatively with both of them, to obtain the related location information and/or network position information. The location information is obtained from the positional information transmitter via the positional information obtaining portion 70.
The network position information can be obtained according to any of the methods described below. Once the network position information is obtained, the information providing equipment 60 can be identified.
A first way is one in which the user operates the terminal 10 to temporarily establish a connection to the information providing equipment 60 located nearby, through the communications network, such as a wireless LAN, or by infrared communication, to obtain the network position information of the information providing equipment 60 from the equipment 60 itself. A second way, which is employed in a case where the network position information of the information providing equipment 60 is known to the user, is one in which the user attaches the network position information to the data, e.g., image data. A third way, which is employed in a case where the information providing equipment 60 is known to the user, is one in which the user obtains the network position information of the information providing equipment 60, for instance, by utilizing a search server via the communications network 20, and attaches the network position information to the data, e.g. image data.
A fourth way, which is available in a case where the information processing terminal 10 is equipped with a function to read a special identification mark (e.g., a two-dimensional code, such as a barcode), is one in which the location information and/or network position information of the information providing equipment 60 is obtained by reading the identification mark and by identifying the equipment 60 which corresponds to the identification mark as read, based on a predetermined relationship between respective identification marks and corresponding information providing equipments; and, since the information-providing-equipment identifier 90 can convert location information into network position information, in the case where only location information has been obtained, network position information is also available. This conversion is implemented as follows: A table stored in the information-providing-equipment identifier 90 in the form of a server placed in or connected to the communications network 20 is referred to, so that location information (in the form of data representative of degrees of latitude and longitude) of the information providing equipment 60 registered in the table is converted into network position information, which is returned to the information processing terminal 10.
The table indicated above is shown in
Next, a processing implemented to obtain the information related to the positional information when storing the data will be described.
The information processing terminal 10 operates to store the substantive data together with its positional information and other information, such as date-and-time information indicative of the date and time when the data is created, in the server 30 via the communications network 20 or external memory device 80. The server 30 identifies the information providing equipment 60 based on the positional information received, and it obtains information related to the positional information, such as publicity. In the case where only location information is available as the received positional information, the server 30 uses the information providing equipment identifier 90 to obtain corresponding network position information, and then it identifies the information providing equipment 60. It is noted that the date-and-time information is obtained from the information processing terminal 10. The information related to the positional information. (or simply “related information”), created data, positional information (i.e. location information and/or network position information), and date-and-time information are stored in the data storage device 40 while being correlated. It is noted that network position information of the server 30 has been set in the information processing terminal 10 beforehand by the user. Alternatively, the network position information of the server 30 may be set at any time desired.
The processing implemented when the data stored in the server 30 is viewed will be described with reference to
The location information and/or network position information acquired when the data is created, and the information related to the positional information as acquired when the data is stored, are utilized or displayed when the substantive data is viewed. The viewing data may be implemented such that the user operates the operation terminal 50 to establish a communication with the server 30 via the communications network 20, so as to display the image or note stored in the server 30 on a display of the operation terminal 50 or a screen of a monitor or other device which is connected to the operation terminal 50. The communication indicated here may be by short range communication, such as infrared communication, or effected via a wireless LAN, or it may be carried out through a wide range communications network, such as the Internet. Or, alternatively, the server 30 may be equipped with a user interface through which the user can directly access or view the data, without using the operation terminal 50. When the data is viewed, the relevant information providing equipment 60 may be identified on the basis of the location information or network position information, so as to access the equipment 60 to receive currently valid or latest information indicative of recommended, merchandise information, advertising information or others, which are displayed with the substantive data to be viewed. For instance, the information obtained from the information providing equipment 60 includes: meteorological information indicative of, for example, weather and temperature; traffic information; particular information being rendered by the equipment 60 when accessed (e.g. information on an event presently held, or an advertisement, such as merchandise information); and a future schedule. It is configured such that such information is selectable by the user as desired.
The information obtained at the time of creating the data, such as positional information and date-and-time information, and the information acquired when the data is stored, are used when the user searches some information stored in the data storage device 40.
First, a camera function of the information processing terminal 10 is activated (step 1000), and the user takes a picture with the camera to generate or create image data 15000 (step 1010). The activation of the camera function initiates the obtaining of location information or the like by means of the positional information obtaining portion 70, or the obtaining of network position information or the like by means of the receiver 100 (step 1020), which location or network position information is attached to the image data 15000 taken by the built-in camera (step 1030). In the example shown in
Next, with reference to
On the other hand, when it is determined to store the transmission data 10000 in the server 30, the data 10000 is sent to the server 30 through the communications network 20 (step 1070). The server 30 receives the transmission data 10000 and checks the content thereof to verify that no communication error has occurred (step 1110). When it is verified that the transmission data 10000 has been duly received with no error, the transmission data 10000 is stored in the data storage device 40 connected to the server 30 (step 1120). The determination of whether the transmission data 10000 has been received with no error is made by utilizing an error checking code for detecting communication errors, as will be described later by reference to
In the case where the transmission data 10000 is transmitted to the server 30, the data 10000 is stored in the data storage device 40. On the other hand, in the case where the transmission data 10000 is stored in a storage area in the information processing terminal 10 or in the external memory device 80, the transmission data 10000 may be forwarded to the server 30 and, in turn, to the data storage device 40 at a later time. This makes it possible for the server 30 to manage and search the data 10000. Since a mobile device, such as a mobile phone, typically has a relatively limited storage area, the information processing terminal 10 of the present embodiment, which takes the form of a mobile phone, transfers the data 10000 to the server 30. That is, in cases where the mobile device or other devices serving as the information processing terminal 10 having a sufficient memory capacity, the mobile device or other devices may not transfer the data 10000 to the server 30. Steps to obtain the information related to the positional information implemented when the data is stored will be described later with reference to
There are two ways to obtain the positional information; one of which uses a positional information transmitter, such as the GPS and a base station of a mobile phone, and the other of which uses a short range wireless network to obtain the positional information from the information providing equipment.
On the other hand, where the transmission data 10000 does not include network position information, but location information (data indicative of longitude and latitude of the information providing equipment 60) is included therein, the location information is transferred to the information providing equipment identifier 90, to obtain network position information of the equipment 60 therefrom (step 3020). Details of this step 3020 will be described with reference to
In a case where network position information can not be obtained on the basis of the location information, or, where network position information is not included in the transmission data 10000, identification of the information providing equipment 60 is not allowed, and, thus, the information related to positional information is not acquirable, making it impossible to provide services utilizing such information.
The information providing equipment identifier 90 identifies the network position information of the information providing equipment 60, which is returned to the server 30.
When the data 10030 stored in the data storage device 40 is displayed (step 3010), location information 20000 stored in association with the data 10030 is firstly looked up (step 3020). The server 30 transmits the location information 20000 to the information-providing-equipment identifier 90 (step 4000). The information-providing-equipment identifier 90, which has received the location information 20000, identifies the information providing equipment 60 on the basis of the data indicative of the degrees of longitude and latitude stored as the location information 20000 (step 4020). Converting location information into network position information is performed by the information-providing-equipment identifier 90, such that the identifier 90 accepts longitude-and-latitude data as an input and returns network position information. In practice, a conversion table, in which a particular pair of degrees of latitude and longitude is correlated with a unique network position data or information, is used to provide the above-described function. Since it imposes too much load on the information-providing-equipment identifier 90 to centralize management of the entirety of such a table, the data of the table may be distributed to and managed at a plurality of devices. In this case, multiple servers, each providing a function identical with that of the information-providing-equipment identifier 90, are located in or connected to the communications network 20. Further, the information converting function may be implemented on the server 30. In this case, by using a Web service or the like, it is possible to obtain network position information without the server 30. Then, the network position information 21000 (such as a URL) which specifies a unique information providing equipment 60 in the communications network 20 is returned to the server 30 (step 4030). When the network position information can not be obtained, a message indicating that the acquisition of the network position information has failed is transmitted to the server 30 (step 4030). The thus obtained network position information permits the server 30 to make a communication with the information providing equipment 60 (step 4010), and, accordingly, it enables the user to view or utilize the data 10030 and information related to the positional information relevant to the data 10030 (step 3040). When the response message is not returned from the information-providing-equipment identifier 90, the server 30 issues a time-out message 23000 for itself, and implements suitable processing for the case where the network position information is unavailable. In this case, the information providing equipment 60 can not be identified, making it impossible to display the information related to the positional information.
According to the above-described arrangement, even when communication with the information providing equipment 60 is impossible when creating the data 10030 (such as when taking an image or making a note), additional information related to the position at which the data 10030 is created can be obtained, based on the location information acquirable by means of the positional information obtaining portion 70. In a case where the information providing equipment 60 can be identified and the network position information of the equipment 60 is acquirable when the data is created, or, where the server 30 has a function to identify the information providing equipment 60 (i.e., the server 30 has the function the information providing equipment identifier 90 provides), the information-providing-equipment identifier 90 is unnecessary. The information-providing-equipment identifier 90 may be configured to have the function to return network position information for identifying the information providing equipment 60, as well as a function to return other useful information acquirable based on location information. For instance, the identifier 90 may convert latitude and longitude data into real positional information (address) which is returned to the server 30.
This specific example is directed to the display of image data taken by a camera and indicates a way of displaying the substantive content (e.g., image data) as a primarily displayed element together with its related information. In practice, other ways of display may be employed, as long as the stored data and its related information can be presented to the user in a manner which makes it recognizable that they are correlated. In a case where information related to the image data takes other forms than visual information, e.g., music or sound, it is not necessary to separately provide the display portion 6030 as shown in
It is noted that the above-described construction or configuration of the information processing terminal 10 may be embodied by using a CPU and a memory of a computer, and other LSI s, as hardware, and a program loaded on a memory, as software. However,
The data 6510 or picture has been taken in an amusement park and images of various buildings or attractions are captured in the picture. By the method according to the embodiment of the invention, information on the position at which the picture is taken is acquirable and displayable at the time of the image taking. Thus, when creating the data, information on the buildings and attractions are obtained, and each piece 6520 of the information on a building or attraction is displayed close to a lead line 6530 extending from the corresponding building or attraction in the picture or image. By employing this way of displaying data, it is possible to display the buildings and attractions and information thereon at the same time.
In a case where the information providing equipment 60 has a function to measure the distance between the user and a building or attraction, an image of which is taken by the user, or, to identify the positional relationship between the user and the building or attraction as a photographic object, it is possible to display a scene as viewed at the same location in the same perspective, as it will appear several years or decades later; for instance, where the picture of interest is one taken in a leisure facility, such as an amusement park, a history of changes in the buildings and attractions can be viewed.
Claims
1. A data management system, comprising:
- an information processing terminal which obtains a data;
- a data storage device which stores and manages the data; and
- an information providing means which transmits network position information as a positional information relevant to a position of the information processing terminal in a network, in response to a positional information acquisition request sent from the information processing terminal,
- wherein the information processing terminal sends the positional information acquisition request when the data is created, receives the network position information from the information providing means, and stores the data and the network position information in the data storage device, associating the data and the network position information with each other,
- and wherein the data storage device accesses the information providing means corresponding to the network position information when the information processing terminal accesses the data, to obtain information rendered by the information providing means currently, so that the information processing terminal displays the rendered information.
2. The data management system according to claim 1, wherein the network position information is transmitted from an information providing equipment located within a predetermined range from a position at which the data is created.
3. The data management system according to claim 1, wherein the data storage device accesses the information providing means corresponding to the network position information when storing the data, obtains information rendered by the information providing means currently, and stores the data and the rendered information, with associating the data and the rendered information with each other.
4. The data management system according to claim 1, wherein the information processing terminal has a positional information obtaining portion which obtains, when the data is created, location information indicative of a position at which the data is created, from a positional-information obtaining equipment, and transmits the location information to an information-providing-equipment identifier so as to acquire network position information relevant to the location information from the information-providing-equipment identifier.
5. The data management system according to claim 4, wherein the information-providing-equipment identifier has a table defining a correspondence relationship among a data indicative of degrees of latitude and longitude of the position at which the data is created, a place name assigned to an area including the position, and network position information pertaining to the area name, and converts between the location information and the network position information by reference to the table.
6. The data management system according to claim 4, wherein the location information is a data indicative of degrees of latitude and longitude of the position at which the data is created.
7. The data management system according to claim 1, wherein the network position information is a URI.
8. The data management system according to claim 1, wherein the data storage device is incorporated in the information processing terminal.
9. An information processing terminal having a data storage device, comprising: a data creating portion which is operable to create a data; and
- a transceiver portion which communicates with information providing means which renders information related to the data,
- the information processing terminal (i) sending, when creating the data, a positional information acquisition request to obtain network position information of the information providing means, and storing the data and the network position information in the data storage device, with associating the data and the network position information with each other, and (ii) acquiring, when displaying the data, information currently rendered by the information providing means corresponding to the network position information and displaying the data and the acquired information related to the data.
10. The information processing terminal according to claim 9, wherein the network position information is transmitted from an information providing equipment located within a predetermined range from a position at which the data is created.
11. The information processing terminal according to claim 9, having a positional information obtaining portion which obtains, when the data is created, location information indicative of a position at which the data is created, from a positional-information obtaining equipment, the information processing terminal transmitting the location information to an information-providing-equipment identifier so as to acquire network position information relevant to the location information from the information-providing-equipment identifier.
12. The information processing terminal according to claim 11, wherein the location information is a data indicative of degrees of latitude and longitude of the position at which the data is created.
13. The information processing terminal according to claim 9, wherein the network position information is a URI.
14. A data management device having a data storage device which stores a data obtained from an information processing terminal connected to the data management device,
- which is connected to an information providing means which transmits network position information as a positional information relevant to a position of the information processing terminal in a network, in response to a positional information acquisition request sent from the information processing terminal;
- which obtains the network position information from the information providing means in response to the positional information acquisition request sent from the information processing terminal, and stores the data and the network position information in the data storage device with associating the data and the network position information with each other;
- and which accesses the information providing means corresponding to the network position information when the information processing terminal accesses the data, to obtain information rendered by the information providing means currently, and transmits the rendered information to the information processing terminal.
15. The data management device according to claim 14, wherein the data storage device accesses the information providing means corresponding to the network position information when storing the data in the data storage device, to acquire information rendered by the information providing means currently and store the data and the rendered information with associating the data and the rendered information with each other.
Type: Application
Filed: Jun 23, 2004
Publication Date: Sep 29, 2005
Inventors: Takayuki Suzuki (Sagamihara), Yoshiaki Morimoto (Kawasaki), Yoichi Nakamoto (Yokohama), Hiroki Miyamoto (Kawasaki), Keitaro Okasaki (Yokohama), Shinichiro Okamura (Yokohama)
Application Number: 10/873,180