ENVIRONMENT-AWARE COMPUTERIZED INFORMATION AND DISPLAY APPARATUS
Computerized apparatus useful for obtaining and displaying information obtained from multiple sources. In one embodiment, the computerized apparatus is part of a transport device or apparatus, and includes a display device and speech recognition apparatus configured to receive user speech input and enable performance of various tasks, such as obtaining desired information relating to an entity, images thereof, maps or directions, or any number of other topics. The apparatus in one variant further includes sensor apparatus in communication with the computerized apparatus, and which enables for example display of data derived from one or more sensors exposed to an environment of the transport device on the display device.
This application is a divisional of and claims priority to co-owned and co-pending U.S. patent application Ser. No. 13/733,098 filed Jan. 2, 2013 and entitled “COMPUTERIZED INFORMATION AND DISPLAY APPARATUS; which is a continuation of and claims priority to Ser. No. 13/369,850 filed Feb. 9, 2012 and entitled “COMPUTERIZED INFORMATION PRESENTATION APPARATUS”, now U.S. Pat. No. 8,447,612; which is a continuation of and claims priority to co-owned U.S. patent application Ser. No. 12/711,692 filed Feb. 24, 2010 and entitled “ADAPTIVE INFORMATION PRESENTATION APPARATUS AND METHODS”, now U.S. Pat. No. 8,117,037; which is a continuation of and claims priority to co-owned U.S. patent application Ser. No. 11/506,975 filed Aug. 17, 2006 and entitled “SMART ELEVATOR SYSTEM AND METHOD”, now U.S. Pat. No. 7,711,565; which is a divisional of and claims priority to co-owned U.S. patent application Ser. No. 10/935,957 filed Sep. 7, 2004 and entitled “SMART ELEVATOR SYSTEM AND METHOD”, now U.S. Pat. No. 7,093,693; which is a divisional of co-owned U.S. patent application Ser. No. 10/651,451 filed Aug. 29, 2003 and entitled “SMART ELEVATOR SYSTEM AND METHOD”, now U.S. Pat. No. 6,988,071; which is a continuation of co-owned U.S. patent application Ser. No. 09/330,101 filed Jun. 10, 1999 and entitled “SMART ELEVATOR SYSTEM AND METHOD”, now U.S. Pat. No. 6,615,175, each of the foregoing incorporated into the present application by reference in its entirety.
This application is also related to U.S. patent application Ser. No. 12/703,666 filed Feb. 10, 2010 entitled “Adaptive Advertising Apparatus and Methods”, now U.S. Pat. No. 8,065,155; Ser. No. 12/704,431 filed Feb. 11, 2010 entitled “Adaptive Advertising Apparatus and Methods”, now U.S. Pat. No. 8,078,473; Ser. No. 12/711,692 filed on Feb. 24, 2010 entitled “ADAPTIVE INFORMATION PRESENTATION APPARATUS AND METHODS”, now U.S. Pat. No. 8,065,156; Ser. No. 13/364,194 filed Feb. 1, 2012 and entitled “COMPUTERIZED INFORMATION PRESENTATION APPARATUS”, now U.S. Pat. No. 8,285,553; Ser. No. 13/362,902 filed Jan. 31, 2012 and entitled “ADAPTIVE INFORMATION PRESENTATION APPARATUS”, now U.S. Pat. No. 8,370,158; Ser. No. 13/357,487 filed Jan. 24, 2012 and entitled “ELECTRONIC INFORMATION ACCESS SYSTEM AND METHODS”, now U.S. Pat. No. 8,301,456; Ser. No. 13/404,606 entitled “COMPUTERIZED INFORMATION PRESENTATION APPARATUS”, now U.S. Pat. No. 8,290,781; Ser. No. 13/404,980 entitled “COMPUTERIZED INFORMATION PRESENTATION APPARATUS”, now U.S. Pat. No. 8,296,146; Ser. No. 13/404,853 entitled “COMPUTERIZED INFORMATION PRESENTATION APPARATUS”, now U.S. Pat. No. 8,290,778; and Ser. No. 13/405,046 entitled “COMPUTERIZED INFORMATION PRESENTATION METHODS” now U.S. Pat. No. 8,296,153, each filed on Feb. 24, 2012; Ser. No. 13/406,408 entitled “COMPUTERIZED INFORMATION SELECTION AND DOWNLOAD APPARATUS AND METHODS” filed on Feb. 27, 2012, now U.S. Pat. No. 8,311,834; and Ser. No. 13/410,080 entitled “NETWORK APPARATUS AND METHODS FOR USER INFORMATION DELIVERY” filed Mar. 1, 2012, now U.S. Pat. No. 8,285,551, each of which is incorporated herein by reference in its entirety.
This application is also related to co-owned and co-pending U.S. patent application Ser. No. 13/728,512 filed Dec. 27, 2012 and entitled “SMART INFORMATION AND DISPLAY APPARATUS”; Ser. No. 13/728,715 filed Dec. 27, 2012 and entitled “COMPUTERIZED INFORMATION AND DISPLAY APPARATUS”, now U.S. Pat. No. 8,682,673; Ser. No. 13/737,833 filed Jan. 9, 2013 and entitled “COMPUTERIZED INFORMATION AND DISPLAY APPARATUS”, now U.S. Pat. No. 8,706,504; Ser. No. 13/737,853 filed Jan. 9, 2013 and entitled “TRANSPORT APPARATUS WITH COMPUTERIZED INFORMATION AND DISPLAY APPARATUS”, now U.S. Pat. No. 8,719,037; Ser. No. 13/746,266 filed Jan. 21, 2013 and entitled “COMPUTERIZED INFORMATION AND DISPLAY APPARATUS”, now U.S. Pat. No. 8,781,839; Ser. No. 13/750,583 filed Jan. 25, 2013 and entitled “COMPUTERIZED INFORMATION AND DISPLAY APPARATUS”, now U.S. Pat. No. 8,712,777; Ser. No. 13/752,222 filed Jan. 28, 2013 and entitled “COMPUTERIZED INFORMATION AND DISPLAY APPARATUS”, now U.S. Pat. No. 8,719,038; Ser. No. 13/753,407 filed Jan. 29, 2013 and entitled “COMPUTERIZED INFORMATION AND DISPLAY APPARATUS AND METHODS”, now U.S. Pat. No. 8,676,587; Ser. No. 13/755,682 filed Jan. 31, 2013 and entitled “INTELLIGENT ADVERTISING METHODS”; and Ser. No. 13/758,898 filed Feb. 4, 2013 and entitled “INTELLIGENT ADVERTISING APPARATUS”, each incorporated herein by reference in its entirety.
This application is also related to co-owned and co-pending U.S. patent application Ser. No. 14/488,239 filed on Sep. 16, 2014 and entitled “COMPUTERIZED INFORMATION AND DISPLAY APPARATUS”; and U.S. patent application Ser. No. 14/488,235 also filed on Sep. 16, 2014 and entitled “TRANSPORT APPARATUS WITH COMPUTERIZED INFORMATION AND DISPLAY APPARATUS”; U.S. patent application Ser. No. 14/491,880 filed on Sep. 19, 2014 entitled “COMPUTERIZED INFORMATION PRESENTATION APPARATUS”; Ser. No. 14/493,198 filed on Sep. 22, 2014 entitled “COMPUTERIZED INFORMATION APPARATUS”, Ser. No. 14/493,209 filed on Sep. 22, 2014 entitled “PERSONNEL TRANSPORT DEVICE WITH COMPUTERIZED INFORMATION AND DISPLAY APPARATUS”, Ser. No. 14/496,879 filed on Sep. 25, 2014 and entitled “COMPUTERIZED INFORMATION AND DISPLAY APPARATUS”; and Ser. No. 14/500,837 filed on Sep. 29, 2014 and entitled “COMPUTERIZED INFORMATION AND DISPLAY APPARATUS AND METHODS”, each also incorporated herein by reference in its entirety.
BACKGROUND OF THE INVENTION1. Field of the Invention
The present invention relates to the field of personnel transport apparatus, and specifically to elevators and similar devices for transporting people from one location to another which incorporate various information technologies.
2. Description of Related Technology
Elevators and similar personnel transport devices (such as moving walkways or shuttles) are important aspects of modern urban life. Commonly used in office buildings, airports, shopping malls, and other large structures, these devices transport large numbers of people and equipment between two locations on a routine basis. Elevators in particular are widely used throughout the world.
Depending on loading, a person may spend up to several minutes on an elevator during travel between floors. Significant amounts of time may also be spent waiting for the elevator to arrive when called. This time is usually “dead” from the standpoint that very little can be accomplished or very few tasks undertaken during these few minutes. However, often times an individual may require information which will be of use after leaving the elevator. For example, the person may wish to obtain travel information such as directions to the nearest airport or public transportation node, or the location of a nearby restaurant. Weather-related information or traffic reports may also be useful. A plethora of different types of information, including financial data, breaking news headlines, sports scores and the like may also be of interest to one waiting for or riding on an elevator or other transport device.
An associated problem relates to determining the location of a person, firm, or store within a building when unfamiliar. Building directories are often posted in the lobby of the building, yet these require the user to manually or visually locate the name of the person, firm, or store which they are looking for, and remember the location information associated therewith. Additionally, such directories often do not provide precise location information, but rather merely a floor number and/or suite number. The user often times does not have a graphical representation of the desired location in relation to the elevators, thereby resulting in additional wasted time in finding the location once off of the elevator. Even if a graphical display is provided, it often requires the user to spatially orient themselves to determine relative location.
Security is also a concern when riding elevators late at night or to remote locations. Many elevator systems are used partly or entirely within parking garages, which often may be sparsely populated at off hours. People are all too frequently assaulted or robbed when departing from elevators under such conditions. Unfortunately, existing elevator systems do not have the facility to provide the occupant(s) with the ability to selectively observe the area immediately surrounding the elevator doors on one or more destination floors, or otherwise take precautions to enhance their security.
Another problem associated with existing elevator systems relates to their loading capacity. Often, especially at peak use hours such as during the noon hour, the call buttons for several different floors within a building will be activated, and elevator cars which are at or near their loading capacity will respond. With no additional room available in the elevator, the person depressing the call button on a given floor is left to wait for the elevator doors to close, depress the call button again, and wait for another (hopefully partially vacant) car to arrive. This process not only delays the person waiting for the car, but also those on the elevator car(s), and those waiting on other floors.
In addition to the foregoing, many elevators must have a means of restricting access to certain floors during certain time periods while not interfering with other operations. These elevators generally also include means by which certain users may gain access to the restricted floors, such as a magnetic striped card which is inserted into a card reader on the elevator. However, such card readers are prone to wear and having to re-swipe the card several times in order to obtain access. Furthermore, as the card wears due to repeated swiping or bending (such as when left in the pocket of the individual carrying the card), the card will be more prone to failure and will eventually require replacement. Also, such cards are prone to unauthorized use. Someone stealing or finding the lost card can simply insert it into the card reader of the elevator and gain access to the restricted floor(s). It is also noted that since access is restricted to certain floors typically during late-night or weekend hours, HVAC and lighting systems are typically turned off or dormant in order to conserve energy. Hence, when the user arrives at one of these restricted access floors, several minutes are typically spent turning on the HVAC, lights, and any other number of electrical devices. Some systems require the user to insert their magnetic strip card in a separate reader, such as in the control room for the HVAC (which is typically located on a different floor), in order to initiate equipment operation. This is obviously time consuming and cumbersome.
Lastly, there is often an element of discomfort associated with riding an elevator car, especially when several individuals are present in the car. Due in part to minimal space within the car and nothing to occupy the occupants attention visually, there is a natural tendency for one to stare up, down, or forward at the door of the elevator, or at the visual floor indicators so as to avoid prolonged eye contact with the other occupants.
Heretofore, many of the technologies necessary to address the aforementioned issues have not been available or, alternatively, have been cost or space prohibitive to implement. However, recent advances in data networking, thin or flat panel display technology, personal electronics, and speech recognition and compression algorithms and processing have enhanced the viability of such features from both technological and commercial perspectives.
Based on the foregoing, there is a need for an improved elevator system and method of operation which will reduce the time spent waiting for and travelling on the elevator car, reduce the frustration associated with repeated stops at different floors, and allow the occupants of the elevator (as well as those waiting for the car) to use their time more efficiently and obtain needed information. Additionally, such an elevator system would enhance the security of the occupants upon egress, and allow for automatic recognition of an individual in order to provide access to certain restricted locations and initiation of certain functions such as lighting and HVAC.
SUMMARY OF THE INVENTIONIn one aspect, computerized information and display apparatus is disclosed. In one embodiment, the apparatus includes: a wireless network interface; processing apparatus in data communication with the network interface; speech processing apparatus in data communication with the processing apparatus; speech synthesis apparatus in data communication with the processing apparatus; an input device in communication with the processing apparatus and configured to, when actuated, cause the computerized information and display apparatus to enter a mode whereby a user can provide a speech input to the speech processing apparatus; a display device viewable by the user while providing the speech input; video data apparatus in data communication with the processing apparatus and the display device and configured to enable digital video data to be displayed on the display device; and a storage apparatus comprising at least one computer program in data communication with at least the processing apparatus. In one variant, the computerized information and display apparatus is configured to: after entry into the mode, obtain digitized speech from the speech processing apparatus, the digitized speech generated based on the speech input received from the user, the received speech input comprising at least part of a name of a business entity; cause, based at least in part on the digitized speech, identification of a match to the at least part of the name; cause retrieval of content associated with the match from a remote network entity via the wireless network interface; and display the content associated with the match on the display device, the content aiding the user in finding the business entity, the content comprising at least an image showing a location of the business entity and at least its immediate surroundings.
In another embodiment, the computerized information and display apparatus includes a wireless network interface; processing apparatus in data communication with the network interface; speech processing apparatus in data communication with the processing apparatus; speech synthesis apparatus in data communication with the processing apparatus; an input device in communication with the processing apparatus and configured to, when actuated, cause the computerized information and display apparatus to enter a mode whereby a user can provide a speech input to the speech processing apparatus; a display device viewable by the user while providing the speech input; video data apparatus in data communication with the processing apparatus and the display device; sensor apparatus in data communication with the computerized information and display apparatus; and a storage apparatus comprising at least one computer program in data communication with at least the processing apparatus.
In one variant, the computerized information and display apparatus is configured to provide information derived from multiple sources to the user by at least: (1) receiving, upon actuation of the input device by the user, a signal from the input device; based at least on the signal, entering the mode; obtaining digitized speech from the speech processing apparatus, the digitized speech generated based on the speech input received from the user, the received speech input comprising at least part of a name of a business entity; causing, based at least in part on the digitized speech, identification of a match to the at least part of the name; causing retrieval of content associated with the match from a remote network entity via the wireless network interface; and displaying the content associated with the match on the display device, the content aiding the user in finding the business entity, the content comprising at least an image showing a location of the business entity and at least its immediate surroundings; and (2) receiving data from the sensor apparatus; and generating, based at least on the received data, at least one of an audible and/or visual alert, the at least one alert relating to at least one of: motion sensed by the sensor apparatus; and/or infrared radiation corresponding to a living being detected by the sensor apparatus.
In a further variant, the information and display apparatus is further configured to provide information derived from multiple sources to the user by at least receiving digital video data from the video data apparatus, the digital video data generated based on video signals obtained from at least one camera apparatus; and displaying the received digital video data on the display device.
In another embodiment, the computerized information and display apparatus, includes: data processing apparatus comprising a central processor and at least one digital signal processor; speech processing apparatus in data communication with at least a portion of the data processing apparatus; speech synthesis apparatus in data communication with at least a portion of the data processing apparatus; an input device in communication with at least a portion of the data processing apparatus and configured to, when actuated, cause the computerized information and display apparatus to enter a mode whereby a user can provide a speech input to the speech processing apparatus; a display device viewable by the user while providing the speech input; video data apparatus in data communication with at least a portion of the data processing apparatus and the display device and configured to enable digital video data to be displayed on the display device, the digital video data generated based on video signals obtained from at least one camera apparatus; sensor apparatus in data communication with the computerized information and display apparatus; data storage apparatus in data communication with at least a portion of the data processing apparatus; and a storage apparatus comprising at least one computer program and in data communication with at least a portion of the data processing apparatus.
In one variant, the computerized information and display apparatus is configured to provide information to the user by at least: (1) receiving, upon actuation of the input device by the user, a signal from the input device; based at least on the signal from the input device, entering the mode; obtaining digitized speech from the speech processing apparatus, the digitized speech generated based on the speech input received from the user, the received speech input comprising at least part of a name of a business entity; causing, based at least in part on the digitized speech, identification of a match to the at least part of the name; causing retrieval of content associated with the match from the data storage apparatus; and displaying the content associated with the match on the display device, the content aiding the user in finding the business entity, the content comprising at least a graphical representation showing a rendering of a location of the business entity and at least its immediate surroundings; and (2) receiving data from the sensor apparatus; and generating, based at least on the received data, at least one of an audible and/or visual alert, the at least one alert relating to at least one of: motion sensed by the sensor apparatus; and/or infrared radiation corresponding to a living being detected by the sensor apparatus.
Reference is now made to the drawings listed above, wherein like numerals refer to like parts throughout.
It is noted that while the system and methods of the invention disclosed herein are described primarily with respect to an elevator car, certain aspects of the invention may be useful in other applications, including, without limitation, other types of personnel transport devices such as trams or shuttles or moving walkways, or stationary devices such as kiosks within the lobby or elevator waiting areas of a building. As used herein, the term “building” is meant to encompass any structure, whether above ground or underground, permanent or temporary, used for any function.
GENERAL DESCRIPTIONReferring now to
As shown in
In the present embodiment, CELP-based voice data compression is also utilized for transmission and storage of voice data. CELP algorithms in general are useful for converting analog speech to a compressed digital format which is more rapidly and easily manipulated and stored within a digital system using less bandwidth and memory. CELP algorithms and low bit rate vocoder technology are well known in the signal processing art, and accordingly will not be described further herein. Note that as used herein, the term CELP is meant to include any and all variants of the CELP family such as, but not limited to, ACELP, VCELP, and QCELP. It is also noted that while CELP is used as the basis of compression within the system 100, other types of compression algorithms and techniques, whether based on companding or otherwise, may be used. For example, PCM (pulse code modulation) or ADPCM (adaptive delta PCM) may be employed, as may other forms of linear predictive coding (LPC).
As illustrated in
The DSP 125 of the present embodiment is a Texas Instruments TMS320C6x VLIW digital signal processor or equivalent, although it will be recognized that other types of processors may be used. The ‘C6x DSP is chosen for its speed and capability, thereby allowing for real-time speech recognition. The central processor 106 and associated motherboard architecture (e.g., northbridge, southbridge, etc.) is optimally an Intel Pentium II®-based design, although others, such as the AMD K600-series processors, may be used in place of the Pentium II®. The aforementioned USB is also advantageously used with the Pentium architecture.
The information and control system keypads 116 and displays 113 (
The touch-screen display 113 generates a variety of different messages or display formats based on the user's input and query. These messages and formats are stored as digital data on the storage device 108 (and temporarily in video RAM 107) which is accessed by the processor 106. The display devices 113 of the present embodiment are low profile capacitive LCD touch screen devices of the type well known in the art, although other types of displays, including “flat” cathode ray tubes, plasma, or TFT displays may be used. Such displays optimally limit the amount of space required external to the interior volume of the elevator car to accommodate the system 100 of the present invention. Furthermore, it is noted that a non-touch sensitive display (not shown) may be used with the aforementioned input device 102 if desired, the latter acting as the sole input device (other than the speech recognition module 104 and associated microphone 118).
In the embodiment of
As shown in
In an alternative embodiment, data may be transferred between the elevator cars 180 and the to remote server 170 via a wireless interface 310 (
It will be appreciated that many different arrangements for the disposition of various components within the system, including, inter alia, the processor/motherboard, storage devices, server, and memory (and the transfer of data and signals there between) are possible, all of which are encompassed within the scope of the present invention.
Building Directory Sub-SystemThe operation of the building directory sub-system is now described in greater detail with reference to the logic diagram of
Upon entering the elevator, the user initiates the “Building Directory” function of the system by pressing a function key 122 on the keypad 116 or touch display 113. The keypad 116 and/or key 122 may be labeled with an appropriate label such as “Building Directory” or the like. Upon depressing the function key 122, a signal is generated which prompts the system to respond with an audible and/or visual query to the user, depending on how the system is pre-configured. For an audible query, the sub-system of the present embodiment retrieves a pre-stored CELP (or other compressed format) data file from one of the storage devices 108, 110 and converts that file to an analog audio representation of voice via the speech synthesis module 112 and processor 106. Speech synthesis technology is well known in the signal processing arts, and accordingly will not be discussed further herein. The audio signal from the synthesis module 112 is applied to the amplifier and audio speaker 111 to generate a voice prompt, such as “Name?”. Alternatively, or simultaneously if desired, the system 100 retrieves a separate data file from the storage device 108, 110 which represents the current building directory. The building directory data file contains a plurality of entries relating to tenants in the building where the system 100 is located. Each entry is parsed into data fields which contain, inter alia, the firm or entity name, its location (such as floor and suite number), and a list of the first and last names of all persons employed there. The processor 106 (and associated graphics co-processor 109 with video RAM 107) initiate the display of all retrieved data entries in the directory file on the display device 113 in a convenient format, such as an alphabetical list from which the user can select their desired option. The user may then speak the specific name of the party they wish to find, or select the name using the touch display 113 or other input device (such as a track ball; not shown). When the user speaks the name of the party desired, the speech recognition module 104 takes the analog signal from the microphone 118 and converts it to a digital format by way of the DSP 125 and compression algorithm, as previously described. The directory file is retrieved (if not already done), and the digitized and coded speech compared to the contents of the directory file to find any matches. Any matching fields within the entries of the data file are provided to the user, either audibly via the speech synthesis module 112 and speaker 111 using prompts, or visually via the display 113. In the present embodiment, audible prompts for a single matching entry are of the form: “[Name], [Company], located at Suite X on Floor Y”. For multiple matching entries, the audible prompts are produced in a sequential, predetermined order (such as the numerical sequence number of the entries within the directory file). For example, the first matching entry (alphabetically) would be synthesized in the foregoing form, followed by the second entry, etc. Upon hearing the desired match in this voice activated embodiment, the user simply states “Stop”, to choose the entry desired. At this point, a separate audio prompt is generated (such as “Select (floor number) Floor?”) which prompts the user to either select the floor number associated with the matched directory item and terminate their session (such as by stating “yes”), or continue on with the next entry (such as by stating “no”) until all entries are exhausted. The directory sub-system is programmed to store in memory 110 and “remember” previous files retrieved within a given user's session so as to not repeat the same selections during that same session. For example, if there are five “Smith” entries in the directory file, and the user enters the query “Smith”, the sub-system will select a different “Smith” entry on each subsequent user query during the same session until the correct Smith is located or all matching entries have been exhausted. In the present embodiment, a session is defined as the time period between two successive selections of the “Building Directory” function key 122, or the expiration of a predetermined period of time without a user input after selection of that function. The sub-system is also optionally programmed to allow the user to append defining information to the initial query statement to form a Boolean search statement. For example, if the first “Smith” selected by the sub-system is not the desired one, the user may then append the query by saying “ABC Corporation” or “John” in response to the next “Select (floor number) Floor?” query by the sub-system. The sub-system will then recognize the new entry, and search all fields in all “Smith” entries to locate those listings having both the name “Smith” and “ABC Corporation” (or “John”), using Boolean “AND” logic. The user will then be prompted again to “Select (floor number) Floor?”. If no matching entries are found, the sub-system will either notify the user to this effect, such as using an audio message such as “No matches found”, or will display or announce the nearest approximation of the query based on a confidence rating. The confidence rating is calculated, for example, by the processor 106 running an algorithm; such confidence rating calculation algorithms are well understood, and indicate the quality of the match using a numeric value or index.
As used herein, the term “match” includes any predetermined criteria for correlating one piece of data to another. For example, the building directory sub-system may be programmed to consider two pieces of data a “match” when all bits with the exception of the least significant bit (LSB) are identical. Many such criteria are possible, and all are considered to be within the scope of the invention disclosed herein. Furthermore, partial matches, such as when the user enters one word which is matched within several different entries of the directory file, may be used as the basis for an appended search, as described below.
The directory file described above also optionally has a location graphic data file appended or linked thereto, which is retrieved from the storage device 108, 110 or the server 170. The location graphic file is displayed on the display device 113 as a floor map graphic 502 illustrating the location of the selected person or firm 504 on that floor in relation to the elevator cars 180, as illustrated in
The directory system 200 of the present embodiment also optionally includes directory files for nearby office buildings or establishments, thereby alerting the user through visual or audible prompt that they are in the wrong location once a match is confirmed by the user.
The user's session is terminated, or a new query initiated, when the “Building Directory” function key 122 is again depressed, after a predetermined time period without a user input, or upon the occurrence of some other event as desired.
Network InterfaceThe information system 100 described above may also include other functional aspects. As illustrated in
The information and control system 100 may also be programmed to provide information via the display unit(s) 113 on a rotating basis without the need for user intervention. For example, a given display unit 113 may be programmed to display a summary of local weather for the next five days (such as that shown in
Referring again to
Referring now to
As shown in
Referring now to
The composite signal 812 from the integrator 813 is correlated using the processor 814 to a known weight using a proportionality or scaling constant stored in memory 815, and ultimately to a first estimate of the number of occupants within the car_by way of another scaling constant also stored in memory 815. For example, if a total pressure reading equating to 1500 lbs. (after null calibration) was obtained from the summing amplifier 810, it could be correlated to an occupancy of ten persons, assuming that the average person weighs 150 lbs. and that their distribution within the car was uniform.
However, such “average” cases of weight and distribution thereof within the car 180 do not always occur, since often times people riding in the car may have significant disparities in size and weight, or may be transporting heavy objects. Furthermore, weights which are not an integer multiple of the scaling constant present the system with an ambiguity that must be resolved; i.e., how to round fractional amounts of a person. Accordingly, to address these situations, the first embodiment of the sub-system 800 of the present invention compares the foregoing first occupancy estimate to the number of different sensors 806 supplying a non-zero signal to the summing amplifier 810 as measured by a counter circuit 811. The number of sensors 806 supplying a non-zero signal is used as a lower limit on the occupancy estimate. Additionally, the number and disposition of sensors 806 within the car 180 are chosen to provide the sub-system 800 with information regarding the distribution of weight therein. For example, the elevator car 180 of the present embodiment is equipped with sixteen sensors positioned in a 4×4 array of four rows and four columns, each sensor 806 being centered within its fractional ( 1/16th) area of the flooring, as shown in
Hence based on the foregoing, the sub-system 800 would need to resolve the ambiguity between (i) the first estimate calculated based purely on weight and a predetermined scalar quantity; (ii) the maximum theoretical number of occupants based on weight sensor data; and (iii) the minimum theoretical number of occupants based on weight sensor data. To resolve this ambiguity, the sub-system 800 of the present embodiment imposes the restriction that any entity atop a sensor producing a signal proportional to less than an arbitrary lower threshold (say, 50 lbs. in the present example) which is adjacent to another sensor producing a non-zero signal is part of the same entity atop that adjacent sensor. In the foregoing example, sensor “11” registers only 40 lbs. of weight, and is adjacent to both sensors “10” and “14”, which have non-zero output. Hence, the signal output from sensor “11” is assumed to be part of the same entity which is atop sensors “10” or “14”. Since no other sensors in the foregoing example registered less than the assumed threshold of 50 lbs., all other sensors are presumed to have a distinct entity atop them. Hence, the corrected maximum number of entities calculated by the system (Omaxc) is reduced from 6 to 5. Note that once a sensor having a weight value less than the threshold is “paired” with another adjacent sensor, that adjacent sensor can not be paired with any others, thereby preventing double-counting. This restriction also addresses the instance where the measured weight on a given sensor of interest is above the lower threshold value, yet is due to two entities each located on adjacent sensors as well as the sensor of interest.
To further assist in resolving occupancy estimate ambiguity, the foregoing information is also correlated with the number of different floors selected within the elevator on the selection panel 820. Specifically, the number of different floors selected on the elevator car selection panel are used as a second lower limit or occupancy minimum, Ominp. Using the preceding example, if the sub-system 800 detects that five different floors were selected, the system would recognize the presence of five persons, one corresponding to each different floor selected. It is assumed that the instance wherein one person selects multiple floors (such as through inadvertent or mistaken floor selection) would occur infrequently, and would also not be of any significance since the number of people actually on the elevator in such instances would always be less than the estimate derived by the system, thereby affording more space within the car than estimated. In the converse situation, for example when the first occupancy estimate or maximum estimate indicate the presence of several different persons, yet the number of different floors selected is fewer, the system does not set the fewer number of floors equal to the number of occupants, since the additional weight is likely represented by additional passengers getting off at the same floor(s), or few passengers having cargo or other weighty objects with them in the elevator.
Lastly, the sub-system 800 utilizes (i) the first occupancy estimate OE, (ii) the corrected occupancy upper limit Omaxc determined by the number of sensors 806 with non-zero output that exceed the predetermined threshold value, (iii) first occupancy minimum Omins as determined by the number of adjacent sensor pairs, and (iv) second occupancy minimum Ominp as determined by the number of floors selected within the car 180, to produce a final occupancy estimate. Specifically, this final occupancy estimate Of is the greater of the first occupancy estimate, corrected occupancy upper limit, the first occupancy minimum, and the second occupancy minimum. In the foregoing example, these quantities are 4.33 persons, 5 persons, 3 persons, and 5 persons; hence, Of equals 5 persons. Note that the highest value is chosen for conservatism; this all but eliminates instances of the elevator car stopping at a floor with an active call signal when no additional room exists, yet does not so under-utilize the car's capacity so as to be grossly inefficient.
As a second example of the operation of the capacity sensing sub-system 800, consider if 16 children each having a weight of 75±20 lbs. (and an average weight of 75 lbs.) were present in the previously described elevator car. The total combined weight would equal 1200 lbs., and therefore OE would equal 1200/150 or 8. If OE alone were used in this instance, it would severely overestimate the remaining capacity of the elevator car. Next, assume each child to take up the space associated with one sensor, whether individually or in combination; hence, Omaxu would equal 16, and Omins would equal 8. Since no sensors 806 would register less than the assumed threshold value of 50 lbs. (i.e., each sensor would be associated with one whole child or one-half of two children), Omaxc would equal Omaxu. If 2 different floors were selected by the 16 children, then Ominp would equal 2. Hence, in this example, Of would equal Omaxu or 16 persons, which matches the actual occupancy exactly.
Note that due to the reduced size of children as compared to the average adult, it may be possible to have somewhat more children than adults within a given floor space of the elevator car; however, this effect is considered minimal since a child is generally much shorter than the average adult, and hence grows disproportionately in height as opposed to width (the latter relating to floor space required to accommodate them). Stated differently, there is a minimum of floor space that any free-standing human requires; this value can be estimated and built into the sensor array design of the present invention.
When the capacity of the elevator car 180 is reached, either by total sensed weight or by the maximum number of occupants allowed (a predetermined value) as estimated by the sub-system 800, any subsequent call signals received by the elevator control circuit 830 are routed to another available car based on inputs received from a micro-controller 817. In this fashion, the fully loaded car bypasses those floors with people desiring to get on the elevator, unless those floors are selected by one or more of the occupants of the car 180.
Similarly, as each successive floor selected by occupants of the elevator car 180 is reached (as based on an door open sensor 850 within the elevator control logic, or other indicia), the sub-system 800 recalculates the first occupancy estimate OE, the corrected occupancy upper limit Omaxc, the first occupancy minimum Omins, and the second occupancy minimum Ominp and produces a new final occupancy estimate Of based thereon. Hence, occupancy estimation according to this embodiment is an ongoing and dynamic process.
Monitoring and Security Sub-SystemReferring now to
The features described above can also be “locked out” during certain periods of the day (such as during busy morning or afternoon hours) when many people ride the elevators and the viewing, override, security, and lighting functions are generally not needed. For example, programming of the processors 106 within each elevator car in an office building could institute the monitoring/override function from the hours of 6 pm until 8 am and during weekends. Such programming can be reconfigured using the remote system server 170 and associated input device 171, as shown in
In an alternate embodiment (
Referring again to
In addition to the aforementioned “early warning” features, the present invention also optionally includes the capability by which the user can select the specific location on the floor of interest to which they will be traveling from inside the elevator car, thereby enabling additional lighting, video surveillance, or other features. In one embodiment, shown in
The operation of the foregoing functions is best illustrated by the example of a parking garage in the basement of an office building, in which a user has parked during late night hours. Such garages typically are located on the ground level or basement of the building and are open to pedestrian access, thereby making them more accessible to criminals. During late night or weekend hours, these garages are also often deserted. When the user enters the elevator car 180 on a higher floor within the building, they first select the floor number to which they desire to travel, in this case the garage (“G”) level. The user may then depress the “Video” function key 1110 followed by the “G” key on the keypad 116 (or touch screen 113) to monitor the video camera output at the door of the elevator 1106 on the garage level, as well as any motion or IR sensors 1140, 1150 located thereabouts. Assuming no indications of danger are present, the user then depresses the “Safety” function key 1111, which displays a map or plan view 1402 of the floor selected in relation to the elevator doors 1106. The user then touches the map 1402 in the general area where their car is parked, which activates the lighting in the zones between the elevator doors and the selected location if not already activated, and initiates a direct video feed to the building security office 1125 (or other desired location) from the video cameras 1102, 1310 covering those zones. These functions may be put on a timer or controlled by another input (such as the timeout of a motion sensor 1140 in the area) such that the monitoring functions are ceased at an appropriate time or upon the occurrence of a desired event. The system may also be programmed to handle multiple zones on the same floor (such as when multiple passengers on the elevator car 180 are parked on the same level), or multiple zones on different floors.
Identification and Access Sub-SystemReferring now to
In the embodiment of
In the event that multiple RFID tags 1502 are present on the car 180, yet multiple occupants carrying such tags wish to go to a single location (such as if one person with authorization for access to floor “A” is accompanying persons with authorization for other floors only), the other tag holders need only not authenticate the non-desired floors, at which point the system will refuse access to those floors, and not generate a call signal via the micro-controller 1513. Hence, people may only egress the elevator on the authenticated floor(s), or the lobby.
Additionally, the access sub-system 1500 can optionally notify security (and/or the destination floor) of the user's destination and identity, and maintain a record of access. Such notification may be useful for monitoring the location of individuals within the building, and/or advance warning of the arrival of a particular person. Furthermore, such security records can be used to archive the history of access to particular areas during certain periods of time. The records may be maintained on a remote central server 170, or locally within the access system 1500 itself.
The user may also optionally perform other functions such as lighting and environmental control from the elevator car 180 using the access sub-system 1500. Specifically, in one embodiment, the authenticated user is provided a display 1700 with several predetermined function keys 1702, 1704 disposed thereon, as shown in
Lastly, the user may also use their RFID tag 1502 to permit the information and control system 100 of the present invention to pre-configure the PED download function described above upon receipt of an authenticated RFID signal. Specifically, the access sub-system 1500 “remembers” each individual user's selected download configuration by storing a data file at an address on the storage device 108, 110 or server 170 referenced within the aforementioned security access database 1510. As described above, each time the tag 1502 authenticates the reader 1504 and the tag emits it's RFID signal (which is subsequently decrypted by the reader 1504), the access control sub-system 1500 attempts to match the user's ID to one located within the access database 1510. Upon a successful match, the access sub-system 1500 also retrieves the download configuration file from the address referenced in the database 1510 associated with that user ID, and stores it in local memory or storage 110, 108. Upon user authentication with the appropriate password via the input device 102, the information and control system 100 transfers the download configuration file from memory 110, 108, whereby the user may receive the pre-configured download simply by inserting their PED 704 into the data terminal 702 associated with the authenticating input device 102. Note that when multiple users with distinct RFID tags 1502 are present in the elevator car, the sub-system 1500 only transfers the download configuration file to the control system 100 for those users completing password authentication, and then only to the data download terminal 702 associated with the authenticating input device 102. Hence, multiple people within the elevator car 180 may authenticate and download data simultaneously, if desired (assuming that the elevator car is equipped with multiple data download terminal/input device pairs).
Adaptive Advertising Sub-SystemReferring now to
In prompt mode, the speech of one or more passengers on the elevator car 180 is sampled and analyzed in real time to determine the general topic of conversation between the passengers.
The system is further configured such that if multiple image data files are requested by the processor 106, such as may occur when two different sets of people within the elevator car 180 are discussing two unrelated topics, each different image data file is allocated to a different available display 113 within the elevator car. For audio, only one data file is converted and played at any given time to avoid confusion. Furthermore, the sampling rate of the system may be set at a low frequency, such as once every 60 seconds, or only when the given elevator car 180 is in operation, so that a given image is maintained for an appropriate period of time on the displays 113.
In the event that a word is recognized by the advertising sub-system which includes two or more sub-file address references (such as for the word “trademark”, which may have connotations relating to both intellectual property law and business), the sub-system allocates each of the ambiguous references to a separate display (up to the existing number of unused displays 113 at that time), and then attempts to resolve the ambiguity by waiting for the next word which is matched within one of the sub-files 1842 (
In an alternate embodiment of the “prompt” mode (
As an example of the alternative embodiment of
In the case of multiple tenants residing on one floor, the sub-system 1800 can be programmed to display images pertinent to each tenant on the floor based on a selection routine. In one embodiment, if multiple unrelated tenants occupy a given floor, and that floor is selected by a person entering the elevator at the lobby, the sub-system 1800 will pick image data relating to the different tenants on a rotating basis such that each subsequent time that same floor is selected, an image appropriate to a different tenant will be retrieved and displayed. Alternatively, the selection may be made random, or even be coupled to the speech recognition module 104 to weight one choice over the other(s). Many other arrangements are possible, all of which are considered to be within the scope of the invention disclosed herein.
Referring now to
It is noted that the aforementioned speech-related adaptive advertising modes (
Alternatively, the aforementioned network interface 300 of
As an example of anecdotal adaptation, consider the case where the user selects the “Weather” function key on the keypad 116 (or touch screen 113). The sub-system 1800 retrieves and displays the desired weather information on the display device, while also retrieving and displaying advertising graphics relating to weather (such as for a local television station's weather reports) on an advertising placard or banner on the same or another display. If the user then selects another function key 114, the sub-system 1800 retrieves another advertising graphic file relating to the newly chosen function.
In a statistical adaptation, the choice of function keys 114 by each successive user adds to a data file which is generated by a statistical algorithm running on the processor 106. The algorithm calculates and stores a running total of the number of times each function key 114 (or each functional category) is selected over a predetermined period. Advertising graphics are displayed on the display unit(s) 113 in proportion to this statistic. For example, if the “Weather” function key were actuated five times as often as the “Stock Quotes” key over a given interval, the sub-system 1800 could be programmed to retrieve and display weather-related advertising on average five times as often as financial advertising
Note that the foregoing anecdotal and statistical adaptation embodiments may also be used together. For example, the sub-system 1800 could be programmed to display advertising on a statistical basis during periods of non-use, while displaying advertising anecdotally during use. Many other variants are also possible.
It is noted that while various aspects of the invention disclosed herein are described in terms of specific embodiments (and logic diagrams) of methods and processes, other embodiments of these methods and processes are possible consistent with the invention. For example, certain steps in the disclosed methods may be deleted, and/or additional steps added. Furthermore, the order of performance of steps may in many cases be permuted, or multiple steps disclosed as being performed in series may be performed in parallel, and vice versa. The embodiments disclosed herein are therefore considered merely illustrative of the broader methods claimed herein.
While the above detailed description has shown, described, and pointed out the fundamental novel features of the invention as applied to various embodiments, it will be understood that various omissions, substitutions, and changes in the form and details of the device or process illustrated may be made by those skilled in the art without departing from the spirit of the invention.
Claims
1.-40. (canceled)
41. Computerized information and display apparatus, comprising:
- a wireless network interface;
- processing apparatus in data communication with the network interface;
- speech processing apparatus in data communication with the processing apparatus;
- speech synthesis apparatus in data communication with the processing apparatus;
- an input device in communication with the processing apparatus and configured to, when actuated, cause the computerized information and display apparatus to enter a mode whereby a user can provide a speech input to the speech processing apparatus;
- a display device viewable by the user while providing the speech input;
- video data apparatus in data communication with the processing apparatus and the display device and configured to enable digital video data to be displayed on the display device; and
- a storage apparatus comprising at least one computer program in data communication with at least the processing apparatus;
- wherein said computerized information and display apparatus is configured to: after entry into the mode, obtain digitized speech from the speech processing apparatus, the digitized speech generated based on the speech input received from the user, the received speech input comprising at least part of a name of a business entity; cause, based at least in part on the digitized speech, identification of a match to the at least part of the name; cause retrieval of content associated with the match from a remote network entity via the wireless network interface; and display the content associated with the match on the display device, the content aiding the user in finding the business entity, the content comprising at least an image showing a location of the business entity and at least its immediate surroundings.
42. The computerized information and display apparatus of claim 41, wherein the computerized information and display apparatus is integral with an apparatus configured to transport multiple persons, and the digital video data is generated by a plurality of cameras in data communication with the computerized information and display apparatus and displayed on the display device in corresponding ones of portions of the display device so as to enable simultaneous monitoring of multiple portions of an area proximate an exterior of the apparatus configured to transport.
43. The computerized information and display apparatus of claim 41, wherein the computerized information and display apparatus is integral with an apparatus configured to transport multiple persons, and the computerized information and display apparatus further comprises at least one motion detection apparatus configured to alert the user of motion occurring outside of the a passenger compartment of the apparatus configured to transport.
44. The computerized information and display apparatus of claim 41, wherein the computerized information and display apparatus is integral with an apparatus configured to transport multiple persons, and the computerized information and display apparatus further comprises at least one motion detector configured to alert the user of motion occurring outside of the apparatus configured to transport, the alert comprising display of visually perceptible information on the display device.
45. The computerized information and display apparatus of claim 41, wherein the image showing the location of the business entity and at least its immediate surroundings further shows one or more other entities immediately proximate to the location, so as to facilitate the user orienting themselves as they approach the business entity.
46. The computerized information and display apparatus of claim 41, wherein the computerized information and display apparatus is configured to prompt the user to provide the speech input, the prompt comprising a synthesized voice prompt requesting the user to provide the speech input.
47. The computerized information and display apparatus of claim 41, wherein the causation of identification of the match comprises:
- identifying a plurality of possible matches to the at least part of the name;
- presenting at least a portion of the plurality of possible matches to the user;
- receiving a subsequent user speech input identifying one of the at least portion of the plurality of matches which the user desires; and
- wherein the display of the content associated with the match on the display device comprises display of the content associated with the identified one of the at least portion of the plurality of matches which the user desires.
48. The computerized information and display apparatus of claim 47, wherein the computerized information and display apparatus is further configured to revert to a mode where the user cannot enter the speech input after a prescribed period of time expires without the user providing the speech input, unless the input device is again actuated.
49. The computerized information and display apparatus of claim 41, wherein the computerized information and display apparatus is further configured to provide at least a portion of information obtained via the network interface in response to a speech query of the user to a portable electronic device via a data interface of the computerized information and display apparatus.
50. The computerized information and display apparatus of claim 49, wherein the computerized information and display apparatus is substantially integral with an apparatus configured to transport multiple persons, and the at least portion of information obtained via the network interface comprises at least map data relating to an area local to the apparatus configured to transport.
51. The computerized information and display apparatus of claim 50, wherein the data interface comprises an interface utilizing a Universal Serial Bus (USB) protocol and a physical connection between the computerized information and display apparatus and the portable electronic device.
52. The computerized information and display apparatus of claim 51, wherein the physical connection between the computerized information and display apparatus and the portable electronic device comprises a physical connector that is fixedly part of the computerized information and display apparatus and which is at least partly recessed with a slot or enclosure of the apparatus configured to transport multiple persons.
53. The computerized information and display apparatus of claim 50, wherein the computerized information and display apparatus is configured such that provision of at least a portion of information obtained via the network interface in response to a speech query of the user to a portable electronic device via a data interface can be invoked by application software present on the portable electronic device, the application software present on the portable electronic device configured to receive and store the at least portion of information for subsequent use by the user in navigating an area local to the apparatus configured to transport.
54. The computerized information and display apparatus of claim 41, wherein the wireless network interface comprises a wireless interface compliant with an IEEE 802.11 WLAN standard.
55. The computerized information and display apparatus of claim 41, wherein the computerized information and display apparatus is further configured to display a plurality of icons corresponding to respective ones of topical areas, selection of the topical areas by the user causing access of an Internet entity via at least the wireless network interface in order to retrieve information relevant to the user and relating to the selected topical area.
56. The computerized information and display apparatus of claim 55, wherein the topical areas include weather information, and the information relevant to the user comprises a weather forecast for a prescribed geographic area, the area selected by the user via the computerized information and display apparatus.
57. The computerized information and display apparatus of claim 55, wherein the icons are selected to facilitate rapid access to and display of a limited collection of data in order to reduce the amount of time needed by the user to locate and be cognitive of information that the user desires to a few seconds.
58. The computerized information and display apparatus of claim 57, wherein the display device comprises a touch-screen input and display device, and the topical areas are selectable by the user via touching the screen of the touch screen input and display device in a region of an icon corresponding with a respective one of the topical areas.
59. The computerized information and display apparatus of claim 55, wherein the display device comprises a touch-screen input and display device, and the topical areas are selectable by the user via touching the screen of the touch screen input and display device in a region of an icon corresponding with a respective one of the topical areas.
60. The computerized information and display apparatus of claim 41, wherein the computerized information and display apparatus is substantially integral with an apparatus configured to transport one or more persons between various locations, and the information and display apparatus further comprises:
- a touch input device configured to allow the user to provide input to the information and display apparatus by touching a touch-sensitive portion of the touch input device, the touch input device not having a display screen; and
- at least one of (i) ultrasonic sensing apparatus in data communication with at least a portion of the processing apparatus and configured to detect at least motion external to the apparatus configured to transport, and provide the user an alert relating thereto; and/or (ii) infrared sensing apparatus configured to detect the presence of at least a human external to the apparatus configured to transport, and provide the user with an indication thereof.
61. The computerized information and display apparatus of claim 60, wherein the computerized information and display apparatus is further configured to revert to a mode where the user cannot enter the speech input after a prescribed period of time expires without the user providing the speech input, unless the input device is again actuated.
62. The computerized information and display apparatus of claim 41, wherein the computerized information and display apparatus is further configured to transfer a plurality of data to a portable electronic device via a data interface of the computerized information and display apparatus, the data interface comprising an interface utilizing a Universal Serial Bus (USB) protocol and a physical connection between the computerized information and display apparatus and the portable electronic device.
63. The computerized information and display apparatus of claim 62, wherein the plurality of data transferred comprises data having been configured at least in part based on a plurality of inputs previously provided by the user, the inputs previously provided by the user to the computerized information and display apparatus.
64. The computerized information and display apparatus of claim 62, wherein the information system further comprises a short-range wireless interface configured to obtain data from a portable user radio frequency device when the portable user radio frequency device is within sufficient range of the short-range interface, the information configured to use the obtained data so as to configure one or more functions of the computerized information apparatus according to a previously supplied user preference or profile.
65. The computerized information and display apparatus of claim 41, further comprising a short-range wireless interface configured to obtain data from a portable user radio frequency device when the portable user radio frequency device is within sufficient range of the short-range interface, the information configured to use the obtained data so as to configure one or more functions of the computerized information apparatus according to a previously supplied user preference or profile.
66. The computerized information and display apparatus of claim 41, further comprising a short-range wireless interface configured to obtain data from a portable user radio frequency device when the portable user radio frequency device is within sufficient range of the short-range interface, the information system configured to use the obtained data so as to selectively enable only a portion of a plurality of functions of the computerized information system according to a pre-existing profile or preference associated with the user.
67. The computerized information and display apparatus of claim 41, wherein the computerized information and display apparatus is substantially integral with an apparatus configured to transport multiple persons, and further comprises at least one sensing apparatus in data communication with at least the processing apparatus and configured to sense occupancy of the transport apparatus.
68. The computerized information and display apparatus of claim 67, wherein the at least one sensing apparatus comprises a plurality of pressure sensors configured to sense a force applied thereto, the force generated by the weight of a person, and wherein the sensing of the occupancy of the transport apparatus comprises determining a number of persons within the transport apparatus based at least in part on one or more of the sensors indicating that a force is being applied thereto corresponding to a person.
69. The computerized information and display apparatus of claim 67, wherein the at least one sensing apparatus comprises a plurality of pressure sensors configured to determine that a force is being applied thereto, and computerized logic configured to determine said occupancy by counting a number of occupants based on outputs from said plurality of pressure sensors.
70. The computerized information and display apparatus of claim 41, wherein the digital video data is generated remotely from the computerized information and display apparatus, and is received by the computerized information and display apparatus via at least a wireless interface thereof.
71. The computerized information and display apparatus of claim 70, wherein the digital video data comprises data that has been compressed in the digital domain using an algorithm which compresses data prior to transmission to the computerized information and display apparatus.
72. The computerized information and display apparatus of claim 70, wherein the remote location comprises a destination to which the user intends to travel.
73. The computerized information and display apparatus of claim 41, further comprising voice communication apparatus, the voice communication apparatus enabling the user to contact a monitoring station or service remotely disposed from the user, the contact to cause the monitoring station or service to invoke one or more security features relevant to at least one of: (i) a current location of the user, and/or (ii) a future destination of the user.
74. The computerized information and display apparatus of claim 72, wherein the one or more security features comprise at least one of (i) additional lighting, and/or (ii) monitoring via a video camera.
75. The computerized information and display apparatus of claim 41, further configured to: (i) receive via a wireless interface a plurality of images of a remote location, the remote location comprising the business entity; and (ii) display the plurality of images substantially simultaneously on the display device, the display of the plurality of images comprising display of a first of the plurality of images at least partly contiguous to a second of the plurality of images, and a third of the plurality of images at least partly contiguous to the second of the plurality of images.
76. The computerized information and display apparatus of claim 41, further configured to: (i) receive via a wireless interface a plurality of images of a remote location, the remote location comprising the business entity, the plurality of images comprising images corresponding to respective ones of portions of the location, the portions being at least partly contiguous with others of the portions at the location; and (ii) display the plurality of images substantially simultaneously on the display device.
77. The computerized information and display apparatus of claim 76, wherein the plurality of images are each derived from a camera that visually observed the respective one of the portion of the location.
78. The computerized information and display apparatus of claim 41, further configured to selectively adjust lighting associated with at least a portion of a path of travel of the user as a safety precaution.
79. The computerized information and display apparatus of claim 78, wherein the selective adjustment of lighting as a safety precaution comprises increasing at least one of the intensity or number of lights activated in order to enhance user visibility, the enhanced visibility enabling the user to better avoid one or more hazards.
80. Computerized information and display apparatus, comprising:
- a wireless network interface;
- processing apparatus in data communication with the network interface;
- speech processing apparatus in data communication with the processing apparatus;
- speech synthesis apparatus in data communication with the processing apparatus;
- an input device in communication with the processing apparatus and configured to, when actuated, cause the computerized information and display apparatus to enter a mode whereby a user can provide a speech input to the speech processing apparatus;
- a display device viewable by the user while providing the speech input;
- video data apparatus in data communication with the processing apparatus and the display device;
- sensor apparatus in data communication with the computerized information and display apparatus; and
- a storage apparatus comprising at least one computer program in data communication with at least the processing apparatus;
- wherein said computerized information and display apparatus is configured to provide information derived from multiple sources to the user by at least:
- (1) receiving, upon actuation of the input device by the user, a signal from the input device; based at least on the signal, entering the mode; obtaining digitized speech from the speech processing apparatus, the digitized speech generated based on the speech input received from the user, the received speech input comprising at least part of a name of a business entity; causing, based at least in part on the digitized speech, identification of a match to the at least part of the name; causing retrieval of content associated with the match from a remote network entity via the wireless network interface; and displaying the content associated with the match on the display device, the content aiding the user in finding the business entity, the content comprising at least an image showing a location of the business entity and at least its immediate surroundings;
- (2) receiving data from the sensor apparatus; and generating, based at least on the received data, at least one of an audible and/or visual alert, the at least one alert relating to at least one of: (i) motion sensed by the sensor apparatus; and/or (ii) infrared radiation corresponding to a living being detected by the sensor apparatus; and
- (3) receiving digital video data from the video data apparatus, the digital video data generated based on video signals obtained from at least one camera apparatus; and displaying the received digital video data on the display device.
81. The computerized information and display apparatus of claim 80, wherein the at least one camera apparatus comprises a plurality of camera apparatus disposed so as to view a plurality of different areas, and the displaying the digital video data on the display device comprises displaying video data derived from respective ones of the plurality of the camera apparatus on respective ones of substantially contiguous display regions on the display device such that the user can substantially simultaneously view each of the video data on the display device.
82. The computerized information and display apparatus of claim 81, wherein each of the plurality of different areas are substantially contiguous with at least a portion of at least one other of the plurality of different areas.
83. The computerized information and display apparatus of claim 80, wherein the sensor apparatus comprises at least one infrared radiation detector, the at least one alert relates to infrared radiation corresponding to a living being detected by the at least one infrared detector, and the at least one alert comprises a visual alert, the visual alert comprising a light-modulated indication.
84. The computerized information and display apparatus of claim 83, wherein the light-modulated indication comprises a flashing or blinking indication rendered on the display device.
85. The computerized information and display apparatus of claim 80, further comprising voice communication apparatus, the voice communication apparatus enabling the user to contact a monitoring station or service remotely disposed from the user via the wireless network interface, the contact to cause the monitoring station or service to invoke one or more security features relevant to at least one of: (i) a current location of the user, and/or (ii) a future destination of the user.
86. The computerized information and display apparatus of claim 80, further configured to: (i) receive a user input, the input invoking a function of the computerized information and display apparatus; (ii) based at least on the receipt of the user input, transmit data to a remote monitoring station indicative that the function has been invoked by the user; and (iii) cause establishment of a voice communication channel with the remote monitoring station via the wireless network interface.
87. The computerized information and display apparatus of claim 80, further configured to: (i) automatically transmit data from computerized information and display apparatus via the wireless network interface to a remote monitoring station, the data indicative that a function of the computerized information and display apparatus has been activated, and (ii) enable establishment of a voice communication channel with the remote monitoring station via the wireless network interface.
88. The computerized information and display apparatus of claim 87, wherein the activated function comprises a function related to enhancing the safety or security of the user.
89. The computerized information and display apparatus of claim 80, wherein the computerized information and display apparatus is further configured to permit the user to select a destination of travel, and based at least in part on the selection, enable one or more functions relevant to at least one of (i) the destination, and/or (ii) a route of travel taken to the destination.
90. The computerized information and display apparatus of claim 89, wherein the display device comprises a touch screen input and display device, and the selection of a destination of travel comprises selection of a particular point on a map of an area via the user touching a screen of the touch screen input and display device.
91. The computerized information and display apparatus of claim 90, wherein the computerized information and display device is further configured to: (i) calculate coordinates for the selected particular point on the map of the area; and (ii) correlate the calculated coordinates to the enabled one or more relevant functions.
92. The computerized information and display apparatus of claim 80, wherein the computerized information and display apparatus is further configured to permit the user to control at least one of an HVAC function and/or lighting function associated with a building or structure which the user frequents via at least the wireless network interface of the computerized information and display apparatus.
93. The computerized information and display apparatus of claim 92, wherein the display device comprises a touch screen input and display device, and the user control of the at least one of an HVAC function and/or lighting function associated with a building or structure which the user frequents comprises actuation of the at least one function via one or more soft function keys generated on the display device and selectable by the user via touching a screen of the display device.
94. Computerized information and display apparatus, comprising: infrared radiation corresponding to a living being detected by the sensor apparatus.
- data processing apparatus comprising a central processor and at least one digital signal processor;
- speech processing apparatus in data communication with at least a portion of the data processing apparatus;
- speech synthesis apparatus in data communication with at least a portion of the data processing apparatus;
- an input device in communication with at least a portion of the data processing apparatus and configured to, when actuated, cause the computerized information and display apparatus to enter a mode whereby a user can provide a speech input to the speech processing apparatus;
- a display device viewable by the user while providing the speech input;
- video data apparatus in data communication with at least a portion of the data processing apparatus and the display device and configured to enable digital video data to be displayed on the display device, the digital video data generated based on video signals obtained from at least one camera apparatus;
- sensor apparatus in data communication with the computerized information and display apparatus;
- data storage apparatus in data communication with at least a portion of the data processing apparatus; and
- a storage apparatus comprising at least one computer program and in data communication with at least a portion of the data processing apparatus;
- wherein said computerized information and display apparatus is configured to provide information to the user by at least:
- (1) receiving, upon actuation of the input device by the user, a signal from the input device; based at least on the signal from the input device, entering the mode; obtaining digitized speech from the speech processing apparatus, the digitized speech generated based on the speech input received from the user, the received speech input comprising at least part of a name of a business entity; causing, based at least in part on the digitized speech, identification of a match to the at least part of the name; causing retrieval of content associated with the match from the data storage apparatus; and displaying the content associated with the match on the display device, the content aiding the user in finding the business entity, the content comprising at least a graphical representation showing a rendering of a location of the business entity and at least its immediate surroundings; and
- (2) receiving data from the sensor apparatus; and generating, based at least on the received data, at least one of an audible and/or visual alert, the at least one alert relating to at least one of: (i) motion sensed by the sensor apparatus; and/or
Type: Application
Filed: Oct 2, 2014
Publication Date: Feb 12, 2015
Inventor: Robert F. Gazdzinski (San Diego, CA)
Application Number: 14/505,434
International Classification: G06F 3/0481 (20060101); G10L 21/10 (20060101); G10L 15/22 (20060101); G06F 3/16 (20060101); G10L 13/00 (20060101); G06Q 30/02 (20060101); G06F 3/0484 (20060101); G10L 15/00 (20060101); H04N 7/18 (20060101);