Pointing Device for Designating Interactive Physical Objects

A system and method allowing a user to interact with objects in the user's environment using a hand-held pointing device. The pointing device is preferably incorporated in a hand-held device case or in the hand-held communication device itself. The pointing device projects a light beam that carries an identification code. The user directs the light beam toward an object of interest. The light beam falls upon a detector on the object of interest. The identification code serves to identify the pointing device that has projected the beam. The selected object of interest then sends a transmission providing: (1) its own identity, and (2) the identity of the pointing device. The identity of the selected object and the identity of the pointing device may be used to trigger any number of actions using software running on the selected object itself, a remote server, or a smart phone.

Skip to: Description  ·  Claims  · Patent History  ·  Patent History
Description
CROSS-REFERENCES TO RELATED APPLICATIONS

Not Applicable.

STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR DEVELOPMENT

Not Applicable.

MICROFICHE APPENDIX

Not Applicable

BACKGROUND OF THE INVENTION

1. Field of the Invention

This invention relates to the field of human interfaces. More specifically, the invention comprises a pointing device that may be used to initiate a response from interactive objects within a user's environment.

2. Description of the Related Art

Hand-held devices have been used to control objects in a user's environment for many years. Most of these devices are dedicated to a single object or use. For example, modern televisions are controlled almost exclusively using a hand-held device that transmits an infrared light or radio based signal. Unfortunately, each individual object to be controlled often requires a dedicated remote control. One remote control may control a television while a separate remote control may be needed for a satellite receiver.

Some consolidation of the proliferating hand-held devices has occurred when devices are expected to work together. For example, some “universal” remote controls are capable of controlling a television, a DVD player, and a satellite receiver. Some user programming is generally required, but once the programming is performed the single remote control is able to control several different devices.

Even this improvement breaks down, however, when a user wishes to control devices spanning different fields. A modern house may have remote controls for the HVAC system, lighting, and security. None of these remote controls are compatible. The result is a seemingly endless proliferation of hand-held controlling devices that must be located and used.

Another problem arises when a user wishes to select and interact with one specific device when there are many other identical devices present in the user's environment. A good example would be the selection of one particular light switch in a user's home. A remote control for such a device would need to be directionally specific so that it does not activate some other, unintended device.

Recent advances in communications technology provide an opportunity to solve this problem. Most homes now include wireless communication devices that serve to connect various objects (phones, tablets, streaming video players, etc.). Most users now carry a “smart phone,” which is a sophisticated computing and communications device capable of storing and running custom software. These smart phones are capable of wirelessly communicating with a wide variety of other devices. FIG. 1 depicts an exemplary prior art smart phone 10. It includes interlace connection 12 allowing it to be plugged into external devices. It also includes one or more radio frequency communication components allowing it to communicate wirelessly with WiFi routers and cellular communications networks.

Some prior art phones now include infrared transmitters that may be programmed to provide a remote control capability. However, such transmitters are not directionally specific. Because of this fact, they may not be easily used to pick one desired device among multiple examples of that type of device.

Smart phone 10 also includes various user controls and displays. Touch screen 26 allows the phone to display a graphical user interface. The user may interact with the interface by touching portions of the touch screen. The user interface is reconfigurable in many different ways using video display technology.

The present invention takes advantage of these recent developments in communications technology to allow a user to designate and interact with various objects in the user's environment. The invention also allows a user to select one particular object when multiple examples of that same type of object are present in the environment.

BRIEF SUMMARY OF THE PRESENT INVENTION

The present invention comprises a system and method allowing a user to interact with objects in the user's environment using a hand-held pointing device. The pointing device is preferably incorporated in a hand-held device case or in the hand-held device itself. The pointing device projects a light beam that carries an identification code. The user directs the light beam toward an object of interest. The light beam falls upon a detector on the object of interest. The identification code serves to identify the pointing device that has projected the beam. The selected object of interest then sends a transmission—preferably via a radio frequency signal—providing: (1) its own identity, and (2) the identity of the pointing device.

The pointing device is associated with a particular communication device—such as a smart phone. The transmission sent by the selected object may be used to control functions on the associated communication device. The identity of the selected object and the identity of the pointing device may be used to trigger any number of actions using software running on the selected object itself, a remote server, or a smart phone. For example, if the selected object is a thermostat, the software may cause a smart phone to display the word “THERMOSTAT” along with the current room temperature and a menu of options covering potential user actions to control the thermostat.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

FIG. 1 is a perspective view, showing a prior art cell phone.

FIG. 2 is a perspective view, showing a transmitter/case embodying the present invention connected to a prior art smart phone.

FIG. 3 is a perspective view, showing the assembly of FIG. 2 from a different vantage point.

FIG. 4 is a perspective view, showing a user triggering the beam used to designate an interactive object.

FIG. 5 is a perspective view, showing a thermostat configured for use in the present invention.

FIG. 6 is a plan view showing a representative display on a communication device that implements the present invention.

FIG. 7 is a perspective view, showing three separate devices that might be designated using the present invention.

FIG. 8 is a plan view showing a representative display on a communication device that implements the present invention.

FIG. 9 is a schematic view showing how the various devices may communicate when carrying out the present invention.

FIG. 10 is a perspective view, showing the present invention being used with a duplex light switch.

 REFERENCE NUMERALS IN THE DRAWINGS

10 smart phone 12 interface connector 14 transmitter/case 16 extended connector 18 beam emitter 20 trigger button 24 access port 26 touch screen 28 beam 30 user 32 thermostat 33 annunciator 34 thermostat control 36 thermostat display 38 device ID 40 control input 42 status display 44 edit button 46 trend display 48 video display 50 DVD player 52 satellite receiver 54 third communication device 56 communication link 58 communication link 60 communication link 62 detector 64 communication link 66 server 68 switch plate 70 first switch 72 second switch 74 point of impact

DETAILED DESCRIPTION OF THE INVENTION

In the present invention a beam emitter is associated with a particular hand-held communication device. The beam emitter transmits a particular emitter identification signal that allows it to be uniquely identified. The associated hand-held communication device may also be uniquely identified using existing technology. The beam emitter is used to point to, and thereby designate objects in a user's environment. The emitter identification signal is received by the designated object and sent to a third communication device—preferably via R/F. The third communication device is preferably physically located within the user's environment. For example, it could be an R/F receiver located in a user's home. The third communication device preferably has an associated memory so that it can store and retrieve the “association data” linking a particular beam emitter with a particular hand-held communication device that has been designated to receive a message.

The beam emitter is directionally specific. In other words, it designates a small “target area” so that a user can select one specific object even if the desired object is near several other identical objects. Examples of a suitable beam emitter include lasers and well-focused conventional light beams.

An embodiment of the invention might therefore be summarized as follows:

1. A beam emitter is used to designate a selected object in a user's environment;

2. The selected object receives an emitter identification signal carried by the beam itself;

3. The selected object sends a message to a third communication device containing the emitter identification signal and additional information identifying the object itself;

4. The third communication device receives the message and determines which hand-held communication device is associated with the beam emitter that designated the selected object; and

5. The third communication device preferably causes a message to be sent to the hand-held communication device indicating that the object has been successfully selected and providing information and possibly command options pertaining to the object.

It is convenient for the beam emitter to be part of or at least attached to the associated hand-held communication device though this need not always be the case. FIGS. 2 and 3 show an embodiment in which the beam emitter is incorporated in a smart phone case. Transmitter/case 14 snaps over smart phone 10 and provides conventional protection. Extended connector 16 is provided in the transmitter/case. This component allows external devices to connect to interface connector 12 on the smart phone itself. It may also provide a parallel connection to electronic components with transmitter/case 14.

FIG. 3 shows the same assembly as FIG. 2 from, a different vantage point. Transmitter/case 14 includes electronics enclosure 22 on its bottom side. Beam emitter 18 is provided on the forward portion of the electronics enclosure. In this example trigger button 20 is provided in a recess in the electronics enclosure. Other conventional case features—such as access port 24—are preferably provided.

When the user presses trigger button 20, beam emitter 18 emits a focused beam of preferably visible light. One option is to use a low power visible laser. This provides a narrow beam that generates a highly visible “backscatter” point of light when it falls upon an object. A second option is to use a focused, high-power LED. These devices use a parabolic reflector and primary lens to focus a narrow beam of light from a very powerful source (an LED of several Watts power). The LED-generated beam is of course not coherent light but it remains focused over a range up to 10 meters. For some applications of the present invention, this range is sufficient.

Whatever light source is used to generate the beam, it is important that the beam carry an emitter identification signal that identifies the emitter generating the beam. Such a signal may be easily carried by pulsing the beam. The pulse duration may be correlated to a binary “1” or “0” in order to convey a digital signal. Many other techniques for placing a signal on the beam are known to those skilled in the art.

FIG. 4 shows the invention in use. User 30 is holding a smart phone including transmitter/case 14. The user presses the trigger button on the bottom of the case and beam 28 is projected. Returning briefly to FIG. 2, the reader will recall that extended connector 16 may be used to connect the electronics within the transmitter/case to the smart phone itself. Using that capability, a software application running on the smart phone may be used to trigger the beam. Software running on the phone may also trigger the beam wirelessly using BLUETOOTH, NFC, WiFi, or some other wireless interface.

Looking again at FIG. 4, the user may employ an application running on the smart phone to trigger the beam by touching an icon on touch screen 26. Whatever method is used to trigger the beam, the result is the same. Beam 28 is projected. The user may point the beam toward any desired object by reorienting the transmitter/case and observing the beam's point of impact.

The inventive method and system may be used with practically any object in the user's environment. It may benefit the reader's understanding to consider a few examples. FIG. 5 shows a residential thermostat 32. It includes conventional features such as display 36 and thermostat controls 34. A user typically interacts with this device by observing the symbols on the display and pressing one or more control buttons. The version shown in FIG. 5 incorporates additional features. In this example, detector 62 detects beam 28 and passes the emitter identification signal to electronics contained within the thermostat.

The signal is used to trigger a communication event back to the associated hand-held communication device, as will be described in more detail subsequently. However, it may be desirable to give the user an immediate indication that the object in question has been successfully selected. Annunicator 33 is provided for this purpose. Annunicator 33 is typically a device that emits a visible signal (a flash) or an audible signal (a tone). When the detector detects the beam and confirms that the emitter identification signal has been successfully received, detector 62 is activated. Thus, the user may see a brief flash from the annunciator or hear a brief tone.

In the embodiment described, the thermostat decodes the emitter identification signal. It then creates an “object signal” that it will transmit. The object signal in this case includes: (1) the emitter identification information, (2) information identifying the thermostat, (3) (optionally) information pertaining to the current status of the thermostat (such as cooling mode, temperature setting, and available commands), and (4) (optionally) information as to various actions the thermostat could be commanded to take.

This object signal is sent over an object communication link to a third communication device. The third communication device is preferably an R/F receiver with an associated computing device and memory. For the example of the thermostat in FIG. 5, the third communication device may be an R/F receiver located in the user's home. The R/F receiver receives the object signal and then communicates with the hand-held communication device.

The communication between the third communication device and the handheld communication device may assume many forms. As a first example, the third communication device may send a signal using a BLUETOOTH connection directly linking it to the handheld communication device. In this example a computing and memory function within the third communication device “knows” which handheld communication device is associated with the emitter transmitting the beam and “knows” how to contact that device (such as by using BLUETOOTH).

As a second example, the third communication device may transmit the object signal over the Internet using a WiFi router located within the residence (and the third communication device may in fact include a WiFi router). The Wifi router then transmits the object signal to a remote server over the Internet. The database and computing functions needed to link the emitter ID signal with a particular handheld communication device may be located with the remote server. After looking up the associated hand-held device, the remote server sends a message to the hand-held device (possibly via the same WiFi router, over a cellular network, or by some other means). The message may be a simple retransmission of the object signal but in many cases it will also consider a receiving application run on the hand-held device and other information available to the remote server.

FIG. 6 shows a resulting display on the hand-held communication device (a smart phone) once the signal from the remote server has been received. Device ID 38 displays the identity of the object the user has selected. It describes the object and its location. Status display 42 provides relevant information as to the current state of the selected object. Since the object is a thermostat, this shows the current temperature setting.

Control input 40 provides context-relevant commands that the user could issue. In this version, the user is allowed to raise or lower the thermostat's temperature setting. Trend display 46 is provided to show how the thermostat's setting is programmed to change over a 24 hour cycle. The user is also given edit button 44. The user may select this button to access one or more addition interlace pages providing more options.

If the user inputs a command, a command signal is sent from the smart phone to the thermostat. This command could be sent via several possible routes, including:

1. Using a BLUETOOTH connection to send a command to the third communication device, which then sends an R/F signal to the thermostat; or

2. Sending the command via a cellular link to a remote server on the Internet, which then sends a command to a wireless router in the home (the wireless router then sending the command on to the thermostat).

If the Internet transmission method is selected, it is important that the remote server stores information regarding the identity of the device that is to receive the command. It may determine this information by storing the identity of the object that was originally selected using the beam.

From the user's perspective, the smart phone appears to be communicating directly with the object selected. However in reality the communications are occurring through a third device. This fact may cause some delay, and this is the reason that the annunciator is preferably provided to tell the user that the object has been successfully selected without having to wait on a response to appear on the smart phone.

Software running on the remote server preferably provides a “handshake” function between the hand-held communication device and the object selected, in other words, it is not necessary to pre-register the objects in the user's environment with the organization running the remote server. Rather, it is preferable to have a manufacturers' agreement for compatibility of many different products. Once the selected object sends the object signal to the server identifying itself, the server would then access information regarding the thermostat and its available features. The server could also access information regarding how best to use the smart phone to access those features.

Of course, a remote server could be used without the need for an Internet connection. The remote server could be located in the user's home. The object signal could then be received and sent to the remote server via a wireless connection such as a WiFi network in the home. The responses could also be sent back to the handheld device using the WiFi network. A hard-wired connection could also be used for at least the object signal, though this will likely be less convenient.

FIG. 7 provides another example of objects that a user may wish to access. Video display 48, DVD player 50, and satellite receiver 52 are all provided with a detector 62. The beam can be directed at any of these in order to interact with the device the detector is attached to. For example, the user might select the detector associated with DVD player 50.

FIG. 8 shows a user interlace that is activated on the smart phone after the DVD player is selected. Device ID 38 displays “SAMSUNG BLU-RAY DVD.” Control inputs 40 then correspond to functions appropriate for a DVD player (such as play, fast forward, stop, etc.). In this example the DVD player is capable of streaming Internet video. Thus, the user is given an Internet menu option as well.

FIG. 9 provides a schematic overview of how a particular embodiment of the invention functions. Transmitter/case 14 transmits a beam to select a particular object. The particular object may be a single object among multiple instances of the same type. In the example of FIG. 9, the selected object is thermostat 32. The thermostat receives the emitter identification signal and incorporates this into an object signal sent over communication link 58. This takes the form of a wireless transmission to third communication device 54. Third communication device 54 may then send a signal directly to smart phone 10 using a method such as a BLUETOOTH link. On the other hand, third communication device 54 may send the object signal to a remote server, such as by using the Internet. Under this option, third communication device 54 uses an internal link to send the object signal over communication link 56 to the Internet, where it is ultimately transmitted to server 66 via communications link 64.

The server accesses information to determine which hand-held communication device is associated with the emitter identification signal it received as part of the object signal. Once it obtains that information, sever 66 transmits a hand-held device signal to smart phone 10. In the embodiment shown, the hand-held device signal is transmitted via communication link 64 to the Internet, then via communication link 56 to third communication device, then via communication link 60 to smart phone 10.

Of course, as explained previously, the linking information could be stored on third communication device 54 itself. In that event, the hand-held device signal could be sent directly from third communication device 54 to smart phone 10 and no external device(s) would be needed.

The beam used in the present invention is preferably tightly concentrated so that it may select a particular physical object that is located near another object of the same type. The hand held device will typically be used to select object's that are within a user's visual range. A typical range would be 1 to 30 meters. The beam must be narrow enough to produce a small spot within this range. The beam width is preferably within 5 minutes of are and even more preferably within 1 minute of are. This angular constraint provides a point of impact diameter that is preferably no larger than 40 mm and even more preferably no larger than 10 mm. Of course, a coherent light beam has no defined angle of divergence. For a coherent light beam, the point of impact is preferably no larger than 40 mm and even more preferably no larger than 10 mm.

FIG. 10 provides an illustration of the significance of providing a relatively small point of impact. FIG. 10 shows a dual light switch of the type commonly found in residential and commercial structures. Switch plate 68 includes first switch 70 and second switch 72. A detector 62 and annunciator 33 is associated with each switch.

A user points the beam toward the detector that is associated with the switch the user desires. When the beam strikes the detector, the communication cycle described previously occurs. The result might be a message appearing on the user's smart phone. If the particular light the switch controls is presently turned off, the message might read: “KITCHEN LIGHTS SELECTED—TURN ON?” If both detectors were inadvertently activated, the message might read: “DO YOU WISH TO CONTROL KITCHEN LIGHTS—YES?”

Numerous other features may be incorporated into the invention, including:

1. Incorporating the beam emitter into the smart phone itself;

2. Hard-wiring the selected object to the third communication device or other communication device;

3. Using cellular communication as a substitute for Internet-based communication;

4. Using wireless communication within a home as a substitute for Internet-based communication;

5. Locating a remote server containing the linking information in the same building as the objects to be selected;

6. Providing a hand-held communication device that is not physically connected to the beam emitter (but that is linking by software, such as using a separate hand-held beam emitter and a tablet computer to receive any resulting information);

7. Using a power source within a smart phone to power the beam emitter;

8. Using a separate power source for the beam emitter; and

9. Where more than one object is selected, providing a menu allowing the user to choose one object among several possibilities.

Objects that are now typically accessed using remote controls have been used in the exemplary embodiments. However, the invention is by no means limited to such objects Additional objects that could be selected using the present invention include:

1. Light switches;

2. Electrical outlets;

3. Coffee makers;

4. Air filters;

5. Refrigerators;

6. Clothes washers;

7. Clothes dryers;

8. Dishwashers;

9. Garage door openers; and

10. Security systems.

Although the preceding description contains significant detail, it should not be construed as limiting the scope of the invention but rather as providing illustrations of the preferred embodiments of the invention. One skilled in the art may easily devise variations on the embodiments described. Thus, the scope of the invention should be fixed by the claims rather than the examples given.

Claims

1. A method for allowing a user to interact with objects in said user's environment using a hand-held communication device, comprising:

a. providing a hand-held communication device including a wireless hand-held device communication link;
b. providing a beam emitter;
c. associating said beam emitter with said hand-held communication device;
d. wherein said beam emitter transmits a narrow beam of visible light carrying an emitter identification signal;
e. providing an object in said user's environment including, i. an object communication link, ii. an object identification, iii. a beam detector;
f. pointing said beam emitter toward said beam detector on said object so that said beam of light strikes said beam detector;
g. said object receiving said emitter identification signal;
h. said object transmitting an object signal over said object communication link, said object signal including said object identification and said emitter identification; and
i. transmitting a hand-held device signal over said hand-held device communication link to said hand-held communication device associated with said beam emitter, said hand-held device signal including information identifying said object.

2. A method for allowing a user to interact with objects as recited in claim 1, wherein said object communication link is a radio frequency link.

3. A method for allowing a user to interact with objects as recited in claim 2, wherein said object signal is transmitted to a remote server via the Internet.

4. A method for allowing a user to interact with objects as recited in claim 3, wherein said hand-held device signal is first transmitted from said remote server to said third communication device, and then from said third communication device to said hand-held communication device.

5. A method for allowing a user to interact with objects as recited in claim 3, wherein said hand-held device signal is first transmitted from said remote server to a cellular communication network, and then from said cellular communication network to said hand-held communication device.

6. A method for allowing a user to interact with objects as recited in claim 1, further comprising a visual annunciator on said object, wherein said visual annunciator activates when said beam detector detects said beam.

7. A method for allowing a user to interact with objects as recited in claim 1, further comprising an auditory annunciator on said object, wherein said auditory annunciator activates when said beam detector detects said beam.

8. A method for allowing a user to interact with objects as recited in claim 1, wherein said hand-held device signal includes information regarding a current status of said object.

9. A method for allowing a user to interact with objects as recited in claim 1, wherein said narrow beam produces a point of impact that is no larger than 40 millimeters in diameter when said point of impact is within 30 meters of said emitter.

10. A method for allowing a user to interact with objects as recited in claim 8, wherein:

a. in response to said hand-held device signal, software running on said hand-held device displays a command prompt to said user;
b. in response to said command prompt, said user enters a command intended for said object on said hand-held communication device;
c. said command is transmitted from said hand-held communication device on said hand-held communication link;
d. said command is received on said object from said object communication link; and
e. said object performs an action responsive to said command.

11. A method for allowing a user to interact with an object in said user's environment using a hand-held communication device, comprising:

a. providing a hand-held communication device including a wireless hand-held device communication link;
b. providing a beam emitter;
c. associating said beam emitter with said hand-held communication device;
d. wherein said beam emitter transmits a narrow beam of visible light carrying an emitter identification signal wherein said beam of visible light creates a point of impact when it strikes a surface;
e. providing an object in said user's environment including, i. an object communication link, ii. an object identification, iii. a beam detector;
f. providing a remote server having an associated memory, wherein said memory includes data describing said association between said beam emitter and said hand-held communication device;
g. pointing said beam emitter toward said beam detector on said object so that said beam of light strikes said beam detector;
h. said object receiving said emitter identification signal;
i. said object transmitting an object signal over said object communication lick to said remote server, said object signal including said object identification and said emitter identification; and
j. in response to receiving said object signal, said remote server transmitting a hand-held device signal over said hand-held device communication link to said hand-held communication device associated with said beam emitter, said hand-held device signal including information identifying said object.

12. A method for allowing a user to interact with objects as recited in claim 11, wherein said object communication link to said remote server includes a transmission sent over the Internet.

13. A method for allowing a user to interact with objects as recited in claim 12, wherein said object signal is transmitted through a wireless router to said Internet.

14. A method for allowing a user to interact with objects as recited in claim 13, wherein said hand-held device signal is first transmitted from said remote server back to said router, and then from said router to said hand-held communication device.

15. A method for allowing a user to interact with objects as recited in claim 13, wherein said hand-held device signal is first transmitted from said remote server to a cellular communication network, and then from said cellular communication network to said hand-held communication device.

16. A method for allowing a user to interact with objects as recited in claim 11, further comprising a visual annunciator on said object, wherein said visual annunciator activates when said beam detector detects said beam.

17. A method for allowing a user to interact with objects as recited in claim 11, further comprising an auditory annunciator on said object, wherein said auditory annunciator activates when said beam detector detects said beam.

18. A method for allowing a user to interact with objects as recited in claim 11, wherein said hand-held device signal includes information regarding a current status of said object.

19. A method for allowing a user to interact with objects as recited in claim 11, wherein said hand-held device signal causes a command prompt to be displayed on said hand-held communication device.

20. A method for allowing a user to interact with objects as recited in claim 19, wherein:

a. in response to said command prompt, said user enters a command intended for said object on said hand-held communication device;
b. said command is transmitted from said hand-held communication device on said hand-held communication link;
c. said command is received on said object from said object communication link; and
d. said object performs an action responsive to said command.
Patent History
Publication number: 20160057272
Type: Application
Filed: May 22, 2015
Publication Date: Feb 25, 2016
Inventor: Niranjan Suri (Pensacola, FL)
Application Number: 14/719,768
Classifications
International Classification: H04M 1/725 (20060101); G06F 3/03 (20060101);