INTERACTIVE LCD DISPLAY BACK LIGHT AND TRIANGULATING TOY BRICK BASEPLATE
A baseplate assembly, used with releasably coupleable playing pieces, includes a baseplate operably coupled to an image generating device. The baseplate includes a display region, having playing pieces coupling elements, and means for transmitting images generated by the image generating device to the display region. An image generating and playing-piece-interacting assembly includes a receptor operably coupled to an image generating device, having a display screen for generated images, including integrated visual and optically encoded message images, a playing piece at a location relative to the display screen having an optical display message sensor, and a messaging transponder. The optical display message sensor receives the generated images and generates a first signal at least partially based upon the optically encoded message image. The messaging transponder receives the first signal and generates and sends the receptor a second signal at least partially based thereon.
Latest TechnologyOne, Inc. Patents:
This application is a continuation-in-part of U.S. patent application Ser. No. 13/760,888, filed 6 Feb. 2013, entitled Baseplate Assembly for Use with Toy Pieces, which is a continuation-in-part of U.S. patent application Ser. No. 13/681,143, filed 19 Nov. 2012, entitled Toy Brick with Sensing, Actuation and Control, which claims the benefit of U.S. provisional patent application No. 61/633,824, filed 17 Feb. 2012.
BACKGROUND OF THE INVENTIONToy pieces in the form of toy bricks such as LEGO® brand toy bricks have been available for many decades. Toy bricks typically have releasable couplings between bricks, which allow them to be connected to form a larger structure. In their simplest form they build unanimated objects such as castles or houses. In some cases, the toy created using toy bricks can be supported on a baseplate having coupling elements to provide stability or proper positioning, or both, for the toy.
An advancement of toy bricks was the addition of bricks with a rotating joint or axel coupled to a wheel. Such a toy brick can be attached to an inanimate structure in order to make that structure roll along a surface when pushed.
A further advancement of toy bricks was the addition of “pull back motors.” These motors are mechanical energy storage elements, which store energy in a watch spring or flywheel. Typically these are toy bricks which have the “pull back motor” mechanism contained within the brick. There is a shaft from the mechanism, which when turned in one direction winds up the motor and then when released will turn in the opposite direction. A toy brick car, for example, equipped with such a motor will wind up when pulled back and then go forwards when released. An example of this is the LEGO Pullback Motor.
The next stage of advancement of a toy brick is an electric motor contained within one brick, having a protruding shaft and another toy brick with a battery compartment. These battery and motor bricks can be coupled to each other directly or through wires in order to create a simple mechanism that is electrically actuated. Typically a switch is present on the brick containing the batteries that can turn the motor on or off or revere its direction. Variations on the actuator can be lights, instead of a motor. An example of this is the LEGO eLab.
Toy bricks containing motors and toy bricks containing batteries can be further enhanced by the insertion of a remote control receiver in between them, such that the passage of power can be modified remotely. Typically a hand held remote control transmitter transmits a signal to a receiver brick, which can change the speed or direction of the motor. By way of example, a toy brick vehicle constructed in such a manner can be steered remotely and also have its speed controlled remotely. An example of this is the LEGO Power Functions.
The most complex state of prior art is the programmable robotics kit sold by the LEGO Group under the trademark Mindstorms®. The kit typically includes a handheld programmable computer, to which sensors and actuators can be plugged in, along with toy bricks and specialized components for making a variety of projects. Actuators can be motors, or solenoids, speakers, or lights. Sensors can be switches, microphones, light sensors or ultrasonic rangefinders. By way of example, a program can be downloaded into the handheld computer, so as to control a motor in a manner so as to avoid collisions with objects in the direction of motion. Another example would be to make a noise when motion is detected. Another programmable Mindstorms programmable robot is the Micro Scout. It is a motorized wheeled robot in which several preprogrammed sequences can be executed when a light is shined on the robot.
US patent publication US2011/0217898 A1 describes a toy brick with a tilt sensor and lights of the same color turning on and off or flashing alternately in response to a shaking motion. U.S. Pat. No. 7,708,615 discloses a toy brick system having separate sensor bricks, logic bricks and function bricks. The following toy bricks also emit sound when a switch is closed. LEGO doorbell Brick #5771, LEGO Space Sound Brick #55206C05.
Various devices generate images on display screens. One type of image generating device is a computer, such as pad computer, which can be designed to permit interaction with the computer through the display screen. This is commonly through touchscreen technology which permits actions to be initiated by, for example, selecting appropriate icons on the display screen, as well as lines to be drawn on the display screen. In addition to touchscreen technologies, interaction with the computer through the display screen can also be through the use of devices commonly referred to as light pens. See, for example, U.S. Pat. No. 4,677,428. In Light pen based interaction, images are generated on a Cathode Ray Tube (CRT) by excitation of the phosphor on the screen by an electron beam. This excitation causes the emission of light. Since a single point electron beam scans the image in a raster pattern, the light at any one point on the screen fades with time, as the beam progresses to a different part of the screen. During the next scan of the screen the image is refreshed. The intensity at any one point on the screen will flicker at the rate of refresh of the screen, and is typically a sawtooth type waveform with a fast rise and a slower decay if plotted in time. The light from any given point on the screen will increase sharply as the electron beam passes by any location as long as the image is not completely black at that point on the screen. The display knows the position of the electron beam at any given time, and this position can be captured at the instant when a sharp jump in a light level is seen by the light pen. By this method the light pen can be used as a pointing device, typically with additional buttons similar to mouse buttons, which are sometimes arranged so as to be mechanically activated when the pen is pressed against a surface.
BRIEF SUMMARY OF THE INVENTIONA first example of a baseplate assembly, for use with playing pieces configured to allow the playing pieces to be releasably coupled to one another, includes a baseplate and an image generating device operably coupled to the baseplate. The baseplate includes a display region, having coupling elements, by which playing pieces can be releasably mounted to the display region. Display region also includes areas adjacent to the coupling elements. The baseplate assembly also includes means for transmitting images generated by the image generating device at least to the display region of the baseplate.
Some embodiments of the first example of the baseplate assembly can include one or more the following. The image generating device can include a display screen on which images are generated. The images transmitting means can include a generally transparent portion of the baseplate whereby images generated on the display screen can pass through the baseplate to be viewed at the display region of the baseplate. The baseplate can be removably mounted to the image generating device. The image generating device can include a computer. The baseplate assembly can include a playing piece releasably mounted to a first location on the display region using a coupling element; with the image generating device being a computer, the playing piece and the baseplate can include computer program instructions stored on a non-transit storage medium that, when executed on a processor, cause the processor to perform actions comprising flow or branching dependent upon the messages received from the playing pieces. The baseplate can be constructed so that the images generated by image generating device pass through the baseplate and are visible through the coupling elements and through the areas adjacent to the coupling elements. The assembly can further include a playing piece releasably mounted to a first location on the display region using a coupling element, and a coil for generating a magnetic field for at least one of the following: (1) transferring energy from the baseplate to the playing piece, and (2) transferring a signal to and receiving a signal from the playing piece. The assembly can further include a playing piece releasably mounted to a first location on the display region using a coupling element, the playing piece comprising at least one of a radio frequency identification (RFID) device and a near field communication (NFC) transponder activatable upon receipt of an optical signal by the playing piece. The playing piece can further include a touch sensitive membrane operably coupled to the image generating device, and the baseplate can include a plurality of access regions overlying the touch sensitive membrane to permit a user to provide a touch input to the membrane at at least a selected one of the access regions. The baseplate can include a grid of first and second sets of spaced apart electrodes, the first set of electrodes extending in a direction transverse to the second set of electrodes, with the first and second sets of electrodes operably coupled to the image generating device.
A second example of a baseplate assembly includes a baseplate body, the playing piece and the triangulating means. The baseplate body includes a playing pieces support surface with the playing piece at a position on the playing pieces support surface. The triangulating means being associated with the playing piece and the baseplate body for generating signals indicating the presence of the playing piece at the position on the playing pieces support surface. In some embodiments of the second example, the baseplate body can include coupling elements by which the playing piece can be releasably mounted to the playing pieces support surface.
An example of a baseplate is for use with (1) an image generator having a display screen on which images can be generated, and (2) playing pieces configured to allow the playing pieces to be releasably coupled to one another. The baseplate includes a body and mounting structure. The body includes a display region with comprising coupling elements, by which playing pieces can be releasably mounted to the display region, and regions adjacent to the coupling elements. The body also includes an inner region, the inner and display regions being on opposite sides of the baseplate. The mounting structure by can be used to removably mount the body to an image generator so that the inner region of the body is positioned adjacent to the display screen of the image generator. At least a portion of the body between the inner region and the display region can be generally transparent so that images generated at the display screen of the image generator can pass through the body to the display region and be visible at the coupling elements and at the regions adjacent to the coupling elements.
An example of an image generating and playing-piece-interacting assembly, for use with playing pieces, includes an image generating device, a receptor operably coupled to the image generating device, and a first playing piece. The image generating device has a display screen on which generated images can be displayed. The generated images include integrated visual and optically encoded message images. The first playing piece can be at a first location relative to the display screen. The first playing piece includes an optical display message sensor and a messaging transponder. The optical display message sensor is configured to receive the integrated visual and optically encoded message image and to generate a first signal at least partially based upon the optically encoded message image. The messaging transponder is coupled to the optical display message sensor for receipt of at least the first signal from the optical display message sensor. The messaging transponder is also coupled to the receptor for generating and sending to the receptor a second signal at least partially based upon the first signal.
Some embodiments of an image generating and playing-piece-interacting assembly can include one or more the following. The receptor can be at least one of a sound receptor, an electromagnetic radiation receptor, and a magnetic field receptor, and the second signal can include a corresponding one of a sound second signal, an electromagnetic radiation field second signal, and a magnetic field second signal. The assembly can include a baseplate mountable on the display screen, the baseplate including a display region, the display region including coupling elements by which playing pieces can be releasably mounted to the display region. The optically encoded message image can be visually imperceptible to a user. The optically encoded message image can contain information encoded as being addressed to a specific playing piece. The second signal can include one or more of the following (1) graphic representation for the first playing piece, (2) other information for the first playing piece, and (3) an address into at least one of a local database, a remote database, a look-up table; which contains information for the first playing piece. The optically encoded message image can change according to the physical position of the optically encoded message image on the display screen. The optically encoded message image can contain information regarding at least one of (1) coordinates for the physical position, and (2) information regarding the visual image portion of the generated image at the physical position, (3) gaming data for the playing piece, (4) data for an actuator on the playing piece. The optically encoded message image can be generated at a number of physical positions on the display screen, and a second playing piece can be at a second location relative to the display screen. The assembly can also include first and second operably coupled image generating devices, a second playing piece at a second location relative to the display screen of the second image generating device, and an optically encoded message image to the second playing piece can be at least partially based upon the second signal from the playing piece. A second playing piece can be at a second location relative to the display screen, the optically encoded message image to the second playing piece can be at least partially based upon the second signal from the first playing piece. The each of first playing piece and the second playing piece each can include a playing-piece-to-playing-piece communication device to permit transfer of messages therebetween. The first playing piece can include a sensor coupled to the messaging transponder to provide sensor data to the messaging transponder, so that the second signal can be generated at least in part based on the sensor data. The first playing piece can include at least one of (1) an actuator operably coupled to receive a message from the optical display message sensor, and (2) an actuator operably coupled to receive a message from the messaging transponder, the message comprising data for actuation of the actuator.
Other features, aspects and advantages of the present invention can be seen on review the drawings, the detailed description, and the claims which follow.
The following description will typically be with reference to specific structural embodiments and methods. It is to be understood that there is no intention to limit the invention to the specifically disclosed embodiments and methods but that the invention may be practiced using other features, elements, methods and embodiments. Preferred embodiments are described to illustrate the present invention, not to limit its scope, which is defined by the claims. Those of ordinary skill in the art will recognize a variety of equivalent variations on the description that follows. Like elements in various embodiments are commonly referred to with like reference numerals.
The prior art discussed above consists of inanimate toy bricks suitable for small children, or more complex powered and wired or coupled toy brick elements, which must be assembled intelligently, in order to perform a function. The toy bricks which require intelligent coupling in order to perform a function are suitable for much older children. Examples of the toy brick described herein allow some animation functions to be experienced by younger children, without requiring them to understand electrical concepts. The toy bricks, as well as other playing pieces, are also well-suited for use with baseplate assemblies discussed below starting with
In addition, the prior art discussed above typically requires wiring between blocks to provide power to and control functions between the blocks. Such wires or connection between blocks distract from the object to be created by the blocks. Examples of the toy brick will also allow some functions to be achieved without the use of wires. While the toy brick building system disclosed in U.S. Pat. No. 7,708,615 does not require wires, it discloses the use of function bricks, sensor bricks and logic bricks which require intelligent assembly and thus may not be suitable for younger children.
An intent of the various examples of the toy brick is to provide the end user with a rich experience from a toy brick, without burdening the user with needing to gain knowledge of how that experience is delivered. Typically a user would perform an action in order to initiate the experience, sensors and a controller within the toy brick would detect the interaction of the user with the brick, the toy brick will then automatically perform an action, in response to the stimulus.
As shown in
Such a toy brick 10 would perform a function in response to a stimulus. The function to be performed is dependent on the sensors present, the programming of the controller, and the actuators present on toy brick 10, which are discussed in detail below.
The provision of a rechargeable power source 29 within the toy brick 10 will allow the toy brick 10 to be incorporated into structures without the need for wires. Further, recharging capability will allow any model or other structure built with the toy brick 10 to exist without requiring disassembly for replacing or recharging the batteries. The ability to transfer electrical power without electrical contact will also allow the brick to be hermetically sealed, so as to be child friendly.
A function of some examples of the toy brick is to detect an input via the sensing element 30, then determine via computation or other logic as described below if the input conditions satisfy the predetermined requirements to actuate one or more actuators 34, and if so actuate one or more actuators 34, typically in sequence or simultaneously as per a predetermined pattern.
Sensing elements 30 can be one or more of the following: (1) a microphone 40 for reception of a sound encoded trigger, such as, but not limited to a clapping sound or voice recognition as shown in
A gripping force sensor 56, typically in the form of a strain gauge rosette as shown in
In some examples, not illustrated, toy brick 10 may be constructed so that it takes more force to decouple a component, such as power source 29, actuator 34 or sensing element 30, from housing 12 than it does to decouple the housing 12 of one toy brick 10 from the housing 12 of another toy brick 10.
Computing control element 32, in the example of
Peripherals can include but are not limited to: USB (Universal Serial Bus), USART (universal synchronous/asynchronous receiver transmitter), I2C (I-squared-C) computer bus, ADC (Analog to Digital Converter), DAC (Digital to Analog Converter), Timers, Pulse Width Modulators, Flash Memory, RAM Memory, EEPROM (Electrically Erasable Programmable Read Only Memory), Bluetooth interface, Ethernet interface, liquid crystal driver interface. An example of such microcontrollers would be the Texas Instruments TMS320LF28XX family or MSP430 family of microcontrollers.
Typically a microcontroller is designed to perform a specific task, and only requires a subset of all possible peripherals to be present in order to perform that task. Usually only the input and output of the peripheral devices are externally accessible via metal pins. The internal data and memory access bus structure is not typically connected to the externally accessible pins of the chip.
The microcontroller receives signals as electrical voltages or currents, presented to one or more of its externally accessible pins. These signals are typically sampled on a one time basis, continuously, or at a regular time intervals by circuitry within the microcontroller, such as an analog to digital converter. The time course and amplitude of such a signal may be kept in the internal memory and analyzed by algorithms. By way of example, a speech recognition algorithm may analyze digitized speech from a microphone, or a motion detection algorithm may analyze signals from accelerometers or tilt switches.
The algorithms which analyze the digitized electrical signals, can be written in a language such as Basic, C or Assembly. The Algorithms may implement logical functions such as: “IF INPUT signal is GREATER THAN a VALUE THEN turn ON an OUTPUT”. The signals may in addition be transformed by transforms such as but not limited to the Fourier transform, or form feedback based algorithms in the S or Z domain such as Kalman Filters. Other algorithms such as neural network based fuzzy logic are also implementable. Indeed almost any algorithm that can be run on a personal computer can be implemented on a microcontroller based design.
Signals received may also be from a communication device, such as a Bluetooth link to an external device such as an iPad® or other tablet computer. Such signals may contain a full message of actions to perform, requiring the microcontroller to perform those actions rather than attempt to make a decision as to if actuation is warranted.
Computing control element 32, in the form of microcontroller 32, receives electrical signals, performs analysis of said signals and then performs an action. Signals for actuation are sent as electrical signals from the pins of microcontroller 32. By way of example, actuation such as making a noise may require microcontroller 32 to create a time course of electrical signal amplitudes, which may be accomplished by means of a DAC (Digital to Analog Converter) which varies the amplitude of the voltage on a pin of microcontroller 32. In another embodiment, actuation of a display, for example, may require microcontroller 32 to send out RGB (Red/Green/Blue) intensities to various display pixels in order to create an image.
Microcontroller 32 may in addition manage battery charging and also conservation of power by powering down peripherals, and even entering a low power mode (sleep mode) and only exit from the low power mode (wake up) at either certain intervals to check if signals are present, or may wake up due to a signal being presented to one or more peripherals which are capable of waking the microcontroller from a sleep state.
Computing control element 32 analyzes the signals from the one or more sensing elements 30, as described below by way of example in
An example of a process for power management, signal detection and actuation is shown in
Actuators which generate the output of a toy brick 10 can be, but are not limited to, one or more light sources 80, as shown in
By way of example, in one embodiment, a single brick 10, similar to that shown in
In yet another embodiment, a single brick with integral solar power battery and Bluetooth receiver, again see
In yet another embodiment, shown used as a component of a racecar 100 in
In yet another embodiment, a clear brick 10, similar to that of
In yet another embodiment as Shown in
In yet another embodiment, not illustrated, a toy brick 10 with a camera 48 and integral face or object recognition algorithm may greet a child with a sound such as “Hello John” when approached. The face to be recognized and the sound to be emitted by the brick may be user downloadable into the toy brick 10 via radio link. The face may even be self-learned by the video captured by the camera itself. Alternatively when the face is recognized the toy brick may transmit a signal to a fixed or mobile computing device.
In yet another embodiment, a sequence of sensing and a sequence of actuation may be programmed, typically by an adult, into the toy brick 10, with perhaps the aid of a user interface running on a fixed or mobile computing device, with radio link or other connection to the toy brick. Once programmed, a child may interact with the brick in a much simpler manner.
In yet another embodiment, several different shaped bricks may be manipulated by a child or other user. The bricks will transmit their shape and position to a fixed or mobile computing device which will show the manipulation of the bricks, with correct shape and size in a virtual building environment on a display screen. Transmission of position may be done by GPS signal, or by a more localized triangulation method, such as through the use of a baseplate, on which the toy bricks 10 are supported, with triangulation capability. The following are three examples of methods of position triangulation.
Measurement of time delay of signals from a signal source of known position: One or more signal sources of known position may send a pulse (“ping”) or encoded message via sound, light or radio wave, at a certain time. The message may contain the time that this signal was sent. The message will be received at a later time by the object that is to be triangulated, in this case typically a toy brick 10. By receiving messages from 3 or more such sources of known positions, and by computing the distance to those sources by measuring the delay between the time that the signal was sent and the time that the signal was received, it is possible to triangulate by standard trigonometric methods the position of the object to be triangulated. A simplified embodiment of a toy brick baseplate can be constructed to be capable of triangulating an object, such as toy brick 10, placed upon it. Such a triangulating baseplate may contain four or more signal emitters at the corners, in the plane of the baseplate and also above the plane of the baseplate. These emitters will emit encoded signals, preferably simultaneously. Then by measurement of the time delay between reception of the signals, it would be possible to locate the three-dimensional position of a toy brick in the vicinity of the baseplate.
Measurement of the position of known landmarks, by image analysis: The object to be triangulated may contain a camera and may compute its position by measurement of angles to various landmarks present in the image. By way of example, a toy brick 10 may contain a camera 48 and analyze the position of, for example, specific colored or marked bricks or flashing lights, placed in and above the plane of a base plate.
Measurement of the position of an object by analysis of its position relative to a known landscape: An object may be photographed in two or more, preferably orthogonal, views against a known landscape and its position computed. By way of example, a toy brick baseplate assembly may be constructed to contain two or more cameras capable of photographing the object in plan and elevation, against the baseplate and/or an orthogonal vertical wall with features present upon the baseplate/wall, such as uniquely marked bricks or flashing lights, whose positions are known.
The bricks may be cemented into position in the virtual environment by a gesture of the brick (such as but not limited to a clicking motion) or by pushing a button on the brick as described in the computer algorithm described below with reference to
In yet another embodiment, a toy brick with an accelerometer may be placed in a brick constructed car, such as that shown in
In yet another embodiment, bricks may be grouped by electronic addressing scheme, as described below with reference to in
In another embodiment, such as shown in
The final algorithm to be discussed is the algorithm for avatar manipulation 152 shown in the flow diagram of
In some examples, computing control element 32 is a user reprogrammable computer control element in contrast with a computer control element that cannot be reprogrammed during normal use, but typically only in a manufacturing-type environment. Such reprogramming can take place in the manners discussed above with regard to the communication algorithm of
In some examples, toy brick 10 can generate an output based upon a currently sensed input value and a previously sensed input value. This is opposed to a decision based on a current input only, such as single push of a button. This aspect is based in part on things that happened prior to an event, e.g., two buttons pushed one second apart. In digital computing terms current and previous means more than one clock apart, which in the current generation of computers running at say 4 GHz is 1/(4×10̂9)=0.25 nanoseconds. A computer's ability to define NOW and BEFORE is defined by its clock speed, since it can only sense things once per clock cycle. However it is possible to have an analog computer do a continuous time integral, for example, the time integral of acceleration yields velocity, and you could have a trigger that triggers when the velocity, as computed by a continuous integral of acceleration, exceeds a certain velocity. In another example, toy brick 10 may be provided an input in the form of a signal received by RF transceiver 44 telling toy brick to await further instruction in the form of an oral command received by microphone 40.
In some examples, toy brick 10 can generate an output(s) or time course of output(s) based on a time course an input(s), wherein the current output(s) or time course of output(s), is determined by mathematical computations based on previous input(s) as well as the current input(s). An example of this is a force or acceleration sensor(s) the signals from which can be integrated to find velocity and integrated again to compute position. Integration is the area under the curve, which is a function of the past history of the signal amplitude over time. In other examples, the mathematical function described can be altered in the field via wired or wireless download of new algorithms. An example of this is a brick which can emit green light when shaken, or can be, for example, reprogrammed via Bluetooth connection to emit red light when shaken. In a further example, each input has more than two possible states (with on and off being two states). Instead, each input may have a continuum of gradually changing values, such as would exist with the input from an accelerometer, the brick may be programmed to continuously change through all the colors of the rainbow as it is tilted in various orientations.
In other examples, toy brick 10 can perform one way or two way communication with an external device wirelessly. The messaging between the devices being more complicated than the detection and/or generation of an instantaneous presence or absence of signal, and is a decoding of the time course of such a signal, said time course carrying an embedded message. An example of this type of toy brick is one which responds to the complex on/off time course of pulsations of light carrying a message from, for example, an infrared remote control.
It can be seen to a person skilled in the art that such a self-contained brick with power, sensing, actuation and control elements within it, sacrifices little of the complex functions possible with the multi-brick prior art. Instead it allows a simple user experience for a small child, and removes the burden of programming the function to the factory, a parent, a teacher, or an older child. The intelligent toy brick provides a much different, much more accessible user experience than the multi-brick intelligent systems described in prior art.
Description of Baseplate AssembliesDisplay screen 206 may be a flat panel display where the light generating pixels are directly visible, such as with the screens of tablet computers. Other examples may be a different implementation where the image is generated remotely and transmitted to baseplate 202; one example of this is shown in
The image can also be transferred to the upper surface 214 of the baseplate 202 in other manners. Two such examples are shown in in
Another type of three-dimensional imaging can be through the use of holographic projection. Holographic projection can be created by projecting a laser through a film that contains a prerecorded interference pattern of light from a solid object. A moving hologram can be created by replacing the film with a “Spatial Light Modulator” which can be an array of small movable mirrors as in a DLP chip. The mirrors can generate a varying interference pattern as would be created by a moving object, thus creating a moving hologram.
In some situations computer 204 includes a touch sensitive membrane 224 as a part of display screen 206 as shown in
In some examples, computer 204 will send an optically coded message as a series of intensity variations in time. These intensity variations will be received by toy bricks 10, capable of receiving and responding to the optically coded message, that have been placed onto baseplate 202. An example of what is sometimes referred to as an intelligent toy brick 10 including a light detector 42 is shown in
In some examples, it is possible to simultaneously stimulate more than one position with different optically encoded messages, since each patch of pixels, at each coupling element 14, may simultaneously have different encoded intensity variations, the message encoding the position being stimulated. It is possible for one or more toy bricks 10 to simultaneously communicate with one or more receptors 236, as is done by way of example in CDMA (code division multiple access) cell phones or as done in Anti Collision NFC Tags. Each toy brick 10 mounted to baseplate 202 will send the message it receives from the display screen 206 in addition to information about the properties of the toy brick, thereby enabling the image generating device 204 to compute the position and type of toy bricks placed upon it.
It can be seen by a person skilled in the art that the intensity variations encoding the message sent by the image generating device 204 can be at a level imperceptible to a user viewing the entire display region 208, but is detectible by sensitive electronics on the toy brick 10 as placed upon the display region 208. The encoding can be of adequate complexity so as to even be detectable over the intensity variations of a moving image. By way of example, the encoded message may be encoded on a carrier of a known frequency, as for example IR remote controls encode the message on a carrier at 40 KHz or so. An example of a miniature optical receiver is the SFH506 IR receiver/demodulator device made by Siemens, which is a fully integrated device capable of delivering a digital data stream from a modulated light signal. Such encoding allowing signals resulting from varying of an image to be distinguished from the encoded message, in much the same manner as one radio station can be heard even though many radio stations and sources of radio frequency noise are present in the ether simultaneously.
The communication from the image generating device 204 to the toy brick 10 includes one or more of information requests and information sent, such as but not limited to send brick type information, send avatar image, send gaming powers of/weapons possessed, receives new avatar image, receive new gaming powers/weapons, and enable RFID/RF transponder for X seconds.
The communication from the toy brick 10 back to the display computer 204 through receptor 236 can be by way of example but not limited to:
-
- 1) An audible or inaudible sound sent from the toy brick 10 received by one or more microphones, acting as receptors 236, attached to the baseplate assembly 200, by way of example implemented as an audio modem with an audio codec chip such as the ADAU1772 chip from Analog Devices.
- 2) A visible or invisible light encoded message sent to one or more light receptors 236 through air or through light guides in the baseplate 202, by way of example implemented with a miniature optical receiver such as the SFH506 from Siemens.
- 3) RF encoded signal, such as but not limited to, Bluetooth implemented with a module such as the SPBT2532C2.AT from STMicroelectronics, ZigBee implemented with an integrated circuit such as the CC2520 from Texas Instruments, or RFID implemented with an integrated circuit such as the Texas Instruments TRF7970A.
The communications from the toy brick 10 to the baseplate assembly 200 contain information such as but not limited to:
-
- 1) Shape and size of the toy brick 10 placed upon baseplate 202,
- 2) Information from sensors located inside the toy brick 10,
- 3) Gaming or characteristics or special powers weapons or appearance of an Avatar of the toy brick 10.
- 4) A serial number, which can be for example an address into a lookup table on the computing device attached to the display or on the internet to provide the information in (1) or (3) above.
The message from the display can be encoded in space rather than time, such as a one-dimensional or two-dimensional barcode.
An example of a formal software implementation of a scanning routine, is as shown in
Similarly, as shown in
Further, as shown in
The modulation function U(n)(t) can be simple amplitude modulation of a carrier such as ASin(wt), or a more complex scheme like CDMA which allows many devices to talk at once.
The contents of the data received from a stimulated brick can then be stored in another 1024×768 RAM. In this manner information, such as the positions, gaming powers/weapons or Avatar images, of all toy bricks placed on the display baseplate is made available to any concurrently running gaming software, as a “map”. By way of example, a block diagram of the data path for such a scheme is as shown in
A playing piece 10 which can interact with a baseplate assembly 200 capable of triangulating its position in a manner as shown in
A tablet computer and smart phones with embedded NFC readers, such as the Google Nexus 10, typically have smaller interrogation coils which do not encircle the entire display screen 206 as shown in
It is also possible to have a toy brick or other playing piece 10 as shown in
Coupling elements 14 may be loose fitting bumps or pockets on the baseplate so as to constrain the bricks in the plane of the display but allow them to be easily removed when lifted up from the plane of the display. As suggested in
A higher density of LEDs, or other light emitters 246, per releasable coupling element 14 in structure such as shown in
Examples of baseplate assembly 200 have the ability to ascertain the position, orientation and characteristics of a toy brick 10 placed upon it, by passive means such as a camera and optical recognition, or by active means such but not limited to RFID or radio frequency triangulation. The toy bricks 10 placed upon baseplate 202 may in addition have sensors on them to transmit their orientation and motion. By way of example, a toy brick figure when manipulated in a waddling or walking manner may cause the scenery displayed on the baseplate to advance as if the toy brick figure were walking through the environment.
The manipulation of smaller toy bricks 10 across upper surface 214 of baseplate 202 may also cause avatars in 2D or 3D to appear on display screen 206 and interact with other features of the displayed image. The virtual characteristics of a toy brick or toy brick figure may be stored in nonvolatile memory on the baseplate assembly 200 or even nonvolatile memory on the toy brick 10 being manipulated. Further, the virtual characteristics of the toy brick being manipulated may change due to interaction with the environment on upper surface 214 of baseplate 202. The changed characteristics may be retained in the physical toy brick 10, or elsewhere, such as at a remote location on the internet, such that the toy brick when taken to a different baseplate assembly 200, the current baseplate assembly 200 may recall the exact environment on the display screen 206 of the prior baseplate assembly 200 and also the characteristics of the avatar from the previous interactive experience with the prior baseplate assembly.
The interaction between the baseplate assembly 200 and the toy brick 10 placed upon it may be two-way. By way of example, a toy brick 10 that is equipped with a similar but smaller display device may receive images to be displayed on its surface, dependent on its position on the baseplate. By way of example, a figural toy brick 10 may change its displayed image to a beach garment when moved onto a beach scene on the baseplate 202. By way of another example, a toy brick could make a splashing noise when placed on a part of a display region 208 which has a water feature; the display screen 206 may in addition show the resulting water splash.
A baseplate assembly 200 with triangulation capability may also be used as a virtual building environment. A toy brick 10 that is moved over upper surface 214 can cause an avatar of the same toy brick 10 to appear on display screen 206, and then by a clicking/cementing motion/gesture, the avatar associated with that toy brick may be cemented to a virtual structure, and the procedure repeated. The avatar need not be of the same shape as the physical toy brick, and selection of the shape of the avatar may be by menu structure displayed on display screen 206 or even by some physical manipulation of the toy brick or other triangulatable object.
In another example, the display screen 206 may show schematic instructions, for example, for the building a toy brick structure or even an electrical circuit with circuit elements made of releasable couplings such as in Snap-Circuits® sold by Elenco Electronics, Inc., of Wheeling Ill. The exact life size image of the building block or circuit element may be displayed on the display screen 206 under the releasable coupling elements 14 where it is to be snapped in, so that a child may create the assembly with ease.
It should be noted that an image generating device 204 may have all the features that by way of example an iPad, or similar computing device, can have. By way of example, one or more the following may be possible: reaction of the image to touch, rechargeable power supply, programmable response to motion or time course of motion, or orientation, integral camera, Bluetooth connection, WiFi connection, NFC reader, ability to play movies, ability to display a touch sensitive interactive game, ability to send and receive audible signals or optically encoded transmission and the like.
In another embodiment, baseplate assembly 200 may form a board game such a Monopoly board game. The Monopoly figures, houses, and hotels, may all be toy brick pieces, and their motion and position may be automatically sensed as discussed above. By way of another example, a game of Scrabble® may be played with toy bricks with letters on them being placed on upper surface 214 displaying a Scrabble game board, the score even may be automatically computed and displayed by automatic identification of the position and type of toy bricks 10, acting as letter tiles, placed on baseplate 202.
In another embodiment, players of a game may interact with a baseplate assembly 200 by means of smaller computing devices such as smart phones. Each player may affect the main displayed image on display screen 206 by means of software on the baseplate assembly 200 and which communicates with software on smaller computing devices. The smaller computing devices may in addition have clear baseplates attached, and placement of toy bricks on the baseplate on the smaller devices may affect a displayed image or game in the larger baseplate assembly 200, or even on a display screen 206 with no baseplate 202. Several smaller devices may simultaneously or sequentially communicate with, and affect the environment of the larger baseplate assembly 200. The environment may be fully interactive, such that by way of example, Monopoly money may be taken from one player and given to another player, and the amounts displayed on the main baseplate assembly 200, or even transferred between the smaller computing devices, depending by way of example on movement of toy brick figures on the main baseplate assembly 200.
In another embodiment, is also possible to extend and route the display image and messaging in a 3rd dimension away from the plane of the display with the use of opaque, translucent or clear toy bricks 10 with optical fibers 274 or other light guides embedded in them as shown in
An example of an image generating and playing-piece-interacting assembly 296 is shown in
The optically encoded message image 235, is a one way signal from the display screen 206 of image generating device 204, and sometimes through display region 208, to the optical display message sensor 237 of playing piece 10. Optical display message sensor 237 generates a first signal 241 based at least in part on the optically encoded message image 235 and is a distinct component from any other sensor on the playing piece 10.
The second signal 238 is a one-way, or a two-way, transaction between the messaging transponder 248 of the playing piece 10 and the receptor 236. This messaging transponder 248 on the playing piece 10 is distinct from any other actuator on the playing piece. The messaging transponder 248 can be by way of example but not limited to, NFC, WiFi, Zigbee, Bluetooth, or infrared signal.
Sensors 30 are distinct from the optical display message sensor 237 which receives the first signal 235. Sensors 30 may include components such as but not limited to temperature sensors, touch sensors, force sensors. In some examples, toy piece 10 does not include any sensors 30.
Actuators 34 are distinct from the messaging transponder 248 on the playing piece 10 which creates and transmits the second signal 238. Actuators 34 may be, but are not limited to, light emitters or sound emitters or another transponder on the playing piece 10. As with sensor 30, in some examples, toy piece 10 does not include any actuators 34.
Receptor 236 communicates with the messaging transponder 248 on the playing piece 10. The receptor 236 may be a one way or two way transponder. The following are examples of methods of triangulation of toy pieces 10 using optically encoded message images 235 thereby determining the physical location of a playing piece 10, typically relative to the display screen 206.
In a first example, the same optically encoded image message 235 being scanned across the display screen 206 is scanned sequentially across patches of pixels. In this example, the message is essentially “turn on messaging transponder 248”. The receipt of the first optically encoded message image by the optical display message sensor 237 turns on the messaging transponder 248, described as a transmitter/transceiver in
In another example, a different first optically encoded message image 235 is sent at different physical locations of the display screen 206. These different message images 235 can be sent simultaneously at all locations or scanned one patch of pixels at a time. The differences between the message images can be, by way of example but not limited to, determined by encoding the X,Y coordinates of the location which is being stimulated. The playing piece 10 receives this message via the optical display message sensor 237 and can, when communicating with the receptor 236 at a subsequent time, by way of the messaging transponder 248, not necessarily coincident with the time of receipt of the first optically encoded message image 235, send the contents of first optically encoded message image 235 received in addition to data about the playing piece 10 itself. The image generating device 204 then knows the position of the playing piece 10 and the type of playing piece 10.
Messaging can also be in addition to or instead of triangulation. For example, optically encoded message image 235 can contain data for actuators 34 on the playing piece 10. For example, the data for an actuator 34 can be to turn the playing piece 10 to a blue color. This optically encoded message image 235 may be sent coincident with a visual image 223 showing water, such that any playing piece 10 placed on the visual image of water will turn blue. It should be noted that this does not require generation of a second signal 238 to receptor 236, nor does it require triangulation of the position of the playing piece 10.
In another example, second signal 238 sent by the messaging transponder 248 on the playing piece 10 to the receptor 236 may contain additional data from sensors 30 on the playing piece 10 in addition to other data. For example, the temperature of the playing piece 10 may be sent to receptor 236, or the push of a button on the playing piece 10 can send a “shoot” signal to the receptor.
The message interaction involving second signal 238 between the messaging transponder 248 on the playing piece 10 and the receptor 236, may be a two way communication, which can send data for actuators 34 on the playing piece 10. For example, speech can be sent to a speaker type of actuator on the playing piece 10 by way of the second message interaction.
Two or more playing pieces 10 on the display screen 206, or on the display region 208 of a baseplate 202 when used, may interact with each other through the display screen based first signal 235 and subsequent second signal 238 to the receptor 236. Examples include but are not limited to the following.
Two playing pieces 10 may be placed and oriented to face each other and a shoot button type of sensor 30 on each toy piece pushed, the progress of the bullet or other projectile is shown on the display screen 206, either directly on the display screen or as viewed on the display region 208 when a baseplate 202 is used. This could be followed by the playing piece 10 turning red if hit. Such an interaction using the first and second signals 235, 238 to compute position, in addition to the second signal 238 encoding the shoot button being pushed, in addition the one way optically encoded message image or the second signal which is a two way transaction in this example, sending a command to the playing piece 10 being hit to turn red.
Two or more playing pieces 10 on the display screen 206, or baseplate 202 when used, may interact with each other directly without using the display transponder 248 through piece-to-piece signal 254. For example, the playing pieces 10 may compute their positions with the information in the first display message image 235. Then the playing pieces 10 may communicate directly with other playing pieces 10 using the messaging transponder 248 or another separate transponder; receptor 236 is not involved in the transaction.
The above descriptions may have used terms such as above, below, top, bottom, over, under, et cetera. These terms may be used in the description and claims to aid understanding of the invention and not used in a limiting sense.
While the present invention is disclosed by reference to the preferred embodiments and examples detailed above, it is to be understood that these examples are intended in an illustrative rather than in a limiting sense. It is contemplated that modifications and combinations will occur to those skilled in the art, which modifications and combinations will be within the spirit of the invention and the scope of the following claims. For example, images may be transmitted to display region 208 using a fiber optic array extending between image generating device 204 and the display region of the baseplate 202 as shown in
The following clauses describe aspects of various examples of methods relating to baseplate assemblies and image generating and playing-piece-interacting assemblies.
1. A baseplate assembly, for use with playing pieces configured to allow the playing pieces to be releasably coupled to one another, comprising:
a baseplate comprising a display region, the display region comprising coupling elements, by which playing pieces can be releasably mounted to the display region, and areas adjacent to the coupling elements;
an image generating device operably coupled to the baseplate;
means for transmitting images generated by the image generating device at least to the display region of the baseplate.
2. The assembly according to clause 1, wherein the baseplate comprises an inner region, the display region and the inner region being on opposite sides of the baseplate.
3. The assembly according to clause 1, wherein the baseplate comprises a plurality of sides, and the display region being on at least one side of the baseplate.
4. The assembly according to clause 1, wherein the image generating device comprises a display screen on which images are generated.
5. The assembly according to clause 4, wherein:
the baseplate comprises an inner region, the display region and the inner region being on opposite sides of the baseplate; and
the inner region of the baseplate facing towards the display screen of the image generating device.
6. The assembly according to clause 5, wherein the images transmitting means comprises a generally transparent portion of the baseplate whereby images generated on the display screen can pass through the baseplate to be viewed at the display region of the baseplate.
7. The assembly according to clause 5, wherein the baseplate is removably mounted to the image generating device.
8. The assembly according to clause 7, wherein the baseplate is removably mounted to the image generating device without the use of tools.
9. The assembly according to clause 7, wherein the image generating device comprises a computer.
10. The assembly according to clause 1, further comprising:
a playing piece releasably mounted to a first location on the display region using a coupling element, the playing piece capable of generating a message; and wherein:
at least one of the image generating device, the playing piece and the baseplate includes computer program instructions stored on a non-transit storage medium that, when executed on a processor, cause the processor to perform actions comprising flow or branching dependent upon the message.
11. The assembly according to clause 5, wherein the baseplate comprises a first portion offset from the display screen and a second portion directly opposite the display screen.
12. The assembly according to clause 11, wherein the second portion is removable and replaceable relative to the first portion and the display screen.
13. The assembly according to clause 12, wherein the second portion covers effectively all of the display screen.
14. The assembly according to clause 11, wherein the second portion covers only part of the display screen and defines an open region to permit direct visual access to another part of the display screen.
15. The assembly according to clause 14, wherein the baseplate comprises a removable and replaceable third portion sized to fit within and completely cover the open region.
16. The assembly according to clause 1, wherein the images generated by image generating device pass through the baseplate and are visible through the coupling elements and through the areas adjacent to the coupling elements.
17. The assembly according to clause 1, wherein the image generating device creates-an image capable of being viewed as a two-dimensional image or a three-dimensional image at the display region of the baseplate.
18. The assembly according to clause 1, wherein the image generating device creates two separate images at the display region of the baseplate suitable for stereoscopic viewing.
19. The assembly according to clause 1, wherein the image generating device comprises a spatial light modulator capable of creating a stationary or moving pattern of interference to create a Hologram associated with the display region of the base plate.
20. The assembly according to clause 1, wherein:
the images transmitting means comprises optical signal transmission lines operably coupling the image generating device to the display region.
21. The assembly according to clause 1, further comprising:
a playing piece releasably mounted to a first location on the display region using a coupling element; and
a coil for generating a magnetic field for at least one of the following: (1) transferring energy from the baseplate to the playing piece, and (2) transferring a signal to and receiving a signal from the playing piece.
22. The assembly according to clause 1, further comprising:
a playing piece releasably mounted to a first location on the display region using a coupling element; and
the playing piece comprising at least one of a radio frequency identification (RFID) device and a near field communication (NFC) transponder activatable upon receipt of an optical signal by the playing piece.
23. The assembly according to clause 1, further comprising:
a playing piece releasably mounted to a first location on the display region using a coupling element; and
the playing piece comprising a first device, the first device comprising a chosen one of a first transponder and a first sensor, the playing piece further comprising a second device, the second device comprising a chosen one of a second transponder and a second actuator, the second device being activated upon receipt of at least one of a message and a sensor value from the first device.
24. The assembly according to clause 23, wherein the at least one of the message and the sensor value are signals chosen from the following types of signals: sound, magnetic and electromagnetic, including radiofrequency and optical.
25. The assembly according to clause 1, further comprising:
a playing piece releasably mounted to a first location on the display region using a coupling element;
the playing piece having an outer surface including a first outer surface region facing the display region and a second outer surface region; and
the playing piece comprising optical guide elements extending from the first outer surface region to the second outer surface region;
whereby an image provided at the display region can appear at the second outer surface region.
26. The assembly according to clause 1, further comprising:
a touch sensitive membrane operably coupled to the image generating device; and
wherein:
the baseplate comprises a plurality of access regions overlying the touch sensitive membrane to permit a user to provide a touch input to the membrane at at least a selected one of the access regions.
27. The assembly according to clause 26, wherein the access regions are coincident with the coupling elements.
28. The assembly according to clause 27, wherein the access regions comprise flexible elements connecting a plurality of the coupling elements to areas adjacent to the coupling elements so that said coupling elements are movable towards the touch sensitive membrane from a first position spaced apart from the touch sensitive membrane to a second position at which a portion of the baseplate is in contact with the touch sensitive membrane.
29. The assembly according to clause 26, wherein the access regions comprise openings formed through the display region.
30. The assembly according to clause 26, wherein the touch sensitive membrane is a part of a chosen one of the baseplate and the image generating device.
31. The assembly according to clause 1, wherein the baseplate comprises a grid of first and second sets of spaced apart electrodes, the first set of electrodes extending in a direction transverse to the second set of electrodes, the first and second sets of electrodes operably coupled to the image generating device.
32. The assembly according to clause 31, wherein the first and second sets of electrodes have intersecting crossover points with at least one of a signal transmitter and a signal receiver electrically coupled to the first and second electrodes at a plurality of the crossover points.
33. The assembly according to clause 32, wherein the at least one of a signal transmitter and a signal receiver comprises at least one of a light transponder and an electrical coil.
34. The assembly according to clause 1, wherein:
the baseplate assembly comprises a receptor;
a first playing piece releasably mounted to a first location on the display region using a coupling element;
at least three spatially separated location emitters carried by the baseplate assembly capable of generating first location signals to the first playing piece at the first location;
the first playing piece at the first location capable of generating a second location signal to the receptor in response to the first location signals thereby signaling the presence of the first playing piece at the first location; and
the baseplate assembly capable of computing the position of the playing piece based on the second signal.
35. The assembly according to clause 34, wherein at least one of the location emitters comprises the receptor.
36. The assembly according to clause 34, wherein the first playing piece is configured to compute the second signal based upon differences among the first location signals from the at least three spatially separated location emitters.
37. The assembly according to clause 36, wherein the differences are time differences.
38. The assembly according to clause 1, wherein:
the baseplate assembly comprising a receptor, said receptor comprising at least three spatially separated location receptors;
a first location-signal-generating playing piece releasably mounted at a first location on the display region using a coupling element, whereby a first location signal can be generated by the first location-signal-generating playing piece for transmission to the location receptors; and
the receptor capable of computing the position of the playing piece by based on the differences between the first location signal received by the spatially separated location receptors.
39. The assembly according to clause 38, wherein the analysis of the differences comprises an analysis of time differences.
40. A baseplate assembly, comprising:
a baseplate body comprising a playing pieces support surface;
a playing piece at a position on the playing pieces support surface; and
triangulating means associated with the playing piece and the baseplate body for generating signals indicating the presence of the playing piece at the position on the playing pieces support surface.
41. The baseplate assembly according to clause 40, wherein the baseplate body comprises coupling elements by which the playing piece can be releasably mounted to the playing pieces support surface.
42. A baseplate, for use with (1) an image generator having a display screen on which images can be generated, and (2) playing pieces configured to allow the playing pieces to be releasably coupled to one another, the baseplate comprising:
a body comprising a display region, the display region comprising coupling elements, by which playing pieces can be releasably mounted to the display region, and regions adjacent to the coupling elements;
the body further comprising an inner region, the inner and display regions being on opposite sides of the body;
mounting structure by which the body can be removably mounted to an image generator so that the inner region of the body is positioned adjacent to the display screen of the image generator;
at least a portion of the body between the inner region and the display region being generally transparent so that images generated at the display screen of the image generator can pass through the body to the display region and be visible at the coupling elements and at the regions adjacent to the coupling elements.
43. An image generating and playing-piece-interacting assembly comprising:
an image generating device having a display screen on which generated images can be displayed;
the generated images comprising integrated visual and optically encoded message images;
a receptor operably coupled to the image generating device;
a first playing piece at a first location relative to the display screen, the first playing piece comprising:
an optical display message sensor configured to receive the integrated visual and optically encoded message image and to generate a first signal at least partially based upon the optically encoded message image;
a messaging transponder coupled to the optical display message sensor for receipt of at least the first signal from the optical display message sensor; and
the messaging transponder coupled to the receptor for generating and sending to the receptor a second signal at least partially based upon the first signal.
44. The assembly according to clause 43, where in the receptor is at least one of a sound receptor, an electromagnetic radiation receptor, and a magnetic field receptor, and the second signal comprises a corresponding one of a sound second signal, an electromagnetic radiation field second signal, and a magnetic field second signal.
45. The assembly according to clause 43, further comprising a baseplate mountable on the display screen, the baseplate comprising a display region, the display region comprising coupling elements, by which playing pieces can be releasably mounted to the display region.
46. The assembly according to clause 43, wherein the optically encoded message image is visually imperceptible to a user.
47. The assembly according to clause 43, wherein the optically encoded message image contains information encoded as being addressed to a specific playing piece.
48. The assembly according to clause 43, wherein the second signal comprises one or more of the following (1) graphic representation for the first playing piece, (2) other information for the first playing piece, and (3) an address into at least one of a local database, a remote database, a look-up table; which contains information for the first playing piece.
49. The assembly according to clause 43, wherein the optically encoded message image changes according to the physical position of the optically encoded message image on the display screen.
50. The assembly according to clause 49, wherein the optically encoded message image contains information regarding at least one of (1) coordinates for the physical position, and (2) information regarding the visual image portion of the generated image at the physical position, (3) gaming data for the playing piece, (4) data for an actuator on the playing piece.
51. The assembly according to clause 43, wherein the optically encoded message image is generated at a plurality of physical positions on the display screen, and wherein a second playing piece is at a second location relative to the display screen.
52. The assembly according to clause 43, further comprising:
a second image generating device;
a second playing piece at a second location relative to the display screen of the second image generating device;
the first and second image generating devices being operably coupled; and
the optically encoded message image to the second playing piece at least partially based upon the second signal from the first playing piece.
53. The assembly according to clause 43, further comprising a second playing piece at a second location relative to the display screen, the optically encoded message image to the second playing piece at least partially based upon the second signal from the first playing piece.
54. The assembly according to clause 53, wherein each of the first playing piece and the second playing piece comprises a playing-piece-to-playing-piece communication device to permit transfer of messages therebetween.
55. The assembly according to clause 43, wherein the first playing piece comprises a second optical display message sensor operably coupled to the messaging transponder.
56. The assembly according to clause 43, wherein the second signal provides information to the image generating device as to where to display optically encoded messages for the first playing piece.
57. The assembly according to clause 43, wherein the second signal generated by the first playing piece is automatically generated without further user interaction following receipt of the optically encoded message image by the optical display message sensor.
58. The assembly according to clause 43, wherein the first playing piece comprises a sensor coupled to the messaging transponder to provide sensor data to the messaging transponder, so that the second signal can be generated at least in part based on the sensor data.
59. The assembly according to clause 43, wherein:
the first playing piece comprises at least one of (1) an actuator operably coupled to receive a message from the optical display message sensor, and (2) an actuator operably coupled to receive a message from the messaging transponder;
the message comprising data for actuation of the actuator.
60. The assembly according to clause 59, wherein the data for actuation of the actuator causes the actuator to do at least one of the following: generate a colored light, generate an image, generate a sound, cause movement.
61. The assembly according to clause 43, wherein the optically encoded message image displayed at the first location is changeable with time.
62. The assembly according to clause 43, further comprising an energy-transmitting near field communication (NFC) antenna and the playing piece comprises an energy-receiving antenna, whereby the NFC antenna can provide power to the first playing piece.
63. The assembly according to clause 43, wherein:
the first playing piece capable of generating a message; and wherein:
at least one of the first playing piece and the image generating device includes computer program instructions stored on a non-transit storage medium that, when executed on a processor, cause the processor to perform actions comprising flow or branching dependent upon the message.
64. A baseplate and playing piece assembly, for use with playing pieces configured to allow the playing pieces to be releasably coupled to one another, comprising:
a baseplate comprising a display region, the display region comprising coupling elements, by which playing pieces can be releasably mounted to the display region, and areas adjacent to the coupling elements;
a computer comprising a display screen on which images can be generated;
the baseplate being removably mounted to the computer to overlie the display screen;
the baseplate comprising a generally transparent portion so that images generated on the display screen can pass through the baseplate, to be visible through the coupling elements and through the areas adjacent to the coupling elements, to be viewed at the display region of the baseplate;
a playing piece releasably mounted to a location on the display region using a coupling element, the playing piece capable of generating a message; and
at least one of the computer, the playing piece and the baseplate comprising computer program instructions stored on a non-transit storage medium that, when executed on a processor, causes the processor to perform actions comprising flow or branching dependent upon the message.
65. An image generating and playing-piece-interacting assembly comprising:
an image generating device having a display screen on which generated images can be displayed;
the generated images comprising integrated visual and optically encoded message images, the optically encoded message image being visually imperceptible to a user;
the optically encoded message image being generated at a plurality of physical positions on the display screen, and wherein a second playing piece is at a second location relative to the display screen
a receptor operably coupled to the image generating device;
a first and second playing pieces at first and second locations relative to the display screen, each said playing piece comprising:
an optical display message sensor configured to receive the integrated visual and optically encoded message image and to generate a first signal at least partially based upon the optically encoded message image;
a messaging transponder coupled to the optical display message sensor for receipt of at least the first signal from the optical display message sensor; and
the messaging transponder coupled to the receptor for generating and sending to the receptor a second signal at least partially based upon the first signal;
the second signal generated by the first playing piece being automatically generated without further user interaction following receipt of the optically encoded message image by the optical display message sensor of the first playing piece;
at least one of the first and second playing pieces comprising a sensor coupled to the messaging transponder to provide sensor data to the messaging transponder, so that the second signal can be generated at least in part based on the sensor data;
at least one of the first and second playing pieces comprising at least one of (1) an actuator operably coupled to receive a message from its optical display message sensor, and (2) an actuator operably coupled to receive a message from its messaging transponder.
66. A method for using playing pieces with a baseplate assembly, the playing pieces having first coupling elements to allow the playing pieces to be releasably coupled to one another, the method comprising:
selectively mounting a playing piece on a baseplate comprising a display region, the display region comprising second coupling elements, the first and second coupling elements being complementary coupling elements so that playing pieces can be releasably mounted to the display region, the baseplate being operably coupled to an image generating device;
transmitting images generated by the image generating device at least to the display region of the baseplate.
67. The method according to clause 66, wherein:
the images transmitting step comprises transmitting images generated at a display screen of the image generating device; and
positioning and inner region of the baseplate to face towards the display screen, the display region and the inner region being on opposite sides of the baseplate.
68. The method according to clause 66, wherein the images transmitting step comprises transmitting images through a generally transparent portion of the baseplate whereby images generated on the display screen pass through the baseplate for viewing at the display region of the baseplate.
69. The assembly according to clause 66, wherein:
the images transmitting step comprises transmitting images through optical signal transmission lines operably coupling the image generating device to the display region.
70. The method according to clause 66, further comprising:
accessing a touch sensitive membrane operably coupled to the image generating device through access regions of the baseplate to permit a user to provide a touch input to the membrane at at least a selected one of the access regions.
71. The method according to clause 66, wherein:
the selectively mounting step comprises releasably mounting a first playing piece to a first location on the display region;
generating first location signals by at least three spatially separated location emitters associated with the baseplate assembly;
generating a second signal by the first location-signal-generating playing piece to a receptor operably coupled to the image generating device in response to the first location signals thereby signaling the presence of the first playing piece at the first location; and
computing the position of the playing piece based on the second signal.
72. The method according to clause 66, wherein:
the selectively mounting step comprises releasably mounting a first playing piece to a first location on the display region;
generating a first location signal by the first playing piece;
generating second location signals by at least three spatially separated location receptors operably coupled to the image generating device in response to the first location signal thereby signaling the presence of the first playing piece at the first location; and
computing the position of the playing piece based on the second signals.
73. A method for generating images and interacting with playing pieces, comprising:
displaying images comprising integrated visual and optically encoded message images on a display screen of an image generating device;
locating a first playing piece at a first location relative to the display screen, the first playing piece comprising an optical display message sensor and a messaging transponder;
receiving the integrated visual and optically encoded message image by the optical display message sensor;
generating a first signal by the optical display message sensor at least partially based upon the optically encoded message image;
transmitting the first signal to the messaging transponder;
generating a second signal by the messaging transponder, the second signal at least partially based upon the first signal; and
sending the second signal to a receptor operably coupled to the image generating device.
74. The method according to clause 73, wherein the locating step is carried out by releasably mounting the first playing piece on coupling elements of a display region of a baseplate.
75. The method according to clause 73, wherein the image displaying step comprises displaying optically encoded message images which are visually imperceptible to a user.
76. The method according to clause 73, wherein the locating step comprises locating a plurality of playing pieces at different locations, and the image displaying step comprises displaying an optically encoded message image containing information encoded as being addressed to a specific playing piece.
77. The method according to clause 73, wherein the image displaying step comprises displaying optically encoded message images which change according to the physical position of the optically encoded message images on the display screen.
78. The assembly according to clause 73, further comprising:
displaying second images comprising second integrated visual and optically encoded message images on a second display screen of a second image generating device, the second playing piece comprising a second optical display message sensor and a second messaging transponder;
locating a second playing piece at a second location relative to the second display screen;
receiving the second integrated visual and optically encoded message image by the second optical display message sensor, the optically encoded message image to the second playing piece at least partially based upon the second signal from the first playing piece;
generating a first signal by the second optical display message sensor at least partially based upon the second optically encoded message image;
transmitting the first signal from the second optical display message sensor to the second messaging transponder;
generating a second signal by the second messaging transponder, the second signal at least partially based upon the first signal; and
sending the second signal from the second message transponder to a second receptor operably coupled to the second image generating device.
79. The method according to clause 73, further comprising locating a second playing piece at a second location relative to the display screen for receipt of a second optically encoded message image, the second optically encoded message image at least partially based upon the second signal from the first playing piece.
80. The method according to clause 79, further comprising transmitting messages between the first and second playing pieces.
81. The method according to clause 73, wherein the second signal generating step occurs without further user interaction following receipt of the optically encoded message image by the optical display message sensor.
82. The method according to clause 73, wherein the first playing piece comprises a sensor coupled to the messaging transponder, and further comprising generating sensor data sensor data by the sensor and transmitting the sensor data to the messaging transponder so that the second signal can be generated at least in part based on the sensor data.
83. The method according to clause 73, wherein the first playing piece comprises an actuator, and further comprising transferring a message to the actuator from at least one of the optical display message sensor and the messaging transponder, the message comprising data for actuation of the actuator. Any and all patents, patent applications and printed publications referred to above are incorporated by reference.
Claims
1. A baseplate assembly, for use with playing pieces configured to allow the playing pieces to be releasably coupled to one another, comprising:
- a baseplate comprising a display region, the display region comprising coupling elements, by which playing pieces can be releasably mounted to the display region, and areas adjacent to the coupling elements;
- an image generating device operably coupled to the baseplate;
- means for transmitting images generated by the image generating device at least to the display region of the baseplate.
2. An image generating and playing-piece-interacting assembly comprising:
- an image generating device having a display screen on which generated images can be displayed;
- the generated images comprising integrated visual and optically encoded message images;
- a receptor operably coupled to the image generating device;
- a first playing piece at a first location relative to the display screen, the first playing piece comprising: an optical display message sensor configured to receive the integrated visual and optically encoded message image and to generate a first signal at least partially based upon the optically encoded message image; a messaging transponder coupled to the optical display message sensor for receipt of at least the first signal from the optical display message sensor; and the messaging transponder coupled to the receptor for generating and sending to the receptor a second signal at least partially based upon the first signal.
3. A method for generating images and interacting with playing pieces, comprising:
- displaying images comprising integrated visual and optically encoded message images on a display screen of an image generating device;
- locating a first playing piece at a first location relative to the display screen, the first playing piece comprising an optical display message sensor and a messaging transponder;
- receiving the integrated visual and optically encoded message image by the optical display message sensor;
- generating a first signal by the optical display message sensor at least partially based upon the optically encoded message image;
- transmitting the first signal to the messaging transponder;
- generating a second signal by the messaging transponder, the second signal at least partially based upon the first signal; and
- sending the second signal to a receptor operably coupled to the image generating device.
Type: Application
Filed: Jun 29, 2016
Publication Date: Dec 15, 2016
Applicant: TechnologyOne, Inc. (Fremont, CA)
Inventor: Arjuna Ragunath Karunaratne (Fremont, CA)
Application Number: 15/197,330