HEADSET-BASED TELECOMMUNICATIONS PLATFORM
A hands-free wireless wearable GPS enabled video camera and audio-video communications headset, mobile phone and personal media player, capable of real-time two-way and multi-feed wireless voice, data and audio-video streaming, telecommunications, and teleconferencing, coordinated applications, and shared functionality between one or more wirelessly networked headsets or other paired or networked wired or wireless devices and optimized device and data management over multiple wired and wireless network connections. The headset can operate in concert with one or more wired or wireless devices as a paired accessory, as an autonomous hands-free wide area, metro or local area and personal area wireless audio-video communications and multimedia device and/or as a wearable docking station, hot spot and wireless router supporting direct connect multi-device ad-hoc virtual private networking (VPN). The headset has built-in intelligence to choose amongst available network protocols while supporting a variety of onboard, and remote operational controls including a retractable monocular viewfinder display for real time hands-free viewing of captured or received video feed and a duplex data-streaming platform supporting multi-channel communications and optimized data management within the device, within a managed or autonomous federation of devices or other peer-to-peer network configuration.
This application is a Continuation of U.S. application Ser. No. 14/557,012, filed 1 Dec. 2014, which is a Division of U.S. application Ser. No. 12/714,693, filed 1 Mar. 2010, which was granted as U.S. Pat. No. 8,902,315 on 2 Dec. 2014, which is a Continuation of PCT Patent Application No. PCT/US10/25603, filed 26 Feb. 2010, which claims priority to U.S. Provisional Application Ser. No. 61/208,783, filed 27 Feb. 2009, and to U.S. Provisional Application Ser. No. 61/270,221 filed 6 Jul. 2009, each of which are incorporated herein in its entirety by this reference thereto.
BACKGROUND OF THE INVENTION Technical FieldThe invention relates to voice, data and audio-video streaming to and from a hands-free wireless mobile device. Further, the invention relates to multiple embodiments of a video camera telecommunications headset with a retractable viewfinder/monocular display and a laser rangefinder offered as either a single unit hands-free wireless real-time bi-directional and multi-feed telecommunications headset or as a modular Bluetooth earpiece headphone (Headphone) unit with a detachable handheld cellular video camera unit, with the earpiece unit serving as either a stand-alone wireless Bluetooth Headphone and personal media player or as a wearable multimedia port for the detachable handheld cellular video camera telephone unit that when linked together operate as a single autonomous hands-free wireless video communications headset capable of still image and audio-video capturing, recording and streaming to and from a receiver or group of receivers and real-time viewing and control of captured and/or received audio-video feeds via the retractable monocular viewfinder or other paired multimedia display system.
Further, the invention relates to the headset accessories including an adjustable docking station for recharging and/or use of the headset as a stationary wired or wireless IP camera, removable/rechargeable earpiece and neckpiece battery units for continuous hands-free wireless mobile headset, headphone and/or other ported device operations and a pair of multimedia sunglasses for active binocular display and eye to camera automation of the headsets optical and digital zoom, day and near infrared night vision camera.
Further the invention relates to device control software that is embedded into the headset and/or downloaded to the headset (or other networked device) and/or executed remotely from an external server. The device control software provides a system and method for infrastructure and ad-hoc networking, operational behavior management, communications protocol selection, security, data and power characteristics, modular data broadcasting, hands-free and remote systems control and autonomous, paired and/or networked device optimization,
DESCRIPTION OF THE BACKGROUND ART Field of InventionWhen wireless/cellular phone technology was initially commercialized, cellular phones were voice-only communication devices, i.e. such devices did not have any capability beyond voice communication. These cellular phones were hand-held devices. A hands-free option was introduced that required plugging in a wired headphone connection between the phone and an earpiece and microphone. Over time, some new technologies evolved.
Most notably:
-
- Bluetooth Communication Protocol for short-range wireless communications enabling wireless devices to communicate with each other over short distances. With the introduction of the Bluetooth communication protocol, the wireless phones could communicate with other devices over a short range. This advancement in technology created a new market for wireless accessories. The very nature of the protocol eliminated the need for a wired device to establish hands-free operation. Now, the user could use a cellular phone to communicate with an accessory (or any other device) over a wireless network, thus truly making the use of the device hands-free.
- Digital Video Camera and Streaming: With the advent of digital imaging cameras could capture and store images and videos in a digital format. The next step in the evolution of the video cameras was their ability to stream the video over wireless networks. Modern day cameras also have built-in GPS capabilities.
- Wearable cameras such as helmet cams began as bulky still image and video cameras that were often bolted into athletes' helmets. With the onset of digital video recording and flash memory came a new generation of what has been referred to as lipstick or bullet cameras that were smaller and lighter and were either wired to an external digital recorder or incorporated some embedded or removable flash memory storage. The next generation of wearable cameras introduced wireless data transmission such as Bluetooth for wireless uploading of stored still image and video files and/or Wireless IP Cameras that offer outgoing video streaming to the Internet via a Wireless Local Area Network or wired or wireless video streaming and networking via an external digital recorder or intelligent paired computing and wide or local area networking device such as a smart phone or personal computer.
- The hands-free wireless video camera telecommunications headset represents a new generation of entirely autonomous wearable two-way and multi-feed hands-free wireless communications devices capable of sending and receiving voice data, and audio-video without the need for a paired external, handheld, wired or wireless computing, networking or storage device.
Comparatively US patent 20100039493, Mobile video headset Feb. 18 2010, comprises an embodiment that allows hands-free imaging of the users surroundings via a camera and transference of simplex (one-way) audio and video stream to a personal (nearby) electronic device. The evolution in this invention advances all communications, including the audio video stream, to be duplex with a plurality of devices for full multimedia exchange amongst multiple devices. Paired or connected devices do not have to be on the person or nearby, instead they can be anywhere a network connection can be established. Additionally, other unified communication data (email, text message, voice, GPS) is integral to the device for a rich communication platform amongst a group of connected devices. Also, user control capabilities (hands-free) are advanced by voice command, eye tracking, motion gesture, and hand operated controls.
Other patents utilize off-board computing power to process data and coordinate control of a wearable (headset) device, this invention integrates all functionality within the headset enclosure.
Technology referenced in some of the prior art (referenced patents) should be considered experimental and largely remains in the laboratory or is prohibitively expensive. Conversely, much of the technology in this invention is proven and available as commercial-off-the-shelf solutions ready for integration into a design. Multiple prior art references incorporate large and heavy headset apparatus. This invention is less intrusive to the user's movement and other worn clothing or accessories. The target weight of this headset is less than 100 grams.
SUMMARY OF THE INVENTIONThe battery powered video camera telecommunications headset is the next innovative step in video capture and wearable hands-free wireless communications devices. Designed to capture, record, stream and display what the eyes see and what the ears hear, the Headset offers two-way and multi-feed real-time voice, data and audio-video communications and streaming to and from multiple wireless network connections, or locally to persistent storage. Operating as an autonomous, paired or peer-to-peer networked computing and multimedia device the Headset offers a wide range of hands-free device operational controls and interfaces including voice command, automated eye-motion and facial recognition for eye-camera control, light and motion sensor for the embedded day and night vision camera, and laser rangefinder automated optical and digital zoom, remote paired or networked device and camera control, and redundant embedded and removable/rechargeable and rapidly swappable battery power sources for uninterrupted hands-free wireless device operation.
The headset can operate as a paired accessory to a cell phone, PC, TV, video game console or other external wired or wireless Bluetooth, Wi-Fi or WiMax, Cellular, or other wired or wirelessly networked device. The video camera telecommunications Headset is worn on the ear similar to other wireless Bluetooth and/or Wi-Fi earpiece Headsets yet unlike its predecessors the Headset is more than a Bluetooth accessory; it is a hands-free wireless GPS enabled Wide, Metro or Local and Personal Area Network cellular communications system capable of wholly autonomous operations. Incorporating an embedded optical and digital zoom video and still image camera with both day and infrared night vision capabilities and a retractable monocular viewfinder display, the headset is an intelligent hands-free wireless device capable of simultaneously capturing, recording, streaming, receiving and outputting voice, data and audio-video in real-time and over multiple networks and pairing with one or more networked devices to create an ad-hoc virtual private network over any WAN, MAN, LAN, PAN or a combination of a paired, managed network, federation of autonomous networked devices or other peer-to-peer networking configuration.
Until now Bluetooth headsets, wearable video cameras and other hands-free wireless devices have been limited in their capability due to one of five major constraints; power, wireless range, size, weight and data processing capability. In addition to introducing functional hardware solutions to each of these physical constraints the Headset also incorporates a mobile device control system that introduces a system and a method for modular device, group and network data, protocol and power management and optimization, modular data channeling, broadcasting and communications, coordinated and shared operations, security and remote systems control.
The Gateway Operating System (GOS) Control Software is designed to support numerous embodiments of the telecommunications headset and other unified, paired and networked communication devices (Headset in this invention, wireless Internet devices and stationary/wired Internet devices) and introduces a modular device architecture and management system, a model for wired and wireless device networking, paired, autonomous, hierarchical or other managed device groups, peer to peer and Virtual Private Networking (VPN) while constantly optimizing single or multiple networked device configurations for data, power and network optimization shared and/or unified operations and inter-device and multi-device secure ad-hoc networking over any combination or type of wired and/or wireless network, public or private federation of autonomous wired or wireless devices.
The GOS is a modular device, data and network management platform and operations model is designed to allow for components or whole devices to be attached or detached and systems to be turned on, shut off, monitored and constantly optimized specific to the available power, memory, wireless transmit power, and network bandwidth of all available networked devices and/or other user, group, network, event, location and/or application based device preferences. The GOS algorithms are consistently generating and updating optimized device operations based on automated and/or user specified guidelines and priorities for each of its coupled systems and/or modules.
The GOS is designed to expand to include one or many devices in a synchronized ad-hoc or coordinated, hierarchical, managed or other device network organizational model offering a standard modular device and data management system. It is also a model for individual and group device power and data management and storage, protocol selection, transmission, broadcasting, networking, applications and systems coordination over any number of wired and wireless networks for optimized individual and grouped device operations and remote systems control.
In addition to supporting multi-device coordinated networking the GOS organizes systems through standardized APIs for interaction of system processes, organized data and communication protocol types and applications such as device, user and network identification and security, location and contextual data, voice, audio and video, communications protocols, system controls, data management, and power management. The GOS identities, quantities, and prioritizes local and remote networked device operation, networks and applications for each of its designated system modules based on a set of variables such as power use, data processing speed, network strength, bandwidth, available data and memory storage.
For example a “Location and Contextual Data Module” may be designated to acquire all data and manage all tasks and processes specific to the location of the device and/or its relation to another device, address, position, location, time/date, contextual event or coordinated application and/or the source and location of any incoming or outgoing data stream. All location and contextual data acquisition, processing and transmission are managed by the location and contextual data module. The data module will automatically locate, organize and prioritize all available firmware components and or software processes designated for the acquisition, processing and or application of location and contextual data. The Location and Contextual Data Module in each independent or networked device will independently quantify and prioritize all of its local firmware components and related software processing systems and location and contextual data applications based on a universal set of variables.
Each Headset or other networked device or group of networked devices may have more than one method, system and/or set of firmware components capable of acquiring and utilizing the same or similar data. Each module then prioritizes all local or networked firmware component's for each of its designated tasks and related data sets in order to select the optimum system(s) and method for acquiring a specific data set and accomplish each task and/or process and which tasks should be acquired and/or processed and/or designated to each available system and/or networked device.
Each individual device then coordinates all networked and independent functions for each module and selects which local tasks, processes, components and/or networks should be idled or shut down at any given moment based on the independent and group generated modular algorithm for optimized system operations. Each device, device group and/or network can be pre-defined with user preferences and updated for coordinated device system settings. Each Module responds based on networked group defined standards for measuring the data, power and networking efficiency and application for all designated processes, tasks, data sets and all available firmware and software systems specific to each task. All data, system, component, device and network operations are then synchronized, coordinated and managed on a modular systems level for one or a group of networked devices with each module continuously updating its operation specific to system capabilities, optimized use case scenario and user priority settings for all available components and networked devices. Each module is assigned its own data channel on which all module specific data streams are transmitted upon. Modular channels and related data streams can be encrypted and grouped together with other channel data streams and sent out via a single network port.
The Headset and GOS Control Software offers a modular device, data and network management, operations and network optimization model that can be installed as an embedded system downloaded and customized to an existing operating system as a middleware application and/or networked to a device either via a networked hub or via a peer-to-peer ad-hoc networked or managed network configuration. The software is configurable for all headset and other networked device embodiments and applications including but not limited to wearable, hands-free and remote wireless systems controls.
A mash-up of a GPS enabled video camera and camcorder, IP camera, video VOIP phone (IP Telephony), Personal Media Player and mobile handset (cell phone) and a hands-free wireless earpiece Bluetooth Headset. As a cell phone the headset is a mobile, wide area networked device that offers one-to-one and one-to-many communication, file storage, audio, text, picture and video communication. As an IP camera phone, the headset provides real-time voice, data and audio-video over a Metro or Local Area, wired or Cloud wireless or wired Internet link and can serve as a wireless router and hot spot for an ad-hoc off-network peer to peer group of devices or secure Virtual Private Network (VPN). As a personal media player the headset offers an entirely autonomous hands-free wireless solution.
The Headset is designed as a modular device on both a physical, functional, and embedded system design architecture. Allowing for components to be attached or detached specific to the desired application. A first embodiment comprises a one-piece GPS enabled hands-free wireless wearable audio-video camera headset capable of two-way, multi-feed and duplex networked voice, data and audio-video communications offered in a curved or rectangular video camera phone (CP) Headset unit body design while a second embodiment introduces two-piece detachable handheld cellular CP unit and a Bluetooth earpiece Headphone unit with both units capable of operating autonomously or, when attached as a single hands-free wireless telecommunications headset device with the earpiece Headphone Unit serving as a universal port for the handheld CP unit.
The headset supports a redundant data and power management and storage system designed to offer both embedded removable/rechargeable and rapidly swappable data and power storage options while offering a modular data management system capable of supporting entirely standalone autonomous device operations, communications, automated and user control and/or securely transfer voice, data and/or video interface control to an authorized external wired or wirelessly networked device or group of devices. Additionally an embedded laser sight and range finder support automated zoom functions and hands free control of the optical and digital zoom camera with light and motion sensor and accelerometer to retractable monocular, view finder, data management and/or headset systems control partially or entirely to an authorized remote wired or wirelessly networked device or group of devices.
The cellular CP module and earpiece Headphone module which are introduced in both single one-piece embodiments and detachable two-piece embodiments, both include independent battery and power systems, independent flash with the CP Unit housing a removable/rechargeable battery and the Headphone unit housing an embedded rechargeable battery. The earpiece Headphone unit also has a dual data/power accessory port system for a removable/rechargeable earpiece or neckpiece battery unit both serving as a counter balance and support system for the headset and/or Headphone units.
In both the single unit and two-piece autonomous CP and Headphone embodiments the system automatically selects from one or more of the available batteries based on power charge status, application and run time scenarios with the CP unit handling the primary processing, system and network drivers and the earpiece Headphone unit housing a microprocessor for the earpiece microphone, speaker, media player and user controls, Bluetooth and multimedia device port and connector functions. Both the CP and Headphone units have independent embedded and removable flash memory ports and independent data storage and management functionality allowing both the CP unit and earpiece unit to operate jointly or independently in both the single unit and two-piece unit embodiments.
When the CP and Headphone unit are attached either by default in the single unit embodiment or by attachment in the two-piece embodiment the system may revert to the larger CP Unit Battery and only use the Headphone battery as a backup or the entire headset may revert to the external earpiece battery unit for all high-level applications and the CP unit battery for all core communications functions so that should the earpiece battery be removed the headset will continue to function without interruption. The modular headset system is able to calculate and use all available resources and make operational decisions based on optimum and redundant functionality.
By introducing the external removable/replaceable tether-free battery power storage option the Headset is able to optimize space and manage heat, weight, size and device operations more effectively and by offering redundant power, storage and system functionality the Headset becomes a truly hands-free wireless communications device and tool with the capability of uninterrupted use by simply replacing the external earpiece or neckpiece battery unit with a fully charged back up unit or directly plugging the earpiece or neckpiece battery unit into an external battery pack or other networked or battery powered device.
Because of the size and weight constraints that are lifted by utilizing the removable earpiece and neckpiece battery solution the CP unit is more comfortably able to house a full optical and digital zoom camera with light and motion sensor, day and night vision lens system, laser rangefinder for target location, motion sensor and automated camera zoom as well as retractable monocular, view finder for real time display of captured or incoming audio-video feed, eye motion sensor for eye-camera control, eye retina scan security, a dual camera and voice microphone system for noise cancellation, voice recognition and voice command and a multi-channel, duplex networking communications module for multi-device, telecommunications, teleconferencing, telenetworking, coordination, and remote systems control.
An expandable platform is possible with the adaptable CP module which is offered in both a curved and a rectangular body design with either a Multimedia and power connector port or retractable high-speed USB port option. The CP module can be operated as either a handheld GPS, Cellular, Wi-Fi or WiMax and Bluetooth duplex and multi-channel cellular, IP and peer to peer networked mobile phone and camera/camcorder device or when ported with the Bluetooth earpiece Headphone module as a hands-free wireless audio-video camera and two-way and multi-feed telecommunications headset. The main processing component is in the CP module which contains an optical and digital zoom day and near infrared night vision camera with an expansion connector for interfacing to other peripheral components, a retractable display/monocular eyepiece view finder with eye and facial scanning system for real-time hands-free viewing of day or night vision camera video feed, a laser sight and rangefinder for visual camera targeting and automated optical and digital zoom, dual front camera and voice microphones for isolated audio-video and audio-voice feeds for noise cancellation and speaker for use as a handheld phone or for audio-video playback, and a hot swappable battery, and SD storage slot a complete numerical key pad and an independent camera/rangefinder audio and video control button array.
The Bluetooth earpiece Headphone wearable plug and play module serves as a universal port with both a multimedia and power port and a high-speed USB port for multi-device synced networking and operations and dual data/power earpiece/neckpiece removable battery ports on either end of the Headphone allowing the Headphone to be reversible and worn on either ear by supporting an external earpiece battery clip or adjustable neckpiece headset battery clip that can be inserted into either end of the earpiece Headphone for support, counterbalance and external, rechargeable and swappable power source for uninterrupted use and a second SD storage slot for use as additional backup memory for the CP module when ported or for use in audio file storage and play back when the earpiece Headphone is worn as one or a set of Bluetooth earpiece Headphones for use as either a hands-free Bluetooth communicator or as a standalone wireless Bluetooth personal media player capable of entirely autonomous operations (free of a connection to an external networked or media storage device or as a unified extension of the CP module via the multimedia or USB port, or as a paired wired network accessory or wirelessly via a Bluetooth paired connection or a Wi-Fi peer to peer networked connection (when connected with the CP module or other Wi-Fi enabled device).
Rechargeable/Replaceable External Earpiece Battery Units
-
- The replaceable/rechargeable external earpiece battery units and the adjustable neck earpiece connector are designed to wrap around the ear to provide added weight balance and support as well as extended battery life for the Bluetooth Headphone particularly when joined with the wearable CP unit.
- The removable earpiece battery port in the Bluetooth earpiece is designed for rapid replacement so that the replaceable/rechargeable earpiece battery units can be replaced with a back up earpiece battery without disconnecting the camcorder telephone unit from the earpiece unit or without taking all or part of the headset off of the ear thereby supporting uninterrupted use. The removable/replaceable earpiece battery unit has a micro-USB port designed for recharging the earpiece battery, headset battery and camcorder telephone batteries while in use. The micro USB port in the earpiece replaceable/rechargeable battery may also be used to sponsor a direct wired pairing and data transfer between the video camera headset and an external telephone or other multimedia, computing, data storage, video gaming, networking, broadcasting and/or communications device.
-
- The camcorder telephone can be operated as a normal handheld phone wirelessly connecting with the earpiece one or both of the Bluetooth earpieces as a paired device or connected and joined directly with one of the earpieces via the 30 Pin Connector or USB 3.0 port becoming a single hands-free wireless video camera headset and audio-video communications system.
- The universal Bluetooth earpiece units are designed to support and connect with multiple styles and types of hands-free video camera/phone units and designs. Three preferred video camera and video communications headset embodiments include:
- A curved camcorder/telephone unit with a retractable high speed USB port designed to connect into the Bluetooth earpiece and operate as a single hands-free wireless video camera, and WAN, LAN or PAN duplex and multi-feed voice, data and audio-video communications headset.
- The curved unit with a face form fitting design and a forward facing video camera designed to capture video at the eye level.
- Embedded and rapid removable/replaceable battery options for uninterrupted use.
- Embedded and removable data storage for voice, data, still image and audio-video recording and
- Day and infrared night vision video camera with optical and digital zoom
The video camera is preferably capable of duplex audio/video streaming; detecting of daylight, lowlight, and night light conditions; video streaming and still photography in varying light conditions; responding to control commands received via the headset; and stabilizing the image as the headset wearer moves.
Embodiments of the invention also provide for the control of the behavior of the headset. An embodiment of the headset has software that controls the operational behavior of the headset by responding to the external stimuli or commands; communicates with the external devices over wireless networks such as Bluetooth, cellular, or Wi-Fi; manages the modes of operation of the headset, which modes can comprise any of (a) voice-only, e.g. voice of the headset-wearer, (b) video-only-with-sound, e.g. video streaming as seen through the onboard video camera and sound of the video stream, but no voice of the headset wearer, (c) video-only-without-sound, similar to (b) but without sound in the video stream), and (d) video with voice; responds to (a) onboard manual controls that are operated by the headset wearer, (b) voice commands, and (c) instructions received from remote control devices, such as but not limited to a PC or another wireless device; and is capable of video transmission for (a) storing to another device, (b) uploading to the Internet, and (c) real-time duplex audio/video communications via a cellular, wireless, direct, or LAN connected device.
One form of operational control of the headset comprises of the following steps and sequence:
-
- Identification of the headset to be controlled (“controlee”);
- Electronic handshake between the controller and controlee;
- Identification and selection of communication options between the controller and controlee;
- Execution of the control action by the control software in the headset; and
- Respond back to the controller.
Although in the above depiction there is a notion of a controller and a controlee, in reality the headset and its participating devices are peers in the system. The headset or any of the other devices can assume the role of controller. The control software in the headset includes an algorithm the electronically negotiates the role of the device, i.e. controller or controlee, with the participating device based on that device's capabilities.
Having described the sequence of steps for operational control, control actions available in one embodiment are grouped in the following high-level categories:
-
- Headset (device itself) controls;
- Video camera and Laser Rangefinder controls;
- Cell Phone & View Finder controls;
- Earpiece & Media Player Controls:
- Audio system controls;
- Eye and Facial Recognition and automated camera zoom controls
- Device Authorization & Security controls
- Communications & Network controls;
- Power controls;
- Recording controls; and
- Storage controls.
Further, an embodiment of the invention provides for communication amongst the headset, a hand-held device (typically a cellular phone), and external entities. The available communication protocols include, for example, Bluetooth, VVi-Fi, and cellular. Protocol selection is made, for example, based upon such factors as optimum power consumption, desired audio or video quality, available bit-rate, and the type of data transmitted.
Embodiments of the invention relate to a hands-free wireless video camera telephone headset, which comprises a real-time two-way and multi-feed voice, data, and audio-video communications device that can operate as a standalone, long range cellular communications terminal and/or as a short-range, paired wireless accessory to a mobile phone, PC, TV, video game console, other wireless device or to a wired Internet terminal.
Embodiment of the invention also provide a manual and/or automated communications protocol selection for device power optimization, paired and/or independent wireless voice, data, and audio-video communications, streaming, networking, recording, archiving, storage, device and caller authorization and security, remote wireless video camera and device control, and remote viewfinder via any mobile phone, cellular, Bluetooth, and/or Wi-Fi enabled terminal.
The inventions now will be described more fully hereinafter with reference to the accompanying drawings, in which some examples of the embodiments of the inventions are shown. Indeed, these inventions may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided by way of example so that this disclosure will satisfy applicable legal requirements. When appropriate, like reference numerals and characters may be used to designate identical, corresponding or similar components in differing figure drawings.
An embodiment of the invention comprises a headset 10, 12, 15, 17, 20, 25 earpiece Headphone module 30, removable/rechargeable power accessories 100, multimedia glasses accessory 120 and headset docking station 150. An exemplary embodiment of the headset comprises the following components:
-
- Wireless Communication Device 10, 12, 15, 17, 20, 25: The headset can serve as a standalone wireless communication device. In standalone mode, it does not require any paired device to communicate with other wireless devices. It functions similar to a standard wireless phone and communicates with other devices over a network, whether connected wirelessly or wired.
- Built-in Video Camera 62: The built-in still image and audio-video camera is used to capture the video stream and record to local flash memory storage 86 or streamed wirelessly to the other devices over wide, metro, local or personal area network or to a network server for storage. The camera has light and motion sensor detection capability and daylight and near infrared night vision sensors making it usable in daylight and extremely lowlight nighttime conditions. The camera also responds to manual 50, hands-free voice and remote control instructions received through the headset. The camera is also designed to operate in sync with the user natural eye movements 13 and focusing via an eye and facial scanning and recognition system 14 for hands-free automated eye to camera zoom functions.
- Optical and Digital Zoom: The camera incorporates internal and external optical zoom lenses 63 for both close up (macro) and wide angle viewing and/or digital zoom for extended zoom capabilities.
- Power Source: The headset is powered by integrated and/or externally attached batteries 100. The batteries are removable, replaceable, and/or rechargeable. Alternately, the headset can be powered from a wired connection 102 with an external battery or power supply wired directly to the electrical grid.
- Storage Device: The audio/video captured by the video camera 62 and microphone 64 can be stored in the removable persistent storage of the headset 86. Embodiments of the invention provide, for example, two types of storage: RAM storage and FLASH storage that is built into the headset, and a removable storage device that is plugged into the headset, e.g. an SD card or similar device. The earpiece contains a SD slot 43 for storage of audio files.
- GPS Location: The headset has a built-in GPS location receiver. This can be used in location contextual decision making or data processing.
- High Intensity Light source: This is a source of light 61 when needed for the video shooting or taking still images. It can also be used as a flash for low-light still image capture.
- Laser Sight and Range finder: A target sighting
FIG. 12 and range measurement sub-system 61 for obtaining accurate distance reporting and automated camera zoom functions. - Viewfinder and Monocular Display: The headset has a built-in adjustable 74, 75, 76 and extendable 73 clamshell phone display 70 and camera viewfinder
FIG. 10A that can be extended out from the headset/camera phone module and worn over the eye as a monocular displayFIG. 15A for real-time hands-free viewing of captured and/or received video feed. The clamshell display has a built-in speaker 66 for use as a handheld phone and/or speakerphone for audio-video playback functions. The clamshell display contains a second optical lens 78 for self image capture and mobile teleconferencing when in handheld cell phone mode or as an eye and facial scanning device for security and automated eye to camera controls when worn over the eye as a monocular display.
The headset power accessories include numerous embodiments of removable/rechargeable batteries. A docking station 150 comprised of a seat 153 for the headset for storage, battery charging, host connection 111, or any other operational purpose. The docking station capabilities include:
-
- Seat: The headset is placed in the docking station when not in use or when charging batteries or uploading/downloading the data from the headset.
- Power Recharger: The docking station provides power for recharging module batteries. When the headset is placed in the docking station and its battery has been drained, the docking station draws the current from the host USB or wall outlet and recharges the battery. The recharger is designed to work on global power grids (110-220 VAC, 50-60 Hz).
- Headset Administration and Configuration: The docking station is a computer 145 pluggable device via a USB interface. It can be used for administering and configuring the headset by placing it in the docking station. The headset administration software installed on the computer provides a simple and user-friendly interface to administer and configure the headset. The headset operates as one of the following USB class devices; 1) Mass Storage 2) Video 3) Communication.
-
- Incoming call (Direct to headset);
- Incoming call through a paired device;
- Manual action by the user;
- Motion detection;
- Voice command;
- Device Authorization & Security
- Scheduled; event, context, network and
- Location based.
After headset is awakened as a result of one of the actions listed above, the headset is ready to perform one or more of the following actions:
Record/Capture
-
- Voice Only
- Audio-Video
- Video-only
- Still image
- Voice and Video
- Data Only
- Multimedia and Data
-
- Voice
- Audio-Video (Streaming)
- Audio-Video (Streaming & Receiving)
- Voice and Video (Streaming & Receiving)
- Metadata
-
- Intrinsic system control
- Manual system controls
- Hands-free systems controls
- Automated system controls
- Paired system controls
- Remote system controls—Hub or Wireless
The following paragraphs explain the system controls in detail.
Intrinsic System ControlsThese are the controls that operate inside the headset as a part of the headset operating system. These controls are essential to the proper functioning of the headset. These controls are activated as soon as power is switched on and run continuously until the headset is switched off. The major subsystems of the intrinsic controls are:
-
- Power systems—storage, management
- Memory management
- Camera controls
- Imager initialization
- Imager data acquisition (during still image and video capture)
- Image stabilization (during image capture)
- Optical and digital zoom (during image capture)
- Laser Rangefinder and automated zoom (during image capture)
- Still Image Capture/Video or Audio-Video record
- Motion Sensor
- Light Sensor
- Day/Near Infrared Night Vision Sensor
- Audio controls
- Wireless Activation/Listen/Streaming/Networking
- Cellular
- Wi-Fi
- GPS
- Bluetooth
- Multi-channel
- Still Image/Video or Audio Video Stream to Internet
- Voice, Audio-Video or Voice and Video Call (Two-way/multi-feed)
- Cellular, IP Phone and/or IP Camera, router/hot spot modes
- Stand-alone, Linked/Ported, wired or wireless paired and/or group device networking modes
- Audio Systems & Volume controls
- Camera/Phone Voice Microphone, AGO
- Earpiece Voice Microphone, AGO
- Video Camera microphone, AGO
- Camera/Phone Speaker
- Earpiece Speaker
- Auto Phone/Earpiece Microphone/Speaker on/off (When CP unit is ported with the earpiece unit, CP Microphone and speaker automatically shut down and earpiece microphone and earpiece speaker take over (Video Camera Microphone remains on for Noise Cancellation)
- Speaker, Earpiece volume change request
- Noise Cancellation system using camera microphone and voice recognition system
- Security controls
- Voice recognition/command
- Retina Scan recognition
- Speak on key-in Device pass code
- Device/IP ID recognition
- User/Group/Network Authorization
- GPS/Location
These controls 50 and 31 are operated by the user by pressing the onboard buttons and switches. These controls include:
-
- Camera Control Buttons 50, Switches and mount 87
- Set button to initiate a particular setting
- Toggle button for lens zoom in/out or Volume Control or Forward/Rewind button for audio video playback
- Laser sight and rangefinder on/off
- Light/Flash on/off
- Day/Near Infrared Night Vision Camera Modes
- Start/stop/pause video recording or still image capture
- On/Off Button to start hands-free voice command
- Menu and settings Button
- USB Port Extend/Retract switch
- Camera mounting fastener 87
- Earpiece Control Buttons & Switches 31
- Outcall/Respond to incoming call button
- Call or Speaker Volume/audio file scan/forward & rewind toggle button
- Menu and settings button
- External hot swap battery port release switch
- High speed USB and Multimedia Port
- Dual External Power and headset accessory ports
- Phone Control Buttons 55, Switches & Display 73
- Numerical Button key pad with menu and left right function buttons
- Security controls as listed above in the section entitled Intrinsic System Controls
- Viewfinder with extension system for use as a monocular display
- Camera Control Buttons 50, Switches and mount 87
These controls include all non-button or physical array manual and semi-automated hands-free user control systems for the device, communications and/or camera operations including;
-
- Voice Command
- Motion Gesture Recognition
- Optical Scan and Eye and Facial Recognition
- Laser Rangefinder and automated optical and/or digital zoom
- Light Sensor for day and near infrared night vision camera
- Motion Sensor and accelerometer
These controls are similar to manual control. However, the controls are operated using a paired device. These controls include all of the manual controls listed above. In addition, the paired device's screen acts as a remote viewfinder for the control operation.
Headset Operational Systems-
- Communications Protocols Subsystem
- Call Type Management Subsystem
- Device Security/ID Subsystem
- Data Management and Storage Subsystems
- Power Management Subsystem
- Device Operations Subsystem
- Event/Context Management Subsystem
The headset supports multiple wireless communication protocols. These include cellular. WiMax or Wi-Fi and Bluetooth. The communications protocols subsystem manages all the incoming and outgoing communication for the headset. The headset will participate in a network infrastructure (client-server) or ad-hoc (peer to peer) arrangement. Attributes of a Mobile Ad-hoc Network (MANET) will allow network connected units to share and forward data when operating in a mesh. Internet telephony is the conduit for the multimedia data streams operating on wideband IP networks. The TCP/IP stack will be IPv6 and IPSec compliant. The TCP/IP stack provides IP sockets for duplex inter-process communication amongst processes or threads for the delivery of multi-media data and control messages. The Session Initiation Protocol (SIP) will be used for multimedia session creation with Real-time Transport Protocol (RTP) for voice and video stream distribution.
Call Type Management SubsystemThe headset powered by at least any of two sources: removable and rechargeable batteries; and grid power when the headset is seated in the docking station. The power management subsystem manages the power consumption of the headset. It makes operational decisions, such as what communication protocol to use, whether to use camera light or not, recording options, or any other action that involves power consumption. These decisions optimize the power consumption.
The device operations subsystem manages the behavior of the headset itself. It is further subdivided into lower level of subsystems such as camera controls, memory management, manual controls, hands-free controls, video codec control, user display output, and audio controls.
Events/Context-Driven SubsystemThis subsystem responds to the external events or the external context of the device. For example, the headset may switch itself on or off when in a specific location or time of the day; the camera may begin recording when the motion sensor is activated and/or begin broadcasting live or recorded audio-video content to the Internet or directly to one or more authorized networked devices, the flashlight, laser sight and/or night-vision sensor may be activated automatically if the quality of the light degrades, etc.
Modes of CommunicationAlthough the invention is described herein with reference to the preferred embodiment, one skilled in the art will readily appreciate that other applications may be substituted for those set forth herein without departing from the spirit and scope of the present invention. Accordingly, the invention should only be limited by the Claims included below.
Claims
1. An apparatus, comprising:
- an eyeglass frame to be worn by a user;
- a microphone;
- a pair of cameras, including a right camera located on the right side of the eyeglass frame, and a left camera located on the left side of the eyeglass frame, wherein each of the cameras is configured for any of image and video capture;
- a pair of lens displays, including a right lens display located on the right side of the eyeglass frame, and a left lens display located on the left side of the eyeglass frame, wherein the pair of lens displays are configured for see-through display of at least one of the pair of cameras;
- an optical sensor located on the eyeglass frame, wherein the optical sensor is configured to monitor any of eye and facial movements of the user; and
- a processor module, including hardware and software components, configured to provide wireless multimedia functions;
- wherein the apparatus is configured for hands-tree control of the left and right cameras using any of the monitored eye or facial movements, or an audio input received through the microphone.
2. The apparatus of claim 1, wherein the lens displays include any of OLED or micro-projector lenses.
3. The apparatus of claim 1, wherein the processor module configured for any of wide, local, or personal area networking, interactive real-time VOIP, data and audio-video streaming, direct peer-to-peer and/or Internet telecommunications.
4. The apparatus of claim 1, wherein the hands-free control of the left and right cameras includes any of eye-to-camera synced automated zoom and/or focusing.
5. The apparatus of claim 1, wherein the one or both of the lens displays is configured to display any of:
- captured video;
- active video; and
- meta data.
6. The apparatus of claim 1, wherein the optical sensor is further configured to monitor any of eye and facial movement for active, hands free automated eye-to-camera control of an external camera, via a joint wired or wireless network connection.
7. The apparatus of claim 1, wherein the apparatus is configured to track hand gestures of the user, and control one or more functions or tasks using tracked hand gestures.
8. The apparatus of claim 1, wherein the apparatus is further configured for any of daylight, low light, near infrared, and infrared binocular visual display of captured video content on any of the left and right lens displays.
9. The apparatus of claim 1, further comprising any of:
- embedded power storage;
- left and right ports configured to connect with corresponding left and right earpiece headphones; and
- a wearable multimedia device port system for access to any of external and removable tethered power storage, for extended runtime capabilities.
10. The apparatus of claim 1, further comprising:
- a docking station comprising a host connection for a Web cam, file access, remote control, a power source, and wired and wireless network access.
11. The apparatus of claim 1, wherein the lens displays include sunglass lenses.
12. The apparatus of claim 1, wherein the pair of cameras are configured for at least one of:
- optical or digital zoom;
- active automatic zoom and focusing;
- detecting any of daylight, lowlight, and night light conditions;
- still image and video capture, recording, streaming, and display;
- responding to control commands received via the apparatus; and
- stabilizing any of a captured image or video as the user moves.
13. The apparatus of claim 1 wherein the pair of lens displays are further configured for any of:
- a display of data received from an external source;
- a display of any of location, relational, and context specific data; and
- a display of different information between the right lens display and the left lens display.
14. The apparatus of claim 1, further comprising:
- any of embedded storage and removable flash storage.
15. The apparatus of claim 1, further comprising:
- an expansion port configured to provide a wired connection.
16. The apparatus of claim 15, wherein the expansion port configured to port and pair with at least one of a video camera headset, a wireless terminal, wireless headphones, or earphones, or audio speakers.
17. The apparatus of claim 1, wherein the apparatus is configured for binocular viewing of captured video and two-way, multi-feed, multi-channel and multi-network real-time wireless mobile telecommunications and active video and meta data display on the lens displays.
18. The apparatus of claim 1, further comprising:
- a port for access to a power source for extended runtime capabilities.
19. A method, comprising:
- receiving image signals from a pair of cameras located on an eyeglass frame worn by a user, the eyeglass frame having a right side and a left side, wherein a right camera is located on the right side of the eyeglass frame, and a left camera is located on the left side of the eyeglass frame;
- displaying the image signals through a pair of lenses located on the right side and the left side of the eyeglass frame;
- monitoring any of eye and facial movements of the user through at least one optical sensor located on the eyeglass frame; and
- controlling the pair of cameras using any of the monitored eye or facial movements, or an audio input.
20. The method of claim 19, further comprising autonomously performing with the cameras at least one of:
- optical or digital zoom;
- detecting any of daylight, lowlight, and night light conditions;
- still image and video capture, record, streaming and/or display;
- responding to control commands received via the apparatus; and
- stabilizing a captured image as the user moves.
21. The method of claim 19, further comprising any of:
- displaying of data received from an external source through one or both of the lenses;
- displaying any of location, relational, and contextual data through one or both of the lenses; and
- displaying different information between the right lens and the left lens.
22. The method of claim 19, wherein the controlling comprises eye-to-camera synced automated zoom and/or focusing.
23. The method of claim 19, further comprising:
- establishing any of wide, local, or personal area networking, interactive real-time VOIP, data and audio-video streaming, direct peer-to-peer and/or Internet telecommunications, using an expansion card that includes hardware and software components.
24. The method of claim 19, further comprising:
- with the lens displays, displaying any of: captured video; active video; and meta data.
25. The method of claim 19, further comprising:
- with the monitored any of eye or facial movement, providing active, hands free automated eye-to-camera control of an external camera, via a joint wired or wireless network connection.
26. The method of claim 19, further comprising:
- tracking hand gestures of the user; and
- controlling one or more functions or tasks using the tracked hand gestures.
27. The method of claim 19, further comprising:
- displaying captured video content on any of the left or right lens displays under any of day light, low light, near infrared, and infrared conditions.
28. The method of claim 19, further comprising:
- connecting left and right earpiece headphones through corresponding left and right ports.
29. The method of claim 19, further comprising:
- establishing a wired or wireless connection.
30. The method of claim 29, further comprising:
- pairing through the connection at least one of a video camera headset, a wireless terminal, wireless headphones, earphones, or audio speakers.
31. The method of claim 19, further comprising:
- displaying a binocular view of captured video and two-way, multi-feed, multi-channel and multi-network real-time wireless mobile telecommunications and active video and meta data display on the lenses.
Type: Application
Filed: Jun 30, 2017
Publication Date: May 10, 2018
Inventors: Ronald Eugene FISHER (San Francisco, CA), Bryan Jonathan DAVIS (San Francisco, CA), Bradley Brian BUSHARD (Chaska, MN), Mark Joseph MEYER (Commerce Twp., MI), James FISHER (Walnut Creek, CA), Nitin PATIL (San Ramon, CA), Ben YOUNG (San Francisco, CA), Daniel JOHNSON (Petaluma, CA)
Application Number: 15/639,564