Search Patents
  • Systems and methods for remapping three-dimensional gestures onto a finite-size two-dimensional surface
    Patent number: 9501138
    Abstract: A method for operating a real-time gesture based interactive system includes: obtaining a sequence of frames of data from an acquisition system; comparing successive frames of the data for portions that change between frames; determining whether any of the portions that changed are part of an interaction medium detected in the sequence of frames of data; defining a 3D interaction zone relative to an initial position of the part of the interaction medium detected in the sequence of frames of data; tracking a movement of the interaction medium to generate a plurality of 3D positions of the interaction medium; detecting movement of the interaction medium from inside to outside the 3D interaction zone at a boundary 3D position; shifting the 3D interaction zone relative to the boundary 3D position; computing a plurality of 2D positions based on the 3D positions; and supplying the 2D positions to control an application.
    Type: Grant
    Filed: May 5, 2015
    Date of Patent: November 22, 2016
    Assignee: Aquifi, Inc.
    Inventors: Carlo Dal Mutto, Giuliano Pasqualotto, Giridhar Murali, Michele Stoppa, Amir hossein Khalili, Ahmed Tashrif Kamal, Britta Hummel
  • Use of natural user interface realtime feedback to customize user viewable ads presented on broadcast media
    Patent number: 9414115
    Abstract: A sponsor of ads included in media content broadcast to devices by a media broadcast system for viewing by users can receive realtime feedback from users indicative of user evaluation of the presently broadcast and viewed ad. User devices anonymously acquire, process, analyze and broadcast user responses to broadcast ads viewed on the device, the responses preferably made with natural user gestures. User responses broadcast from the device are received by the media broadcast system. Ad sponsors may the customized the ad and/or future ads for the user based upon feedback and, if present, a user history profile. Broadcast ads can allow user to preselect desired ads by interacting with sponsor logos or icons presented on the device. Gesture data can be acquired, processed and broadcast to the media broadcast system for latent, incomplete, user responses, and for responses made during non-ad portions of the broadcast media.
    Type: Grant
    Filed: March 27, 2015
    Date of Patent: August 9, 2016
    Assignee: AQUIFI, INC.
    Inventors: Teresa Mao, Abbas Rafii
  • Two-dimensional method and system enabling three-dimensional user interaction with a device
    Patent number: 9207773
    Abstract: User interaction with a display is detected substantially simultaneously using at least two cameras whose intersecting FOVs define a three-dimensional hover zone within which user interactions can be imaged. Separately and collectively image data is analyzed to identify a relatively few user landmarks. A substantially unambiguous correspondence is established between the same landmark on each acquired image, and a three-dimensional reconstruction is made in a common coordinate system. Preferably cameras are modeled to have characteristics of pinhole cameras, enabling rectified epipolar geometric analysis to facilitate more rapid disambiguation among potential landmark points. Consequently processing overhead is substantially reduced, as are latency times. Landmark identification and position information is convertible into a command causing the display to respond appropriately to a user gesture.
    Type: Grant
    Filed: March 21, 2014
    Date of Patent: December 8, 2015
    Assignee: AQUIFI, INC.
    Inventor: Abbas Rafii
  • Method and system enabling natural user interface gestures with user wearable glasses
    Patent number: 8836768
    Abstract: User wearable eye glasses include a pair of two-dimensional cameras that optically acquire information for user gestures made with an unadorned user object in an interaction zone responsive to viewing displayed imagery, with which the user can interact. Glasses systems intelligently signal process and map acquired optical information to rapidly ascertain a sparse (x,y,z) set of locations adequate to identify user gestures. The displayed imagery can be created by glasses systems and presented with a virtual on-glasses display, or can be created and/or viewed off-glasses. In some embodiments the user can see local views directly, but augmented with imagery showing internet provided tags identifying and/or providing information as to viewed objects. On-glasses systems can communicate wirelessly with cloud servers and with off-glasses systems that the user can carry in a pocket or purse.
    Type: Grant
    Filed: August 23, 2013
    Date of Patent: September 16, 2014
    Assignee: Aquifi, Inc.
    Inventors: Abbas Rafii, Tony Zuccarino
  • Systems and methods for tracking human hands using parts based template matching using corresponding pixels in bounded regions of a sequence of frames that are a specified distance interval from a reference camera
    Patent number: 9111135
    Abstract: Systems and methods for tracking human hands using parts based template matching within bounded regions are described. One embodiment of the invention includes a processor; an image capture system configured to capture multiple images of a scene; and memory containing a plurality of templates that are rotated and scaled versions of a finger template. A hand tracking application configures the processor to: obtain a reference frame of video data and an alternate frame of video data from the image capture system; identify corresponding pixels within the reference and alternate frames of video data; identify at least one bounded region within the reference frame of video data containing pixels having corresponding pixels in the alternate frame of video data satisfying a predetermined criterion; and detect at least one candidate finger within the at least one bounded region in the reference frame of video data.
    Type: Grant
    Filed: June 11, 2013
    Date of Patent: August 18, 2015
    Assignee: Aquifi, Inc.
    Inventors: Britta Hummel, Giridhar Murali
  • Systems and methods for implementing three-dimensional (3D) gesture based graphical user interfaces (GUI) that incorporate gesture reactive interface objects
    Patent number: 9298266
    Abstract: Systems and methods in accordance with embodiments of the invention implement three-dimensional (3D) gesture based graphical user interfaces (GUI) using gesture reactive interface objects. One embodiment includes using a computing device to render an initial user interface comprising a set of interface objects, detect a targeting 3D gesture in captured image data that identifies a targeted interface object within the user interface, change the rendering of at least the targeted interface object within the user interface in response to the targeting 3D gesture that targets the interface object, detect an interaction 3D gesture in additional captured image data that identifies a specific interaction with a targeted interface object, modify the user interface in response to the interaction with the targeted interface object identified by the interaction 3D gesture, and render the modified user interface.
    Type: Grant
    Filed: August 12, 2013
    Date of Patent: March 29, 2016
    Assignee: Aquifi, Inc.
    Inventors: Keith Blackstone, Eric Webb, David Girdwood, Carlo Dal Mutto
  • System and method for high dynamic range depth capture using multiple cameras
    Patent number: 10453185
    Abstract: A method for capturing a depth map includes: controlling a plurality of cameras to capture, concurrently, a plurality of first images during a first exposure interval, each of the cameras concurrently capturing a corresponding one of the first images, the cameras having overlapping fields of view; controlling a projection source to emit light at a first illumination level during the first exposure interval; controlling the cameras to capture, concurrently, a plurality of second images during a second exposure interval, each of the cameras concurrently capturing a corresponding one of the second images; controlling the projection source to emit light at a second illumination level during the second exposure interval, the second illumination level being different from the first illumination level; combining the first images with the second images to generate a depth map; and outputting the depth map.
    Type: Grant
    Filed: November 2, 2016
    Date of Patent: October 22, 2019
    Assignee: AQUIFI, INC.
    Inventors: Carlo Dal Mutto, Abbas Rafii, Pietro Salvagnini, Aryan Hazeghi, Michele Stoppa, Francesco Peruch, Giulio Marin
  • System and method for 3D reconstruction using multiple multi-channel cameras
    Patent number: 9392262
    Abstract: A method for three-dimensional reconstruction of a scene includes: controlling a projection source to emit invisible light toward the scene; while the projection source is emitting light: controlling a first multi-channel image sensor to capture a first image, the first multi-channel image sensor including visible light detecting pixels and invisible light detecting pixels, the first image including a first invisible light channel and a first visible light channel; controlling a second multi-channel image sensor to capture a second image substantially simultaneously as the capture of the first image, the second multi-channel image sensor including visible light detecting pixels and invisible light detecting pixels, the second image including a second invisible light channel and a second visible light channel; performing stereo analysis of the first image and the second image in accordance with the invisible light channels and the visible light channels to generate a depth map.
    Type: Grant
    Filed: March 6, 2015
    Date of Patent: July 12, 2016
    Assignee: Aquifi, Inc.
    Inventors: Carlo Dal Mutto, Abbas Rafii, David Demirdjian
  • Systems and methods for tracking human hands by performing parts based template matching using images from multiple viewpoints
    Patent number: 8934675
    Abstract: Systems and methods for tracking human hands by performing parts based template matching using images captured from multiple viewpoints are described. One embodiment of the invention includes a processor, a reference camera, an alternate view camera, and memory containing: a hand tracking application; and a plurality of edge feature templates that are rotated and scaled versions of a finger template that includes an edge features template. In addition, the hand tracking application configures the processor to: detect at least one candidate finger in a reference frame, where each candidate finger is a grouping of pixels identified by searching the reference frame for a grouping of pixels that have image gradient orientations that match one of the plurality of edge feature templates; and verify the correct detection of a candidate finger in the reference frame by locating a grouping of pixels in an alternate view frame that correspond to the candidate finger.
    Type: Grant
    Filed: May 21, 2013
    Date of Patent: January 13, 2015
    Assignee: Aquifi, Inc.
    Inventors: Carlo Dal Mutto, Britta Hummel, Michele Stoppa, Giridhar Murali, Teresa Mao, Giuliano Pasqualotto
  • Portable remote control device enabling three-dimensional user interaction with at least one appliance
    Patent number: 8773512
    Abstract: A portable remote control device enables user interaction with an appliance by detecting user gestures made in a hover zone, and converting the gestures to commands that are wirelessly transmitted to the appliance. The remote control device includes at least two cameras whose intersecting FOVs define a three-dimensional hover zone within which user interactions are imaged. Separately and collectively image data is analyzed to identify a relatively few user landmarks. Substantially unambiguous correspondence is established between the same landmark on each acquired image, and a three-dimensional reconstruction is made in a common coordinate system. Preferably cameras are modeled to have characteristics of pinhole cameras, enabling rectified epipolar geometric analysis to facilitate more rapid disambiguation among potential landmark points. As a result processing overhead and latency times are substantially reduced.
    Type: Grant
    Filed: June 29, 2012
    Date of Patent: July 8, 2014
    Assignee: Aquifi, Inc.
    Inventor: Abbas Rafii
  • Systems and methods for compact space-time stereo three-dimensional depth sensing
    Patent number: 9826216
    Abstract: A pattern projection system includes a coherent light source, a repositionable DOE disposed to receive coherent light from said coherent light source and disposed to output at least one pattern of projectable light onto a scene to be imaged by an (x,y) two-dimensional optical acquisition system. Coherent light speckle artifacts in the projected pattern are reduced by rapidly controllably repositioning the DOE or the entire pattern projection system. Different projectable patterns are selected from a set of M patterns that are related to each other by a translation and/or rotation operation in two-dimensional cosine space. A resultant (x,y,z) depth map has improved quality and robustness due to projection of the selected patterns. Three-dimensional (x,y,z) depth data obtained from two-dimensional imaged data including despeckling is higher quality data than if projected patterns without despeckling were used.
    Type: Grant
    Filed: September 23, 2016
    Date of Patent: November 21, 2017
    Assignee: AQUIFI, INC.
    Inventors: Aryan Hazeghi, Carlo Dal Mutto, Giulio Marin, Francesco Peruch, Michele Stoppa, Abbas Rafii
  • Dynamically reconfigurable optical pattern generator module useable with a system to rapidly reconstruct three-dimensional data
    Patent number: 9521399
    Abstract: Dynamic projection of at least first and second patterns contributes detectable disparity onto a scene that includes a target object. The scene is imaged with two-dimensional cameras whose acquired imagery includes disparity contributions whose presence enable a three-dimensional reconstruction depth map to be rapidly and accurately generated. In one embodiment coherent light is input to a first DOE within whose near range output is disposed a second DOE, whose far range output projects an image. Electronically varying effective optical distance between the two DOEs varies the pattern projected from the second DOE. A processor system and algorithms enable dynamic intelligent selection of projected patterns to more readily discern target object characteristics: shape, size, velocity. Patterns can implement spatio-temporal depth reconstruction, spatio-temporal depth reconstruction, and even single-camera spatio-temporal light coding reconstruction.
    Type: Grant
    Filed: April 25, 2016
    Date of Patent: December 13, 2016
    Assignee: AQUIFI, INC.
    Inventors: Aryan Hazeghi, Carlo Dal Mutto, Abbas Rafii, David Demirdjian
  • Dynamically reconfigurable optical pattern generator module useable with a system to rapidly reconstruct three-dimensional data
    Patent number: 9325973
    Abstract: Dynamic projection of at least first and second patterns contributes detectable disparity onto a scene that includes a target object. The scene is imaged with two-dimensional cameras whose acquired imagery includes disparity contributions whose presence enable a three-dimensional reconstruction depth map to be rapidly and accurately generated. In one embodiment coherent light is input to a first DOE within whose near range output is disposed a second DOE, whose far range output projects an image. Electronically varying effective optical distance between the two DOEs varies the pattern projected from the second DOE. A processor system and algorithms enable dynamic intelligent selection of projected patterns to more readily discern target object characteristics: shape, size, velocity. Patterns can implement spatio-temporal depth reconstruction, spatio-temporal depth reconstruction, and even single-camera spatio-temporal light coding reconstruction.
    Type: Grant
    Filed: July 1, 2015
    Date of Patent: April 26, 2016
    Assignee: AQUIFI, INC.
    Inventors: Aryan Hazeghi, Carlo Dal Mutto, Abbas Rafii, David Demirdjian
Narrow Results

Filter by US Classification