Patents by Inventor Roel Vertegaal

Roel Vertegaal has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11630510
    Abstract: A system and a method for performing 2D on-screen user gaze estimation using an input facial image of a user captured using a camera associated to a processing device having a display. The method and system allow automated user calibration through automatic recording of calibration samples each including a calibration facial image of the user and an interaction point corresponding to a point on the display where an occurrence of a user interaction was detected when the corresponding calibration image was captured. The system and method also optimize user-specific parameters using the calibration samples by iteratively minimizing a total difference between the interaction points of a plurality of the calibration samples and corresponding 2D gaze estimation results and convert an estimated 3D gaze direction into a 2D gaze estimation result corresponding to a point on the display, by applying the users-specific parameters.
    Type: Grant
    Filed: June 23, 2021
    Date of Patent: April 18, 2023
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Zhenhao Li, Rasoul Mohammadi Nasiri, Zheng Liu, Hisham Elhalabi, Yuanhao Yu, Roel Vertegaal, Yang Wang, Jin Tang
  • Publication number: 20220413602
    Abstract: A system and a method for performing 2D on-screen user gaze estimation using an input facial image of a user captured using a camera associated to a processing device having a display. The method and system allow automated user calibration through automatic recording of calibration samples each including a calibration facial image of the user and an interaction point corresponding to a point on the display where an occurrence of a user interaction was detected when the corresponding calibration image was captured. The system and method also optimize user-specific parameters using the calibration samples by iteratively minimizing a total difference between the interaction points of a plurality of the calibration samples and corresponding 2D gaze estimation results and convert an estimated 3D gaze direction into a 2D gaze estimation result corresponding to a point on the display, by applying the users-specific parameters.
    Type: Application
    Filed: June 23, 2021
    Publication date: December 29, 2022
    Inventors: Zhenhao LI, Rasoul MOHAMMADI NASIRI, Zheng LIU, Hisham ELHALABI, Yuanhao YU, Roel VERTEGAAL, Yang WANG, Jin TANG
  • Publication number: 20220391012
    Abstract: Devices, methods, and processor-readable media for eye tracking using statistically derived linear functions are described. Two simple linear functions may be identified, one for the horizontal and one for the vertical, with two parameters each, that fully correct for horizontal and vertical estimation bias error in a cross-ratio gaze estimation method. An implicit calibration step may be performed that finds the parameters of said linear functions statistically based on undirected user point of gaze measurements that indicate the extremities of the error between gaze vectors and glint vectors. Various hardware devices are described that may implement the novel eye tracking techniques.
    Type: Application
    Filed: June 7, 2022
    Publication date: December 8, 2022
    Inventors: Roel VERTEGAAL, Sean BRALEY, Hisham EL-HALABI
  • Patent number: 10915171
    Abstract: This invention relates to methods and apparatus for improving communications between humans and devices. The invention provides a method of modulating operation of a device, comprising: providing an attentive user interface for obtaining information about an attentive state of a user; and modulating operation of a device on the basis of the obtained information, wherein the operation that is modulated is initiated by the device. Preferably, the information about the user's attentive state is eye contact of the user with the device that is sensed by the attentive user interface.
    Type: Grant
    Filed: May 9, 2019
    Date of Patent: February 9, 2021
    Inventors: Roel Vertegaal, Jeffrey S. Shell
  • Publication number: 20200166967
    Abstract: A display device comprises a flexible display comprising a plurality of pixels and one or more of a z-input element and a flexible array of convex microlenses disposed on the flexible display, wherein each microlens in the array receives light from a selected number of underlying pixels and projects the received light over a range of viewing angles so as to collectively produce a flexible 3D light field display. The display device may be augmented with a flexible x,y-input element. The display device may be implemented in a mobile computing device such as a smartphone, a tablet personal computer, a personal digital assistant, a music player, a gaming device, or a combination thereof. One embodiment relates to a mobile computing device with a flexible 3D display and z-input provided by bending the display.
    Type: Application
    Filed: September 30, 2019
    Publication date: May 28, 2020
    Inventors: Roel Vertegaal, Daniel M. Gotsch, Jesse Burstyn
  • Publication number: 20200097078
    Abstract: This invention relates to methods and apparatus for improving communications between humans and devices. The invention provides a method of modulating operation of a device, comprising: providing an attentive user interface for obtaining information about an attentive state of a user; and modulating operation of a device on the basis of the obtained information, wherein the operation that is modulated is initiated by the device. Preferably, the information about the user's attentive state is eye contact of the user with the device that is sensed by the attentive user interface.
    Type: Application
    Filed: May 9, 2019
    Publication date: March 26, 2020
    Inventors: Roel Vertegaal, Jeffrey S. Shell
  • Patent number: 10296084
    Abstract: This invention relates to methods and apparatus for improving communications between humans and devices. The invention provides a method of modulating operation of a device, comprising: providing an attentive user interface for obtaining information about an attentive state of a user; and modulating operation of a device on the basis of the obtained information, wherein the operation that is modulated is initiated by the device. Preferably, the information about the user's attentive state is eye contact of the user with the device that is sensed by the attentive user interface.
    Type: Grant
    Filed: February 10, 2017
    Date of Patent: May 21, 2019
    Assignee: Queen's University at Kingston
    Inventors: Roel Vertegaal, Jeffrey S. Shell
  • Publication number: 20180252935
    Abstract: Described are various embodiments of a digital display device for use by a user having reduced visual acuity. In one embodiment, a digital display device includes: a digital display medium including an array of pixels and operable to render a pixelated image; a diffractive light field barrier overlaying said digital display at a distance therefrom and defined by an array of diffractive optical elements, each of said diffractive optical elements defined by a concentrically patterned barrier centered over a corresponding set of said pixels to diffractively influence a light field emanating therefrom and thereby govern a projection thereof from said display medium toward the user; and a hardware processor operable to output corrected image pixel data to be rendered as a function of a stored characteristic of said diffractive light field barrier and a selected vision correction parameter related to the user's reduced visual acuity.
    Type: Application
    Filed: March 2, 2018
    Publication date: September 6, 2018
    Inventors: Roel VERTEGAAL, Andreas HANEWICH-HOLLATZ, Daniel GOTSCH
  • Patent number: 9983673
    Abstract: A flexible computing device with bend input and active haptic feedback that provides vibro-tactile sensations such as friction and resistance to a user. The sensations include vibrations that simulate a physical affordance of content displayed on the flexible computing device. In one embodiment the device is a smartphone.
    Type: Grant
    Filed: March 16, 2016
    Date of Patent: May 29, 2018
    Assignee: Queen's University at Kingston
    Inventor: Roel Vertegaal
  • Publication number: 20170371407
    Abstract: This invention relates to methods and apparatus for improving communications between humans and devices. The invention provides a method of modulating operation of a device, comprising: providing an attentive user interface for obtaining information about an attentive state of a user; and modulating operation of a device on the basis of the obtained information, wherein the operation that is modulated is initiated by the device. Preferably, the information about the user's attentive state is eye contact of the user with the device that is sensed by the attentive user interface.
    Type: Application
    Filed: February 10, 2017
    Publication date: December 28, 2017
    Inventors: Roel Vertegaal, Jeffrey S. Shell
  • Patent number: 9841867
    Abstract: Apparatus for displaying a plurality of electronic documents to a user. The apparatus comprising a desk having a plurality of proximity zones which comprise at least a first proximity zone which is close to a user of the apparatus and at least a second proximity zone which is further away from said user; at least one display device comprising a display for displaying one of said plurality of electronic documents and at least one sensing device for determining the proximity zone within which said at least one display device is located. The functionality of said display device is determined by the proximity zone within which it is located.
    Type: Grant
    Filed: February 6, 2013
    Date of Patent: December 12, 2017
    Inventors: Roel Vertegaal, Paul Strohmeier, Aneesh Pradyumna Tarun
  • Publication number: 20170224140
    Abstract: The invention relates to a set of interaction techniques for obtaining input to a computer system based on methods and apparatus for detecting properties of the shape, location and orientation of flexible display surfaces, as determined through manual or gestural interactions of a user with said display surfaces. Such input may be used to alter graphical content and functionality displayed on said surfaces or some other display or computing system. The invention also relates to interactive food or beverage container with associated computing apparatus inside its body, and a curved multitouch display on its surface, associated interaction techniques for curved multitouch displays, methods of use, and apparatus for refilling said electronic food or beverage container.
    Type: Application
    Filed: October 14, 2016
    Publication date: August 10, 2017
    Inventors: ROEL VERTEGAAL, JUSTIN LEE, YVES BEHAR, PICHAYA PUTTORNGUL
  • Publication number: 20160328017
    Abstract: A flexible computing device with bend input and active haptic feedback that provides vibro-tactile sensations such as friction and resistance to a user. The sensations include vibrations that simulate a physical affordance of content displayed on the flexible computing device. In one embodiment the device is a smartphone.
    Type: Application
    Filed: March 16, 2016
    Publication date: November 10, 2016
    Inventor: Roel Vertegaal
  • Publication number: 20160306390
    Abstract: A display device comprises a flexible display comprising a plurality of pixels and one or more of a z-input element and a flexible array of convex microlenses disposed on the flexible display, wherein each microlens in the array receives light from a selected number of underlying pixels and projects the received light over a range of viewing angles so as to collectively produce a flexible 3D light field display. The display device may be augmented with a flexible x,y-input element. The display device may be implemented in a mobile computing device such as a smartphone, a tablet personal computer, a personal digital assistant, a music player, a gaming device, or a combination thereof. One embodiment relates to a mobile computing device with a flexible 3D display and z-input provided by bending the display.
    Type: Application
    Filed: March 17, 2016
    Publication date: October 20, 2016
    Inventors: Roel Vertegaal, Daniel M. Gotsch, Jesse Burstyn
  • Publication number: 20160299531
    Abstract: A mobile computing device with a substantially cylindrical form factor and a flexible display screen. The flexible display screen is adapted to display content when it is substantially completely wrapped around the cylindrical body, partially wrapped around the cylindrical body, or substantially not wrapped around the cylindrical body. In one embodiment the flexible display comprises a touch-sensitive user interface. The mobile computing device may be a smartphone, a tablet pc, a personal digital assistant, a music player, a gaming device, a remote control, or a combination thereof.
    Type: Application
    Filed: March 17, 2016
    Publication date: October 13, 2016
    Inventor: Roel Vertegaal
  • Publication number: 20160103486
    Abstract: This invention relates to methods and apparatus for improving communications between humans and devices. The invention provides a method of modulating operation of a device, comprising: providing an attentive user interface for obtaining information about an attentive state of a user; and modulating operation of a device on the basis of the obtained information, wherein the operation that is modulated is initiated by the device. Preferably, the information about the user's attentive state is eye contact of the user with the device that is sensed by the attentive user interface.
    Type: Application
    Filed: May 27, 2015
    Publication date: April 14, 2016
    Inventors: Roel Vertegaal, Jeffrey S. Shell
  • Publication number: 20150309611
    Abstract: The invention relates to a set of interaction techniques for obtaining input to a computer system based on methods and apparatus for detecting properties of the shape, location and orientation of flexible display surfaces, as determined through manual or gestural interactions of a user with said display surfaces. Such input may be used to alter graphical content and functionality displayed on said surfaces or some other display or computing system. The invention also relates to interactive food or beverage container with associated computing apparatus inside its body, and a curved multitouch display on its surface, associated interaction techniques for curved multitouch displays, methods of use, and apparatus for refilling said electronic food or beverage container.
    Type: Application
    Filed: June 25, 2014
    Publication date: October 29, 2015
    Inventors: Roel VERTEGAAL, Justin LEE, Yves BEHAR, Pichaya PUTTORNGUL
  • Publication number: 20150042555
    Abstract: This invention relates to methods and apparatus for improving communications between humans and devices. The invention provides a method of modulating operation of a device, comprising: providing an attentive user interface for obtaining information about an attentive state of a user; and modulating operation of a device on the basis of the obtained information, wherein the operation that is modulated is initiated by the device. Preferably, the information about the user's attentive state is eye contact of the user with the device that is sensed by the attentive user interface.
    Type: Application
    Filed: March 14, 2014
    Publication date: February 12, 2015
    Applicant: Queen's University at Kingston
    Inventors: Roel Vertegaal, Jeffrey S. Shell
  • Publication number: 20140195898
    Abstract: Apparatus for displaying a plurality of electronic documents to a user. The apparatus comprising a desk having a plurality of proximity zones which comprise at least a first proximity zone which is close to a user of the apparatus and at least a second proximity zone which is further away from said user; at least one display device comprising a display for displaying one of said plurality of electronic documents and at least one sensing device for determining the proximity zone within which said at least one display device is located. The functionality of said display device is determined by the proximity zone within which it is located.
    Type: Application
    Filed: February 6, 2013
    Publication date: July 10, 2014
    Inventors: Roel Vertegaal, Paul Strohmeier, Aneesh Pradyumna Tarun
  • Publication number: 20140085184
    Abstract: The invention relates to a set of interaction techniques for obtaining input to a computer system based on methods and apparatus for detecting properties of the shape, location and orientation of flexible display surfaces, as determined through manual or gestural interactions of a user with said display surfaces. Such input may be used to alter graphical content and functionality displayed on said surfaces or some other display or computing system.
    Type: Application
    Filed: June 17, 2013
    Publication date: March 27, 2014
    Inventors: Roel Vertegaal, David Holman