Patents by Inventor Hrvoje Benko

Hrvoje Benko has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20110195781
    Abstract: Keyboards, mice, joysticks, customized gamepads, and other peripherals are continually being developed to enhance a user's experience when playing computer video games. Unfortunately, many of these devices provide users with limited input control because of the complexity of today's gaming applications. For example, many computer video games require a combination of mouse and keyboard to control even the simplest of in-game tasks (e.g., walking into a room and looking around may require several keyboard keystrokes and mouse movements). Accordingly, one or more systems and/or techniques for performing in-game tasks based upon user input within a multi-touch mouse are disclosed herein. User input comprising one or more user interactions detect by spatial sensors within the multi-touch mouse may be received. A wide variety of in-game tasks (e.g., character movements, character actions, character view, etc.) may be performed based upon the user interactions (e.g., a swipe gesture, a mouse position change, etc.).
    Type: Application
    Filed: February 5, 2010
    Publication date: August 11, 2011
    Applicant: Microsoft Corporation
    Inventors: Billy Chen, Hrvoje Benko, Eyal Ofek, Daniel A. Rosenfeld
  • Publication number: 20110157025
    Abstract: A method of controlling a virtual object within a virtual workspace includes recognizing a hand posture of an initial touch gesture directed to a touch-input receptor, and a mode constraint is set based on the hand posture. The mode constraint specifies a constrained parameter of a virtual object that is to be maintained responsive to a subsequent touch gesture. The method further includes recognizing a subsequent touch gesture directed to the touch-input receptor. An unconstrained parameter of the virtual object is modulated responsive to the subsequent touch gesture while the constrained parameter of the virtual object is maintained in accordance with the mode constraint.
    Type: Application
    Filed: December 30, 2009
    Publication date: June 30, 2011
    Inventors: Paul Armistead Hoover, Maxim Oustiogov, Daniel J. Wigdor, Hrvoje Benko, Jarrod Lombardo
  • Publication number: 20110117535
    Abstract: A method for providing multi-touch input training on a display surface is disclosed. A touch input is detected at one or more regions of the display surface. A visualization of the touch input is displayed at a location of the display surface offset from the touch input. One or more annotations are displayed at a location of the display surface offset from the touch input and proximate to the visualization, where each annotation shows a different legal continuation of the touch input.
    Type: Application
    Filed: November 16, 2009
    Publication date: May 19, 2011
    Applicant: MICROSOFT CORPORATION
    Inventors: Hrvoje Benko, Daniel J. Wigdor, Dustin Freeman
  • Publication number: 20110117526
    Abstract: A method for providing multi-touch input initiation training on a display surface is disclosed. A set of one or more registration hand postures is determined, where each registration hand posture corresponds to one or more gestures executable from that registration hand posture. A registration posture guide is displayed on the display surface. The registration posture guide includes a catalogue for each registration hand posture, where the catalogue includes a contact silhouette showing a model touch-contact interface between the display surface and that registration hand posture.
    Type: Application
    Filed: November 16, 2009
    Publication date: May 19, 2011
    Applicant: MICROSOFT CORPORATION
    Inventors: Daniel J. Wigdor, Hrvoje Benko
  • Publication number: 20110080341
    Abstract: Indirect multi-touch interaction is described. In an embodiment, a user interface is controlled using a cursor and a touch region comprising a representation of one or more digits of a user. The cursor and the touch region are moved together in the user interface in accordance with data received from a cursor control device, such that the relative location of the touch region and the cursor is maintained. The representations of the digits of the user are moved in the touch region in accordance with data describing movement of the user's digits. In another embodiment, a user interface is controlled in a first mode of operation using an aggregate cursor, and switched to a second mode of operation in which the aggregate cursor is divided into separate portions, each of which can be independently controlled by the user.
    Type: Application
    Filed: October 1, 2009
    Publication date: April 7, 2011
    Applicant: Microsoft Corporation
    Inventors: John Helmes, Nicolas Villar, Hrvoje Benko, Shahram Izadi, Daniel Rosenfeld, Stephen Hodges, David Alexander Butler, Xiang Cao, Richard Banks
  • Publication number: 20100315335
    Abstract: A pointing device with independently movable portions is described. In an embodiment, a pointing device comprises a base unit and a satellite portion. The base unit is arranged to be located under a palm of a user's hand and be movable over a supporting surface. The satellite portion is arranged to be located under a digit of the user's hand and be independently movable over the supporting surface relative to the base unit. In embodiments, data from at least one sensing device is read, and movement of both the base unit and the independently movable satellite portion of the pointing device is calculated from the data. The movement of the base unit and the satellite portion is analyzed to detect a user gesture.
    Type: Application
    Filed: June 16, 2009
    Publication date: December 16, 2010
    Applicant: Microsoft Corporation
    Inventors: Nicolas Villar, John Helmes, Shahram Izadi, Daniel Rosenfeld, Stephen E. Hodges, David Alexander Butler, Xiang Cao, Otmar Hilliges, Richard Banks, Benjamin David Eidelson, Hrvoje Benko
  • Publication number: 20100315336
    Abstract: A pointing device using proximity sensing is described. In an embodiment, a pointing device comprises a movement sensor and a proximity sensor. The movement sensor generates a first data sequence relating to sensed movement of the pointing device relative to a surface. The proximity sensor generates a second data sequence relating to sensed movement relative to the pointing device of one or more objects in proximity to the pointing device. In embodiments, data from the movement sensor of the pointing device is read and the movement of the pointing device relative to the surface is determined. Data from the proximity sensor is also read, and a sequence of sensor images of one or more objects in proximity to the pointing device are generated. The sensor images are analyzed to determine the movement of the one or more objects relative to the pointing device.
    Type: Application
    Filed: June 16, 2009
    Publication date: December 16, 2010
    Applicant: Microsoft Corporation
    Inventors: David Alexander BUTLER, Nicolas VILLAR, John HELMES, Shahram IZADI, Stephen E. HODGES, Daniel ROSENFELD, Hrvoje BENKO
  • Publication number: 20100302137
    Abstract: Described herein is a system that includes a receiver component that receives gesture data from a sensor unit that is coupled to a body of a gloveless user, wherein the gesture data is indicative of a bodily gesture of the user, wherein the bodily gesture comprises movement pertaining to at least one limb of the gloveless user. The system further includes a location determiner component that determines location of the bodily gesture with respect to a touch-sensitive display apparatus. The system also includes a display component that causes the touch-sensitive display apparatus to display an image based at least in part upon the received gesture data and the determined location of the bodily gesture with respect to the touch-sensitive display apparatus.
    Type: Application
    Filed: May 27, 2009
    Publication date: December 2, 2010
    Applicant: Microsoft Corporation
    Inventors: Hrvoje Benko, Desney S. Tan, Daniel Morris, Timothy Scott Saponas
  • Publication number: 20100265178
    Abstract: Technologies for a camera-based multi-touch input device operable to provide conventional mouse movement data as well as three-dimensional multi-touch data. Such a device is based on an internal camera focused on a mirror or set of mirrors enabling the camera to image the inside of a working surface of the device. The working surface allows light to pass through. An internal light source illuminates the inside of the working surface and reflects off of any objects proximate to the outside of the device. This reflected light is received by the mirror and then directed to the camera. Imaging from the camera can be processed to extract touch points corresponding to the position of one or more objects outside the working surface as well as to detect gestures performed by the objects. Thus the device can provide conventional mouse functionality as well as three-dimensional multi-touch functionality.
    Type: Application
    Filed: April 17, 2009
    Publication date: October 21, 2010
    Applicant: Microsoft Corporation
    Inventors: Hrvoje Benko, Daniel Allen Rosenfeld, Eyal Ofek, Billy Chen, Shahram Izadi, Nicolas Villar, John Helmes
  • Publication number: 20100245246
    Abstract: Embodiments are disclosed herein that are related to input devices with curved multi-touch surfaces. One disclosed embodiment comprises a touch-sensitive input device having a curved geometric feature comprising a touch sensor, the touch sensor comprising an array of sensor elements integrated into the curved geometric feature and being configured to detect a location of a touch made on a surface of the curved geometric feature.
    Type: Application
    Filed: June 19, 2009
    Publication date: September 30, 2010
    Applicant: MICROSOFT CORPORATION
    Inventors: Daniel Rosenfeld, Jonathan Westhues, Shahram Izadi, Nicolas Villar, Hrvoje Benko, John Helmes, Kurt Allen Jenkins
  • Publication number: 20100242274
    Abstract: Embodiments are disclosed herein that are related to input devices with curved multi-touch surfaces. For example, in one disclosed embodiment, a method of making a multi-touch input device having a curved touch-sensitive surface comprises forming on a substrate an array of sensor elements defining a plurality of pixels of the multi-touch sensor, forming the substrate into a shape that conforms to a surface of the curved geometric feature of the body of the input device, and fixing the substrate to the curved geometric feature of the body of the input device.
    Type: Application
    Filed: June 19, 2009
    Publication date: September 30, 2010
    Applicant: MICROSOFT CORPORATION
    Inventors: Daniel Rosenfeld, Jonathan Westhues, Shahram Izadi, Nicolas Villar, Hrvoje Benko, John Helmes, Kurt Allen Jenkins
  • Publication number: 20100225595
    Abstract: The claimed subject matter provides a system and/or a method that facilitates distinguishing input among one or more users in a surface computing environment. A variety of information can be obtained and analyzed to infer an association between a particular input and a particular user. Touch point information can be acquired from a surface wherein the touch point information relates to a touch point. In addition, one or more environmental sensors can monitor the surface computing environment and provide environmental information. The touch point information and the environmental information can be analyzed to determine direction of inputs, location of users, and movement of users and so on. Individual analysis results can be correlated and/or aggregated to generate a inference of association between a touch point and user.
    Type: Application
    Filed: March 3, 2009
    Publication date: September 9, 2010
    Applicant: MICROSOFT CORPORATION
    Inventors: Stephen E. Hodges, Hrvoje Benko, Ian M. Sands, David Alexander Butler, Shahram Izadi, William Ben Kunz, Kenneth P. Hinckley
  • Publication number: 20100218249
    Abstract: The claimed subject matter provides a system and/or a method that facilitates authentication of a user in a surface computing environment. A device or authentication object can be carried by a user and employed to retain authentication information. An authentication component can obtain the authentication information from the device and analyze the information to verify an identity of the user. A touch input component can ascertain if a touch input is authentication by associating touch input with the user. In addition, authentication information can be employed to establish a secure communications channel for transfer of user data.
    Type: Application
    Filed: February 25, 2009
    Publication date: August 26, 2010
    Applicant: MICROSOFT CORPORATION
    Inventors: Andrew D. Wilson, Stephen E. Hodges, Peter B. Thompson, Meredith June Morris, Paul Armistead Hoover, William J. Westerinen, Steven N. Bathiche, Ian M. Sands, Shahram Izadi, David Alexander Butler, Matthew B. MacLaurin, Arthur T. Whitten, William Ben Kunz, Shawn R. LeProwse, Hrvoje Benko
  • Publication number: 20100182220
    Abstract: An image orientation system is provided wherein images (rays of lights) are projected to a user based on the user's field of view or viewing angle. As the rays of light are projected, streams of air can be produced that bend or focus the rays of light toward the user's field of view. The streams of air can be cold air, hot air, or combinations thereof. Further, an image receiver can be utilized to receive the produced image/rays of light directly in line with the user's field of view. The image receiver can be a wearable device, such as a head mounted display.
    Type: Application
    Filed: January 16, 2009
    Publication date: July 22, 2010
    Applicant: Microsoft Corporation
    Inventors: Steven N. Bathiche, Hrvoje Benko, Stephen E. Hodges, Shahram Izadi, David Alexander Butler, William Ben Kunz, Shawn R. LeProwse
  • Publication number: 20100149090
    Abstract: Aspects relate to detecting gestures that relate to a desired action, wherein the detected gestures are common across users and/or devices within a surface computing environment. Inferred intentions and goals based on context, history, affordances, and objects are employed to interpret gestures. Where there is uncertainty in intention of the gestures for a single device or across multiple devices, independent or coordinated communication of uncertainty or engagement of users through signaling and/or information gathering can occur.
    Type: Application
    Filed: December 15, 2008
    Publication date: June 17, 2010
    Applicant: MICROSOFT CORPORATION
    Inventors: Meredith June Morris, Eric J. Horvitz, Andrew David Wilson, F. David Jones, Stephen E. Hodges, Kenneth P. Hinckley, David Alexander Butler, Ian M. Sands, V. Kevin Russ, Hrvoje Benko, Shawn R. LeProwse, Shahram Izadi, William Ben Kunz
  • Publication number: 20100079369
    Abstract: An interaction management module (IMM) is described for allowing users to engage an interactive surface in a collaborative environment using various input devices, such as keyboard-type devices and mouse-type devices. The IMM displays digital objects on the interactive surface that are associated with the devices in various ways. The digital objects can include input display interfaces, cursors, soft-key input mechanisms, and so on. Further, the IMM provides a mechanism for establishing a frame of reference for governing the placement of each cursor on the interactive surface. Further, the IMM provides a mechanism for allowing users to make a digital copy of a physical article placed on the interactive surface. The IMM also provides a mechanism which duplicates actions taken on the digital copy with respect to the physical article, and vice versa.
    Type: Application
    Filed: September 30, 2008
    Publication date: April 1, 2010
    Applicant: Microsoft Corporation
    Inventors: Bjorn U. Hartmann, Andrew D. Wilson, Hrvoje Benko, Meredith J. Morris
  • Publication number: 20100020026
    Abstract: Touch interaction with a curved display (e.g., a sphere, a hemisphere, a cylinder, etc.) is enabled through various user interface (UI) features. In an example embodiment, a curved display is monitored to detect a touch input. If a touch input is detected based on the act of monitoring, then one or more locations of the touch input are determined. Responsive to the determined one or more locations of the touch input, at least one user UI feature is implemented. Example UI features include an orb-like invocation gesture feature, a rotation-based dragging feature, a send-to-dark-side interaction feature, and an object representation and manipulation by proxy representation feature.
    Type: Application
    Filed: December 26, 2008
    Publication date: January 28, 2010
    Applicant: MICROSOFT CORPORATION
    Inventors: Hrvoje Benko, Andrew D. Wilson, Billy Chen, Ravin Balakrishnan, Patrick M. Baudisch
  • Publication number: 20100023895
    Abstract: Touch interaction with a curved display (e.g., a sphere, a hemisphere, a cylinder, etc.) is facilitated by preserving a predetermined orientation for objects. In an example embodiment, a curved display is monitored to detect a touch input on an object. If a touch input on an object is detected based on the monitoring, then one or more locations of the touch input are determined. The object may be manipulated responsive to the determined one or more locations of the touch input. While manipulation of the object is permitted, a predetermined orientation is preserved.
    Type: Application
    Filed: December 26, 2008
    Publication date: January 28, 2010
    Applicant: MICROSOFT CORPORATION
    Inventors: Hrvoje Benko, Andrew D. Wilson, Billy Chen, Ravin Balakrishnan, Patrick M. Baudisch
  • Publication number: 20090189857
    Abstract: Described herein is an apparatus that includes a curved display surface that has an interior and an exterior. The curved display surface is configured to display images thereon. The apparatus also includes an emitter that emits light through the interior of the curved display surface. A detector component analyzes light reflected from the curved display surface to detect a position on the curved display surface where a first member is in physical contact with the exterior of the curved display surface.
    Type: Application
    Filed: May 19, 2008
    Publication date: July 30, 2009
    Applicant: MICROSOFT CORPORATION
    Inventors: Hrvoje Benko, Andrew Wilson, Ravin Balakrishnan
  • Publication number: 20090189917
    Abstract: A method for displaying images on a curved display surface is described herein. The method includes receiving a graphical object and distorting the graphical object at run-time such that an appearance of the graphical object on the curved display surface will be substantially similar regardless of a position of the graphical object on the curved display surface when viewed at a viewing axis that is approximately orthogonal to a plane that is tangential to the curved display surface at a center of the graphical object. The method may further include displaying the graphical object on the curved display surface.
    Type: Application
    Filed: May 19, 2008
    Publication date: July 30, 2009
    Applicant: MICROSOFT CORPORATION
    Inventors: Hrvoje Benko, Andrew Wilson