Patents by Inventor Hrvoje Benko

Hrvoje Benko has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10678334
    Abstract: The disclosed wearable apparatus may include wearable apparatus includes a (1) device dimensioned to fit about a body part of a user, (2) a tensioning mechanism that harnesses to the device in a manner that is relative to the fit of the device about the body part of the user, and (3) an actuator couples to the tensioning mechanism that, when actuated, causes substantially tangential movement of the tensioning mechanism relative to a surface of the body part to produce substantially orthogonal movement of the device relative to the surface of the body part. Various other methods, systems, and/or computer-readable media are also disclosed.
    Type: Grant
    Filed: November 30, 2018
    Date of Patent: June 9, 2020
    Assignee: Facebook Technologies, LLC
    Inventors: Evan Matthew Pezent, Priyanshu Agarwal, Hrvoje Benko, Nicholas Colonnese, Ali Israr, Shea Jonathan Robinson
  • Patent number: 10678335
    Abstract: A method of creating haptic stimulations and anatomical information includes a wearable device including a plurality of transducers that can each generate one or more waves. The method includes activating one or more first transducers of the plurality of transducers based on an instruction received from a remote device. Waves generated by the activated one or more first transducers provide a haptic stimulation. The method further includes activating one or more second transducers of the plurality of transducers. Waves generated by the activated one or more second transducers provide anatomical information of a user of the wearable device when the waves are received by one or more transducers of the plurality of transducers.
    Type: Grant
    Filed: January 7, 2019
    Date of Patent: June 9, 2020
    Assignee: Facebook Technologies, LLC
    Inventors: Sean Jason Keller, Tristan Thomas Trutna, Hrvoje Benko, Raymond King, Yang Lou, Yon Visell, Yitian Shao, Bharat Dandu
  • Publication number: 20200150784
    Abstract: A virtual reality system is described herein. The virtual reality system includes a cane controller and a computing system. The cane controller comprises a rod, a sensor, and a brake mechanism, wherein the sensor is configured to generate a signal that is indicative of position, direction of movement, and velocity of the rod, and wherein the brake mechanism is configured to apply a force to the rod. The computing system receives the signal, computes a position, direction of movement, and velocity of a virtual rod in a virtual space, and outputs a control signal to the brake mechanism based upon such computation. The brake mechanism applies the force to the rod in a direction and with a magnitude indicated in the control signal, thereby preventing the user from causing the virtual rod to penetrate a virtual barrier in the virtual space.
    Type: Application
    Filed: January 20, 2020
    Publication date: May 14, 2020
    Inventors: Edward CUTRELL, Christian HOLZ, Hrvoje BENKO, Michael J. SINCLAIR, Meredith June MORRIS, Yuhang ZHAO, Cynthia Lynn BENNETT
  • Patent number: 10617942
    Abstract: A controller is provided that can provide haptic feedback to a user by controlling a separation of a stationary portion and a moveable portion, such as a moveable arm, which can include one or more mounts for one or more of a user's fingers. A sensor can be included on the stationary portion to sense whether the user's thumb is proximate a thumb rest. Different haptic interaction modes can be set depending on whether the user's thumb is not proximate the sensor, such as a touch mode, or is proximate the sensor, such as a grasping or trigger mode. When grasping and trigger modes are provided, they can be determined based on the nature of a virtual object grasped by a user. Additional haptic sensations can be provided, such as to a user's fingertip, such as by a vibratory component or a rotatable object of one or more haptic elements.
    Type: Grant
    Filed: December 29, 2017
    Date of Patent: April 14, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Christian Holz, Eyal Ofek, Michael Jack Sinclair, Hrvoje Benko, Inrak Choi, Eric Whitmire
  • Patent number: 10551940
    Abstract: A virtual reality system is described herein. The virtual reality system includes a cane controller and a computing system. The cane controller comprises a rod, a sensor, and a brake mechanism, wherein the sensor is configured to generate a signal that is indicative of position, direction of movement, and velocity of the rod, and wherein the brake mechanism is configured to apply a force to the rod. The computing system receives the signal, computes a position, direction of movement, and velocity of a virtual rod in a virtual space, and outputs a control signal to the brake mechanism based upon such computation. The brake mechanism applies the force to the rod in a direction and with a magnitude indicated in the control signal, thereby preventing the user from causing the virtual rod to penetrate a virtual barrier in the virtual space.
    Type: Grant
    Filed: November 22, 2017
    Date of Patent: February 4, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Edward Cutrell, Christian Holz, Hrvoje Benko, Michael J. Sinclair, Meredith June Morris, Yuhang Zhao, Cynthia Lynn Bennett
  • Patent number: 10459559
    Abstract: A method, system, and one or more computer-readable storage media for providing multi-dimensional haptic touch screen interaction are provided herein. The method includes detecting a force applied to a touch screen by an object and determining a magnitude, direction, and location of the force. The method also includes determining a haptic force feedback to be applied by the touch screen on the object based on the magnitude, direction, and location of the force applied to the touch screen, and displacing the touch screen in a specified direction such that the haptic force feedback is applied by the touch screen on the object.
    Type: Grant
    Filed: June 20, 2017
    Date of Patent: October 29, 2019
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Michael J. Sinclair, Michel Pahud, Hrvoje Benko
  • Patent number: 10416769
    Abstract: A computing system including a head mounted display device with a processor and an associated display is provided. A sensor in communication with the processor is configured to detect a movable body part of a user. A plurality of physical haptic feedback structures are configured to be contacted by the movable body part. The processor is configured to operate the display device, receive data from the sensor, and determine an intended virtual target of the movable body part and a target physical structure having haptic characteristics corresponding to the intended virtual target. Also, the processor is configured to compute a path in real three-dimensional space from the movable body part to the target physical structure, compute a spatial warping pattern, and display via the display the virtual space and the virtual reality representation according to the spatial warping pattern.
    Type: Grant
    Filed: February 14, 2017
    Date of Patent: September 17, 2019
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Eyal Ofek, Andrew Wilson, Hrvoje Benko, Christian Holz, Lung-Pan Cheng
  • Patent number: 10409381
    Abstract: Aspects relate to detecting gestures that relate to a desired action, wherein the detected gestures are common across users and/or devices within a surface computing environment. Inferred intentions and goals based on context, history, affordances, and objects are employed to interpret gestures. Where there is uncertainty in intention of the gestures for a single device or across multiple devices, independent or coordinated communication of uncertainty or engagement of users through signaling and/or information gathering can occur.
    Type: Grant
    Filed: August 10, 2015
    Date of Patent: September 10, 2019
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Meredith June Morris, Eric J. Horvitz, Andrew David Wilson, F. David Jones, Stephen E. Hodges, Kenneth P. Hinckley, David Alexander Butler, Ian M. Sands, V. Kevin Russ, Hrvoje Benko, Shawn R. LeProwse, Shahram Izadi, William Ben Kunz
  • Patent number: 10373381
    Abstract: A method, computing device and head-mounted display device for manipulating a virtual object displayed via a display device are disclosed. In one example, image data of a physical environment comprising physical features is received. A three dimensional model of at least a portion of the environment is generated. Candidate anchor features that each correspond to one of the physical features are extracted from the image data. User input is received that manipulates the virtual object as displayed within the environment. Based on the manipulation, a correspondence between a virtual anchor feature of the virtual object and a corresponding candidate anchor feature is identified. An indication of the corresponding candidate anchor feature at its corresponding physical feature within the environment is displayed to the user.
    Type: Grant
    Filed: March 30, 2016
    Date of Patent: August 6, 2019
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Benjamin Nuernberger, Hrvoje Benko, Andrew Wilson, Eyal Ofek
  • Publication number: 20190212821
    Abstract: A method of creating haptic stimulations and anatomical information includes a wearable device including a plurality of transducers that can each generate one or more waves. The method includes activating one or more first transducers of the plurality of transducers based on an instruction received from a remote device. Waves generated by the activated one or more first transducers provide a haptic stimulation. The method further includes activating one or more second transducers of the plurality of transducers. Waves generated by the activated one or more second transducers provide anatomical information of a user of the wearable device when the waves are received by one or more transducers of the plurality of transducers.
    Type: Application
    Filed: January 7, 2019
    Publication date: July 11, 2019
    Inventors: Sean Jason Keller, Tristan Thomas Trutna, Hrvoje Benko, Raymond King, Yang Lou
  • Publication number: 20190212823
    Abstract: An example method of identifying a touch gesture on a user is provided. The method includes receiving, by one or more transducers of a first wearable device attached to a first appendage of the user, a set of signals transmitted by a second wearable device attached to the user, wherein (i) receiving the set of signals creates a signal pathway between the first and second wearable devices, and (ii) signals in the set of signals propagate through at least the user's first appendage. The method also includes determining baseline characteristics for the signal pathway created between the first wearable device and the second wearable device, sensing a change in the baseline characteristics while receiving the set of signals, and in accordance with a determination that the sensed change in the baseline characteristics for the signal pathway satisfies a contact criterion, report a candidate touch event on the user's first appendage.
    Type: Application
    Filed: January 7, 2019
    Publication date: July 11, 2019
    Inventors: Sean Jason Keller, Tristan Thomas Trutna, Hrvoje Benko
  • Publication number: 20190212822
    Abstract: A method of determining contact on a user of a virtual reality and/or augmented reality device includes a first device including a plurality of transducers and a control circuit coupled to the plurality of transducers. The method includes activating one or more of the first plurality of transducers and generating waves that couple into at least a portion of a first appendage of a user wearing the first wearable device. The method further includes at a second wearable device having a second plurality of transducers, receiving at least a portion of the waves generated by the first plurality of transducers when the first appendage of the user is within a threshold distance from the second wearable device.
    Type: Application
    Filed: January 7, 2019
    Publication date: July 11, 2019
    Inventors: Sean Jason Keller, Tristan Thomas Trutna, Hrvoje Benko
  • Publication number: 20190212824
    Abstract: A method of creating localized haptic stimulations on a user includes a wearable device including a plurality of transducers that can each generate one or more waves that propagate away from the wearable device through a medium. The method includes activating two or more transducers of the plurality of transducers, selecting values for characteristics of waves to be generated by the two or more transducers based at least in part on a known impedance of the medium. The method further includes generating, by the two or more transducers, waves that constructively interfere at a target location to create a haptic stimulation on a user of the wearable device, the waves having the selected values.
    Type: Application
    Filed: January 7, 2019
    Publication date: July 11, 2019
    Inventors: Sean Jason Keller, Tristan Thomas Trutna, Hrvoje Benko, Raymond King, Andrew Arthur Stanley, Massimiliano Di Luca
  • Patent number: 10346529
    Abstract: An interaction management module (IMM) is described for allowing users to engage an interactive surface in a collaborative environment using various input devices, such as keyboard-type devices and mouse-type devices. The IMM displays digital objects on the interactive surface that are associated with the devices in various ways. The digital objects can include input display interfaces, cursors, soft-key input mechanisms, and so on. Further, the IMM provides a mechanism for establishing a frame of reference for governing the placement of each cursor on the interactive surface. Further, the IMM provides a mechanism for allowing users to make a digital copy of a physical article placed on the interactive surface. The IMM also provides a mechanism which duplicates actions taken on the digital copy with respect to the physical article, and vice versa.
    Type: Grant
    Filed: May 18, 2016
    Date of Patent: July 9, 2019
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Björn U. Hartmann, Andrew D. Wilson, Hrvoje Benko, Meredith J. Morris
  • Publication number: 20190201784
    Abstract: A controller is provided that can provide haptic feedback to a user by controlling a separation of a stationary portion and a moveable portion, such as a moveable arm, which can include one or more mounts for one or more of a user's fingers. A sensor can be included on the stationary portion to sense whether the user's thumb is proximate a thumb rest. Different haptic interaction modes can be set depending on whether the user's thumb is not proximate the sensor, such as a touch mode, or is proximate the sensor, such as a grasping or trigger mode. When grasping and trigger modes are provided, they can be determined based on the nature of a virtual object grasped by a user. Additional haptic sensations can be provided, such as to a user's fingertip, such as by a vibratory component or a rotatable object of one or more haptic elements.
    Type: Application
    Filed: December 29, 2017
    Publication date: July 4, 2019
    Applicant: Microsoft Technology Licensing, LLC
    Inventors: Christian Holz, Eyal Ofek, Michael Jack Sinclair, Hrvoje Benko, Inrak Choi, Eric Whitmire
  • Publication number: 20190155404
    Abstract: A virtual reality system is described herein. The virtual reality system includes a cane controller and a computing system. The cane controller comprises a rod, a sensor, and a brake mechanism, wherein the sensor is configured to generate a signal that is indicative of position, direction of movement, and velocity of the rod, and wherein the brake mechanism is configured to apply a force to the rod. The computing system receives the signal, computes a position, direction of movement, and velocity of a virtual rod in a virtual space, and outputs a control signal to the brake mechanism based upon such computation. The brake mechanism applies the force to the rod in a direction and with a magnitude indicated in the control signal, thereby preventing the user from causing the virtual rod to penetrate a virtual barrier in the virtual space.
    Type: Application
    Filed: November 22, 2017
    Publication date: May 23, 2019
    Inventors: Edward CUTRELL, Christian HOLZ, Hrvoje BENKO, Michael J. SINCLAIR, Meredith June MORRIS, Yuhang ZHAO, Cynthia Lynn BENNETT
  • Patent number: 10297082
    Abstract: Various technologies pertaining to shared spatial augmented reality (SSAR) are described. Sensor units in a room output sensor signals that are indicative of positions of two or more users in the room and gaze directions of the two or more users. Views of at least one virtual object are computed separately for each of the two or more users, and projectors project such views in the room. The projected views cause the two or more users to simultaneously perceive the virtual object in space.
    Type: Grant
    Filed: April 9, 2015
    Date of Patent: May 21, 2019
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Andrew D. Wilson, Hrvoje Benko
  • Patent number: 10290152
    Abstract: Methods, computing devices and head-mounted display devices for displaying user interface elements with virtual objects are disclosed. In one example, a virtual object and one or more user interface elements are displayed within a physical environment. User input is received that moves one or more of the virtual object and the one or more user interface elements. One or more of the virtual object and the one or more user interface elements are determined to be within a predetermined distance of a physical surface. Based at least on this determination, the one or more user interface elements are displayed on the surface.
    Type: Grant
    Filed: April 3, 2017
    Date of Patent: May 14, 2019
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Julia Schwarz, Bo Robert Xiao, Hrvoje Benko, Andrew Wilson
  • Patent number: 10290153
    Abstract: Dynamic haptic retargeting can be implemented using world warping techniques and body warping techniques. World warping is applied to improve an alignment between a virtual object and a physical object, while body warping is applied to redirect a user's motion to increase a likelihood that a physical hand will reach the physical object at the same time a virtual representation of the hand reaches the virtual object. Threshold values and/or a combination of world warping a body warping can be used to mitigate negative impacts that may be caused by using either technique excessively or independently.
    Type: Grant
    Filed: September 13, 2017
    Date of Patent: May 14, 2019
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Hrvoje Benko, Andrew D. Wilson, Eyal Ofek, Mahdi Azmandian, Mark Hancock
  • Patent number: 10216982
    Abstract: Various systems and methods for projecting a remote object are described herein. In one example, a method includes collecting environment data corresponding to a local environment in which a system is located and detecting a remote object corresponding to a remote user in a remote environment. The method can also include detecting a viewpoint of a local user in the local environment, and projecting the remote object corresponding to the remote user in the local environment based on the viewpoint of the local user, the virtual copy of the remote object to be positioned in the local environment by taking into account geometry of local objects in the local environment.
    Type: Grant
    Filed: March 12, 2015
    Date of Patent: February 26, 2019
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Tomislav Pejsa, Andrew Wilson, Hrvoje Benko, Eyal Ofek, Julian Kantor