Patents by Inventor Hrvoje Benko
Hrvoje Benko has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 10678334Abstract: The disclosed wearable apparatus may include wearable apparatus includes a (1) device dimensioned to fit about a body part of a user, (2) a tensioning mechanism that harnesses to the device in a manner that is relative to the fit of the device about the body part of the user, and (3) an actuator couples to the tensioning mechanism that, when actuated, causes substantially tangential movement of the tensioning mechanism relative to a surface of the body part to produce substantially orthogonal movement of the device relative to the surface of the body part. Various other methods, systems, and/or computer-readable media are also disclosed.Type: GrantFiled: November 30, 2018Date of Patent: June 9, 2020Assignee: Facebook Technologies, LLCInventors: Evan Matthew Pezent, Priyanshu Agarwal, Hrvoje Benko, Nicholas Colonnese, Ali Israr, Shea Jonathan Robinson
-
Patent number: 10678335Abstract: A method of creating haptic stimulations and anatomical information includes a wearable device including a plurality of transducers that can each generate one or more waves. The method includes activating one or more first transducers of the plurality of transducers based on an instruction received from a remote device. Waves generated by the activated one or more first transducers provide a haptic stimulation. The method further includes activating one or more second transducers of the plurality of transducers. Waves generated by the activated one or more second transducers provide anatomical information of a user of the wearable device when the waves are received by one or more transducers of the plurality of transducers.Type: GrantFiled: January 7, 2019Date of Patent: June 9, 2020Assignee: Facebook Technologies, LLCInventors: Sean Jason Keller, Tristan Thomas Trutna, Hrvoje Benko, Raymond King, Yang Lou, Yon Visell, Yitian Shao, Bharat Dandu
-
Publication number: 20200150784Abstract: A virtual reality system is described herein. The virtual reality system includes a cane controller and a computing system. The cane controller comprises a rod, a sensor, and a brake mechanism, wherein the sensor is configured to generate a signal that is indicative of position, direction of movement, and velocity of the rod, and wherein the brake mechanism is configured to apply a force to the rod. The computing system receives the signal, computes a position, direction of movement, and velocity of a virtual rod in a virtual space, and outputs a control signal to the brake mechanism based upon such computation. The brake mechanism applies the force to the rod in a direction and with a magnitude indicated in the control signal, thereby preventing the user from causing the virtual rod to penetrate a virtual barrier in the virtual space.Type: ApplicationFiled: January 20, 2020Publication date: May 14, 2020Inventors: Edward CUTRELL, Christian HOLZ, Hrvoje BENKO, Michael J. SINCLAIR, Meredith June MORRIS, Yuhang ZHAO, Cynthia Lynn BENNETT
-
Patent number: 10617942Abstract: A controller is provided that can provide haptic feedback to a user by controlling a separation of a stationary portion and a moveable portion, such as a moveable arm, which can include one or more mounts for one or more of a user's fingers. A sensor can be included on the stationary portion to sense whether the user's thumb is proximate a thumb rest. Different haptic interaction modes can be set depending on whether the user's thumb is not proximate the sensor, such as a touch mode, or is proximate the sensor, such as a grasping or trigger mode. When grasping and trigger modes are provided, they can be determined based on the nature of a virtual object grasped by a user. Additional haptic sensations can be provided, such as to a user's fingertip, such as by a vibratory component or a rotatable object of one or more haptic elements.Type: GrantFiled: December 29, 2017Date of Patent: April 14, 2020Assignee: Microsoft Technology Licensing, LLCInventors: Christian Holz, Eyal Ofek, Michael Jack Sinclair, Hrvoje Benko, Inrak Choi, Eric Whitmire
-
Patent number: 10551940Abstract: A virtual reality system is described herein. The virtual reality system includes a cane controller and a computing system. The cane controller comprises a rod, a sensor, and a brake mechanism, wherein the sensor is configured to generate a signal that is indicative of position, direction of movement, and velocity of the rod, and wherein the brake mechanism is configured to apply a force to the rod. The computing system receives the signal, computes a position, direction of movement, and velocity of a virtual rod in a virtual space, and outputs a control signal to the brake mechanism based upon such computation. The brake mechanism applies the force to the rod in a direction and with a magnitude indicated in the control signal, thereby preventing the user from causing the virtual rod to penetrate a virtual barrier in the virtual space.Type: GrantFiled: November 22, 2017Date of Patent: February 4, 2020Assignee: Microsoft Technology Licensing, LLCInventors: Edward Cutrell, Christian Holz, Hrvoje Benko, Michael J. Sinclair, Meredith June Morris, Yuhang Zhao, Cynthia Lynn Bennett
-
Patent number: 10459559Abstract: A method, system, and one or more computer-readable storage media for providing multi-dimensional haptic touch screen interaction are provided herein. The method includes detecting a force applied to a touch screen by an object and determining a magnitude, direction, and location of the force. The method also includes determining a haptic force feedback to be applied by the touch screen on the object based on the magnitude, direction, and location of the force applied to the touch screen, and displacing the touch screen in a specified direction such that the haptic force feedback is applied by the touch screen on the object.Type: GrantFiled: June 20, 2017Date of Patent: October 29, 2019Assignee: Microsoft Technology Licensing, LLCInventors: Michael J. Sinclair, Michel Pahud, Hrvoje Benko
-
Patent number: 10416769Abstract: A computing system including a head mounted display device with a processor and an associated display is provided. A sensor in communication with the processor is configured to detect a movable body part of a user. A plurality of physical haptic feedback structures are configured to be contacted by the movable body part. The processor is configured to operate the display device, receive data from the sensor, and determine an intended virtual target of the movable body part and a target physical structure having haptic characteristics corresponding to the intended virtual target. Also, the processor is configured to compute a path in real three-dimensional space from the movable body part to the target physical structure, compute a spatial warping pattern, and display via the display the virtual space and the virtual reality representation according to the spatial warping pattern.Type: GrantFiled: February 14, 2017Date of Patent: September 17, 2019Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Eyal Ofek, Andrew Wilson, Hrvoje Benko, Christian Holz, Lung-Pan Cheng
-
Patent number: 10409381Abstract: Aspects relate to detecting gestures that relate to a desired action, wherein the detected gestures are common across users and/or devices within a surface computing environment. Inferred intentions and goals based on context, history, affordances, and objects are employed to interpret gestures. Where there is uncertainty in intention of the gestures for a single device or across multiple devices, independent or coordinated communication of uncertainty or engagement of users through signaling and/or information gathering can occur.Type: GrantFiled: August 10, 2015Date of Patent: September 10, 2019Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Meredith June Morris, Eric J. Horvitz, Andrew David Wilson, F. David Jones, Stephen E. Hodges, Kenneth P. Hinckley, David Alexander Butler, Ian M. Sands, V. Kevin Russ, Hrvoje Benko, Shawn R. LeProwse, Shahram Izadi, William Ben Kunz
-
Patent number: 10373381Abstract: A method, computing device and head-mounted display device for manipulating a virtual object displayed via a display device are disclosed. In one example, image data of a physical environment comprising physical features is received. A three dimensional model of at least a portion of the environment is generated. Candidate anchor features that each correspond to one of the physical features are extracted from the image data. User input is received that manipulates the virtual object as displayed within the environment. Based on the manipulation, a correspondence between a virtual anchor feature of the virtual object and a corresponding candidate anchor feature is identified. An indication of the corresponding candidate anchor feature at its corresponding physical feature within the environment is displayed to the user.Type: GrantFiled: March 30, 2016Date of Patent: August 6, 2019Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Benjamin Nuernberger, Hrvoje Benko, Andrew Wilson, Eyal Ofek
-
Publication number: 20190212821Abstract: A method of creating haptic stimulations and anatomical information includes a wearable device including a plurality of transducers that can each generate one or more waves. The method includes activating one or more first transducers of the plurality of transducers based on an instruction received from a remote device. Waves generated by the activated one or more first transducers provide a haptic stimulation. The method further includes activating one or more second transducers of the plurality of transducers. Waves generated by the activated one or more second transducers provide anatomical information of a user of the wearable device when the waves are received by one or more transducers of the plurality of transducers.Type: ApplicationFiled: January 7, 2019Publication date: July 11, 2019Inventors: Sean Jason Keller, Tristan Thomas Trutna, Hrvoje Benko, Raymond King, Yang Lou
-
METHODS, DEVICES, AND SYSTEMS FOR DISPLAYING A USER INTERFACE ON A USER AND DETECTING TOUCH GESTURES
Publication number: 20190212823Abstract: An example method of identifying a touch gesture on a user is provided. The method includes receiving, by one or more transducers of a first wearable device attached to a first appendage of the user, a set of signals transmitted by a second wearable device attached to the user, wherein (i) receiving the set of signals creates a signal pathway between the first and second wearable devices, and (ii) signals in the set of signals propagate through at least the user's first appendage. The method also includes determining baseline characteristics for the signal pathway created between the first wearable device and the second wearable device, sensing a change in the baseline characteristics while receiving the set of signals, and in accordance with a determination that the sensed change in the baseline characteristics for the signal pathway satisfies a contact criterion, report a candidate touch event on the user's first appendage.Type: ApplicationFiled: January 7, 2019Publication date: July 11, 2019Inventors: Sean Jason Keller, Tristan Thomas Trutna, Hrvoje Benko -
Publication number: 20190212822Abstract: A method of determining contact on a user of a virtual reality and/or augmented reality device includes a first device including a plurality of transducers and a control circuit coupled to the plurality of transducers. The method includes activating one or more of the first plurality of transducers and generating waves that couple into at least a portion of a first appendage of a user wearing the first wearable device. The method further includes at a second wearable device having a second plurality of transducers, receiving at least a portion of the waves generated by the first plurality of transducers when the first appendage of the user is within a threshold distance from the second wearable device.Type: ApplicationFiled: January 7, 2019Publication date: July 11, 2019Inventors: Sean Jason Keller, Tristan Thomas Trutna, Hrvoje Benko
-
Publication number: 20190212824Abstract: A method of creating localized haptic stimulations on a user includes a wearable device including a plurality of transducers that can each generate one or more waves that propagate away from the wearable device through a medium. The method includes activating two or more transducers of the plurality of transducers, selecting values for characteristics of waves to be generated by the two or more transducers based at least in part on a known impedance of the medium. The method further includes generating, by the two or more transducers, waves that constructively interfere at a target location to create a haptic stimulation on a user of the wearable device, the waves having the selected values.Type: ApplicationFiled: January 7, 2019Publication date: July 11, 2019Inventors: Sean Jason Keller, Tristan Thomas Trutna, Hrvoje Benko, Raymond King, Andrew Arthur Stanley, Massimiliano Di Luca
-
Patent number: 10346529Abstract: An interaction management module (IMM) is described for allowing users to engage an interactive surface in a collaborative environment using various input devices, such as keyboard-type devices and mouse-type devices. The IMM displays digital objects on the interactive surface that are associated with the devices in various ways. The digital objects can include input display interfaces, cursors, soft-key input mechanisms, and so on. Further, the IMM provides a mechanism for establishing a frame of reference for governing the placement of each cursor on the interactive surface. Further, the IMM provides a mechanism for allowing users to make a digital copy of a physical article placed on the interactive surface. The IMM also provides a mechanism which duplicates actions taken on the digital copy with respect to the physical article, and vice versa.Type: GrantFiled: May 18, 2016Date of Patent: July 9, 2019Assignee: Microsoft Technology Licensing, LLCInventors: Björn U. Hartmann, Andrew D. Wilson, Hrvoje Benko, Meredith J. Morris
-
Publication number: 20190201784Abstract: A controller is provided that can provide haptic feedback to a user by controlling a separation of a stationary portion and a moveable portion, such as a moveable arm, which can include one or more mounts for one or more of a user's fingers. A sensor can be included on the stationary portion to sense whether the user's thumb is proximate a thumb rest. Different haptic interaction modes can be set depending on whether the user's thumb is not proximate the sensor, such as a touch mode, or is proximate the sensor, such as a grasping or trigger mode. When grasping and trigger modes are provided, they can be determined based on the nature of a virtual object grasped by a user. Additional haptic sensations can be provided, such as to a user's fingertip, such as by a vibratory component or a rotatable object of one or more haptic elements.Type: ApplicationFiled: December 29, 2017Publication date: July 4, 2019Applicant: Microsoft Technology Licensing, LLCInventors: Christian Holz, Eyal Ofek, Michael Jack Sinclair, Hrvoje Benko, Inrak Choi, Eric Whitmire
-
Publication number: 20190155404Abstract: A virtual reality system is described herein. The virtual reality system includes a cane controller and a computing system. The cane controller comprises a rod, a sensor, and a brake mechanism, wherein the sensor is configured to generate a signal that is indicative of position, direction of movement, and velocity of the rod, and wherein the brake mechanism is configured to apply a force to the rod. The computing system receives the signal, computes a position, direction of movement, and velocity of a virtual rod in a virtual space, and outputs a control signal to the brake mechanism based upon such computation. The brake mechanism applies the force to the rod in a direction and with a magnitude indicated in the control signal, thereby preventing the user from causing the virtual rod to penetrate a virtual barrier in the virtual space.Type: ApplicationFiled: November 22, 2017Publication date: May 23, 2019Inventors: Edward CUTRELL, Christian HOLZ, Hrvoje BENKO, Michael J. SINCLAIR, Meredith June MORRIS, Yuhang ZHAO, Cynthia Lynn BENNETT
-
Patent number: 10297082Abstract: Various technologies pertaining to shared spatial augmented reality (SSAR) are described. Sensor units in a room output sensor signals that are indicative of positions of two or more users in the room and gaze directions of the two or more users. Views of at least one virtual object are computed separately for each of the two or more users, and projectors project such views in the room. The projected views cause the two or more users to simultaneously perceive the virtual object in space.Type: GrantFiled: April 9, 2015Date of Patent: May 21, 2019Assignee: Microsoft Technology Licensing, LLCInventors: Andrew D. Wilson, Hrvoje Benko
-
Patent number: 10290152Abstract: Methods, computing devices and head-mounted display devices for displaying user interface elements with virtual objects are disclosed. In one example, a virtual object and one or more user interface elements are displayed within a physical environment. User input is received that moves one or more of the virtual object and the one or more user interface elements. One or more of the virtual object and the one or more user interface elements are determined to be within a predetermined distance of a physical surface. Based at least on this determination, the one or more user interface elements are displayed on the surface.Type: GrantFiled: April 3, 2017Date of Patent: May 14, 2019Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Julia Schwarz, Bo Robert Xiao, Hrvoje Benko, Andrew Wilson
-
Patent number: 10290153Abstract: Dynamic haptic retargeting can be implemented using world warping techniques and body warping techniques. World warping is applied to improve an alignment between a virtual object and a physical object, while body warping is applied to redirect a user's motion to increase a likelihood that a physical hand will reach the physical object at the same time a virtual representation of the hand reaches the virtual object. Threshold values and/or a combination of world warping a body warping can be used to mitigate negative impacts that may be caused by using either technique excessively or independently.Type: GrantFiled: September 13, 2017Date of Patent: May 14, 2019Assignee: Microsoft Technology Licensing, LLCInventors: Hrvoje Benko, Andrew D. Wilson, Eyal Ofek, Mahdi Azmandian, Mark Hancock
-
Patent number: 10216982Abstract: Various systems and methods for projecting a remote object are described herein. In one example, a method includes collecting environment data corresponding to a local environment in which a system is located and detecting a remote object corresponding to a remote user in a remote environment. The method can also include detecting a viewpoint of a local user in the local environment, and projecting the remote object corresponding to the remote user in the local environment based on the viewpoint of the local user, the virtual copy of the remote object to be positioned in the local environment by taking into account geometry of local objects in the local environment.Type: GrantFiled: March 12, 2015Date of Patent: February 26, 2019Assignee: Microsoft Technology Licensing, LLCInventors: Tomislav Pejsa, Andrew Wilson, Hrvoje Benko, Eyal Ofek, Julian Kantor