Patents by Inventor Hrvoje Benko

Hrvoje Benko has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20190155404
    Abstract: A virtual reality system is described herein. The virtual reality system includes a cane controller and a computing system. The cane controller comprises a rod, a sensor, and a brake mechanism, wherein the sensor is configured to generate a signal that is indicative of position, direction of movement, and velocity of the rod, and wherein the brake mechanism is configured to apply a force to the rod. The computing system receives the signal, computes a position, direction of movement, and velocity of a virtual rod in a virtual space, and outputs a control signal to the brake mechanism based upon such computation. The brake mechanism applies the force to the rod in a direction and with a magnitude indicated in the control signal, thereby preventing the user from causing the virtual rod to penetrate a virtual barrier in the virtual space.
    Type: Application
    Filed: November 22, 2017
    Publication date: May 23, 2019
    Inventors: Edward CUTRELL, Christian HOLZ, Hrvoje BENKO, Michael J. SINCLAIR, Meredith June MORRIS, Yuhang ZHAO, Cynthia Lynn BENNETT
  • Patent number: 10297082
    Abstract: Various technologies pertaining to shared spatial augmented reality (SSAR) are described. Sensor units in a room output sensor signals that are indicative of positions of two or more users in the room and gaze directions of the two or more users. Views of at least one virtual object are computed separately for each of the two or more users, and projectors project such views in the room. The projected views cause the two or more users to simultaneously perceive the virtual object in space.
    Type: Grant
    Filed: April 9, 2015
    Date of Patent: May 21, 2019
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Andrew D. Wilson, Hrvoje Benko
  • Patent number: 10290152
    Abstract: Methods, computing devices and head-mounted display devices for displaying user interface elements with virtual objects are disclosed. In one example, a virtual object and one or more user interface elements are displayed within a physical environment. User input is received that moves one or more of the virtual object and the one or more user interface elements. One or more of the virtual object and the one or more user interface elements are determined to be within a predetermined distance of a physical surface. Based at least on this determination, the one or more user interface elements are displayed on the surface.
    Type: Grant
    Filed: April 3, 2017
    Date of Patent: May 14, 2019
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Julia Schwarz, Bo Robert Xiao, Hrvoje Benko, Andrew Wilson
  • Patent number: 10290153
    Abstract: Dynamic haptic retargeting can be implemented using world warping techniques and body warping techniques. World warping is applied to improve an alignment between a virtual object and a physical object, while body warping is applied to redirect a user's motion to increase a likelihood that a physical hand will reach the physical object at the same time a virtual representation of the hand reaches the virtual object. Threshold values and/or a combination of world warping a body warping can be used to mitigate negative impacts that may be caused by using either technique excessively or independently.
    Type: Grant
    Filed: September 13, 2017
    Date of Patent: May 14, 2019
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Hrvoje Benko, Andrew D. Wilson, Eyal Ofek, Mahdi Azmandian, Mark Hancock
  • Patent number: 10216982
    Abstract: Various systems and methods for projecting a remote object are described herein. In one example, a method includes collecting environment data corresponding to a local environment in which a system is located and detecting a remote object corresponding to a remote user in a remote environment. The method can also include detecting a viewpoint of a local user in the local environment, and projecting the remote object corresponding to the remote user in the local environment based on the viewpoint of the local user, the virtual copy of the remote object to be positioned in the local environment by taking into account geometry of local objects in the local environment.
    Type: Grant
    Filed: March 12, 2015
    Date of Patent: February 26, 2019
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Tomislav Pejsa, Andrew Wilson, Hrvoje Benko, Eyal Ofek, Julian Kantor
  • Patent number: 10203836
    Abstract: A unique system and method is provided that facilitates pixel-accurate targeting with respect to multi-touch sensitive displays when selecting or viewing content with a cursor. In particular, the system and method can track dual inputs from a primary finger and a secondary finger, for example. The primary finger can control movement of the cursor while the secondary finger can adjust a control-display ratio of the screen. As a result, cursor steering and selection of an assistance mode can be performed at about the same time or concurrently. In addition, the system and method can stabilize a cursor position at a top middle point of a user's finger in order to mitigate clicking errors when making a selection.
    Type: Grant
    Filed: November 20, 2017
    Date of Patent: February 12, 2019
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Hrvoje Benko, Andrew D. Wilson, Patrick M. Baudisch
  • Patent number: 10181193
    Abstract: Various methods and systems for reducing the effects of latency in a camera-projection system are described herein. A method includes recording, via a camera, a plurality of frames of one or more moving objects, wherein at least one of the moving objects is a target object to have an image projected thereupon. The method can include analyzing the recorded frames of the one or more moving objects to determine a predicted path of the target object. Additionally, the method can include projecting, via a projection device, an image onto the target object using the predicted path of the target object to compensate for a predetermined system latency. The method can include recording a plurality of frames of the target object and the image. The method can include adjusting the predicted path of the target object until an offset between the target object and the image is below a predetermined threshold.
    Type: Grant
    Filed: March 10, 2014
    Date of Patent: January 15, 2019
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Jarrod Knibbe, Hrvoje Benko, Andrew Wilson
  • Patent number: 10175487
    Abstract: Various technologies described herein pertain to a head mounted display device having a display with a central portion and a periphery portion. Graphical content can be displayed on the central portion of the display. The central portion can be a primary display that provides a field of view and displays the graphical content, and the periphery portion can be a peripheral display. The peripheral display can be positioned relative to the primary display such that an overall field of view provided by the primary display and the peripheral display is extended compared to the field of view of the primary display. Further, complementary content can be rendered based on the graphical content and caused to be displayed on the periphery portion (e.g., the peripheral display). The complementary content can include a countervection visualization viewable in a far periphery region of a field of view of human vision.
    Type: Grant
    Filed: March 29, 2016
    Date of Patent: January 8, 2019
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Hrvoje Benko, Bo Robert Xiao
  • Patent number: 10168827
    Abstract: Pen and computing device sensor correlation technique embodiments correlate sensor signals received from various grips on a touch-sensitive pen and touches to a touch-sensitive computing device in order to determine the context of such grips and touches and to issue context-appropriate commands to the touch sensitive pen or the touch-sensitive computing device. A combination of concurrent sensor inputs received from both a touch-sensitive pen and a touch-sensitive computing device are correlated. How the touch-sensitive pen and the touch-sensitive computing device are touched or gripped are used to determine the context of their use and the user's intent. A context-appropriate user interface action based can then be initiated. Also the context can be used to label metadata.
    Type: Grant
    Filed: July 1, 2017
    Date of Patent: January 1, 2019
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Ken Hinckley, Hrvoje Benko, Michel Pahud, Andrew D. Wilson, Pourang Polad Irani, Francois Guimbretiere
  • Publication number: 20180330533
    Abstract: Methods, systems, and computer-readable media providing focal feedback and control in a three-dimensional display. Focal anchors are provided at different depths and used to determine at what depth the user is currently focusing. The focal anchors are also used to receive input from the user. By looking at a focal anchor, the use can cause the portion of content associated with the focal anchor to be displayed more prominently relative to content displayed at different depths. In one embodiment, predictive feedback is provided at a depth associated with one of the focal anchors.
    Type: Application
    Filed: July 2, 2018
    Publication date: November 15, 2018
    Inventors: Hrvoje BENKO, Daniel Chaim ROBBINS
  • Publication number: 20180286126
    Abstract: Methods, computing devices and head-mounted display devices for displaying user interface elements with virtual objects are disclosed. In one example, a virtual object and one or more user interface elements are displayed within a physical environment. User input is received that moves one or more of the virtual object and the one or more user interface elements. One or more of the virtual object and the one or more user interface elements are determined to be within a predetermined distance of a physical surface. Based at least on this determination, the one or more user interface elements are displayed on the surface.
    Type: Application
    Filed: April 3, 2017
    Publication date: October 4, 2018
    Applicant: Microsoft Technology Licensing, LLC
    Inventors: Julia Schwarz, Bo Robert Xiao, Hrvoje Benko, Andrew Wilson
  • Publication number: 20180232050
    Abstract: A computing system including a head mounted display device with a processor and an associated display is provided. A sensor in communication with the processor is configured to detect a movable body part of a user. A plurality of physical haptic feedback structures are configured to be contacted by the movable body part. The processor is configured to operate the display device, receive data from the sensor, and determine an intended virtual target of the movable body part and a target physical structure having haptic characteristics corresponding to the intended virtual target. Also, the processor is configured to compute a path in real three-dimensional space from the movable body part to the target physical structure, compute a spatial warping pattern, and display via the display the virtual space and the virtual reality representation according to the spatial warping pattern.
    Type: Application
    Filed: February 14, 2017
    Publication date: August 16, 2018
    Applicant: Microsoft Technology Licensing, LLC
    Inventors: Eyal Ofek, Andrew Wilson, Hrvoje Benko, Christian Holz, Lung-Pan Cheng
  • Patent number: 10044982
    Abstract: A tele-immersive environment is described that provides interaction among participants of a tele-immersive session. The environment includes two or more set-ups, each associated with a participant. Each set-up, in turn, includes mirror functionality for presenting a three-dimensional virtual space for viewing by a local participant. The virtual space shows at least some of the participants as if the participants were physically present at a same location and looking into a mirror. The mirror functionality can be implemented as a combination of a semi-transparent mirror and a display device, or just a display device acting alone. According to another feature, the environment may present a virtual object in a manner that allows any of the participants of the tele-immersive session to interact with the virtual object.
    Type: Grant
    Filed: March 28, 2017
    Date of Patent: August 7, 2018
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Andrew D. Wilson, Zhengyou Zhang, Philip A. Chou, Neil S. Fishman, Donald M. Gillett, Hrvoje Benko
  • Patent number: 10013793
    Abstract: Methods, systems, and computer-readable media providing focal feedback and control in a three-dimensional display. Focal anchors are provided at different depths and used to determine at what depth the user is currently focusing. The focal anchors are also used to receive input from the user. By looking at a focal anchor, the use can cause the portion of content associated with the focal anchor to be displayed more prominently relative to content displayed at different depths. In one embodiment, predictive feedback is provided at a depth associated with one of the focal anchors.
    Type: Grant
    Filed: January 4, 2018
    Date of Patent: July 3, 2018
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Hrvoje Benko, Daniel Chaim Robbins
  • Patent number: 10013143
    Abstract: A technology is described for interfacing with a computing application using a multi-digit sensor. A method may include obtaining an initial stroke using a single digit of a user on the multi-digit sensor. A direction change point for the initial stroke can be identified. At the direction change point for the initial stroke, a number of additional digits can be presented by the user to the multi-digit sensor. Then a completion stroke can be identified as being made with the number of additional digits. A user interface signal to can be sent to the computing application based on the number of additional digits used in the completion touch stroke. In another configuration of the technology, the touch stroke or gesture may include a single stroke where user interface items can be selected when additional digits are presented at the end of a gesture.
    Type: Grant
    Filed: July 24, 2014
    Date of Patent: July 3, 2018
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Hrvoje Benko, Daniel Wigdor
  • Publication number: 20180173300
    Abstract: Disclosed are an apparatus and a method of detecting a user interaction with a virtual object. In some embodiments, a depth sensing device of an NED device receives a plurality of depth values. The depth values correspond to depths of points in a real-world environment relative to the depth sensing device. The NED device overlays an image of a 3D virtual object on a view of the real-world environment, and identifies an interaction limit in proximity to the 3D virtual object. Based on depth values of points that are within the interaction limit, the NED device detects a body part or a user device of a user interacting with the 3D virtual object.
    Type: Application
    Filed: December 19, 2016
    Publication date: June 21, 2018
    Inventors: Julia Schwarz, Hrvoje Benko, Andrew D. Wilson, Robert Charles Johnstone Pengelly, Bo Robert Xiao
  • Publication number: 20180130250
    Abstract: Methods, systems, and computer-readable media providing focal feedback and control in a three-dimensional display. Focal anchors are provided at different depths and used to determine at what depth the user is currently focusing. The focal anchors are also used to receive input from the user. By looking at a focal anchor, the use can cause the portion of content associated with the focal anchor to be displayed more prominently relative to content displayed at different depths. In one embodiment, predictive feedback is provided at a depth associated with one of the focal anchors.
    Type: Application
    Filed: January 4, 2018
    Publication date: May 10, 2018
    Inventors: HRVOJE BENKO, DANIEL CHAIM ROBBINS
  • Patent number: 9939888
    Abstract: A system is described herein which receives internal-assessed (IA) movement information from a mobile device. The system also receives external-assessed (EA) movement information from at least one monitoring system which captures a scene containing the mobile device. The system then compares the IA movement information with the EA movement information with respect to each candidate object in the scene. If the IA movement information matches the EA movement information for a particular candidate object, the system concludes that the candidate object is associated with the mobile device. For example, the object may correspond to a hand that holds the mobile device. The system can use the correlation results produced in the above-indicated manner to perform various environment-specific actions.
    Type: Grant
    Filed: September 15, 2011
    Date of Patent: April 10, 2018
    Assignee: Microsoft Technology Licensing LLC
    Inventors: Andrew D. Wilson, Hrvoje Benko
  • Publication number: 20180074678
    Abstract: A unique system and method is provided that facilitates pixel-accurate targeting with respect to multi-touch sensitive displays when selecting or viewing content with a cursor. In particular, the system and method can track dual inputs from a primary finger and a secondary finger, for example. The primary finger can control movement of the cursor while the secondary finger can adjust a control-display ratio of the screen. As a result, cursor steering and selection of an assistance mode can be performed at about the same time or concurrently. In addition, the system and method can stabilize a cursor position at a top middle point of a user's finger in order to mitigate clicking errors when making a selection.
    Type: Application
    Filed: November 20, 2017
    Publication date: March 15, 2018
    Inventors: Hrvoje Benko, Andrew D. Wilson, Patrick M. Baudisch
  • Patent number: 9916003
    Abstract: A controller device for a virtual environment includes a handle and a contact device having a substantially planar surface. A position of the contact device relative to the handle is adjustable. An actuator module is arranged to adjust the position of the contact device relative to the handle. A control module in communication with the virtual environment selectively controls the actuator module to adjust the position of the contact device in response to data received from the virtual environment. The data includes an indication of an interaction between a user and an object represented within the virtual environment.
    Type: Grant
    Filed: September 2, 2016
    Date of Patent: March 13, 2018
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Michael Jack Sinclair, Eyal Ofek, Hrvoje Benko, Christian Holz