Patents by Inventor Hrvoje Benko

Hrvoje Benko has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11941174
    Abstract: The disclosed system may include a support structure dimensioned for a user's hand. The system may also include transmitting electrodes coupled to a first finger portion of the support structure and may further include receiving electrodes coupled to a second, different finger portion of the support structure. The system may also include a controller that is coupled to the support structure and that is communicatively connected to the transmitting and receiving electrodes. The controller may also be configured to cause the transmitting electrodes to transmit a signal, detect at least some of the transmitted signal at the receiving electrodes and, based on the detected signal, determine that at least two fingers of the user's hand are touching each other. Various other methods, systems, and computer-readable media are also disclosed.
    Type: Grant
    Filed: January 23, 2023
    Date of Patent: March 26, 2024
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Shiu Sang Ng, Yanjun Ma, Wolf Kienzle, Hrvoje Benko
  • Patent number: 11789544
    Abstract: The disclosed computer-implemented method may include (1) receiving information associated with a real-time output of a recognition model adapted to recognize at least one behavior of a user, (2) determining, based on the information, a level of uncertainty associated with the real-time output, (3) modulating at least one attribute of feedback based on the level of uncertainty, and (4) presenting the feedback to the user substantially contemporaneous with the real-time output of the recognition model. Various other methods, systems, and computer-readable media are also disclosed.
    Type: Grant
    Filed: January 14, 2022
    Date of Patent: October 17, 2023
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Ting Zhang, Aakar Gupta, Marcello Giordano, Tanya Renee Jonker, Hrvoje Benko
  • Patent number: 11720175
    Abstract: The disclosed system may include (1) a processor that generates an artificial environment that includes a virtual object, (2) a display that presents the artificial environment, (3) an input subsystem that detects tracks positioning of a body, and (4) a plurality of haptic actuators that are arranged to apply haptic feedback to a first plurality of locations on the body, where the processor (a) determines, based on the positioning of the body, a virtual contact of one of a second plurality of locations on the body with the virtual object, where the second plurality of locations is different from the first plurality of locations, and (b) activates, in response to the virtual contact, at least one of the plurality of haptic actuators based on a mapping of the second plurality of locations to the plurality of haptic actuators. Various other systems and methods are also disclosed.
    Type: Grant
    Filed: September 9, 2021
    Date of Patent: August 8, 2023
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Aakar Gupta, Majed Jamal Samad, Hrvoje Benko
  • Patent number: 11656693
    Abstract: An electronic device tracks, for a user performing a target acquisition movement within a 3D space, movement parameters of a plurality of input devices of the user. The electronic device predicts, for the user, a region of interest within the 3D space, based on the movement parameters. The region of interest includes a plurality of targets in close proximity. The electronic device predicts an endpoint of the target acquisition movement, within the region of interest. In some embodiments, the plurality of input devices includes an eye tracking input device, each input device corresponds to a predefined input device type, and the movement parameters include gaze data from the eye tracking input device. In some embodiments, input devices includes an eye tracking input device, a head-mounted display, and a hand-held controller, and the user's eye, hand, and head movements are coordinated.
    Type: Grant
    Filed: January 5, 2022
    Date of Patent: May 23, 2023
    Assignee: META PLATFORMS TECHNOLOGIES, LLC
    Inventors: Rorik Henrikson, Tovi Samuel Grossman, Sean Edwin Trowbridge, Hrvoje Benko, Daniel John Wigdor, Marcello Giordano, Michael Glueck, Tanya Renee Jonker, Aakar Gupta, Stephanie Santosa, Carolina Brum Medeiros, Daniel Clarke
  • Patent number: 11630520
    Abstract: A system for vibration-driven sensing may include a wearable dimensioned to be donned by a user of an artificial reality system. The system may also include a vibration sensor that is incorporated into the wearable and generates an electrical response that corresponds to a vibration detected at the wearable. The system may further include at least one processing device communicatively coupled to the vibration sensor. The processing device may determine, based at least in part on the electrical response generated by the vibration sensor, that the user has made a specific gesture with at least one body part. In response to this determination, the processing device may generate an input command for the artificial reality system based at least in part on the specific gesture made by the user. Various other systems and methods are also disclosed.
    Type: Grant
    Filed: October 27, 2021
    Date of Patent: April 18, 2023
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Hrvoje Benko, Wolf Kienzle, Neil Weiss, Yu-Te Wang, Yanjun Ma, David R Perek
  • Patent number: 11599193
    Abstract: The disclosed system may include a support structure dimensioned for a user's hand. The system may also include transmitting electrodes coupled to a first finger portion of the support structure and may further include receiving electrodes coupled to a second, different finger portion of the support structure. The system may also include a controller that is coupled to the support structure and that is communicatively connected to the transmitting and receiving electrodes. The controller may also be configured to cause the transmitting electrodes to transmit a signal, detect at least some of the transmitted signal at the receiving electrodes and, based on the detected signal, determine that at least two fingers of the user's hand are touching each other. Various other methods, systems, and computer-readable media are also disclosed.
    Type: Grant
    Filed: June 25, 2021
    Date of Patent: March 7, 2023
    Assignee: META PLATFORMS TECHNOLOGIES, LLC
    Inventors: Shiu Sang Ng, Yanjun Ma, Wolf Kienzle, Hrvoje Benko
  • Publication number: 20230069764
    Abstract: A disclosed computer-implemented method may include (1) tracking a gaze of a user as the user interacts with a user interface, (2) determining, based on tracking of the gaze of the user, that a detected user interaction with the user interface represents a false positive input inference by the user interface, and (3) executing at least one remedial action based on determining that the detected user interaction represents the false positive input inference by the user interface. Various other methods, systems, and computer-readable media are also disclosed.
    Type: Application
    Filed: July 15, 2022
    Publication date: March 2, 2023
    Inventors: Tanya Renee Jonker, Candace Peacock, Benjamin Lafreniere, Ting Zhang, Hrvoje Benko, Rawan Alghofaili, Michael Glueck
  • Publication number: 20230056020
    Abstract: The disclosed computer-implemented method may include (1) receiving information associated with a real-time output of a recognition model adapted to recognize at least one behavior of a user, (2) determining, based on the information, a level of uncertainty associated with the real-time output, (3) modulating at least one attribute of feedback based on the level of uncertainty, and (4) presenting the feedback to the user substantially contemporaneous with the real-time output of the recognition model. Various other methods, systems, and computer-readable media are also disclosed.
    Type: Application
    Filed: January 14, 2022
    Publication date: February 23, 2023
    Inventors: Ting Zhang, Aakar Gupta, Marcello Giordano, Tanya Renee Jonker, Hrvoje Benko
  • Patent number: 11579704
    Abstract: The disclosed computer-implemented method may include detecting, by a computing system, a gesture that appears to be intended to trigger a response by the computing system, identifying, by the computing system, a context in which the gesture was performed, and adjusting, based at least on the context in which the gesture was performed, a threshold for determining whether to trigger the response to the gesture in a manner that causes the computing system to perform an action that is based on the detected gesture.
    Type: Grant
    Filed: March 24, 2021
    Date of Patent: February 14, 2023
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Benjamin Lafreniere, Tanya Renee Jonker, Stephanie Santosa, Hrvoje Benko, Daniel John Wigdor
  • Patent number: 11531389
    Abstract: A system may include a wearable dimensioned to be donned by a user of an artificial reality system. The system may also include an energy measuring device incorporated into the wearable. The energy measuring device may measure an electrical energy differential between a body of the user and a surface. The system may further include at least one processing device communicatively coupled to the energy measuring device. The processing device may detect, based at least in part on the electrical energy differential measured by the energy measuring device, an interaction between the user and the surface. In response to this detection, the processing device may generate an input command for the artificial reality system based at least in part on the interaction detected between the user and the surface. Various other systems and methods are also disclosed.
    Type: Grant
    Filed: January 29, 2021
    Date of Patent: December 20, 2022
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Eric Whitmire, Wolf Kienzle, David R Perek, Hrvoje Benko
  • Patent number: 11488361
    Abstract: The disclosed wearable may include (1) a plurality of electrodes dimensioned to interface with a skin surface of a user of an artificial reality system, wherein the electrodes are spaced a known distance from one another, (2) a signal generator communicatively coupled to one of the electrodes, wherein the signal generator injects a test signal into the skin surface of the user via the one of the electrodes, (3) at least one sensor communicatively coupled to another one of the electrodes, wherein the sensor measures the test signal as received by the another one of the electrodes, and (4) at least one processing device communicatively coupled to the sensor, wherein the processing device determines a current impedance of the skin surface based at least in part on the known distance and the measurement of the test signal. Various other systems and methods are also disclosed.
    Type: Grant
    Filed: July 30, 2019
    Date of Patent: November 1, 2022
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Shiu Sang Ng, Yanjun Ma, Wolf Kienzle, Hrvoje Benko
  • Patent number: 11467670
    Abstract: An example method of identifying a touch gesture on a user is provided. The method includes receiving, by one or more transducers of a wearable device, a set of signals that establish a signal pathway to the wearable device. The method also includes, while receiving the set of signals, determining baseline characteristics for the signal pathway, and sensing a change in the baseline characteristics caused by user interaction with an affordance of a user interface projected or perceived on the user's appendage. The method further includes, in accordance with a determination that the sensed change in the baseline characteristics satisfies a contact criterion, reporting a candidate touch event on the user's appendage to a separate electronic device that creates the user interface or is in communication with another electronic device that creates the user interface.
    Type: Grant
    Filed: June 22, 2021
    Date of Patent: October 11, 2022
    Assignee: META PLATFORMS TECHNOLOGIES, LLC
    Inventors: Sean Jason Keller, Tristan Thomas Trutna, Hrvoje Benko
  • Publication number: 20220308675
    Abstract: The disclosed computer-implemented method may include detecting, by a computing system, a gesture that appears to be intended to trigger a response by the computing system, identifying, by the computing system, a context in which the gesture was performed, and adjusting, based at least on the context in which the gesture was performed, a threshold for determining whether to trigger the response to the gesture in a manner that causes the computing system to perform an action that is based on the detected gesture.
    Type: Application
    Filed: March 24, 2021
    Publication date: September 29, 2022
    Inventors: Benjamin Lafreniere, Tanya Renee Jonker, Stephanie Santosa, Hrvoje Benko, Daniel John Wigdor
  • Publication number: 20220293241
    Abstract: The disclosed computer-implemented method may include (1) acquiring, via one or more biosensors, one or more biosignals generated by a user of a computing system, (2) using the one or more biosignals to anticipate a transition to or from a cognitive state of the user, and (3) providing a signal indicating the transition to or from the cognitive state of the user to an intelligent-facilitation subsystem adapted to perform one or more assistive actions to reduce the user's cognitive load. Various other methods, systems, and computer-readable media are also disclosed.
    Type: Application
    Filed: February 10, 2022
    Publication date: September 15, 2022
    Inventors: Tanya Renee Jonker, Candace Peacock, Ting Zhang, Brendan Matthew David-John, Matthew Jordan Boring, Thomas Scott Murdison, Yan Xu, Hrvoje Benko
  • Patent number: 11422628
    Abstract: A method creates haptic stimulations on a user of an artificial reality system. The system includes a head-mounted display (HMD) and a wearable device. The HMD includes a display and speakers. The wearable device includes a plurality of transducers that can each generate waves to provide haptic feedback to a user. The system displays media content on the display and, in accordance with the displayed media content, determines a virtual object location in the displayed media content corresponding to a physical object location. The system provides, to the user, audio directed to the virtual object location. The system activates one or more transducers to provide haptic feedback at a target location on the user, distinct from the physical object location, to produce haptic feedback whose perceptual interpretation is at the physical object location based on a combination of the displayed media, the provided audio, and the haptic feedback.
    Type: Grant
    Filed: April 23, 2020
    Date of Patent: August 23, 2022
    Assignees: META PLATFORMS TECHNOLOGIES, LLC, THE REGENTS OF THE UNIVERSITY OF CALIFORNIA
    Inventors: Sean Jason Keller, Tristan Thomas Trutna, Hrvoje Benko, Raymond King, Andrew Arthur Stanley, Massimiliano Di Luca, Yon Visell, Yitian Shao, Bharat Dandu
  • Patent number: 11416075
    Abstract: A wearable device equipped with sensors or transducers capable of detecting a vibration propagating through two different mediums. In some embodiments, the two mediums are air and a surface contacted by a user. In such an embodiment, the sensors or transducers include a microphone and an accelerometer. In some embodiments, the device may perform some or all of the signal processing and/or logic used to determine that a contact occurred and the location of the contact using a processor programmed with a set of computer-executable instructions. In some embodiments, the device may transmit data or signals to a processor located in a different device, such as a mobile phone or artificial reality headset, for signal processing and/or the execution of logic.
    Type: Grant
    Filed: March 25, 2020
    Date of Patent: August 16, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Jun Gong, Aakar Gupta, Hrvoje Benko
  • Publication number: 20220236795
    Abstract: The disclosed computer-implemented method may include (1) acquiring, via a biosensor, biosignals generated by a user (e.g., biosignals indicative of gaze dynamics), (2) using the biosignals to anticipate an intent of the user to interact with a computing system (e.g., an extended-reality system), and (3) providing an intent-to-interact signal indicating the user's intent to interact to an intelligent-facilitation subsystem. The disclosed computing systems may include (1) a targeting subsystem that enables a user to explicitly target, for interaction, one or more objects, (2) an interaction subsystem that enables the user to interact with, when targeted, one or more of the objects, and (3) an intelligent-facilitation subsystem that targets one or more of the objects on behalf of the user in response to intent-to-interact signals. Various other methods, systems, and computer-readable media are also disclosed.
    Type: Application
    Filed: January 11, 2022
    Publication date: July 28, 2022
    Inventors: Tanya Renee Jonker, Brendan Matthew David-John, Ting Zhang, Thomas Scott Murdison, Candace Peacock, Hrvoje Benko
  • Patent number: 11379054
    Abstract: A virtual reality system is described herein. The virtual reality system includes a cane controller and a computing system. The cane controller comprises a rod, a sensor, and a brake mechanism, wherein the sensor is configured to generate a signal that is indicative of position, direction of movement, and velocity of the rod, and wherein the brake mechanism is configured to apply a force to the rod. The computing system receives the signal, computes a position, direction of movement, and velocity of a virtual rod in a virtual space, and outputs a control signal to the brake mechanism based upon such computation. The brake mechanism applies the force to the rod in a direction and with a magnitude indicated in the control signal, thereby preventing the user from causing the virtual rod to penetrate a virtual barrier in the virtual space.
    Type: Grant
    Filed: January 20, 2020
    Date of Patent: July 5, 2022
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Edward Cutrell, Christian Holz, Hrvoje Benko, Michael J. Sinclair, Meredith June Morris, Yuhang Zhao, Cynthia Lynn Bennett
  • Patent number: 11366522
    Abstract: The disclosed wearable apparatus may include (1) a device dimensioned to fit about a body part of a user, (2) a tensioning mechanism that harnesses to the device in a manner that is relative to the fit of the device about the body part of the user, and (3) an actuator couples to the tensioning mechanism that, when actuated, causes substantially tangential movement of the tensioning mechanism relative to a surface of the body part to produce substantially orthogonal movement of the device relative to the surface of the body part. Various other methods, systems, and/or computer-readable media are also disclosed.
    Type: Grant
    Filed: May 12, 2020
    Date of Patent: June 21, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Evan Matthew Pezent, Priyanshu Agarwal, Hrvoje Benko, Nicholas Colonnese, Ali Israr, Shea Jonathan Robinson
  • Patent number: 11366527
    Abstract: A system for vibration-driven sensing may include a wearable dimensioned to be donned by a user of an artificial reality system. The system may also include a vibration sensor that is incorporated into the wearable and generates an electrical response that corresponds to a vibration detected at the wearable. The system may further include at least one processing device communicatively coupled to the vibration sensor. The processing device may determine, based at least in part on the electrical response generated by the vibration sensor, that the user has made a specific gesture with at least one body part. In response to this determination, the processing device may generate an input command for the artificial reality system based at least in part on the specific gesture made by the user. Various other systems and methods are also disclosed.
    Type: Grant
    Filed: July 20, 2020
    Date of Patent: June 21, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Hrvoje Benko, Wolf Kienzle, Neil Weiss, Yu-Te Wang, Yanjun Ma, David R. Perek