Patents by Inventor Hrvoje Benko
Hrvoje Benko has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11941174Abstract: The disclosed system may include a support structure dimensioned for a user's hand. The system may also include transmitting electrodes coupled to a first finger portion of the support structure and may further include receiving electrodes coupled to a second, different finger portion of the support structure. The system may also include a controller that is coupled to the support structure and that is communicatively connected to the transmitting and receiving electrodes. The controller may also be configured to cause the transmitting electrodes to transmit a signal, detect at least some of the transmitted signal at the receiving electrodes and, based on the detected signal, determine that at least two fingers of the user's hand are touching each other. Various other methods, systems, and computer-readable media are also disclosed.Type: GrantFiled: January 23, 2023Date of Patent: March 26, 2024Assignee: Meta Platforms Technologies, LLCInventors: Shiu Sang Ng, Yanjun Ma, Wolf Kienzle, Hrvoje Benko
-
Patent number: 11789544Abstract: The disclosed computer-implemented method may include (1) receiving information associated with a real-time output of a recognition model adapted to recognize at least one behavior of a user, (2) determining, based on the information, a level of uncertainty associated with the real-time output, (3) modulating at least one attribute of feedback based on the level of uncertainty, and (4) presenting the feedback to the user substantially contemporaneous with the real-time output of the recognition model. Various other methods, systems, and computer-readable media are also disclosed.Type: GrantFiled: January 14, 2022Date of Patent: October 17, 2023Assignee: Meta Platforms Technologies, LLCInventors: Ting Zhang, Aakar Gupta, Marcello Giordano, Tanya Renee Jonker, Hrvoje Benko
-
Patent number: 11720175Abstract: The disclosed system may include (1) a processor that generates an artificial environment that includes a virtual object, (2) a display that presents the artificial environment, (3) an input subsystem that detects tracks positioning of a body, and (4) a plurality of haptic actuators that are arranged to apply haptic feedback to a first plurality of locations on the body, where the processor (a) determines, based on the positioning of the body, a virtual contact of one of a second plurality of locations on the body with the virtual object, where the second plurality of locations is different from the first plurality of locations, and (b) activates, in response to the virtual contact, at least one of the plurality of haptic actuators based on a mapping of the second plurality of locations to the plurality of haptic actuators. Various other systems and methods are also disclosed.Type: GrantFiled: September 9, 2021Date of Patent: August 8, 2023Assignee: Meta Platforms Technologies, LLCInventors: Aakar Gupta, Majed Jamal Samad, Hrvoje Benko
-
Patent number: 11656693Abstract: An electronic device tracks, for a user performing a target acquisition movement within a 3D space, movement parameters of a plurality of input devices of the user. The electronic device predicts, for the user, a region of interest within the 3D space, based on the movement parameters. The region of interest includes a plurality of targets in close proximity. The electronic device predicts an endpoint of the target acquisition movement, within the region of interest. In some embodiments, the plurality of input devices includes an eye tracking input device, each input device corresponds to a predefined input device type, and the movement parameters include gaze data from the eye tracking input device. In some embodiments, input devices includes an eye tracking input device, a head-mounted display, and a hand-held controller, and the user's eye, hand, and head movements are coordinated.Type: GrantFiled: January 5, 2022Date of Patent: May 23, 2023Assignee: META PLATFORMS TECHNOLOGIES, LLCInventors: Rorik Henrikson, Tovi Samuel Grossman, Sean Edwin Trowbridge, Hrvoje Benko, Daniel John Wigdor, Marcello Giordano, Michael Glueck, Tanya Renee Jonker, Aakar Gupta, Stephanie Santosa, Carolina Brum Medeiros, Daniel Clarke
-
Patent number: 11630520Abstract: A system for vibration-driven sensing may include a wearable dimensioned to be donned by a user of an artificial reality system. The system may also include a vibration sensor that is incorporated into the wearable and generates an electrical response that corresponds to a vibration detected at the wearable. The system may further include at least one processing device communicatively coupled to the vibration sensor. The processing device may determine, based at least in part on the electrical response generated by the vibration sensor, that the user has made a specific gesture with at least one body part. In response to this determination, the processing device may generate an input command for the artificial reality system based at least in part on the specific gesture made by the user. Various other systems and methods are also disclosed.Type: GrantFiled: October 27, 2021Date of Patent: April 18, 2023Assignee: Meta Platforms Technologies, LLCInventors: Hrvoje Benko, Wolf Kienzle, Neil Weiss, Yu-Te Wang, Yanjun Ma, David R Perek
-
Patent number: 11599193Abstract: The disclosed system may include a support structure dimensioned for a user's hand. The system may also include transmitting electrodes coupled to a first finger portion of the support structure and may further include receiving electrodes coupled to a second, different finger portion of the support structure. The system may also include a controller that is coupled to the support structure and that is communicatively connected to the transmitting and receiving electrodes. The controller may also be configured to cause the transmitting electrodes to transmit a signal, detect at least some of the transmitted signal at the receiving electrodes and, based on the detected signal, determine that at least two fingers of the user's hand are touching each other. Various other methods, systems, and computer-readable media are also disclosed.Type: GrantFiled: June 25, 2021Date of Patent: March 7, 2023Assignee: META PLATFORMS TECHNOLOGIES, LLCInventors: Shiu Sang Ng, Yanjun Ma, Wolf Kienzle, Hrvoje Benko
-
Publication number: 20230069764Abstract: A disclosed computer-implemented method may include (1) tracking a gaze of a user as the user interacts with a user interface, (2) determining, based on tracking of the gaze of the user, that a detected user interaction with the user interface represents a false positive input inference by the user interface, and (3) executing at least one remedial action based on determining that the detected user interaction represents the false positive input inference by the user interface. Various other methods, systems, and computer-readable media are also disclosed.Type: ApplicationFiled: July 15, 2022Publication date: March 2, 2023Inventors: Tanya Renee Jonker, Candace Peacock, Benjamin Lafreniere, Ting Zhang, Hrvoje Benko, Rawan Alghofaili, Michael Glueck
-
Publication number: 20230056020Abstract: The disclosed computer-implemented method may include (1) receiving information associated with a real-time output of a recognition model adapted to recognize at least one behavior of a user, (2) determining, based on the information, a level of uncertainty associated with the real-time output, (3) modulating at least one attribute of feedback based on the level of uncertainty, and (4) presenting the feedback to the user substantially contemporaneous with the real-time output of the recognition model. Various other methods, systems, and computer-readable media are also disclosed.Type: ApplicationFiled: January 14, 2022Publication date: February 23, 2023Inventors: Ting Zhang, Aakar Gupta, Marcello Giordano, Tanya Renee Jonker, Hrvoje Benko
-
Patent number: 11579704Abstract: The disclosed computer-implemented method may include detecting, by a computing system, a gesture that appears to be intended to trigger a response by the computing system, identifying, by the computing system, a context in which the gesture was performed, and adjusting, based at least on the context in which the gesture was performed, a threshold for determining whether to trigger the response to the gesture in a manner that causes the computing system to perform an action that is based on the detected gesture.Type: GrantFiled: March 24, 2021Date of Patent: February 14, 2023Assignee: Meta Platforms Technologies, LLCInventors: Benjamin Lafreniere, Tanya Renee Jonker, Stephanie Santosa, Hrvoje Benko, Daniel John Wigdor
-
Patent number: 11531389Abstract: A system may include a wearable dimensioned to be donned by a user of an artificial reality system. The system may also include an energy measuring device incorporated into the wearable. The energy measuring device may measure an electrical energy differential between a body of the user and a surface. The system may further include at least one processing device communicatively coupled to the energy measuring device. The processing device may detect, based at least in part on the electrical energy differential measured by the energy measuring device, an interaction between the user and the surface. In response to this detection, the processing device may generate an input command for the artificial reality system based at least in part on the interaction detected between the user and the surface. Various other systems and methods are also disclosed.Type: GrantFiled: January 29, 2021Date of Patent: December 20, 2022Assignee: Meta Platforms Technologies, LLCInventors: Eric Whitmire, Wolf Kienzle, David R Perek, Hrvoje Benko
-
Patent number: 11488361Abstract: The disclosed wearable may include (1) a plurality of electrodes dimensioned to interface with a skin surface of a user of an artificial reality system, wherein the electrodes are spaced a known distance from one another, (2) a signal generator communicatively coupled to one of the electrodes, wherein the signal generator injects a test signal into the skin surface of the user via the one of the electrodes, (3) at least one sensor communicatively coupled to another one of the electrodes, wherein the sensor measures the test signal as received by the another one of the electrodes, and (4) at least one processing device communicatively coupled to the sensor, wherein the processing device determines a current impedance of the skin surface based at least in part on the known distance and the measurement of the test signal. Various other systems and methods are also disclosed.Type: GrantFiled: July 30, 2019Date of Patent: November 1, 2022Assignee: Meta Platforms Technologies, LLCInventors: Shiu Sang Ng, Yanjun Ma, Wolf Kienzle, Hrvoje Benko
-
Methods, devices, and systems for displaying a user interface on a user and detecting touch gestures
Patent number: 11467670Abstract: An example method of identifying a touch gesture on a user is provided. The method includes receiving, by one or more transducers of a wearable device, a set of signals that establish a signal pathway to the wearable device. The method also includes, while receiving the set of signals, determining baseline characteristics for the signal pathway, and sensing a change in the baseline characteristics caused by user interaction with an affordance of a user interface projected or perceived on the user's appendage. The method further includes, in accordance with a determination that the sensed change in the baseline characteristics satisfies a contact criterion, reporting a candidate touch event on the user's appendage to a separate electronic device that creates the user interface or is in communication with another electronic device that creates the user interface.Type: GrantFiled: June 22, 2021Date of Patent: October 11, 2022Assignee: META PLATFORMS TECHNOLOGIES, LLCInventors: Sean Jason Keller, Tristan Thomas Trutna, Hrvoje Benko -
Publication number: 20220308675Abstract: The disclosed computer-implemented method may include detecting, by a computing system, a gesture that appears to be intended to trigger a response by the computing system, identifying, by the computing system, a context in which the gesture was performed, and adjusting, based at least on the context in which the gesture was performed, a threshold for determining whether to trigger the response to the gesture in a manner that causes the computing system to perform an action that is based on the detected gesture.Type: ApplicationFiled: March 24, 2021Publication date: September 29, 2022Inventors: Benjamin Lafreniere, Tanya Renee Jonker, Stephanie Santosa, Hrvoje Benko, Daniel John Wigdor
-
Publication number: 20220293241Abstract: The disclosed computer-implemented method may include (1) acquiring, via one or more biosensors, one or more biosignals generated by a user of a computing system, (2) using the one or more biosignals to anticipate a transition to or from a cognitive state of the user, and (3) providing a signal indicating the transition to or from the cognitive state of the user to an intelligent-facilitation subsystem adapted to perform one or more assistive actions to reduce the user's cognitive load. Various other methods, systems, and computer-readable media are also disclosed.Type: ApplicationFiled: February 10, 2022Publication date: September 15, 2022Inventors: Tanya Renee Jonker, Candace Peacock, Ting Zhang, Brendan Matthew David-John, Matthew Jordan Boring, Thomas Scott Murdison, Yan Xu, Hrvoje Benko
-
Patent number: 11422628Abstract: A method creates haptic stimulations on a user of an artificial reality system. The system includes a head-mounted display (HMD) and a wearable device. The HMD includes a display and speakers. The wearable device includes a plurality of transducers that can each generate waves to provide haptic feedback to a user. The system displays media content on the display and, in accordance with the displayed media content, determines a virtual object location in the displayed media content corresponding to a physical object location. The system provides, to the user, audio directed to the virtual object location. The system activates one or more transducers to provide haptic feedback at a target location on the user, distinct from the physical object location, to produce haptic feedback whose perceptual interpretation is at the physical object location based on a combination of the displayed media, the provided audio, and the haptic feedback.Type: GrantFiled: April 23, 2020Date of Patent: August 23, 2022Assignees: META PLATFORMS TECHNOLOGIES, LLC, THE REGENTS OF THE UNIVERSITY OF CALIFORNIAInventors: Sean Jason Keller, Tristan Thomas Trutna, Hrvoje Benko, Raymond King, Andrew Arthur Stanley, Massimiliano Di Luca, Yon Visell, Yitian Shao, Bharat Dandu
-
Patent number: 11416075Abstract: A wearable device equipped with sensors or transducers capable of detecting a vibration propagating through two different mediums. In some embodiments, the two mediums are air and a surface contacted by a user. In such an embodiment, the sensors or transducers include a microphone and an accelerometer. In some embodiments, the device may perform some or all of the signal processing and/or logic used to determine that a contact occurred and the location of the contact using a processor programmed with a set of computer-executable instructions. In some embodiments, the device may transmit data or signals to a processor located in a different device, such as a mobile phone or artificial reality headset, for signal processing and/or the execution of logic.Type: GrantFiled: March 25, 2020Date of Patent: August 16, 2022Assignee: Facebook Technologies, LLCInventors: Jun Gong, Aakar Gupta, Hrvoje Benko
-
Publication number: 20220236795Abstract: The disclosed computer-implemented method may include (1) acquiring, via a biosensor, biosignals generated by a user (e.g., biosignals indicative of gaze dynamics), (2) using the biosignals to anticipate an intent of the user to interact with a computing system (e.g., an extended-reality system), and (3) providing an intent-to-interact signal indicating the user's intent to interact to an intelligent-facilitation subsystem. The disclosed computing systems may include (1) a targeting subsystem that enables a user to explicitly target, for interaction, one or more objects, (2) an interaction subsystem that enables the user to interact with, when targeted, one or more of the objects, and (3) an intelligent-facilitation subsystem that targets one or more of the objects on behalf of the user in response to intent-to-interact signals. Various other methods, systems, and computer-readable media are also disclosed.Type: ApplicationFiled: January 11, 2022Publication date: July 28, 2022Inventors: Tanya Renee Jonker, Brendan Matthew David-John, Ting Zhang, Thomas Scott Murdison, Candace Peacock, Hrvoje Benko
-
Patent number: 11379054Abstract: A virtual reality system is described herein. The virtual reality system includes a cane controller and a computing system. The cane controller comprises a rod, a sensor, and a brake mechanism, wherein the sensor is configured to generate a signal that is indicative of position, direction of movement, and velocity of the rod, and wherein the brake mechanism is configured to apply a force to the rod. The computing system receives the signal, computes a position, direction of movement, and velocity of a virtual rod in a virtual space, and outputs a control signal to the brake mechanism based upon such computation. The brake mechanism applies the force to the rod in a direction and with a magnitude indicated in the control signal, thereby preventing the user from causing the virtual rod to penetrate a virtual barrier in the virtual space.Type: GrantFiled: January 20, 2020Date of Patent: July 5, 2022Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Edward Cutrell, Christian Holz, Hrvoje Benko, Michael J. Sinclair, Meredith June Morris, Yuhang Zhao, Cynthia Lynn Bennett
-
Patent number: 11366522Abstract: The disclosed wearable apparatus may include (1) a device dimensioned to fit about a body part of a user, (2) a tensioning mechanism that harnesses to the device in a manner that is relative to the fit of the device about the body part of the user, and (3) an actuator couples to the tensioning mechanism that, when actuated, causes substantially tangential movement of the tensioning mechanism relative to a surface of the body part to produce substantially orthogonal movement of the device relative to the surface of the body part. Various other methods, systems, and/or computer-readable media are also disclosed.Type: GrantFiled: May 12, 2020Date of Patent: June 21, 2022Assignee: Facebook Technologies, LLCInventors: Evan Matthew Pezent, Priyanshu Agarwal, Hrvoje Benko, Nicholas Colonnese, Ali Israr, Shea Jonathan Robinson
-
Patent number: 11366527Abstract: A system for vibration-driven sensing may include a wearable dimensioned to be donned by a user of an artificial reality system. The system may also include a vibration sensor that is incorporated into the wearable and generates an electrical response that corresponds to a vibration detected at the wearable. The system may further include at least one processing device communicatively coupled to the vibration sensor. The processing device may determine, based at least in part on the electrical response generated by the vibration sensor, that the user has made a specific gesture with at least one body part. In response to this determination, the processing device may generate an input command for the artificial reality system based at least in part on the specific gesture made by the user. Various other systems and methods are also disclosed.Type: GrantFiled: July 20, 2020Date of Patent: June 21, 2022Assignee: Facebook Technologies, LLCInventors: Hrvoje Benko, Wolf Kienzle, Neil Weiss, Yu-Te Wang, Yanjun Ma, David R. Perek