Patents by Inventor Ivan RAZUMENIC
Ivan RAZUMENIC has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20230316552Abstract: The techniques described herein disclose a system that is configured to detect and track the three-dimensional pose of an object (e.g., a head-mounted display device) in a color image using an accessible three-dimensional model of the object. The system uses the three-dimensional pose of the object to repair pixel depth values associated with a region (e.g., a surface) of the object that is composed of material that absorbs light emitted by a time-of-flight depth sensor to determine depth. Consequently, a color-depth image (e.g., a Red-Green-Blue-Depth image or RGB-D image) can be produced that does not include dark holes on and around the region of the object that is composed of material that absorbs light emitted by the time-of-flight depth sensor.Type: ApplicationFiled: April 4, 2022Publication date: October 5, 2023Inventors: JingJing SHEN, Erroll William WOOD, Toby SHARP, Ivan RAZUMENIC, Tadas BALTRUSAITIS, Julien Pascal Christophe VALENTIN, Predrag JOVANOVIC
-
Patent number: 11314321Abstract: One disclosed example provides a head-mounted device configured to control a plurality of light sources of a handheld object and acquire image data comprising a sequence of environmental tracking exposures in which the plurality of light sources are controlled to have a lower integrated intensity and handheld object tracking exposures in which the plurality of light sources are controlled to have a higher integrated intensity. The instructions are further executable to detect, via an environmental tracking exposure, one or more features of the surrounding environment, determine a pose of the head-mounted device based upon the one or more features of the surrounding environment detected, detect via a handheld object tracking exposure the plurality of light sources of the handheld object, determine a pose of the handheld object relative to the head-mounted device based upon the plurality of light sources detected, and output the pose of the handheld object.Type: GrantFiled: July 7, 2020Date of Patent: April 26, 2022Assignee: Microsoft Technology Licensing, LLCInventors: Drew Steedly, Michael Edward Samples, Alexandru Octavian Balan, William Douglas Guyman, Vuk Jovanovic, Taras Khapko, Ivan Razumenic, Vladimir Carapic, Martin Thomas Shetter, Jelena Mojasevic, Andrew C. Goris, Marko Bezulj
-
Publication number: 20200394289Abstract: A method for biometric verification includes obtaining a verification image and extracting a set of verification image features from the verification image. The method also includes processing the set of verification image features and a set of enrollment image features using a convolutional neural network to determine a metric. A determination may then be made about whether the verification image matches an enrollment image based on the metric.Type: ApplicationFiled: September 26, 2019Publication date: December 17, 2020Inventors: Ivan RAZUMENIC, Radim SPETLĂK
-
Publication number: 20200333878Abstract: One disclosed example provides a head-mounted device configured to control a plurality of light sources of a handheld object and acquire image data comprising a sequence of environmental tracking exposures in which the plurality of light sources are controlled to have a lower integrated intensity and handheld object tracking exposures in which the plurality of light sources are controlled to have a higher integrated intensity. The instructions are further executable to detect, via an environmental tracking exposure, one or more features of the surrounding environment, determine a pose of the head-mounted device based upon the one or more features of the surrounding environment detected, detect via a handheld object tracking exposure the plurality of light sources of the handheld object, determine a pose of the handheld object relative to the head-mounted device based upon the plurality of light sources detected, and output the pose of the handheld object.Type: ApplicationFiled: July 7, 2020Publication date: October 22, 2020Applicant: Microsoft Technology Licensing, LLCInventors: Drew STEEDLY, Michael Edward SAMPLES, Alexandru Octavian BALAN, William Douglas GUYMAN, Vuk JOVANOVIC, Taras KHAPKO, Ivan RAZUMENIC, Vladimir CARAPIC, Martin Thomas SHETTER, Jelena MOJASEVIC, Andrew C. GORIS, Marko BEZULJ
-
Patent number: 10740924Abstract: Examples are disclosed that relate to tracking a pose of a handheld object used with a head-mounted display device. In one example, a method comprises: receiving image data from an image sensing system; detecting a plurality of feature points of the handheld object in a frame of the image data; receiving inertial measurement unit (IMU) data from an IMU of the handheld object; based on detecting the plurality of feature points and receiving the IMU data, determining a first pose of the handheld object; determining that at least a portion of the plurality of feature points is not detected in another frame of the image data; using the IMU data, updating the first pose of the handheld object to a second pose; and body-locking the second pose of the handheld object to a body location on a user wearing the head-mounted display device.Type: GrantFiled: April 16, 2018Date of Patent: August 11, 2020Assignee: Microsoft Technology Licensing, LLCInventors: Alexandru Octavian Balan, Yogeshwar Narayanan Nagaraj, Constantin Dulu, William Guyman, Ivan Razumenic
-
Patent number: 10719125Abstract: One disclosed example provides a head-mounted device configured to control a plurality of light sources of a handheld object and acquire image data comprising a sequence of environmental tracking exposures in which the plurality of light sources are controlled to have a lower integrated intensity and handheld object tracking exposures in which the plurality of light sources are controlled to have a higher integrated intensity. The instructions are further executable to detect, via an environmental tracking exposure, one or more features of the surrounding environment, determine a pose of the head-mounted device based upon the one or more features of the surrounding environment detected, detect via a handheld object tracking exposure the plurality of light sources of the handheld object, determine a pose of the handheld object relative to the head-mounted device based upon the plurality of light sources detected, and output the pose of the handheld object.Type: GrantFiled: November 29, 2017Date of Patent: July 21, 2020Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Drew Steedly, Michael Edward Samples, Alexandru Octavian Balan, William Douglas Guyman, Vuk Jovanovic, Taras Khapko, Ivan Razumenic, Vladimir Carapic, Martin Thomas Shetter, Jelena Mojasevic, Andrew C. Goris, Marko Bezulj
-
Patent number: 10679376Abstract: Examples are disclosed herein that relate to determining a pose of a handheld object. One example provides a computing system configured to determine a pose of a handheld object comprising a plurality of light sources by acquiring image data of a surrounding environment, detecting a subset of light sources of the plurality of light sources of the handheld object in the image data, and performing a search, without using previous pose data, to determine the pose of the handheld object relative to the computing system. The computing system is further configured to use the pose determined to perform a later search for an updated pose of the handheld object, and if the later search fails to find the updated pose, determine the updated pose by again performing the search without using previous pose data.Type: GrantFiled: April 24, 2018Date of Patent: June 9, 2020Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Alexandru Octavian Balan, Ronald Boskovic, Filip Panjevic, Ivan Razumenic, Vuk Jovanovic
-
Patent number: 10628711Abstract: One disclosed example provides a method for determining a pose of a handheld object in a surrounding environment. Optical pose data is stored in an image queue of a first filter. IMU data is received from an IMU of the handheld object and stored in an IMU queue of the first filter. Using at least a portion of the optical pose data and the IMU data, an initial pose of the handheld object is determined and outputted. The method determines that either the image queue or the IMU queue is empty. A second filter comprising the one empty queue and the other non-empty queue is instantiated as a copy of the first filter. Using the data from the non-empty queue in the second filter, the initial pose of the handheld object is updated to an updated pose, and the updated pose is outputted.Type: GrantFiled: April 24, 2018Date of Patent: April 21, 2020Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Alexandru Octavian Balan, Ruven Jaime Rivera, III, Michael Edward Samples, Ivan Razumenic
-
Patent number: 10496157Abstract: Examples are disclosed herein related to tracking poses of a head-mounted display device that interfaces with handheld peripheral objects. One disclosed example provides a handheld object configured for providing user input to a head-mounted device, the handheld object including a body, a plurality of visible light sources arranged on the body in an arrangement trackable by a vision system of the head-mounted device, and a controller configured to control a brightness of one or more visible light sources of the plurality of visible light sources.Type: GrantFiled: November 29, 2017Date of Patent: December 3, 2019Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Drew Steedly, Alexandru Octavian Balan, Taras Khapko, Ivan Razumenic, Steven James Velat, Vladimir Carapic
-
Publication number: 20190325274Abstract: One disclosed example provides a method for determining a pose of a handheld object in a surrounding environment. Optical pose data is stored in an image queue of a first filter. IMU data is received from an IMU of the handheld object and stored in an IMU queue of the first filter. Using at least a portion of the optical pose data and the IMU data, an initial pose of the handheld object is determined and outputted. The method determines that either the image queue or the IMU queue is empty. A second filter comprising the one empty queue and the other non-empty queue is instantiated as a copy of the first filter. Using the data from the non-empty queue in the second filter, the initial pose of the handheld object is updated to an updated pose, and the updated pose is outputted.Type: ApplicationFiled: April 24, 2018Publication date: October 24, 2019Applicant: Microsoft Technology Licensing, LLCInventors: Alexandru Octavian BALAN, Ruven Jaime RIVERA, III, Michael Edward SAMPLES, Ivan RAZUMENIC
-
Publication number: 20190325600Abstract: Examples are disclosed herein that relate to determining a pose of a handheld object. One example provides a computing system configured to determine a pose of a handheld object comprising a plurality of light sources by acquiring image data of a surrounding environment, detecting a subset of light sources of the plurality of light sources of the handheld object in the image data, and performing a search, without using previous pose data, to determine the pose of the handheld object relative to the computing system. The computing system is further configured to use the pose determined to perform a later search for an updated pose of the handheld object, and if the later search fails to find the updated pose, determine the updated pose by again performing the search without using previous pose data.Type: ApplicationFiled: April 24, 2018Publication date: October 24, 2019Applicant: Microsoft Technology Licensing, LLCInventors: Alexandru Octavian BALAN, Ronald BOSKOVIC, Filip PANJEVIC, Ivan RAZUMENIC, Vuk JOVANOVIC
-
Publication number: 20190318501Abstract: Examples are disclosed that relate to tracking a pose of a handheld object used with a head-mounted display device. In one example, a method comprises: receiving image data from an image sensing system; detecting a plurality of feature points of the handheld object in a frame of the image data; receiving inertial measurement unit (IMU) data from an IMU of the handheld object; based on detecting the plurality of feature points and receiving the IMU data, determining a first pose of the handheld object; determining that at least a portion of the plurality of feature points is not detected in another frame of the image data; using the IMU data, updating the first pose of the handheld object to a second pose; and body-locking the second pose of the handheld object to a body location on a user wearing the head-mounted display device.Type: ApplicationFiled: April 16, 2018Publication date: October 17, 2019Applicant: Microsoft Technology Licensing, LLCInventors: Alexandru Octavian BALAN, Yogeshwar Narayanan NAGARAJ, Constantin DULU, William GUYMAN, Ivan RAZUMENIC
-
Publication number: 20180329484Abstract: One disclosed example provides a head-mounted device configured to control a plurality of light sources of a handheld object and acquire image data comprising a sequence of environmental tracking exposures in which the plurality of light sources are controlled to have a lower integrated intensity and handheld object tracking exposures in which the plurality of light sources are controlled to have a higher integrated intensity. The instructions are further executable to detect, via an environmental tracking exposure, one or more features of the surrounding environment, determine a pose of the head-mounted device based upon the one or more features of the surrounding environment detected, detect via a handheld object tracking exposure the plurality of light sources of the handheld object, determine a pose of the handheld object relative to the head-mounted device based upon the plurality of light sources detected, and output the pose of the handheld object.Type: ApplicationFiled: November 29, 2017Publication date: November 15, 2018Applicant: Microsoft Technology Licensing, LLCInventors: Drew STEEDLY, Michael Edward SAMPLES, Alexandru Octavian BALAN, William Douglas GUYMAN, Vuk JOVANOVIC, Taras KHAPKO, Ivan RAZUMENIC, Vladimir CARAPIC, Martin Thomas SHETTER, Jelena MOJASEVIC, Andrew C. GORIS, Marko BEZULJ
-
Publication number: 20180329517Abstract: Examples are disclosed herein related to tracking poses of a head-mounted display device that interfaces with handheld peripheral objects. One disclosed example provides a handheld object configured for providing user input to a head-mounted device, the handheld object including a body, a plurality of visible light sources arranged on the body in an arrangement trackable by a vision system of the head-mounted device, and a controller configured to control a brightness of one or more visible light sources of the plurality of visible light sources.Type: ApplicationFiled: November 29, 2017Publication date: November 15, 2018Applicant: Microsoft Technology Licensing, LLCInventors: Drew STEEDLY, Alexandru Octavian BALAN, Taras KHAPKO, Ivan RAZUMENIC, Steven James VELAT, Vladimir CARAPIC