Patents by Inventor Andreas Girgensohn
Andreas Girgensohn has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11410540Abstract: A computer-implemented method is provided, comprising, based on information of a subject positioned on an object in an environment, generating a data stream; for the data stream, extracting features associated with a movement of the subject with respect to the object or the environment, wherein the movement is represented by spatio-temporal features extracted from sensors; generating a prediction associated with a likelihood of the movement based on the extracted features, and a risk profile of the movement based on a plurality of fall risk factors; and applying the prediction and the risk profile to a rule base to perform an action.Type: GrantFiled: November 27, 2019Date of Patent: August 9, 2022Assignee: FUJI XEROX CO., LTD.Inventors: Yanxia Zhang, Andreas Girgensohn, Qiong Liu, Yulius Tjahjadi
-
Patent number: 11343532Abstract: A computer-implemented method, comprising, extracting a video sequence, the video sequence including a series of video frames, estimating current poses of one or more subjects within each video frame and determining joint locations for a joint associated with the one or more subjects within each video frame, computing optical flows from the video sequence, extracting motion features from the video sequence based on the optical flows, and predicting at least one future pose.Type: GrantFiled: January 29, 2021Date of Patent: May 24, 2022Assignee: FUJIFILM Business Innovation Corp.Inventors: Yanjun Zhu, Yanxia Zhang, Qiong Liu, Andreas Girgensohn, Daniel Avrahami, Francine Chen, Hao Hu
-
Patent number: 11227406Abstract: A computer-implemented method, comprising applying training images of an environment divided into zones to a neural network, and performing classification to label a test image based on a closest zone of the zones; extracting a feature from retrieved training images and pose information of the test image that match the closest zone; performing bundle adjustment on the extracted feature by triangulating map points for the closest zone to generate a reprojection error, and minimizing the reprojection error to determine an optimal pose of the test image; and for the optimal pose, providing an output indicative of a location or probability of a location of the test image at the optimal pose within the environment.Type: GrantFiled: February 28, 2020Date of Patent: January 18, 2022Assignee: FUJIFILM Business Innovation Corp.Inventors: Miteshkumar Patel, Jingwei Song, Andreas Girgensohn, Chelhwon Kim
-
Patent number: 11199411Abstract: A computer-implemented method performed in a computerized system incorporating a central processing unit, a localization signal receiver, a plurality of sensors, separate and distinct from the localization signal receiver, and a memory, the computer-implemented method involving: using the central processing unit to initialize a plurality of particles based on an information on a map graph; using the central processing unit to repeatedly execute a particle filter loop, wherein the particle filter loop includes: using the central processing unit to perform a motion update of the plurality of particles; using the central processing unit to perform a measurement update of the plurality of particles; and using the central processing unit to perform a resampling of the plurality of particles based on particle importance weights and the map graph information. The location of the computerized system is subsequently determined based on the plurality of particles.Type: GrantFiled: October 5, 2017Date of Patent: December 14, 2021Assignee: FUJIFILM Business Innovation Corp.Inventors: Miteshkumar Patel, Jacob Biehl, Andreas Girgensohn
-
Publication number: 20210289227Abstract: A computer-implemented method, comprising, extracting a video sequence, the video sequence including a series of video frames, estimating current poses of one or more subjects within each video frame and determining joint locations for a joint associated with the one or more subjects within each video frame, computing optical flows from the video sequence, extracting motion features from the video sequence based on the optical flows, and predicting at least one future pose.Type: ApplicationFiled: January 29, 2021Publication date: September 16, 2021Inventors: Yanjun Zhu, Yanxia Zhang, Qiong Liu, Andreas Girgensohn, Daniel Avrahami, Francine Chen, Hao Hu
-
Publication number: 20210272317Abstract: A computer-implemented method, comprising applying training images of an environment divided into zones to a neural network, and performing classification to label a test image based on a closest zone of the zones; extracting a feature from retrieved training images and pose information of the test image that match the closest zone; performing bundle adjustment on the extracted feature by triangulating map points for the closest zone to generate a reprojection error, and minimizing the reprojection error to determine an optimal pose of the test image; and for the optimal pose, providing an output indicative of a location or probability of a location of the test image at the optimal pose within the environment.Type: ApplicationFiled: February 28, 2020Publication date: September 2, 2021Inventors: Miteshkumar PATEL, Jingwei SONG, Andreas GIRGENSOHN, Chelhwon KIM
-
Patent number: 11023829Abstract: Many professionals use public transportation for site visits. If there is spare time between site visits, it is desirable for them to find a workspace that is more secure than a coffee shop. Work booths located at train stations meet that need. The system handles the reservation of those work booths based on the customer's schedule and destinations. In a dense public transportation network of a major metropolitan area, there are several routes one can take to travel between two points with only slight delays. Small additional detours may be acceptable if they pass by an available work booth. Unlike a traditional public transportation navigation system, one or more of the described embodiments can check all routes leading past work booths in parallel.Type: GrantFiled: August 22, 2018Date of Patent: June 1, 2021Assignee: FUJI XEROX CO., LTD.Inventors: Andreas Girgensohn, Lynn Donelle Wilcox
-
Publication number: 20210035437Abstract: A computer-implemented method is provided, comprising, based on information of a subject positioned on an object in an environment, generating a data stream; for the data stream, extracting features associated with a movement of the subject with respect to the object or the environment, wherein the movement is represented by spatio-temporal features extracted from sensors; generating a prediction associated with a likelihood of the movement based on the extracted features, and a risk profile of the movement based on a plurality of fall risk factors; and applying the prediction and the risk profile to a rule base to perform an action.Type: ApplicationFiled: November 27, 2019Publication date: February 4, 2021Inventors: Yanxia Zhang, Andreas Girgensohn, Qiong Liu, Yulius Tjahjadi
-
Patent number: 10911775Abstract: A computer-implemented method, comprising extracting each frame of a video sequence, estimating current poses of a subject within each frame and determining joint locations for a joint associated with the subject within each frame, computing optical flows between each pair of consecutive video frames, extracting motion features from each video frame of the video sequence based on the optical flows, encoding state information based on the current poses and the motion features, determining a current action label for each motion feature in the state information for a first frame; predicting future action labels for each motion feature in a second frame subsequent to the first frame, based on the current pose, action label and state information, predicting future poses for each motion feature in the second frame based on the current poses and the state information; and refining the current action label, the future action labels, and the future poses.Type: GrantFiled: March 11, 2020Date of Patent: February 2, 2021Assignee: FUJI XEROX CO., LTD.Inventors: Yanjun Zhu, Yanxia Zhang, Qiong Liu, Andreas Girgensohn, Daniel Avrahami, Francine Chen, Hao Hu
-
Patent number: 10871547Abstract: System is built using the particle filter (PF) framework which utilizes data from round trip time (RTT) ranging or BLE signal strength to perform both (1) sensing the environment by using the scan data during measurement phase and (2) detect motion state of the user which it utilized during the motion update phase of PF. To detect the motion state of the user the temporal difference of the received ranging scans is used over which is utilized within the PF framework. The primary advantage of the described technique is that the velocity parameter of the PF can dynamically be updated based on the motion state as estimated using ranging scans.Type: GrantFiled: December 23, 2019Date of Patent: December 22, 2020Assignee: FUJI XEROX CO., LTD.Inventors: Miteshkumar Patel, Jacob Biehl, Andreas Girgensohn
-
Patent number: 10812877Abstract: A probabilistic motion model to calculate the motion parameters of a user's hand held device using a noisy low cost Inertial Measurement Unit (IMU) sensor. Also described is a novel technique to reduce the bias noise present in the aforesaid IMU sensor signal, which results in a better performance of the motion model. The system utilizes a Particle Filter (PF) loop, which fuses radio signal data accumulated from Bluetooth Low Energy (BLE) beacons using BLE receiver with the signal from IMU sensor to perform localization and tracking. The Particle Filter loop operates based on a Sequential Monte Carlo technique well known to persons of ordinary skill in the art. The described approach provides a solution for both the noise problem in the IMU sensor and a motion model utilized in the Particle Filter loop, which provides better performance despite the noisy IMU sensor.Type: GrantFiled: May 15, 2017Date of Patent: October 20, 2020Assignee: FUJI XEROX CO., LTD.Inventors: Maani Ghaffari Jadidi, Miteshkumar Patel, Jacob Biehl, Andreas Girgensohn
-
Patent number: 10726511Abstract: Rights holders such as copyright owners want to keep track of copying of printed materials owned by them. That information can be used to check if the person copying has a license. Alternatively, the information can be used for billing. In some countries, an intermediary such as a copyright agency may facilitate the tracking of such copying and the compensation of the rights holders. This system automates the process by monitoring copiers, matching copied images to materials owned by rights holders, and recording such copying actions including the identifier of the copier, the copying person, the number of copies, and the matched materials. Alternatively, the system may prevent the copying if there is no permission by the rights holders.Type: GrantFiled: March 22, 2018Date of Patent: July 28, 2020Assignee: FUJI XEROX CO., LTD.Inventors: Andreas Girgensohn, Lynn Donelle Wilcox, Scott Carter, Kishore Papineni
-
Patent number: 10677883Abstract: A system and method, which utilizes incremental smoothing and mapping (iSAM) algorithm and automatically builds a beacon location map using various sensor and environmental information. The aforesaid iSAM algorithm fuses received signal strength indicator (RSSI) values available from different beacons in the environment and the information provided by the IMU sensor. The aforesaid iSAM algorithm is capable of simultaneously generating beacon and landmark map and localize the mobile computing device in the environment without having any prior information about any beacon locations. To accommodate for noisy sensor data and achieve better convergence for the iSAM algorithm, the system uses a prior beacon location map, which contains location information of some of the BLE beacons located in the environment. These known beacon locations provide cleaner environmental information to the iSAM algorithm and hence improve the overall estimation of beacon locations, which were not available apriori.Type: GrantFiled: May 3, 2017Date of Patent: June 9, 2020Assignee: FUJI XEROX CO., LTD.Inventors: Miteshkumar Patel, Maani Ghaffari Jadidi, Jacob Biehl, Andreas Girgensohn
-
Publication number: 20200065724Abstract: Many professionals use public transportation for site visits. If there is spare time between site visits, it is desirable for them to find a workspace that is more secure than a coffee shop. Work booths located at train stations meet that need. The system handles the reservation of those work booths based on the customer's schedule and destinations. In a dense public transportation network of a major metropolitan area, there are several routes one can take to travel between two points with only slight delays. Small additional detours may be acceptable if they pass by an available work booth. Unlike a traditional public transportation navigation system, one or more of the described embodiments can check all routes leading past work booths in parallel.Type: ApplicationFiled: August 22, 2018Publication date: February 27, 2020Applicant: FUJI XEROX CO., LTD.Inventors: Andreas Girgensohn, Lynn Donelle Wilcox
-
Patent number: 10504002Abstract: Detection of near-duplicate images is important for detecting the reuse of copyrighted material. Some applications require the clustering of near-duplicates instead of the comparison to an original. Representing images as bags of visual words is the first step for our clustering approach. An inverted index points from visual words to all the images containing that visual word. In the next step, matches are geometrically verified in pairs of images that share a large fraction of their visual words. Geometric verification may use affine, perspective, or other transformations. The verification step provides a similarity measure based on the fraction of the matching image points and on their distributions in the compared images. The resulting distance matrix is very sparse because most images in the collection are not compared to each other. This distance matrix is used as input for modified agglomerative hierarchical clustering approach that can handle a sparse distance matrix.Type: GrantFiled: July 30, 2017Date of Patent: December 10, 2019Assignee: FUJI XEROX CO., LTD.Inventor: Andreas Girgensohn
-
Publication number: 20190295200Abstract: Rights holders such as copyright owners want to keep track of copying of printed materials owned by them. That information can be used to check if the person copying has a license. Alternatively, the information can be used for billing. In some countries, an intermediary such as a copyright agency may facilitate the tracking of such copying and the compensation of the rights holders. This system automates the process by monitoring copiers, matching copied images to materials owned by rights holders, and recording such copying actions including the identifier of the copier, the copying person, the number of copies, and the matched materials. Alternatively, the system may prevent the copying if there is no permission by the rights holders.Type: ApplicationFiled: March 22, 2018Publication date: September 26, 2019Applicant: FUJI XEROX CO., LTD.Inventors: Andreas Girgensohn, Lynn Donelle Wilcox, III, Scott Carter, Kishore Papineni
-
Patent number: 10200206Abstract: A method of requesting an inquiry reply during a synchronous remote meeting is provided. The method includes recording a synchronous meeting between remote users to generate a meeting recording, generating an inquiry during the synchronous meeting to create a generated inquiry, identifying a portion of the meeting recording relevant to the inquiry during the synchronous meeting, and transmitting the generated inquiry and the captured portion of the recording to a recipient user.Type: GrantFiled: March 11, 2016Date of Patent: February 5, 2019Assignee: FUJI XEROX CO., LTD.Inventors: Torben Wallbaum, Andreas Girgensohn, Lynn Donelle Wilcox, Frank M. Shipman, III, Susanne Boll-Westermann
-
Publication number: 20190034758Abstract: Detection of near-duplicate images is important for detecting the reuse of copyrighted material. Some applications require the clustering of near-duplicates instead of the comparison to an original. Representing images as bags of visual words is the first step for our clustering approach. An inverted index points from visual words to all the images containing that visual word. In the next step, matches are geometrically verified in pairs of images that share a large fraction of their visual words. Geometric verification may use affine, perspective, or other transformations. The verification step provides a similarity measure based on the fraction of the matching image points and on their distributions in the compared images. The resulting distance matrix is very sparse because most images in the collection are not compared to each other. This distance matrix is used as input for modified agglomerative hierarchical clustering approach that can handle a sparse distance matrix.Type: ApplicationFiled: July 30, 2017Publication date: January 31, 2019Inventor: Andreas Girgensohn
-
Publication number: 20180332369Abstract: A probabilistic motion model to calculate the motion parameters of a user's hand held device using a noisy low cost Inertial Measurement Unit (IMU) sensor. Also described is a novel technique to reduce the bias noise present in the aforesaid IMU sensor signal, which results in a better performance of the motion model. The system utilizes a Particle Filter (PF) loop, which fuses radio signal data accumulated from Bluetooth Low Energy (BLE) beacons using BLE receiver with the signal from IMU sensor to perform localization and tracking. The Particle Filter loop operates based on a Sequential Monte Carlo technique well known to persons of ordinary skill in the art. The described approach provides a solution for both the noise problem in the IMU sensor and a motion model utilized in the Particle Filter loop, which provides better performance despite the noisy IMU sensor.Type: ApplicationFiled: May 15, 2017Publication date: November 15, 2018Inventors: Maani Ghaffari Jadidi, Miteshkumar Patel, Jacob Biehl, Andreas Girgensohn
-
Publication number: 20180328738Abstract: A computer-implemented method performed in a computerized system incorporating a central processing unit, a localization signal receiver, a plurality of sensors, separate and distinct from the localization signal receiver, and a memory, the computer-implemented method involving: using the central processing unit to initialize a plurality of particles based on an information on a map graph; using the central processing unit to repeatedly execute a particle filter loop, wherein the particle filter loop includes: using the central processing unit to perform a motion update of the plurality of particles; using the central processing unit to perform a measurement update of the plurality of particles; and using the central processing unit to perform a resampling of the plurality of particles based on particle importance weights and the map graph information. The location of the computerized system is subsequently determined based on the plurality of particles.Type: ApplicationFiled: October 5, 2017Publication date: November 15, 2018Applicant: FUJI XEROX CO., LTD.Inventors: Miteshkumar Patel, Jacob Biehl, Andreas Girgensohn