Patents by Inventor Andreas Girgensohn

Andreas Girgensohn has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11410540
    Abstract: A computer-implemented method is provided, comprising, based on information of a subject positioned on an object in an environment, generating a data stream; for the data stream, extracting features associated with a movement of the subject with respect to the object or the environment, wherein the movement is represented by spatio-temporal features extracted from sensors; generating a prediction associated with a likelihood of the movement based on the extracted features, and a risk profile of the movement based on a plurality of fall risk factors; and applying the prediction and the risk profile to a rule base to perform an action.
    Type: Grant
    Filed: November 27, 2019
    Date of Patent: August 9, 2022
    Assignee: FUJI XEROX CO., LTD.
    Inventors: Yanxia Zhang, Andreas Girgensohn, Qiong Liu, Yulius Tjahjadi
  • Patent number: 11343532
    Abstract: A computer-implemented method, comprising, extracting a video sequence, the video sequence including a series of video frames, estimating current poses of one or more subjects within each video frame and determining joint locations for a joint associated with the one or more subjects within each video frame, computing optical flows from the video sequence, extracting motion features from the video sequence based on the optical flows, and predicting at least one future pose.
    Type: Grant
    Filed: January 29, 2021
    Date of Patent: May 24, 2022
    Assignee: FUJIFILM Business Innovation Corp.
    Inventors: Yanjun Zhu, Yanxia Zhang, Qiong Liu, Andreas Girgensohn, Daniel Avrahami, Francine Chen, Hao Hu
  • Patent number: 11227406
    Abstract: A computer-implemented method, comprising applying training images of an environment divided into zones to a neural network, and performing classification to label a test image based on a closest zone of the zones; extracting a feature from retrieved training images and pose information of the test image that match the closest zone; performing bundle adjustment on the extracted feature by triangulating map points for the closest zone to generate a reprojection error, and minimizing the reprojection error to determine an optimal pose of the test image; and for the optimal pose, providing an output indicative of a location or probability of a location of the test image at the optimal pose within the environment.
    Type: Grant
    Filed: February 28, 2020
    Date of Patent: January 18, 2022
    Assignee: FUJIFILM Business Innovation Corp.
    Inventors: Miteshkumar Patel, Jingwei Song, Andreas Girgensohn, Chelhwon Kim
  • Patent number: 11199411
    Abstract: A computer-implemented method performed in a computerized system incorporating a central processing unit, a localization signal receiver, a plurality of sensors, separate and distinct from the localization signal receiver, and a memory, the computer-implemented method involving: using the central processing unit to initialize a plurality of particles based on an information on a map graph; using the central processing unit to repeatedly execute a particle filter loop, wherein the particle filter loop includes: using the central processing unit to perform a motion update of the plurality of particles; using the central processing unit to perform a measurement update of the plurality of particles; and using the central processing unit to perform a resampling of the plurality of particles based on particle importance weights and the map graph information. The location of the computerized system is subsequently determined based on the plurality of particles.
    Type: Grant
    Filed: October 5, 2017
    Date of Patent: December 14, 2021
    Assignee: FUJIFILM Business Innovation Corp.
    Inventors: Miteshkumar Patel, Jacob Biehl, Andreas Girgensohn
  • Publication number: 20210289227
    Abstract: A computer-implemented method, comprising, extracting a video sequence, the video sequence including a series of video frames, estimating current poses of one or more subjects within each video frame and determining joint locations for a joint associated with the one or more subjects within each video frame, computing optical flows from the video sequence, extracting motion features from the video sequence based on the optical flows, and predicting at least one future pose.
    Type: Application
    Filed: January 29, 2021
    Publication date: September 16, 2021
    Inventors: Yanjun Zhu, Yanxia Zhang, Qiong Liu, Andreas Girgensohn, Daniel Avrahami, Francine Chen, Hao Hu
  • Publication number: 20210272317
    Abstract: A computer-implemented method, comprising applying training images of an environment divided into zones to a neural network, and performing classification to label a test image based on a closest zone of the zones; extracting a feature from retrieved training images and pose information of the test image that match the closest zone; performing bundle adjustment on the extracted feature by triangulating map points for the closest zone to generate a reprojection error, and minimizing the reprojection error to determine an optimal pose of the test image; and for the optimal pose, providing an output indicative of a location or probability of a location of the test image at the optimal pose within the environment.
    Type: Application
    Filed: February 28, 2020
    Publication date: September 2, 2021
    Inventors: Miteshkumar PATEL, Jingwei SONG, Andreas GIRGENSOHN, Chelhwon KIM
  • Patent number: 11023829
    Abstract: Many professionals use public transportation for site visits. If there is spare time between site visits, it is desirable for them to find a workspace that is more secure than a coffee shop. Work booths located at train stations meet that need. The system handles the reservation of those work booths based on the customer's schedule and destinations. In a dense public transportation network of a major metropolitan area, there are several routes one can take to travel between two points with only slight delays. Small additional detours may be acceptable if they pass by an available work booth. Unlike a traditional public transportation navigation system, one or more of the described embodiments can check all routes leading past work booths in parallel.
    Type: Grant
    Filed: August 22, 2018
    Date of Patent: June 1, 2021
    Assignee: FUJI XEROX CO., LTD.
    Inventors: Andreas Girgensohn, Lynn Donelle Wilcox
  • Publication number: 20210035437
    Abstract: A computer-implemented method is provided, comprising, based on information of a subject positioned on an object in an environment, generating a data stream; for the data stream, extracting features associated with a movement of the subject with respect to the object or the environment, wherein the movement is represented by spatio-temporal features extracted from sensors; generating a prediction associated with a likelihood of the movement based on the extracted features, and a risk profile of the movement based on a plurality of fall risk factors; and applying the prediction and the risk profile to a rule base to perform an action.
    Type: Application
    Filed: November 27, 2019
    Publication date: February 4, 2021
    Inventors: Yanxia Zhang, Andreas Girgensohn, Qiong Liu, Yulius Tjahjadi
  • Patent number: 10911775
    Abstract: A computer-implemented method, comprising extracting each frame of a video sequence, estimating current poses of a subject within each frame and determining joint locations for a joint associated with the subject within each frame, computing optical flows between each pair of consecutive video frames, extracting motion features from each video frame of the video sequence based on the optical flows, encoding state information based on the current poses and the motion features, determining a current action label for each motion feature in the state information for a first frame; predicting future action labels for each motion feature in a second frame subsequent to the first frame, based on the current pose, action label and state information, predicting future poses for each motion feature in the second frame based on the current poses and the state information; and refining the current action label, the future action labels, and the future poses.
    Type: Grant
    Filed: March 11, 2020
    Date of Patent: February 2, 2021
    Assignee: FUJI XEROX CO., LTD.
    Inventors: Yanjun Zhu, Yanxia Zhang, Qiong Liu, Andreas Girgensohn, Daniel Avrahami, Francine Chen, Hao Hu
  • Patent number: 10871547
    Abstract: System is built using the particle filter (PF) framework which utilizes data from round trip time (RTT) ranging or BLE signal strength to perform both (1) sensing the environment by using the scan data during measurement phase and (2) detect motion state of the user which it utilized during the motion update phase of PF. To detect the motion state of the user the temporal difference of the received ranging scans is used over which is utilized within the PF framework. The primary advantage of the described technique is that the velocity parameter of the PF can dynamically be updated based on the motion state as estimated using ranging scans.
    Type: Grant
    Filed: December 23, 2019
    Date of Patent: December 22, 2020
    Assignee: FUJI XEROX CO., LTD.
    Inventors: Miteshkumar Patel, Jacob Biehl, Andreas Girgensohn
  • Patent number: 10812877
    Abstract: A probabilistic motion model to calculate the motion parameters of a user's hand held device using a noisy low cost Inertial Measurement Unit (IMU) sensor. Also described is a novel technique to reduce the bias noise present in the aforesaid IMU sensor signal, which results in a better performance of the motion model. The system utilizes a Particle Filter (PF) loop, which fuses radio signal data accumulated from Bluetooth Low Energy (BLE) beacons using BLE receiver with the signal from IMU sensor to perform localization and tracking. The Particle Filter loop operates based on a Sequential Monte Carlo technique well known to persons of ordinary skill in the art. The described approach provides a solution for both the noise problem in the IMU sensor and a motion model utilized in the Particle Filter loop, which provides better performance despite the noisy IMU sensor.
    Type: Grant
    Filed: May 15, 2017
    Date of Patent: October 20, 2020
    Assignee: FUJI XEROX CO., LTD.
    Inventors: Maani Ghaffari Jadidi, Miteshkumar Patel, Jacob Biehl, Andreas Girgensohn
  • Patent number: 10726511
    Abstract: Rights holders such as copyright owners want to keep track of copying of printed materials owned by them. That information can be used to check if the person copying has a license. Alternatively, the information can be used for billing. In some countries, an intermediary such as a copyright agency may facilitate the tracking of such copying and the compensation of the rights holders. This system automates the process by monitoring copiers, matching copied images to materials owned by rights holders, and recording such copying actions including the identifier of the copier, the copying person, the number of copies, and the matched materials. Alternatively, the system may prevent the copying if there is no permission by the rights holders.
    Type: Grant
    Filed: March 22, 2018
    Date of Patent: July 28, 2020
    Assignee: FUJI XEROX CO., LTD.
    Inventors: Andreas Girgensohn, Lynn Donelle Wilcox, Scott Carter, Kishore Papineni
  • Patent number: 10677883
    Abstract: A system and method, which utilizes incremental smoothing and mapping (iSAM) algorithm and automatically builds a beacon location map using various sensor and environmental information. The aforesaid iSAM algorithm fuses received signal strength indicator (RSSI) values available from different beacons in the environment and the information provided by the IMU sensor. The aforesaid iSAM algorithm is capable of simultaneously generating beacon and landmark map and localize the mobile computing device in the environment without having any prior information about any beacon locations. To accommodate for noisy sensor data and achieve better convergence for the iSAM algorithm, the system uses a prior beacon location map, which contains location information of some of the BLE beacons located in the environment. These known beacon locations provide cleaner environmental information to the iSAM algorithm and hence improve the overall estimation of beacon locations, which were not available apriori.
    Type: Grant
    Filed: May 3, 2017
    Date of Patent: June 9, 2020
    Assignee: FUJI XEROX CO., LTD.
    Inventors: Miteshkumar Patel, Maani Ghaffari Jadidi, Jacob Biehl, Andreas Girgensohn
  • Publication number: 20200065724
    Abstract: Many professionals use public transportation for site visits. If there is spare time between site visits, it is desirable for them to find a workspace that is more secure than a coffee shop. Work booths located at train stations meet that need. The system handles the reservation of those work booths based on the customer's schedule and destinations. In a dense public transportation network of a major metropolitan area, there are several routes one can take to travel between two points with only slight delays. Small additional detours may be acceptable if they pass by an available work booth. Unlike a traditional public transportation navigation system, one or more of the described embodiments can check all routes leading past work booths in parallel.
    Type: Application
    Filed: August 22, 2018
    Publication date: February 27, 2020
    Applicant: FUJI XEROX CO., LTD.
    Inventors: Andreas Girgensohn, Lynn Donelle Wilcox
  • Patent number: 10504002
    Abstract: Detection of near-duplicate images is important for detecting the reuse of copyrighted material. Some applications require the clustering of near-duplicates instead of the comparison to an original. Representing images as bags of visual words is the first step for our clustering approach. An inverted index points from visual words to all the images containing that visual word. In the next step, matches are geometrically verified in pairs of images that share a large fraction of their visual words. Geometric verification may use affine, perspective, or other transformations. The verification step provides a similarity measure based on the fraction of the matching image points and on their distributions in the compared images. The resulting distance matrix is very sparse because most images in the collection are not compared to each other. This distance matrix is used as input for modified agglomerative hierarchical clustering approach that can handle a sparse distance matrix.
    Type: Grant
    Filed: July 30, 2017
    Date of Patent: December 10, 2019
    Assignee: FUJI XEROX CO., LTD.
    Inventor: Andreas Girgensohn
  • Publication number: 20190295200
    Abstract: Rights holders such as copyright owners want to keep track of copying of printed materials owned by them. That information can be used to check if the person copying has a license. Alternatively, the information can be used for billing. In some countries, an intermediary such as a copyright agency may facilitate the tracking of such copying and the compensation of the rights holders. This system automates the process by monitoring copiers, matching copied images to materials owned by rights holders, and recording such copying actions including the identifier of the copier, the copying person, the number of copies, and the matched materials. Alternatively, the system may prevent the copying if there is no permission by the rights holders.
    Type: Application
    Filed: March 22, 2018
    Publication date: September 26, 2019
    Applicant: FUJI XEROX CO., LTD.
    Inventors: Andreas Girgensohn, Lynn Donelle Wilcox, III, Scott Carter, Kishore Papineni
  • Patent number: 10200206
    Abstract: A method of requesting an inquiry reply during a synchronous remote meeting is provided. The method includes recording a synchronous meeting between remote users to generate a meeting recording, generating an inquiry during the synchronous meeting to create a generated inquiry, identifying a portion of the meeting recording relevant to the inquiry during the synchronous meeting, and transmitting the generated inquiry and the captured portion of the recording to a recipient user.
    Type: Grant
    Filed: March 11, 2016
    Date of Patent: February 5, 2019
    Assignee: FUJI XEROX CO., LTD.
    Inventors: Torben Wallbaum, Andreas Girgensohn, Lynn Donelle Wilcox, Frank M. Shipman, III, Susanne Boll-Westermann
  • Publication number: 20190034758
    Abstract: Detection of near-duplicate images is important for detecting the reuse of copyrighted material. Some applications require the clustering of near-duplicates instead of the comparison to an original. Representing images as bags of visual words is the first step for our clustering approach. An inverted index points from visual words to all the images containing that visual word. In the next step, matches are geometrically verified in pairs of images that share a large fraction of their visual words. Geometric verification may use affine, perspective, or other transformations. The verification step provides a similarity measure based on the fraction of the matching image points and on their distributions in the compared images. The resulting distance matrix is very sparse because most images in the collection are not compared to each other. This distance matrix is used as input for modified agglomerative hierarchical clustering approach that can handle a sparse distance matrix.
    Type: Application
    Filed: July 30, 2017
    Publication date: January 31, 2019
    Inventor: Andreas Girgensohn
  • Publication number: 20180332369
    Abstract: A probabilistic motion model to calculate the motion parameters of a user's hand held device using a noisy low cost Inertial Measurement Unit (IMU) sensor. Also described is a novel technique to reduce the bias noise present in the aforesaid IMU sensor signal, which results in a better performance of the motion model. The system utilizes a Particle Filter (PF) loop, which fuses radio signal data accumulated from Bluetooth Low Energy (BLE) beacons using BLE receiver with the signal from IMU sensor to perform localization and tracking. The Particle Filter loop operates based on a Sequential Monte Carlo technique well known to persons of ordinary skill in the art. The described approach provides a solution for both the noise problem in the IMU sensor and a motion model utilized in the Particle Filter loop, which provides better performance despite the noisy IMU sensor.
    Type: Application
    Filed: May 15, 2017
    Publication date: November 15, 2018
    Inventors: Maani Ghaffari Jadidi, Miteshkumar Patel, Jacob Biehl, Andreas Girgensohn
  • Publication number: 20180328738
    Abstract: A computer-implemented method performed in a computerized system incorporating a central processing unit, a localization signal receiver, a plurality of sensors, separate and distinct from the localization signal receiver, and a memory, the computer-implemented method involving: using the central processing unit to initialize a plurality of particles based on an information on a map graph; using the central processing unit to repeatedly execute a particle filter loop, wherein the particle filter loop includes: using the central processing unit to perform a motion update of the plurality of particles; using the central processing unit to perform a measurement update of the plurality of particles; and using the central processing unit to perform a resampling of the plurality of particles based on particle importance weights and the map graph information. The location of the computerized system is subsequently determined based on the plurality of particles.
    Type: Application
    Filed: October 5, 2017
    Publication date: November 15, 2018
    Applicant: FUJI XEROX CO., LTD.
    Inventors: Miteshkumar Patel, Jacob Biehl, Andreas Girgensohn