Patents by Inventor Lixin Fan

Lixin Fan has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20180293805
    Abstract: A method comprising performing image re-projection on each of a plurality of first images of a scene, thereby to generate a plurality of re-projected second images of the scene, wherein each first image of the scene is captured by a respective camera of a first multi-directional image capture apparatus and each second image of the scene is associated with a respective virtual camera; processing the plurality of second images based on a previously generated virtual three dimensional model of the scene, thereby to generate respective positions of the virtual cameras associated with the second images; and determining a position of the first multi-directional image capture apparatus based on one or more of the generated positions of the virtual cameras.
    Type: Application
    Filed: April 9, 2018
    Publication date: October 11, 2018
    Inventors: Tinghuai WANG, Yu YOU, Lixin FAN
  • Patent number: 10049492
    Abstract: A method comprising: obtaining a plurality of three-dimensional (3D) point clouds about a plurality of objects of interest, each of said 3D point clouds being labelled to a category of objects of interest; rendering facades for the objects of interests categorized as buildings using an ambient occlusion method, where illumination of the point cloud is calculated based on light coming from a theoretical hemisphere or sphere around the object of interest; and rendering shapes of the objects of interests categorized as non-buildings by fitting predefined templates of street view objects to the point clouds labelled as non-buildings.
    Type: Grant
    Filed: October 18, 2016
    Date of Patent: August 14, 2018
    Assignee: Nokia Technologies Oy
    Inventors: Pouria Babahajiani, Lixin Fan
  • Patent number: 9898486
    Abstract: The invention relates to a method and a system for image-based retrieval. The method comprises receiving a query image; processing the query image to obtain visual features; determining a feature from the obtained visual features; determining a viewing direction for the query image from a pre-determined set of viewing directions; generating a direction-based hash based on the determined feature in the query image and the viewing direction; identifying sub-volumes of a point cloud database that match the direction-based hash; and matching the identified sub-volumes against all the query image features to find a match.
    Type: Grant
    Filed: February 9, 2016
    Date of Patent: February 20, 2018
    Assignee: Nokia Technologies Oy
    Inventors: Kimmo Roimela, Lixin Fan
  • Publication number: 20180012105
    Abstract: A method comprising: obtaining a three-dimensional (3D) point cloud about an object; obtaining binary feature descriptors for feature points in a 2D image about the object; assigning a plurality of index values for each feature point as multiple bits of the corresponding binary feature descriptor; storing the binary feature descriptor in a table entry of a plurality of hash key tables of a database image; obtaining query binary feature descriptors for feature points in a query image; matching the query binary feature descriptors to the binary feature descriptors of the database image; reselecting one bit of the hash key of the matched database image; and re-indexing the feature points in the table entries of the hash key table of the database image.
    Type: Application
    Filed: January 27, 2015
    Publication date: January 11, 2018
    Inventors: Lixin Fan, Youji Feng, Yihong Wu
  • Patent number: 9846946
    Abstract: A method comprising: obtaining a three-dimensional (3D) point cloud about at least one object of interest; detecting ground and/or building objects from 3D point cloud data using an unsupervised segmentation method; removing the ground and/or building objects from the 3D point cloud data; and detecting one or more vertical objects from the remaining 3D point cloud data using a supervised segmentation method.
    Type: Grant
    Filed: November 21, 2015
    Date of Patent: December 19, 2017
    Assignee: Nokia Technologies Oy
    Inventors: Lixin Fan, Pouria Babahajiani
  • Publication number: 20170357873
    Abstract: An augmented reality method for displaying information comprises: capturing a sequence of image frames by a camera of a portable device, obtaining movement data by using an inertial sensor of the portable device, determining a sampling frame rate according to the movement data, selecting a tracking image from the captured image frames according to the sampling frame rate, determining a position of the portable device by comparing the tracking image with a point cloud, and displaying information on a display of the device based on the determined position.
    Type: Application
    Filed: December 3, 2015
    Publication date: December 14, 2017
    Applicant: Nokia Technologies Oy
    Inventors: Kimmo Roimela, Lixin Fan
  • Publication number: 20170344116
    Abstract: The invention relates to a method, apparatus and system for producing haptic output. Data of a plurality of objects of a model are received. The data of the plurality of objects comprise information of dimensions of the objects and properties of the objects. Haptic instructions for a haptic output device are received for producing haptic output of the properties, and in accordance with the instructions, haptic output for the objects using the haptic instructions is produced. One or more mappings between properties of virtual objects and target haptic outputs may be formed into a haptic data structure, the haptic data structure comprising a plurality of haptic instructions indicative of mappings between properties and haptic outputs, the haptic data structure being configured for use in haptic output related to objects when a user is determined to interact with said objects.
    Type: Application
    Filed: December 1, 2015
    Publication date: November 30, 2017
    Applicant: Nokia Technologies Oy
    Inventors: Yu You, Lixin Fan
  • Patent number: 9699375
    Abstract: An approach is provided for processing and/or facilitating a processing of one or more images to determine camera location information, camera pose information, or a combination thereof associated with at least one camera capturing the one or more images, wherein the camera location information, the camera pose information, or a combination thereof is represented according to a global coordinate system. The approach involves causing, at least in part, an association of the camera location information, the camera pose information, or a combination thereof with the one or more images as meta-data information.
    Type: Grant
    Filed: August 30, 2013
    Date of Patent: July 4, 2017
    Assignee: Nokia Technology Oy
    Inventors: Lixin Fan, Junsheng Fu, Kimmo Tapio Roimela, Yu You
  • Publication number: 20170132843
    Abstract: The embodiments relate to a method and to technical equipment for implementing the method. The method includes receiving an image with location information from a client; requesting processed region data from a media server based on the location information, said processed region data including one or more images with the corresponding location information; applying a first process for determining a pose of a device for the received image by means of the processed region data; if the first process fails to result the pose of the device, applying a second process for determining a pose of a device for the received image by means of the processed region data; saving the image with the determined pose of the device to the media server; providing the image and the pose of the device to a client for client rendering.
    Type: Application
    Filed: June 27, 2014
    Publication date: May 11, 2017
    Inventors: Lixin FAN, Ville-Veikko MATTILA, Yu YOU, Kimmo ROIMELA, Junsheng FU, Antti ERONEN
  • Publication number: 20170116781
    Abstract: A method comprising: obtaining a plurality of three-dimensional (3D) point clouds about a plurality of objects of interest, each of said 3D point clouds being labelled to a category of objects of interest; rendering facades for the objects of interests categorized as buildings using an ambient occlusion method, where illumination of the point cloud is calculated based on light coming from a theoretical hemisphere or sphere around the object of interest; and rendering shapes of the objects of interests categorized as non-buildings by fitting predefined templates of street view objects to the point clouds labelled as non-buildings.
    Type: Application
    Filed: October 18, 2016
    Publication date: April 27, 2017
    Inventors: Pouria Babahajiani, Lixin Fan
  • Patent number: 9633281
    Abstract: Abstract A method comprising: providing a first three-dimensional (3D) point cloud obtained according to a first sensing technique, a second 3D point cloud obtained according to a second sensing technique and a first radius of a sphere covering a real object underlying the second first 3D point cloud and a second radius of a sphere covering a real object underlying the second 3D point cloud; defining scales of the first 3D point cloud and the second 3D point cloud based on said first radius and second radius; searching statistically substantially similar candidate regions between the first 3D point cloud and the second 3D point cloud using an ensemble shape function (ESF); aligning the statistically substantially similar candidate regions between the first 3D point cloud and the second 3D point cloud at least in vertical direction; and ranking the aligned candidate regions between the 3D point clouds based on their structural similarity.
    Type: Grant
    Filed: May 18, 2015
    Date of Patent: April 25, 2017
    Assignee: Nokia Technologies Oy
    Inventors: Lixin Fan, Yu You, Furong Peng, Qiang Wu, Jian Zhang
  • Patent number: 9631932
    Abstract: Methods and apparatus, including computer program products, are provided for mapping. In one aspect there is provided a method which may include sampling a position and a viewpoint of a three-dimensional map view presented at a browser while traversing the three-dimensional map; sending to a database a query including the sampled position and the sampled viewpoint; and receiving, in response to the sent query, a recommended browsing path including a recommended position and a recommended viewpoint for traversing the three-dimensional map presented at the browser. The recommended browsing path represents an aggregation including crowd-sourced information for position and viewpoint. Related apparatus, systems, methods, and articles are also described.
    Type: Grant
    Filed: June 5, 2015
    Date of Patent: April 25, 2017
    Assignee: Nokia Technologies Oy
    Inventors: Lixin Fan, Kimmo Tapio Roimela, Yu You
  • Patent number: 9558559
    Abstract: An approach is provided for processing and/or facilitating a processing of one or more images to determine camera location information, camera pose information, or a combination thereof associated with at least one camera capturing the one or more images, wherein the camera location information, the camera pose information, or a combination thereof is represented according to a global coordinate system. The approach involves causing, at least in part, an association of the camera location information, the camera pose information, or a combination thereof with the one or more images as meta-data information.
    Type: Grant
    Filed: April 5, 2013
    Date of Patent: January 31, 2017
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Lixin Fan, Junsheng Fu, Kimmo Roimela, Yu You
  • Publication number: 20170026577
    Abstract: An apparatus comprising a processor and memory including computer program code, the memory and computer program code configured to, with the processor, enable the apparatus at least to: use received current-field-of-view indication data together with future-event-direction data, in respect of recorded panoramic video output provided by panoramic video content data, to provide a sensory cue for a viewer of the recorded panoramic video output to indicate the direction of a future event in the recorded panoramic video output which is outside a current field of view, wherein the recorded panoramic video output is configured to provide video content to the viewer which extends outside the field of view of the viewer in at least in one direction, and the future-event-direction data is supplemental to the panoramic video content data which provides the video content itself.
    Type: Application
    Filed: June 27, 2016
    Publication date: January 26, 2017
    Inventors: Yu You, Lixin Fan
  • Publication number: 20160356600
    Abstract: Methods and apparatus, including computer program products, are provided for mapping. In one aspect there is provided a method which may include sampling a position and a viewpoint of a three-dimensional map view presented at a browser while traversing the three-dimensional map; sending to a database a query including the sampled position and the sampled viewpoint; and receiving, in response to the sent query, a recommended browsing path including a recommended position and a recommended viewpoint for traversing the three-dimensional map presented at the browser. The recommended browsing path represents an aggregation including crowd-sourced information for position and viewpoint. Related apparatus, systems, methods, and articles are also described.
    Type: Application
    Filed: June 5, 2015
    Publication date: December 8, 2016
    Inventors: Lixin Fan, Kimmo Tapio Roimela, Yu You
  • Publication number: 20160239518
    Abstract: The invention relates to a method and a system for image-based retrieval. The method comprises receiving a query image; processing the query image to obtain visual features; determining a feature from the obtained visual features; determining a viewing direction for the query image from a pre-determined set of viewing directions; generating a direction-based hash based on the determined feature in the query image and the viewing direction; identifying sub-volumes of a point cloud database that match the direction-based hash; and matching the identified sub-volumes against all the query image features to find a match.
    Type: Application
    Filed: February 9, 2016
    Publication date: August 18, 2016
    Inventors: Kimmo Roimela, Lixin Fan
  • Publication number: 20160232420
    Abstract: A method, comprising: providing a first border array associated with a first block, the first border array comprising several elements, wherein the value of each element corresponds to the sum of signal values of pixels enclosed within an integration region within said first block, providing a second border array associated with a second block, the second border array comprising several elements, wherein the value of each element corresponds to the sum of signal values of pixels enclosed within an integration region within said second block, determining a first representative element from the first border array according to a calculation point, determining a second representative element from the second border array according to said calculation point, and calculating a sum of signal values of pixels located within a summation region by using the first representative element and the second representative element, said summation region having a corner at said calculation point.
    Type: Application
    Filed: February 3, 2016
    Publication date: August 11, 2016
    Inventors: Lixin Fan, Kimmo Roimela, Yu You, Sounak Bhattacharya
  • Publication number: 20160154999
    Abstract: A method comprising: obtaining a three-dimensional (3D) point cloud about at least one object of interest; detecting ground and/or building objects from 3D point cloud data using an unsupervised segmentation method; removing the ground and/or building objects from the 3D point cloud data; and detecting one or more vertical objects from the remaining 3D point cloud data using a supervised segmentation method.
    Type: Application
    Filed: November 21, 2015
    Publication date: June 2, 2016
    Inventors: Lixin Fan, Pouria Babahajiani
  • Publication number: 20160086334
    Abstract: Embodiments relate to a method and a technical equipment for estimating a camera pose. The method comprises obtaining query binary feature descriptors for feature points in an image; placing a selected part of the obtained query binary feature descriptors into a query binary tree; and matching the query binary feature descriptors in the query binary tree to database binary feature descriptors of a database image to estimate a pose of a camera.
    Type: Application
    Filed: March 26, 2013
    Publication date: March 24, 2016
    Inventors: Lixin Fan, Youji Feng, Yihong Wu
  • Patent number: 9271344
    Abstract: A PWM circuit is disclosed in the application, which includes: a PWM counter, a reference value setting register, a frequency multiplier and a comparator, where the frequency multiplier is adapted to increase the frequency of a clock signal input and to output the clock signal with the increased frequency to the PWM counter. An LED drive circuit is further disclosed in the application. The frequency of a PWM input clock signal is increased to N times of the original frequency of the PWM input clock signal by the frequency multiplier, so that the counting cycle of the PWM counter is shortened to 1/N of the original counting cycle of the PWM counter. Therefore, in the dynamic LED display screen, the refresh frequency can be increased to N times of the original refresh frequency while the original resolution is maintained.
    Type: Grant
    Filed: August 14, 2012
    Date of Patent: February 23, 2016
    Assignee: Supec (Suzhou) Co., Ltd.
    Inventor: Lixin Fan