Patents by Inventor Fatih Porikli

Fatih Porikli has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20200380848
    Abstract: A method and device for mitigating passenger-related item loss in a travel-for-hire context are disclosed. An item within a vehicle passenger region is identified, and the identified item is associated with an identified passenger. A presence of the identified item is detected within the vehicle cabin passenger region in response to detecting an exit of the identified passenger, and an announcement message is generated based on the presence of the identified item within the vehicle cabin passenger region.
    Type: Application
    Filed: August 18, 2020
    Publication date: December 3, 2020
    Inventors: Qijie Xu, Fatih Porikli, Junqiang Shen
  • Publication number: 20200320287
    Abstract: An activity recognition device comprises a port configured to receive a video stream from a video source for a first object and a second object; a memory configured to store instructions and image frames of the video stream; and one or more processors, wherein the one or more processors execute the instructions stored in the memory, the one or more processors configured to: select portions of the image frames based on presence of the first object; determine areas within the portions of image frames, wherein locations of the first object in the video frames are bounded by the determined areas; determine motion of the first object and locations of a second object within the areas of the image frames; and identify an activity according to the determined motion and locations of the second object, and generate an alert according to the identified activity.
    Type: Application
    Filed: March 18, 2020
    Publication date: October 8, 2020
    Inventors: Fatih Porikli, Qijie Xu, Luis Bill, Huang Wei
  • Publication number: 20200257895
    Abstract: A computer-implemented method for estimating head pose angles of a user includes determining a first rotation between a first head pose axis associated with a first image of a plurality of images of the user and a camera axis associated with a camera taking the images. A second rotation is determined between a second head pose axis associated with a second image of the user and the camera axis. The first and second head pose axes are determined based on light reflections within the plurality of images. A head pose angle of the user can be estimated based on the first rotation and the second rotation. An alert can be generated based on the estimated head pose angle.
    Type: Application
    Filed: December 5, 2019
    Publication date: August 13, 2020
    Applicant: Futurewei Technologies, Inc.
    Inventors: Lei Yang, Fatih Porikli, Hai Yu
  • Patent number: 10628667
    Abstract: An activity recognition device comprises a port configured to receive a video stream from a video source for a first object and a second object; a memory configured to store instructions and image frames of the video stream; and one or more processors, wherein the one or more processors execute the instructions stored in the memory, the one or more processors configured to: select portions of the image frames based on presence of the first object; determine areas within the portions of image frames, wherein locations of the first object in the video frames are bounded by the determined areas; determine motion of the first object and locations of a second object within the areas of the image frames; and identify an activity according to the determined motion and locations of the second object, and generate an alert according to the identified activity.
    Type: Grant
    Filed: January 11, 2018
    Date of Patent: April 21, 2020
    Assignee: Futurewei Technologies, Inc.
    Inventors: Fatih Porikli, Qijie Xu, Luis Bill, Huang Wei
  • Patent number: 10528802
    Abstract: A computer-implemented method for estimating head pose angles of a user includes determining a first rotation between a first head pose axis associated with a first image of a plurality of images of the user and a camera axis associated with a camera taking the images. A second rotation is determined between a second head pose axis associated with a second image of the user and the camera axis. The first and second head pose axes are determined based on light reflections within the plurality of images. A head pose angle of the user can be estimated based on the first rotation and the second rotation. An alert can be generated based on the estimated head pose angle.
    Type: Grant
    Filed: January 9, 2018
    Date of Patent: January 7, 2020
    Assignee: Futurewei Technologies, Inc.
    Inventors: Lei Yang, Fatih Porikli, Hai Yu
  • Publication number: 20190246036
    Abstract: A computer-implemented method of acquiring visual data is provided that comprises: determining, by one or more processors, a gaze point of a person in a vehicle; detecting, by the one or more processors, a gesture by the person in the vehicle; and in response to the detection of the gesture, causing, by the one or more processors, a camera to acquire visual data corresponding to the gaze point of the person.
    Type: Application
    Filed: February 2, 2018
    Publication date: August 8, 2019
    Inventors: Yitian Wu, Fatih Porikli, Lei Yang, Luis Bill
  • Publication number: 20190236386
    Abstract: A computer-implemented method of detecting distracted driving comprises: determining, by one or more processors, a primary preview region (PPR) in a representation of an environment; determining, by the one or more processors, a gaze point for a driver based on a sequence of images of the driver; determining, by the one or more processors, that the gaze point is outside of the PPR; based on the determined gaze point being outside of the PPR, decreasing, by the one or more processors, an attention level for the PPR; based on the attention level for the PPR, generating, by the one or more processors, an alert.
    Type: Application
    Filed: January 29, 2018
    Publication date: August 1, 2019
    Inventors: Hai Yu, Fatih Porikli, Yuzhu Wu
  • Publication number: 20190228246
    Abstract: A vehicle is configured to receive, from a passenger, a pickup request including an approximate location of the passenger, to scan for the passenger after arriving at the approximate location of the passenger, and to determine whether the passenger has been identified by comparing passenger attribute information to results of the scan, and to transmit an approximate location of the vehicle and vehicle identification information to the passenger when the passenger has not been identified or is not accessible for pickup. The passenger is picked up by the vehicle when the passenger has been identified and is accessible for pickup. In addition, the passenger may also use a portable electronic device to identify the vehicle based on the received approximate location of the vehicle and vehicle identification information.
    Type: Application
    Filed: January 25, 2018
    Publication date: July 25, 2019
    Inventors: Lei Yang, Hai Yu, Qijie Xu, Fatih Porikli
  • Publication number: 20190213406
    Abstract: An activity recognition device comprises a port configured to receive a video stream from a video source for a first object and a second object; a memory configured to store instructions and image frames of the video stream; and one or more processors, wherein the one or more processors execute the instructions stored in the memory, the one or more processors configured to: select portions of the image frames based on presence of the first object; determine areas within the portions of image frames, wherein locations of the first object in the video frames are bounded by the determined areas; determine motion of the first object and locations of a second object within the areas of the image frames; and identify an activity according to the determined motion and locations of the second object, and generate an alert according to the identified activity.
    Type: Application
    Filed: January 11, 2018
    Publication date: July 11, 2019
    Inventors: Fatih Porikli, Qijie Xu, Luis Bill, Huang Wei
  • Publication number: 20190213402
    Abstract: A computer-implemented method for estimating head pose angles of a user includes determining a first rotation between a first head pose axis associated with a first image of a plurality of images of the user and a camera axis associated with a camera taking the images. A second rotation is determined between a second head pose axis associated with a second image of the user and the camera axis. The first and second head pose axes are determined based on light reflections within the plurality of images. A head pose angle of the user can be estimated based on the first rotation and the second rotation. An alert can be generated based on the estimated head pose angle.
    Type: Application
    Filed: January 9, 2018
    Publication date: July 11, 2019
    Inventors: Lei Yang, Fatih Porikli, Hai Yu
  • Patent number: 10322728
    Abstract: A system for determining distress of a driver of a vehicle is provided, comprising a plurality of sensors, including interior vehicle image sensors, an interior vehicle audio sensor, vehicle data sensors, and Global Positioning System (GPS) data sensors. The system also includes one or more processors configured to receive inputs from the plurality of sensors, and process the received inputs to obtain a driver heat change estimate, a driver expression estimate, a driver gesture estimate, an on-board diagnostics (OBD) estimate, and a GPS estimate. The one or more processors are further configured to store the estimates in a memory, use the stored estimates to generate deviation scores for each of the estimates, execute a machine learning algorithm to classify driver behavior as normal or impaired based on the deviation scores, and generate a warning based on the classification indicating impaired driver behavior.
    Type: Grant
    Filed: February 22, 2018
    Date of Patent: June 18, 2019
    Assignee: Futurewei Technologies, Inc.
    Inventors: Fatih Porikli, Yuzhu Wu, Luis Bill
  • Patent number: 10311704
    Abstract: A method and device for mitigating passenger-related item loss in a travel-for-hire context are disclosed. An item within a vehicle passenger region is identified, and associated the identified item with a passenger identified by a passenger identifier. A vehicle cabin inventory database is updated with an entry based on the identified item associated with the passenger identifier. A presence of the identified item is detected within the vehicle cabin passenger region when a passenger exit event occurs, and message data is generated including the entry that relates to the identified item based on the presence of the identified item within the vehicle cabin passenger region.
    Type: Grant
    Filed: March 29, 2018
    Date of Patent: June 4, 2019
    Assignee: Futurewei Technologies, Inc.
    Inventors: Qijie Xu, Fatih Porikli, Junqiang Shen
  • Patent number: 9734558
    Abstract: A method generates a high-resolution (HR) image from a low-resolution (LR) image using regression functions. During a training stage, training HR images are downsampled to LR images. A signature is determined for each LR-HR patch pair based on a local ternary pattern (LTP). The signature is a low dimensional descriptor used as an abstraction of the patch pair features. Then, patch pairs with the same signature are clustered, and a regression function which maps the LR patches to the HR patches is determined. In some cases patch pairs of similar signatures can be combined for learning and a single regression function determined, thus decreasing the number of required regression functions. During actual upscaling, LR patches of an input image are similarly processed to obtain the signatures and from the regression functions. The LR patches can then be upscaled using the training regression functions.
    Type: Grant
    Filed: March 20, 2014
    Date of Patent: August 15, 2017
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Fatih Porikli, Ashish Shrivastava, Jay Thornton
  • Patent number: 9639748
    Abstract: A method detects an object in a scene by first determining an active set of window positions from depth data. Specifically, the object can be a person. The depth data are acquired by a depth sensor. For each, window position perform the following steps. Assign a window size based on the depth data. Select a current window from the active set of window positions. Extract a joint feature from the depth data and texture data for the current window, wherein the texture data are acquired by a camera. Classify the joint feature to detect the object. The classifier is trained with joint training features extracted from training data including training depth data and training texture data acquired by the sensor and camera respectively. Finally, the active set of window positions is updated before processing the next current window.
    Type: Grant
    Filed: May 20, 2013
    Date of Patent: May 2, 2017
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Fatih Porikli, Mehmet Kocamaz
  • Patent number: 9418434
    Abstract: Three-dimensional (3D) geometric boundaries are detected in images of a scene that undergoes varying lighting conditions caused by light sources in different positions, from a set of input images of the scene illuminated by at least two different lighting conditions. The images are aligned, e.g., acquired by a stationary camera, so that pixels at the same location in all of the input images correspond to the same point in the scene. For each location, a patch of corresponding pixels centered at the location is extracted from each input image. For each location, a confidence value that there is a 3D geometric boundary at the location is determined.
    Type: Grant
    Filed: April 3, 2013
    Date of Patent: August 16, 2016
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Tim K Marks, Oncel Tuzel, Fatih Porikli, Jay Thornton, Jie Ni
  • Patent number: 9384553
    Abstract: A set of nonnegative lighting basis images representing a scene illuminated by a set of stationary light sources is recovered from a set of input images of the scene that were acquired by a stationary camera. Each image is illuminated by a combination of the light sources, and at least two images in the set are illuminated by different combinations. The set of input images is factorized into the nonnegative lighting basis images and a set of indicator coefficients, wherein each lighting basis image corresponds to an appearance of the scene illuminated by one of the light sources, and wherein each indicator coefficient indicates a contribution of one of the light sources to one of the input images.
    Type: Grant
    Filed: April 3, 2013
    Date of Patent: July 5, 2016
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Oncel Tuzel, Tim K Marks, Fatih Porikli, Jie Ni
  • Patent number: 9262808
    Abstract: An input image is denoised by first constructing a pixel-wise noise variance map from the input image. The noise has spatially varying variances. The input image is partitioned into patches using the noise variance map. An intermediate image is determined from the patches. Collaborative filtering is applied to each patch in the intermediate image using the noise variance map to produce filtered patches. Then, the filtered patches are projected to an output image.
    Type: Grant
    Filed: February 7, 2013
    Date of Patent: February 16, 2016
    Assignee: MITSUBISHI ELECTRIC RESEARCH LABORATORIES, INC.
    Inventors: Fatih Porikli, Akshay Soni
  • Publication number: 20150269708
    Abstract: A method generates a high-resolution (HR) image from a low-resolution (LR) image using regression functions. During a training stage, training HR images are downsampled to LR images. A signature is determined for each LR-HR patch pair based on a local ternary pattern (LTP). The signature is a low dimensional descriptor used as an abstraction of the patch pair features. Then, patch pairs with the same signature are clustered, and a regression function which maps the LR patches to the HR patches is determined. In some cases patch pairs of similar signatures can be combined for learning and a single regression function determined, thus decreasing the number of required regression functions. During actual upscaling, LR patches of an input image are similarly processed to obtain the signatures and from the regression functions. The LR patches can then be upscaled using the training regression functions.
    Type: Application
    Filed: March 20, 2014
    Publication date: September 24, 2015
    Applicant: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Fatih Porikli, Ashish Shrivastava, Jay Thornton
  • Patent number: 9076227
    Abstract: A tumor is tracked in multiple sequences of images acquired concurrently from different viewpoints. Features are extracted in each set of current images using a window. A regression function, subject to motion constraints, is applied to the features to obtain 3D motion parameters, which are applied to the tumor as observed in the images to obtain a 3D location of the object. Then, the shape of the 3D object at the 3D location is projected onto each image to update the location of the window for the next set of images to be processed.
    Type: Grant
    Filed: October 1, 2012
    Date of Patent: July 7, 2015
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Fatih Porikli, Feng Li
  • Patent number: 8989472
    Abstract: Four-dimensional (4D) computed tomography (CT) is simulated by first generating a surface mesh from a single thoracic CT scan. Tetrahedralization is applied to the surface mesh to obtain a first volume mesh. Finite element analysis, using boundary constraints and load definitions, is applied to the first volume mesh to obtain a lung deformation according to an Ogden model. Constrained tetrahedralization, using control points, is applied to the lung deformation to obtain a second volume mesh, which is then deformed using mass-spring-damper simulation to produces the 4DCT.
    Type: Grant
    Filed: February 13, 2013
    Date of Patent: March 24, 2015
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Fatih Porikli, Feng Li