Patents by Inventor Martin Renschler

Martin Renschler has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20210342387
    Abstract: Aspects of the disclosed technology relate to an apparatus including a memory and at least one processor. The at least one processor can obtain at least one image of a scene and determine a portion of interest within the scene based on a first input. The first input can include a non-touch input. The at least one processor can output, in response to the first input, content associated with the portion of interest and receive a second input from the user. The second input can include a non-eye gaze input and be associated with the content. An action can be initiated by the one or more processor based on the second input.
    Type: Application
    Filed: June 24, 2021
    Publication date: November 4, 2021
    Inventors: Md Sazzadur RAHMAN, Kexi LIU, Martin RENSCHLER
  • Patent number: 11068531
    Abstract: A method, an apparatus, and a computer program product conduct online visual searches through an augmented reality (AR) device having an optical see-through head mounted display (HMD). An apparatus identifies a portion of an object in a field of view of the HMD based on user interaction with the HMD. The portion includes searchable content, such as a barcode. The user interaction may be an eye gaze or a gesture. A user interaction point in relation to the HMD screen is tracked to locate a region of the object that includes the portion and the portion is detected within the region. The apparatus captures an image of the portion. The identified portion of the object does not encompass the entirety of the object. Accordingly, the size of the image is less than the size of the object in the field of view. The apparatus transmits the image to a visual search engine.
    Type: Grant
    Filed: May 16, 2019
    Date of Patent: July 20, 2021
    Assignee: QUALCOMM Incorporated
    Inventors: Md Sazzadur Rahman, Kexi Liu, Martin Renschler
  • Publication number: 20210111976
    Abstract: The present disclosure relates to methods and apparatus for display or graphics processing. Aspects of the present disclosure can determine a communication compatibility of one or more client devices. Further, aspects of the present disclosure can modify a user space or a kernel based on the communication compatibility of each of the one or more client devices. Additionally, aspects of the present disclosure can communicate at least some data with the one or more client devices based on the modified user space or the modified kernel. Aspects of the present disclosure can also modify the kernel based on the communication compatibility of each of the one or more client devices. Aspects of the present disclosure can also extend the kernel based on the communication compatibility.
    Type: Application
    Filed: October 13, 2020
    Publication date: April 15, 2021
    Inventors: David ARELLANES, Ramesh CHANDRASEKHAR, Aditya DEGWEKAR, Ashwani Kumar JHA, Rohit BANDI, Walker CURTIS, Abhijeet BISAIN, Martin RENSCHLER
  • Patent number: 10957093
    Abstract: An apparatus is configured to render graphics content to reduce latency of the graphics content. The apparatus includes a display configured to present graphics content including a first portion corresponding to an area of interest and further including a second portion. The apparatus further includes a fovea estimation engine configured to generate an indication of the area of interest based on scene information related to the graphics content. The apparatus further includes a rendering engine responsive to the fovea estimation engine. The rendering engine is configured to perform a comparison of a first result of an evaluation metric on part of the area of interest with a second result of the evaluation metric with another part of the area of interest. The rendering engine is further configured to render the graphics content using predictive adjustment to reduce latency based on the comparison.
    Type: Grant
    Filed: November 5, 2019
    Date of Patent: March 23, 2021
    Assignee: QUALCOMM Incorporated
    Inventors: Mehrad Tavakoli, Moinul Khan, Martin Renschler, Mriganka Mondal
  • Publication number: 20200186817
    Abstract: The present disclosure relates to methods and devices for motion estimation which may include a GPU. In one aspect, the GPU may generate at least one first motion vector in a first subset of a frame, the first motion vector providing a first motion estimation for image data in the first subset of the frame. The GPU may also perturb the image data. Also, the GPU may generate at least one second motion vector based on the perturbed image data, the second motion vector providing a second motion estimation for the image data. Moreover, the GPU may compare the first motion vector and the second motion vector. Further, the GPU may determine at least one third motion vector for the motion estimation of the image data based on the comparison between the first motion vector and the second motion vector.
    Type: Application
    Filed: December 10, 2018
    Publication date: June 11, 2020
    Inventors: Samuel Benjamin HOLMES, Martin RENSCHLER, Jonathan WICKS, Robert John VANREENEN
  • Publication number: 20200066024
    Abstract: An apparatus is configured to render graphics content to reduce latency of the graphics content. The apparatus includes a display configured to present graphics content including a first portion corresponding to an area of interest and further including a second portion. The apparatus further includes a fovea estimation engine configured to generate an indication of the area of interest based on scene information related to the graphics content. The apparatus further includes a rendering engine responsive to the fovea estimation engine. The rendering engine is configured to perform a comparison of a first result of an evaluation metric on part of the area of interest with a second result of the evaluation metric with another part of the area of interest. The rendering engine is further configured to render the graphics content using predictive adjustment to reduce latency based on the comparison.
    Type: Application
    Filed: November 5, 2019
    Publication date: February 27, 2020
    Inventors: Mehrad Tavakoli, Moinul Khan, Martin Renschler, Mriganka Mondal
  • Patent number: 10482648
    Abstract: An apparatus is configured to render graphics content to reduce latency of the graphics content. The apparatus includes a display configured to present graphics content including a first portion corresponding to an area of interest and further including a second portion. The apparatus further includes a fovea estimation engine configured to generate an indication of the area of interest based on scene information related to the graphics content. The apparatus further includes a rendering engine responsive to the fovea estimation engine. The rendering engine is configured to perform a comparison of a first result of an evaluation metric on part of the area of interest with a second result of the evaluation metric with another part of the area of interest. The rendering engine is further configured to render the graphics content using predictive adjustment to reduce latency based on the comparison.
    Type: Grant
    Filed: December 13, 2016
    Date of Patent: November 19, 2019
    Assignee: QUALCOMM Incorporated
    Inventors: Mehrad Tavakoli, Moinul Khan, Martin Renschler, Mriganka Mondal
  • Publication number: 20190278799
    Abstract: A method, an apparatus, and a computer program product conduct online visual searches through an augmented reality (AR) device having an optical see-through head mounted display (HMD). An apparatus identifies a portion of an object in a field of view of the HMD based on user interaction with the HMD. The portion includes searchable content, such as a barcode. The user interaction may be an eye gaze or a gesture. A user interaction point in relation to the HMD screen is tracked to locate a region of the object that includes the portion and the portion is detected within the region. The apparatus captures an image of the portion. The identified portion of the object does not encompass the entirety of the object. Accordingly, the size of the image is less than the size of the object in the field of view. The apparatus transmits the image to a visual search engine.
    Type: Application
    Filed: May 16, 2019
    Publication date: September 12, 2019
    Inventors: Md Sazzadur RAHMAN, Kexi LIU, Martin RENSCHLER
  • Patent number: 10372751
    Abstract: A method, an apparatus, and a computer program product conduct online visual searches through an augmented reality (AR) device having an optical see-through head mounted display (HMD). An apparatus identifies a portion of an object in a field of view of the HMD based on user interaction with the HMD. The portion includes searchable content, such as a barcode. The user interaction may be an eye gaze or a gesture. A user interaction point in relation to the HMD screen is tracked to locate a region of the object that includes the portion and the portion is detected within the region. The apparatus captures an image of the portion. The identified portion of the object does not encompass the entirety of the object. Accordingly, the size of the image is less than the size of the object in the field of view. The apparatus transmits the image to a visual search engine.
    Type: Grant
    Filed: November 5, 2018
    Date of Patent: August 6, 2019
    Assignee: QUALCOMM Incorporated
    Inventors: Md Sazzadur Rahman, Kexi Liu, Martin Renschler
  • Publication number: 20190073386
    Abstract: A method, an apparatus, and a computer program product conduct online visual searches through an augmented reality (AR) device having an optical see-through head mounted display (HMD). An apparatus identifies a portion of an object in a field of view of the HMD based on user interaction with the HMD. The portion includes searchable content, such as a barcode. The user interaction may be an eye gaze or a gesture. A user interaction point in relation to the HMD screen is tracked to locate a region of the object that includes the portion and the portion is detected within the region. The apparatus captures an image of the portion. The identified portion of the object does not encompass the entirety of the object. Accordingly, the size of the image is less than the size of the object in the field of view. The apparatus transmits the image to a visual search engine.
    Type: Application
    Filed: November 5, 2018
    Publication date: March 7, 2019
    Inventors: Md Sazzadur RAHMAN, Kexi LIU, Martin RENSCHLER
  • Publication number: 20180329465
    Abstract: Disclosed are methods and systems for intelligent adjustment of an immersive multimedia workload in a portable computing device (“PCD”), such as a virtual reality (“VR”) or augmented reality (“AR”) workload. An exemplary embodiment monitors one or more performance indicators comprising a motion to photon latency associated with the immersive multimedia workload. Performance parameters associated with thermally aggressive processing components are adjusted to reduce demand for power while ensuring that the motion to photon latency is and/or remains optimized. Performance parameters that may be adjusted include, but are not limited to including, eye buffer resolution, eye buffer MSAA, timewarp CAC, eye buffer FPS, display FPS, timewarp output resolution, textures LOD, 6DOF camera FPS, and fovea size.
    Type: Application
    Filed: May 11, 2017
    Publication date: November 15, 2018
    Inventors: MEHRAD TAVAKOLI, Idreas Mir, Moinul Khan, Ronald Alton, Gheorghe Cascaval, Rajiv Vijayakumar, Mriganka Mondal, Maurice Ribble, Martin Renschler
  • Patent number: 10043318
    Abstract: Certain aspects of the present disclosure provide methods and apparatus for operating a wearable display device. Certain aspects of the present disclosure provide a method for operating a wearable display device. The method includes determining a position of the wearable display device based on a motion sensor. The method includes rendering, by a graphics processing unit, an image based on the determined position. The method includes determining a first updated position of the wearable display device based on the motion sensor. The method includes warping, by a warp engine, a first portion of the rendered image based on the first updated position. The method includes displaying the warped first portion of the rendered image on a display of the wearable display device.
    Type: Grant
    Filed: December 9, 2016
    Date of Patent: August 7, 2018
    Assignee: QUALCOMM Incorporated
    Inventors: Moinul Khan, Nhon Quach, Martin Renschler, Ramesh Chandrasekhar, Assaf Menachem, Ning Bi, Maurice Ribble
  • Publication number: 20180217663
    Abstract: A method by a wearable device is described. The method includes receiving geometric information from a controller. The geometric information includes a point cloud and a key frame of the controller. The method also includes receiving first six degree of freedom (6DoF) pose information from the controller. The method further includes synchronizing a coordinate system of the wearable device with a coordinate system of the controller based on the point cloud and the key frame of the controller. The method additionally includes rendering content in an application based on the first 6DoF pose information.
    Type: Application
    Filed: January 27, 2017
    Publication date: August 2, 2018
    Inventors: Ramesh Chandrasekhar, Md Sazzadur Rahman, Martin Renschler, Ananthapadmanabhan Arasanipalai Kandhadai
  • Publication number: 20180165792
    Abstract: An apparatus is configured to render graphics content to reduce latency of the graphics content. The apparatus includes a display configured to present graphics content including a first portion corresponding to an area of interest and further including a second portion. The apparatus further includes a fovea estimation engine configured to generate an indication of the area of interest based on scene information related to the graphics content. The apparatus further includes a rendering engine responsive to the fovea estimation engine. The rendering engine is configured to perform a comparison of a first result of an evaluation metric on part of the area of interest with a second result of the evaluation metric with another part of the area of interest. The rendering engine is further configured to render the graphics content using predictive adjustment to reduce latency based on the comparison.
    Type: Application
    Filed: December 13, 2016
    Publication date: June 14, 2018
    Inventors: Mehrad Tavakoli, Moinul Khan, Martin Renschler, Mriganka Mondal
  • Publication number: 20180165878
    Abstract: Certain aspects of the present disclosure provide methods and apparatus for operating a wearable display device. Certain aspects of the present disclosure provide a method for operating a wearable display device. The method includes determining a position of the wearable display device based on a motion sensor. The method includes rendering, by a graphics processing unit, an image based on the determined position. The method includes determining a first updated position of the wearable display device based on the motion sensor. The method includes warping, by a warp engine, a first portion of the rendered image based on the first updated position. The method includes displaying the warped first portion of the rendered image on a display of the wearable display device.
    Type: Application
    Filed: December 9, 2016
    Publication date: June 14, 2018
    Inventors: Moinul KHAN, Nhon QUACH, Martin RENSCHLER, Ramesh CHANDRASEKHAR, Assaf MENACHEM, Ning BI, Maurice RIBBLE
  • Patent number: 9858637
    Abstract: Systems, methods, and computer programs are disclosed for reducing motion-to-photon latency and memory bandwidth in a virtual reality display system. An exemplary method involves receiving sensor data from one or more sensors tracking translational and rotational motion of a user for a virtual reality application. An updated position of the user is computed based on the received sensor data. The speed and acceleration of the user movement may be computed based on the sensor data. The updated position, the speed, and the acceleration may be provided to a warp engine configured to update a rendered image before sending to a virtual reality display based on one or more of the updated position, the speed, and the acceleration.
    Type: Grant
    Filed: August 31, 2016
    Date of Patent: January 2, 2018
    Assignee: QUALCOMM Incorporated
    Inventors: Nhon Quach, Moinul Khan, Maurice Ribble, Martin Renschler, Mehrad Tavakoli, Rashmi Kulkarni, Ricky Wai Kit Yuen, Todd Lemoine
  • Publication number: 20170324831
    Abstract: Information transfer methods for exchange of information with a wireless access terminal (W-AT) includes receiving a first message from the W-AT, the first message including first information provided by the W-AT and an address of the W-AT capable of identifying the W-AT, converting the first message to an anonymized message by replacing the W-AT address with a transaction identifier (ID), transmitting the anonymized message to a remote server, receiving a first response from the remote server, the first response having response information and the anonymized address information, converting the first response to a second response by replacing the transaction ID with the W-AT address, and transmitting the second response to the W-AT.
    Type: Application
    Filed: July 25, 2017
    Publication date: November 9, 2017
    Inventors: Martin Renschler, Pooja Aggarwal, Dilip Krishnaswamy, Robert Daley, Patrik Lundqvist
  • Patent number: 9417329
    Abstract: A method, an apparatus, and a computer program product for initiating at least one process in a vehicle are provided. The apparatus determines an approximate position of the vehicle. In addition, the apparatus determines a shortest time period based on the determined approximate position in which one or more registered drivers of the vehicle is in proximity to the vehicle. Furthermore, the apparatus determines whether to initiate the at least one process within the vehicle based on the determined time period.
    Type: Grant
    Filed: March 19, 2012
    Date of Patent: August 16, 2016
    Assignee: QUALCOMM Incorporated
    Inventors: Babak Forutanpour, Jeffrey D. Beckley, Shivakumar Balasubramanyam, Martin Renschler
  • Patent number: 9203912
    Abstract: Methods and systems for determining a suitability for a mobile client to display information are disclosed. A particular exemplary method includes generating a first value for a first targeted content message based on at least a first weighted sum of first user profile attributes, a user profile attribute being a numeric quantity relating to at least one of a preference and a demographic of a user of the mobile client, comparing the first value with a stored list of second values related to respective stored messages in a cache memory of the mobile client to produce a comparison result; and updating the cache memory based on the comparison result by storing the first targeted content message in the cache memory if the comparison result indicates a higher desirability of the first targeted content message over at least one stored message.
    Type: Grant
    Filed: November 11, 2008
    Date of Patent: December 1, 2015
    Assignee: QUALCOMM Incorporated
    Inventors: Dilip Krishnaswamy, Pooja Aggarwal, Robert S Daley, Martin Renschler, Patrik Lundqvist
  • Publication number: 20130245884
    Abstract: A method, an apparatus, and a computer program product for initiating at least one process in a vehicle are provided. The apparatus determines an approximate position of the vehicle. In addition, the apparatus determines a shortest time period based on the determined approximate position in which one or more registered drivers of the vehicle is in proximity to the vehicle. Furthermore, the apparatus determines whether to initiate the at least one process within the vehicle based on the determined time period.
    Type: Application
    Filed: March 19, 2012
    Publication date: September 19, 2013
    Applicant: QUALCOMM INCORPORATED
    Inventors: Babak FORUTANPOUR, Jeffrey D. BECKLEY, Shivakumar BALASUBRAMANYAM, Martin RENSCHLER