Patents by Inventor Martin Renschler
Martin Renschler has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240036640Abstract: Techniques and systems are provided for attention evaluation by an extended reality system. In some examples, the system determines one or more regions of interest (ROI) for an image displayed to a user. The system may also receive eye tracking information indicating an area of the image that the user is looking at. The system may further generate focus statistics based on the area of the image at which the user is looking at and the one or more ROI; and output the generated focus statistics.Type: ApplicationFiled: July 29, 2022Publication date: February 1, 2024Inventors: Danlu ZHANG, Paul HOLDAWAY, Jiaying PAN, Ajinkya Shyam AMBRE, Vinayak MURALIDHARAN, Martin RENSCHLER, Michael MAGER, Brian MOMEYER, Rashmi KULKARNI, Damir DIDJUSTO
-
Publication number: 20230360227Abstract: Systems and techniques are provided for synchronizing a frame rate of pass-through content from a camera and a display refresh rate. An example method can include obtaining first and second frames captured by an image capture device (which may be part of a device, such as an extended reality (XR) device). A display refresh rate of a display is greater than a camera frame rate of the image capture device. The method may determine motion between the first frame and the second frame. The method can include predicting, based on the second frame and the determined motion, a third frame corresponding to a time after the second frame. The method can include displaying content (e.g., mixed reality content) including the predicted third frame and virtual content rendered for the XR device.Type: ApplicationFiled: May 9, 2022Publication date: November 9, 2023Inventors: Samuel Benjamin HOLMES, Jonathan WICKS, Arjun CHOPRA, Martin RENSCHLER
-
Publication number: 20230341930Abstract: A method by a wearable device is described. The method includes receiving geometric information from a controller. The geometric information includes a point cloud and a key frame of the controller. The method also includes receiving first six degree of freedom (6DoF) pose information from the controller. The method further includes synchronizing a coordinate system of the wearable device with a coordinate system of the controller based on the point cloud and the key frame of the controller. The method additionally includes rendering content in an application based on the first 6DoF pose information.Type: ApplicationFiled: June 27, 2023Publication date: October 26, 2023Inventors: Ramesh CHANDRASEKHAR, Md Sazzadur RAHMAN, Martin RENSCHLER, Ananthapadmanabhan Arasanipalai KANDHADAI
-
Publication number: 20230342388Abstract: Techniques can conduct online visual searches through an augmented reality (AR) device having an optical see-through head mounted display (HMD). An apparatus identifies a portion of an object in a field of view of the HMD based on user interaction with the HMD. The portion includes searchable content, such as a barcode. The user interaction may be an eye gaze or a gesture. A user interaction point in relation to the HMD screen is tracked to locate a region of the object that includes the portion and the portion is detected within the region. The apparatus captures an image of the portion. The identified portion of the object does not encompass the entirety of the object. Accordingly, the size of the image is less than the size of the object in the field of view. The apparatus transmits the image to a visual search engine.Type: ApplicationFiled: June 29, 2023Publication date: October 26, 2023Inventors: Md Sazzadur RAHMAN, Kexi LIU, Martin RENSCHLER
-
Patent number: 11740690Abstract: A method by a wearable device is described. The method includes receiving geometric information from a controller. The geometric information includes a point cloud and a key frame of the controller. The method also includes receiving first six degree of freedom (6DoF) pose information from the controller. The method further includes synchronizing a coordinate system of the wearable device with a coordinate system of the controller based on the point cloud and the key frame of the controller. The method additionally includes rendering content in an application based on the first 6DoF pose information.Type: GrantFiled: January 27, 2017Date of Patent: August 29, 2023Assignee: QUALCOMM IncorporatedInventors: Ramesh Chandrasekhar, Md Sazzadur Rahman, Martin Renschler, Ananthapadmanabhan Arasanipalai Kandhadai
-
Patent number: 11734336Abstract: Aspects of the disclosed technology relate to an apparatus including a memory and at least one processor. The at least one processor can obtain at least one image of a scene and determine a portion of interest within the scene based on a first input. The first input can include a non-touch input. The at least one processor can output, in response to the first input, content associated with the portion of interest and receive a second input from the user. The second input can include a non-eye gaze input and be associated with the content. An action can be initiated by the one or more processor based on the second input.Type: GrantFiled: June 24, 2021Date of Patent: August 22, 2023Assignee: QUALCOMM IncorporatedInventors: Md Sazzadur Rahman, Kexi Liu, Martin Renschler
-
Publication number: 20230206385Abstract: Examples are described of marking specified regions of stored image frame buffer data in an image frame buffer. An imaging system can read the specified regions of the image frame buffer to identify whether the marking has been overwritten or not. The imaging system can thus efficiently identify how much of the image frame buffer has been overwritten with data from a new image frame. Based on this, the imaging system can retrieve partial image frame data from the image frame buffer and can process the partial image frame data, for instance to composite the partial image frame data with virtual content and/or to perform distortion compensation. The processed partial image frame data can be uploaded to a display buffer and displayed by a display, either as-is or once more of the frame is captured and processed. The imaging system can also perform auto-exposure using the partial image frame data.Type: ApplicationFiled: February 22, 2023Publication date: June 29, 2023Inventors: Martin RENSCHLER, Cullum James BALDWIN, Michael MAGER, Gautham MAYYURI, Bijan FORUTANPOUR
-
Patent number: 11620725Abstract: Examples are described of marking specified regions of stored image frame buffer data in an image frame buffer. An imaging system can read the specified regions of the image frame buffer to identify whether the marking has been overwritten or not. The imaging system can thus efficiently identify how much of the image frame buffer has been overwritten with data from a new image frame. Based on this, the imaging system can retrieve partial image frame data from the image frame buffer and can process the partial image frame data, for instance to composite the partial image frame data with virtual content and/or to perform distortion compensation. The processed partial image frame data can be uploaded to a display buffer and displayed by a display, either as-is or once more of the frame is captured and processed. The imaging system can also perform auto-exposure using the partial image frame data.Type: GrantFiled: June 22, 2021Date of Patent: April 4, 2023Assignee: QUALCOMM IncorporatedInventors: Martin Renschler, Cullum James Baldwin, Michael Mager, Gautham Mayyuri, Bijan Forutanpour
-
Publication number: 20230062244Abstract: Systems, methods, and non-transitory media are provided for extended reality (XR) control of smart devices. An example method can include generating, by a first computing device, a cryptographic key; outputting, by the first computing device, a pattern that encodes the cryptographic key, the pattern including a visual pattern, an audio pattern, and/or a light pattern; receiving, by the first computing device from a second computing device, a signed message including a command to modify an operation of the first computing device; determining, by the first computing device, whether the signed message is signed with the cryptographic key encoded in the pattern; and based on a determination that the signed message is signed with the cryptographic key encoded in the pattern, modifying the operation of the first computing device according to the command in the signed message.Type: ApplicationFiled: September 1, 2021Publication date: March 2, 2023Inventors: Wesley James HOLLAND, Brian VOGELSANG, Robert TARTZ, Martin RENSCHLER
-
Publication number: 20220261951Abstract: Examples are described of marking specified regions of stored image frame buffer data in an image frame buffer. An imaging system can read the specified regions of the image frame buffer to identify whether the marking has been overwritten or not. The imaging system can thus efficiently identify how much of the image frame buffer has been overwritten with data from a new image frame. Based on this, the imaging system can retrieve partial image frame data from the image frame buffer and can process the partial image frame data, for instance to composite the partial image frame data with virtual content and/or to perform distortion compensation. The processed partial image frame data can be uploaded to a display buffer and displayed by a display, either as-is or once more of the frame is captured and processed. The imaging system can also perform auto-exposure using the partial image frame data.Type: ApplicationFiled: June 22, 2021Publication date: August 18, 2022Inventors: Martin RENSCHLER, Cullum James BALDWIN, Michael MAGER, Gautham MAYYURI, Bijan FORUTANPOUR
-
Patent number: 11388432Abstract: The present disclosure relates to methods and devices for motion estimation which may include a GPU. In one aspect, the GPU may generate at least one first motion vector in a first subset of a frame, the first motion vector providing a first motion estimation for image data in the first subset of the frame. The GPU may also perturb the image data. Also, the GPU may generate at least one second motion vector based on the perturbed image data, the second motion vector providing a second motion estimation for the image data. Moreover, the GPU may compare the first motion vector and the second motion vector. Further, the GPU may determine at least one third motion vector for the motion estimation of the image data based on the comparison between the first motion vector and the second motion vector.Type: GrantFiled: December 10, 2018Date of Patent: July 12, 2022Assignee: QUALCOMM IncorporatedInventors: Samuel Benjamin Holmes, Martin Renschler, Jonathan Wicks, Robert John Vanreenen
-
Publication number: 20210342387Abstract: Aspects of the disclosed technology relate to an apparatus including a memory and at least one processor. The at least one processor can obtain at least one image of a scene and determine a portion of interest within the scene based on a first input. The first input can include a non-touch input. The at least one processor can output, in response to the first input, content associated with the portion of interest and receive a second input from the user. The second input can include a non-eye gaze input and be associated with the content. An action can be initiated by the one or more processor based on the second input.Type: ApplicationFiled: June 24, 2021Publication date: November 4, 2021Inventors: Md Sazzadur RAHMAN, Kexi LIU, Martin RENSCHLER
-
Patent number: 11068531Abstract: A method, an apparatus, and a computer program product conduct online visual searches through an augmented reality (AR) device having an optical see-through head mounted display (HMD). An apparatus identifies a portion of an object in a field of view of the HMD based on user interaction with the HMD. The portion includes searchable content, such as a barcode. The user interaction may be an eye gaze or a gesture. A user interaction point in relation to the HMD screen is tracked to locate a region of the object that includes the portion and the portion is detected within the region. The apparatus captures an image of the portion. The identified portion of the object does not encompass the entirety of the object. Accordingly, the size of the image is less than the size of the object in the field of view. The apparatus transmits the image to a visual search engine.Type: GrantFiled: May 16, 2019Date of Patent: July 20, 2021Assignee: QUALCOMM IncorporatedInventors: Md Sazzadur Rahman, Kexi Liu, Martin Renschler
-
Publication number: 20210111976Abstract: The present disclosure relates to methods and apparatus for display or graphics processing. Aspects of the present disclosure can determine a communication compatibility of one or more client devices. Further, aspects of the present disclosure can modify a user space or a kernel based on the communication compatibility of each of the one or more client devices. Additionally, aspects of the present disclosure can communicate at least some data with the one or more client devices based on the modified user space or the modified kernel. Aspects of the present disclosure can also modify the kernel based on the communication compatibility of each of the one or more client devices. Aspects of the present disclosure can also extend the kernel based on the communication compatibility.Type: ApplicationFiled: October 13, 2020Publication date: April 15, 2021Inventors: David ARELLANES, Ramesh CHANDRASEKHAR, Aditya DEGWEKAR, Ashwani Kumar JHA, Rohit BANDI, Walker CURTIS, Abhijeet BISAIN, Martin RENSCHLER
-
Patent number: 10957093Abstract: An apparatus is configured to render graphics content to reduce latency of the graphics content. The apparatus includes a display configured to present graphics content including a first portion corresponding to an area of interest and further including a second portion. The apparatus further includes a fovea estimation engine configured to generate an indication of the area of interest based on scene information related to the graphics content. The apparatus further includes a rendering engine responsive to the fovea estimation engine. The rendering engine is configured to perform a comparison of a first result of an evaluation metric on part of the area of interest with a second result of the evaluation metric with another part of the area of interest. The rendering engine is further configured to render the graphics content using predictive adjustment to reduce latency based on the comparison.Type: GrantFiled: November 5, 2019Date of Patent: March 23, 2021Assignee: QUALCOMM IncorporatedInventors: Mehrad Tavakoli, Moinul Khan, Martin Renschler, Mriganka Mondal
-
Publication number: 20200186817Abstract: The present disclosure relates to methods and devices for motion estimation which may include a GPU. In one aspect, the GPU may generate at least one first motion vector in a first subset of a frame, the first motion vector providing a first motion estimation for image data in the first subset of the frame. The GPU may also perturb the image data. Also, the GPU may generate at least one second motion vector based on the perturbed image data, the second motion vector providing a second motion estimation for the image data. Moreover, the GPU may compare the first motion vector and the second motion vector. Further, the GPU may determine at least one third motion vector for the motion estimation of the image data based on the comparison between the first motion vector and the second motion vector.Type: ApplicationFiled: December 10, 2018Publication date: June 11, 2020Inventors: Samuel Benjamin HOLMES, Martin RENSCHLER, Jonathan WICKS, Robert John VANREENEN
-
Publication number: 20200066024Abstract: An apparatus is configured to render graphics content to reduce latency of the graphics content. The apparatus includes a display configured to present graphics content including a first portion corresponding to an area of interest and further including a second portion. The apparatus further includes a fovea estimation engine configured to generate an indication of the area of interest based on scene information related to the graphics content. The apparatus further includes a rendering engine responsive to the fovea estimation engine. The rendering engine is configured to perform a comparison of a first result of an evaluation metric on part of the area of interest with a second result of the evaluation metric with another part of the area of interest. The rendering engine is further configured to render the graphics content using predictive adjustment to reduce latency based on the comparison.Type: ApplicationFiled: November 5, 2019Publication date: February 27, 2020Inventors: Mehrad Tavakoli, Moinul Khan, Martin Renschler, Mriganka Mondal
-
Patent number: 10482648Abstract: An apparatus is configured to render graphics content to reduce latency of the graphics content. The apparatus includes a display configured to present graphics content including a first portion corresponding to an area of interest and further including a second portion. The apparatus further includes a fovea estimation engine configured to generate an indication of the area of interest based on scene information related to the graphics content. The apparatus further includes a rendering engine responsive to the fovea estimation engine. The rendering engine is configured to perform a comparison of a first result of an evaluation metric on part of the area of interest with a second result of the evaluation metric with another part of the area of interest. The rendering engine is further configured to render the graphics content using predictive adjustment to reduce latency based on the comparison.Type: GrantFiled: December 13, 2016Date of Patent: November 19, 2019Assignee: QUALCOMM IncorporatedInventors: Mehrad Tavakoli, Moinul Khan, Martin Renschler, Mriganka Mondal
-
Publication number: 20190278799Abstract: A method, an apparatus, and a computer program product conduct online visual searches through an augmented reality (AR) device having an optical see-through head mounted display (HMD). An apparatus identifies a portion of an object in a field of view of the HMD based on user interaction with the HMD. The portion includes searchable content, such as a barcode. The user interaction may be an eye gaze or a gesture. A user interaction point in relation to the HMD screen is tracked to locate a region of the object that includes the portion and the portion is detected within the region. The apparatus captures an image of the portion. The identified portion of the object does not encompass the entirety of the object. Accordingly, the size of the image is less than the size of the object in the field of view. The apparatus transmits the image to a visual search engine.Type: ApplicationFiled: May 16, 2019Publication date: September 12, 2019Inventors: Md Sazzadur RAHMAN, Kexi LIU, Martin RENSCHLER
-
Patent number: 10372751Abstract: A method, an apparatus, and a computer program product conduct online visual searches through an augmented reality (AR) device having an optical see-through head mounted display (HMD). An apparatus identifies a portion of an object in a field of view of the HMD based on user interaction with the HMD. The portion includes searchable content, such as a barcode. The user interaction may be an eye gaze or a gesture. A user interaction point in relation to the HMD screen is tracked to locate a region of the object that includes the portion and the portion is detected within the region. The apparatus captures an image of the portion. The identified portion of the object does not encompass the entirety of the object. Accordingly, the size of the image is less than the size of the object in the field of view. The apparatus transmits the image to a visual search engine.Type: GrantFiled: November 5, 2018Date of Patent: August 6, 2019Assignee: QUALCOMM IncorporatedInventors: Md Sazzadur Rahman, Kexi Liu, Martin Renschler