Patents by Inventor Martin H. Renschler

Martin H. Renschler has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11366515
    Abstract: An apparatus, a method, and a computer program product are provided. The apparatus detects an eye gaze on a first region in a real world scene, sets a boundary that surrounds the first region, the boundary excluding at least a second region in the real world scene, performs an object recognition procedure on the first region within the boundary, and refrains from performing an object recognition procedure on the at least the second region.
    Type: Grant
    Filed: May 23, 2019
    Date of Patent: June 21, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Kexi Liu, Frederick D. Kim, Martin H. Renschler
  • Patent number: 10914951
    Abstract: A method, an apparatus, and a computer program product provide feedback to a user of an augmented reality (AR) device having an optical see-through head mounted display (HMD). The apparatus obtains a location on the HMD corresponding to a user interaction with an object displayed on the HMD. The object may be an icon on the HMD and the user interaction may be an attempt by the user to select the icon through an eye gaze or gesture. The apparatus determines whether a spatial relationship between the location of user interaction and the object satisfies a criterion, and outputs a sensory indication, e.g., visual display, sound, vibration, when the criterion is satisfied. The apparatus may be configured to output a sensory indication when user interaction is successful, e.g., the icon was selected. Alternatively, the apparatus may be configured to output a sensory indication when the user interaction fails.
    Type: Grant
    Filed: January 23, 2014
    Date of Patent: February 9, 2021
    Assignee: QUALCOMM Incorporated
    Inventors: Kexi Liu, Vijay Naicker Subramaniam, Md Sazzadur Rahman, Martin H. Renschler
  • Patent number: 10681021
    Abstract: A system and method provide for the selective authorization and admission of a client into a data sharing session with a host. A host may select one or more clients into the sharing session based on the proximity of the clients. When a client is selected, an identifier is provided from the client device to the host device, for example, utilizing an optical identifier such as a bar code or an audible identifier such as an encoded sound. The identifier is then utilized to establish a link between the client and the host. In this fashion any number of client devices may be selectively admitted into the sharing session in a quick and easy process enabling security for the host and anonymity for the client.
    Type: Grant
    Filed: June 1, 2011
    Date of Patent: June 9, 2020
  • Publication number: 20190278367
    Abstract: An apparatus, a method, and a computer program product are provided. The apparatus detects an eye gaze on a first region in a real world scene, sets a boundary that surrounds the first region, the boundary excluding at least a second region in the real world scene, performs an object recognition procedure on the first region within the boundary, and refrains from performing an object recognition procedure on the at least the second region.
    Type: Application
    Filed: May 23, 2019
    Publication date: September 12, 2019
  • Patent number: 10359841
    Abstract: An apparatus, a method, and a computer program product are provided. The apparatus detects an eye gaze on a first region in a real world scene, sets a boundary that surrounds the first region, the boundary excluding at least a second region in the real world scene, performs an object recognition procedure on the first region within the boundary, and refrains from performing an object recognition procedure on the at least the second region.
    Type: Grant
    Filed: January 13, 2013
    Date of Patent: July 23, 2019
  • Patent number: 10152495
    Abstract: A method, an apparatus, and a computer program product conduct online visual searches through an augmented reality (AR) device having an optical see-through head mounted display (HMD). An apparatus identifies a portion of an object in a field of view of the HMD based on user interaction with the HMD. The portion includes searchable content, such as a barcode. The user interaction may be an eye gaze or a gesture. A user interaction point in relation to the HMD screen is tracked to locate a region of the object that includes the portion and the portion is detected within the region. The apparatus captures an image of the portion. The identified portion of the object does not encompass the entirety of the object. Accordingly, the size of the image is less than the size of the object in the field of view. The apparatus transmits the image to a visual search engine.
    Type: Grant
    Filed: January 9, 2014
    Date of Patent: December 11, 2018
    Assignee: QUALCOMM Incorporated
    Inventors: Md Sazzadur Rahman, Kexi Liu, Martin H. Renschler
  • Patent number: 10089786
    Abstract: A method, an apparatus, and a computer program product render a graphical user interface (GUI) on an optical see-through head mounted display (HMD). The apparatus obtains a location on the HMD corresponding to a user interaction with a GUI object displayed on the HMD. The GUI object may be an icon on the HMD and the user interaction may be an attempt by the user to select the icon through an eye gaze or gesture. The apparatus determines whether a spatial relationship between the location of user interaction and the GUI object satisfies a criterion, and adjusts a parameter of the GUI object when the criterion is not satisfied. The parameter may be one or more of a size of the GUI object, a size of a boundary associated with the GUI object or a location of the GUI object.
    Type: Grant
    Filed: January 9, 2014
    Date of Patent: October 2, 2018
    Assignee: QUALCOMM Incorporated
    Inventors: Kexi Liu, Md Sazzadur Rahman, Martin H. Renschler, Babak Forutanpour
  • Patent number: 10073518
    Abstract: An apparatus for calibrating an eye tracking system of a head mounted display displays a moving object in a scene visible through the head mounted display. The object is displayed progressively at a plurality of different points (P) at corresponding different times (T). While the object is at a first point of the plurality of different points in time, the apparatus determines whether an offset between the point P and an eye gaze point (E) satisfies a threshold. The eye-gaze point (E) corresponds to a point where a user is determined to be gazing by the eye tracking system. If the threshold is not satisfied, the apparatus performs a calibration of the eye tracking system when the object is at a second point of the plurality of different points in time. The apparatus then repeats the determining step when the object is at a third point of the plurality of different points in time.
    Type: Grant
    Filed: January 23, 2014
    Date of Patent: September 11, 2018
    Assignee: QUALCOMM Incorporated
    Inventors: Md Sazzadur Rahman, Kexi Liu, Martin H. Renschler
  • Patent number: 9264702
    Abstract: An apparatus for calibrating an augmented reality (AR) device having an optical see-through head mounted display (HMD) obtains eye coordinates in an eye coordinate system corresponding to a location of an eye of a user of the AR device, and obtains object coordinates in a world coordinate system corresponding to a location of a real-world object in the field of view of the AR device, as captured by a scene camera having a scene camera coordinate system. The apparatus calculates screen coordinates in a screen coordinate system corresponding to a display point on the HMD, where the calculating is based on the obtained eye coordinates and the obtained object coordinates. The apparatus calculates calibration data based on the screen coordinates, the object coordinates and a transformation from the target coordinate system to the scene camera coordinate system. The apparatus then derives subsequent screen coordinates for the display of AR in relation to other real-world object points based on the calibration data.
    Type: Grant
    Filed: January 9, 2014
    Date of Patent: February 16, 2016
    Assignee: QUALCOMM Incorporated
    Inventors: Kexi Liu, Md Sazzadur Rahman, Martin H. Renschler
  • Publication number: 20150049113
    Abstract: A method, an apparatus, and a computer program product conduct online visual searches through an augmented reality (AR) device having an optical see-through head mounted display (HMD). An apparatus identifies a portion of an object in a field of view of the HMD based on user interaction with the HMD. The portion includes searchable content, such as a barcode. The user interaction may be an eye gaze or a gesture. A user interaction point in relation to the HMD screen is tracked to locate a region of the object that includes the portion and the portion is detected within the region. The apparatus captures an image of the portion. The identified portion of the object does not encompass the entirety of the object. Accordingly, the size of the image is less than the size of the object in the field of view. The apparatus transmits the image to a visual search engine.
    Type: Application
    Filed: January 9, 2014
    Publication date: February 19, 2015
    Applicant: QUALCOMM INCORPORATED
    Inventors: Md Sazzadur RAHMAN, Kexi LIU, Martin H. RENSCHLER
  • Publication number: 20150049112
    Abstract: A method, an apparatus, and a computer program product render a graphical user interface (GUI) on an optical see-through head mounted display (HMD). The apparatus obtains a location on the HMD corresponding to a user interaction with a GUI object displayed on the HMD. The GUI object may be an icon on the HMD and the user interaction may be an attempt by the user to select the icon through an eye gaze or gesture. The apparatus determines whether a spatial relationship between the location of user interaction and the GUI object satisfies a criterion, and adjusts a parameter of the GUI object when the criterion is not satisfied. The parameter may be one or more of a size of the GUI object, a size of a boundary associated with the GUI object or a location of the GUI object.
    Type: Application
    Filed: January 9, 2014
    Publication date: February 19, 2015
    Applicant: QUALCOMM Incorporated
    Inventors: Kexi LIU, Md Sazzadur RAHMAN, Martin H. RENSCHLER, Babak FORUTANPOUR
  • Publication number: 20150049013
    Abstract: An apparatus for calibrating an eye tracking system of a head mounted display displays a moving object in a scene visible through the head mounted display. The object is displayed progressively at a plurality of different points (P) at corresponding different times (T). While the object is at a first point of the plurality of different points in time, the apparatus determines whether an offset between the point P and an eye gaze point (E) satisfies a threshold. The eye-gaze point (E) corresponds to a point where a user is determined to be gazing by the eye tracking system. If the threshold is not satisfied, the apparatus performs a calibration of the eye tracking system when the object is at a second point of the plurality of different points in time. The apparatus then repeats the determining step when the object is at a third point of the plurality of different points in time.
    Type: Application
    Filed: January 23, 2014
    Publication date: February 19, 2015
    Applicant: QUALCOMM Incorporated
    Inventors: Md Sazzadur RAHMAN, Kexi LIU, Martin H. RENSCHLER
  • Publication number: 20150049001
    Abstract: A method, an apparatus, and a computer program product construct an augmented view as perceived by a user of an augmented reality (AR) device having an optical see-through head mounted display (HMD) with AR, for display at a remote device. An apparatus obtains scene data corresponding to a real-world scene visible through the optical see-through HMD, and screen data of at least one of a first augmented object displayed on the optical see-through HMD, and a second augmented object displayed on the optical see-through HMD. The apparatus determines to apply at least one of a first offset to the first augmented object relative to an origin of the real-world scene, and a second offset to the second augmented object relative to the origin. The apparatus then generates augmented-view screen data for displaying the augmented view on an HMD remote from the AR device. The augmented-view screen data is based on at least one of the first offset and the second offset.
    Type: Application
    Filed: January 9, 2014
    Publication date: February 19, 2015
    Applicant: QUALCOMM Incorporated
    Inventors: Md Sazzadur RAHMAN, Martin H. RENSCHLER, Kexi LIU
  • Publication number: 20150049012
    Abstract: A method, an apparatus, and a computer program product provide feedback to a user of an augmented reality (AR) device having an optical see-through head mounted display (HMD). The apparatus obtains a location on the HMD corresponding to a user interaction with an object displayed on the HMD. The object may be an icon on the HMD and the user interaction may be an attempt by the user to select the icon through an eye gaze or gesture. The apparatus determines whether a spatial relationship between the location of user interaction and the object satisfies a criterion, and outputs a sensory indication, e.g., visual display, sound, vibration, when the criterion is satisfied. The apparatus may be configured to output a sensory indication when user interaction is successful, e.g., the icon was selected. Alternatively, the apparatus may be configured to output a sensory indication when the user interaction fails.
    Type: Application
    Filed: January 23, 2014
    Publication date: February 19, 2015
    Applicant: QUALCOMM Incorporated
    Inventors: Kexi LIU, Vijay Naicker SUBRAMANIAM, Md Sazzadur RAHMAN, Martin H. RENSCHLER
  • Publication number: 20150049201
    Abstract: An apparatus for calibrating an augmented reality (AR) device having an optical see-through head mounted display (HMD) obtains eye coordinates in an eye coordinate system corresponding to a location of an eye of a user of the AR device, and obtains object coordinates in a world coordinate system corresponding to a location of a real-world object in the field of view of the AR device, as captured by a scene camera having a scene camera coordinate system. The apparatus calculates screen coordinates in a screen coordinate system corresponding to a display point on the HMD, where the calculating is based on the obtained eye coordinates and the obtained object coordinates. The apparatus calculates calibration data based on the screen coordinates, the object coordinates and a transformation from the target coordinate system to the scene camera coordinate system. The apparatus then derives subsequent screen coordinates for the display of AR in relation to other real-world object points based on the calibration data.
    Type: Application
    Filed: January 9, 2014
    Publication date: February 19, 2015
    Applicant: QUALCOMM Incorporated
    Inventors: Kexi LIU, Md Sazzadur RAHMAN, Martin H. RENSCHLER
  • Patent number: 8901783
    Abstract: Techniques for providing directional force induction in a handheld device for use in, e.g., personal navigation applications. In an exemplary embodiment, a magnetic element is provided on a mechanical support fixedly attached to a chassis of the handheld device. One or more conducting coils surround the support. Current is generated in the one or more conducting coils to accelerate the magnetic element relative to the support, causing a tactilely perceptible force to a user of the handheld device due to the recoil of the chassis from the movement of the magnetic element. In an exemplary embodiment, passive movement of the magnetic element due to, e.g., physical jostling of the handheld device, may be used to deliver energy back to the system for energy harvesting.
    Type: Grant
    Filed: August 24, 2010
    Date of Patent: December 2, 2014
    Assignee: QUALCOMM Incorporated
    Inventors: Sherman A. Gregory, Martin H. Renschler
  • Patent number: 8866840
    Abstract: In a particular embodiment, a method includes detecting a hardware configuration change at an electronic device. The electronic device includes at least a first panel having a first display surface and a second panel having a second display surface. An effective screen size or a screen resolution corresponding to a viewing area that includes the first display surface and the second display surface is modified in response to the hardware configuration change. The method also includes sending at least one parameter associated with or based on the modified effective screen size or the modified screen resolution to a server.
    Type: Grant
    Filed: September 3, 2009
    Date of Patent: October 21, 2014
    Assignee: Qualcomm Incorporated
    Inventors: Sten Jorgen Ludvig Dahl, Bennett M. King, Thomas E. Kilpatrick, II, Dimosthenis Kaleas, Martin H. Renschler, Robert S. Daley
  • Publication number: 20120311165
    Abstract: A system and method provide for the selective authorization and admission of a client into a data sharing session with a host. A host may select one or more clients into the sharing session based on the proximity of the clients. When a client is selected, an identifier is provided from the client device to the host device, for example, utilizing an optical identifier such as a bar code or an audible identifier such as an encoded sound. The identifier is then utilized to establish a link between the client and the host. In this fashion any number of client devices may be selectively admitted into the sharing session in a quick and easy process enabling security for the host and anonymity for the client.
    Type: Application
    Filed: June 1, 2011
    Publication date: December 6, 2012
  • Publication number: 20120049659
    Abstract: Techniques for providing directional force induction in a handheld device for use in, e.g., personal navigation applications. In an exemplary embodiment, a magnetic element is provided on a mechanical support fixedly attached to a chassis of the handheld device. One or more conducting coils surround the support. Current is generated in the one or more conducting coils to accelerate the magnetic element relative to the support, causing a tactilely perceptible force to a user of the handheld device due to the recoil of the chassis from the movement of the magnetic element. In an exemplary embodiment, passive movement of the magnetic element due to, e.g., physical jostling of the handheld device, may be used to deliver energy back to the system for energy harvesting.
    Type: Application
    Filed: August 24, 2010
    Publication date: March 1, 2012
    Applicant: QUALCOMM Incorporated
    Inventors: Sherman A. Gregory, Martin H. Renschler
  • Publication number: 20110216064
    Abstract: In a particular embodiment, a method includes detecting a hardware configuration change at an electronic device. The electronic device includes at least a first panel having a first display surface and a second panel having a second display surface. An effective screen size or a screen resolution corresponding to a viewing area that includes the first display surface and the second display surface is modified in response to the hardware configuration change. The method also includes sending at least one parameter associated with or based on the modified effective screen size or the modified screen resolution to a server.
    Type: Application
    Filed: September 3, 2009
    Publication date: September 8, 2011
    Applicant: QUALCOMM Incorporated
    Inventors: Sten Jorgen Ludvig Dahl, Bennett M. King, Thomas E. Kilpatrick, II, Dimosthenis Kaleas, Martin H. Renschler, Robert S. Daley