Patents by Inventor Shree K. Nayar

Shree K. Nayar has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11954883
    Abstract: Systems and methods are provided for: receiving an image containing a code that has one or more visual qualities that fail to satisfy respective thresholds; applying a trained machine learning model to find a rough location of the code by generating a bounding box and cropping out the portion of the image; applying another trained machine learning model to the portion of the image to estimate key point locations of the code depicted in the portion of the image, aligning the portion of the image that depicts the code based on the estimated key point locations; and decoding, by the other trained machine learning model, the aligned portion of the image that depicts the code.
    Type: Grant
    Filed: August 25, 2022
    Date of Patent: April 9, 2024
    Assignee: Snap Inc.
    Inventors: Shree K. Nayar, Jian Wang, Wenzheng Chen
  • Publication number: 20240103610
    Abstract: A pose tracking system is provided. The pose tracking system includes an EMF tracking system having a user-worn head-mounted EMF source and one or more user-worn EMF tracking sensors attached to the wrists of the user. The EMF source is associated with a VIO tracking system such as AR glasses or the like. The pose tracking system determines a pose of the user's head and a ground plane using the VIO tracking system and a pose of the user's hands using the EMF tracking system to determine a full-body pose for the user. Metal interference with the EMF tracking system is minimized using an IMU mounted with the EMF tracking sensors. Long term drift in the IMU and the VIO tracking system are minimized using the EMF tracking system.
    Type: Application
    Filed: September 14, 2023
    Publication date: March 28, 2024
    Inventors: Riku Arakawa, Gurunandan Krishnan Gorumkonda, Shree K. Nayar, Bing Zhou
  • Publication number: 20240094824
    Abstract: A finger gesture recognition system is provided. The finger gesture recognition system includes one or more audio sensors and one or more optic sensors. The finger gesture recognition system captures, using the one or more audio sensors, audio signal data of a finger gesture being made by a user, and captures, using the one or more optic sensors, optic signal data of the finger gesture. The finger gesture recognition system recognizes the finger gesture based on the audio signal data and the optic signal data and communicates finger gesture data of the recognized finger gesture to an Augmented Reality/Combined Reality/Virtual Reality (XR) application.
    Type: Application
    Filed: September 14, 2023
    Publication date: March 21, 2024
    Inventors: Gurunandan Krishnan Gorumkonda, Shree K. Nayar, Chenhan Xu, Bing Zhou
  • Publication number: 20240086659
    Abstract: An apparatus to perform fast data access comprises a receiver, a processor, and a memory. The processor receives using the receiver a light signal from a light source. The light signal can be structured to generate a temporal code. The light source is an optical beacon that includes a Light-Emitting Diode (LED). The processor then decodes the light signal to generate a network address, and causes a display of a client device coupled to the apparatus to display information based on the network address. The network address can be a Uniform Resource Locator (URL) address and the information based on the network address includes a webpage associated with the URL. Other embodiments are described herein.
    Type: Application
    Filed: November 20, 2023
    Publication date: March 14, 2024
    Inventors: Jian Wang, Karl Bayer, Shree K. Nayar
  • Patent number: 11907638
    Abstract: A client device processing received emoji messages using emoji-first messaging. Text messaging is automatically converted to emojis by an emoji-first application so that only emojis are communicated from one client device to another client device. Each client device has a library of emojis that are mapped to words, which libraries are customizable and unique to the users of the client devices, such that the users can communicate secretly in code. Upon receipt of a string of emojis, a user can select the emoji string to convert to text if desired, for a predetermined period of time.
    Type: Grant
    Filed: December 29, 2022
    Date of Patent: February 20, 2024
    Assignee: SNAP INC.
    Inventors: Karl Bayer, Prerna Chikersal, Shree K. Nayar, Brian Anthony Smith
  • Patent number: 11901941
    Abstract: A client device, such as a mobile phone or a mobile phone accessory (e.g., phone case), is provided that receives and transmits data (e.g., a social media code) via light wave communication. The light wave communication may comprise structured light (e.g., projected light patterns). The client device may include a lightbox comprised of LEDs located on a back face of the client device.
    Type: Grant
    Filed: July 9, 2021
    Date of Patent: February 13, 2024
    Assignee: Snap Inc.
    Inventors: Shree K. Nayar, Mikhail Fridberg, Mohit Gupta
  • Patent number: 11888797
    Abstract: Emoji-first messaging where text messaging is automatically converted to emojis by an emoji-first application so that only emojis are communicated from one client device to another client device. Each client device has a library of emojis that are mapped to words, which libraries are customizable and unique to the users of the client devices, such that the users can communicate secretly in code. Upon receipt of a string of emojis, a user can select the emoji string to convert to text if desired, for a predetermined period of time.
    Type: Grant
    Filed: April 20, 2021
    Date of Patent: January 30, 2024
    Assignee: Snap Inc.
    Inventors: Karl Bayer, Prerna Chikersal, Shree K. Nayar, Brian Anthony Smith
  • Patent number: 11886673
    Abstract: Aspects of the present disclosure involve a system and a method for performing operations comprising: detecting physical touch of a touch-sensitive component on a back portion of a client device, the client device displaying a graphical user interface on a touch-sensitive display screen of a front portion of the client device; in response to detecting the physical touch, transmitting an electrical signal representing the physical touch of the touch-sensitive component on the back portion of the client device to the touch-sensitive display screen of the front portion of the client device; and causing an operation associated with the graphical user interface to be executed in response to the touch-sensitive display screen receiving the electrical signal representing the physical touch of the touch-sensitive component on the back portion of the client device.
    Type: Grant
    Filed: December 8, 2022
    Date of Patent: January 30, 2024
    Assignee: Snap Inc.
    Inventors: Shree K. Nayar, Chang Xiao, Changxi Zheng
  • Publication number: 20240013467
    Abstract: Methods, devices, media, and other embodiments are described for managing and configuring a pseudorandom animation system and associated computer animation models. One embodiment involves generating image modification data with a computer animation model configured to modify frames of a video image to insert and animate the computer animation model within the frames of the video image, where the computer animation model of the image modification data comprises one or more control points. Motion patterns and speed harmonics are automatically associated with the control points, and motion states are generated based on the associated motions and harmonics. A probability value is then assigned to each motion state. The motion state probabilities can then be used when generating a pseudorandom animation.
    Type: Application
    Filed: September 21, 2023
    Publication date: January 11, 2024
    Inventors: Gurunandan Krishnan Gorumkonda, Shree K. Nayar
  • Patent number: 11861075
    Abstract: A personalized emoji dictionary, such as for use with emoji-first messaging. Text messaging is automatically converted to emojis by an emoji-first application so that only emojis are communicated from one client device to another client device. Each client device has a personalized emoji library of emojis that are mapped to words, which libraries are customizable and unique to the users of the client devices, such that the users can communicate secretly in code. Upon receipt of a string of emojis, a user can select the emoji string to convert to text if desired, for a predetermined period of time.
    Type: Grant
    Filed: November 30, 2022
    Date of Patent: January 2, 2024
    Assignee: Snap Inc.
    Inventors: Karl Bayer, Prerna Chikersal, Shree K. Nayar, Brian Anthony Smith
  • Publication number: 20230419578
    Abstract: Methods, devices, media, and other embodiments are described for a state-space system for pseudorandom animation. In one embodiment animation elements within a computer model are identified, and for each animation element motion patterns and speed harmonics are identified. A set of motion data values comprising a state-space description of the motion patterns and the speed harmonics are generated, and a probability assigned to each value of the set of motion data values for the state-space description. The probability can then be used to select and update a particular motion used in an animation generated from the computer model.
    Type: Application
    Filed: September 6, 2023
    Publication date: December 28, 2023
    Inventors: Gurunandan Krishnan Gorumkonda, Shree K. Nayar
  • Patent number: 11823002
    Abstract: An apparatus to perform fast data access comprises a receiver, a processor, and a memory. The processor receives using the receiver a light signal from a light source. The light signal can be structured to generate a temporal code. The light source is an optical beacon that includes a Light-Emitting Diode (LED). The processor then decodes the light signal to generate a network address, and causes a display of a client device coupled to the apparatus to display information based on the network address. The network address can be a Uniform Resource Locator (URL) address and the information based on the network address includes a webpage associated with the URL. Other embodiments are described herein.
    Type: Grant
    Filed: December 30, 2020
    Date of Patent: November 21, 2023
    Assignee: SNAP INC.
    Inventors: Jian Wang, Karl Bayer, Shree K. Nayar
  • Patent number: 11825276
    Abstract: An apparatus with a selector input device to transmit an audio signal comprises a microphone, a communication interface, and a selector input device. The apparatus can also comprise a processor and a memory having instructions stored thereon, when executed by the processor, causes the processor to perform operations comprising detecting an activation of the selector input device. In response to detecting the activation, the processor captures the audio signal via the microphone and transmits the audio signal via the communication interface to a first client device. Other embodiments are described herein.
    Type: Grant
    Filed: December 20, 2021
    Date of Patent: November 21, 2023
    Assignee: SNAP INC.
    Inventors: Karl Bayer, Jacob Andreou, Shree K. Nayar
  • Publication number: 20230360251
    Abstract: A device that measures a size of a user's face, referred to as face scaling, using a monocular camera. Depth is calculated from sparse feature points. A face mesh is used to improve the estimation accuracy. A processing pipeline detects face features by applying a face landmark detection algorithm to find the important face feature points such as the eyes, nose, and mouth. The processing pipeline estimates feature points depth using depth obtained through image defocus. The processing pipeline further scales the face using an estimated depth of the face features.
    Type: Application
    Filed: May 6, 2023
    Publication date: November 9, 2023
    Inventors: Gurunandan Krishnan Gorumkonda, Shree K. Nayar, Yicheng Wu
  • Patent number: 11810236
    Abstract: Methods, devices, media, and other embodiments are described for managing and configuring a pseudorandom animation system and associated computer animation models. One embodiment involves generating image modification data with a computer animation model configured to modify frames of a video image to insert and animate the computer animation model within the frames of the video image, where the computer animation model of the image modification data comprises one or more control points. Motion patterns and speed harmonics are automatically associated with the control points, and motion states are generated based on the associated motions and harmonics. A probability value is then assigned to each motion state. The motion state probabilities can then be used when generating a pseudorandom animation.
    Type: Grant
    Filed: June 17, 2021
    Date of Patent: November 7, 2023
    Assignee: Snap Inc.
    Inventors: Gurunandan Krishnan Gorumkonda, Shree K. Nayar
  • Patent number: 11790585
    Abstract: Methods, devices, media, and other embodiments are described for a state-space system for pseudorandom animation. In one embodiment animation elements within a computer model are identified, and for each animation element motion patterns and speed harmonics are identified. A set of motion data values comprising a state-space description of the motion patterns and the speed harmonics are generated, and a probability assigned to each value of the set of motion data values for the state-space description. The probability can then be used to select and update a particular motion used in an animation generated from the computer model.
    Type: Grant
    Filed: May 27, 2022
    Date of Patent: October 17, 2023
    Assignee: Snap Inc.
    Inventors: Gurunandan Krishnan Gorumkonda, Shree K. Nayar
  • Publication number: 20230260180
    Abstract: Methods, devices, media, and other embodiments are described for generating, modifying, and outputting pseudorandom animations that can be synchronized to audio data. In one embodiment, a computer animation model made up of comprising one or more control points is accessed by one or more processors, which associate motion patterns with a first control point of the one or more control points, and associate one or more speed harmonics with the first control point. A set of motion states is identify with a motion state for the combinations of possibilities, and a probability value is assigned to each motion state of the set of motion states. The probability value can be used to probabilistically determine a particular motion state to be part of displayed animation for the computer animation model.
    Type: Application
    Filed: April 25, 2023
    Publication date: August 17, 2023
    Inventors: Gurunandan Krishnan Gorumkonda, Shree K. Nayar
  • Patent number: 11721354
    Abstract: Method of performing acoustic zooming starts with microphones capturing acoustic signals associated with video content. Beamformers generate beamformer signals using the acoustic signals. Beamformer signals correspond respectively to tiles of video content. Each of the beamformers is respectively directed to a center of each of the tiles. Target enhanced signal is generated using beamformer signals. Target enhanced signal is associated with a zoom area of video content. Target enhanced signal is generated by identifying the tiles respectively having at least portions that are included in the zoom area, selecting beamformer signals corresponding to identified tiles, and combining selected beamformer signals to generate target enhanced signal. Combining selected beamformer signals may include determining proportions for each of the identified tiles in relation to the zoom area and combining selected beamformer signals based on the proportions to generate the target enhanced signal.
    Type: Grant
    Filed: September 14, 2021
    Date of Patent: August 8, 2023
    Assignee: Snap Inc.
    Inventors: Changxi Zheng, Arun Asokan Nair, Austin Reiter, Shree K. Nayar
  • Patent number: 11670027
    Abstract: Methods, devices, media, and other embodiments are described for generating, modifying, and outputting pseudorandom animations that can be synchronized to audio data. In one embodiment, a computer animation model made up of comprising one or more control points is accessed by one or more processors, which associate motion patterns with a first control point of the one or more control points, and associate one or more speed harmonics with the first control point. A set of motion states is identify with a motion state for the combinations of possibilities, and a probability value is assigned to each motion state of the set of motion states. The probability value can be used to probabilistically determine a particular motion state to be part of displayed animation for the computer animation model.
    Type: Grant
    Filed: November 15, 2021
    Date of Patent: June 6, 2023
    Assignee: Snap Inc.
    Inventors: Gurunandan Krishnan Gorumkonda, Shree K. Nayar
  • Publication number: 20230137950
    Abstract: A client device processing received emoji messages using emoji-first messaging. Text messaging is automatically converted to emojis by an emoji-first application so that only emojis are communicated from one client device to another client device. Each client device has a library of emojis that are mapped to words, which libraries are customizable and unique to the users of the client devices, such that the users can communicate secretly in code. Upon receipt of a string of emojis, a user can select the emoji string to convert to text if desired, for a predetermined period of time.
    Type: Application
    Filed: December 29, 2022
    Publication date: May 4, 2023
    Inventors: Karl Bayer, Prerna Chikersal, Shree K. Nayar, Brian Anthony Smith