Patents Assigned to mmhmm inc.
  • Patent number: 11929095
    Abstract: Setting a replay speed of a pre-recorded video presentation includes determining a mood of a presenter of the pre-recorded video presentation, determining complexity of material that is presented in the pre-recorded video presentation, and setting a replay speed based on the mood of the presenter and the complexity of the material that is presented. Setting a replay speed of a pre-recorded video presentation may also include adjusting the replay speed based on determining a desired speech tempo for a listener. The desired speech tempo of the listener may be based on time of day, age of the listener, and/or comprehension level of the listener. Measuring the comprehension level of the listener may be based facial expressions of the listener, eye-tracking of the listener, and/or listener comprehension quizzes. Measuring the mood of the presenter may be based on facial recognition, sentiment recognition, and/or gesture recognition.
    Type: Grant
    Filed: June 29, 2022
    Date of Patent: March 12, 2024
    Assignee: mmhmm inc.
    Inventor: Phil Libin
  • Patent number: 11800060
    Abstract: Providing a video conference for multiple participants includes choosing between at least one physical conference space and at least one virtual conference space, a first one of the participants inviting a second one of the participants to the video conference, the second one of the participants joining the video conference, and conducting the video conference by showing the participants in a same conference space in real time. The conference space may be a physical location of one of the participants or may be a virtual conference space. The participants may switch between the at least one physical conference space and the at least one virtual conference space during the video conference. The first one of the participants may invite the second one of the participants by sending a link. At least one of the participants may see the first participant and the second participant interacting in the conference space.
    Type: Grant
    Filed: April 20, 2022
    Date of Patent: October 24, 2023
    Assignee: mmhmm inc.
    Inventors: Phil Libin, Leonid Kitainik
  • Patent number: 11792355
    Abstract: Creating a video presentation includes obtaining a first front-camera video stream and a first back-camera video stream that are recorded synchronously using a first device having a front-camera and a back-camera and extracting a first image of a first presenter from the first front-camera video stream. Creating a video presentation also includes obtaining a second front-camera video stream and a second back-camera video stream that are recorded synchronously and extracting a second image of a second presenter from the second front-camera video stream. It is determined whether that the first back-camera video stream and the second back-camera video stream are complimentary views. Creating a video presentation also includes constructing a panoramic view by combining the first back-camera video stream and the second back-camera video stream and superimposing the first image of the first presenter and the second image of the second presenter onto to the panoramic view.
    Type: Grant
    Filed: July 27, 2022
    Date of Patent: October 17, 2023
    Assignee: mmhmm inc.
    Inventors: Phil Libin, Roelof F. Botha
  • Patent number: 11778143
    Abstract: Manipulating an image in an immersive video conference space includes associating an anchor to a background of the immersive video conference space, static interior objects in the immersive video conference space, and/or dynamic interior objects in the immersive video conference space or an area within a display pane of the immersive video conference space and actuating an anchor activation control that causes the image to move to a position of the anchor. The image may be an image of the presenter. The presenter may provide a gesture that actuates the anchor activation. The gesture may be a keyboard shortcut or a touch gesture. The touch gesture may be a tap, a swipe, or a tap and hold. The image may move to the position of the anchor along a transitional route. The image may change appearance as the image moves to the position of the anchor along the transitional route.
    Type: Grant
    Filed: October 18, 2022
    Date of Patent: October 3, 2023
    Assignee: mmhmm inc.
    Inventor: Phil Libin
  • Patent number: 11714595
    Abstract: Adapting an audio portion of a video conference includes a presenter providing content for the video conference by delivering live content, prerecorded content, or combining live content with prerecorded content, at least one additional co-presenter provides content for the video conference, and untangling overlapping audio streams of the presenter and the co-presenter by replaying individual audio streams from the presenter and/or the at least one co-presenter or separating the audio streams by diarization. Adapting an audio portion of a video conference may also include recording the presenter to provide a recorded audio stream, using speech-to-text conversion to convert the recorded audio stream to text, correlating the text to the recorded audio stream, retrieving a past portion of the recorded audio stream using a keyword search of the text, and replaying the past portion of the recorded audio stream. The keyword may be entered using a voice recognition system.
    Type: Grant
    Filed: June 25, 2021
    Date of Patent: August 1, 2023
    Assignee: mmhmm inc.
    Inventors: Phil Libin, Leonid Kitainik
  • Patent number: 11677575
    Abstract: Adapting an audio-visual presentation includes assessing a degree of engagement for at least some of the participants by monitoring participant reactions and feedback to the audio-visual presentation, creating a histogram having a plurality of bins that each represent a number of participants exhibiting a particular degree of engagement, comparing histogram values to predetermined engagement goals for the audio-visual presentation, and modifying the audio-visual presentation in response to the feedback and to the histogram values indicating deviation from the predetermined engagement goals for the audio-visual presentation. Degrees of engagement may be positive/productive, angry/over-reacting, or indifferent. The feedback may include verbal and non-verbal cues of the participants. The non-verbal cues may include gaze direction and facial expressions that are captured by cameras of the participants and/or results of physiological monitoring of the participants.
    Type: Grant
    Filed: October 1, 2021
    Date of Patent: June 13, 2023
    Assignee: mmhmm inc.
    Inventor: Phil Libin
  • Patent number: 11543932
    Abstract: Selecting an active one of a plurality of screen areas of one or more applications presented to a user on a screen includes determining properties of the screen areas corresponding to brightness, playing audio, displaying an avatar, transparency of an avatar, timing of new content, intensity of content change, number of objects, number of objects in an intersection of multiple areas, and/or speed of objects in a particular area, setting one or more rules for choosing one of a plurality of the screen areas for a plurality of applications based on at least one of the properties, and selecting a particular one of the screen areas to be the active one of the plurality of screen areas based on the rules, the properties, and location of a pointer or touch area. The avatar may be located, at least partially, within an intersection of different ones of the screen areas.
    Type: Grant
    Filed: October 26, 2021
    Date of Patent: January 3, 2023
    Assignee: mmhmm inc.
    Inventors: Matthew Tonkin, Phil Libin, Gabe Campodonico, Stephen James White, Seth Hitchings, Dairien Marcus Boyd
  • Patent number: 11539918
    Abstract: Manipulating an image in an immersive video conference space includes associating an anchor to a background of the immersive video conference space, static interior objects in the immersive video conference space, and/or dynamic interior objects in the immersive video conference space or an area within a display pane of the immersive video conference space and actuating an anchor activation control that causes the image to move to a position of the anchor. The image may be an image of the presenter. The presenter may provide a gesture that actuates the anchor activation. The gesture may be a keyboard shortcut or a touch gesture. The touch gesture may be a tap, a swipe, or a tap and hold. The image may move to the position of the anchor along a transitional route. The image may change appearance as the image moves to the position of the anchor along the transitional route.
    Type: Grant
    Filed: August 16, 2021
    Date of Patent: December 27, 2022
    Assignee: mmhmm inc.
    Inventor: Phil Libin
  • Patent number: 11516036
    Abstract: The present disclosure provides methods and systems for quantifying meeting effectiveness. A method for quantifying meeting effectiveness may comprise: (a) receiving calendar data related to a meeting; (b) generating a feedback survey based on the calendar data for collecting user feedback data, wherein the feedback survey is presented to a user on an electronic device; (c) generating, using a trained machine learning algorithm, a meeting score indicative of an effectiveness of the meeting based on the meeting data and the user feedback data, and (d) displaying the meeting score within a graphical user interface (GUI) on the electronic device.
    Type: Grant
    Filed: November 23, 2020
    Date of Patent: November 29, 2022
    Assignee: mmhmm inc.
    Inventors: Ankith Harathi, John Keck
  • Patent number: 11317060
    Abstract: Managing a video conference includes presenting, to a plurality of participants of the video conference, a channel pane containing information for the video conference that is controlled by a presenter, the channel pane being provided on a background that is visible to the plurality of participants and superimposing a dynamic image of the presenter on the background. The dynamic image of the presenter is continuously captured by a camera. Managing a video conference also includes adjusting the dynamic image of the presenter to prevent obscuring the information of the channel pane and/or to focus attention of the participants to specific information of the channel pane. The dynamic image of the presenter may be adjusted in response to the channel pane being enlarged and/or moved and/or by shrinking and/or by making the dynamic image semi-transparent. The channel pane may include a physical medium that the presenter actuates.
    Type: Grant
    Filed: May 18, 2021
    Date of Patent: April 26, 2022
    Assignee: mmhmm inc.
    Inventor: Phil Libin
  • Patent number: 11228625
    Abstract: Managing a video conference includes connecting participants of the videoconference to at least one video conferencing server that sends and receives video streams between the participants, detecting non-verbal cues of the participants, using the non-verbal cues to track reactions of the participants to segments of a presentation provided by a speaker and to interactions among participants, determining a health index of the video conference based on the reactions of the participants, and providing to at least a subset of the participants recommendations based on the health index for modifying the video conference. The non-verbal cues may include facial expressions, body language, gestures, postures, and/or eye contact. The interactions among participants may include discussions, agreement, disagreement, interruption, and/or eye-rolling. The recommendations may include asking a participant to provide an opinion on a subject matter being discussed in the video conference. The participant may be an expert.
    Type: Grant
    Filed: January 28, 2019
    Date of Patent: January 18, 2022
    Assignee: mmhmm inc.
    Inventor: Phil Libin