Patents Assigned to mmhmm inc.
-
Patent number: 11929095Abstract: Setting a replay speed of a pre-recorded video presentation includes determining a mood of a presenter of the pre-recorded video presentation, determining complexity of material that is presented in the pre-recorded video presentation, and setting a replay speed based on the mood of the presenter and the complexity of the material that is presented. Setting a replay speed of a pre-recorded video presentation may also include adjusting the replay speed based on determining a desired speech tempo for a listener. The desired speech tempo of the listener may be based on time of day, age of the listener, and/or comprehension level of the listener. Measuring the comprehension level of the listener may be based facial expressions of the listener, eye-tracking of the listener, and/or listener comprehension quizzes. Measuring the mood of the presenter may be based on facial recognition, sentiment recognition, and/or gesture recognition.Type: GrantFiled: June 29, 2022Date of Patent: March 12, 2024Assignee: mmhmm inc.Inventor: Phil Libin
-
Patent number: 11800060Abstract: Providing a video conference for multiple participants includes choosing between at least one physical conference space and at least one virtual conference space, a first one of the participants inviting a second one of the participants to the video conference, the second one of the participants joining the video conference, and conducting the video conference by showing the participants in a same conference space in real time. The conference space may be a physical location of one of the participants or may be a virtual conference space. The participants may switch between the at least one physical conference space and the at least one virtual conference space during the video conference. The first one of the participants may invite the second one of the participants by sending a link. At least one of the participants may see the first participant and the second participant interacting in the conference space.Type: GrantFiled: April 20, 2022Date of Patent: October 24, 2023Assignee: mmhmm inc.Inventors: Phil Libin, Leonid Kitainik
-
Patent number: 11792355Abstract: Creating a video presentation includes obtaining a first front-camera video stream and a first back-camera video stream that are recorded synchronously using a first device having a front-camera and a back-camera and extracting a first image of a first presenter from the first front-camera video stream. Creating a video presentation also includes obtaining a second front-camera video stream and a second back-camera video stream that are recorded synchronously and extracting a second image of a second presenter from the second front-camera video stream. It is determined whether that the first back-camera video stream and the second back-camera video stream are complimentary views. Creating a video presentation also includes constructing a panoramic view by combining the first back-camera video stream and the second back-camera video stream and superimposing the first image of the first presenter and the second image of the second presenter onto to the panoramic view.Type: GrantFiled: July 27, 2022Date of Patent: October 17, 2023Assignee: mmhmm inc.Inventors: Phil Libin, Roelof F. Botha
-
Patent number: 11778143Abstract: Manipulating an image in an immersive video conference space includes associating an anchor to a background of the immersive video conference space, static interior objects in the immersive video conference space, and/or dynamic interior objects in the immersive video conference space or an area within a display pane of the immersive video conference space and actuating an anchor activation control that causes the image to move to a position of the anchor. The image may be an image of the presenter. The presenter may provide a gesture that actuates the anchor activation. The gesture may be a keyboard shortcut or a touch gesture. The touch gesture may be a tap, a swipe, or a tap and hold. The image may move to the position of the anchor along a transitional route. The image may change appearance as the image moves to the position of the anchor along the transitional route.Type: GrantFiled: October 18, 2022Date of Patent: October 3, 2023Assignee: mmhmm inc.Inventor: Phil Libin
-
Patent number: 11714595Abstract: Adapting an audio portion of a video conference includes a presenter providing content for the video conference by delivering live content, prerecorded content, or combining live content with prerecorded content, at least one additional co-presenter provides content for the video conference, and untangling overlapping audio streams of the presenter and the co-presenter by replaying individual audio streams from the presenter and/or the at least one co-presenter or separating the audio streams by diarization. Adapting an audio portion of a video conference may also include recording the presenter to provide a recorded audio stream, using speech-to-text conversion to convert the recorded audio stream to text, correlating the text to the recorded audio stream, retrieving a past portion of the recorded audio stream using a keyword search of the text, and replaying the past portion of the recorded audio stream. The keyword may be entered using a voice recognition system.Type: GrantFiled: June 25, 2021Date of Patent: August 1, 2023Assignee: mmhmm inc.Inventors: Phil Libin, Leonid Kitainik
-
Patent number: 11677575Abstract: Adapting an audio-visual presentation includes assessing a degree of engagement for at least some of the participants by monitoring participant reactions and feedback to the audio-visual presentation, creating a histogram having a plurality of bins that each represent a number of participants exhibiting a particular degree of engagement, comparing histogram values to predetermined engagement goals for the audio-visual presentation, and modifying the audio-visual presentation in response to the feedback and to the histogram values indicating deviation from the predetermined engagement goals for the audio-visual presentation. Degrees of engagement may be positive/productive, angry/over-reacting, or indifferent. The feedback may include verbal and non-verbal cues of the participants. The non-verbal cues may include gaze direction and facial expressions that are captured by cameras of the participants and/or results of physiological monitoring of the participants.Type: GrantFiled: October 1, 2021Date of Patent: June 13, 2023Assignee: mmhmm inc.Inventor: Phil Libin
-
Patent number: 11543932Abstract: Selecting an active one of a plurality of screen areas of one or more applications presented to a user on a screen includes determining properties of the screen areas corresponding to brightness, playing audio, displaying an avatar, transparency of an avatar, timing of new content, intensity of content change, number of objects, number of objects in an intersection of multiple areas, and/or speed of objects in a particular area, setting one or more rules for choosing one of a plurality of the screen areas for a plurality of applications based on at least one of the properties, and selecting a particular one of the screen areas to be the active one of the plurality of screen areas based on the rules, the properties, and location of a pointer or touch area. The avatar may be located, at least partially, within an intersection of different ones of the screen areas.Type: GrantFiled: October 26, 2021Date of Patent: January 3, 2023Assignee: mmhmm inc.Inventors: Matthew Tonkin, Phil Libin, Gabe Campodonico, Stephen James White, Seth Hitchings, Dairien Marcus Boyd
-
Patent number: 11539918Abstract: Manipulating an image in an immersive video conference space includes associating an anchor to a background of the immersive video conference space, static interior objects in the immersive video conference space, and/or dynamic interior objects in the immersive video conference space or an area within a display pane of the immersive video conference space and actuating an anchor activation control that causes the image to move to a position of the anchor. The image may be an image of the presenter. The presenter may provide a gesture that actuates the anchor activation. The gesture may be a keyboard shortcut or a touch gesture. The touch gesture may be a tap, a swipe, or a tap and hold. The image may move to the position of the anchor along a transitional route. The image may change appearance as the image moves to the position of the anchor along the transitional route.Type: GrantFiled: August 16, 2021Date of Patent: December 27, 2022Assignee: mmhmm inc.Inventor: Phil Libin
-
Patent number: 11516036Abstract: The present disclosure provides methods and systems for quantifying meeting effectiveness. A method for quantifying meeting effectiveness may comprise: (a) receiving calendar data related to a meeting; (b) generating a feedback survey based on the calendar data for collecting user feedback data, wherein the feedback survey is presented to a user on an electronic device; (c) generating, using a trained machine learning algorithm, a meeting score indicative of an effectiveness of the meeting based on the meeting data and the user feedback data, and (d) displaying the meeting score within a graphical user interface (GUI) on the electronic device.Type: GrantFiled: November 23, 2020Date of Patent: November 29, 2022Assignee: mmhmm inc.Inventors: Ankith Harathi, John Keck
-
Patent number: 11317060Abstract: Managing a video conference includes presenting, to a plurality of participants of the video conference, a channel pane containing information for the video conference that is controlled by a presenter, the channel pane being provided on a background that is visible to the plurality of participants and superimposing a dynamic image of the presenter on the background. The dynamic image of the presenter is continuously captured by a camera. Managing a video conference also includes adjusting the dynamic image of the presenter to prevent obscuring the information of the channel pane and/or to focus attention of the participants to specific information of the channel pane. The dynamic image of the presenter may be adjusted in response to the channel pane being enlarged and/or moved and/or by shrinking and/or by making the dynamic image semi-transparent. The channel pane may include a physical medium that the presenter actuates.Type: GrantFiled: May 18, 2021Date of Patent: April 26, 2022Assignee: mmhmm inc.Inventor: Phil Libin
-
Patent number: 11228625Abstract: Managing a video conference includes connecting participants of the videoconference to at least one video conferencing server that sends and receives video streams between the participants, detecting non-verbal cues of the participants, using the non-verbal cues to track reactions of the participants to segments of a presentation provided by a speaker and to interactions among participants, determining a health index of the video conference based on the reactions of the participants, and providing to at least a subset of the participants recommendations based on the health index for modifying the video conference. The non-verbal cues may include facial expressions, body language, gestures, postures, and/or eye contact. The interactions among participants may include discussions, agreement, disagreement, interruption, and/or eye-rolling. The recommendations may include asking a participant to provide an opinion on a subject matter being discussed in the video conference. The participant may be an expert.Type: GrantFiled: January 28, 2019Date of Patent: January 18, 2022Assignee: mmhmm inc.Inventor: Phil Libin