Patents by Inventor Stephane Taine

Stephane Taine has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10469427
    Abstract: Exemplary embodiments relate to techniques for sharing live video while maintaining an asynchronous copy of the video. According to some embodiments, a user begins to record video and shares the video with selected other users. If one of the other users opts to join the original user, the shared video upgrades to a live video conversation. If no one (or only some participants) joins the original user, the recorded video becomes an asynchronous artifact in the users' messaging history. In some embodiments, the live video may be recorded and shared in response to a first user initiating a video call with at least a second user, but receiving no answer. The first user begins to share a live video (which may become an asynchronous artifact). If the second user joins the call while the video is being recorded, the conversation may upgraded to a video conversation.
    Type: Grant
    Filed: November 8, 2016
    Date of Patent: November 5, 2019
    Assignee: FACEBOOK, INC.
    Inventors: Brendan Benjamin Aronoff, Stephane Taine
  • Patent number: 10440306
    Abstract: An online system customizes video conversations between users of the online system. During a video conversation, the online system presents a composite view to the participating users. The composite view may include visual representations of the users, a background graphic, or other types of graphics such as masks and props that the users can wear or interact with in the environment of the video conversation. The visual representations may be generated based on a live video feed of the users or include avatars of the users. The online system can determine the graphics based on information about the users. For instance, the online system determines a background graphic showing a location that the users have each visited. Upon viewing the background graphic, the users may be encouraged to interact with the background graphic or other graphics included in the composite view, which can promote an engaging video conversation experience.
    Type: Grant
    Filed: October 29, 2018
    Date of Patent: October 8, 2019
    Assignee: Facebook, Inc.
    Inventors: Jason Duane Clark, Brendan Benjamin Aronoff, Stephane Taine
  • Patent number: 10410678
    Abstract: Exemplary embodiments relate to the creation of a media effect index for group video conversations. Media effect application (e.g., in the form of graphical overlays, filters, sounds, etc.) may be tracked in a timeline during a chat session. The resulting index may be used to create a highlights reel, which may serve as an index into a live show or may be used to determine the best time to insert materials into a recording of the conversation. The index may be used to automatically detect events in the video feed, to allow viewers to skip ahead to exciting moments (e.g., represented by clusters of applications of particular types of media effects), to determine where each participant spoke in a discussion, or to provide a common “watch together” experience while multiple users watch a common video. An analysis of the index may be used for research or consumer testing.
    Type: Grant
    Filed: November 18, 2016
    Date of Patent: September 10, 2019
    Assignee: FACEBOOK, INC.
    Inventors: Stephane Taine, Brendan Benjamin Aronoff, Jason Clark
  • Patent number: 10368034
    Abstract: Exemplary embodiments relate to techniques for facilitating a connection between two users in a call by providing an “answering window” when a user calls. When a caller places a call to a callee, the call invitation may remain open for a window of time during which the caller remains available. The callee may opt to answer the call at any time during the window. During the window, the caller may be placed in a lobby and may share audio and/or video. Accepting the call during the answering window may place the callee in the lobby or may directly convert the interaction into an active call. The callee may request that the window can be altered, or may signal their intention to answer the call at a particular time.
    Type: Grant
    Filed: November 28, 2016
    Date of Patent: July 30, 2019
    Assignee: FACEBOOK, INC.
    Inventors: Zhengping Zuo, Stephane Taine, Brendan Benjamin Aronoff
  • Patent number: 10303928
    Abstract: Exemplary embodiments relate to uses of face detection in video, and especially in video calls. In some embodiments, face detection may be used to center a camera shot by maintaining a face in the center of a screen. The centering may be applied selectively, such as by overriding centering if the user is looking off-screen. The video may also be cropped to better fit a face in a screen, or to allow multiple faces to appear on screen. In some embodiments, emphasizing the face over the background (or parts of the face over the whole face) allows for improvement in video call performance. Moreover, these techniques can be used to bring certain areas of a camera shot into focus while de-emphasizing the background (or vice versa).
    Type: Grant
    Filed: November 29, 2016
    Date of Patent: May 28, 2019
    Assignee: FACEBOOK, INC.
    Inventors: Stephane Taine, Brendan Benjamin Aronoff, Jason Clark
  • Publication number: 20190124177
    Abstract: This disclosure covers methods, non-transitory computer readable media, and systems that analyze a previously unrecognized communication number associated with a sender of a direct digital message when a client device receives the direct digital message from the previously unrecognized communication number. Based on this analysis, the methods, non-transitory computer readable media, and systems provide profile information associated with the communication number for the client device to present together with the direct digital message. To find relevant profile information for the communication number, the disclosed methods, non-transitory computer readable media, and systems optionally query a social networking system for profile information connected to the communication number.
    Type: Application
    Filed: October 25, 2017
    Publication date: April 25, 2019
    Inventors: Vivek Garg, Li Hua, Joshua Gordon Selbo, Johnathan Harms, Stephane Taine, Michael Leggett
  • Patent number: 10242385
    Abstract: An online system using attributes of users to select content for presentation to the users predicts one or more attributes of users whose attributes are unavailable to the online system. For a user with one or more attributes unavailable to the online system, the online system applies a model to attributes of additional users to predict one or more attributes of the user. Attributes of the additional user use in the prediction may include demographic information and interactions with content by the additional users. The online system may determine an accuracy of the model by using the model to predict attributes for users whose attributes are known to the online system and comparing the predicted attributes to the known attributes. If the model's accuracy is less than a threshold value, the online system discontinues using the model to predict attributes of users.
    Type: Grant
    Filed: July 24, 2015
    Date of Patent: March 26, 2019
    Assignee: Facebook, Inc.
    Inventors: Ahmad Abdulmageed Mohammed Abdulkader, Stephane Taine, Vladislav Belous, Seyed Mohsen Amiri, Ewa Dominowska
  • Publication number: 20190082023
    Abstract: In one embodiment, a method includes launching, by a client system of a first user, a video-call session to enable a video stream for display in a small-overlay-window on a display of the client system of the first user; receiving, by the client system of the first user, a video stream comprising video from a client system of a second user; determining at least one property for the small-overlay-window based on information associated with the second user; and displaying the video stream in the small-overlay-window, wherein the small-overlay-window is customized based on the determined at least one property, and wherein the small-overlay-window is positioned directly over an interface of an active application running on the client system of the first user.
    Type: Application
    Filed: November 13, 2018
    Publication date: March 14, 2019
    Inventors: Stephane Taine, Edward Young Zhang, Dwayne B. Mercredi, Michael Leggett, Brendan Benjamin Aronoff, Peter Henry Martinazzi, Evan Patrick Noon, Duckjin Kang, John Randall Ehrhardt
  • Patent number: 10187484
    Abstract: In one embodiment, a method includes launching, by a client system of a first user, a video-call session; receiving, by the client system of the first user, a video stream including video captured at a client system of a second user; and displaying the video stream in a small-overlay-window on a display of the client system of the first user, wherein the small-overlay-window is positioned over an active application.
    Type: Grant
    Filed: May 6, 2016
    Date of Patent: January 22, 2019
    Assignee: Facebook, Inc.
    Inventors: Stephane Taine, Edward Young Zhang, Dwayne B. Mercredi, Michael Leggett, Brendan Benjamin Aronoff, Peter Henry Martinazzi, Evan Patrick Noon, Duckjin Kang, John Randall Ehrhardt
  • Patent number: 10182204
    Abstract: Users of multiple clients participate in a video chat session by exchanging video streams. A user initiates generation of a high-quality composite image of the video chat session. The clients each capture high-quality local images and send the images to a chat server via a communications channel that is out-of-band from the video streams. The chat server stores the images in a repository. The initiating user views the images and selects images and a layout to use for the composite image. The chat server assembles the composite image based on the selections and saves the composite image to the repository. The initiating user can retrieve the composite image and view it, post it to social media, and/or use it for other purposes.
    Type: Grant
    Filed: November 16, 2017
    Date of Patent: January 15, 2019
    Assignee: Facebook, Inc.
    Inventors: Stephane Taine, Nora Micheva, Shyamalan Pather, Jason Duane Clark, Michelle Ruby Hwang, Hoang Le, Joel Alexander Bullard, Candace Button Disco, Joseph Stephen Gonzalez, Kelly Nicole Stevens, Anne Raynor
  • Patent number: 10158828
    Abstract: An online system customizes video conversations between users of the online system. During a video conversation, the online system presents a composite view to the participating users. The composite view may include visual representations of the users, a background graphic, or other types of graphics such as masks and props that the users can wear or interact with in the environment of the video conversation. The visual representations may be generated based on a live video feed of the users or include avatars of the users. The online system can determine the graphics based on information about the users. For instance, the online system determines a background graphic showing a location that the users have each visited. Upon viewing the background graphic, the users may be encouraged to interact with the background graphic or other graphics included in the composite view, which can promote an engaging video conversation experience.
    Type: Grant
    Filed: April 5, 2017
    Date of Patent: December 18, 2018
    Assignee: Facebook, Inc.
    Inventors: Jason Duane Clark, Brendan Benjamin Aronoff, Stephane Taine
  • Patent number: 10122965
    Abstract: Exemplary embodiments relate to uses of face detection for modifying the background of a video. By detecting the portion of the video shot that corresponds to a face, it can also determined which portion of the shot do not correspond to the face (e.g., the background of the video). The thus-detected background may be replaced with a movie, event, or other material. Different types of materials may be targeted at different users based on user affinities or preferences. In some embodiments, a user may manually select and apply a background during a video call. When applying a custom background, the system can transmit a control signal and the background. The client recognizes the control signal and, in response, applies the background.
    Type: Grant
    Filed: November 29, 2016
    Date of Patent: November 6, 2018
    Assignee: Facebook, Inc.
    Inventors: Stephane Taine, Brendan Benjamin Aronoff, Jason Clark
  • Patent number: 10116898
    Abstract: Exemplary embodiments relate to techniques for displaying participants in an interface during a group call, and is particularly well-suited to use with small displays. A full-size call interface may be shrunk down into a chathead that makes good use of limited screen real estate, especially when being used on a mobile device. On the smaller chathead, the dominant user is shown, and a roster of users is shrunk and may exhibit reduced functionality. The chathead may be moved around the screen, and other applications may continue to run in the space not occupied by the chathead.
    Type: Grant
    Filed: November 18, 2016
    Date of Patent: October 30, 2018
    Assignee: FACEBOOK, INC.
    Inventors: Duckjin Kang, Zhengping Zuo, Stephane Taine, Brendan Benjamin Aronoff
  • Publication number: 20180295324
    Abstract: An online system customizes video conversations between users of the online system. During a video conversation, the online system presents a composite view to the participating users. The composite view may include visual representations of the users, a background graphic, or other types of graphics such as masks and props that the users can wear or interact with in the environment of the video conversation. The visual representations may be generated based on a live video feed of the users or include avatars of the users. The online system can determine the graphics based on information about the users. For instance, the online system determines a background graphic showing a location that the users have each visited. Upon viewing the background graphic, the users may be encouraged to interact with the background graphic or other graphics included in the composite view, which can promote an engaging video conversation experience.
    Type: Application
    Filed: April 5, 2017
    Publication date: October 11, 2018
    Inventors: Jason Duane Clark, Brendan Benjamin Aronoff, Stephane Taine
  • Patent number: 10079994
    Abstract: Exemplary embodiments relate to techniques for selecting which users should be shown in an interface during a group call, and for presenting the users on (potentially small) displays. According to some embodiments, a most-relevant speaker is selected for display on each call participants' screen. When deciding which user to display in the primary window of a video call, a dominant or relevant user is selected. A dominant user may be selected based on the audio energy represented by the audio packets for the user's device; alternatively dominant user selection may be implemented using artificial intelligence or machine learning, allowing for better differentiation between speaking and noise. On each user's display that does not belong to the relevant user, the current relevant user is shown. On the current relevant user's display, the previous relevant user is shown.
    Type: Grant
    Filed: November 18, 2016
    Date of Patent: September 18, 2018
    Assignee: FACEBOOK, INC.
    Inventors: Duckjin Kang, Zhengping Zuo, Stephane Taine, Brendan Benjamin Aronoff
  • Publication number: 20180262404
    Abstract: The present disclosure is directed to systems, methods and devices for converting REST service events for playback. A plurality of web service resource requests comprising at least one operational event and at least one resource event may be received. At least one resource associated with the plurality of web service resource requests may be retrieved. Each operational event resource may be tagged. A correlation ID may be associated with each tagged operational event resource. A plurality of dynamic elements associated with the plurality of web service resource requests may be normalized. One or more event recording timelines for the plurality of web service resource requests may be identified, and the one or more event recording timelines may be evaluated during playback.
    Type: Application
    Filed: March 13, 2017
    Publication date: September 13, 2018
    Applicant: Microsoft Technology Licensing, LLC
    Inventors: Zhao S. Su, Prashanth Venkataraman, Ganesh Sridharan, Huiwen Ru, Alex D. Edelsburg, Stephane Taine
  • Patent number: 10063809
    Abstract: Exemplary embodiments relate to techniques for displaying participants in an interface during a group call, and is particularly well-suited to use with small displays. A full-size call interface may be shrunk down into a chathead that makes good use of limited screen real estate, especially when being used on a mobile device. On the smaller chathead, the dominant user is shown, and a roster of users is shrunk and may exhibit reduced functionality. The chathead may be moved around the screen, and other applications may continue to run in the space not occupied by the chathead.
    Type: Grant
    Filed: November 18, 2016
    Date of Patent: August 28, 2018
    Assignee: FACEBOOK, INC.
    Inventors: Duckjin Kang, Zhengping Zuo, Stephane Taine, Brendan Benjamin Aronoff
  • Publication number: 20180160055
    Abstract: Exemplary embodiments relate to the application of media effects, such as visual overlays, sound effects, etc. to a video conversation. A media effect may be applied as a reaction to an occurrence in the conversation, such as in response to an emotional reaction detected by emotion analysis of information associated with the video. Effect application may be controlled through gestures, such as applying different effects with different gestures, or canceling automatic effect application using a gesture. Effects may also be applied in group settings, and may affect multiple users. A real-time data channel may synchronize effect application across multiple participants. When broadcasting a video stream that includes effects, the three channels may be sent to an intermediate server, which stitches the three channels together into a single video stream; the single video stream may then be sent to a broadcast server for distribution to the broadcast recipients.
    Type: Application
    Filed: December 5, 2016
    Publication date: June 7, 2018
    Inventors: Stephane Taine, Brendan Benjamin Aronoff, Jason Clark
  • Publication number: 20180152666
    Abstract: Exemplary embodiments relate to uses of face detection in video, and especially in video calls. In some embodiments, face detection may be used to center a camera shot by maintaining a face in the center of a screen. The centering may be applied selectively, such as by overriding centering if the user is looking off-screen. The video may also be cropped to better fit a face in a screen, or to allow multiple faces to appear on screen. In some embodiments, emphasizing the face over the background (or parts of the face over the whole face) allows for improvement in video call performance. Moreover, these techniques can be used to bring certain areas of a camera shot into focus while de-emphasizing the background (or vice versa).
    Type: Application
    Filed: November 29, 2016
    Publication date: May 31, 2018
    Inventors: Stephane Taine, Brendan Benjamin Aronoff, Jason Clark
  • Publication number: 20180152530
    Abstract: Exemplary embodiments relate to techniques for connecting two users when a caller places a call but a callee rejects the call or fails to answer in a predetermined period of time. The calling application may terminate the call attempt and request status updates regarding the called party to determine when the callee is available for a follow-up call. The system may gain insight into when a user is available based on the user's presence in a messaging or social networking app, activity in a third-party application unrelated to the call, or the power status of the user's device. When it is determined that the callee is available, a notification may be sent to the caller informing the caller that it is a good time to call back. The techniques may also be used in reverse, informing the callee of when the caller is available for a return call.
    Type: Application
    Filed: November 28, 2016
    Publication date: May 31, 2018
    Inventors: Zhengping Zuo, Stephane Taine, Brendan Benjamin Aronoff