Patents Examined by Stella L. Woo
  • Patent number: 10708544
    Abstract: In one embodiment, a method is provided to intelligently frame groups of participants in a meeting. This gives a more pleasing experience with fewer switches, better contextual understanding, and more natural framing, as would be seen in a video production made by a human director. Furthermore, in accordance with another embodiment, conversational framing techniques are provided. During speaker tracking, when two local participants are addressing each other, a method is provided to show a close-up framing showing both participants. By evaluating the direction participants are looking and a speaker history, it is determined if there is a local discussion going on, and an appropriate framing is selected to give far-end participants the most contextually rich experience.
    Type: Grant
    Filed: February 27, 2019
    Date of Patent: July 7, 2020
    Assignee: Cisco Technology, Inc.
    Inventors: Kristian Tangeland, Rune Oistein Aas, Christian Fjelleng Theien
  • Patent number: 10701319
    Abstract: The present invention provides systems and methods employing a conferencing system for facilitating enhanced communication between users. In certain embodiments, the conferencing system comprises a communication interface configured to, during a conference session, provide a virtual and/or augmented conference between multiple users having access to a multi-channel, multi-access, always-on, and non-blocking communication. In particular embodiments, the communication interface is in communication with at least one additional component select from: a video component, a data component (e.g., that provides non-audio data to one or more of said users), an audio/video ambience component, and a whiteboard component.
    Type: Grant
    Filed: December 6, 2017
    Date of Patent: June 30, 2020
    Inventors: John Jurrius, David Brand, Stephen Brand
  • Patent number: 10699080
    Abstract: The present disclosure relates to a response analysis system that employs a small-data training dataset to train a neural network that accurately performs domain-agnostic opinion mining. For example, in one or more embodiments, the response analysis system trains a response classification neural network using part of speech information (e.g., syntactic information) to learn and apply response classification labels for opinion text responses. In particular, the response analysis system employs part of speech information patterns without regard to word patterns to determine whether words in a text response correspond to an opinion, the target of the opinion, or neither. In addition, the trained response classification neural network has a significantly reduced learned parameter space, which decreases processing, memory requirements, and overall complexity.
    Type: Grant
    Filed: July 24, 2019
    Date of Patent: June 30, 2020
    Assignee: QUALTRICS, LLC
    Inventor: John Hewitt
  • Patent number: 10681310
    Abstract: The subject technology provides a video conferencing application in which a live incoming or outgoing video stream can be supplemented with supplemental content, such as stickers, animations, etc., from within the video conferencing application. In this manner, a user participating in a video conferencing session with a remote user can add stickers, animations, and/or adaptive content to an outgoing video stream being captured by the device of the user, or to an incoming video stream from the device of the remote user, without having to locally cache/store a video clip before editing, and without having to leave the video conferencing session (or the video conferencing application) to access a video editing application.
    Type: Grant
    Filed: October 3, 2018
    Date of Patent: June 9, 2020
    Assignee: Apple Inc.
    Inventors: Christopher M. Garrido, Eric L. Chien, Austin W. Shyu, Ming Jin, Yan Yang, Ian J. Baird, Joe S. Abuan
  • Patent number: 10681308
    Abstract: Disclosed is an electronic apparatus for providing a video conference, and a method of controlling the same. The electronic apparatus includes a plurality of cameras, and a processor configured to execute instructions to: control to obtain, through a first camera from among the plurality of cameras, first video of a plurality of users who perform the video conference, determine a first user who is currently speaking among the plurality of users on a basis of the first video that is obtained through the first camera, control to obtain, through a second camera from among the plurality of cameras, second video of the determined first user, determine a second user who is expected to speak after the first user on a basis of the first video that is obtained through the first camera, control to obtain, through a third camera from among the plurality of cameras, third video of the determined second user, and control to output a screen in which the second video is simultaneously displayed with the third video.
    Type: Grant
    Filed: April 17, 2019
    Date of Patent: June 9, 2020
    Inventor: Dugin Lyu
  • Patent number: 10659757
    Abstract: This disclosure pertains to operations, systems, and computer readable media to capture images of a scene using a camera array and process the captured images based on a viewer's point of view (POV) for immersive augmented reality, live display wall, head mounted display, video conferencing, and similar applications. In one implementation, the disclosed subject matter provides a complete view to a viewer by combining images captured by a camera array. In another implementation, the disclosed subject matter tracks the viewer's POV as he moves from one location to another and displays images in accordance with his varying POV. The change of the viewer's POV is inclusive of movements in the X, Y, and Z dimensions.
    Type: Grant
    Filed: January 7, 2019
    Date of Patent: May 19, 2020
    Assignee: Apple Inc.
    Inventors: Ricardo J. Motta, Gary L. Vondran, Jr., Manohar B. Srikanth, Brett D. Miller
  • Patent number: 10659728
    Abstract: Provided is an information processing apparatus including a receiving section that receives a captured image of a video communication partner from a communication destination apparatus and a control section that controls a display of the received captured image on a display section. The control section executes image processing to display the captured image such that a line of sight of a communication partner appearing in the captured image appears to point towards a user looking at the display section, on a basis of information indicating that the communication partner appearing in the captured image is looking at the user being displayed on the communication destination apparatus.
    Type: Grant
    Filed: February 8, 2017
    Date of Patent: May 19, 2020
    Inventors: Yusuke Sakai, Daisuke Miki, Atsushi Izumihara
  • Patent number: 10659731
    Abstract: In one embodiment, a method includes accessing input data from one or more different input sources. The input sources include: one or more cameras, one or more microphones, and a social graph maintained by a social-networking system. Based on the input data, generating a current descriptive model for a current audio-video communication session that comprises one or more descriptive characteristics about (1) an environment associated with the current audio-video communication session, (2) one or more people within the environment, or (3) one or more contextual elements associated with the current audio-video communication session. The method also includes generating one or more instructions for the current audio-video communication session that are based the one or more descriptive characteristics; and sending the one or more instructions to a computing device associated with the one or more cameras and the one or more microphones.
    Type: Grant
    Filed: October 5, 2018
    Date of Patent: May 19, 2020
    Assignee: Facebook, Inc.
    Inventors: Jason Francis Harrison, Eric W. Hwang, Rahul Nallamothu, Shahid Razzaq
  • Patent number: 10650370
    Abstract: Methods and systems are disclosed for enabling the generation of a token corresponding to a tone generated by a telephony system, comprising receiving one or more dual tone multi-frequency (DTMF) tones generated by a telephony system, generating a token based on the one or more DTMF tones; and transmitting the generated token to a merchant system.
    Type: Grant
    Filed: November 29, 2018
    Date of Patent: May 12, 2020
    Assignee: Worldpay, LLC
    Inventor: Brant Peterson
  • Patent number: 10638091
    Abstract: There is provided an information processing device including a reception unit that receives data from a communication destination, a generation unit that generates spatial image information placed at a predetermined position in a three-dimensional space by using captured images of a plurality of the communication destinations, and a display control unit that performs control so as to display the generated spatial image information on a display unit.
    Type: Grant
    Filed: April 26, 2017
    Date of Patent: April 28, 2020
    Assignee: Sony Corporation
    Inventors: Atsushi Izumihara, Yusuke Sakai
  • Patent number: 10637987
    Abstract: A method and system for sending messages in a telecommunications network, in which digital messages which contain information on the desired reply address are mass sent, and messages, which are sent on the basis of the reply-address information are received. The reply-address information of each mass-sent message is converted to correspond to a predefined dialogue, in which the stage of the dialogue defines unequivocally the reply-address information, so that the transmission and reception of the messages are implemented in different parts of the telecommunications system.
    Type: Grant
    Filed: January 8, 2019
    Date of Patent: April 28, 2020
    Assignee: Bookit Oy
    Inventor: Jukka Kalevi Salonen
  • Patent number: 10623447
    Abstract: A method for triggering IMS communication based on a data communication protocol. In a data communication protocol, the various collected sensed data is defined in accordance with regulations specified in the present invention. Connection to a mobile phone, a computer or a hardware device or the like is established by Bluetooth, or by a virtual serial port, or by RS485 or RS232 or the like. If receiving set data matching the data communication protocol, the mobile phone, the computer or the hardware device or the like into which an IMS system client program is embedded automatically triggers the embedded IMS system client program to communicate through an IMS system. Different telecommunication numbers are triggered by different data. The data between the mobile phone, the computer or the hardware device and the data communication protocol is in a SIP-MESSAGE format.
    Type: Grant
    Filed: July 6, 2019
    Date of Patent: April 14, 2020
    Assignee: Ankang Hongtian Science & Techonology Incorporated Company
    Inventor: Lihong Hao
  • Patent number: 10617299
    Abstract: A two-way audiovisual communication device with multiple audio and video subsystems. In one embodiment, the device includes a wheeled cart that supports a dock for a tablet computing device that includes a tablet camera, a tablet display, and a tablet microphone. The device also includes a cart camera, a cart speaker, and a cart microphone. The device may be coupled to a network and accessible to other devices on the network to allow a two-way audiovisual session to take place between remote parties. The device may operate in two modes: In a first mode, the tablet is mated with the dock and the remote device receives video from the pan-tilt-zoom camera and audio from the cart microphone. In a second mode, the tablet is removed from the dock and the remote device receives video from the tablet camera and audio from the tablet microphone. In both modes, the tablet monitor displays video from the remote device.
    Type: Grant
    Filed: April 27, 2018
    Date of Patent: April 14, 2020
    Inventors: Daniel Steven Sanchez, Gary S. Douville, Shuodan Chen, James Rosenthal, Andrew Kirchhoff
  • Patent number: 10623700
    Abstract: An overlay network platform facilitates a multi-party videoconference. End users participate using client-based browser or mobile application rendering software, such as a web browser, and using a protocol such as WebRTC. Dynamic speaker selection among the participants is facilitated by continuously determining the “relevance” of a participant's stream with respect to other participants in the conference. Thus, for example, a particular participant stream might be deemed to have a higher relevance if it is the stream corresponding to a person that is currently speaking, that has spoken recently, or that is about to speak. Streams with higher relevance are then selectively delivered at higher quality relative to less relevant streams. Preferably, individual client machines determine which streams are requested and at which quality based in part on their local resource capabilities.
    Type: Grant
    Filed: April 1, 2019
    Date of Patent: April 14, 2020
    Assignee: Akamai Technologies, Inc.
    Inventors: Charles E. Gero, Thomas Houman, Abhijit C. Mehta
  • Patent number: 10616396
    Abstract: A danger detection system is provided. The system includes a user computing device programmed to receive from a microphone of the computing device a signal indicating a gunshot-like sound and automatically determine if the gunshot-like sound is a gunshot. The user computing device is also programmed to automatically determine a location of the gunshot; and to automatically generate and send to a display of the user computing device a safety notification in response to determining if the gunshot is within a predetermined distance.
    Type: Grant
    Filed: June 27, 2017
    Date of Patent: April 7, 2020
    Inventor: Adam Gersten
  • Patent number: 10616441
    Abstract: Embodiments of a fax system with adaptive protocol selection, and methods for such a system, are disclosed herein. Embodiments of a fax system may be adapted to selectively configure the protocol (both the type of protocol or aspects of a particular protocol) used in association with the transmission or reception of a specific fax. The configuration of the protocol utilized can be based on one or more attributes associated with a sender or a destination. The fax can then be transmitted or received according to those configuration parameters.
    Type: Grant
    Filed: April 29, 2019
    Date of Patent: April 7, 2020
    Inventors: Michael Alexander Preobrazhensky, Philippe C. Haussy, David M. Hayden
  • Patent number: 10609290
    Abstract: Control of video camera monitors using a augmented reality wearable device is disclosed including integration within a communications network. A user of the wearable device can communicate wirelessly with other components or elements of the network, allowing for hands-free control of the video recording and/or streaming and physical work contemporaneously.
    Type: Grant
    Filed: August 17, 2017
    Date of Patent: March 31, 2020
    Inventors: Dallen Wendt, Luke Pennington
  • Patent number: 10609333
    Abstract: In the present invention the camera of a student's mobile communications device sends a live image of the student's paper through an image-sharing subsystem to the instructor's personal computing or mobile communications device. An annotation subsystem allows the instructor to mark said image of the student's paper, and a background-subtraction subsystem allows a background-free image of the instructor to appear on said image of the student's paper. A screen-sharing subsystem transmits a combined image of the student's paper and the instructor and his or her markings back to the student's device. Mounting the student's device above the paper on which he or she is working allows the student to see the instructor and the instructor's markings overlaid on the student's paper, giving the impression that the instructor is present and collaborating on the student's work.
    Type: Grant
    Filed: February 17, 2019
    Date of Patent: March 31, 2020
    Inventor: Albert Roy Leatherman, III
  • Patent number: 10602091
    Abstract: Disclosed are a method of learning relationship among characters in video call or its background, temporal and spatial information, and visual objects and automatically recommending and providing a visual object using the relationship, and a system configured to execute the method. A method of providing video call may include: storing a visual object selection model including relation information between at least one visual object and at least one selection factor, by a video call providing system; and automatically determining, by the video call providing system, a recommended visual object to be displayed on at least one of a terminal and a counterpart terminal of the terminal performing video call, at a point of time specified for displaying a visual object, based on the visual object selection model.
    Type: Grant
    Filed: March 25, 2019
    Date of Patent: March 24, 2020
    Assignee: Hyperconnect, Inc.
    Inventors: Sangil Ahn, Hyeok Choi
  • Patent number: 10594990
    Abstract: Systems and methods provide a notification of a connectivity problem of a video doorbell to a smartphone. A first communication link between the video doorbell and a backend server is determined unavailable, such as when a password used by the video doorbell to access a local area network (LAN) is not accepted by the LAN. A Bluetooth transceiver of the video doorbell is activated and a Bluetooth signal transmitted from the smartphone is detected. A second communication link between the video doorbell and the smartphone via the Bluetooth transceiver is established and a message is sent to the smartphone, via the Bluetooth transceiver, indicating that the password used by the video doorbell to access the LAN is not accepted by the LAN. The message causes an application running on the smartphone to display a notification on a display of the smartphone indicating the communication problem.
    Type: Grant
    Filed: November 7, 2018
    Date of Patent: March 17, 2020
    Assignee: Amazon Technologies, Inc.
    Inventors: Elliott Lemberger, Joshua Hongpyo Yoon