Conferencing With Multipoint Control Unit Patents (Class 348/14.09)
  • Patent number: 11405448
    Abstract: A device may include a processor configured to monitor a user of a video conferencing application. The processor may be further configured to determine that the user corresponds to a passive user based on the monitoring; switch a setting for the video conferencing application for the user from real-time video to video streaming, in response to determining that the user corresponds to a passive user; generate a delay between receiving content via the video conferencing application and playing the content by the video conferencing application, wherein the delay progressively increases from no delay to a particular delay value over a time period, in response to switching the setting for the video conferencing application for the user from real-time video to video streaming; and play the received content using the video conferencing application based on the generated delay.
    Type: Grant
    Filed: August 23, 2021
    Date of Patent: August 2, 2022
    Assignee: Verizon Patent and Licensing Inc.
    Inventors: Pierre Seigneurbieux, Satish Malalaganv Ramakrishna, Michael Grupenhoff
  • Patent number: 11375138
    Abstract: A method includes recording a first video stream characterized by a first value of a first quality characteristic. The method includes determining that the first video stream satisfies a trigger criterion. The trigger criterion characterizes a threshold amount of video content change information. The method includes, in response to determining that the first video stream satisfies the trigger criterion, obtaining a second video stream characterized by a second value of a second quality characteristic. The second video stream includes scene information also included in the first video stream. The second value of the second quality characteristic is indicative of a higher quality video stream than the first value of the first quality characteristic. The method includes generating a third video stream by adding information from the second video stream to the first video stream. The third video stream corresponds to a higher quality version of the first video stream.
    Type: Grant
    Filed: August 4, 2020
    Date of Patent: June 28, 2022
    Assignee: APPLE INC.
    Inventors: William D. Lindmeier, Devin William Chalmers
  • Patent number: 11375158
    Abstract: One example system for sharing content across videoconferencing sub-meetings includes a processor and at least one memory device. The memory device includes instructions that are executable by the processor to cause the processor to establish a videoconferencing session including a main meeting and a first sub-meeting, receive, from a presenter, a content to be displayed in the main meeting, and cause the content to be displayed in the main meeting. The memory device further includes instructions that are executable by the processor to cause the processor to receive, from a first participant in the videoconferencing session, an indication that the content is to be displayed in the first sub-meeting, and cause the content to be displayed in the first sub-meeting simultaneously with the content in the main meeting.
    Type: Grant
    Filed: March 26, 2021
    Date of Patent: June 28, 2022
    Assignee: Zoom Video Communications, Inc.
    Inventors: Lin Han, Nitasha Walia
  • Patent number: 11368503
    Abstract: Provided is a method, computer program product, and virtual conferencing system for automatically positioning a video thumbnail within an area on a display during a virtual conferencing session. A processor may receive a data stream of a virtual conferencing session. The data stream includes visual data associated with a presentation. The processor may analyze the visual data to identify a blank space area in the visual data. The processor may display the visual data to one or more users of the virtual conferencing session. The processor may display a video thumbnail of a presenter in the blank space area.
    Type: Grant
    Filed: June 25, 2019
    Date of Patent: June 21, 2022
    Assignee: Kyndryl, Inc.
    Inventors: Saravanan Devendran, Thangadurai Muthusamy, Aditya M. Burli
  • Patent number: 11363135
    Abstract: A system and method for with an inmate in a privileged communication are disclosed. a communication system includes a portal subsystem that determines whether a communication should be monitored, or not, based on received information, including access information, from a first communication device. Based on the determination, the communication system bypasses a monitoring subsystem and stores and/or transmits the communication to a second communication device by way of a non-monitoring subsystem.
    Type: Grant
    Filed: April 6, 2020
    Date of Patent: June 14, 2022
    Assignee: Global Tel*Link Corporation
    Inventor: Stephen L. Hodge
  • Patent number: 11356289
    Abstract: Techniques for prioritization of data streams include transmitting a plurality of data streams to a first device over a network where each data stream is configured to cause the first device to perform a specific function, dynamically detecting a bandwidth limitation limiting an amount of available bandwidth for transmitting the plurality of data streams, dynamically determining bandwidth reduction criteria by identifying a first subset of the plurality of data streams to stop transmitting based on the specific function that each respective data stream causes the first device to perform, temporarily stopping transmitting of the first subset of data streams configured to cause the first device to perform a first set of functions, and continuing to transmit a second subset of data streams not included in the first subset of the data streams to the first device to cause the first device to continue to perform a second set of functions.
    Type: Grant
    Filed: September 4, 2020
    Date of Patent: June 7, 2022
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Arash Ghanaie-Sichanie, Sriram Srinivasan, Wei Xiong, Bin Wang
  • Patent number: 11290356
    Abstract: Aspects of the disclosure relate to a method for inspecting a data stream. The method may include conveying the data stream through a multi-level data channel and inspection architecture. The architecture includes a multi-level data pipeline. The pipeline is formed from pipes arranged serially such that each output of one pipe provides an input to a successive one of the plurality of pipes. The pipeline receives the data stream at an upstream portion of the pipeline, and inspects the data in the data stream. Thereafter, the pipeline outputs inspected data at a downstream portion of the pipeline. The outputted inspected data becomes inputted date for a successive one of the pipes. A data manager may be configured to coordinate passage of the data into and out of the pipeline, and between one or more of the group of mechanisms.
    Type: Grant
    Filed: November 2, 2020
    Date of Patent: March 29, 2022
    Assignee: Bank of America Corporation
    Inventors: Rajesh Narayanan, Manu Jacob Kurian
  • Patent number: 11256464
    Abstract: According to an embodiment, provided is a communication device that performs communications of an image and audio. The communication device includes: a storage unit that stores therein arrangement information for specifying a display scheme for the image; an arrangement-information setting unit that sets arrangement information in the storage unit; and a display control unit that refers to the arrangement information and causes a plurality of display devices to display the image. The display control unit causes a first display device to display captured images of a local point and a remote point and causes a second display device to display an image supplied from an image supply device of the local point or the remote point.
    Type: Grant
    Filed: June 18, 2020
    Date of Patent: February 22, 2022
    Assignee: RICOH COMPANY, LTD.
    Inventor: Yoshinaga Kato
  • Patent number: 11258836
    Abstract: A method, computer program product, and computer system for providing, by a computing device, a session of an application, wherein the session may include a sub-session configured to exchange data with a plurality of endpoint devices. The computing device may receive a stream of data from an endpoint device outside the plurality of endpoint devices and that controls the session. The computing device may provide data to at least one of the plurality of endpoint devices, wherein the data may include the stream of data from the endpoint device that controls the session and another stream of data from a different endpoint device of the plurality of endpoint devices.
    Type: Grant
    Filed: January 22, 2021
    Date of Patent: February 22, 2022
    Assignee: CITRIX SYSTEMS, INC.
    Inventor: Yuran Ou
  • Patent number: 11234073
    Abstract: The disclosed computer-implemented method may include accessing environment information identifying an undesired sound source within an environment. The method may further include determining, based on the accessed environment information, a spatial location of the undesired sound source in the environment that is to be attenuated using an active noise cancelling (ANC) signal. The method may also include forming a microphone beam, using two or more microphones, directed at the determined spatial location, where the microphone beam is configured to capture audio information from the determined spatial location. Still further, the method may include generating an ANC signal using the audio information captured using the microphone beam, and playing back the generated ANC signal to attenuate the undesired sound source at the determined spatial location. Various other methods, systems, and computer-readable media are also disclosed.
    Type: Grant
    Filed: November 14, 2019
    Date of Patent: January 25, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Buye Xu, Antonio John Miller, Jacob Ryan Donley
  • Patent number: 11228766
    Abstract: Videos may be characterized by objective metrics that quantify video quality. Embodiments are directed to target bitrate prediction methods in which one or more objective metrics may serve as inputs into a model that predicts a mean opinion score (MOS), a measure of perceptual quality, as a function of metric values. The model may be derived by generating training data through conducting subjective tests on a set of video encodings, obtaining MOS data from the subjective tests, and correlating the MOS data with metric measurements on the training data. The MOS predictions may be extended to predict the target (encoding) bitrate that achieves a desired MOS value. The target bitrate prediction methods may be applied to segments of a video. The methods may be made computationally faster by applying temporal subsampling.
    Type: Grant
    Filed: January 7, 2021
    Date of Patent: January 18, 2022
    Assignee: EUCLID DISCOVERIES, LLC
    Inventors: Dane P. Kottke, Katherine H. Cornog, John J. Guo, Myo Tun, Jeyun Lee, Nigel Lee
  • Patent number: 11202035
    Abstract: This disclosure describes a video room system that can efficiently and flexibly generate and facilitate video rooms for video chatting between participant devices by prioritizing video streams to provide to participant devices based on performance parameters. For example, the video room system can provide different video room streams to different participant devices based on the performance parameters of the participant devices. In addition, the video room system can customize or tailor video room streams based on identifying dominant speaker devices, determining connections between participant devices as indicated by a social graph of a social networking system, and/or based on join methods utilized by participant devices to join a video room.
    Type: Grant
    Filed: March 9, 2021
    Date of Patent: December 14, 2021
    Assignee: FACEBOOK, INC.
    Inventors: Vivek Garg, Mudit Goel, Paul Seia Ogawa, Eduardo Diaz Real, Joel Alexander Sharin, Keetaek Hong, Ross Legacy
  • Patent number: 11188389
    Abstract: A technique is described herein for allocating tasks within a distributed system. The distributed system includes plural computing devices. Each computing device, in turn, provides a bucket manager and at least one application instance. The bucket managers allocate work to the computing devices in units of buckets, in a manner governed by a set of application-specific initialization parameters. The bucket managers also perform their assignment function in cooperation with a separate storage and notification (S&N) system. The S&N system stores data nodes in a hierarchical data structure that reflect the assignment-related state of the distributed system. The S&N system also notifies the bucket managers upon changes in the data nodes. According to one provision, the bucket managers include logic that reduces expensive context changes when computing devices join and leave the distributed system.
    Type: Grant
    Filed: July 2, 2019
    Date of Patent: November 30, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Jia Zhu, Simon Julian Powers, Paolo Codato, Yi Zou, Junaid Ahmed
  • Patent number: 11115541
    Abstract: Teleconference audio data including a plurality of individual uplink data packet streams, may be received during a teleconference. Each uplink data packet stream may corresponding to a telephone endpoint used by one or more teleconference participants. The teleconference audio data may be analyzed to determine a plurality of suppressive gain coefficients, which may be applied to first instances of the teleconference audio data during the teleconference, to produce first gain-suppressed audio data provided to the telephone endpoints during the teleconference. Second instances of the teleconference audio data, as well as gain coefficient data corresponding to the plurality of suppressive gain coefficients, may be sent to a memory system as individual uplink data packet streams. The second instances of the teleconference audio data may be less gain-suppressed than the first gain-suppressed audio data.
    Type: Grant
    Filed: November 21, 2019
    Date of Patent: September 7, 2021
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Glenn N. Dickins, Richard J. Cartwright
  • Patent number: 11115444
    Abstract: Apparatus comprising an interface for receiving a respective uplink data stream from each of three or more further apparatuses, and for transmitting a respective downlink data stream to each of the further apparatuses; and a logic system in communication with the interface. The logic system is configured: to receive first data in the uplink data stream received from a first one of the further apparatuses; and in a first mode, to include at least some of the first data in the respective downlink data streams transmitted to every other one of the further apparatuses, or, in a second mode, to include at least some of the first data in the downlink data stream transmitted to a second one of the further apparatuses and to omit or attenuate substantially all of the first data in the downlink data stream transmitted to at least a third one of the further apparatuses. Corresponding methods and computer readable media are disclosed.
    Type: Grant
    Filed: August 8, 2017
    Date of Patent: September 7, 2021
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Rowan James Katekar, Glenn N. Dickins
  • Patent number: 11102451
    Abstract: A videoconferencing server for providing a multi-screen video conference by using multiple videoconferencing terminals and a method thereof. The video conferencing server can logically group a plurality of the existing videoconferencing terminals (physical terminals) each having one or two displays to operate like a logical terminal operating as one videoconferencing point. The video conferencing server may process as if the logical terminal supports multiple screens by transmitting videos to the plurality of physical terminals constituting the logical terminal.
    Type: Grant
    Filed: March 20, 2018
    Date of Patent: August 24, 2021
    Assignee: UPRISM CO., LTD.
    Inventor: Min Soo Cha
  • Patent number: 11102490
    Abstract: A method of controlling intra prediction for decoding or encoding of a video sequence, is by at least one processor and includes obtaining an index of an intra prediction mode of a current block of the video sequence, obtaining a coefficient scanning direction based on the obtained index, using a first look up table indicating a mapping between a plurality of indices of a plurality of intra prediction modes and respective coefficient scanning directions, and performing a coefficient scanning of the current block, based on the obtained coefficient scanning direction.
    Type: Grant
    Filed: December 18, 2019
    Date of Patent: August 24, 2021
    Assignee: TENCENT AMERICA LLC
    Inventors: Yiming Li, Xiaozhong Xu, Zhenzhong Chen, Shan Liu
  • Patent number: 11102595
    Abstract: An audiovisual conferencing system provides a centrally controlled system for managing and broadcasting the audiovisual data sent from a group of members using their own personal devices. In an exemplar embodiment, a moderator controls requests from various participant members to broadcast audio or video from their personal mobile device to the other group members. In various embodiments, the moderator has the capability to manage the member requests to broadcast social media or registered user profile information about the member or other textual or graphic information originating from or about the group member. In various embodiments, the audio and video broadcasts from group members, the member requests to broadcast and the set or queue of member requests to broadcast, which may be prioritized or otherwise organized by the moderator, are hosted in the cloud or Internet.
    Type: Grant
    Filed: August 30, 2020
    Date of Patent: August 24, 2021
    Assignee: Social Microphone, Inc.
    Inventors: Kenneth Nathaniel Sherman, Andrew Michael Livingston
  • Patent number: 11057443
    Abstract: A video conference apparatus includes a relay unit that is configured to transmit video image data acquired at a site of a first conference system to a second terminal provided in a second conference system and transmit video image data of the second conference system to a first terminal provided in the first conference system. The relay unit is configured to transmit only a combined video image of video images at respective sites of the first conference system to the second terminal as first video image data, and transmit a video image sent from the second terminal to the first terminal as second video image data.
    Type: Grant
    Filed: February 19, 2020
    Date of Patent: July 6, 2021
    Assignee: Panasonic Intellectual Property Management Co., Ltd.
    Inventors: Naoki Koga, Hiroshige Masuda, Keita Waseda, Satoshi Yashiki
  • Patent number: 11050801
    Abstract: During a call session between a first user equipment (UE) and a second UE managed by a call application server, the first UE can send a request to a conference application server to upgrade the call session to a meeting session. The conference application server can set up the meeting session. Once the first UE and the second UE have joined the meeting session with the conference application server, the first UE and the second UE can end their legs of the original call session with the call application server. The first UE and the second UE can transition their user interfaces from a call mode to a meeting mode upon joining the meeting session, such that users are seamlessly transitioned from a call to a meeting.
    Type: Grant
    Filed: December 4, 2018
    Date of Patent: June 29, 2021
    Assignee: T-Mobile USA, Inc.
    Inventor: Vinod Ravichandran
  • Patent number: 11038704
    Abstract: Embodiments of the disclosure provided herein can be used to improve the control, selection and transmission of data to a remote video conferencing environment, by use of a plurality of wired or wirelessly connected electronic devices. In one example, the transmission of data from a local environment can be improved by switching the source of visual inputs (e.g., cameras or display of an electronic device, such as laptop) and/or audio inputs (e.g., microphones) to the one or more appropriate visual and audio sources available within the local environment. The most appropriate visual and audio sources can be the sources that provide the participants in the remote environment the most relevant data giving the remote users the best understanding of the current activities in the local environment.
    Type: Grant
    Filed: August 16, 2019
    Date of Patent: June 15, 2021
    Assignee: LOGITECH EUROPE S.A.
    Inventors: Andreas Franz William Atkins, Joseph Yao-Hua Chu, Henry Levak, Kevin Mclintock
  • Patent number: 11013989
    Abstract: Methods and systems are provided for independent audio volume control. An audio system that includes at least one audio output element may be configured for handling and outputting, via the at least one audio output element, combined-game-and-chat audio. The handling may include determining, based on user input, a mix setting for mixing together of a chat audio component and a game audio component to generate combined-game-and-chat audio signals; determining a corresponding volume setting applicable at an audio output element of the audio system; and determining based on a mixing related parameter, a delay for applying the volume setting in the audio output element. The mix setting may be determined based on a data set characterizing the audio system. Application of one or both of the mix setting and the volume setting may be controlled, such as based a plurality of ramp up or down steps, for gradual or stepped changes.
    Type: Grant
    Filed: March 11, 2019
    Date of Patent: May 25, 2021
    Assignee: VOYETRA TURTLE BEACH, INC.
    Inventors: Shobha Devi Kuruba Buchannagari, Kevin Robertson, Scott Warren
  • Patent number: 11006075
    Abstract: A novel universal bridge (UB) can handle and conduct multimedia multipoint conferences between a plurality of MREs and LEPs without using an MRM, an MCU and a gateway. Further, a UB can be configured to allocate and release resources dynamically according to the current needs of each conferee and the session.
    Type: Grant
    Filed: September 12, 2019
    Date of Patent: May 11, 2021
    Assignee: Polycom, Inc.
    Inventor: Avishay Halavy
  • Patent number: 11006232
    Abstract: An example playback device is configured to (i) receive, via a network interface, data representing a command to play back audio content, where the audio content is a first type of audio content, (ii) during playback of the first type of audio content via an audio amplifier configured to drive a speaker, apply a first calibration and a second calibration to playback by the playback device, where the first calibration at least partially offsets one or more acoustic characteristics of an environment surrounding the playback device when applied to playback by the playback device, and where the second calibration corresponds to the first type of audio content, and (iii) during playback of a second type of audio content via the audio amplifier configured to drive the speaker, apply a third calibration to playback by the playback device, where the third calibration corresponds to the second type of audio content.
    Type: Grant
    Filed: December 21, 2020
    Date of Patent: May 11, 2021
    Assignee: Sonos, Inc.
    Inventors: Klaus Hartung, Dayn Wilberding
  • Patent number: 10999089
    Abstract: Certain aspects of the disclosure are directed to communication bridging among disparate platforms in a remote communications environment. According to a specific example, a remote communications service module configured to provide remote communications services including a communication bridging service and another type of data communications services, in the remote communications environment. The communication server further comprises a uniform resource locator (URL) generation module configured to facilitate formation of the communication bridge by generating a URL associated with the communication bridge, and identifying chat room protocols associated with the first and second chat rooms. The server further comprises an assimilation and processing module configured to translate chat messages using the specifications for the first and second chat room protocols, and transmit chat messages between the first chat room and the second chat room.
    Type: Grant
    Filed: April 6, 2020
    Date of Patent: May 4, 2021
    Assignee: 8x8, Inc.
    Inventors: Andrei Soroker, Peter Hizalev, Bryan R. Martin
  • Patent number: 10966040
    Abstract: An example playback device is configured to (i) receive, via a network interface, data representing a command to play back audio content, where the audio content is a first type of audio content, (ii) during playback of the first type of audio content via an audio amplifier configured to drive a speaker, apply a first calibration and a second calibration to playback by the playback device, where the first calibration at least partially offsets one or more acoustic characteristics of an environment surrounding the playback device when applied to playback by the playback device, and where the second calibration corresponds to the first type of audio content, and (iii) during playback of a second type of audio content via the audio amplifier configured to drive the speaker, apply a third calibration to playback by the playback device, where the third calibration corresponds to the second type of audio content.
    Type: Grant
    Filed: December 21, 2020
    Date of Patent: March 30, 2021
    Assignee: Sonos, Inc.
    Inventors: Klaus Hartung, Dayn Wilberding
  • Patent number: 10965481
    Abstract: Disclosed is an information processing device capable of remote sharing with one or a plurality of other information processing devices. The information processing device acts as a reference information processing device, and includes a memory; and one or more processors coupled to the memory and configured to display one or more of the other information processing devices as a candidate for remote connection, the one or more of the other information processing devices being used by same participants as participants determined in the reference information processing device; prompt a user of the reference information processing device to select any of the one or more of the other information processing devices displayed as a candidate for remote connection; and remotely connect the reference information processing device to the selected one or more of the other information processing devices.
    Type: Grant
    Filed: November 29, 2019
    Date of Patent: March 30, 2021
    Assignee: RICOH COMPANY, LTD.
    Inventor: Shigeo Araki
  • Patent number: 10951430
    Abstract: An electronic communication method and system are disclosed. Exemplary methods include using the second communication device, determining a presence of a first communication device, based on the step of determining the presence of the first communication device, using a cloud service, connecting the first communication device to the electronic communication, and using the cloud service, connecting the second communication device to the electronic communication. Exemplary methods and systems can provide a way to automatically extract meeting access information and seamlessly launch and/or log a user/participant into an electronic communication.
    Type: Grant
    Filed: March 19, 2019
    Date of Patent: March 16, 2021
    Assignee: Mitel Networks Corporation
    Inventors: Anders Fahrendorff, Ian Murchison, Logendra Naidoo
  • Patent number: 10951947
    Abstract: The disclosed system implements techniques to identify activity in which attendees to a communication session likely have a greater interest. Prior to commencement of a communication session or during the communication session, the techniques enable a list of attendees to a communication session to be designated as a group for which detected activity has a priority with respect to being displayed. The designated list of attendees is a subset of a total number of attendees to the communication session. The system monitors streams associated with individual attendees on the list to detect an occurrence of a preset target event. The system configures a portion of a graphical user interface of the communication session to accentuate the stream that includes the occurrence of the preset target event.
    Type: Grant
    Filed: June 28, 2018
    Date of Patent: March 16, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Jason Thomas Faulkner, Sonu Arora, Santhosh Kumar Misro, Joshua George, Kevin Daniel Morrison
  • Patent number: 10931919
    Abstract: A video conference system, a video conference apparatus and a video conference method are provided. The video conference system includes a video conference apparatus and a display apparatus. The video conference apparatus includes an image detection device, a sound source detection device, and a processor. The image detection device obtains a conference image of a conference space. When the sound source detection device detects a sound generated by a sound source in the conference space, the sound source detection device outputs a positioning signal. The processor receives the positioning signal, and determines whether a real face image exists in a sub-image block of the conference image corresponding to the sound source according to the positioning signal to output the image signal. The display apparatus displays a close-up conference image including the real face image according to the image signal.
    Type: Grant
    Filed: May 5, 2020
    Date of Patent: February 23, 2021
    Assignee: Optoma Corporation
    Inventors: Yuan-Mao Tsui, Shou-Hsiu Hsu, Yu-Cheng Lee
  • Patent number: 10928895
    Abstract: Techniques for interacting with a first computing device based on gaze information are described. In an example, the first computing device captures a gaze direction of a first user of the first computing device by using an eye tracking device. The first computing device displays a representation of a second user on a display of the first computing device. Further, the first computing device receives from the first user, communication data generated by an input device. The first computing device determines if the gaze direction of the first user is directed to the representation of the second user. If the gaze direction of the first user is directed to the representation of the second user, the first computing device transmits the communication data to a second computing device of the second user.
    Type: Grant
    Filed: September 19, 2018
    Date of Patent: February 23, 2021
    Assignee: Tobii AB
    Inventors: Daniel Ricknäs, Erland George-Svahn, Rebecka Lannsjö, Andrew Ratcliff, Regimantas Vegele, Geoffrey Cooper, Niklas Blomqvist
  • Patent number: 10917612
    Abstract: In one embodiment, a video conference endpoint may detect a one or more participants within a field of view of a camera of the video conference endpoint. The video conference endpoint may determine one or more alternative framings of an output of the camera of the video conference endpoint based on the detected one or more participants. The video conference endpoint may send the output of the camera of the video conference endpoint to one or more far-end video conference endpoints participating in a video conference with the video conference endpoint. The video conference endpoint may send data descriptive of the one or more alternative framings of the output of the camera to the far-end video conference endpoints. The far-end video conference endpoints may utilize the data to display one of the one or more alternative framings.
    Type: Grant
    Filed: October 28, 2019
    Date of Patent: February 9, 2021
    Assignee: Cisco Technology, Inc.
    Inventors: Christian Fjelleng Theien, Rune Øistein Aas, Kristian Tangeland
  • Patent number: 10911735
    Abstract: A system and methods for a CODEC driving a real-time light field display for multi-dimensional video streaming, interactive gaming and other light field display applications is provided applying a layered scene decomposition strategy. Multi-dimensional scene data is divided into a plurality of data layers of increasing depths as the distance between a given layer and the display surface increases. Data layers which are sampled using an effective resolution function to determine a suitable sampling rate and rendered using hybrid rendering, such as perspective and oblique rendering, to encode light fields corresponding to each data layer. The resulting compressed, (layered) core representation of the multi-dimensional scene data is produced at predictable rates, reconstructed and merged at the light field display in real-time by applying view synthesis protocols, including edge adaptive interpolation, to reconstruct pixel arrays in stages (e.g. columns then rows) from reference elemental images.
    Type: Grant
    Filed: February 21, 2020
    Date of Patent: February 2, 2021
    Assignee: Avalon Holographics Inc.
    Inventors: Matthew Hamilton, Chuck Rumbolt, Donovan Benoit, Matthew Troke, Robert Lockyer, Thomas Butyn
  • Patent number: 10897599
    Abstract: In one aspect, an apparatus may include at least one processor and storage accessible to the at least one processor. The storage may include instructions executable by the at least one processor to compare a first number of bytes sent from a first device as part of a video conference to a second number of bytes received at a second device as part of the video conference, where the first and second number of bytes may both pertain to a same portion of the video conference. The instructions may also be executable to, responsive to the first number of bytes not matching the second number of bytes to within a threshold, take one or more actions to assist in mitigating future loss of bytes for the video conference.
    Type: Grant
    Filed: February 18, 2020
    Date of Patent: January 19, 2021
    Assignee: Lenovo (Singapore) Pte. Ltd.
    Inventors: Matthew Fardig, Lindsay Nelson, Sarah Kleinman, Shawn Sharp
  • Patent number: 10897618
    Abstract: In various embodiments, an encoding optimization application positions key frames within encoded video sequences based on shot changes. The encoding optimization application determines key frame location(s) based on shot change(s) included in a source video sequence associated with a media title. Each key frame location is associated with a different frame included in the source video sequence. For each of the key frame location(s), the encoding optimization application configures an encoding application to encode a frame of video content located at the key frame location as a key frame when performing encoding operations. Subsequently, the encoding optimization application causes the encoding application to perform encoding operation(s) on the source video sequence to generate a first encoded video sequence. During playback, the media title is switchable between a decoded version of the first encoded video sequence and a decoded version of a second encoded video sequence at the key frame location(s).
    Type: Grant
    Filed: February 22, 2018
    Date of Patent: January 19, 2021
    Assignee: NETFLIX, INC.
    Inventor: Ioannis Katsavounidis
  • Patent number: 10880519
    Abstract: A panoramic video conferencing server is disclosed. The server is operational to capture an audio stream via an array of microphones. The captured audio stream is de-multiplexed to extract audio for a plurality of audio zones. A region of interest (ROI) is determined for a plurality of client devices to which a panoramic video is being streamed. The ROI is determined based on a zoom information which is inputted by any one of the client devices. A modified audio channel associated with the panoramic video being streamed to at least one of the client devices is generated for each of the client devices. The modified audio channel is adjusted to coincide with directionality of an audio corresponding to the associated region of interest (ROI) inputted by the at least one of said client device and the modified audio channel is adjusted to mute audio corresponding to the audio zones other than the audio zone associated with the ROI.
    Type: Grant
    Filed: May 28, 2019
    Date of Patent: December 29, 2020
    Assignee: Altia Systems Inc.
    Inventors: Ram Natarajan, Aurangzeb Khan, Naveed Alam, Yashket Gupta, Lars Herlitz
  • Patent number: 10826801
    Abstract: Aspects of the disclosure relate to a method for inspecting a data stream. The method may include conveying the data stream through a multi-level data channel and inspection architecture. The architecture includes a multi-level data pipeline. The pipeline is formed from pipes arranged serially such that each output of one pipe provides an input to a successive one of the plurality of pipes. The pipeline receives the data stream at an upstream portion of the pipeline, and inspects the data in the data stream. Thereafter, the pipeline outputs inspected data at a downstream portion of the pipeline. The outputted inspected data becomes inputted date for a successive one of the pipes. A data manager may be configured to coordinate passage of the data into and out of the pipeline, and between one or more of the group of mechanisms.
    Type: Grant
    Filed: July 31, 2019
    Date of Patent: November 3, 2020
    Assignee: Bank of America Corporation
    Inventors: Rajesh Narayanan, Manu Jacob Kurian
  • Patent number: 10826979
    Abstract: The present invention relates to technology that allows a logical grouping of client nodes using client identifiers in an Internet of things environment. An apparatus for grouping client nodes according to an embodiment of the invention can include: a manager unit configured that receives a connection request from a client node and assigns a particular MQTT (Message Queuing Telemetry Transport) broker to the client node in response to the connection request; an MQTT brokerage unit that includes at least one or more MQTT brokers and receives from the client node the identifier information and subscribed topic information of the client node by way of the particular MQTT from among the at least one or more MQTT brokers; and a load processing unit that stores the received identifier information and the topic information in a database to newly connect the client node.
    Type: Grant
    Filed: December 4, 2017
    Date of Patent: November 3, 2020
    Assignee: University-Industry Cooperation Group of Kyung-Hee University
    Inventors: Eui Nam Huh, Yong Hyun Kim
  • Patent number: 10805557
    Abstract: An object is to clarify a relation between a partial area on an image and a voice corresponding to the area when providing them to a user. A control section acquires an image such as a fisheye moving image stored in a storage section and a voice corresponding to this image from the storage section, specifies a partial area on a plane of the entire area of the acquired image, acquires a voice from a direction corresponding to the specified partial area among all acquired voices and outputs this voice from a loudspeaker section.
    Type: Grant
    Filed: September 14, 2018
    Date of Patent: October 13, 2020
    Assignee: CASIO COMPUTER CO., LTD.
    Inventor: Kazuhisa Kitamura
  • Patent number: 10771272
    Abstract: Techniques for conducting a communication session include receiving, from a first device and in connection with a communication session, an indication of a bandwidth limitation on transferring data associated with the communication session, the first device being configured to generate a plurality of data streams associated with the communication session and to transmit the plurality of data streams to a second device; dynamically determining one or more operating parameters of the first device to reduce the amount of bandwidth required to transmit the plurality of data streams by eliminating one or more data streams, reducing an amount of bandwidth required by one or more data streams, or both based on bandwidth reduction criteria determined by the first device, the second device, or both; and directing the first device to transmit the plurality of data streams to the second device according to the one or more operating parameters.
    Type: Grant
    Filed: November 1, 2019
    Date of Patent: September 8, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Arash Ghanaie-Sichanie, Sriram Srinivasan, Wei Xiong, Bin Wang
  • Patent number: 10747490
    Abstract: Provided is a method for displaying an image on a device. The method includes: acquiring, by a wearable device, use information indicating whether a user uses the device; determining at least a portion of an image displayed by the wearable device according to the use information acquired; and transmitting the at least a portion of the image determined to the device.
    Type: Grant
    Filed: March 23, 2015
    Date of Patent: August 18, 2020
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventor: Hak-su Jeong
  • Patent number: 10726877
    Abstract: The present invention generates a compression invariant motion timeline for a video. For each second in the video, the method uses an identification procedure to determine a stored key frame size, a frame counter, and an accumulated size of frames. The method then calculates and stores a motion value for the second using the stored key frame size, the frame counter, and the accumulated size of frames. The motion values for each second may be used to construct a timeline for the video.
    Type: Grant
    Filed: March 1, 2019
    Date of Patent: July 28, 2020
    Assignee: Verint Americas Inc.
    Inventor: Zvi Figov
  • Patent number: 10715736
    Abstract: An image capturing apparatus including an image capturing unit capable of moving its imaging direction and a sound input unit including a plurality of microphones, a sound source direction detecting unit which detects a sound source direction based on sound data from the sound input unit, a control unit which performs processing related to image capturing, and, a vibration detecting unit which detects a vibration due to a contact on a housing of the image capturing apparatus, wherein, in a case where a vibration due to a contact is detected, the sound source direction detecting unit detects a direction of sound due to the contact, the control unit estimates a position of the contact on the housing, and the control unit sets the imaging direction of the image capturing unit to a direction based on the estimated position.
    Type: Grant
    Filed: March 29, 2019
    Date of Patent: July 14, 2020
    Assignee: Canon Kabushiki Kaisha
    Inventors: Yusuke Toriumi, Kikuo Kazama, Nobuhiko Tanaka
  • Patent number: 10701344
    Abstract: Technology to display images with presence on a display device while reducing data communication volume. An information processing device includes: a communicator; a multiple viewpoint image generator configured to, based on a three-dimensional model of a subject the communicator receives from an external device, generate a display image including a viewpoint image corresponding to the perspective of multiple viewpoints; and a display controller configured to display the display image on a multiple viewpoint display device that displays images corresponding to multiple viewpoints.
    Type: Grant
    Filed: November 21, 2016
    Date of Patent: June 30, 2020
    Assignee: SEIKO EPSON CORPORATION
    Inventors: Yasumasa Nakajima, Hiroshi Matsushita, Senichi Mokuya
  • Patent number: 10700883
    Abstract: Apparatus and method for teleconferencing with multiple participants using a computer device through which one locally present participant is connected with multiple remote participants, the computer device including one processor device and two output devices. One output device is configured as an optical display device and one output device, as an audio device. The output devices realize a conference environment for the participants. On the display device, a display area is depicted on which a conference environment is depicted and on which the participants in the teleconference are graphically represented by representatives.
    Type: Grant
    Filed: December 3, 2018
    Date of Patent: June 30, 2020
    Assignee: VITERO GMBH
    Inventor: Fabian Kempf
  • Patent number: 10681309
    Abstract: A non-Skype multipoint control unit (MCU) is configured to operate differently for handling incoming streams from endpoints and outgoing streams from a Skype multipoint control unit. When passing incoming streams from non-Skype endpoints to a Skype conference, the non-Skype MCU acts as a gateway, passing the streams to Skype MCU as if they were coming from Skype endpoints. When receiving outgoing streams from Skype MCU, the non-Skype MCU acts as an MCU, transcoding, compositing, and scaling streams into continuous presence layouts for delivery to the non-Skype endpoints. Thus, non-Skype endpoints can participate in Skype conferences as if they were Skype endpoints, allowing a better user experience for both Skype endpoints and non-Skype endpoints.
    Type: Grant
    Filed: March 29, 2018
    Date of Patent: June 9, 2020
    Assignee: Polycom, Inc.
    Inventors: Jeffrey Adams, Eric Nylander, Damian Diaz, Chad Alexander, Joanne Kubischta, George David, Matt Parker, Jozef Saniga, Ryan Hermanson
  • Patent number: 10673920
    Abstract: Disclosed are methods and systems for selecting a host facility for a communications session for a group of devices. In one aspect, a method includes partitioning the devices into multiple clusters. Each cluster is associated with a respective host facility that is estimated to provide each device in the respective cluster a specified quality requirement during the communication session. The method also includes accessing a weighting value for each cluster of the different clusters based on one or more attributes of the devices in each respective cluster of the different clusters, and selecting a group host facility, from the host facilities associated with the clusters based on the weighting value of each respective cluster and a predefined criterion, the group host facility to host the communication session for the devices.
    Type: Grant
    Filed: August 8, 2018
    Date of Patent: June 2, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Amer Aref Hassan, Sonu Arora, Omar Aftab, Bradford R. Clark, Danny Levin
  • Patent number: 10656896
    Abstract: Examples associated with display mapping are described. One example system includes a display mapping module. The display mapping module maps display components connected to the system to virtual channels to which the system is subscribed. A communication module transmits a content instruction to subscribers of a virtual channel. The instruction controls the subscribers of the virtual channel to display content associated with the content instruction on display components the respective subscribers have mapped to the virtual channel. A display module causes a display component mapped to the virtual channel to display content associated with the content instruction.
    Type: Grant
    Filed: September 20, 2016
    Date of Patent: May 19, 2020
    Assignee: Hewlett-Packard Development Company, L.P.
    Inventors: Arun Kumar Paruchuri, Nelson L. Chang, Jason Jewell, Juan Pablo Sepulveda Lopez, Enrique Alejandro Pena Arenzana, Curtis N. Thetford
  • Patent number: 10659731
    Abstract: In one embodiment, a method includes accessing input data from one or more different input sources. The input sources include: one or more cameras, one or more microphones, and a social graph maintained by a social-networking system. Based on the input data, generating a current descriptive model for a current audio-video communication session that comprises one or more descriptive characteristics about (1) an environment associated with the current audio-video communication session, (2) one or more people within the environment, or (3) one or more contextual elements associated with the current audio-video communication session. The method also includes generating one or more instructions for the current audio-video communication session that are based the one or more descriptive characteristics; and sending the one or more instructions to a computing device associated with the one or more cameras and the one or more microphones.
    Type: Grant
    Filed: October 5, 2018
    Date of Patent: May 19, 2020
    Assignee: Facebook, Inc.
    Inventors: Jason Francis Harrison, Eric W. Hwang, Rahul Nallamothu, Shahid Razzaq
  • Patent number: 10659729
    Abstract: The present disclosure is directed toward systems and methods for optimizing video conferences. For instance, systems and methods described herein optimize both the transmission and display of one or more video conference data streams. Systems and methods described herein optimize the transmission and display of one or more video conference data streams by identifying a context associated with the one or more video conference data streams and optimizing the one or more video conference data streams based on the identified context.
    Type: Grant
    Filed: September 10, 2018
    Date of Patent: May 19, 2020
    Assignee: FACEBOOK, INC.
    Inventor: Oliver Pell