Display Arrangement (e.g., Multiscreen Display) Patents (Class 348/14.07)
  • Patent number: 10931863
    Abstract: A method of controlling cameras from a set of cameras in a geographical region to obtain image streams capturing a topographical area of interest. It includes receiving an area data object defining the topographical area of interest; deriving a centroid of the topographical area of interest from the area data object; determining a subset of target cameras from the set of cameras having a zone of potential coverage comprising the topographical area of interest; computing pan and tilt angles for one or more target cameras of the subset of target cameras; computing for one or more target cameras of the subset of target cameras a zoom factor, the zoom factor calculated by determining a narrowest field of view angle of the target camera that encompasses the entire topographical area of interest; and generating transmission commands for the subset of target cameras.
    Type: Grant
    Filed: September 13, 2018
    Date of Patent: February 23, 2021
    Assignee: GENETEC INC.
    Inventors: Yannick Nadeau, Simon Brassard
  • Patent number: 10912019
    Abstract: Methods and systems are presented for providing audio routing and roaming functionality for a wireless intercom system including a plurality of wireless access points. A first wireless access point is configured to receive a communication from a first wireless intercom device and identify a home access point for the first wireless intercom device. The first wireless access point transmits audio data from the first wireless intercom device directly to the intercom system in response to a determination that the first wireless access point is the home access point for the first wireless device. The audio data from the first wireless intercom device is transmitted to the intercom system through a second wireless access point in response to a determination that the second wireless access point is the home access point for the first wireless intercom device.
    Type: Grant
    Filed: March 14, 2017
    Date of Patent: February 2, 2021
    Assignee: Robert Bosch GbmH
    Inventors: Jason Brchan, Jim Andersen, Keith Jenkins, La Rhue Gene Friesen
  • Patent number: 10911741
    Abstract: A device (100) comprising an antenna array (102) having a plurality of transmit and receive antennas (104) for wireless radio communication and a display (106) for displaying a stereoscopic image (108), wherein the stereoscopic image (108) is visible to an observer (110A, 110B) at a position (112A, 112B), wherein the antenna array (102) and the display (104) are arranged so that from the position (112A, 112B) the observer's view of at least a part of the antenna array (102) is obstructed by the display (106). A method for operating the device.
    Type: Grant
    Filed: December 4, 2017
    Date of Patent: February 2, 2021
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Simone Maier, Andreas Pascht, Wolfgang Templ
  • Patent number: 10911717
    Abstract: Provided is a method and system for providing a video stream for a video conference. A video stream providing method may include managing class information in which a resolution range for the video conference is classified into a plurality of classes; determining at least two classes in which a resolution providable from a source providing client that participates in the video conference is included among the plurality of classes, based on the class information; encoding a video stream for the video conference as a plurality of layers using a resolution set for each of the determined at least two classes; and controlling an electronic device of the source providing client to transmit the video stream encoded as the plurality of layers to a server for the video conference over a network.
    Type: Grant
    Filed: January 6, 2020
    Date of Patent: February 2, 2021
    Assignee: LINE CORPORATION
    Inventor: Jung nam Gwock
  • Patent number: 10911790
    Abstract: A method and an apparatus for pushing a live broadcast video are provided. The method includes obtaining plural live broadcast videos related to a live broadcast theme, the live broadcast videos including live broadcast videos enabled after a participation entrance of the live broadcast theme is triggered. Tags of the plurality of live broadcast videos are obtained. The tags correspond to video display locations on a live broadcast theme page of the live broadcast theme in a one-to-one correspondence. The tags are added to the live broadcast videos. A live broadcast video to which the tags have been added is selected as a target live broadcast video. The selected target live broadcast video is pushed to the live broadcast theme page in real-time, the target live broadcast video being played at a corresponding display location on the live broadcast theme page.
    Type: Grant
    Filed: February 19, 2019
    Date of Patent: February 2, 2021
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Xiang Zhang, Xiao Jun Yin, Yu Qi Cai, Zi He Dai
  • Patent number: 10902274
    Abstract: In implementations of opting-in or opting-out of visual tracking, a computing device maintains digital images received for scanning, and includes an image scanning system that receives a digital image depicting one or more faces of persons captured in the digital image. The image scanning system is implemented to detect a face of a person who is depicted in the digital image from a scan of the digital image. The image scanning system can then scan the digital image for a visual tracking identifier that indicates a preference of the person for one of opting-in or opting-out of visual tracking. The image scanning system can detect the visual tracking identifier associated with the person from the scan of the digital image, and continue or discontinue the visual tracking of the person based on the visual tracking identifier indicating that the person opt-in or opts-out of visual tracking.
    Type: Grant
    Filed: April 30, 2018
    Date of Patent: January 26, 2021
    Assignee: Adobe Inc.
    Inventors: David Eldridge Benge, Max Gray Edell
  • Patent number: 10887628
    Abstract: Systems and methods include handling media data based on triggers. Media data includes livestream audiovisual data. Media data or portions thereof are categorized to assist with defining or executing triggers.
    Type: Grant
    Filed: April 26, 2017
    Date of Patent: January 5, 2021
    Assignee: United Services Automobile Services (USAA)
    Inventors: Matthew T Flachsbart, Richard Daniel Graham
  • Patent number: 10887548
    Abstract: A method can include determining a distance of a person's face from a camera that captured an image of the person's face, determining a size of a display in communication with the camera, and scaling the image based on the determined distance of the person's face and the determined size of the display.
    Type: Grant
    Filed: August 17, 2018
    Date of Patent: January 5, 2021
    Assignee: GOOGLE LLC
    Inventors: Brandon Mayer, Luke Sorenson, Matthew Frazier, Wei Guan, James McGill, Zachary Yorke, Adrien Baranes, John Finley
  • Patent number: 10880495
    Abstract: A video recording method and apparatus, an electronic device and a readable storage medium, which realize positioning of a privacy background by acquiring a sensitive video frame containing a privacy background image from the recorded video information; acquire an image region of the privacy background image in the sensitive video frame; superimpose an augmented reality AR occlusion image on the image region of the privacy background image to obtain an occlusion frame in which the privacy background image is occluded, so as to realize the hiding of the privacy background image by occluding part of the background; obtain live video information according to the recorded video information and the occlusion frame, thereby improving the reliability of real time occlusion of objects that need to be hidden, during video recording.
    Type: Grant
    Filed: July 16, 2019
    Date of Patent: December 29, 2020
    Inventor: Miao Yao
  • Patent number: 10873697
    Abstract: Multiple users communicate over a network via client devices that include one or more cameras and a display to enable video messaging. At least one of the client devices modifies regions of video data captured by the client device's camera to more prominently identify the people within the video data. To identify a person, the client device disambiguates between actual people and static objects that may appear like people. The client device uses pose models to identify bounding boxes and applies a motion model to determine if a bounding box may include a person based on an amount of movement within the bounding box. If a threshold amount of movement is detected in a bounding box, the client device obtains a higher resolution portion of the scene including the bounding box and classifies whether the bounding box contains a person based on movement within the higher resolution video.
    Type: Grant
    Filed: September 9, 2019
    Date of Patent: December 22, 2020
    Assignee: Facebook, Inc.
    Inventors: Anshul Kumar Jain, Abhinav Garlapati, Eric W. Hwang
  • Patent number: 10868955
    Abstract: Various client devices include displays and one or more image capture devices configured to capture video data. Different users of an online system may authorize client devices to exchange information captured by their respective image capture devices. Additionally, a client device modifies captured video data based on users identified in the video data. For example, the client device changes parameters of the image capture device to more prominently display a user identified in the video data and may further change parameters of the image capture device based on gestures or movement of the user identified in the video data. The client device may apply multiple models to captured video data to modify the captured video data or subsequent capturing of video data by the image capture device.
    Type: Grant
    Filed: September 4, 2018
    Date of Patent: December 15, 2020
    Assignee: Facebook, Inc.
    Inventor: Vincent Charles Cheung
  • Patent number: 10868848
    Abstract: A host computing device for a multimedia system includes: a processor configured to generate multimedia data for transmission to a client device; a compression/decompression device connected to the processor, the compression/decompression device configured to receive the multimedia data and generated compressed multimedia data; a communications assembly connected to the processor and including (i) a wireless transceiver and (ii) a controller configured to receive the multimedia data from the processor and the compressed multimedia data from the compression/decompression device; the controller further configured to select one of the multimedia data and the compressed multimedia data for transmission to the client device via the wireless transceiver.
    Type: Grant
    Filed: July 25, 2017
    Date of Patent: December 15, 2020
    Assignee: PERASO TECHNOLOGIES INC.
    Inventors: Derek Yuen, Bradley Robert Lynch
  • Patent number: 10862987
    Abstract: A telepresence system which includes at least one display device and a beacon coupled to the display device. The beacon emits a signal so as to be discoverable by electronic devices nearby such as in a meeting location. The system also includes a receiver-controller coupled to the beacon, the receiver-controller configured to enable such electronic devices to be recognized and to join a collaborative session in which content from one electronic device can be shared with other electronic devices. The receiver-controller can and will share some or all of its functions with one or more of the joined devices simultaneously, if security and identity protocols are satisfied.
    Type: Grant
    Filed: August 23, 2019
    Date of Patent: December 8, 2020
    Assignee: Polycom, Inc.
    Inventors: Matvey Digilov, Amir Levy, Marek Dutkiewicz, Thomas Quentin Brady, Mike Tucker, Moshe Noah Lipsker, Anat Levy
  • Patent number: 10855727
    Abstract: A video call mediating method includes: connecting, by a first terminal and a second terminal, to a video call platform; extracting a first identifier (ID) of a user of the first terminal and a second ID of a user of the second terminal, that is not displayed on the first terminal and the second terminal, during a video call; creating a first identification code for the first terminal and a second identification code of the second terminal from the first ID and the second ID, respectively; establishing a first video call session between the first terminal and the second terminal; creating a first image and a second image corresponding to the first terminal and the second terminal, respectively, with reference to the first identification code and the second identification code, respectively; and displaying the first image and the second image on a display of the first terminal and on a display of the second terminal, respectively.
    Type: Grant
    Filed: March 24, 2020
    Date of Patent: December 1, 2020
    Assignee: HYPERCONNECT, INC.
    Inventors: Sangil Ahn, Sangpil Yoon
  • Patent number: 10853993
    Abstract: A system for producing images for display apparatus includes an image source to obtain an input image and a processor configured to obtain information of a gaze direction of a user, determine a region of interest of the input image based on the gaze direction, and process the input image to generate a first with a first region that is blurred with respect to region of interest, and a second image corresponding to the region of interest. The processor adjusts an intensity of pixels within the first region and an intensity of pixels within the second image. When an intensity of a given pixel within the region of interest is lower than or equal to a predefined intensity threshold, an intensity of a corresponding pixel within the first region is lower than an intensity of a corresponding pixel within the second image.
    Type: Grant
    Filed: July 9, 2019
    Date of Patent: December 1, 2020
    Assignee: Varjo Technologies Oy
    Inventor: Jarno Wuolijoki
  • Patent number: 10841535
    Abstract: Enterprise communication display systems enable life-like images for videoconferencing and entertainment productions. Life-like images appear in a 3D environment where imaged people are visible through specially configured see-through displays. Imaged people can be viewed amongst a reflected foreground. Methods for enterprise-wide deployments for corporate, healthcare, education, theater which includes cinema and government communications, including hotel properties and a property management system are shown. Direct projection see-through screen configurations are created that eliminate unwanted secondary images in the room, conceal exposed projector lenses, reduce lens flare, makes practical multi-use room installations, images conferees among a room environment, enables touch screen interactivity, and utilizes extreme and other types of short throw projectors to reduce cost and bulk of common throw projectors.
    Type: Grant
    Filed: October 3, 2018
    Date of Patent: November 17, 2020
    Inventors: Steve H. McNelley, Jeffrey S. Machtig
  • Patent number: 10839199
    Abstract: An image extracting unit and an album setting unit are provided. The image extracting unit sets a predetermined image of a plurality of images as a group photograph and extracts, from the plurality of images, images including each of face images of the group photograph. The album setting unit records image identification information of the extracted images in a predetermined file.
    Type: Grant
    Filed: June 29, 2016
    Date of Patent: November 17, 2020
    Assignee: FUJIFILM Corporation
    Inventor: Koki Okamura
  • Patent number: 10834381
    Abstract: A method and system for modifying a video file is provided. The method includes continuously receiving a video stream. A video frame of the video stream is divided into viewport portions each including an associated meta data portion. An eye focus of a user with respect to a first viewport portion is detected and a resulting importance score is determined for each viewport portion. Viewing trajectories for viewing each viewport portion are determined and a first group of viewport portions and a second group of viewport portions are determined. A payoff matrix associated with the viewing trajectories is generated and a best possible decision for the user with respect to viewing the viewport portions is generated. A third group of viewport portions is determined and presented with respect to the best possible decision.
    Type: Grant
    Filed: July 25, 2019
    Date of Patent: November 10, 2020
    Assignee: International Business Machines Corporation
    Inventors: Jhilam Bera, Vijay Kumar Ananthapur Bache, Saravanan Sadacharam, Vijay Ekambaram
  • Patent number: 10785445
    Abstract: In one example method, a computing device scans an environment via an omnidirectional camera, detects objects in the environment, and captures depth information of the environment and the objects in the environment via 3D imaging of the omnidirectional camera. The computing device makes adjustments to audiovisual (AV) transmissions based on the detected objects and the depth information captured of the environment and the objects.
    Type: Grant
    Filed: December 5, 2016
    Date of Patent: September 22, 2020
    Assignee: Hewlett-Packard Development Company, L.P.
    Inventors: Alexander Wayne Clark, Kent E Biggs, Michael James Pescetto
  • Patent number: 10785447
    Abstract: [Object] To provide an information processing apparatus, an information processing method, and a program capable of producing the distance to a communication partner by using a three-dimensional expression to connect spaces, and realizing more comfortable communication. [Solution] An information processing apparatus including: a reception unit configured to receive data from a communication destination; a generation unit configured to generate space image information in which an image corresponding to a space of the communication destination is disposed at a predetermined position in a three-dimensional space; and a display control unit configured to perform control such that the generated space image information is displayed on a display unit in a communication source.
    Type: Grant
    Filed: July 2, 2019
    Date of Patent: September 22, 2020
    Assignee: Sony Corporation
    Inventors: Yusuke Sakai, Atsushi Izumihara, Daisuke Miki
  • Patent number: 10772026
    Abstract: A wireless communication network controls wireless base stations that serve wireless relays that serve wireless User Equipment (UEs). In a relay control system, data transceivers receive configuration data that was transferred by the wireless relays and that indicates their individual wireless media services. Relay control circuitry allocates individual carrier aggregation Quality-of-Service (QoS) levels to the individual wireless relays based on the individual wireless media services. The relay transceivers transfer the individual carrier aggregation QoS levels for the individual wireless relays to the wireless base stations. The wireless base stations serve the wireless relays with the individual carrier aggregation QoS levels. The wireless relays serve the wireless UEs with the wireless media services.
    Type: Grant
    Filed: March 29, 2019
    Date of Patent: September 8, 2020
    Assignee: Sprint Communications Company L.P.
    Inventors: Nitesh Manchanda, Vanil Parihar
  • Patent number: 10768748
    Abstract: A position indicator includes a housing and circuitry. The circuitry transmits a plurality of signal blocks successively to a position detecting device. Each of the signal blocks includes a position detection signal, a first modulated signal acquired by modulating one part of a plurality of divided parts of position indicator identification information, and a second modulated signal acquired by modulating current position indicator status information acquired successively from a signal supplied to a control terminal or from a voltage state of the control terminal. The position indicator transmits the plurality of divided parts of position indicator identification information by transmitting the plurality of signal blocks.
    Type: Grant
    Filed: December 27, 2018
    Date of Patent: September 8, 2020
    Assignee: Wacom Co., Ltd.
    Inventor: Hideyuki Hara
  • Patent number: 10764446
    Abstract: [Object] To propose an information processing device, an information processing method, and a program capable of efficiently transmitting captured images between devices connected via a network even when a moving image or a plurality of still images are captured as a series of images. [Solution] The information processing device includes: an acquisition unit configured to acquire a series of images captured by an imaging unit in accordance with a predetermined operation mode on the basis of an instruction from an external device connected via a network; and a transmission control unit configured to transmit a series of thumbnail images corresponding to the series of images to the external device via the network. The transmission control unit transmits at least some of the series of images to the external device via the network in accordance with an instruction from the external device to which the series of thumbnail images has been transmitted.
    Type: Grant
    Filed: June 8, 2015
    Date of Patent: September 1, 2020
    Assignee: Sony Corporation
    Inventors: Masanori Kasa, Yoshihiro Otsuka
  • Patent number: 10728371
    Abstract: A mobile terminal comprises a window and a display module, which is provided on the rear surface of the window and forms an output area of a display, in order to maximize the output area of the display, wherein the output area of the display module includes: a first output area; a second output area provided at one end on the left side of the first output area; and a third second output area provided at one end on the right side of the first output area, wherein the second output area and the third output area are spaced apart.
    Type: Grant
    Filed: September 11, 2019
    Date of Patent: July 28, 2020
    Assignee: LG ELECTRONICS INC.
    Inventor: Wooyong Kwon
  • Patent number: 10721394
    Abstract: Various client devices include displays and one or more image capture devices configured to capture video data. Different users of an online system may authorize client devices to exchange information captured by their respective image capture devices. Additionally, a client device modifies captured video data based on users identified in the video data. For example, the client device changes parameters of the image capture device to more prominently display a user identified in the video data and may further change parameters of the image capture device based on gestures or movement of the user identified in the video data. The client device may apply multiple models to captured video data to modify the captured video data or subsequent capturing of video data by the image capture device.
    Type: Grant
    Filed: May 29, 2019
    Date of Patent: July 21, 2020
    Assignee: Facebook, Inc.
    Inventors: Hemanth Korrapati, Jakub Czupryna
  • Patent number: 10719919
    Abstract: An information processing apparatus includes: an imaging unit configured to acquire an RGB image of an imaging target, and to output either a captured image in which a background area determined to be the background in the RGB image is subjected to blur processing based on the depth information, or a captured image in which the blur processing is not performed on the RGB image; an authentication processing section configured to execute authentication processing based on the captured image output from the imaging unit; a login processing section configured to execute login processing to log in based on the authentication result by the authentication processing section; and a blur processing control section configured to instruct the imaging unit not to perform the blur processing at least during a period in which the authentication processing section executes the authentication processing.
    Type: Grant
    Filed: July 9, 2019
    Date of Patent: July 21, 2020
    Assignee: LENOVO (SINGAPORE) PTE. LTD.
    Inventors: Kazuhiro Kosugi, Masashi Nishio
  • Patent number: 10701118
    Abstract: A method is provided for processing multimedia streams between a platform for digital distribution of interactive applications and a customer terminal, connected through a communications network and communicating with each other according to a first communication protocol. The method includes the following acts implemented by an intermediate device distinct from the customer terminal: modifying a multimedia stream compliant with the first communication protocol, obtained from a multimedia stream transmitted from the platform for the digital distribution of interactive applications to the customer terminal, generating at least one modified multimedia stream compliant with at least one second communication protocol, the at least one second communication protocol being distinct from the first communication protocol, and transmitting the at least one modified multimedia stream to at least one rendering device using the at least one second communication protocol.
    Type: Grant
    Filed: January 13, 2016
    Date of Patent: June 30, 2020
    Assignee: ORANGE
    Inventor: Herve Brelivet
  • Patent number: 10694304
    Abstract: For a multiple microphone system, a phase response mismatch may be corrected. One embodiment includes receiving audio from a first microphone and from a second microphone, the microphones being coupled to a single device for combining the received audio, recording the received audio from the first microphone and the second microphone before combining the received audio, detecting a phase response mismatch in the recording at the device between the audio received at the second microphone and the audio received at the first microphone, if a phase response mismatch is detected, then estimating a phase delay between the second microphone and the first microphone, and storing the estimated phase delay for use in correcting the phase delay in received audio before combining the received audio.
    Type: Grant
    Filed: June 26, 2015
    Date of Patent: June 23, 2020
    Assignee: Intel Corporation
    Inventors: Przemyslaw Maziewski, Lukasz Kurylo, Piotr Chlebek
  • Patent number: 10694146
    Abstract: Techniques for video capture including determining a position of a subject in relation to multiple cameras; selecting a foreground camera from the cameras based on at least the determined position; obtaining an RGB image captured by the foreground camera; segmenting the RGB image to identify a foreground portion corresponding to the subject, with a total height of the foreground portion being a first percentage of a total height of the RGB image; generating a foreground image from the foreground portion; producing a composite image, including compositing the foreground image and a background image to produce a portion of the composite image, with a total height of the foreground image in the composite image being a second percentage of a total height of the composite image and the second percentage being substantially less than the first percentage; and causing the composite image to be displayed on a remote system.
    Type: Grant
    Filed: November 5, 2018
    Date of Patent: June 23, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Se Hoon Lim, Timothy Andrew Large
  • Patent number: 10681313
    Abstract: An apparatus includes a video capture device, an audio capture device and a processor. The video capture device may be configured to generate a plurality of video frames. The audio capture device may be configured to capture audio. The processor may be configured to analyze the audio to determine a direction of a source of the audio, select a window of interest for the video frames corresponding to the direction of the source of the audio, perform video operations to generate high resolution images of the window of interest, perform facial recognition operations on the high resolution images and determine an identity of the source of the audio in response to the facial recognition operations. The window of interest may have an area less than a total area of the video frames. The identity of the source of the audio may determine permissions for accessing features of the apparatus.
    Type: Grant
    Filed: September 28, 2018
    Date of Patent: June 9, 2020
    Assignee: Ambarella International LP
    Inventor: Christopher N. Day
  • Patent number: 10666902
    Abstract: A device is disclosed, which includes a processor and a memory in communication with the processor. The memory includes executable instructions that, when executed by the processor, cause the processor to control the device to perform functions of receiving user interaction data from a remote device via a communication network, the user interaction data indicating user interaction with a graphical user interface of the remote device; determining, based on the user interaction data, that the user interaction causes a display conflict between the graphical user interface of the remote device and visual information displayed on the graphical user interface of the remote device; and resolving the display conflict by causing the remote device to display modified visual information. The device thus allows a user to see and interact with the graphical user interface without needing to stop or pause displaying the visual information or to wait for the visual information display to be over.
    Type: Grant
    Filed: January 30, 2019
    Date of Patent: May 26, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Kshitij Mahendru, Sabra Alexis Wieditz Rossman, Shivaram Prabhakar
  • Patent number: 10628641
    Abstract: Presented herein are techniques for matching a user, e.g., a child, with an autonomous vehicle instructed to pick up the child. In an embodiment, a method includes receiving, at a server, information from an autonomous vehicle, receiving, at the server, information from a user device, receiving, at the server, information from a responsible party device, processing, by the server, the information from the autonomous vehicle, the information from the user device, and the information from the responsible party device, and based on the processing of the information from the autonomous vehicle, the information from the user device, and the information from the responsible party device, verifying, by the server, that the autonomous vehicle is matched with a user of the user device.
    Type: Grant
    Filed: April 18, 2017
    Date of Patent: April 21, 2020
    Assignee: Cisco Technology, Inc.
    Inventors: Monica Shen Knotts, John George Apostolopoulos, Charles Calvin Byers
  • Patent number: 10623700
    Abstract: An overlay network platform facilitates a multi-party videoconference. End users participate using client-based browser or mobile application rendering software, such as a web browser, and using a protocol such as WebRTC. Dynamic speaker selection among the participants is facilitated by continuously determining the “relevance” of a participant's stream with respect to other participants in the conference. Thus, for example, a particular participant stream might be deemed to have a higher relevance if it is the stream corresponding to a person that is currently speaking, that has spoken recently, or that is about to speak. Streams with higher relevance are then selectively delivered at higher quality relative to less relevant streams. Preferably, individual client machines determine which streams are requested and at which quality based in part on their local resource capabilities.
    Type: Grant
    Filed: April 1, 2019
    Date of Patent: April 14, 2020
    Assignee: Akamai Technologies, Inc.
    Inventors: Charles E. Gero, Thomas Houman, Abhijit C. Mehta
  • Patent number: 10607314
    Abstract: Systems and methods for autonomously generating one or more images are disclosed. According to at least one embodiment, a method of autonomously generating one or more images includes: receiving, by a content server, an image having one or more characteristics rendering the image suitable for display at a device of a first breakpoint type; in response to receiving the image, autonomously deriving, by the content server, at least one image from the received image, the at least one derived image having one or more characteristics optimized for display at a device of a second breakpoint type different from the first breakpoint type; and controlling, by the content server, a display to display the received image and the at least one derived image.
    Type: Grant
    Filed: January 9, 2018
    Date of Patent: March 31, 2020
    Assignee: Universal City Studios LLC
    Inventors: Troy Meek, Nithin Kumar
  • Patent number: 10580040
    Abstract: Disclosed herein are methods and systems for real-time image and signal processing in an augmented reality environment; for example, for video conferencing in a virtual environment of the participants' choice. In particular, image information of a real life object is extracted by separating the object from its actual environment in one or more images that are captured in real-time using a comprehensive characteristic-based mechanism. The extracted real life object is then integrated with a virtual environment based on image relations between each pixel of the image information of the real life object and a corresponding pixel of each image of the plurality of images of the virtual environment through a pixel-by-pixel integration approach. The image relations comprise at least a depth relation or a transparency relation.
    Type: Grant
    Filed: April 4, 2017
    Date of Patent: March 3, 2020
    Inventor: Eliza Y. Du
  • Patent number: 10582117
    Abstract: A video conference system operates to identity and to determine a location of things in a conference room, and to determine an orientation of video conference participants towards the identified things, and uses an assigned priority of the things that the participants are oriented towards to automatically control a camera to focus on the highest priority thing.
    Type: Grant
    Filed: May 2, 2019
    Date of Patent: March 3, 2020
    Assignee: Yamaha-United Communications
    Inventors: Ryo Tanaka, Pascal Cleve
  • Patent number: 10545230
    Abstract: For augmented reality view activation, a processor determines if an optical image captured by the camera and a sensor image captured by the sensor satisfy an activation policy. In response to the activation policy being satisfied, the processor activates an augmented reality view that comprises the sensor image.
    Type: Grant
    Filed: June 1, 2017
    Date of Patent: January 28, 2020
    Assignee: Lenovo (Singapore) PTE LTD
    Inventors: Russell Speight VanBlon, Robert James Kapinos, Timothy Winthrop Kingsbury, Scott Wentao Li
  • Patent number: 10542315
    Abstract: Aspects of the subject disclosure include, for example, embodiments that include determining a content context of a first segment of content being presented by a media processor at a display to an audience. Further embodiments include determining an expected audience reaction according to the content context of the first segment, and receiving sensor data captured from a sensor device in proximity to the audience where the sensor data is indicative of a sensed audience reaction to the first segment of the content. Additional embodiments include comparing the sensed audience reaction with the expected audience reaction to determine a level of interest in the first segment, and adjusting a second segment of the content according to the level of interest to generate an adjusted second segment displayable at the display. Other embodiments are disclosed.
    Type: Grant
    Filed: November 11, 2015
    Date of Patent: January 21, 2020
    Assignee: AT&T Intellectual Property I, L.P.
    Inventors: Venson Shaw, Sangar Dowlatkhah, Zhi Cui
  • Patent number: 10523864
    Abstract: In one embodiment, a method includes identifying, from a set of coordinate points that correspond to a plurality of surface points of a person in an environment, a coordinate point that corresponds to a facial feature of the person; generating a facial structure for a face of the person, wherein the facial structure: covers a plurality of facial features of the person; and substantially matches a pre-determined facial structure; generating a body skeletal structure for the person, wherein the body skeletal structure substantially matches a predetermined body skeletal structure and substantially aligns with the generated facial structure in at least one dimension of a two-dimensional coordinate plane; and associating the generated body skeletal structure and facial structure with the person in the environment.
    Type: Grant
    Filed: October 5, 2018
    Date of Patent: December 31, 2019
    Assignee: Facebook, Inc.
    Inventors: Jason Francis Harrison, Eric W. Hwang, Rahul Nallamothu, Shahid Razzaq
  • Patent number: 10509459
    Abstract: An approach to sensor data is based on scenes. One aspect concerns a computer-implemented method for specifying and obtaining a variety of sensor data and processed sensor data related to a scene. The method incorporates a Scene-based API that uses SceneModes and SceneData. An application requesting sensor data communicates a SceneMode to a group of one or more sensor devices and/or sensor modules via the Scene-based API. The SceneMode determines the SceneData to be captured or provided by the sensor group, which typically includes different types of sensor data related to the Scene and also further processed or analyzed data. The application receives the SceneData from the sensor group via the Scene-based API, with the SceneData organized into SceneShots which are samples of the Scene.
    Type: Grant
    Filed: March 24, 2017
    Date of Patent: December 17, 2019
    Assignee: SCENERA, INC.
    Inventors: David D. Lee, Andrew Augustine Wajs, Seungoh Ryu, Chien Lim
  • Patent number: 10509968
    Abstract: A data fusion based safety surveillances system has a first through Nth virtual monitoring systems and a data fusion and decision device. The data fusion and decision device defines an ith detection model of the ith virtual monitoring system, and estimates an ith detection loss probability of the ith virtual monitoring system according to detection loss sample numbers of batches of ith monitored data of the ith virtual monitoring system under conditions corresponding to the locations, batches of context data and existence of intruder, the ith detection model, the batches of ith monitored data corresponding to locations of the ith virtual monitoring system and the batches of context data. The data fusion and decision device determines a fusion parameter set according to the first through Nth detection loss probabilities, and performs data fusion on a first through Nth detection results to generate a decision result.
    Type: Grant
    Filed: January 30, 2018
    Date of Patent: December 17, 2019
    Assignee: NATIONAL CHUNG SHAN INSTITUTE OF SCIENCE AND TECHNOLOGY
    Inventors: Jiunn-Tsair Chen, Chin-Sheng Kuan, Wei-Jen Chien, Wen-Hao Hsiao
  • Patent number: 10511804
    Abstract: A display apparatus includes a communication interface configured to communicate with another display apparatus, a display configured to display contents being shared with the other display apparatus and a video call user interface (UI) for a video call with a user of the other display apparatus, and a processor, in response to at least one of a gesture and a voice of the user included in video call data received from the other display apparatus satisfying a predetermined condition, configured to control the display to change a size of the video call UI displayed on the display.
    Type: Grant
    Filed: July 6, 2018
    Date of Patent: December 17, 2019
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Seong-wook Jeong, Sung-hye Lee, Sung-hyun Jang, Kwan-min Lee, Sang-hee Lee
  • Patent number: 10509964
    Abstract: Systems and methods for hosting a teleconference session. Media data is received from a plurality of client computing devices at a server. The media data is combined into a teleconference stream configured to display a selected teleconference session view. The teleconference stream is transmitted to a client computing device having a display. The teleconference stream is displayed according to the teleconference session view, which includes a primary section displaying a first graphic element and at least one secondary section each including a user interface element having a toggle view function. The teleconference session view changes the display in the primary section to a second graphic element when a toggle actuation is detected at the user interface element of one of the secondary sections.
    Type: Grant
    Filed: January 11, 2017
    Date of Patent: December 17, 2019
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Ruchir Astavans, Jason Thomas Faulkner, Kevin D Morrison, Michael H Hill
  • Patent number: 10491809
    Abstract: A system for ensuring that the best available view of a person's face is included in a video stream when the person's face is being captured by multiple cameras at multiple angles at a first endpoint. The system uses one or more microphone arrays to capture direct-reverberant ratio information corresponding to the views, and determines which view most closely matches a view of the person looking directly at the camera, thereby improving the experience for viewers at a second endpoint.
    Type: Grant
    Filed: September 26, 2018
    Date of Patent: November 26, 2019
    Assignee: Polycom, Inc.
    Inventors: Jinwei Feng, Peter Chu
  • Patent number: 10477148
    Abstract: Systems and methods are disclosed for anticipating a video switch to accommodate a new speaker in a video conference comprising a real time video stream captured by a camera local to a first videoconference endpoint is analyzed according to at least one speaker anticipation model. The speaker anticipation model predicts that a new speaker is about to speak. Video of the anticipated new speaker is sent to the conferencing server in response to a request for the video on the anticipated new speaker from the conferencing server. Video of the anticipated new speaker is distributed to at least a second videoconference endpoint.
    Type: Grant
    Filed: July 11, 2017
    Date of Patent: November 12, 2019
    Assignee: CISCO TECHNOLOGY, INC.
    Inventors: Paul Bright-Thomas, Nathan Buckles, Keith Griffin, Eric Chen, Manikandan Kesavan, Plamen Nedeltchev, Hugo Mike Latapie, Enzo Fenoglio
  • Patent number: 10462412
    Abstract: A method and a surgical visualization and recording system (SVRS) for capturing, communicating, and displaying images of a surgical site with up to a 4K ultrahigh definition (UHD) resolution in association with patient information in real time during a surgery are provided. The SVRS includes a UHD camera system with an optical component and an image sensor, and a display unit with an embedded microcomputer and a tactile user interface (TUI). The image sensor captures and communicates images of the surgical site with up to a 4K UHD resolution to the embedded microcomputer. The embedded microcomputer receives patient information via the TUI, and associates the captured and communicated images of the surgical site with the patient information in real time. The display unit displays the captured and communicated images of the surgical site with the patient information with up to a 4K UHD resolution on the TUI in real time.
    Type: Grant
    Filed: January 30, 2018
    Date of Patent: October 29, 2019
    Inventor: Manish Eknath Ingle
  • Patent number: 10455135
    Abstract: In one embodiment, a method includes determining a layout for an output screen. The layout may be determined based on a producer interface. A video production device operated either by a server or by a client device may display a plurality of data input streams on the output screen in accordance with the layout. Each of the data input streams may be generated by one of several image capture devices. Each image capture device may include a display screen that displays guidelines as the image capture device captures images. The guidelines may have a first dimension that is based on the layout. The video production device may receive an indication that the layout has changed. The video production device may send instructions to one or more of the image capture devices to adjust the guidelines to a second dimension based on the change to the layout.
    Type: Grant
    Filed: November 17, 2017
    Date of Patent: October 22, 2019
    Assignee: Facebook, Inc.
    Inventor: Bradley Isbell
  • Patent number: 10453267
    Abstract: A method for representing virtual information in a view of a real environment comprises providing a virtual object having a global position and orientation with respect to a geographic global coordinate system, with first pose data on the global position and orientation of the virtual object, in a database of a server, taking an image of a real environment by a mobile device and providing second pose data as to at which position and with which orientation with respect to the geographic global coordinate system the image was taken. The method further includes displaying the image on a display of the mobile device, accessing the virtual object in the database and positioning the virtual object in the image on the basis of the first and second pose data, manipulating the virtual object or adding a further virtual object, and providing the manipulated virtual object with modified first pose data or the further virtual object with third pose data in the database.
    Type: Grant
    Filed: September 10, 2018
    Date of Patent: October 22, 2019
    Assignee: Apple Inc.
    Inventors: Peter Meier, Michael Kuhn, Frank Angermann
  • Patent number: 10447795
    Abstract: A telepresence system which includes at least one display device and a beacon coupled to the display device. The beacon emits a signal so as to be discoverable by electronic devices nearby such as in a meeting location. The system also includes a receiver-controller coupled to the beacon, the receiver-controller configured to enable such electronic devices to be recognized and to join a collaborative session in which content from one electronic device can be shared with other electronic devices. The receiver-controller can and will share some or all of its functions with one or more of the joined devices simultaneously, if security and identity protocols are satisfied.
    Type: Grant
    Filed: October 5, 2016
    Date of Patent: October 15, 2019
    Assignee: Polycom, Inc.
    Inventors: Matvey Digilov, Amir Levy, Marek Dutkiewicz, Thomas Quentin Brady, Mike Tucker, Moshe Noah Lipsker, Anat Levy
  • Patent number: 10440306
    Abstract: An online system customizes video conversations between users of the online system. During a video conversation, the online system presents a composite view to the participating users. The composite view may include visual representations of the users, a background graphic, or other types of graphics such as masks and props that the users can wear or interact with in the environment of the video conversation. The visual representations may be generated based on a live video feed of the users or include avatars of the users. The online system can determine the graphics based on information about the users. For instance, the online system determines a background graphic showing a location that the users have each visited. Upon viewing the background graphic, the users may be encouraged to interact with the background graphic or other graphics included in the composite view, which can promote an engaging video conversation experience.
    Type: Grant
    Filed: October 29, 2018
    Date of Patent: October 8, 2019
    Assignee: Facebook, Inc.
    Inventors: Jason Duane Clark, Brendan Benjamin Aronoff, Stephane Taine