Patents Examined by Loi H Tran
  • Patent number: 10755103
    Abstract: Interacting with a broadcast video content stream is performed with a machine learning facility that processes a video feed of a video broadcast through a spatiotemporal pattern recognition algorithm that applies machine learning on at least one event in the video feed in order to develop an understanding of the at least one event. Developing the understanding includes identifying context information relating to the at least one event and identifying an entry in a relationship library detailing a relationship between two visible features of the video feed. Interacting is further enabled with a touch screen user interface configured to permit at least one broadcaster to control a portion of the content of the video feed through interaction options that are based on the identified context information. Interacting is further enhanced through an interface configured to permit remote viewers to control the portion of the content.
    Type: Grant
    Filed: May 19, 2017
    Date of Patent: August 25, 2020
    Assignee: Second Spectrum, Inc.
    Inventors: Yu-Han Chang, Rajiv Maheswaran, Jeffrey Wayne Su, Noel Hollingsworth
  • Patent number: 10748008
    Abstract: Providing enhanced video content includes processing at least one video feed through at least one spatiotemporal pattern recognition algorithm that uses machine learning to develop an understanding of a plurality of events and to determine at least one event type for each of the plurality of events. The event type includes an entry in a relationship library detailing a relationship between two visible features. Extracting and indexing a plurality of video cuts from the video feed is performed based on the at least one event type determined by the understanding that corresponds to an event in the plurality of events detectable in the video cuts. Lastly, automatically and under computer control, an enhanced video content data structure is generated using the extracted plurality of video cuts based on the indexing of the extracted plurality of video cuts.
    Type: Grant
    Filed: March 12, 2019
    Date of Patent: August 18, 2020
    Assignee: Second Spectrum, Inc.
    Inventors: Yu-Han Chang, Rajiv Tharmeswaran Maheswaran, Jeffrey Wayne Su, Noel Hollingsworth
  • Patent number: 10742946
    Abstract: Imaging apparatus (100) includes selectors (115, 120) that select sound signals having a set number of channels, and a control unit. When a number of channels is set to two at time of recording sound signals, the control unit, according to a first format, records sound data generated based on selected sound signals for two channels, on one sound track included in a video file. When the number of channels is set to four, the control unit, does not record two pieces of sound data respectively on two sound tracks included in one video file in accordance with the first format.
    Type: Grant
    Filed: December 18, 2018
    Date of Patent: August 11, 2020
    Assignee: Panasonic Intellectual Property Management Co., Ltd.
    Inventor: Yoshio Ohtsuka
  • Patent number: 10741213
    Abstract: Video edit information, video modification information, and/or other information may be obtained. Video edit information may define a video edit of video content. Video edit may include one or more portions of the video content and may have a progress length. Video modification information may define one or more criteria for modifying the video edit. One or more portions of the video edit may be identified based on the video modification information. The portion(s) of the video edit may be modified based on the video modification information. A revised video edit information may be generated. The revised video edit information may define a revised video edit of the video content. The revised video edit may include the portion(s) of the video edit modified based on the video modification information. The revised video edit may have a progress length shorter than the progress length of the video edit.
    Type: Grant
    Filed: March 1, 2018
    Date of Patent: August 11, 2020
    Assignee: GoPro, Inc.
    Inventor: James Selby
  • Patent number: 10733230
    Abstract: Approaches presented herein enable automatic creation of metadata for contents of a video. More specifically, a video and a script corresponding to the video are obtained. A location corresponding to an object in at least one shot of the video is extracted. This at least one shot includes a series of adjacent frames. The extracted location is saved as an annotation area in an annotation knowledge base. An element of a plot of the video is extracted from the script. This element of the plot is derived from content of the video in combination with content of the script. The extracted element of the plot is saved in a narrative knowledge base.
    Type: Grant
    Filed: December 31, 2018
    Date of Patent: August 4, 2020
    Assignee: INHA UNIVERSITY RESEARCH AND BUSINESS FOUNDATION
    Inventor: Geun Sik Jo
  • Patent number: 10734031
    Abstract: A communication apparatus configured to transmit information about content stored in an external apparatus is enabled to autonomously perform control based on a state based on reproduction processing of the content in a destination to which the information is transmitted. Another communication apparatus configured to receive related information about the content from the communication apparatus and perform the reproduction processing on the content based on the related information transmits information about the state related to the reproduction processing of the content. The communication apparatus receives the information about the state related to the reproduction processing of the content, and performs control based on the received information.
    Type: Grant
    Filed: March 13, 2018
    Date of Patent: August 4, 2020
    Assignee: Canon Kabushiki Kaisha
    Inventor: Toshiyuki Nakagawa
  • Patent number: 10734026
    Abstract: Systems, methods, and non-transitory computer-readable media can acquire a first selection to identify a subset of media content items out of a set of media content items. A second selection to identify a mood out of a set of moods can be acquired. A soundtrack can be identified based on at least one of first selection or the second selection. The soundtrack can be associated with data utilized to determine when each media content item in the subset is to be presented during a playback of the soundtrack. A set of declarative instructions utilized to determine how each media content item in the subset is to be presented during the playback of the soundtrack can be provided. The subset can be dynamically presented based on the set of declarative instructions. The subset can be presented during the playback of the soundtrack and can be presented to represent video content.
    Type: Grant
    Filed: September 1, 2016
    Date of Patent: August 4, 2020
    Assignee: Facebook, Inc.
    Inventors: William Edward Fisher, Nathaniel Gregory Salciccioli, Alexander Matthew Madjar, William M. Ruben, Nicholas J. Kwiatek, Zachary W. Gomez
  • Patent number: 10728460
    Abstract: In a monitoring system, the management device extracts a security guard from an image generated by capturing by a camera whose direction has been controlled; performs comparison between the security guard and at least one moving object other than the security guard in the image; determines a moving object to be a tracking target when a result of the comparison between the security guard and the moving object satisfies a predetermined condition; and performs tracking control comprising controlling a photographing range of the camera in such a way that the tracking target is kept captured by the camera.
    Type: Grant
    Filed: May 2, 2019
    Date of Patent: July 28, 2020
    Assignee: NEC CORPORATION
    Inventor: Tomoya Kouno
  • Patent number: 10715828
    Abstract: According to one embodiment, an image encoding method includes selecting a motion reference block from an already-encoded pixel block. The method includes selecting an available block including different motion information from the motion reference block, and selecting a selection block from the available block. The method includes generating a predicted image of the encoding target block using motion information of the selection block. The method includes encoding a prediction error between the predicted image and an original image. The method includes encoding selection information identifying the selection block by referring to a code table decided according to a number of the available block.
    Type: Grant
    Filed: September 7, 2017
    Date of Patent: July 14, 2020
    Assignee: KABUSHIKI KAISHA TOSHIBA
    Inventors: Taichiro Shiodera, Saori Asaka, Akiyuki Tanizawa, Takeshi Chujoh
  • Patent number: 10713494
    Abstract: In various embodiments, a Data Processing System for Generating Interactive User Interfaces and Interactive Game Systems Based on Spatiotemporal Analysis of Video Content may be configured to: (1) enable a user to select one or more players participating in a substantially live (e.g., live) sporting or other event; (2) determine scoring data for each of the one or more selected players during the sporting or other event; (3) track the determined scoring data; (4) generate a custom (e.g., to the user) user interface that includes the scoring data; and (5) display the custom user interface over at least a portion of a display screen (e.g., on a mobile computing device) displaying one or more video feeds of the sporting or other event. In this way, the system may be configured to convert a video feed of a sporting event into an interactive game.
    Type: Grant
    Filed: November 6, 2019
    Date of Patent: July 14, 2020
    Assignee: Second Spectrum, Inc.
    Inventors: Yu-Han Chang, Rajiv Tharmeswaran Maheswaran, Jeffrey Wayne Su
  • Patent number: 10708587
    Abstract: Systems and methods for adaptive bitrate streaming of alternative streams of video encoded at resolution and sample aspect ratio combinations and maximum bitrates in accordance with embodiments of the invention are disclosed. In one embodiment of the invention, a source encoder configured to encode a source video stream as a plurality of alternative streams of video for playback on a playback device includes a processor configured to receive multimedia content including source video data having a primary resolution, a primary sample aspect ratio, and a primary frame rate and to encode the source video data as alternative streams of video, where the resolution and sample aspect ratio of at least one of the alternative streams of video are selected to have an aspect ratio that is the same as a predetermined display aspect ratio and at least one of the alternative streams is encoded at a maximum bitrate.
    Type: Grant
    Filed: October 25, 2016
    Date of Patent: July 7, 2020
    Assignee: DIVX, LLC
    Inventors: Kourosh Soroushian, Auke Sjoerd van der Schaar
  • Patent number: 10681408
    Abstract: Systems and methods for creating videos played on an audio track are provided. In some embodiments, a master take may be selected after one or more video takes are captured. The video portions of the takes may then be played on top of the audio track of the master take. The takes may be analyzed to determine notable events occurring within each take. The video takes may be played on top of the audio track of the chosen master take so that they all appear integrated into a single scene. Clips from the video takes may be paired or matched with certain sections of the audio track based on, for example, the notable events.
    Type: Grant
    Filed: April 7, 2017
    Date of Patent: June 9, 2020
    Inventors: David Leiberman, Samuel Rubin
  • Patent number: 10631047
    Abstract: A browser-based video editor is configured to allow a user to create a composition schema having multimedia layers, including video, audio, and graphic and text layers. The composition schema may be transmitted to a remote service that employs a rendering engine to play back the composition schema and align the clocks for each respective multimedia layer into a single video representation. A master clock object is employed to sync the clocks while also checking a series of properties with each multimedia layer to comport the multimedia layers with an interval-based master clock. The composition schema is recorded using FFmpeg (Fast Forward Moving Picture Experts Group) to create a video representation for user consumption, such as an MP4 (Motion Pictures Experts Group 4) formatted file.
    Type: Grant
    Filed: March 29, 2019
    Date of Patent: April 21, 2020
    Assignee: POND5 INC.
    Inventors: Mathieu Frederic Welche, Hugo Valentín Elías García, Taylor James McMonigle, Pier Stabilini, Nicola Onassis
  • Patent number: 10600168
    Abstract: A method by which a planar scan videokymographic image generation server generates planar scan videokymographic images by using real-time or pre-stored ultra-high speed laryngeal endoscopy images. The method includes the steps of: (a) acquiring monochrome or color ultra-high speed laryngeal endoscopy images; (b) setting a target region and a unit pixel for generating the 2D scan videokymographic images from the ultra-high speed laryngeal endoscopy images; (c) extracting pixel information of each frame of the ultra-high speed laryngeal endoscopy images according to the unit pixel for the target region; (d) generating frames of the planar scan videokymographic images by combining the extracted pixel information of each frame; and (e) generating a planar scan videokymographic video by combining the frames of the planar scan videokymographic images.
    Type: Grant
    Filed: June 9, 2016
    Date of Patent: March 24, 2020
    Assignees: UMEDICAL CO., LTD.
    Inventors: Yong Jin Wang, Duck Hoon Kang
  • Patent number: 10574972
    Abstract: A depth map generation unit (15) generates a depth map through a matching process using a first image generated by a first imaging unit which has a pixel configuration including pixels having different polarization directions and a second image generated by a second imaging unit which has a different pixel configuration from the pixel configuration of the first imaging unit. A normal-line map generation unit (17) generates a normal-line map based on a polarization state of a polarized image of at least one of the first and second images. A map unifying unit (19) performs a process of unifying the generated depth map and the generated normal-line map and acquires an image in which the number of pixels is not reduced while generating the depth map with precision equal to or greater than the generated depth map. The image in which the number of pixels is not reduced can be acquired while generating the highly precise depth map.
    Type: Grant
    Filed: November 17, 2014
    Date of Patent: February 25, 2020
    Assignee: SONY CORPORATION
    Inventor: Yasutaka Hirasawa
  • Patent number: 10574968
    Abstract: An information processing apparatus includes an image pickup element which acquires at least three images of an object, each image corresponding to a different perspective of the object; and a control unit which selectively combines subsets of the images to generate stereoscopic images.
    Type: Grant
    Filed: August 14, 2014
    Date of Patent: February 25, 2020
    Assignee: SONY CORPORATION
    Inventor: Tsuneo Hayashi
  • Patent number: 10573348
    Abstract: The disclosure is generally directed to methods, systems and apparatuses for multi-directional still pictures and/or multi-directional motion pictures and their applications on mobile, embedded, and other computing devices and applications.
    Type: Grant
    Filed: January 25, 2017
    Date of Patent: February 25, 2020
    Inventor: Jasmin Cosic
  • Patent number: 10567706
    Abstract: An interface module 61 relays control signal communication between a main CPU 621 and a light source control CPU 651 and between the main CPU 621 and a camera head CPU 242. The interface module 61 includes an FPGA 610 having CPU I/Fs 611 to 613 that correspond to communication schemes of CPUs 621, 651, and 242, respectively, and first and second storage units 615 (617) and 616 (618). The FPGA 610 relays a control signal between the main CPU 621 and the light source control CPU 651 and between the main CPU 621 and the camera head CPU 242, while temporarily storing the control signal in the first and the second storage units 615 (617) and 616 (618). Moreover, a first communication timing and second and third communication timings are set at timings shifted from one another.
    Type: Grant
    Filed: February 22, 2016
    Date of Patent: February 18, 2020
    Assignee: SONY OLYMPUS MEDICAL SOLUTIONS INC.
    Inventors: Aki Mizukami, Yoshihiro Koizumi, Masashige Kimura
  • Patent number: 10560717
    Abstract: According to one embodiment, an image encoding method includes selecting a motion reference block from an already-encoded pixel block. The method includes selecting an available block including different motion information from the motion reference block, and selecting a selection block from the available block. The method includes generating a predicted image of the encoding target block using motion information of the selection block. The method includes encoding a prediction error between the predicted image and an original image. The method includes encoding selection information identifying the selection block by referring to a code table decided according to a number of the available block.
    Type: Grant
    Filed: February 26, 2014
    Date of Patent: February 11, 2020
    Assignee: KABUSHIKI KAISHA TOSHIBA
    Inventors: Taichiro Shiodera, Saori Asaka, Akiyuki Tanizawa, Takeshi Chujoh
  • Patent number: 10560628
    Abstract: In some implementations, a 360-degree camera includes two wide-angle lenses that provide a spherical view of a scene. The 360-degree camera is configured to be connected to a computing device (e.g., a smart phone) for rendering the captured images. In some implementations, the camera lenses in the 360-degree camera are wide-angle lenses (e.g., 208°) and corrections are performed to the projection of the 3D video data into a planar view to adjust the fisheye effect. A fisheye mapping function is selected that improves the distribution of sampling rays to present a natural view without blurred areas.
    Type: Grant
    Filed: March 6, 2018
    Date of Patent: February 11, 2020
    Assignee: Visual Supply Company
    Inventors: Alexandre Karpenko, Christopher Cunningham, Jonathan Denby