Patents Examined by Daquan Zhao
  • Patent number: 11887371
    Abstract: Embodiments are directed to a thumbnail segmentation that defines the locations on a video timeline where thumbnails are displayed. Candidate thumbnail locations are determined from boundaries of feature ranges of the video indicating when instances of detected features are present in the video. In some embodiments, candidate thumbnail separations are penalized for being separated by less than a minimum duration corresponding to a minimum pixel separation (e.g., the width of a thumbnail) between consecutive thumbnail locations on a video timeline. The thumbnail segmentation is computed by solving a shortest path problem through a graph that models different thumbnail locations and separations. As such, a video timeline is displayed with thumbnails at locations on the timeline defined by the thumbnail segmentation, with each thumbnail depicting a portion of the video associated with the thumbnail location.
    Type: Grant
    Filed: May 26, 2021
    Date of Patent: January 30, 2024
    Assignee: Adobe Inc.
    Inventors: Seth Walker, Hijung Shin, Cristin Ailidh Fraser, Aseem Agarwala, Lubomira Dontcheva, Joel Richard Brandt, Jovan Popović, Joy Oakyung Kim, Justin Salamon, Jui-hsien Wang, Timothy Jeewun Ganter, Xue Bai, Dingzeyu Li
  • Patent number: 11887629
    Abstract: Embodiments are directed to interactive tiles that represent video segments of a segmentation of a video. In some embodiments, each interactive tile represents a different video segment from a particular video segmentation (e.g., a default video segmentation). Each interactive tile includes a thumbnail (e.g., the first frame of the video segment represented by the tile), some transcript from the beginning of the video segment, a visualization of detected faces in the video segment, and one or more faceted timelines that visualize a category of detected features (e.g., a visualization of detected visual scenes, audio classifications, visual artifacts). In some embodiments, interacting with a particular interactive tile navigates to a corresponding portion of the video, adds a corresponding video segment to a selection, and/or scrubs through tile thumbnails.
    Type: Grant
    Filed: May 26, 2021
    Date of Patent: January 30, 2024
    Assignee: Adobe Inc.
    Inventors: Seth Walker, Hijung Shin, Cristin Ailidh Fraser, Aseem Agarwala, Lubomira Dontcheva, Joel Richard Brandt, Jovan Popović, Joy Oakyung Kim, Justin Salamon, Jui-hsien Wang, Timothy Jeewun Ganter, Xue Bai, Dingzeyu Li
  • Patent number: 11887631
    Abstract: The present technology relates to an information processing device, an information processing method, and a program capable of providing video and sound in a synchronized state. An information processing device includes a determination unit that determines whether it is content in which sound is delayed with respect to video, and a processing unit that delays the video by a predetermined period and plays the video when the determination unit determines that it is the content in which the sound is delayed with respect to the video. The processing unit delays and plays the video so that the video when a sound source produces the sound is synchronized with the sound. The predetermined period corresponds to a period by which the sound is delayed. The present technology can be applied to an information processing device that processes video.
    Type: Grant
    Filed: October 29, 2020
    Date of Patent: January 30, 2024
    Assignee: SONY GROUP CORPORATION
    Inventors: Ryo Yokoyama, Takeshi Ogita
  • Patent number: 11882268
    Abstract: A head-up display system includes a three-dimensional display device, an optical member, and an accelerometer. The three-dimensional display device includes a display panel, an optical element, and a controller. The display panel displays an image. The optical element defines a traveling direction of image light emitted from the display panel. The optical member reflects the image light from the three-dimensional display device toward a user's eye. The optical member is at a fixed position relative to the three-dimensional display device. The accelerometer detects acceleration of the three-dimensional display device. The controller controls a position of the image on the display panel based on the acceleration.
    Type: Grant
    Filed: May 29, 2020
    Date of Patent: January 23, 2024
    Assignee: KYOCERA CORPORATION
    Inventors: Kaoru Kusafuka, Sunao Hashimoto
  • Patent number: 11875568
    Abstract: Embodiments are directed to segmentation and hierarchical clustering of video. In an example implementation, a video is ingested to generate a multi-level hierarchical segmentation of the video. In some embodiments, the finest level identifies a smallest interaction unit of the video—semantically defined video segments of unequal duration called clip atoms. Clip atom boundaries are detected in various ways. For example, speech boundaries are detected from audio of the video, and scene boundaries are detected from video frames of the video. The detected boundaries are used to define the clip atoms, which are hierarchically clustered to form a multi-level hierarchical representation of the video. In some cases, the hierarchical segmentation identifies a static, pre-computed, hierarchical set of video segments, where each level of the hierarchical segmentation identifies a complete set (i.e., covering the entire range of the video) of disjoint (i.e.
    Type: Grant
    Filed: June 2, 2022
    Date of Patent: January 16, 2024
    Assignee: Adobe Inc.
    Inventors: Hijung Shin, Xue Bai, Aseem Agarwala, Joel R. Brandt, Jovan Popović, Lubomira Dontcheva, Dingzeyu Li, Joy Oakyung Kim, Seth Walker
  • Patent number: 11875484
    Abstract: The present disclosure relates to a method of removing, by an imaging processing device, remanence artifacts from an image (fn) of a sequence of images captured by an infrared imaging device, the method comprising: generating a remanence measure for at least some pixels in the image (fn) based on a difference between the pixels values of the image (fn) and the pixel values a previous image (fn?1) of the sequence; and removing remanence artifacts from at least some pixels of the image (fn) based on a remanence estimation for each of the at least some pixels, each remanence estimation being generated based on the remanence measure and on one or more previous remanence estimations of the at least some pixels and on a model of the exponential decay of the remanence.
    Type: Grant
    Filed: April 28, 2020
    Date of Patent: January 16, 2024
    Assignee: LYNRED
    Inventors: Alain Durand, Olivier Harant
  • Patent number: 11875676
    Abstract: A system and method for alerting a driver of a motor vehicle or a person walking along a road or hiking on a trail of potentially dangerous hazards in their path. Hazards may be deep water, ice, oil slicks or other hazards. In the case of a motor vehicle, the system uses cameras mounted on or within the vehicle to detect potential hazards and then analyzes the images combined with the known topography of the location to evaluate the ability of the vehicle to safely traverse the hazard. In the case of a person walking or hiking, the person may use the camera on a personal mobile device to capture images of the hazard and to combine the images with the known topography at the location to evaluate the danger presented by the hazard.
    Type: Grant
    Filed: January 5, 2023
    Date of Patent: January 16, 2024
    Assignee: United Services Automobile Association (USAA)
    Inventors: Andre Rene Buentello, Nina Schuessler, Ashley Raine Philbrick, Stacy Callaway Huggar, Jose L. Romero, Jr.
  • Patent number: 11871127
    Abstract: Methods, apparatus, systems, and articles of manufacture to process high-speed video are disclosed. An example apparatus comprises at least one memory; instructions in the apparatus; and processor circuitry to execute the instructions to: interleave a plurality of images from a first camera and a second camera in chronological order, the first camera to capture first images of the plurality of images, the second camera to capture second images of the plurality of images at a different time offset than the first camera; and generate video with an adaptive frame rate from the plurality of images by applying a mask to the plurality of images.
    Type: Grant
    Filed: October 25, 2021
    Date of Patent: January 9, 2024
    Assignee: Intel Corporation
    Inventors: Maha El Choubassi, Oscar Nestares
  • Patent number: 11854580
    Abstract: User-generated content is received from multiple user devices, including first content recorded by a first user device during a first time interval and second content recorded by a second user device during a second time interval. If the second time interval immediately precedes, or immediately follows, the first time interval, then at least a portion of the second content may be appended to the first content. For example, if a user ends recording of the first content before an interesting event occurs, then a portion of the second content may be appended to the first content so that the user has a recording including the missed event. The second content may be selected based on a location, and/or a field of view of the second user device during the second time interval being similar to that of the first user device during the first time interval.
    Type: Grant
    Filed: November 24, 2021
    Date of Patent: December 26, 2023
    Assignee: Rovi Guides, Inc.
    Inventor: Vishwas Sharadanagar Panchaksharaiah
  • Patent number: 11849169
    Abstract: A programming access device such as, for example, a cable or satellite set top box (STB), a digital video recorder (DVR), a personal computer, and/or a digital media receiver automatically optimizes an order of content choices presented in a content listing, such as a program guide display, favorite channel display, and/or a recording listing display based on the past viewing and/or recording history of an identified user.
    Type: Grant
    Filed: March 12, 2020
    Date of Patent: December 19, 2023
    Assignee: Universal Electronics Inc.
    Inventors: Bhuvanesh Prabhu, Anurag Thakur
  • Patent number: 11847154
    Abstract: Playback and distribution systems and methods for multimedia files are provided. The multimedia files are encoded with flags associated with the content data of the multimedia files. Through the use of the flags, playback of the content is enhanced without significantly increasing the file size of the multimedia file.
    Type: Grant
    Filed: November 7, 2022
    Date of Patent: December 19, 2023
    Assignee: DIVX, LLC
    Inventors: Kourosh Soroushian, Shaiwal Priyadarshi, Jason Braness, Roland Osborne, William Frantz, Jerome Vashisht-Rota, Daniel Salmonsen, John Funnell, Michael Floyd
  • Patent number: 11841601
    Abstract: A vehicle photographic booth is provided that accommodates cameras with lenses with focal lengths that avoid wide angle distortion that is common in low end car photography. The photographic booth has an ovoid hemispherical dome shape with a camera mounted at the apex of the ovoid portion so as to accommodate longer focal length lenses. The overall dimension of the ovoid section of the dome for placement of a camera is determined by the available floor space of a user. The use of an enclosed ovoid hemispherical dome shape that rotates with respect to a stationary stage, or in the alternative a fixed enclosed ovoid hemispherical dome with a rotating stage allows for much less light to be needed as compared to a full open volume. An ovoid shape also provides a smaller fixed footprint than a full structure for an equal camera distance from a subject.
    Type: Grant
    Filed: April 13, 2020
    Date of Patent: December 12, 2023
    Inventor: Davo Scheich
  • Patent number: 11843822
    Abstract: A transmission apparatus includes a transmission unit. The transmission unit transmits a packet including divided image data as payload data, the divided image data being obtained by dividing image data having a predetermined frame frequency into a predetermined number of frames, the image data having the predetermined frame frequency being subjected to mixing processing for each frame, image data of a previous frame and/or a subsequent frame being selectively used in the mixing processing, and further transmits metadata including information regarding the mixing processing in association with image data of each frame.
    Type: Grant
    Filed: December 16, 2021
    Date of Patent: December 12, 2023
    Assignee: Sony Group Corporation
    Inventor: Ikuo Tsukagoshi
  • Patent number: 11843765
    Abstract: A head-up display system includes a three-dimensional display device, an optical member, and an accelerometer. The three-dimensional display device includes a display panel, an optical element, and a controller. The display panel displays an image. The optical element defines a traveling direction of image light emitted from the display panel. The optical member reflects the image light from the three-dimensional display device toward a user's eye. The optical member is at a fixed position relative to the three-dimensional display device. The accelerometer detects acceleration of the three-dimensional display device. The controller controls a position of the image on the display panel based on the acceleration.
    Type: Grant
    Filed: May 29, 2020
    Date of Patent: December 12, 2023
    Assignee: KYOCERA CORPORATION
    Inventors: Kaoru Kusafuka, Sunao Hashimoto
  • Patent number: 11830030
    Abstract: Disclosed are methods, systems, and non-transitory computer-readable medium for transition-coded media, measuring engagement of transition-coded media, and distribution of components of transition-coded media. For instance, the method may include: obtaining a media file; determining whether the media file includes transition-coded media; in response to determining the media file includes the transition-coded media, setting up a dynamic media environment; detecting whether a user is interacting with the transition-coded media; and in response to detecting the user is interacting with the transition-coded media, executing the transition-coded media with the dynamic media environment.
    Type: Grant
    Filed: May 16, 2022
    Date of Patent: November 28, 2023
    Assignee: Capital One Services, LLC
    Inventor: Eric K. Barnum
  • Patent number: 11818328
    Abstract: A method includes receiving, from a multiscopic image capture system, a plurality of images depicting a scene. The method includes determining, by application of a neural network based on the plurality of images, a disparity map of the scene. The neural network includes a plurality of layers, and the layers include a rectification layer. The method include determining a matching error of the disparity map based on differences between corresponding pixels of two or more images associated with the disparity map. The method includes back-propagating the matching error to the rectification layer of the neural network. Back-propagating the matching error includes updating one or more weights applied to the rectification layer.
    Type: Grant
    Filed: September 23, 2022
    Date of Patent: November 14, 2023
    Assignee: Google LLC
    Inventor: Guy Satat
  • Patent number: 11816558
    Abstract: An integrated circuit device for reservoir computing can include a weighted input layer, an unweighted, asynchronous, internal recurrent neural network made up of nodes having binary weighting, and a weighted output layer. Weighting of output signals can be performed using predetermined weighted sums stored in memory. Application specific integrated circuit (ASIC) embodiments may include programmable nodes. Characteristics of the reservoir of the device can be tunable to perform rapid processing and pattern recognition of signals at relatively large rates.
    Type: Grant
    Filed: May 16, 2018
    Date of Patent: November 14, 2023
    Assignee: UNIVERSITY OF MARYLAND, COLLEGE PARK
    Inventors: Daniel Lathrop, Itamar Shani, Peter Megson, Alessandro Restelli, Anthony Robert Mautino
  • Patent number: 11810358
    Abstract: Embodiments are directed to video segmentation based on a query. Initially, a first segmentation such as a default segmentation is displayed (e.g., as interactive tiles in a finder interface, as a video timeline in an editor interface), and the default segmentation is re-segmented in response to a user query. The query can take the form of a keyword and one or more selected facets in a category of detected features. Keywords are searched for detected transcript words, detected object or action tags, or detected audio event tags that match the keywords. Selected facets are searched for detected instances of the selected facets. Each video segment that matches the query is re-segmented by solving a shortest path problem through a graph that models different segmentation options.
    Type: Grant
    Filed: May 26, 2021
    Date of Patent: November 7, 2023
    Assignee: ADOBE INC.
    Inventors: Hijung Shin, Cristin Ailidh Fraser, Aseem Agarwala, Lubomira Dontcheva, Joel Richard Brandt, Jovan Popović
  • Patent number: 11803297
    Abstract: A system for monitoring the movement of objects, structures, models of structures, cables and the like provides for the acquisition of images with an optical sensing device such as a video camera fixedly mounted at a selected distance from the item studied, in which the images are arranged into frames divided into pixels which are characterized by an intensity reflected or emitted over a selected time interval, and a data processing system to calculate a physical displacement as function of time of the item being studied or a portion of the item being studied based on an output from the video camera, and in some embodiments the system visually distinguishes one or more locations in the frame to indicate a difference in the phase of motion for multiple objects appearing in the frame.
    Type: Grant
    Filed: March 14, 2022
    Date of Patent: October 31, 2023
    Assignee: RDI TECHNOLOGIES, INC.
    Inventor: Jeffrey R. Hay
  • Patent number: 11800176
    Abstract: A mobile device running a mobile application accesses a remote content receiver to request the remote content receiver to retrieve a particular recording timer, and upon receiving the recording timer from the remote content receiver, establishes a radio communication link with a second mobile device and transfers the recording timer to the second mobile device over the established radio communication link. The radio communication link is preferably the Near Field Communication (NFC) link.
    Type: Grant
    Filed: June 3, 2021
    Date of Patent: October 24, 2023
    Assignee: DISH Technologies L.L.C.
    Inventors: Christofer Hardy, Thomas Allan Yarborough