Format Conversion Patents (Class 348/441)
  • Patent number: 11956568
    Abstract: [Object] To contribute to the achievement of a workflow in which an HDR video and an SDR video are compatible with each other. [Solving Means] This video signal processing apparatus includes an HDR video generation unit including a first converter unit that performs OOTF conversion on an HDR video by using an exponentiation function for calculating an exponentiation of 1.2, where 100% is 1, to an input signal level of the HDR video having a range from a point of 0%, where an expression range of an input signal level of an SDR video is 100%, to a change point optionally determined within a range of 100% to 500%, and by using a linear function for multiplying an input signal level of the HDR video having a range higher than the change point by a predetermined coefficient to maintain a change rate of a calculation result in a portion of the change point calculated by using the exponentiation function.
    Type: Grant
    Filed: April 28, 2022
    Date of Patent: April 9, 2024
    Assignee: SONY CORPORATION
    Inventors: Tomoyuki Endo, Koji Kamiya
  • Patent number: 11928855
    Abstract: Embodiments of the disclosure include a method, a device, and a computer program product for video processing. This method includes: selecting frames having features of a first type from a first instance of a video as a first candidate set, the first instance having a first resolution; generating a set of training frames based at least on the first candidate set; acquiring a set of corresponding frames for the set of training frames in a second instance of the video, the second instance having a second resolution lower than the first resolution; and determining, using the set of training frames and the set of corresponding frames, a conversion parameter for conversion from the second resolution to a third resolution. This solution provides a smaller-scale and higher-quality training set for the training of a video conversion model, thus improving the quality of training while saving computational resources and increasing training speed.
    Type: Grant
    Filed: January 10, 2022
    Date of Patent: March 12, 2024
    Assignee: Dell Products L.P.
    Inventors: Pedro Fernandez Orellana, Qiang Chen, Zhen Jia
  • Patent number: 11889107
    Abstract: According to one embodiment, an image encoding method includes selecting a motion reference block from an encoded pixel block to which an inter prediction is applied. The method includes selecting one or more available blocks from the motion reference block. The method includes selecting a selection block from the available blocks. The method includes generating a predicted image of the encoding target block using motion information of the selection block. The method includes encoding a prediction error between the predicted image and an original image. The method includes encoding selection information specifying the selection block by referring to a code table decided according to a number of the available blocks.
    Type: Grant
    Filed: January 11, 2022
    Date of Patent: January 30, 2024
    Assignee: KABUSHIKI KAISHA TOSHIBA
    Inventors: Taichiro Shiodera, Saori Asaka, Akiyuki Tanizawa, Takeshi Chujoh
  • Patent number: 11863904
    Abstract: Disclosed are an electronic device and an operation method of the electronic device, and the electronic device may include a communication circuit configured to transmit or receive data using a call channel established via a call connection with an external electronic device, and a processor, wherein the processor is configured to receive at least some packets of a first plurality of packets of a first frame via the call channel, to identify whether a lost packet is present in the first plurality of packets of the first frame, and to determine, based on the result of the identification, whether to perform frame rate conversion (FRC) based on the first frame and a second frame corresponding to a second plurality of packets received after the reception of the at least some packets. In addition, various other embodiments are possible.
    Type: Grant
    Filed: April 28, 2022
    Date of Patent: January 2, 2024
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Hyeyoung Jun, Yongtae Kim, Taewon Do, Hoonjae Lee
  • Patent number: 11778135
    Abstract: Example multi-channel display systems are disclosed. An example apparatus includes at least one processor to execute instructions to at least in response to determining that a first display controller is to provide at least a first portion of video data on a first channel, provide a first control signal to the first display controller instructing the first display controller to provide the at least the first portion of the video data on the first channel, and in response to determining that a second display controller is to provide at least a second portion of the video data on a second channel, provide a second control signal to the second display controller instructing the second display controller to provide the at least the second portion of the video data on the second channel, the second channel different from the first channel.
    Type: Grant
    Filed: December 11, 2020
    Date of Patent: October 3, 2023
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventors: Aravind Lakshminarayanan, Vivek Kumar Thakur, Jobin Raj
  • Patent number: 11758097
    Abstract: Provided is a method for transmitting video signals, including: receiving an input video signal provided by a source, wherein the input video signal includes an image signal and a source timing signal; generating a pulse synchronization signal based on the source timing signal and an output frame rate, wherein the output frame rate is a frame rate of outputting the image signal to a display module, and a cycle of the pulse synchronization signal is an integer multiple of a cycle of the source timing signal, and is an integer multiple of a cycle corresponding to the output frame rate; generating an output timing signal based on the pulse synchronization signal; and transmitting an output video signal to the display module, wherein the output video signal includes the image signal and the output timing signal.
    Type: Grant
    Filed: January 7, 2021
    Date of Patent: September 12, 2023
    Assignee: BOE TECHNOLOGY GROUP CO., LTD.
    Inventor: Xitong Ma
  • Patent number: 11748833
    Abstract: Systems and methods described herein relate to creating or modifying multimedia content using theme-based effects. In accordance with some implementations, a method can comprise the operations of: accessing foundational content; receiving a request to apply a theme to the foundational content; receiving a theme-based effect associated with the theme; receiving a licensing parameter of use associated with the theme; and applying the theme-based effect to the foundational content according to the licensing parameter. Themes can include those created by third-party vendors and those created by one or more users of a method or system implementing features described herein. Additionally, use of different themes can vary in cost and/or use limitations, which can be determined according to licensing parameters associated with the themes.
    Type: Grant
    Filed: February 14, 2014
    Date of Patent: September 5, 2023
    Assignee: WeVideo, Inc.
    Inventors: Jostein Svendsen, Bjørn Rustberggaard, Krishna Menon
  • Patent number: 11729349
    Abstract: Illustrative embodiments include a method, an electronic device, and a computer program product for video processing. In the method, a first group of image frames in a first video having a first resolution is converted into a second group of image frames having a second resolution, the first resolution being higher than the second resolution; a second video having the second resolution is generated based on the second group of image frames; conversion parameters for the second video are determined based on the first group of image frames and the second group of image frames, the conversion parameters being used to convert an image frame in the second group of image frames into an image frame having a third resolution, and the third resolution being higher than the second resolution; and the conversion parameters and the second video are sent to a requester of the first video.
    Type: Grant
    Filed: August 12, 2021
    Date of Patent: August 15, 2023
    Assignee: EMC IP Holding Company LLC
    Inventors: Qiang Chen, Pedro Fernandez Orellana
  • Patent number: 11721187
    Abstract: A method for displaying video streams involves detecting multiple video events, and displaying multiple video streams on a display. Display windows for displayed video streams define an ordered sequence of display windows. When a new event is detected, the display of one or more of the video streams is shifted to respective next one or more display windows in an ordered sequence of display windows.
    Type: Grant
    Filed: November 6, 2019
    Date of Patent: August 8, 2023
    Assignee: MOTOROLA SOLUTIONS, INC.
    Inventors: Tulio de Souza Alcantara, Roger David Donaldson, David Flanagan, Zachary Lang, Quan Pan, Brenna Randlett, Brady James Schnell
  • Patent number: 11636829
    Abstract: A display device includes a display panel including a first display area and a second display area adjacent to the first display area, a processor configured to generate first image data corresponding to the first and second display areas for a first mode, and to generate second image data corresponding to the first display area for a second mode, and a display driver configured to drive the display panel in response to the first image data in the first mode, and to drive the display panel in response to the second image data in the second mode, wherein a supplementary image is displayed in at least a portion of the second display area in the second mode.
    Type: Grant
    Filed: February 12, 2020
    Date of Patent: April 25, 2023
    Assignee: Samsung Display Co., Ltd.
    Inventors: Ji Hye Kim, Jae Hyeon Jeon
  • Patent number: 11622110
    Abstract: Provided is a video decoding method including obtaining split information indicating whether to split a current block; when the split information indicates that the current block is split, splitting the current block into at least two lower blocks; obtaining encoding order information indicating an encoding order of the at least two lower blocks of the current block; determining a decoding order of the at least two lower blocks according to the encoding order information; and decoding the at least two lower blocks according to the decoding order.
    Type: Grant
    Filed: October 1, 2020
    Date of Patent: April 4, 2023
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Yin-ji Piao, Jie Chen, Chan-yul Kim
  • Patent number: 11601709
    Abstract: A UHD display presents HD video in the native resolution of HD, leaving some portions of the UHD display unused for presenting the HD video. Ancillary information received, for example, in real time with the HD video or in parallel with the HD video over the Internet is presented in the unused portions of the UHD display along with the HD video.
    Type: Grant
    Filed: April 20, 2017
    Date of Patent: March 7, 2023
    Assignee: SATURN LICENSING LLC
    Inventor: Eric Hsiao
  • Patent number: 11570397
    Abstract: One embodiment of the present invention sets forth a technique for performing deinterlacing. The technique includes separating a first interlaced video frame into a first sequence of fields ordered by time, the first sequence of fields including a first field. The technique also includes generating, by applying a deinterlacing network to a first field in the first sequence, a second field that is missing from the first sequence of fields and is complementary to the first field. The technique further includes constructing a progressive video frame based on the first field and the second field.
    Type: Grant
    Filed: July 10, 2020
    Date of Patent: January 31, 2023
    Assignees: DISNEY ENTERPRISES, INC., ETH ZÜRICH, (EIDGENÖSSISCHE TECHNISCHE HOCHSCHULE ZÜRICH)
    Inventors: Michael Bernasconi, Daniel Konrad Dorda, Abdelaziz Djelouah, Shinobu Hattori, Christopher Richard Schroers
  • Patent number: 11545071
    Abstract: A display device includes a controller, a display processor, a resolution converter, and a display screen. The controller, in response to first request of setting a current signal source type to a first signal source type which is a type of a signal source for providing display data having a target resolution and a first definition, generates and transmits a first control signal corresponding to the first request. The display processor receives and forwards the first control signal from the controller. The resolution converter converts the initial display data into first display data having a target resolution and a first definition in response to the first control signal, and transmits the first display data to the display processor. The target resolution is greater than the initial resolution. The first definition is greater than a definition of display data obtained by stretching the initial display data and having the target resolution.
    Type: Grant
    Filed: December 15, 2021
    Date of Patent: January 3, 2023
    Assignee: BEIJING BOE TECHNOLOGY DEVELOPMENT CO., LTD.
    Inventor: Zhusong Yi
  • Patent number: 11528424
    Abstract: An imaging device having an imager that includes first pixels having sensitivity to a first light and second pixels having sensitivity to a second light, a wavelength of the first light being different from a wavelength of the second light. The imager being configured to acquire first image data from the first pixels and being configured to acquire second image data from the second pixels. Each of the first image data and the second image data including an image of a code, the code being configured to output the second light. The imaging device further including an image processor configured to extract an image of the code based on the first image data and the second image data.
    Type: Grant
    Filed: October 14, 2020
    Date of Patent: December 13, 2022
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Yoshiaki Satou, Kazuko Nishimura, Yasuo Miyake, Osamu Shibata, Hiroshi Iwai
  • Patent number: 11508029
    Abstract: An information processing apparatus includes: a processor configured to: set a geometrical transformation region for use in generating a geometrical transformation image into which a sample image is geometrically transformed, based on a replacement target region set in a part of an original image; generate the geometrical transformation image by geometrically transforming the sample image such that the transformed sample image has a shape of the geometrical transformation region; and replace the replacement target region using the geometrical transformation image.
    Type: Grant
    Filed: May 12, 2021
    Date of Patent: November 22, 2022
    Assignee: FUJIFILM Business Innovation Corp.
    Inventors: Jungo Harigai, Yoshitaka Kuwada, Hirotake Sasaki, Takuma Ishihara
  • Patent number: 11477451
    Abstract: Provided is a video decoding method including obtaining split information indicating whether to split a current block; when the split information indicates that the current block is split, splitting the current block into at least two lower blocks; obtaining encoding order information indicating an encoding order of the at least two lower blocks of the current block; determining a decoding order of the at least two lower blocks according to the encoding order information; and decoding the at least two lower blocks according to the decoding order.
    Type: Grant
    Filed: October 1, 2020
    Date of Patent: October 18, 2022
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Yin-ji Piao, Jie Chen, Chan-yul Kim
  • Patent number: 11468542
    Abstract: This disclosure addresses the single-image compressive sensing (CS) and reconstruction problem. A scalable Laplacian pyramid reconstructive adversarial network (LAPRAN) facilitates high-fidelity, flexible and fast CS image reconstruction. LAPRAN progressively reconstructs an image following the concept of the Laplacian pyramid through multiple stages of reconstructive adversarial networks (RANs). At each pyramid level, CS measurements are fused with a contextual latent vector to generate a high-frequency image residual. Consequently, LAPRAN can produce hierarchies of reconstructed images and each with an incremental resolution and improved quality. The scalable pyramid structure of LAPRAN enables high-fidelity CS reconstruction with a flexible resolution that is adaptive to a wide range of compression ratios (CRs), which is infeasible with existing methods.
    Type: Grant
    Filed: January 17, 2020
    Date of Patent: October 11, 2022
    Assignee: ARIZONA BOARD OF REGENTS ON BEHALF OF ARIZONA STATE UNIVERSITY
    Inventors: Fengbo Ren, Kai Xu, Zhikang Zhang
  • Patent number: 11462246
    Abstract: A camera control unit for processing a first video signal from an image sensor, the first video signal including a plurality of frames includes a frame replication device that replicates pixels of a respective frame of the first video signal to produce at least one replicated frame, an image processing controller that detects a noise level in the first digital video signal and that selects a modification level for the random modification of the respective pixel data based on the detected noise level, and a frame modification controller that modifies at least some of the respective pixels in the at least one replicated frame resulting in at least one modified replicated frame based on the selected modification level.
    Type: Grant
    Filed: June 17, 2020
    Date of Patent: October 4, 2022
    Assignee: KARL STORZ Imaging, Inc.
    Inventor: Russell Granneman
  • Patent number: 11445109
    Abstract: An image processing device comprises: one or more processors comprising hardware, the one or more processors being configured to: generate a high-resolution combined image by aligning a plurality of time-series images with each other in a high-resolution image space having a resolution higher than the plurality of time-series images based on an amount of displacement between the plurality of time-series images, and combining the plurality of time-series images; generate a low-resolution combined image by aligning the plurality of time-series images with each other in a low-resolution image space having a resolution equal to or lower than the resolution of the plurality of time-series images based on the amount of displacement, combining the plurality of time-series images through weighted addition; calculate a feature quantity pertaining to a pixel-value change direction at each region in the generated low-resolution combined image; and correct the high-resolution combined image based on the calculated featur
    Type: Grant
    Filed: December 16, 2019
    Date of Patent: September 13, 2022
    Assignee: OLYMPUS CORPORATION
    Inventors: Eiji Furukawa, Shunichi Koga
  • Patent number: 11430085
    Abstract: In one embodiment, a computing system may access a video including a first frame and a second frame. The computing system may determine first sampling locations for the first frame and determine second sampling locations for the second frame by transforming the first sampling locations to the second frame according to an optical flow between the first frame and the second frame. The computing system may select a subset of the second sampling locations based on a comparison between pixels in the first frame corresponding to the first sampling locations and pixels in the second frame corresponding to the second sampling locations. The computing system may define one or more rejection areas in the second frame based on the subset of the second sampling locations to determine third sampling locations in areas outside of the rejection areas. The computing system may generate a sample of the video.
    Type: Grant
    Filed: September 22, 2020
    Date of Patent: August 30, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Todd Goodall, Anton S Kaplanyan, Anjul Patney, Jamorn Sriwasansak
  • Patent number: 11425331
    Abstract: A method of region-based video-image interpolation is provided, which includes the following steps: respectively dividing each image and its subsequent image in an input video signal into first regions and second regions to obtain first regional images and second regional images; performing a motion-compensated frame-interpolation process on the first regional image and the second regional image in the same position in each image and its subsequent image to obtain an interpolated regional image; performing a frame-rate-conversion process on reference images and the interpolated regional images of each first region according to an original frame rate of each first region and a display frame rate of an output video signal to obtain a regional output image of each first region; and superimposing the regional output image generated at each output timestamp by each motion-compensated frame-interpolation circuit to generate an output image of the output video signal.
    Type: Grant
    Filed: November 10, 2021
    Date of Patent: August 23, 2022
    Assignee: TERAWINS, INC.
    Inventors: Yu-Kuang Wang, Wen-Yi Huang, Pei-Kai Hsu
  • Patent number: 11393376
    Abstract: A refresh rate setting apparatus for use in a portable terminal, comprises a first setting unit configured to, when an application program is started, set a refresh rate of a display of the portable terminal to a first refresh rate equal to or higher than 90 Hz; a determination unit configured to determine whether the first refresh rate is an integer multiple of a frame rate of the application program; and a second setting unit configured to, in a case where the determination unit determines that the first refresh rate is not an integer multiple of the frame rate, set the refresh rate to a second refresh rate according to whether values settable as the refresh rate include one or more values each equal to an integer multiple of the frame rate.
    Type: Grant
    Filed: February 12, 2021
    Date of Patent: July 19, 2022
    Assignee: SHARP KABUSHIKI KAISHA
    Inventor: Takuya Honda
  • Patent number: 11394919
    Abstract: An object of one embodiment of the present disclosure is to provide a product with a high added value to a user by preventing an erroneous character string from being combined in a case where a voice before and after an image selected from within a moving image is a mixed voice. One embodiment of the present disclosure is an image processing apparatus including: a selection unit configured to select, from a moving image including a plurality of frames, a part of the moving image; an extraction unit configured to extract a voice during a predetermined time corresponding to the selected part in the moving image; and a combination unit configured to combine a character string based on a voice extracted by the extraction unit, with the part of the moving image selected by the selection unit or a frame among frames corresponding to the part.
    Type: Grant
    Filed: June 30, 2020
    Date of Patent: July 19, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventors: Daiki Kadomatsu, Kosei Tanaka, Gou Sasaki, Hirokazu Kameda, Chisei Sumita, Takeshi Nakamura, Ken Hoshino, Hiroaki Hasegawa, Kenichi Yoshida
  • Patent number: 11375152
    Abstract: Embodiments of this disclosure provide a video frame interpolation apparatus and method. The method includes calculating a bidirectional optical flow between a first frame and a second frame; an performing kernel and weight estimation according to the first frame and the second frame. An adaptive local convolutional kernel is generated by using a convolutional layer and a weight coefficient is generated by using another convolutional layer. A conversion on the first frame and the second frame is performed by using an adaptive conversion layer according to the bidirectional optical flow, the weight coefficient and the adaptive local convolutional kernel, so as to generate a conversion frame. A frame synthesis on the first frame, the second frame and the conversion frame is performed to generate an interpolation frame between the first frame and the second frame.
    Type: Grant
    Filed: April 9, 2021
    Date of Patent: June 28, 2022
    Assignee: FUJITSU LIMITED
    Inventors: Sihan Wen, Jing Zhou, Zhiming Tan
  • Patent number: 11356633
    Abstract: [Object] To contribute to the achievement of a workflow in which an HDR video and an SDR video are compatible with each other. [Solving Means] This video signal processing apparatus includes an HDR video generation unit including a first converter unit that performs OOTF conversion on an HDR video by using an exponentiation function for calculating an exponentiation of 1.2, where 100% is 1, to an input signal level of the HDR video having a range from a point of 0%, where an expression range of an input signal level of an SDR video is 100%, to a change point optionally determined within a range of 100% to 500%, and by using a linear function for multiplying an input signal level of the HDR video having a range higher than the change point by a predetermined coefficient to maintain a change rate of a calculation result in a portion of the change point calculated by using the exponentiation function.
    Type: Grant
    Filed: August 10, 2017
    Date of Patent: June 7, 2022
    Assignee: SONY CORPORATION
    Inventors: Tomoyuki Endo, Koji Kamiya
  • Patent number: 11356635
    Abstract: An imaging apparatus includes at least one processor to implement: a re-sizer configured to re-size an image to a predetermined size, an encoder configured to encode the re-sized image, and a frame rate controller configured to calculate an actual bit rate of the encoded image for a preset period of time, compare a user-set target bit rate with the calculated actual bit rate, adjust a frame rate of the encoded image according to a result of the comparison, and output an encoded image signal at a user-set target bit rate irrespective of a complexity of the encoded image.
    Type: Grant
    Filed: May 23, 2016
    Date of Patent: June 7, 2022
    Assignee: Hanwha Techwin Co., Ltd.
    Inventors: Sujit Kumar Mahapatro, Karthikeyan Kannaiyan
  • Patent number: 11348211
    Abstract: An embodiment of the present invention provides an image processing method based on a convolution internet algorithm, a device, an electronic apparatus and a computer readable storage medium thereof. The method includes: determining a padding radius for each convolution calculation layer; summing the padding radiuses; acquiring an input image of a convolution internet algorithm; padding the input image to acquire a padded image according to the sum; determining a calculation range for each convolution calculation layer; implementing a convolution internet algorithm calculation to the padded image according to each convolution calculation layer; acquiring an output image. Image processing device, electronic apparatus, and computer readable storage medium of a convolution internet algorithm are provided.
    Type: Grant
    Filed: December 27, 2019
    Date of Patent: May 31, 2022
    Assignee: TCL China Star Optoelectronics Technology Co., Ltd.
    Inventor: Chinghong Lai
  • Patent number: 11343495
    Abstract: Systems and methods for implementing temporal filtering are provided. A method includes: applying a temporal filter to a current picture and encoding the current picture after the temporal filter is applied. The applying includes obtaining an exponential function, that includes an exponent with a numerator with at least one first factor and a denominator with at least one second factor, by computing the exponent of the exponential function as fixed-point values or by using at least one lookup table; obtaining a weight of at least one neighboring picture by multiplying a scaling function with the exponential function; obtaining a filtered sample value of the current picture based on a sample value of the current picture and the weight of the at least one neighboring picture; and replacing the sample value of the current picture with the filtered sample value.
    Type: Grant
    Filed: April 26, 2021
    Date of Patent: May 24, 2022
    Assignee: TENCENT AMERICA LLC
    Inventors: Anish Mahendra Tamse, Xiang Li, Shan Liu
  • Patent number: 11323647
    Abstract: The present invention discloses a method of injecting additional data in one or more image sensor frames in an image sensor device. The method comprises: providing (801) additional data in the form of a numeric sequence, controlling (802) the lengths of subsequent blanking intervals in one or more image sensor frames to represent the numeric sequence, and transmitting the one or more image sensor frames from the image sensor device. The one or more image sensor frames may be transmitted to an image processor (12, 72). Examples of image processors (12, 72) and a system (1, 7) comprising an image processor (12, 72) are also disclosed.
    Type: Grant
    Filed: October 15, 2020
    Date of Patent: May 3, 2022
    Assignee: AXIS AB
    Inventor: Carl-Axel Alm
  • Patent number: 11303482
    Abstract: Embodiments of the present disclosure provide a signal processing apparatus and method, a network device and a computer readable storage medium. The apparatus comprises: a receiving unit configured to receive a signal from a remote radio frequency unit (RRH), the RRH being independent from the signal processing apparatus; a processing unit configured to perform signal enhancement on the signal; and a transmitting unit configured to transmit the enhanced signal to a baseband unit (BBU). According to the present disclosure, it is possible to implement a fronthaul or anyhaul solution with a high reliability, and meanwhile save the RF transmission power of the terminal device and reduce the operation costs of the operators.
    Type: Grant
    Filed: October 24, 2018
    Date of Patent: April 12, 2022
    Assignee: Nokia Solutions and Networks Oy
    Inventors: Chenhui Ye, Dongxu Zhang, Kaibin Zhang
  • Patent number: 11303846
    Abstract: An digital imaging system and method that is provided that is capable of receiving and processing multiple types of image formats. Thus, the system is capable of receiving image signals from multiple types of image sources, such as medical imaging devices, that may each use different image formats, and converting the image format of the received image signals to the image formats required by one or more predetermined devices, such as an image recording device and a display.
    Type: Grant
    Filed: December 5, 2018
    Date of Patent: April 12, 2022
    Assignee: MediCapture, Inc.
    Inventor: Alexander Yurusov
  • Patent number: 11277632
    Abstract: A data processing system for performing motion estimation in a sequence of frames comprising first and second frames each divided into respective sets of blocks of pixels, the system comprising: a vector generator configured to form motion vector candidates representing mappings of pixels between the first and second frames; and a vector processor configured to, for a search block of the first frame, identify a first motion vector candidate ending in a block of the second frame collocated with the search block and form an output vector for the search block which is substantially parallel to the first motion vector candidate and represents a mapping of pixels from the search block to the second frame.
    Type: Grant
    Filed: June 8, 2016
    Date of Patent: March 15, 2022
    Assignee: Imagination Technologies Limited
    Inventors: Steven Fishwick, Jonathan Diggins
  • Patent number: 11272094
    Abstract: Providing object-oriented-zoom by identifying, in a transmitter, a region-of-interest in a captured video part, communicating to a receiver the video stream, and an identification of the region-of-interest, marking, on a display of the receiver, the region-of-interest over the captured video stream on a screen display, receiving from a selection of the displayed region-of-interest forming a selected object, communicating the selection to the transmitter, dividing the video stream, in the transmitter, into a first part including the selected object, and a second part including at least a part of the captured video stream less the first part, communicating the first and second parts to the receiver, displaying the first and second parts simultaneously, where the first part is displayed in a substantially constant location of a screen display of the receiver, and where the second part is displayed around the first part to fill the screen display of the receiver.
    Type: Grant
    Filed: July 14, 2017
    Date of Patent: March 8, 2022
    Assignee: ENDLESS TECHNOLOGIES LTD.
    Inventors: Roi Ginat, Liron Hertz
  • Patent number: 11258942
    Abstract: A terminal apparatus performs: receiving a first selection operation of selecting a shot image; acquiring a first characteristic amount relating to a shape of at least one of the shot image and an object included in the shot image; acquiring a second characteristic amount relating to a shape of a frame included in each of a plurality of templates; controlling a display to display a selection screen for selecting one template, the selection screen showing, as a particular template, a template including a frame of the second characteristic amount indicative of a shape corresponding to the first characteristic amount such that the particular template is distinguishable from a template other than the particular template; receiving a second selection operation of selecting a selection template on the selection screen; creating a composite image by combining the shot image with a frame included in the selection template; and outputting the composite image.
    Type: Grant
    Filed: February 27, 2020
    Date of Patent: February 22, 2022
    Assignee: Brother Kogyo Kabushiki Kaisha
    Inventor: Kazuaki Ogawa
  • Patent number: 11233970
    Abstract: Disclosed is an electronic apparatus. The electronic apparatus includes a memory configured to store a plurality of frames included in an input image and a processor configured to: identify whether one frame of the plurality of frames is a first interpolated frame generated based on at least two frames from remaining frames of the plurality of frames, and select a reference frame to be used in frame interpolation of the plurality of frames based on the first interpolated frame being identified.
    Type: Grant
    Filed: April 2, 2020
    Date of Patent: January 25, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Wonseok Song, Yoosun Jung, Shinhaeng Kim, Sangsu Lee
  • Patent number: 11200644
    Abstract: A video super resolution method comprises successively executing instances of a first plurality of layers (SISR) of a neural network for generating a first image (St) at a higher resolution than an input image frame (Xt); successively executing a second plurality of layers (VSR) of the neural network for generating a second image (Vt) at the higher resolution, at least one of the second plurality of layers generating intermediate output information (Ht), the second plurality of layers taking into account an output image (Yt?1) at the higher resolution generated by a previous instance of the network from a previous input image frame (Xt?1) and intermediate output information (Ht?1) generated by the second plurality of layers of the previous instance, and executing a third plurality of layers for combining the first (St) and second (Vt) images to produce an output image (Yt) for the instance of the network.
    Type: Grant
    Filed: February 27, 2020
    Date of Patent: December 14, 2021
    Inventors: Cian Ryan, Richard Blythman
  • Patent number: 11200915
    Abstract: Methods and systems for recording streaming audio and video by directing an incoming audio-visual stream to a discrete memory region serving as a virtual display. The virtual display is configured with a section visible to the viewer and a section invisible to the viewer, wherein a streaming video is hidden from the user's display under all conditions. The user's browser is pre-loaded with hooks to redirect the video portion of the stream to the invisible section of the virtual memory wherein a video capture tool specifically designed to interact with the hooks can now recognize each function call and intercept each frame as it is rendered in the GPU. Concurrently, the audio portion of the stream is remapped using an audio indexing application. The GPU framebuffers and audio sinks are multiplexed together and saved to disk. The file is immediately accessible for playback or copying.
    Type: Grant
    Filed: October 12, 2020
    Date of Patent: December 14, 2021
    Assignee: Modulus Media Systems, Inc.
    Inventor: Steven E. Schulz
  • Patent number: 11200681
    Abstract: A motion detection method includes acquiring a raw image, detecting a motion object image according to the raw image by using a motion detector, cropping the raw image to generate a sub-image according to the motion object image, and inputting the sub-image to a processor for determining if a motion object of the sub-image matches with a detection category. The processor includes a neural network. The shape of the sub-image is a polygonal shape.
    Type: Grant
    Filed: January 16, 2020
    Date of Patent: December 14, 2021
    Assignee: Realtek Semiconductor Corp.
    Inventors: Shang-Lun Chan, Chao-Hsun Yang, Chun-Chang Wu, Shih-Tse Chen
  • Patent number: 11195258
    Abstract: A device and method for automatic image enhancement in vehicles, in particular land vehicles, including a camera to record a primary-image, and an image-processing-module to determine a resulting-image from the primary-image.
    Type: Grant
    Filed: September 19, 2019
    Date of Patent: December 7, 2021
    Assignee: Robert Bosch GmbH
    Inventors: Attila Borcs, Kornel Istvan Kis, Levente Kis, Peter Korosi-Szabo
  • Patent number: 11183136
    Abstract: A display device includes a display panel including gate lines, data lines, and pixels connected to the gate lines and the data lines and a driving circuit which controls the display panel in response to an image signal, a control signal, and a mode signal from an outside to display an image through the display panel. The driving circuit converts the image signal to data voltage signals corresponding to a first gamma curve to apply the data voltage signals to the data lines when the mode signal represents a normal mode and converts the image signal to data voltage signals corresponding to a second gamma curve different from the first gamma curve to apply the data voltage signals to the data lines when the mode signal represents a frequency variable mode.
    Type: Grant
    Filed: April 11, 2019
    Date of Patent: November 23, 2021
    Assignee: SAMSUNG DISPLAY CO., LTD.
    Inventors: Dongkeon Kim, Seonghyeon Kim, Suji Han
  • Patent number: 11184602
    Abstract: The present disclosure relates to an image processing apparatus and an image processing method capable of storing auxiliary information in CbCr components in a YCbCr format. The image processing apparatus includes a receiving section that receives depth image data in which a depth image transmitted together with a texture image is stored in a Y component in a YCbCr format and auxiliary information is stored in CbCr components in the YCbCr format, and an auxiliary information utilization section that executes a predetermined image process using the auxiliary information on at least one of the texture image or the depth image. A value that can be taken on by the auxiliary information for each pixel of the texture image has N patterns, and a gradation value out of N×N gradation values into which a combination of the auxiliary information regarding two pixels is converted is stored in the CbCr components.
    Type: Grant
    Filed: January 30, 2018
    Date of Patent: November 23, 2021
    Assignee: SONY CORPORATION
    Inventor: Tetsuya Fukuyasu
  • Patent number: 11170692
    Abstract: The display driver includes control circuitry and signal supply circuitry. The control circuitry is configured to store a first setting table for a first frame rate and a second setting table for a second frame rate. The control circuitry is further configured to, in response to adjusting a frame rate of a display device from the first frame rate to the second frame rate, generate an interpolated control parameter through interpolation of a first control parameter obtained from the first setting table and a second control parameter obtained from the second setting table. The signal supply circuitry is configured to generate at least one first signal to be supplied to a display panel based on the interpolated control parameter.
    Type: Grant
    Filed: September 11, 2020
    Date of Patent: November 9, 2021
    Assignee: Synaptics Incorporated
    Inventors: Masao Orio, Takashi Nose, Hirobumi Furihata, Akio Sugiyama
  • Patent number: 11159735
    Abstract: An imaging system comprises a rolling shutter sensor that captures images of a scene, an illumination source that continuously illuminates the scene, a time-varying illumination source that illuminates the scene, and a processor that receives the images from the rolling shutter sensor. The rolling shutter sensor and the time-varying illumination source are operated synchronously to cause: on-cadence lines of the rolling shutter sensor to receive illumination from the continuously illuminating illumination source and a first amount of illumination from the time-varying illumination source; and off-cadence lines of the rolling shutter sensor to receive the illumination from the continuously illuminating illumination source and a second amount of illumination from the time-varying illumination source.
    Type: Grant
    Filed: February 5, 2018
    Date of Patent: October 26, 2021
    Assignee: INTUITIVE SURGICAL OPERATIONS, INC.
    Inventors: Jason Paul Watson, Ian E. McDowall
  • Patent number: 11150475
    Abstract: A system and method for an HMD system including an HMD and a computing device. The computing device to render an image for the HMD, and transfer the image to the HMD without inactive pixels of the image. The inactive pixels include pixels outside of a viewable area of the image.
    Type: Grant
    Filed: April 12, 2017
    Date of Patent: October 19, 2021
    Assignee: Hewlett-Packard Development Company, L.P.
    Inventor: Lee Atkinson
  • Patent number: 11146762
    Abstract: Methods and systems for reconstructing a high frame rate high resolution video in a Bayer domain, when an imaging device is set in a Flexible Sub-Sampled Readout (FSR) mode are described. A method provides the FSR mode, which utilizes a multiparty FSR mechanism to spatially and temporally sample the full frame Bayer data. The multi parity FSR utilizes a zigzag sampling that assists reconstruction of motion compensated artifact free high frame rate high resolution video with full frame size. The method includes reconstructing the high frame rate high resolution video using the plurality of parity fields generated. The reconstruction is based on a FSR reconstruction mechanism that can be a pre-Image Signal Processor (ISP) FSR reconstruction or a post-ISP FSP reconstruction based on bandwidth capacity of an ISP used by the imaging device.
    Type: Grant
    Filed: January 19, 2017
    Date of Patent: October 12, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Alok Shankarlal Shukla, Sathish Chalasani, Narasimha Gopalakrishna Pai, Pyo-jae Kim, Jin-hee Na, Abhishek Somani, Venkatesh Ambati
  • Patent number: 11146746
    Abstract: An image processing device includes one or more processors configured to: generate a high-resolution combined image by aligning the plurality of images with each other in a high-resolution image space based on an amount of displacement between the plurality of images, and combining the plurality of images; generate at least two low-resolution combined images by generating at least two groups each composed of at least two images by dividing the plurality of images in the time direction, aligning the at least two images in each of the groups with each other in a low-resolution image space based on the amount of displacement, and combining the at least two images through weighted addition; calculate, in each region, a feature quantity pertaining to a correlation between the generated at least two low-resolution combined images; and correct the high-resolution combined image based on the calculated feature quantity.
    Type: Grant
    Filed: December 16, 2019
    Date of Patent: October 12, 2021
    Assignee: OLYMPUS CORPORATION
    Inventors: Eiji Furukawa, Shunichi Koga
  • Patent number: 11107186
    Abstract: A method is implemented at an electronic device for displaying output from an application. The electronic device includes a display module and an application. The application sends to the display module a request to display output on the fixed orientation display. The display module determines whether the application is able to scale the output from the application to fit the fixed orientation display. In accordance with a determination that the application is able to scale the output, the electronic device causes the application to receive information concerning the fixed orientation display from the display module and scale the output for display on the fixed orientation display according to the information. In accordance with a determination that the application is not able to scale the output, the display module scales the output received from the application, thereby enabling the output of the application to be displayed on the fixed orientation display.
    Type: Grant
    Filed: September 4, 2020
    Date of Patent: August 31, 2021
    Assignee: Google LLC
    Inventors: Patrick Brady, Dianne Hackborn, Jason Bayer
  • Patent number: 11082383
    Abstract: Systems and methods are disclosed herein for generating for display a notification to a plurality of users at a position within a display screen to which each user of the plurality of users is paying attention. Specifically, the media guidance application captures lines of sight of users who are paying attention to a display screen, based on which the media guidance application determines line-of-sight regions on the display screen that the users are paying attention to. The media guidance application then determines a display area that is noticeable to the users based on the respective line-of-sight regions on the display screen to display an electronic message.
    Type: Grant
    Filed: March 13, 2018
    Date of Patent: August 3, 2021
    Assignee: ROVl GUIDES, INC.
    Inventors: Charles Dawes, Takeaki Obara
  • Patent number: 11082637
    Abstract: Apparatus, systems, articles of manufacture, and methods for processing video in virtual reality environments are disclosed. An example virtual reality display device to process video in a virtual reality environment includes a video analyzer to detect unsmooth video data in the stream of video data and a video library to provide alternative video data. The example device also includes a selector to receive the stream of video data, an indication of the unsmooth video data, and the alternative video data. The selector is to select the alternative video data to replace the unsmooth video data based on the indication of the unsmooth video data and output a modified stream of video data including the stream of video data with the alternative video data in place of the unsmooth video data. The example device also includes an output display to display the modified stream of video data.
    Type: Grant
    Filed: June 28, 2018
    Date of Patent: August 3, 2021
    Assignee: Intel Corporation
    Inventors: Sharon Talmor Marcovici, Michael Glik, Yaniv Frishman, Elad Levy, Shani Ben-Haim