Abstract: A UHD display presents HD video in the native resolution of HD, leaving some portions of the UHD display unused for presenting the HD video. Ancillary information received, for example, in real time with the HD video or in parallel with the HD video over the Internet is presented in the unused portions of the UHD display along with the HD video.

Abstract: One embodiment of the present invention sets forth a technique for performing deinterlacing. The technique includes separating a first interlaced video frame into a first sequence of fields ordered by time, the first sequence of fields including a first field. The technique also includes generating, by applying a deinterlacing network to a first field in the first sequence, a second field that is missing from the first sequence of fields and is complementary to the first field. The technique further includes constructing a progressive video frame based on the first field and the second field.

Abstract: A display device includes a controller, a display processor, a resolution converter, and a display screen. The controller, in response to first request of setting a current signal source type to a first signal source type which is a type of a signal source for providing display data having a target resolution and a first definition, generates and transmits a first control signal corresponding to the first request. The display processor receives and forwards the first control signal from the controller. The resolution converter converts the initial display data into first display data having a target resolution and a first definition in response to the first control signal, and transmits the first display data to the display processor. The target resolution is greater than the initial resolution. The first definition is greater than a definition of display data obtained by stretching the initial display data and having the target resolution.

Abstract: An imaging device having an imager that includes first pixels having sensitivity to a first light and second pixels having sensitivity to a second light, a wavelength of the first light being different from a wavelength of the second light. The imager being configured to acquire first image data from the first pixels and being configured to acquire second image data from the second pixels. Each of the first image data and the second image data including an image of a code, the code being configured to output the second light. The imaging device further including an image processor configured to extract an image of the code based on the first image data and the second image data.

Abstract: An information processing apparatus includes: a processor configured to: set a geometrical transformation region for use in generating a geometrical transformation image into which a sample image is geometrically transformed, based on a replacement target region set in a part of an original image; generate the geometrical transformation image by geometrically transforming the sample image such that the transformed sample image has a shape of the geometrical transformation region; and replace the replacement target region using the geometrical transformation image.

Abstract: Provided is a video decoding method including obtaining split information indicating whether to split a current block; when the split information indicates that the current block is split, splitting the current block into at least two lower blocks; obtaining encoding order information indicating an encoding order of the at least two lower blocks of the current block; determining a decoding order of the at least two lower blocks according to the encoding order information; and decoding the at least two lower blocks according to the decoding order.

Abstract: This disclosure addresses the single-image compressive sensing (CS) and reconstruction problem. A scalable Laplacian pyramid reconstructive adversarial network (LAPRAN) facilitates high-fidelity, flexible and fast CS image reconstruction. LAPRAN progressively reconstructs an image following the concept of the Laplacian pyramid through multiple stages of reconstructive adversarial networks (RANs). At each pyramid level, CS measurements are fused with a contextual latent vector to generate a high-frequency image residual. Consequently, LAPRAN can produce hierarchies of reconstructed images and each with an incremental resolution and improved quality. The scalable pyramid structure of LAPRAN enables high-fidelity CS reconstruction with a flexible resolution that is adaptive to a wide range of compression ratios (CRs), which is infeasible with existing methods.

Abstract: A camera control unit for processing a first video signal from an image sensor, the first video signal including a plurality of frames includes a frame replication device that replicates pixels of a respective frame of the first video signal to produce at least one replicated frame, an image processing controller that detects a noise level in the first digital video signal and that selects a modification level for the random modification of the respective pixel data based on the detected noise level, and a frame modification controller that modifies at least some of the respective pixels in the at least one replicated frame resulting in at least one modified replicated frame based on the selected modification level.

Abstract: An image processing device comprises: one or more processors comprising hardware, the one or more processors being configured to: generate a high-resolution combined image by aligning a plurality of time-series images with each other in a high-resolution image space having a resolution higher than the plurality of time-series images based on an amount of displacement between the plurality of time-series images, and combining the plurality of time-series images; generate a low-resolution combined image by aligning the plurality of time-series images with each other in a low-resolution image space having a resolution equal to or lower than the resolution of the plurality of time-series images based on the amount of displacement, combining the plurality of time-series images through weighted addition; calculate a feature quantity pertaining to a pixel-value change direction at each region in the generated low-resolution combined image; and correct the high-resolution combined image based on the calculated featur

Abstract: In one embodiment, a computing system may access a video including a first frame and a second frame. The computing system may determine first sampling locations for the first frame and determine second sampling locations for the second frame by transforming the first sampling locations to the second frame according to an optical flow between the first frame and the second frame. The computing system may select a subset of the second sampling locations based on a comparison between pixels in the first frame corresponding to the first sampling locations and pixels in the second frame corresponding to the second sampling locations. The computing system may define one or more rejection areas in the second frame based on the subset of the second sampling locations to determine third sampling locations in areas outside of the rejection areas. The computing system may generate a sample of the video.

Abstract: A method of region-based video-image interpolation is provided, which includes the following steps: respectively dividing each image and its subsequent image in an input video signal into first regions and second regions to obtain first regional images and second regional images; performing a motion-compensated frame-interpolation process on the first regional image and the second regional image in the same position in each image and its subsequent image to obtain an interpolated regional image; performing a frame-rate-conversion process on reference images and the interpolated regional images of each first region according to an original frame rate of each first region and a display frame rate of an output video signal to obtain a regional output image of each first region; and superimposing the regional output image generated at each output timestamp by each motion-compensated frame-interpolation circuit to generate an output image of the output video signal.

Abstract: A refresh rate setting apparatus for use in a portable terminal, comprises a first setting unit configured to, when an application program is started, set a refresh rate of a display of the portable terminal to a first refresh rate equal to or higher than 90 Hz; a determination unit configured to determine whether the first refresh rate is an integer multiple of a frame rate of the application program; and a second setting unit configured to, in a case where the determination unit determines that the first refresh rate is not an integer multiple of the frame rate, set the refresh rate to a second refresh rate according to whether values settable as the refresh rate include one or more values each equal to an integer multiple of the frame rate.

Abstract: An object of one embodiment of the present disclosure is to provide a product with a high added value to a user by preventing an erroneous character string from being combined in a case where a voice before and after an image selected from within a moving image is a mixed voice. One embodiment of the present disclosure is an image processing apparatus including: a selection unit configured to select, from a moving image including a plurality of frames, a part of the moving image; an extraction unit configured to extract a voice during a predetermined time corresponding to the selected part in the moving image; and a combination unit configured to combine a character string based on a voice extracted by the extraction unit, with the part of the moving image selected by the selection unit or a frame among frames corresponding to the part.

Abstract: Embodiments of this disclosure provide a video frame interpolation apparatus and method. The method includes calculating a bidirectional optical flow between a first frame and a second frame; an performing kernel and weight estimation according to the first frame and the second frame. An adaptive local convolutional kernel is generated by using a convolutional layer and a weight coefficient is generated by using another convolutional layer. A conversion on the first frame and the second frame is performed by using an adaptive conversion layer according to the bidirectional optical flow, the weight coefficient and the adaptive local convolutional kernel, so as to generate a conversion frame. A frame synthesis on the first frame, the second frame and the conversion frame is performed to generate an interpolation frame between the first frame and the second frame.

Abstract: An imaging apparatus includes at least one processor to implement: a re-sizer configured to re-size an image to a predetermined size, an encoder configured to encode the re-sized image, and a frame rate controller configured to calculate an actual bit rate of the encoded image for a preset period of time, compare a user-set target bit rate with the calculated actual bit rate, adjust a frame rate of the encoded image according to a result of the comparison, and output an encoded image signal at a user-set target bit rate irrespective of a complexity of the encoded image.

Abstract: [Object] To contribute to the achievement of a workflow in which an HDR video and an SDR video are compatible with each other. [Solving Means] This video signal processing apparatus includes an HDR video generation unit including a first converter unit that performs OOTF conversion on an HDR video by using an exponentiation function for calculating an exponentiation of 1.2, where 100% is 1, to an input signal level of the HDR video having a range from a point of 0%, where an expression range of an input signal level of an SDR video is 100%, to a change point optionally determined within a range of 100% to 500%, and by using a linear function for multiplying an input signal level of the HDR video having a range higher than the change point by a predetermined coefficient to maintain a change rate of a calculation result in a portion of the change point calculated by using the exponentiation function.

Abstract: An embodiment of the present invention provides an image processing method based on a convolution internet algorithm, a device, an electronic apparatus and a computer readable storage medium thereof. The method includes: determining a padding radius for each convolution calculation layer; summing the padding radiuses; acquiring an input image of a convolution internet algorithm; padding the input image to acquire a padded image according to the sum; determining a calculation range for each convolution calculation layer; implementing a convolution internet algorithm calculation to the padded image according to each convolution calculation layer; acquiring an output image. Image processing device, electronic apparatus, and computer readable storage medium of a convolution internet algorithm are provided.

Abstract: Systems and methods for implementing temporal filtering are provided. A method includes: applying a temporal filter to a current picture and encoding the current picture after the temporal filter is applied. The applying includes obtaining an exponential function, that includes an exponent with a numerator with at least one first factor and a denominator with at least one second factor, by computing the exponent of the exponential function as fixed-point values or by using at least one lookup table; obtaining a weight of at least one neighboring picture by multiplying a scaling function with the exponential function; obtaining a filtered sample value of the current picture based on a sample value of the current picture and the weight of the at least one neighboring picture; and replacing the sample value of the current picture with the filtered sample value.

Abstract: The present invention discloses a method of injecting additional data in one or more image sensor frames in an image sensor device. The method comprises: providing (801) additional data in the form of a numeric sequence, controlling (802) the lengths of subsequent blanking intervals in one or more image sensor frames to represent the numeric sequence, and transmitting the one or more image sensor frames from the image sensor device. The one or more image sensor frames may be transmitted to an image processor (12, 72). Examples of image processors (12, 72) and a system (1, 7) comprising an image processor (12, 72) are also disclosed.

Abstract: Embodiments of the present disclosure provide a signal processing apparatus and method, a network device and a computer readable storage medium. The apparatus comprises: a receiving unit configured to receive a signal from a remote radio frequency unit (RRH), the RRH being independent from the signal processing apparatus; a processing unit configured to perform signal enhancement on the signal; and a transmitting unit configured to transmit the enhanced signal to a baseband unit (BBU). According to the present disclosure, it is possible to implement a fronthaul or anyhaul solution with a high reliability, and meanwhile save the RF transmission power of the terminal device and reduce the operation costs of the operators.

Abstract: An digital imaging system and method that is provided that is capable of receiving and processing multiple types of image formats. Thus, the system is capable of receiving image signals from multiple types of image sources, such as medical imaging devices, that may each use different image formats, and converting the image format of the received image signals to the image formats required by one or more predetermined devices, such as an image recording device and a display.

Abstract: A data processing system for performing motion estimation in a sequence of frames comprising first and second frames each divided into respective sets of blocks of pixels, the system comprising: a vector generator configured to form motion vector candidates representing mappings of pixels between the first and second frames; and a vector processor configured to, for a search block of the first frame, identify a first motion vector candidate ending in a block of the second frame collocated with the search block and form an output vector for the search block which is substantially parallel to the first motion vector candidate and represents a mapping of pixels from the search block to the second frame.

Abstract: Providing object-oriented-zoom by identifying, in a transmitter, a region-of-interest in a captured video part, communicating to a receiver the video stream, and an identification of the region-of-interest, marking, on a display of the receiver, the region-of-interest over the captured video stream on a screen display, receiving from a selection of the displayed region-of-interest forming a selected object, communicating the selection to the transmitter, dividing the video stream, in the transmitter, into a first part including the selected object, and a second part including at least a part of the captured video stream less the first part, communicating the first and second parts to the receiver, displaying the first and second parts simultaneously, where the first part is displayed in a substantially constant location of a screen display of the receiver, and where the second part is displayed around the first part to fill the screen display of the receiver.

Abstract: A terminal apparatus performs: receiving a first selection operation of selecting a shot image; acquiring a first characteristic amount relating to a shape of at least one of the shot image and an object included in the shot image; acquiring a second characteristic amount relating to a shape of a frame included in each of a plurality of templates; controlling a display to display a selection screen for selecting one template, the selection screen showing, as a particular template, a template including a frame of the second characteristic amount indicative of a shape corresponding to the first characteristic amount such that the particular template is distinguishable from a template other than the particular template; receiving a second selection operation of selecting a selection template on the selection screen; creating a composite image by combining the shot image with a frame included in the selection template; and outputting the composite image.

Abstract: Disclosed is an electronic apparatus. The electronic apparatus includes a memory configured to store a plurality of frames included in an input image and a processor configured to: identify whether one frame of the plurality of frames is a first interpolated frame generated based on at least two frames from remaining frames of the plurality of frames, and select a reference frame to be used in frame interpolation of the plurality of frames based on the first interpolated frame being identified.

Abstract: Methods and systems for recording streaming audio and video by directing an incoming audio-visual stream to a discrete memory region serving as a virtual display. The virtual display is configured with a section visible to the viewer and a section invisible to the viewer, wherein a streaming video is hidden from the user's display under all conditions. The user's browser is pre-loaded with hooks to redirect the video portion of the stream to the invisible section of the virtual memory wherein a video capture tool specifically designed to interact with the hooks can now recognize each function call and intercept each frame as it is rendered in the GPU. Concurrently, the audio portion of the stream is remapped using an audio indexing application. The GPU framebuffers and audio sinks are multiplexed together and saved to disk. The file is immediately accessible for playback or copying.

Abstract: A video super resolution method comprises successively executing instances of a first plurality of layers (SISR) of a neural network for generating a first image (St) at a higher resolution than an input image frame (Xt); successively executing a second plurality of layers (VSR) of the neural network for generating a second image (Vt) at the higher resolution, at least one of the second plurality of layers generating intermediate output information (Ht), the second plurality of layers taking into account an output image (Yt?1) at the higher resolution generated by a previous instance of the network from a previous input image frame (Xt?1) and intermediate output information (Ht?1) generated by the second plurality of layers of the previous instance, and executing a third plurality of layers for combining the first (St) and second (Vt) images to produce an output image (Yt) for the instance of the network.

Abstract: A motion detection method includes acquiring a raw image, detecting a motion object image according to the raw image by using a motion detector, cropping the raw image to generate a sub-image according to the motion object image, and inputting the sub-image to a processor for determining if a motion object of the sub-image matches with a detection category. The processor includes a neural network. The shape of the sub-image is a polygonal shape.

Abstract: A device and method for automatic image enhancement in vehicles, in particular land vehicles, including a camera to record a primary-image, and an image-processing-module to determine a resulting-image from the primary-image.

Abstract: The present disclosure relates to an image processing apparatus and an image processing method capable of storing auxiliary information in CbCr components in a YCbCr format. The image processing apparatus includes a receiving section that receives depth image data in which a depth image transmitted together with a texture image is stored in a Y component in a YCbCr format and auxiliary information is stored in CbCr components in the YCbCr format, and an auxiliary information utilization section that executes a predetermined image process using the auxiliary information on at least one of the texture image or the depth image. A value that can be taken on by the auxiliary information for each pixel of the texture image has N patterns, and a gradation value out of N×N gradation values into which a combination of the auxiliary information regarding two pixels is converted is stored in the CbCr components.

Abstract: A display device includes a display panel including gate lines, data lines, and pixels connected to the gate lines and the data lines and a driving circuit which controls the display panel in response to an image signal, a control signal, and a mode signal from an outside to display an image through the display panel. The driving circuit converts the image signal to data voltage signals corresponding to a first gamma curve to apply the data voltage signals to the data lines when the mode signal represents a normal mode and converts the image signal to data voltage signals corresponding to a second gamma curve different from the first gamma curve to apply the data voltage signals to the data lines when the mode signal represents a frequency variable mode.

Abstract: The display driver includes control circuitry and signal supply circuitry. The control circuitry is configured to store a first setting table for a first frame rate and a second setting table for a second frame rate. The control circuitry is further configured to, in response to adjusting a frame rate of a display device from the first frame rate to the second frame rate, generate an interpolated control parameter through interpolation of a first control parameter obtained from the first setting table and a second control parameter obtained from the second setting table. The signal supply circuitry is configured to generate at least one first signal to be supplied to a display panel based on the interpolated control parameter.

Abstract: An imaging system comprises a rolling shutter sensor that captures images of a scene, an illumination source that continuously illuminates the scene, a time-varying illumination source that illuminates the scene, and a processor that receives the images from the rolling shutter sensor. The rolling shutter sensor and the time-varying illumination source are operated synchronously to cause: on-cadence lines of the rolling shutter sensor to receive illumination from the continuously illuminating illumination source and a first amount of illumination from the time-varying illumination source; and off-cadence lines of the rolling shutter sensor to receive the illumination from the continuously illuminating illumination source and a second amount of illumination from the time-varying illumination source.

Abstract: A system and method for an HMD system including an HMD and a computing device. The computing device to render an image for the HMD, and transfer the image to the HMD without inactive pixels of the image. The inactive pixels include pixels outside of a viewable area of the image.

Abstract: An image processing device includes one or more processors configured to: generate a high-resolution combined image by aligning the plurality of images with each other in a high-resolution image space based on an amount of displacement between the plurality of images, and combining the plurality of images; generate at least two low-resolution combined images by generating at least two groups each composed of at least two images by dividing the plurality of images in the time direction, aligning the at least two images in each of the groups with each other in a low-resolution image space based on the amount of displacement, and combining the at least two images through weighted addition; calculate, in each region, a feature quantity pertaining to a correlation between the generated at least two low-resolution combined images; and correct the high-resolution combined image based on the calculated feature quantity.

Abstract: Methods and systems for reconstructing a high frame rate high resolution video in a Bayer domain, when an imaging device is set in a Flexible Sub-Sampled Readout (FSR) mode are described. A method provides the FSR mode, which utilizes a multiparty FSR mechanism to spatially and temporally sample the full frame Bayer data. The multi parity FSR utilizes a zigzag sampling that assists reconstruction of motion compensated artifact free high frame rate high resolution video with full frame size. The method includes reconstructing the high frame rate high resolution video using the plurality of parity fields generated. The reconstruction is based on a FSR reconstruction mechanism that can be a pre-Image Signal Processor (ISP) FSR reconstruction or a post-ISP FSP reconstruction based on bandwidth capacity of an ISP used by the imaging device.

Abstract: A method is implemented at an electronic device for displaying output from an application. The electronic device includes a display module and an application. The application sends to the display module a request to display output on the fixed orientation display. The display module determines whether the application is able to scale the output from the application to fit the fixed orientation display. In accordance with a determination that the application is able to scale the output, the electronic device causes the application to receive information concerning the fixed orientation display from the display module and scale the output for display on the fixed orientation display according to the information. In accordance with a determination that the application is not able to scale the output, the display module scales the output received from the application, thereby enabling the output of the application to be displayed on the fixed orientation display.

Abstract: Systems and methods are disclosed herein for generating for display a notification to a plurality of users at a position within a display screen to which each user of the plurality of users is paying attention. Specifically, the media guidance application captures lines of sight of users who are paying attention to a display screen, based on which the media guidance application determines line-of-sight regions on the display screen that the users are paying attention to. The media guidance application then determines a display area that is noticeable to the users based on the respective line-of-sight regions on the display screen to display an electronic message.

Abstract: Apparatus, systems, articles of manufacture, and methods for processing video in virtual reality environments are disclosed. An example virtual reality display device to process video in a virtual reality environment includes a video analyzer to detect unsmooth video data in the stream of video data and a video library to provide alternative video data. The example device also includes a selector to receive the stream of video data, an indication of the unsmooth video data, and the alternative video data. The selector is to select the alternative video data to replace the unsmooth video data based on the indication of the unsmooth video data and output a modified stream of video data including the stream of video data with the alternative video data in place of the unsmooth video data. The example device also includes an output display to display the modified stream of video data.

Abstract: A fault tolerant video streaming distribution service utilizes multiple distribution servers to receive and process a video stream simultaneously. Each distribution server performs a mapping of each encoded timestamp associated with a transport stream having time discontinuities to a continuous time sequence. The distribution servers coordinate the timestamp mapping through a distributed leader election protocol that elects a leader to coordinate the timestamp mapping in an environment where failures are anticipated and the number of distribution servers dynamically changes without notice.

Abstract: A computer-based method for rendering modified graphical content is disclosed. The graphical content includes a plurality of cells. The method includes receiving the graphical content with metadata modifying the graphical content, rendering the graphical content upon a screen according to the metadata, and receiving user input. The method also includes in response to the user input, progressing through at least a subset of the cells, wherein the progressing includes moving a camera view from cell to cell in the at least a subset, each of the cells in the at least a subset being displayed as a focus point with surrounding area being adjusted in opacity according to the metadata.

Abstract: A video processing method for a video processing circuit includes receiving a first video source corresponding to a first pixel rate and a second video source corresponding to a second pixel rate, wherein a processing data rate of a video processing path is greater than or equal to a sum of the first pixel rate and the second pixel rate. The method further includes using the processing data rate to sequentially perform an image processing to a first image of the first video source and a second image of the second video source corresponding to the same display time, to generate a first processed image and a second processed image.

Abstract: A system for decoding a video bitstream includes receiving a frame of the video that includes at least one slice and at least one tile and where each of the at least one slice and the at least one tile are not all aligned with one another.

Abstract: Methods for encoding and decoding high-dynamic range signals are presented. The signals are encoded in a high frame rate and are accompanied by frame-rate conversion metadata defining a preferred set of frame-rate down-conversion parameters, which are determined according to the maximum luminance of a target display, display playback priority modes, or judder control modes. A decoder uses the frame-rate conversion metadata to apply frame-rate down-conversion to the input high-frame-rate signal according to at least the maximum luminance of the target display and/or the characteristics of the signal itself. Frame-based and pixel-based frame-rate conversions, and judder models for judder control via metadata are also discussed.

Abstract: A control circuit according to an embodiment of the disclosure performs control of active matrix driving by a field inversion driving method to cause a vertical effective display period in one field period to be close to a start time of the one field period upon observation of a waveform of a signal outputted from the control circuit with display resolution of 200 ?sec or display resolution lower than display resolution of 200 ?sec. The one field period is defined by a vertical start signal.

Abstract: Coding a current block using a directional intra-prediction mode is described. A filter to apply to reference pixels peripheral to the current block is determined using a prediction angle of the intra-prediction mode and a size of the current block. The reference pixels are filtered using the filter to generate modified reference pixels, and a prediction block is generated for the current block using the intra-prediction mode and the modified reference pixels.

Abstract: A video interface conversion apparatus comprises a video interface circuit, a video clock adjustment information generation circuit and a video clock recovery circuit. The video interface circuit generates at least one original synchronization signal according to a control signal, and fetches video data from a data signal according to a video synchronization signal. The video clock adjustment information generation circuit generates video clock adjustment information and the video synchronization signal according to the original video synchronization signal and a video clock. The video clock recovery circuit receives an original clock and the video clock adjustment information, and recovers the video clock by adjusting the original clock according to the video clock adjustment information.

Abstract: An image display device includes a plurality of signal input parts, a plurality of sub-controllers configured to process video signals from a plurality of signal input parts, and a controller configured to generate a display screen to be displayed on a display. The controller obtains the timing information for a video signal from the sub-controller based on the display information installed in advance.

Abstract: Embodiments are disclosed for a stereoscopic device (also referred to simply as the “device”) that captures three-dimensional (3D) images and videos with a wide field of view and provides a virtual reality (VR) experience by immersing a user in a simulated environment using the captured 3D images or videos.

Abstract: A method and apparatus for encoding three-dimensional (“3D”) video includes receiving a left-eye interlaced frame and a corresponding right-eye interlaced frame of a 3D video. An amount of interlacing exhibited by at least one of the left-eye interlaced frame and the corresponding right-eye interlaced frame is determined. A frame packing format to be used for packing the left-eye interlaced frame and the corresponding right-eye interlaced frame into a 3D frame is selected based on the amount of interlacing that is determined. The left-eye interlaced frame and the corresponding right-eye interlaced frame are formatted into a 3D frame using the selected frame packing format. Illustrative frame packing formats that may be employed include a side-by-side format and a top-and-bottom format.