Abstract: A generation apparatus that generates a virtual viewpoint image based on a plurality of captured images obtained by a plurality of cameras and virtual viewpoint information, and includes: a generation unit configured to generate a virtual viewpoint image by a generation method determined from a plurality of generation methods for generating a virtual viewpoint image: a changing unit configured to change the generation method for generating a virtual viewpoint image from a first generation method to a second generation method; and a control unit configured to perform control to restrain a change of the generation method by the changing unit.

Abstract: Disclosed are an image data access control apparatus for a vehicle and a method thereof. The image data access control apparatus for a vehicle includes storage that stores image data of the vehicle, a communicator that communicates with a user device, an authentication processor that authenticates the user device, and a controller that determines whether the user device can have access to the image data based on an authentication result of the authentication processor.

Abstract: The invention relates to displaying an autostereoscopic image of two viewpoints, each formed of strips of subpixels, called image strips, on an autostereoscopic display screen configured to display N viewpoints, N being greater than or equal to 3. The method includes detecting the position of a privileged observer relative to the screen; determining, for each eye of the observer, strips of the screen visible by the eye at the detected position; determining, for each eye of the observer, strips that are not visible by either of the two eyes at the position; an assignment to the subpixels, of the visible strips of the screen for each eye, of subpixels corresponding to the image strip of the corresponding eye; an assignment to the subpixels, of the non-visible strips of the screen, of subpixels corresponding to safety viewpoints constructed from subpixels of the image strips.

Abstract: A method of controlling residual coding for decoding or encoding of a video sequence, is performed by at least one processor and includes determining whether a secondary transform is used, based on a primary transform that is set. The method further includes, based on the secondary transform being determined to be used setting a flag indicating whether the secondary transform is used to indicate that the secondary transform is used, determining the secondary transform, based on the set primary transform and an intra prediction mode of a current block of the video sequence, and performing the residual coding of a luma coding block of the current block and a chroma coding block of the current block, using the set primary transform and the determined secondary transform.

Abstract: The present disclosure provides systems and methods that leverage machine-learned models (e.g., neural networks) to provide video frame synthesis. In particular, the systems and methods of the present disclosure can include or otherwise leverage a machine-learned video frame synthesis model to allow for video frames to be synthesized from videos. In one particular example, the video frame synthesis model can include a convolutional neural network having a voxel flow layer and provides one or more synthesized video frames as part of slow-motion video.

Abstract: The disclosure provides an approach for mimicking human camera operation with an autonomous camera system. In one embodiment, camera planning is formulated as a supervised regression problem in which an automatic broadcasting application receives one video input captured by a human-operated camera and another video input captured by a stationary camera with a wider field of view. The automatic broadcasting application extracts feature vectors and pan-tilt-zoom states from the stationary camera and the human-operated camera, respectively, and learns a regressor which takes as input such feature vectors and outputs pan-tilt-zoom settings predictive of what the human camera operator would choose. The automatic broadcasting application may then apply the learned regressor on newly captured video to obtain planned pan-tilt-zoom settings and control an autonomous camera to achieve the planned settings to record videos which resemble the work of a human operator in similar situations.

Abstract: A tracking method for a video surveillance system includes: obtaining identification information for a first target object uploaded by a positioning system; obtaining time information and location information for the positioning system at the time the positioning system uploads the identification information; storing the identification information, the location information, and the time information in a preset database to obtain a storage result; and generating tracking information for the first target object according to the storage result.

Abstract: A method of decoding video data includes receiving a block of video data, determining an intra prediction mode for the block of video data, and determining whether or not to use a position-dependent prediction combination (PDPC) mode to decode the block of video data based at least on the determined intra prediction mode. The method may also include receiving a syntax element associated with a primary transform or a secondary transform used for a block of video data, determining a usage of one or more video coding tools based on a value of the syntax element, the one or more video coding tools being video coding techniques other than the primary transform or secondary transform, and applying the one or more coding tools to the block of video data based on the determined usage.

Abstract: An image processing system, an image generation apparatus, and an image generation method are provided. The image processing system includes a switching unit configured to switch an operating mode of the image processing system between at least a first mode and a second mode, a detection unit configured to detect a joining position among a plurality of input images to generate a detection result, and a joining unit configured to join the plurality of input images to generate an output image. When the mode is switched to the first mode, the joining unit joins the plurality of input images based on the detection result of the detection unit to generate the output image. When the mode is switched to the second mode, the joining unit joins the plurality of input images to generate the output image, without causing the detection unit to generate the detection result.

Abstract: A system for a motor vehicle for use by a driver of the vehicle to view the surroundings of the vehicle, while driving the vehicle has a system of digital cameras, a computer processor, a memory and a display screen. The processor receives inputs from the system of cameras where the inputs have a sequence of images representing views of surroundings of the vehicle and temporarily saves the images in the memory. The processor processes the series of images to create composite views of the surroundings and displays the composite views on the display screen.

Abstract: Methods for performing motion estimation in multiple reference frames scenario are disclosed. The method includes considering a motion vector of a plurality of neighbouring macro blocks present in a current frame and a co-located frame to find a best prediction point motion vector set, scaling at least one motion vector in a plurality of prediction frames and a plurality of bidirectional frames to find a predictive motion vector set by calculating a temporal distance between a nth reference frame and a reference frame referred by an input motion vector and finding at least one best prediction point motion vector of the nth reference frame from a set of motion vectors by utilizing a cost based motion search. The cost based motion search comprising finding a prediction motion vector, finding a cost factor, performing a cost based motion search of at least one partition level to find the best motion vector from the set of motion vectors.

Abstract: Systems, methods, and computer-readable media to improve multi-image color-refinement operations are disclosed for refining color differences between images in a multi-image camera system with application to disparity estimation. Recognizing that corresponding pixels between two (or more) images of a scene should have not only the same spatial location, but the same color, can be used to improve the spatial alignment of two (or more) such images and the generation of improved disparity maps. After making an initial disparity estimation and using it to align the images, colors in one image may be refined toward that of another image. (The image being color corrected may be either the reference image or the image(s) being registered with the reference image.) Repeating this process in an iterative manner allows improved spatial alignment between the images and the generation of superior disparity maps between the two (or more) images.

Abstract: System and method of mapping multiple reference frame motion estimation on a multi core digital signal processor is disclosed. The method includes considering at least one motion vector of a plurality of neighbouring macro blocks present in a current frame and a co-located frame to find a best prediction point motion vector set, collecting a best data block among a plurality of data blocks from a plurality of reference frames according to a plurality of sets of motion vectors at a first pipeline stage, transmitting a data searched related to the plurality of sets of motion vectors from the second level of memory to a first level of memory of a second digital signal processor at a second pipeline stage and finding a best motion vector by utilizing a cost based search on the second digital signal processor is performed at third pipeline stage.

Abstract: An apparatus includes a first lens and first image sensor, a second lens and second image sensor, a first motion sensor, a second motion sensor, and a processor. The first image sensor may be configured to capture a first video image stream of a first field of view (FOV). The second image sensor may be configured to capture a second video image stream of a second FOV. The first motion sensor may be configured to detect motion in the first FOV. The second motion sensor may be configured to detect motion in the second FOV. The processor is generally coupled to the first image sensor, the first motion sensor, the second image sensor, and the second motion sensor, and configured to generate a third video image stream in response to one or more of the first video image stream and the second video image stream.

Abstract: An image transmission apparatus includes an imaging device, wireless communication equipment and at least one processor. The processor determines whether the wireless communication equipment is able to complete transmission of a first frame image within a transmission period corresponding to a first imaging cycle. The processor controls the wireless communication equipment to continue transmission of the first frame image in a transmission period of a second frame image output from the imaging device in a second imaging cycle when the processor determines that the wireless communication equipment is not able to complete transmission of the first frame image.

Abstract: The present invention relates to a system and method of inserting a secondary stream of digital frames into a primary stream of digital frames without transcoding any of the streams, where the primary stream is encoded according to a first format and the secondary stream is encoded according to a second format where each frame is independent of a succeeding frame. The approach comprises receiving a requested splice-out point in the primary stream; determining an optimal splice-out point in the primary stream in dependence upon the requested splice-out point; receiving a requested splice-in point in the primary stream; determining an optimal splice-in point in the primary stream in dependence upon the requested splice-out point; and replacing the section of the primary stream between the optimal splice-out point and the optimal splice-in point with the secondary stream.

Abstract: A driving recorder includes: an image data acquisition unit; an extraction unit; a determination unit; and a writing controller. The writing controller configured to write, when the determination unit has determined that a change in the other vehicle does not coincide with a predetermined reference change, the image data into a memory by a ring buffer form, and write, when the determination unit has determined that the change coincides with the predetermined reference change, the image data for a predetermined period of time including the plurality of pieces of image data regarding which the determination has been made in such a way that the image data is not overwritten by other data.

Abstract: A vehicle occupant detection system for a transportation vehicle includes an infrared camera mounted in the vehicle for sensing persons therein. The infrared camera provides a camera signal to an electronic controller. The electronic controller is configured to process the camera signal to determine a number of persons disposed in the transportation vehicle, compare the number of persons to a number stored in memory and provide a number signal to a display for displaying the number of available seats in the transportation vehicle. The infrared camera can be a passive infrared camera that senses thermal images.

Abstract: This application provides a photographing method and a control device, and relate to the field of communications. The photographing method comprises: a shutter triggering step of triggering a virtual shutter according to a first input instruction of a user; an information recording step of recording photographing related information at a moment of triggering the virtual shutter; a request sending step of sending a photo obtaining request to a server, where the photo obtaining request comprises the photographing related information; and a photo obtaining step of receiving at least one photo provided by the server according to the photo obtaining request. The photographing method and the control device provide convenience for a user to photograph and obtain an interested photo from a photo library, so as to improve user experience.

Abstract: An image device for generating panoramic depth images includes at least two image capturing groups. Each image capturing group of the at least two image capturing groups includes at least three image capturers. A size of each image capturer of the at least three image capturers is a first length, a distance between two adjacent capturing devices of the at least three image capturers is a second length, and a ratio of the second length to the first length is not less than a predetermined value. Depths of at least three depth maps corresponding to the at least two image capturing groups are applied to generating a panoramic depth image.