Abstract: Provided are a method and device for video coding, video decoding and storage medium. The video coding method includes: classifying video frames into independent frames and dependent frames, which comprise a first type of the dependent frames; generating region wise packing (RWP) coding configuration of each of the independent frames by coding parameters of the respective one of the independent frames, wherein the RWP coding configuration of the independent frames comprises the parameters to be unpacked to restore the video; and for each of the first type of the dependent frames, generating RWP coding configuration of the dependent frame by coding parameters of the dependent frame based on difference and dependency between the parameters of the dependent frame and the parameters of an independent frame used as a reference for the coding of the dependent frame.

Abstract: Examples described herein generally relate to systems and method for streaming a video game at a client device. The client device may transmit video game controls to a streaming server. The client device may receive a video stream encoding video images generated in response to the video game controls from the streaming server. The client device may determine that a video image of the video stream to display in a frame has not been completely received at a designated time prior to display of the frame. The client device may determine an image transformation based on a history of the video images and motion vectors for the video stream. The client device may apply the image transformation to a portion of one or more images corresponding to previous frames. The client device may display a substitute video image in the frame including the portion of the transformed image.

Abstract: Glasses with gesture recognition function include a glasses frame and a gesture recognition system. The gesture recognition system is disposed on the glasses frame and configured to detect hand gestures in front of the glasses thereby generating a control command. The gesture recognition system transmits the control command to an electronic device to correspondingly control the electronic device.

Abstract: In a method or system in which an imaging element views navigation elements for e.g. navigation, the navigating elements may not be positioned optimally. Positions may exist in which the same angles exist from the imaging element to the same or similar navigating elements, whereby the positions are not unique. Navigation elements may then be repositioned, added or removed to make the positions unique.

Abstract: Embodiments of the present disclosure provide interaction methods and devices. The method can include obtaining a display object comprising a plurality of collage pictures for display; acquiring, in response to a switch operation for at least one collage picture of the plurality of collage pictures of the display object, a first target collage picture, wherein a first target content type of the first target collage picture matches a content type of the at least one collage picture; and replacing the at least one collage picture with the first target collage picture.

Abstract: A method for constructing and implementing a small cell is disclosed herein. The method includes capturing data and developing a model of the small cell; obtaining and validating a bill of materials for the small cell; identifying type, quantity, and location of materials for acquisition; coordinating utilities for the small cell with utility providers; and developing a project plan for the small cell and including with the model.

Abstract: An electronic device mounted on a fixed or a movable apparatus is provided. The electronic device may comprise a neural processing unit (NPU), including a plurality of processing elements (PEs), configured to process an operation of an artificial neural network model trained to detect or track at least one object and output an inference result based on at least one image acquired from at least one camera; and a signal generator generating a signal applicable to the at least one camera.

Abstract: Methods, devices and systems are disclosed for improved depth perception in stereoscopic night vision devices. Among these are embodiments for aligning information overlays in the stereo view with associated objects, and for generating stereo information from single lenses or intensifiers. In some illustrative embodiments, a camera and position sensor are provided for at least two viewers, e.g., a pilot and a copilot, such that when a scene overlaps between viewers, the system produces a stereoptic scene, in which the users can more accurately determine a difference in depth between two or more distant objects. An illustrative binocular night vision system uses a high-resolution depth map to present binocular images to a user. In some embodiments, supplementary content can be overlaid, with an appropriate binocular disparity that is based on the depth map.

Abstract: Systems and methods described herein provide for monitoring of video streaming events. Techniques disclosed include rendering a first omnidirectional video associated with a first viewpoint. In response to a request to access an omnidirectional video associated with another viewpoint, a time of the request and information identifying the other viewpoint is recorded. Techniques disclosed also include identifying a time of switching into rendering of a second omnidirectional video associated with a second viewpoint, and reporting a viewpoint switching latency, representing a difference between the identified switching time and a recorded request time associated with information identifying the second viewpoint.

Abstract: One or more techniques for managing virtual objects between one or more displays are described. In accordance with some embodiments, exemplary techniques for displaying a virtual object are described.

Abstract: A method of decoding an image, includes obtaining at least one offset for a picture, deriving a variable for scaling for the picture based on the at least one offset, and performing inter prediction based on the variable for scaling for the picture. The at least one offset is defined with a direction of scaling.

Abstract: A learning device, an image generating device, a learning method, an image generating method, and a program are provided which can improve accuracy of estimation of an environment outside an angle of view of an image input to an image generating section. A second learning data obtaining section (64) obtains an input image. A second learning section (66) obtains result data indicating a result of execution of semantic segmentation on the input image. An input data generating section (38) generates input data obtained by coupling the input image and the result data to each other. By using the input data as input, the second learning section (66) performs learning of a wide view angle image generating section (28) that generates, in response to input of data obtained by coupling an image to a result of execution of semantic segmentation on the image, an image having a wider angle of view than the image.

Abstract: Embodiments are generally directed to selective packing of patches for immersive video. An embodiment of a processing system includes one or more processor cores; and a memory to store data for immersive video, the data including a plurality of patches for multiple projection directions. The system is select the patches for packing, the selection of the patches based at least in part on which of the multiple projection directions is associated with each of the patches. The system is to encode the patches into one or more coded pictures according to the selection of the patches.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, are described for performing privacy-aware surveillance with a security camera drone. The drone obtains image data using an imaging device and processes the image data to detect an object external to the drone. In response to processing the image data, the drone determines multiple viewing angles indicated in the image data with respect to the object. Based on the image data and the multiple viewing angles, a first section of the area for surveillance and a second, different section of the area to be excluded from surveillance are identified. The drone determines an adjustment to at least one of the multiple viewing angles to cause the second section to be excluded from surveillance. Based on the adjustment, the drone controls the imaging device to exclude the second section from surveillance imagery obtained by the drone.

Abstract: There are provided an apparatus and a method for generating a panorama image. The apparatus includes: a Region Of Interest (ROI) selecting block for receiving a plurality of images, and outputting ROI images by selecting an ROI of each of the plurality of images; a High Dynamic Range (HDR) processing block for performing HDR processing on the ROI images; and a panorama image generating block for generating a panorama image by stitching the plurality of images using a matching coordinate of the ROI images on which the HDR processing is performed. The HDR processing block performs the HDR processing on the panorama image.

Abstract: Various embodiments are generally directed to techniques for receiving first video data comprising one or more frames having a scene with a person and perform a facial detection process on the first video data to detect a facial region in each frame having the scene with the person. Embodiments also include generating second video data from the first video data, the second video data to include a blurring effect applied to the facial region detected in the first video data, providing the second video data for display on one or more devices, and receiving a tag indication from at least one of the one or more devices, the tag indication to indicate a portion of the second video data having suspicious activity.

Abstract: A portable remote controlled video production apparatus and method are provided, as is a teleprompter/Interrotron integrated with a camera. A computer is mounted in a rigid cage, the computer having a local portion of remote access remote control software. A camera is fixedly mounted in the cage in communication with the computer; either the camera or the computer have camera control software running thereon. A monitor is fixedly mounted in the cage in front of the camera and parallel to the lens axis; the monitor is in communication with the computer. A beamsplitter is fixedly mounted in the cage in front of the lens reflecting light from the monitor towards a front of the cage. The camera and computer are controllable remotely via a remote portion of the remote access remote control software running on a remote computer communicating with the local portion of the remote access remote control software.

Abstract: The present disclosure provides a terminal, a photographing method, a storage medium, and an electronic device. The terminal comprises a housing, a display panel, and a camera, wherein the camera is provided inside the terminal, and is located behind a gap formed by the display panel and the housing. A driving assembly is provided inside the terminal, and is connected to the camera, for driving the camera to rotate.

Abstract: A method of rendering geometry of a 3D scene for display on a non-standard projection display projects geometry of the 3D scene into a 2D projection plane, wherein image regions are defined in the projection plane, maps the geometry from the projection plane into an image space using transformations, wherein a respective transformation is defined for each image region, and renders the geometry in the image space to determine image values of an image to be displayed on the non-standard projection display. The transformations are configured for mapping the geometry into the image space so as to counteract distortion introduced by an optical arrangement of the non-standard projection display.

Abstract: Methods and apparatus for shear correction in spherical projections. Embedded devices generally lack the compute and/or memory resources to implement two-dimensional (2D) stitches for spherical projections. Objects (such as a mounting fixture) within a certain distance of the camera may experience a 2D “tear” or “shear” artifact when stitched. Various embodiments of the present disclosure perform two orthogonal 1D stitches: (i) latitudinally across the meridian and (ii) longitudinally along the meridian to approximate the effect of a 2D stitch. Notably, the 1D stitch may be less precise than a true 2D stitch, however the image portion being stitched (e.g., the camera mount) is not the user's subject of interest and can be rendered much more loosely without adverse consequence. Temporal smoothing optimizations are additionally disclosed.

Abstract: A method for scheduling construction of a power plant at a telecommunications site is disclosed. The method includes assessing the telecommunication site and the power plant. The method also includes obtaining data from the location utilizing one or more data capture techniques. The method also includes generating a model of the existing infrastructure and a model of the power plant and inserting the model of the power plant therein. The method further includes developing a draft schedule. The method also includes publishing the final schedule with the model of the power plant inserted into the model of the existing infrastructure.

Abstract: A method for decoding a 360-degree image includes: receiving a bitstream obtained by encoding a 360-degree image; generating a prediction image by making reference to syntax information obtained from the received bitstream; combining the generated prediction image with a residual image obtained by dequantizing and inverse-transforming the bitstream, so as to obtain a decoded image; and reconstructing the decoded image into a 360-degree image according to a projection format. Here, generating the prediction image includes: checking, from the syntax information, prediction mode accuracy for a current block to be decoded; determining whether the checked prediction mode accuracy corresponds to most probable mode (MPM) information obtained from the syntax information; and when the checked prediction mode accuracy does not correspond to the MPM information, reconfiguring the MPM information according to the prediction mode accuracy for the current block.

Abstract: A method for preparing and vetting a power plant for implementation at a telecommunications site is disclosed. The method includes assessing the power plant and a location for the power plant at the telecommunications site. The method also includes obtaining data from the location utilizing one or more data capture techniques, the one or more data capture techniques including capturing one or more of photos and videos of existing infrastructure at the telecommunications site. The method further includes generating one of a 360 degree view and a model of the existing infrastructure. The method also includes identifying installation obstacles and flaws utilizing the model including the conditions of the existing infrastructure selected to receive and interface with the power plant. The method further includes re-designing the power plant installation based on the obstacles and flaws identified. The method also includes developing a project plan for the power plant installation.

Abstract: An electronic mirror system presents circumstances surrounding a moving vehicle by displaying an image presenting the circumstances surrounding the moving vehicle. The electronic mirror system includes an image display and an optical system. The image display displays, every time image data is acquired from an image capturing unit, the image, based on the image data acquired from the image capturing unit, on a display screen. The image capturing unit continuously shoots video presenting the circumstances surrounding the moving vehicle. The optical system condenses, into an eye box, a light beam representing the image displayed on the display screen to make a user, who has a viewpoint inside the eye box, view a virtual image based on the image displayed on the display screen. The display screen is arranged to be tilted with respect to an optical path that leads from the display screen to the optical system (30).

Abstract: A panoramic camera is provided with an orientation sensor to record orientation along with a panoramic image. The display or print image is selected from the captured panoramic image, a warped, non-scale-correct image. The selection of the display image is done using the orientation sensor. The orientation sensor data can be recorded with the panoramic image as metadata. The orientation sensor can also be used to control an external display and/or panoramic image selection during browsing.

Abstract: A stereoscopic display device and a display method thereof are provided. The stereoscopic display device includes a display panel, a lens array, an image sensor, and a processing circuit. The display panel displays a three-dimensional image. The lens array is disposed on a transmission path of the three-dimensional image. The image sensor acquires a sensed image of a viewing field of the display panel. The processing circuit is coupled to the lens array and the image sensor. The processing circuit calculates an actual eye position of a user in the viewing field according to reference coordinates of a reference position in the sensed image and eye coordinates of the user in the sensed image. The processing circuit adjusts a liquid crystal rotation angle of the lens array according to the actual eye position, so that a viewing position of the three-dimensional image matches the actual eye position.

Abstract: A portable stereoscopic image capturing camera of the present invention comprises: a case including an opening; a plurality of lenses disposed in a line at a first interval within the case; and a driving module for rotating each of the lenses, wherein the driving module includes a rotating body combined with the lens to rotate the lens, and rotates each of the lenses toward a subject to form a projection intersection point.

Abstract: An image management system includes a reception unit and transmission unit. The reception unit receives, from a first communication terminal, link information that is transmitted from the image management system and is managed in a link information management system. The transmission unit transmits, to the first communication terminal, a view script and image data corresponding to the link information. The image data is received from a second communication terminal.

Abstract: A system or method for imaging a panorama view may include a physical writing surface, a camera capturing the panorama view, and a sensor identifying a bearing of interest within the view. The system may maintain a coordinate map of the view, adjust an aspect ratio of the view, and generate a scaled panorama view based on the adjusted aspect ratio. The system may determine a coordinate of a designated view based on coordinate instructions and may generate a designated view signal based on the determined coordinate of the designated view comprising at least a portion of the physical writing surface. The system may composite a video signal including one or more of the scaled panorama view signal, a stage view signal, or the designated view signal, and may transmit the composite video signal.

Abstract: An object detection apparatus includes a first camera unit, a second camera unit, and a control unit. The first camera unit includes one or more cameras, and is configured to capture an image around a vehicle. The second camera unit includes one or more cameras, and is configured to capture an image of an area ahead of the vehicle. The control unit is configured to: determine a displacement of a feature point positioned in a common area from the image acquired via the first camera unit; determine a pixel displacement of the feature point in the image acquired via the second camera unit; and determine distance information to an object recognized in the image captured via the second camera unit based on the displacement of the feature point and the pixel displacement of the feature point.

Abstract: The disclosure provide methods and content consumption devices that enable a scene, for example a 360° scene, that is larger (i.e. has more pixels in at least one dimension) than a display format of the content consumption device to be displayed. Constituent scene views are received individually by the content consumption device, for example as broadcasts, and are combined, for example stitched together, at the content consumption device to output a part of the scene that fits in the display format. The part of the scene (and hence the required constituent streams) to be displayed are determined by a signal, for example a navigational input from a user, enabling the user to navigate in the scene.

Abstract: Video information and sensor information may be obtained. The video information may define spherical video content having a progress length. The spherical video content may define visual content viewable from a point a view as a function of progress through the progress length of the spherical video content. The spherical video content may be captured by one or more image capture devices. The sensor information may characterize capture of the spherical video content. A viewing direction for the spherical video content may be determined based on the sensor information and/or other information. The viewing direction may define a direction of view for the spherical video content from the point of view as the function of progress through the progress length of the spherical video content. The spherical video content may be presented on a display based on the viewing direction.

Abstract: A system that has a plurality of monitors, a control unit, a first object and a second object is provided. The second object has one or more sensors operable to generate data and is remote from the first object. The control unit is configured to determine whether a first user is positioned on a first or on a second location of the first object and display a simulation of a second user onto the plurality of monitors based on the generated data. The second user is located remote from the first user and is displayed as being positioned in a different location on the first object than the first user on the first object. The control unit is further configured to activate the one or more heat generating devices to simulate a presence of the second user being positioned in the different location on the first object.

Abstract: A method is provided. The method includes: generating a tracking plane image of a next video frame by using reference polar coordinates of a central position of a play plane image of a current video frame as a center based on a panoramic image of the next video frame in a spherical polar coordinate system; determining updated polar coordinates of a central position of a target object in the tracking plane image of the next video frame in the spherical polar coordinate system based on an object feature of the target object; and using the updated polar coordinates as the reference polar coordinates to re-perform the generating a tracking plane image of a next video frame by using reference polar coordinates as a center based on a panoramic image of the next video frame in a spherical polar coordinate system.

Abstract: A learning device includes one or more processors. The processors acquire input data and a target label indicating a correct answer of inference based on the input data. The processors add noise to at least one of the input data and intermediate layer data of the neural network and perform inference by the neural network with respect to the input data. The noise is based on contributions of a plurality of elements included in the input data with respect to an inference result when the input data is input to a neural network. The processors update parameters of the neural network so that the inference result by the neural network matches the target label.

Abstract: A system and method for tracking the movement of a recording device to form a composite image is provided. The system has a user device with a sensor array capturing motion data and velocity vector data of the recording device when the recording device is in motion, an attachment member for coupling the user device to the motion capturing device, and a server with program modules. The program modules described are a calibration module for calibrating a position of the user device relative to a position of a lens of the recording device, a recorder module for receiving the motion data and velocity vector data from the sensor array; and a conversion module for combining the position of the user device relative to the lens of the recording device, and the motion data and velocity vector data and transforming the data into a file that is usable by a compositing suite, a three-dimensional application, or both.

Abstract: Provided are a method and an apparatus for streaming a multi-view 360 degree video, and a method for streaming a 360 degree video according to an embodiment of the present disclosure includes: encoding a multi-view video to a bitstream of a base layer and a bitstream of a tile layer constituted by at least one tile; selecting a tile included in a user view video in the encoded bitstream of the tile layer by using user view information received from a 360 degree video rendering apparatus, and video information of the multi-view video; extracting tile data included in the selected user view video from the encoded bitstream of the tile layer, and generating a tile bitstream corresponding to the extracted tile data; and transmitting the encoded bitstream of the base layer and the generated tile bitstream to the 360 degree video rendering apparatus.

Abstract: Systems, apparatuses, and methods are described herein for a communication bus that virtualizes physiological data. Sensors and/or physiological data acquisition devices have different physical connectors which provide physiological data from a patient to a shared interface such as a display or patient monitor. A transfer interface within a mount can receive and interpret data streams associated with one or more physiological data acquisition devices. The transfer interface can prioritize the various data streams associated with the one or more physiological data acquisition devices and generate a single, combined data stream based on the assigned prioritization. The transfer interface can provide the combined data stream for transmission to a patient monitor via an interchangeable transport medium. Another transfer interface can process and/or virtualize the data streams from the physiological data acquisition devices.

Abstract: A method and system for determining flight height of an unmanned aerial vehicle (UAV) includes a determining device that includes a camera at bottom of the UAV carried on a three-axis self-stabilizing tripod head; and a carrier phase difference satellite positioning system (CPDSPS), a graphics processing computer (GPC) and a power supply system provided on top of the UAV The GPC is connected with the CPDSPS, the power supply system and the camera, respectively. An attitude and heading reference system (AHRS) is provided at the bottom of the three-axis self-stabilizing tripod head and connected with the GPC The GPC is configured to determine relative height of the UAV from a canopy of farmland surface crops according to position information acquired by the CPDSPS, attitude information acquired by the AHRS and ground orthographic image acquired by the camera, and determine flight height of the UAV according to the relative height.

Abstract: The present disclosure provides a panoramic image stitching method, including the steps of acquiring a partial panoramic image taken by each lens; acquiring a first equirectangular rectangular projection graph of each partial panoramic image; performing rotation transformation on the first equirectangular rectangular projection graph of each partial panoramic image to obtain a second equirectangular rectangular projection graph; and adjusting stitching positions of adjacent second equirectangular rectangular projection graphs, and performing stitching operation on the second equirectangular rectangular projection graphs according to the adjusted stitching positions.

Abstract: Disclosed is a method and apparatus for providing a 360-degree panoramic background during a video call. A non-transitory computer-readable recording medium stores instructions that, when executed by a processor, cause the processor to perform operations for providing a background on an electronic device. The operations include separating an object video and an original background video from video data input to a first video call screen of an electronic device during a video call; generating new video data by synthesizing a panoramic video image and the object video such that the new video data includes the object video and includes the panoramic video image as a replacement background video; and displaying, on the first video call screen, the new video data such that a location of the panoramic video image of the new video data moves in response to motion information of a user.

Abstract: Disclosed are methods and apparatuses for decoding an image. A method includes receiving a bitstream obtained by encoding the image; dividing a first coding block into a plurality of second coding blocks; generating a prediction block of a second coding block based on syntax information obtained from the bitstream; and reconstructing the second coding block based on the prediction block and a residual block of the second coding block, the residual block being obtained by performing a dequantization and an inverse-transform on quantized transform coefficients from the bitstream. The first coding block has a recursive division structure. The first coding block is divided based on at least one of a quad tree division, a binary tree division or a triple tree division.

Abstract: The present disclosure relates to image processing systems and methods. The method may include obtaining a first image and a second image. The first image may be captured by a first camera lens of a panorama device and the second image may be captured by a second camera lens of the panorama device. The method may also include performing an interpolation based on a center of the first image to obtain a first rectangular image, and performing an interpolation based on a center of the second image to obtain a second rectangular image. The method may further include generating a fused image based on the first rectangular image and the second rectangular image, and mapping the fused image to a spherical panorama image.

Abstract: An apparatus including a cover, an actuator and a processor. The cover may be configured to enable light to reach an image sensor. The actuator may be configured to cause a vibration of the cover at a particular frequency. The processor may be configured to generate image frames from pixel data generated by the image sensor and present a control signal to the actuator in response to an input. The input may activate the vibration at the particular frequency. The particular frequency of the vibration may cause debris to be removed from the cover.

Abstract: A method for decoding a 360-degree image includes: receiving a bitstream obtained by encoding a 360-degree image; generating a prediction image by making reference to syntax information obtained from the received bitstream; combining the generated prediction image with a residual image obtained by dequantizing and inverse-transforming the bitstream to obtain a decoded image; and reconstructing the decoded image into a 360-degree image according to a projection format.

Abstract: A portable remote controlled video production apparatus and method are provided, as is a teleprompter/Interrotron integrated with a camera. A computer is mounted in a rigid cage, the computer having a local portion of remote access remote control software. A camera is fixedly mounted in the cage in communication with the computer; either the camera or the computer have camera control software running thereon. A monitor is fixedly mounted in the cage in front of the camera and parallel to the lens axis; the monitor is in communication with the computer. A beamsplitter is fixedly mounted in the cage in front of the lens reflecting light from the monitor towards a front of the cage. The camera and computer are controllable remotely via a remote portion of the remote access remote control software running on a remote computer communicating with the local portion of the remote access remote control software.

Abstract: An image processing method includes the steps of lighting up at least a part of light emitting units of a light emitting device; capturing a plurality of detection images corresponding to a plurality of sections of the light emitting device respectively, wherein each section includes a plurality of lighted-up light emitting units, each detection image includes a plurality of light spots respectively corresponding to the light emitting units of the associated section, and every two adjacent sections have an overlap area including at least one lighted-up light emitting unit; and stitching the detection images of the adjacent sections together by taking the light spots corresponding to at least one lighted-up light emitting unit of the overlap area as alignment reference spots, so that the light emitting statuses of all the light emitting units are presented by a single image.

Abstract: The present invention relates to a wide-angle image providing method including: an image taking step of generating a first region image obtained by taking an image of a first region and generating a second region image obtained by taking an image of a second region adjacent to the first region by a second camera module; a distortion calibration step of correcting distortion of each of the first and second region images by a distortion calibration unit; a phase difference calibration step of correcting a phase difference of each of the first and second region images; an overlap calibration step of correcting the first and second region images while overlapping the first and second region images to be adjacent to each other by an overlap calibration unit; and a color calibration step of correcting colors of the first and second region images which have been overlapped and calibrated.

Abstract: A surveillance camera system includes a surveillance camera having a plurality of cameras for capturing images in a plurality of different image capturing ranges, and a terminal device capable of communicating with the surveillance camera. The terminal device transmits to the surveillance camera arrangement pattern information and image capturing range information of the plurality of cameras that are input by an operation of a user. The surveillance camera calculates camera parameters of the plurality of cameras based on the arrangement pattern information and the image capturing range information of the plurality of cameras transmitted from the terminal device, respectively set the plurality of cameras based on the camera parameters, and transmits to the terminal device images respectively captured by the plurality of cameras after the setting. The terminal device displays the images captured by the plurality of cameras and transmitted from the surveillance camera.

Abstract: Embodiments of the present disclosure provide a method for controlling a virtual reality display device, wherein the virtual reality display device includes a display, an optical system, and a movement controller. In this method, an anti-distortion image is generated based on the original image according to distortion parameters of the optical system. The anti-distortion image includes an effective image area and an invalid image area, wherein the effective image area includes image information of the original image. The movement control information is written into the invalid image area, and the movement control information is used by the movement controller to control the movement of the display. The anti-distortion image is provided to the virtual reality display device.