Abstract: Methods and apparatus for streaming or playing back stereoscopic content are described. Camera dependent correction information is communicated to a playback device and applied in the playback device to compensate for distortions introduced by the lenses of individual cameras. By performing lens dependent distortion compensation in the playback device edges which might be lost if correction were performed prior to encoding are preserved. Distortion correction information may be in the form of UV map correction information. The correction information may indicate changes to be made to information in a UV map, e.g., at rendering time, to compensate for distortions specific to an individual camera. Different sets of correction information may be communicated and used for different cameras of a stereoscopic pair which provide images that are rendered using the same UV map. The communicated correction information is sometimes called a correction mesh since it is used to correct mesh related information.

Abstract: A generation unit configured to generate a combined image obtained by combining an image captured in a case where an image capturing direction is moved in a first direction from an image capturing start, and an image captured in a case where the image capturing direction is moved in a second direction opposite to the first direction with respect to a position of the image capturing start, and a recording control unit configured to perform control to, in a case where the image capturing direction is moved in the first direction before the image capturing direction is moved in the second direction, then according to an end condition for ending image capturing being satisfied, record the combined image obtained by the generation unit combining the image captured in the case where the image capturing direction is moved in the first direction are included.

Abstract: In particular embodiments, a computing system may detect a number of objects captured within an overlapping region between a first field of view associated with a first camera and a second field of view associated with a second camera. The system may determine a respective priority ranking for each of the objects. The system may select an object from the objects based on the respective priority ranking for the object. The system may determine, for the first camera, a first lighting condition associated with the first field of view. The system may determine, for the second camera, a second lighting condition associated with the second field of view. The system may determine a shared exposure time for the selected object based on the first lighting condition and the second lighting condition. The system may cause at least one image of the selected object to be captured using the shared exposure time.

Abstract: A method and an apparatus for transmitting and receiving video content including 3D data are provided. According to an embodiment, a method for transmitting data related to content including an omnidirectional image and a point cloud object is provided. The method includes generating media data and metadata for the content including the omnidirectional image and the point cloud object; and transmitting the generated media data and the generated metadata, wherein the metadata comprises information for specifying sub-spaces of a bounding space related to the point cloud object.

Abstract: A technique of generating a stereoscopic panorama image includes panning a portable camera device, and acquiring multiple image frames. Multiple at least partially overlapping image frames are acquired of portions of the scene. The method involves registering the image frames, including determining displacements of the imaging device between acquisitions of image frames. Multiple panorama images are generated including joining image frames of the scene according to spatial relationships and determining stereoscopic counterpart relationships between the multiple panorama images. The multiple panorama images are processed based on the stereoscopic counterpart relationships to form a stereoscopic panorama image.

Abstract: A method and a device for stabilizing photographic equipment on a mobile device. The method includes: acquiring attitude information of the mobile device; determining an expected pitch angle of the photographic equipment; determining a driving force according to the expected pitch angle; and adjusting a pitch angle of the photographic equipment by adoption of the driving force.

Abstract: A plurality of multi-camera systems and methods for imaging faint objects are disclosed, which includes an array of cameras that, when taken alone, are incapable of imaging such objects. The systems and methods may include common field arrays, hybrid field arrays, and/or adaptive field arrays.

Abstract: A panoramic photo shooting method and apparatus related to the field of communications technologies include detecting, by a terminal, an input operation used to turn on a camera, turning on, by the terminal, the camera in response to the input operation, displaying, by the terminal, a preview picture obtained by the camera, and displaying, by the terminal in the preview picture, a prompt for entering a panoramic photo shooting mode.

Abstract: There is provided an image processing apparatus including an association section configured to, in a case where panorama image data generated by using a plurality of frame image data obtained by an imaging operation while displacing an imaging direction is determined to be a full circumference panorama image, associate the panorama image data with information showing that the panorama image data is the full circumference panorama image.

Abstract: An electronic device according to the present invention includes at least one memory and at least one processor which function as: a display controlling unit configured to perform control so as to display a range of a part of a VR content as a display range on a display, and configured to be able to change a position of the display range, wherein the display controlling unit performs control so that, when a part of a VR content that is a display target is a non-video range, a range of a part of the VR content is displayed as a display range and a guide indicating a positional relationship between a video range and the non-video range of the VR content is displayed.

Abstract: Embodiments of the present application provide a method, apparatus and video monitoring device for capturing a target object. The method comprises detecting target objects in current panoramic video frame acquired by panoramic camera, and determining first position information, size, moving direction, and speed information of each target object in the current panoramic video frame; calculating position information for capturing of each target object; determining detail camera position information corresponding to each target object and determining a magnification corresponding to each target object according to size thereof; and determining a tracking duration for each target object, and controlling, for each target object, the detail camera to adjust its position and magnification according to the detail camera position information and magnification corresponding to the target object, and controlling the adjusted detail camera to capture the target object within the tracking duration for the target object.

Abstract: Techniques are disclosed for managing display of content from multi-view video data. According to these techniques, an object may be identified from content of the multi-view video. The object's location may be tracked across a sequence of multi-view video. The technique may extract a sub-set of video that is contained within a view window that is shifted in an image space of the multi-view video in correspondence to the tracked object's location. These techniques may be implemented either in an image source device or an image sink device.

Abstract: Disclosed is an image processing apparatus in which an image receiver receives a plurality of captured images, where image-captured ranges partially overlap, from an image-capturing device and stores the plurality of captured images in an input buffer, a composite region setter sets a composite region such that a portion projected in the vicinity of a polar point of a celestial sphere panoramic image is wider than a portion projected in the vicinity of an equator of the celestial sphere panoramic image, in an overlapping image-captured range of at least two captured images, an image composer performs composite processing on overlapping images in the composite region, connects the plurality of captured images, generates the celestial sphere panoramic image, and stores the generated image to an output buffer, and an image transmitter transmits the celestial sphere panoramic image to a display device.

Abstract: A method for providing content includes determining a viewing direction of a user viewing a content item comprising a plurality of video streams, selecting two or more video streams of the content item based on the viewing direction of the user and directional data associated with the plurality of video streams, decoding the two or more video streams to form two or more decoded video streams, stitching the two or more decoded video streams to form a combined image, and causing the combined image to be displayed to the user. Systems perform similar steps and non-transitory computer readable storage mediums each store one or more computer programs.

Abstract: Provided is a drawing section that generates a display image from a predetermined viewpoint by using a texture image and a depth image of a first layer and using a texture image and a depth image of a second layer in which a range of information indicated by a pixel value is different from at least one of the texture image or the depth image of the first layer.

Abstract: A system and method is provided for displaying surfaces of an object from a vantage point different from the vantage point from which imagery of the object was captured. In some aspects, imagery may be generated for display by combining visual characteristics from multiple source images and applying greater weight to the visual characteristics of some of the source images relative to the other source images. The weight may be based on the orientation of the surface relative to the location from which the image was captured and the location from which the object will be displayed.

Abstract: A video system processes video frames from a wide angle camera to dewarp the video frames in a manner that preserves conformity of an object of interest. A crop region of a video frame corresponding to the object of interest is determined. An input parameter to a dewarping function is generated based on the detected crop region. The dewarping function is applied to the crop region using the input parameter to generate a dewarped video frame and the dewarped video frame is outputted. The input parameter may be generated in a manner that causes the dewarped video frame to have higher conformity and lower distortion in the region around the object of interest than in a region distant from the object of interest.

Abstract: An image processing device includes a hardware processor configured to: acquire items of image information; determine lateral image information as a particular state of luminance when a first region of interest exhibits luminance of a first given value or more and a difference in luminance between the first region of interest and a second region of interest is a second given value or more, the first region of interest and the second region of interest being included in a vehicular front region and a vehicular rear region of the lateral image information, respectively; set, in the particular state of luminance, a first correction value in accordance with luminance of the vehicular front region and set a second correction value in accordance with luminance of rear image information; and set, according to the first second correction values, an individual correction value for correcting luminance of a region between the first and second regions of interest.

Abstract: Example video data processing methods and apparatus are disclosed. One example method includes obtaining viewport information by a server. The server obtains spatial object information based on the viewport information, where the spatial object information is used to describe a specified spatial object in panoramic space. The server obtains a first bitstream, where the first bitstream is obtained by encoding image data in the specified spatial object. The server obtains a second bitstream, where the second bitstream is obtained by encoding image data in the panoramic space. The server transmits the first bitstream and the second bitstream to a client.

Abstract: An encoder is configured for encoding an immersive video spatially tiled with a set of tiles in one or more representations in accordance with corresponding assigned bit-rate upper limits depending on obtained proximity values of the corresponding tiles.

Abstract: Provided is an image processing device that includes a first generation unit that projects a first image on a plurality of planes on a virtual spherical surface according to projection angles obtained by dividing a viewing angle at time of capturing the first image to generate the plurality of basis planar images. The image processing device further includes a second generation unit that projects a second image on a plurality of planes on a virtual spherical surface according to projection angles obtained by dividing a viewing angle at time of capturing the second image having an imaging range overlapping with the first image to generate the plurality of reference planar images, and a plurality of stereo image processing units that performs stereo image processing using a corresponding image pair of the plurality of generated basis planar images and reference planar images to generate distance information indicating a distance to an object on the basis image.

Abstract: Methods and systems are provided for generating enhanced image. A neural network system is trained where the training includes training a first neural network that generates enhanced images conditioned on content of an image undergoing enhancement and training a second neural network that designates realism of the enhanced images generated by the first neural network. The neural network system is trained by determine loss and accordingly adjusting the appropriate neural network(s). The trained neural network system is used to generate an enhanced aesthetic image from a selected image where the output enhanced aesthetic image has increased aesthetics when compared to the selected image.

Abstract: Images captured by multi-camera arrays with overlap regions can be stitched together using image stitching operations. An image stitching operation can be selected for use in stitching images based on a number of factors. An image stitching operation can be selected based on a view window location of a user viewing the images to be stitched together. An image stitching operation can also be selected based on a type, priority, or depth of image features located within an overlap region. Finally, an image stitching operation can be selected based on a likelihood that a particular image stitching operation will produce visible artifacts. Once a stitching operation is selected, the images corresponding to the overlap region can be stitched using the stitching operation, and the stitched image can be stored for subsequent access.

Abstract: A device and a method for capturing media by using a device including a plurality of flaps are provided. At least two flaps among the plurality of flaps each include at least one camera. The method includes analyzing preview images of the cameras based on a first media capture mode, adjusting a bend angle between the at least two flaps based on the analysis of the preview images to determine at least one baseline distance, and obtaining at least one media in the first capture mode at the at least one baseline distance.

Abstract: The present disclosure relates to a communication technique for converging IoT technology with a 5G communication system for supporting a higher data transmission rate than a 4G system, and a system therefor. The present disclosure may be applied to intelligent services based on 5G communication technology and IoT-related technology (e.g. smart homes, smart buildings, smart cities, etc.). A method for receiving image data for a virtual-reality streaming service by an electronic device according to an embodiment of the present invention comprises: a step in which the electronic device determines whether to execute an adaptive virtual-reality streaming service on the basis of a bandwidth state; and a step in which, if it is determined to execute the adaptive virtual-reality streaming service, the electronic device requests and receives, from a server, the image data for the adaptive virtual-reality streaming service on the basis of head-tracking information and bandwidth information collected in advance.

Abstract: An image capturing device includes image sensor, capturing a first image in a first image capturing region, capturing a second image in the first image capturing region at a shorter exposure time than that of the first image, after capturing the first image, capturing a third image in a second image capturing region at a shorter exposure time than that of the first image, after capturing the second image; and capturing a fourth image in the second image capturing region at a longer exposure time than those of the second and third images, after capturing the third image; and combining unit configured to carry out alignment processing between the images using the second image and the third image, and combine the first image and the fourth image on the basis of a result of the alignment processing.

Abstract: Zoom digital cameras comprising a Wide sub-camera and a folded fixed Tele sub-camera. The folded Tele sub-camera may be auto-focused by moving either its lens or a reflecting element inserted in an optical path between its lens and a respective image sensor. The folded Tele sub-camera is configured to have a low profile to enable its integration within a portable electronic device.

Abstract: A wide-angle image processing apparatus and method includes receiving in a first client terminal having a display an original image captured by a wide-angle camera; receiving in the first client terminal a user input for selecting a first view mode for the display; requesting metadata corresponding to the first view mode from a shared memory accessible to the first client terminal and the wide-angle camera; receiving the metadata corresponding to the first view mode from the shared memory; and setting at least one region of interest in the original image based on the metadata corresponding to the first view mode.

Abstract: There is provided an image processing apparatus including a display image generation section configured to generate display image data by performing a display projection process in a case where panorama image data to be a display target is judged to be a full circumference panorama image.

Abstract: Disclosed is a localization method and apparatus that may acquire localization information of a device, generate a first image that includes a directional characteristic corresponding to an object included in an input image, generate a second image in which the object is projected based on the localization information, to map data corresponding to a location of the object, and adjust the localization information based on visual alignment between the first image and the second image.

Abstract: An image processing method includes performing horizontal division and vertical division on a longitude-latitude map or a sphere map of a to-be-processed image to obtain sub-areas of the longitude-latitude map or the sphere map, where a division location of the horizontal division is a preset latitude, a division location of the vertical division is determined by a latitude, there are at least two types of vertical division intervals in an area formed by adjacent division locations of the horizontal division, and a vertical division interval is a distance between adjacent division locations of the vertical division, and encoding images of the sub-areas.

Abstract: An image-capturing device uses a light reflecting member to redirect an exterior light image toward a lens module in order to focus the light image onto an image-capturing unit. The image-capturing device includes a rotating unit for driving the light-reflecting member to rotate within a limited range in such a manner that the image-capturing device can capture at least two light images of different photo-ing areas and combine them into one single combined image without a need of moving the image-capturing unit and the lens module. When a user takes a panoramic or wide-ranged picture, he/she doesn't need to move the whole image-capturing device, but only needs to stand at the same position, faces the same direction and simply pushes the shutter button, and then the image-capturing device will automatically capture light images of different photo-ing areas and then integrate them into one single panoramic or wide-ranged picture.

Abstract: In some examples, a system includes an article of personal protective equipment (PPE) comprising one or more sensors, the one or more sensors configured to generate usage data that is indicative of an operation of the article of PPE; and at least one computing device comprising a memory and one or more computer processors that: receive the usage data that is indicative of the operation of the article of PPE; apply the usage data to a safety learning model that predicts a likelihood of an occurrence of a safety event associated with the article of PPE based at least in part on previously generated usage data that corresponds to the safety event; and perform, based at least in part on predicting the likelihood of the occurrence of the safety event, at least one operation.

Abstract: A server is disclosed. A server for providing a content to a user terminal device providing a virtual reality service comprises: a communication unit for performing communication with at least one source device and the user terminal device; and a processor for, when a content transmission request for a preconfigured location is received from the user terminal device, receiving a content photographed in a real time from a source device of the preconfigured location on the basis of location information received from at least one source device, and providing the content to the user terminal device.

Abstract: A calibration system and a method for panoramic photographing device parameter, including: an image acquisition module, a parameter solver module connected with the image acquisition module, and a data analysis module connected with the parameter computation module; the image acquisition module is configured to send an instruction to cause N cameras of the panoramic photographing device to acquire and store M sets of images synchronously and consecutively; the parameter solver module configured to sequentially read out the M sets of images from the image acquisition module, and to separately process the M sets of images, and to acquire M corresponding device parameters for storage and delivery; and the data analysis module configured to receive the M corresponding device parameters sent by the parameter solver module, and to perform data analysis to the M corresponding device parameters, and to acquire and store an optimal solution of the calibration parameters.

Abstract: An image processing apparatus including a storage unit, a correction unit, and an output unit. The storage unit stores moving-image data including a plurality of frames captured by an image-capturing device communicable with the image processing apparatus, time-series data of an inclination angle with reference to a reference direction of the image-capturing device, and time-series data of an angle velocity of the image-capturing device. The correction unit, based on the time-series data of the angle velocity, rotates an image of each of the plurality of frames of the moving-image data to reduce a rotational distortion around the reference direction within a prescribed frequency range. The output unit outputs image data of the rotated image of each of the plurality of frames to an external device communicable with the image processing apparatus.

Abstract: The invention relates to a multi-sensor camera (1) including at least one housing (2) extending along a camera longitudinal axis (KLA) and having a flat housing base (3) running at least in portions perpendicularly to the camera longitudinal axis (KLA), and including a plurality of image sensor units (6, 6?, 6.1-6.6), wherein one image sensor unit (6, 6?, 6.1-6.6) includes a lens (6a, 6a?) and an image sensor (6b, 6b?) adjoining said lens along a sensor longitudinal axis (SLA). The image sensor units (6, 6?, 6.1-6.6) are distributed concentrically around the camera longitudinal axis (KLA) and are arranged within the housing (2) and above the housing base (3) in such a way that the lenses (6a, 6a?) of the image sensor units (6, 6?, 6a-6.6) are oriented towards the camera longitudinal axis (KLA).

Abstract: Systems and methods may be used to detect an inaudible signal associated with a first audible signal of an audio input. The inaudible signal may include a frequency signature. The frequency signature may be associated with an electronic device type. The systems and methods may activate a response monitor. The response monitor may be activated for a predetermined time. The response monitor may be activated responsive to the frequency signature. The systems and methods may determine a content characteristic of the first audible signal based on the inaudible signal. The systems and methods may include generating a message. The message may be based on the content characteristic. The systems and methods may include transmitting the message. The message may be transmitted on a condition that a second audible signal corresponds to the message and is received within the predetermined time.

Abstract: Embodiments of the present application provide a method and apparatus for generating a panoramic image. The method includes: determining, according to a pre-established mapping relationship, a pixel point in the two-dimensional planar image to which each of grid points in a preset stereoscopic model is mapped, wherein multiple grid points form one grid plane and accordingly, multiple pixel points to which the multiple grid points are mapped form one pixel region; and rendering each of the grid planes by the pixel region corresponding to this grid plane, to obtain a panoramic image. In the solution of the present application, it is not necessary to generate a distortion-corrected image and an overhead image, thereby saving storage resources.

Abstract: The digital 3D/360° camera system is an omnidirectional stereoscopic device for capturing image data that may be used to create a 3-dimensional model for presenting a 3D image, a 3D movie, or 3D animation. The device uses multiple digital cameras, arranged with overlapping fields of view, to capture image data covering an entire 360° scene. The data collected by one, or several, digital 3D/360° camera systems can be used to create a 3D model of a 360° scene by using triangulation of the image data within the overlapping fields of view.

Abstract: A Position and Orientation Measurement Engine (POME) is a mobile camera system that can be used for accurate indoor measurement (e.g., at a construction site). The POME uses a plurality of cameras to acquire images of a plurality of targets. If locations of the plurality of targets are precisely known, images of the targets can be used to determine a position of the POME in relation to the plurality of targets. However, to precisely determine locations of the plurality of targets can be time consuming and/or use expensive equipment. This disclosure discusses how to use a camera system with an electronic distance measuring unit to determine locations of the plurality of targets.

Abstract: A device for communicating including a housing including a camera, a microphone, a speaker, a button, a battery, a sensor, non-volatile memory, a processor, and a wireless communications module, wherein the non-volatile memory stores code operable by the processor for switching the processor from low-power mode to active mode in response to an activation trigger, receiving, from the one of the microphone and the camera, outbound audio and video signals, then sending a signal to a server via the wireless communications module during active mode, the signal including one or more of an alert signal, a signal based on the outbound audio signal, and a signal based on the outbound video signal, receiving from the server an inbound audio signal and outputting a signal based on the inbound audio signal via the speaker, and switching the processor from active mode to low-power mode in response to a deactivation trigger.

Abstract: [Problem] To provide a photographing apparatus that reduces motion blur caused by camera rotation, provides high quality binocular parallax video, and suppresses visually induced motion sickness.

Abstract: The present disclosure includes a method for generating simulated previews of dynamic virtual cameras, the method comprising receiving virtual camera descriptor data, receiving object tracking data, generating virtual camera behavior data based on the virtual camera descriptor data and the object tracking data, the virtual camera behavioral data corresponding to virtual camera parameters for rendering a view, and generating a simulated preview based on the object tracking data and the virtual camera behavioral data.

Abstract: An image capture device may capture two hemispherical views of a scene. The two hemispherical view of the scene may be stitched along a stitch line. The image capture device may be rotated to align the stitch line with a mid-line of a panoramic field of view of the scene. Separate exposure settings may be used to capture the two hemispherical views of the scene, with the exposure settings increasing the dynamic range of the scene depicted within the panoramic field of view of the scene. The panoramic field of view of the scene may be punched out as panoramic visual content.

Abstract: The present application provides a method and device for constructing a projection image.

Abstract: An electronic apparatus for acquiring a panorama image using a plurality of cameras and a method for controlling the electronic apparatus thereof are provided. The electronic apparatus includes a plurality of cameras for capturing an image, a sensor for acquiring movement information, and a processor for determining individual movement information of the plurality of cameras with reference to a predefined location using movement information acquired through the sensor, acquiring a plurality of images through the plurality of cameras based on the individual movement information and generating a panorama image using the plurality of photographed images.

Abstract: An image device for generating a 360 degree depth map includes a plurality of image capturers, wherein an image pair captured by each two adjacent image capturers of the plurality of image capturers is used for generating the 360 degree depth map, and a sum of all view angles of the plurality of image capturers is not less than 720 degree.

Abstract: There is provided an image processing apparatus including a display image generation section configured to generate display image data by performing a display projection process in a case where panorama image data to be a display target is judged to be a full circumference panorama image.

Abstract: An electronic device and method are disclosed herein. The electronic device includes a display, a camera, a sensor circuit, a processor. The processor implements the method, including executing a preview mode and outputting a camera preview image, detecting movement of the device, detecting whether a movement distance reaches a reference distance, when the movement distance reaches the reference distance, detecting whether the movement direction matches a reference direction, and when the movement direction matches the reference direction, switching to a panorama capture mode.