Abstract: Embodiments of the disclosure provides a method and an apparatus for synchronizing viewing angles in Virtual Reality (VR) live streaming. The method comprises: determining transmitting user's viewing angle information corresponding to image frames in a process of playing VR content on a transmitting device side; and providing the image frames in the VR content and the transmitting user's viewing angle information corresponding to the image frames to a VR receiving device such that, when displaying the VR content, the VR receiving device is configured to determine, based on the transmitting user's viewing angle information corresponding to a current image frame to be displayed and a preset number of preceding image frames, a display angle for the VR receiving device to display the current image frame to be displayed.

Abstract: A 360° view of an area is obtained by stitching together multiple images each of the images obtained at a different point of view. One of the points of view or each one of the points of view receives different angled views of different features in the image. Each feature in the image is therefore imaged from multiple different angles. The images are stitched together into a three-dimensional panorama which is optimized for display on a display where one image is intended for users left eye and another image is intended for the users right eye. The left eye sees features of the image from one field of view, and the right eye sees features of that same image from a different field of view, where each field in the image is shown to the different eyes at different points of view. Therefore, the different eyes perceive different parts of the depth of the image. And that last part into the specification and maybe into the claims.

Abstract: To reduce size and cost of a stereo camera and an onboard lighting unit. A stereo camera includes a first convex hyperboloidal mirror and a second convex hyperboloidal mirror that share a central axis and are vertically disposed with vertexes facing each other, an imaging optical system, and an image sensor. The second convex hyperboloidal mirror is formed of an outer circumferential hyperboloidal mirror and an inner circumferential hyperboloidal mirror that share the central axis with different conic constants, and an absolute value of the conic constant of the inner circumferential hyperboloidal mirror is greater than an absolute value of the conic constant of the outer circumferential hyperboloidal mirror.

Abstract: A 360° video capture, processing and display system includes a 360° video camera to capture a 360° raw video file, and a 360° video processing assembly to generate a 360° equirectangular geographic projection from each frame of the 360° raw video file. A 360° video processing algorithm captures a plurality of viewport images from each of a plurality of equirectangular geographic projections. A composite video displays includes a plurality of viewport images from a corresponding one of each of the 360° equirectangular geographic projections, wherein at least one of a top or bottom composite video display comprises a seamless integration of corresponding ones of the plurality of viewport images. The 360° video capture, processing and display system generates a multi-platform compatible processed 360° video file comprising the plurality of composite video displays, wherein the multi-platform compatible processed 360° video file is viewable on a video display assembly.

Abstract: Systems and methods for automatic detection and insetting of digital streams into a video. Various examples of such regions of interest to the user include, without limitation, content displayed on various electronic displays or written on electronic paper (electronic ink), content projected on various surfaces using electronic projectors, content of paper documents appearing in the video and/or content written on white (black) boards inside the video. For some content, such as whiteboards, paper documents or paintings in a museum, a participant (or curator) could have taken pictures of the regions, again stored digitally somewhere and available for download. These digital streams with content of interest to the user are obtained and then inset onto the view generated from the raw video feed, giving users the ability to view them at their native high resolution.

Abstract: A method of correcting an image obtained by an image acquisition device includes obtaining successive measurements, Gn, of device movement during exposure of each row of an image. An integration range, idx, is selected in proportion to an exposure time, te, for each row of the image. Accumulated measurements, Cn, of device movement for each row of an image are averaged across the integration range to provide successive filtered measurements, G, of device movement during exposure of each row of an image. The image is corrected for device movement using the filtered measurements G.

Abstract: An image pickup apparatus includes: an image sensor; a first detection unit configured to detect movement of the image sensor; a second detection unit configured to compare images to detect a positional deviation thereof; a combining unit configured to combine the images on a basis of the detected positional deviation and to generate a panoramic image; and a display control unit, in which in a case where combining of images up to an Nth frame is completed by the combining unit, on a basis of information about a size of the panoramic image generated by combining the images up to the Nth frame and the movement of the image sensor, which is detected by the first detection unit and corresponds to frames from an (N+1)th frame to an (N+M)th frame, the display control unit generates information indicating progress of combining of the panoramic image.

Abstract: Provided are a method and apparatus for encoding or decoding a 360-degree image. An image decoding method and apparatus according to an embodiment include: obtaining image data from a bitstream; decoding a first region of a projection image corresponding to a non-clipping region of a 360-degree image from the image data; obtaining information about a clipping region of the 360-degree image from the bitstream; determining a second region of the projection image, based on the information about the clipping region; and converting the projection image including the first region and the second region into the 360-degree image.

Abstract: Disclosed herein are techniques for eye illumination for eye position tracking. An illumination system includes a light source configured to emit a light beam in a first wavelength range, a beam splitter configured to split the light beam emitted by the light source into a plurality of light beams, a substrate configured to be placed in front of an eye of a user, and a plurality of reflectors located within the substrate. Each of the plurality of reflectors is configured to intercept one or more light beams from the plurality of light beams, reflect light in the one or more light beams from the plurality of light beams to the eye of the user, and transmit light in a second wavelength range different from the first wavelength range to the eye of the user. The substrate is transparent to both light in the first wavelength range and light in the second wavelength range.

Abstract: Feature points included in input images are extracted and matching information indicating mapping relationships for feature points included in different input images is generated. A reference image is selected among the input images based on the matching information. Valid images are determined among the input images by excluding noise images from the input images based on the matching information. A two-dimensional bundle adjustment is performed to generate synchronized images by aligning the valid images to the reference image. A merged image is generated by merging the reference image and the synchronized images. Image merging performance is enhanced by selecting the reference image highly correlated with the other input images and estimating exact homography based on the reference image.

Abstract: Embodiments herein disclose a method for recommending an image capture mode by an electronic device. The method includes identifying, by the electronic device, at least one ROI displayed in a camera preview of the electronic device for capturing an image in a non-ultra-wide image capture mode. Further, the method includes determining, by the electronic device, that the at least one ROI is suitable to capture in an ultra-wide image capture mode. Further, the method includes providing, by the electronic device, at least one recommendation to switch to the ultra-wide image capture mode from the non-ultra-wide image capture mode for capturing the image.

Abstract: A distributed object tracking system includes a plurality of image analysis devices and a cluster management service device connected to the plurality of image analysis devices, wherein each image analysis device analyzes an object in a corresponding real-time video stream to generate an analysis result for tracking the object, and the cluster management service device includes a tracking module to form a trajectory of the object according to the analysis result generated by each of the plurality of image analysis devices.

Abstract: Provided in the present invention are a method for achieving a bullet time capturing effect and a panoramic camera. The method comprises: acquiring a panoramic video captured when a panoramic camera rotates around a capture target; acquiring from within the panoramic video hemispherical images close to the side of the capture target; splicing the hemispherical images to generate a spliced image; and fixing a viewpoint of the spliced image, thus achieving a bullet time capturing effect. According to the present invention, only one panoramic camera is needed to be able to capture the bullet time capturing effect, so that the capturing cost of the bullet time capturing effect in the present invention is low. Meanwhile, since the bullet time capturing effect is obtained by means of a panoramic video being captured when a panoramic camera rotates around a capture target and processing being carried out on the panoramic video, the precision is high.

Abstract: A data handling or patching system operates to reduce redundant data within a data storage. Data files are compared, and a data difference is output. In files that have very similar data, the data difference between values is relatively small, and thus when a basic data file and a data difference file are stored, data redundancy is significantly reduced. The data difference of “diff” file can then be used to losslessly reproduce the data of either of the compared files. A first or primary port is dedicated for base quality transmissions on which the broadcasting client sends the lowest available quality. Additional or secondary ports enable transmission of higher than base quality data, sent as “diff's” of the base quality. The receiving client combines the “diff” data on the secondary ports with the base data of the first port, to produce higher quality media.

Abstract: Disclosed herein are systems and methods for distributed computing and/or networking for mixed reality systems. A method may include capturing an image via a camera of a head-wearable device. Inertial data may be captured via an inertial measurement unit of the head-wearable device. A position of the head-wearable device can be estimated based on the image and the inertial data via one or more processors of the head-wearable device. The image can be transmitted to a remote server. A neural network can be trained based on the image via the remote server. A trained neural network can be transmitted to the head-wearable device.

Abstract: Embodiments of this application disclose a virtual scene display method performed at an electronic apparatus, and a storage medium, and belong to the field of computer technologies. The method includes: displaying a focusing button in a terminal screen in a case that a virtual scene is in a scaling display mode based on a scope, the focusing button being configured to adjust a scaling ratio of the virtual scene; obtaining an adjusted target field of view (FOV) corresponding to the scope according to a touch operation on the focusing button; obtaining the scaling ratio of the virtual scene according to the target FOV, the target FOV and the scaling ratio being in a negative correlation; and updating the virtual scene in the terminal screen according to the scaling ratio.

Abstract: The present technology relates to an image processing device, an image processing method, a program, and a projection system that facilitate the adjustment of the position and tilt of a camera. An image processing device according to one aspect of the present technology estimates, on the basis of a taken image taken by a camera installed at a predetermined tilt, the tilt of the camera, the camera being configured to photograph a projection surface of a screen on which a pattern image that is an image having a predetermined pattern has been projected from a projector, and performs control to display the taken image rotated depending on the tilt of the camera. The present technology is applicable to computers configured to control a plurality of projectors to project video.

Abstract: An in-vehicle monitoring camera device 100 includes: an obstacle detection unit 3 that detects, as first obstacles, obstacles detected by a millimeter-wave radar 11 which might collide with the host vehicle; a collision risk determination unit 4 that detects the time before the respective first obstacles and the vehicle come into contact with each other; a distortion correction unit 2 that generates image 2 by correcting distortion in image 1 captured using a wide-angle lens; and a camera-viewpoint display control unit 5 that generates image 3 by cutting out, from image 2, an image of the first obstacle having the shortest time to collision. Therein, a radar chart 31 indicating the visual field range or the center direction of the visual field of image 3 is superimposed on image 3.

Abstract: To determine a cause of a fault in a robotic system, a diagnostic service of the robotic system will receive primary signals from various processes running on the robotic system. The service will access a graph representation of functions as stored in memory, and the service will perform the functions on one or more of the primary signals to yield one or more derived signals. A sink of the robotic system will subscribing to a causal trace that includes a value for a specified one of the derived signals and an identification of each signal from which the specified derived signal was derived. During runtime, the sink will receive updates to the causal trace as the value for the specified derived signal changes. The diagnostic service will use the causal trace to identify a process that caused the fault.

Abstract: Provided are a method and apparatus for encoding or decoding a 360-degree image. An image decoding method and apparatus according to an embodiment include: obtaining image data from a bitstream; decoding a first region of a projection image corresponding to a non-clipping region of a 360-degree image from the image data; obtaining information about a clipping region of the 360-degree image from the bitstream; determining a second region of the projection image, based on the information about the clipping region; and converting the projection image including the first region and the second region into the 360-degree image.

Abstract: A video data stream is rendered reducible in a manner so that the reduction leads to a restriction of pictures of the reduced video data stream to merely a predetermined subarea of the pictures of the original video data stream and in a manner so that transcoding, such as re-quantization, may be avoided and a conformance of the reduced video data stream relative to the codec underlying the original video data stream be maintained. This is achieved by providing the video data stream with information including an indication of the predetermined subarea and replacement indices for redirecting the indices included by the payload portion so as to refer to, and/or replacement parameters for adjusting the first set of coding parameter settings so as to result in, a second set of coding parameter settings.

Abstract: Improved HMDs are described. The HMD is configured to provide higher resolution image content within a central area of a display of the HMD and to provide lower resolution image content within peripheral areas of the display. The HMD includes a higher resolution camera, a first lower resolution camera, and a second lower resolution camera. The FOV of the first lower resolution camera minimally overlaps the FOV of the higher resolution camera, and the FOV of the second lower resolution camera minimally overlaps the FOV of the higher resolution camera. The minimal overlap is less than 10 degrees. By structuring the HMD in this manner, the HMD can generate merged images that mimic a user's foveal vision acuity.

Abstract: A method for image acquisition may include receiving a video from a first video camera in a period, the video including a first view of a scene. The method may also include delineating a plurality of first regions within the first view of the scene. The method may further include determining an accumulated effect of at least one feature occurring within the period within at least one of the plurality of first regions. The method may further include directing a second video camera towards a second view of the scene based on the accumulated effect.

Abstract: A device for generating a model of an object with superposition image data in a virtual environment includes an image capturing element configured to generate an image data stream of the object as well as a calculating unit configured to extract, from the image data stream, a model of the object from a real environment, to insert the extracted model into the virtual environment, and to superpose at least part of the model with superposition image data so as to generate the model of the object with superposition image data in the virtual environment, and a display element configured to display the model of the object with superposition image data in the virtual environment.

Abstract: A computer-implemented method for arranging communication between two or more users is provided. The two or more users including at least a first client and at least a first consultant. The first computing device is associated with the at least first client. The second computing device is associated with the at least first consultant. The method includes operations performed by at least one computer processor.

Abstract: An image acquisition device, a goods shelf, a monitoring device for a goods shelf, a monitoring method for a goods shelf and an image recognition method are disclosed. The image acquisition device includes at least one reflective part which is configured to form a virtual image of an object through reflection of the object; and a camera which is configured to take a picture of the object and the virtual image of the object, so as to reduce a photograph blind zone.

Abstract: An image management system includes a reception unit and transmission unit. The reception unit receives, from a first communication terminal, link information that is transmitted from the image management system and is managed in a link information management system. The transmission unit transmits, to the first communication terminal, a view script and image data corresponding to the link information. The image data is received from a second communication terminal.

Abstract: The invention relates to a security system comprising: a first monitoring subsystem, said first monitoring subsystem being arranged to detect events within a first field of view using a first detection mechanism; a second monitoring subsystem, said monitoring subsystem being arranged to detect events within a second field of view using a second detection mechanism; a mounting arrangement configured to carry the first and second monitoring subsystems and mount them to a substrate; wherein in use, an alignable component of the first monitoring subsystem is configured to be orientated with respect to the mounting arrangement so that the first field of view covers an area to be monitored; and wherein the orientation of the alignable component of the first monitoring subsystem determines the orientation of the second field of view of the second monitoring subsystem.

Abstract: An in-vehicle information display apparatus and a method of controlling the same output outputting various pieces of information using image output devices disposed on a rear surface of a protrusion type information display apparatus. The protrusion type information display apparatus applied to a vehicle includes an output region determination unit configured to, upon detecting that an event occurs, determine an image corresponding to the event and an output region, among a plurality of regions of a windshield, a screen correction unit configured to correct the determined image to match the determined output region, and a projector unit disposed on a rear surface opposite to a front surface on which a display is disposed and configured to project the corrected image onto the determined output region.

Abstract: Disclosed are method and apparatus for fusing an object into a panoramic video. The method may include: playing a panoramic video in a panoramic video player; obtaining a target object; parsing the target object to obtain a coordinates parameter and a material parameter of the target object; setting the color of each pixel of the target object when the target object is fused into the panoramic video according to the coordinate parameter and the material parameter, so as to obtain a colored target object; and fusing the colored target object into the panoramic video.

Abstract: An apparatus includes a tool body and a structured illumination device attached to the tool body, wherein the structured illumination device includes a light source and a light filter mask to generate a light pattern. The apparatus also includes a subsurface camera system attached to the tool body, wherein the subsurface camera system comprises a plurality of cameras. The apparatus also includes a processor and a machine-readable medium having program code executable by the processor to cause the apparatus to acquire an image of a feature using the subsurface camera system and determine a three-dimensional position of the feature based on the image, wherein the feature is illuminated by the light pattern.

Abstract: An intelligent dual-lens photographing device and a photographing method is provided. The photographing device includes a first photographing module, a second photographing module, a shutter, a first driving mechanism, a second driving mechanism, a third driving mechanism, and a controller. The shutter is connected to the second photographing module. The first photographing module and the second photographing module are driven by the first driving mechanism to horizontally rotate synchronously. The first photographing module and the second photographing module are driven by the second driving mechanism to rotate around horizontal axis synchronously. The second photographing module is driven by the third driving mechanism to horizontally move and/or pitching independently.

Abstract: Aspects of the present disclosure relate to capturing panorama images using an image capture device including a camera. An example method includes receiving a user command to begin generation of a panorama image, capturing a plurality of images with the camera for generating the panorama image, while capturing the plurality of images, receiving an indication specifying a center region of interest (ROI), completing capture of the plurality of images, and automatically generating the panorama image based on the plurality of image, the panorama image centered at the specified center ROI.

Abstract: A vehicular multi-camera vision system includes a plurality of exterior viewing vehicle cameras disposed at a vehicle, a trailer camera disposed at a rear of a trailer and viewing rearward, an ECU and a display device in the vehicle. With the trailer not hitched to the vehicle and during a driving maneuver of the vehicle, image data captured by the vehicle cameras is provided to the ECU and the display device displays video images generated by the ECU and derived from image data captured by the vehicle cameras. With the trailer hitched to the vehicle and during a driving maneuver of the vehicle towing the trailer, image data captured by the trailer camera and the vehicle cameras is provided to the ECU and the display device displays video images generated by the ECU and derived from image data captured by the trailer camera and side viewing vehicle cameras.

Abstract: A wide-angle imaging optical system obtains sufficient information in the image periphery, and achieves high-performance imaging across the entire field of view. The imaging optical system uses stereographic projection, and includes, in sequence from an object, a first lens with a negative refractive power having a convex surface facing the object, a second lens with a negative refractive power, a third lens with a negative refractive power, a fourth lens with a positive refractive power, an aperture stop, a fifth lens with a positive refractive power, a sixth lens with a negative refractive power, and a seventh lens with a positive refractive power.

Abstract: To provide an imaging device for controlling imaging ranges of a plurality of imaging units, the imaging device includes: a first imaging unit and a second imaging unit; a driving mechanism for controlling an imaging range of at least one of the first imaging unit and the second imaging unit; a synthesizing unit for synthesizing a first image acquired by the first imaging unit and a second image acquired by the second imaging unit to generate a wide-angle image; a display unit for displaying an image; a user interface used for a user to designate an region or a position in the image displayed by the display unit; and a control unit for controlling the imaging range of at least one of the first imaging unit and the second imaging unit in accordance with the designated region or position and control whether the synthesizing unit performs synthesizing.

Abstract: A method, apparatus and computer program products are provided for capturing omnidirectional video with one or more cameras, streaming the video over a network, and rendering the video on a Head Mounted Display (HMD) and more specifically to a method, apparatus, and computer program product for improving the visual quality of viewport-based omnidirectional video streaming. One example method includes selecting a primary viewport, encoding a first representation that covers the primary viewport, and encoding a second representation that provides a gradual picture quality change from a background viewport to the primary viewport.

Abstract: A camera device is provided. The camera device includes: a first imaging section, a second imaging section, a third imaging section, and a processor. The first imaging section, second imaging section, and third imaging section capture a first image, a second image, and a third image of a scene with a first field of view (FOV), a second FOV, and a third FOV. The processor is configured to generate a first output image by performing a first image-fusion process on at least two of the first image, the second image, and the third image in response to a zooming factor of the camera device being between a first zooming factor and a second zooming factor, wherein the first FOV is wider than the second FOV, and the second FOV is wider than the third FOV, and the second zooming factor is greater than the first zooming factor.

Abstract: Disclosed are methods and apparatuses for image data encoding/decoding. A method for decoding a 360-degree image includes the steps of: receiving a bitstream obtained by encoding a 360-degree image; generating a prediction image by making reference to syntax information obtained from the received bitstream; adding the generated prediction image to a residual image obtained by dequantizing and inverse-transforming the bitstream, so as to obtain a decoded image; and reconstructing the decoded image into a 360-degree image according to a projection format. Therefore, the performance of image data compression can be improved.

Abstract: Apparatus and methods for optimized stitching of overcapture content. In one embodiment, the optimized stitching of the overcapture content includes capturing the overcapture content; producing overlap bands associated with the captured overcapture content; downsampling the produced overlap bands; generating derivative images from the downsampled overlap bands; generating a cost map associated with the generated derivative images; determining shortest path information for the generated cost map; generating a warp file based on the determined shortest path information, the generated warp file being utilized for the optimized stitching of the overcapture content. Camera apparatus and a non-transitory computer-readable apparatus are also disclosed.

Abstract: The present disclosure discloses a method and an apparatus for point cloud registration. The method includes: segmenting a source point cloud and a destination point cloud respectively into different categories of attribute features based on semantic; segmenting the source point cloud and the destination point cloud into a plurality of grids based on the attribute features; calculating a current similarity between the source point cloud and the destination point cloud based on the plurality of grids; determining whether the current similarity and a current iterative number satisfy a preset condition; when the current similarity and the current iterative number satisfy the preset condition, performing a registration on the source point cloud and the destination point cloud to obtain a registered result; and based on the registered result, adjusting a position of the source point cloud, updating the current iterative number.

Abstract: An image capturing apparatus, including an image sensor, a display, and circuitry is provided. The circuitry is configured to control the display to display a user interface that includes an imaging range setting item for setting a reference position. The reference position indicates a reference angle of a swing operation during capturing a plurality of images by the image sensor for generating a panoramic image.

Abstract: Systems and methods for capturing and transforming wide-angle video information are disclosed. Exemplary implementations may: guide light to an image sensor by a fisheye lens; capture wide-angled video information having a horizontal angle-of-view of 200 degrees or more and a vertical angle-of-view of 180 degrees or more; select a portion of the captured wide-angled video information; transform the selected portion into a rectilinear projection that represents the video sequence; and transform the rectilinear projection into a viewable video sequence that has a format suitable for playback in a virtual reality headset.

Abstract: A method of streaming panoramic video is provided. In one embodiment, the method includes receiving a panoramic video stream formed by a sequence of stitched panoramic frames, each stitched panoramic frame representative of a panoramic view defined by horizontal and vertical dimensions in relation to a central viewing point; splitting the stitched panoramic frames into pieces to create split frames and split frame streams; encoding the split frames for each split frame stream at multiple bitrates to form multiple resolution qualities for each split frame stream; and combining the split frame streams to form a video bunch frame stream. An apparatus for streaming equirectangular video is also provided. A non-transitory computer-readable medium storing program instructions is also provided. When executed by a computer or processor, the program instructions cause the apparatus to perform the method.

Abstract: A stereo camera system for a driver assistance system includes a first camera having a first aperture angle and a second camera having a second aperture angle, wherein the first camera produces a wide-angle camera image, the second camera produces a telephoto camera image, and the two camera images have an area of overlap. The first camera is a rolling shutter camera and the second camera is a global shutter camera. The two cameras' shutters are synchronized with one another in particular manners.

Abstract: System, methods, and other embodiments described herein relate to generating depth estimates of an environment depicted in a monocular image. In one embodiment, a method includes, in response to receiving the monocular image, processing the monocular image according to a depth model to generate a depth map. Processing the monocular images includes encoding the monocular image according to encoding layers of the depth model including iteratively encoding features of the monocular image to generate feature maps at successively refined representations using packing blocks within the encoding layers. Processing the monocular image further includes decoding the feature maps according to decoding layers of the depth model including iteratively decoding the features maps associated with separate ones of the packing blocks using unpacking blocks of the decoding layers to generate the depth map. The method includes providing the depth map as the depth estimates of objects represented in the monocular image.

Abstract: A 360-degree image data processing method performed by a 360-degree video reception apparatus according to the present invention includes: receiving 360-degree image data; obtaining information on an encoded picture and metadata from the 360-degree image data; decoding a picture based on the information on the encoded picture; and rendering the decoded picture and an overlay based on the metadata, wherein the metadata includes group information, the group information includes group type information indicating a group including a main media and the overlay that can be rendered together, the decoded picture includes the main media, and the group information includes information indicating whether a track belonging to the group includes the main media or the overlay.

Abstract: Systems and methods of repairing damage to the body structure of a vehicle based on a comparison of vehicle damage to vehicle specification data to indicate the magnitude and direction of vehicle damage to formulate a repair plan for review.

Abstract: A color temperature of each of a first sensed image that is sensed by a first image sensing device and a second sensed image that is sensed by a second image sensing device different from the first image sensing device is acquired, a color temperature that is common between the first image sensing device and the second image sensing device is decided based on the acquired color temperatures, and color information in an image sensed by the first image sensing device and an image sensed by the second image sensing device is adjusted based on the decided color temperature.

Abstract: The present disclosure illustrates a chromatic aberration adjusting method and apparatus of a detection device. The method includes the following steps: recording optical parameters corresponding to multiple image detection components when the multiple image detection components are respectively used to obtain images of multiple different standard films, selecting one of the optical parameters for each standard film, enter the selected optical parameter into a database as a base, and adjust the optical parameters of other image sensing components according to the database. The apparatus comprises a recording module, a selection module, an input module and an adjustment module.