Abstract: An image capture device may switch operation between a spherical capture mode or a non-spherical capture mode. Operation of the image capture device in the spherical capture mode includes generation of spherical visual content based on the visual content generated by multiple image sensors. Operation of the image capture device in the non-spherical capture mode includes generation of non-spherical visual content based on visual content generated by a single image sensor.

Abstract: The present invention discloses an object modeling and movement method. The method is applied to a mobile terminal, and the mobile terminal includes a color camera and a depth camera. The method includes: performing panoramic scanning on a target object by using the color camera and the depth camera, to obtain a 3D model of the target object; obtaining a target skeletal model; fusing the target skeletal model and the 3D model of the target object; obtaining a target movement manner; and controlling the target skeletal model in the target movement manner, to animate the 3D model of the target object in the target movement manner. This can implement integration from scanning, 3D reconstruction, skeletal rigging, to preset animation display for an object on one terminal, thereby implementing dynamization of a static object, and increasing interest in using the mobile terminal by a user.

Abstract: An optical system is provided. The optical system includes a first optical module, a second optical module and a third optical module. The first optical module is configured to connect at least one first optical member. The second optical module is configured to connect at least one second optical member. The third optical module is configured to connect a third optical member, wherein the third optical module is located between the first optical module and the second optical module.

Abstract: A computer vision processing device is provided which comprises memory configured to store data and a processor. The processor is configured to store captured image data in a first buffer and acquire access to the captured image data in the first buffer when the captured image data is available for processing. The processor is also configured to execute a first group of operations in a processing pipeline, each of which processes the captured image data accessed from the first buffer and return the first buffer for storing next captured image data when a last operation of the first group of operations executes.

Abstract: In certain embodiments, an electronic device comprises a camera; a tilt optical image stabilizer (OIS) configured to rotate the camera with respect to the electronic device, about at least one axis; and at least one processor operatively connected to the camera and the tilt OIS, wherein the at least one processor is configured to: operate the camera and the tilt OIS such that the camera is rotated about the at least one axis and captures an image, and synthesize a plurality of images captured by the camera.

Abstract: An image recording method in an image processing apparatus, includes the steps of acquiring, from a plurality of cameras, respective video images which the plurality of cameras start capturing in the sea before a first light that is lit in a first color is turned on and end capturing after a second light that is lit in a second color is turned on after the first tight is turned on, detecting, for each of the video images, a difference in luminance between chronologically adjacent frames in the video image, associating times of frames between the video images on the basis of the difference, and recording the video images with the associated times in a recording medium.

Abstract: Receive first context information (FCI) including entered in-field incident timeline information values from an in-field incident timeline application and a time associated with an entry of the FCI values. Access a mapping that maps in-field incident timeline information values to events having a pre-determined threshold confidence of occurring and identify an event associated with the received FCI. Determine a location associated with the entry of the FCI and a time period associated with the entry of the FCI. Access a camera location database and identify cameras that have a field of view including the location during the time period. Retrieve audio and/or video streams captured by the cameras during the time period. And provide the audio and/or video streams to machine learning training modules corresponding to machine learning models for detecting the event in and/or video streams for further training of the machine learning models.

Abstract: Methods for parameter alignment processing are described herein. An image capture device includes a first image capture device configured to capture a first image, a second image capture device configured to capture a second image, and an image signal processor connected to the first image capture device and to the second image capture device. The image signal processor is configured to apply, to the first image and the second image, at least two of a respective luminance lens shading (LLS) compensation factor, a respective color lens shading (CLS) compensation factor, a respective exposure difference compensation factor, a respective white balance compensation factor, a respective lens exposure correction (LEC) compensation factor, and a respective flare compensation factor, blend the compensated first image and the compensated second image to form a blended image, and output an image based on the blended image.

Abstract: A first mirror has a first reflecting surface convexed in a first direction, a first apex, and a first fan shape. A second mirror has a second reflecting surface convexed in a second direction, a second apex, and a second fan shape. An imaging optical system forms images from a first light emitted from an object, reflected by the first reflecting surface, and subsequently further reflected by the second reflecting surface, and a second light emitted from the object and reflected by the second reflecting surface. The first and second fan shapes have interior angles of 180° or more. A center position of the image sensor is displaced with respect to an optical axis of the imaging optical system. A short side of a photo-receiving surface of the image sensor and a center line of the image of the first or second fan shape are approximately parallel.

Abstract: The disclosure herein provides systems and methods for linking database entries of a network platform. The network platform provides a plurality of pages each dedicated to an item and including details of the item. A user-uploaded content can be linked to two or more of such pages or items provided on the network platform such that a navigable path is created among such pages or items. The linked pages or items may include an intermediary page or content that is linked to each of such pages or items.

Abstract: A display control system to generate a virtual environment in a vehicle includes an electronic control unit (ECU) configured to receive an input that corresponds to a selection of a video to be displayed on one or more display mediums provided in the vehicle. A relevance factor is determined between a current travel route of the vehicle and a travel route associated with the selected video. The relevance factor is determined in an event the vehicle is in motion along the current travel route. One or more video parameters of the selected video are adjusted based on the determined relevance factor. Display of at least the selected video on the one or more display mediums is controlled in the vehicle in motion in accordance with the adjusted one or more video parameters of the selected video.

Abstract: A system that has a plurality of monitors, a control unit, a first object and a second object is provided. The second object has one or more sensors operable to generate data and is remote from the first object. The control unit is configured to determine whether a first user is positioned on a first or on a second location of the first object and display a simulation of a second user onto the plurality of monitors based on the generated data. The second user is located remote from the first user and is displayed as being positioned in a different location on the first object than the first user on the first object. The control unit is further configured to activate the one or more heat generating devices to simulate a presence of the second user being positioned in the different location on the first object.

Abstract: The present disclosure relates to an image labeling system, comprising: a support framework, the support framework being a polyhedral structure constructed by a plurality of support boards; at least two cameras mounted on at least two support boards of the plurality of support boards of the support framework; and a labeling device configured to receive two or more images to be processed taken by the at least two cameras, and to label the hand in the image to be processed.

Abstract: Face authentication can easily be performed based on an input image including a mirror region reflected by a mirror without increasing a storage capacity of a database. With the database, for each face of a person to be authenticated, only one real front image is to be registered as a reference face image. A mirror image processing circuitry detects the mirror region from the input image and to subject a detected mirror region to lateral inversion processing to produce a processed image. A face detection processing circuitry detects a face image from the processed image to generate a detected face image. A face authentication processing circuitry compares the detected face image with the reference face image, to thereby perform face authentication.

Abstract: A method for a mobile device to photograph a panoramic image includes: photographing, by a camera in the mobile device, a first image at a first time, and sensing, by a sensor in the mobile device, a first directing vector when the camera photographs the first image; sensing, by the sensor, an actually measured directing vector of the camera at a second time; photographing, by the camera, a second image, and sensing, by the sensor, a second directing vector when the camera photographs the second image, in case that a first trigger photographing threshold or a second trigger photographing threshold is reached; determining whether a photographing stop condition is satisfied, in case that the photographing stop condition is satisfied, generating a panoramic image based on the images photographed by the camera.

Abstract: A method, a mixed reality (MR) system, and a recording medium for detecting a real-world light source in MR are provided. The method is applicable to the MR system having a computing apparatus and a head-mounted display (HMD). In the method, a plurality of light regions of a plurality of continuous images is analyzed, and each of the light regions is projected according to a coordinate position of the HMD corresponding to the plurality of continuous images to generate three-dimensional vectors. Then, the three-dimensional vectors are clustered to predict a directional light in a current image. Finally, a plurality of intersection points between the three-dimensional vectors is calculated, and a point light in the current image is predicted according to the intersection points.

Abstract: Methods, devices and systems are disclosed for improved depth perception in stereoscopic night vision devices. Among these are embodiments for aligning information overlays in the stereo view with associated objects, and for generating stereo information from single lenses or intensifiers. In some illustrative embodiments, a camera and position sensor are provided for at least two viewers, e.g., a pilot and a copilot, such that when a scene overlaps between viewers, the system produces a stereoptic scene, in which the users can more accurately determine a difference in depth between two or more distant objects. An illustrative binocular night vision system uses a high-resolution depth map to present binocular images to a user. In some embodiments, supplementary content can be overlaid, with an appropriate binocular disparity that is based on the depth map.

Abstract: A position information acquisition device for acquiring position information of a position acquisition target arranged in a space includes a processor configured to detect light that is based on identification information included in-common in captured images that are images of the space captured from a plurality of shooting directions that are different from each other, acquire a three-dimensional position in the space of the position information acquisition target identified by the identification information, based on detection positions of the detected light in the captured images, and position information of image capturing devices during capturing performed by the image capturing devices, acquire reliability degree information of the acquired three-dimensional position of the position information acquisition target, based on information relating to an imaging state of each image capturing device during capturing of the captured images, and store the acquired the reliability degree information in a storag

Abstract: Certain embodiments disclosed herein generate an image that is devoid of a person. Such an embodiment can includes using a camera to obtain a first image of a scene while a person is at a first location within the FOV of the camera, obtaining a second image of the scene while the person is at a second location within the FOV of the camera, and generating, based on the first and second images, a third image of the scene, such that the third image of the scene is devoid of the person and includes portions of the scene that were blocked by the person in the first and second images. Other embodiments disclosed herein determine spatial information for one or more items of interest within a graphical representation of a region generated based on one or more images of the region captured using a camera of a mobile device.

Abstract: A contact-free method of determining biometric parameters and physiological parameters of a subject of interest (20) to be examined by a medical imaging modality (10), comprising steps of taking (72) a picture by a first digital camera (52) including a total view of an examination table (44); applying (74) a computer vision algorithm or an image processing algorithm to the picture for determining a biometric parameter of the subject of interest (20) in relation to the examination table (44); taking (78) at least one picture with a second digital camera (58), whose field of view (60) includes a region of the subject of interest (20) that is related to the at least one determined biometric parameter; using data indicative of the determined biometric parameter to identify (82) a subset of pixels of the at least one picture taken by the second digital camera (58) that define a region of interest (64) from which at least one physiological parameter of the subject of interest (20) is to be determined, taking (84) a

Abstract: Based on a three-dimensional map in which three-dimensional information of a scene captured by an image capturing apparatus and a position and orientation of the apparatus are associated with each other and an image captured by the apparatus, a first position and orientation of the apparatus at the time of capturing the image is derived. The map is updated based on the captured image and the first position and orientation. A relative position and orientation between the first position and orientation and a second position and orientation of the apparatus derived by a method different from a method of deriving the first position and orientation or at a point of time different from a point of time of deriving the first position and orientation is derived. The map is corrected based on the relative position and orientation.

Abstract: A display system comprises: a shooting unit configured to shoot a periphery of a vehicle; a display unit configured to display an image shot by the shooting unit; and a display control unit configured to switch a display mode of display in the display unit between a first display mode for displaying a first display region and a second display mode for displaying a second display region that is different from the first display region. When the display mode is switched to the second display mode in a state in which a display range of the display unit has been adjusted in the first display mode, the display control unit displays the second display region regardless of the adjustment of the display range.

Abstract: Content delivery and playback methods and apparatus are described. The methods and apparatus are well suited for delivery and playback of content corresponding to a 360 degree environment and can be used to support streaming and/or real time delivery of 3D content corresponding to an event, e.g., while the event is ongoing or after the event is over. Portions of the environment are captured by cameras located at different positions. The content captured from different locations is encoded and made available for delivery. A playback device selects the content to be received based in a user's head position.

Abstract: The present invention provides a new and useful paradigm in wide area imaging, in which wide area imaging is provided by a step/dwell/image capture process and system to capture images and produce from the captured images a wide area image. The image capture is by a sensor that has a predetermined image field and provides image capture at a predetermined frame capture rate, and by a motorized step and dwell sequence of the sensor, where image capture is during a dwell, and the step and dwell sequence of the sensor is synchronized with the image capture rate of the sensor.

Abstract: A panoramic camera is provided with an orientation sensor to record orientation along with a panoramic image. The display or print image is selected from the captured panoramic image, a warped, non-scale-correct image. The selection of the display image is done using the orientation sensor. The orientation sensor data can be recorded with the panoramic image as metadata. The orientation sensor can also be used to control an external display and/or panoramic image selection during browsing.

Abstract: The described positional awareness techniques employing visual-inertial sensory data gathering and analysis hardware with reference to specific example implementations implement improvements in the use of sensors, techniques and hardware design that can enable specific embodiments to provide positional awareness to machines with improved speed and accuracy.

Abstract: An image processing system includes a camera interface and a processor. The camera interface acquires a captured image from at least one camera that images an article. The processor acquires a basic shape of the article and acquires an image captured with imaging parameters corresponding to the basic shape from the at least one camera through the camera interface.

Abstract: Systems, methods, and computer-readable storage media for how to select, suggest, and modify content, which is relevant to the user, on a user interface. The system does this by combining physiological data, location data, and historical data to create a multi-dimensional user state of the user, where at least one dimension is time. The system also identifies available content, ranks the available content based on the multi-dimensional user state, and transmits a user interface a suggestion for a top-ranked item within the ranked list of available content.

Abstract: Methods and systems for bandwidth efficient streaming and synching multimedia content at a desired quality of experience are described herein. One method includes: requesting, by a client device and from a server device, a multimedia file for streaming; receiving, at the client device and responsive to the request, a plurality of chunks of the multimedia file, wherein the chunks are of varying quality; streaming the multimedia file based on the received plurality of chunks; determining a first subset of the plurality of chunks that meet a predefined quality threshold, and a second subset of the plurality of chunks that do not meet the predefined quality threshold; requesting, by the client device and from the server device, a replacement chunk for each chunk of the second subset, wherein each replacement chunk meets the predefined quality threshold; and storing the multimedia file using the first subset and the replacement chunks.

Abstract: A detection apparatus includes a memory and a processor coupled to the memory. The processor configured to determine a position of each of a plurality of partial images relative to the wide-angle image, to extract, from among the plurality of partial images, a pair of partial images that are consecutive in an image-capturing order, that do not have an overlapping portion, and at least one of which includes an image of a damaged portion, to detect a region of the outside of the partial image to which a damaged portion is estimated to be continuous, as an image-capturing omission candidate region, to determine the image-capturing omission candidate region as an image-capturing omission region, in a case where the image-capturing omission candidate region is included in none of the other partial images, and to issue, based on the position, a notification of a position corresponding to the image-capturing omission region.

Abstract: An apparatus including an interface and a processor. The interface may be configured to receive first video frames of a first field of view captured by a first capture device and second video frames of a second field of view captured by a second capture device. The first capture device and the second capture device may have a symmetrical orientation with respect to a vehicle. The fields of view may have an overlapping region. The processor may be configured to select the capture devices to operate as a stereo pair of cameras based on the symmetrical orientation, receive the video frames from the interface, detect an object located in the overlapping region, perform a comparison operation on the object based on the symmetrical orientation with respect to the video frames and determine a distance of the object from the vehicle in response to the comparison operation.

Abstract: A system for generating multi-depth image sequence comprising a modulation array. The modulation array comprising a plurality of light modulators which may shift light incident upon the modulators by a number of degrees. The plurality of light modulators may shift light in concert according to a modulation shift pattern. The modulation shift pattern can be configured to focus incident light to a voxel or to form a 3-D image. One or more modulation shift patterns can be changed or cycled through to raster one or more image objects in one or more image depth planes.

Abstract: In various embodiments, a client device can obtain user field of view information and recommended field of view information of a panoramic video. The client can then determine, based on the user field of view information and the recommended field of view information, that a field of view range corresponding to a recommended field of view is not within a range of a user field of view. The client can display an image corresponding to the user field of view and an image within the recommended field of view. An image corresponding to a recommended field of view can be prompted and presented, so that the user independently determines whether to switch a field of view.

Abstract: An image acquisition apparatus based on a miniature camera matrix, comprising an image generation circuit board and a miniature lens matrix, wherein the image generation circuit board comprises an image generation circuit matrix, various image generation circuits in the image generation circuit matrix all comprise a miniature photosensitive element, and various miniature photosensitive elements constitute a miniature photosensitive element matrix; and various miniature lenses in the miniature lens matrix are fixedly arranged on the image generation circuit board and correspond to the various miniature photosensitive elements on a one-to-one basis, and the axes of the various miniature lenses are respectively perpendicular to a plane where the image generation circuit board is located.

Abstract: A method includes obtaining a video based on images detected with cameras mounted on a vehicle and displaying a portion of the video corresponding to a time offset and a viewing angle.

Abstract: To reduce size and cost of a stereo camera and an onboard lighting unit. A stereo camera includes a first convex hyperboloidal mirror and a second convex hyperboloidal mirror that share a central axis and are vertically disposed with vertexes facing each other, an imaging optical system, and an image sensor. The second convex hyperboloidal mirror is formed of an outer circumferential hyperboloidal mirror and an inner circumferential hyperboloidal mirror that share the central axis with different conic constants, and an absolute value of the conic constant of the inner circumferential hyperboloidal mirror is greater than an absolute value of the conic constant of the outer circumferential hyperboloidal mirror.

Abstract: A 360° view of an area is obtained by stitching together multiple images each of the images obtained at a different point of view. One of the points of view or each one of the points of view receives different angled views of different features in the image. Each feature in the image is therefore imaged from multiple different angles. The images are stitched together into a three-dimensional panorama which is optimized for display on a display where one image is intended for users left eye and another image is intended for the users right eye. The left eye sees features of the image from one field of view, and the right eye sees features of that same image from a different field of view, where each field in the image is shown to the different eyes at different points of view. Therefore, the different eyes perceive different parts of the depth of the image. And that last part into the specification and maybe into the claims.

Abstract: Embodiments of the disclosure provides a method and an apparatus for synchronizing viewing angles in Virtual Reality (VR) live streaming. The method comprises: determining transmitting user's viewing angle information corresponding to image frames in a process of playing VR content on a transmitting device side; and providing the image frames in the VR content and the transmitting user's viewing angle information corresponding to the image frames to a VR receiving device such that, when displaying the VR content, the VR receiving device is configured to determine, based on the transmitting user's viewing angle information corresponding to a current image frame to be displayed and a preset number of preceding image frames, a display angle for the VR receiving device to display the current image frame to be displayed.

Abstract: A system and method are provided for aiding an operator in operating a vehicle. In one embodiment, a system includes a sensor system configured to generate sensor data sensed from an environment of the vehicle. The system further includes a control module configured to, by a processor, generate a bowl view image of the environment based on the sensor data, identify at least one of a double object and a missing object in the bowl view image, generate a second bowl view image of the environment by re-stitching the sensor data based on the at least one of double object and missing object, and generate display data based on the second bowl view image.

Abstract: A 360° video capture, processing and display system includes a 360° video camera to capture a 360° raw video file, and a 360° video processing assembly to generate a 360° equirectangular geographic projection from each frame of the 360° raw video file. A 360° video processing algorithm captures a plurality of viewport images from each of a plurality of equirectangular geographic projections. A composite video displays includes a plurality of viewport images from a corresponding one of each of the 360° equirectangular geographic projections, wherein at least one of a top or bottom composite video display comprises a seamless integration of corresponding ones of the plurality of viewport images. The 360° video capture, processing and display system generates a multi-platform compatible processed 360° video file comprising the plurality of composite video displays, wherein the multi-platform compatible processed 360° video file is viewable on a video display assembly.

Abstract: Systems and methods for automatic detection and insetting of digital streams into a video. Various examples of such regions of interest to the user include, without limitation, content displayed on various electronic displays or written on electronic paper (electronic ink), content projected on various surfaces using electronic projectors, content of paper documents appearing in the video and/or content written on white (black) boards inside the video. For some content, such as whiteboards, paper documents or paintings in a museum, a participant (or curator) could have taken pictures of the regions, again stored digitally somewhere and available for download. These digital streams with content of interest to the user are obtained and then inset onto the view generated from the raw video feed, giving users the ability to view them at their native high resolution.

Abstract: A method of correcting an image obtained by an image acquisition device includes obtaining successive measurements, Gn, of device movement during exposure of each row of an image. An integration range, idx, is selected in proportion to an exposure time, te, for each row of the image. Accumulated measurements, Cn, of device movement for each row of an image are averaged across the integration range to provide successive filtered measurements, G, of device movement during exposure of each row of an image. The image is corrected for device movement using the filtered measurements G.

Abstract: Provided are a method and apparatus for encoding or decoding a 360-degree image. An image decoding method and apparatus according to an embodiment include: obtaining image data from a bitstream; decoding a first region of a projection image corresponding to a non-clipping region of a 360-degree image from the image data; obtaining information about a clipping region of the 360-degree image from the bitstream; determining a second region of the projection image, based on the information about the clipping region; and converting the projection image including the first region and the second region into the 360-degree image.

Abstract: An image pickup apparatus includes: an image sensor; a first detection unit configured to detect movement of the image sensor; a second detection unit configured to compare images to detect a positional deviation thereof; a combining unit configured to combine the images on a basis of the detected positional deviation and to generate a panoramic image; and a display control unit, in which in a case where combining of images up to an Nth frame is completed by the combining unit, on a basis of information about a size of the panoramic image generated by combining the images up to the Nth frame and the movement of the image sensor, which is detected by the first detection unit and corresponds to frames from an (N+1)th frame to an (N+M)th frame, the display control unit generates information indicating progress of combining of the panoramic image.

Abstract: Disclosed herein are techniques for eye illumination for eye position tracking. An illumination system includes a light source configured to emit a light beam in a first wavelength range, a beam splitter configured to split the light beam emitted by the light source into a plurality of light beams, a substrate configured to be placed in front of an eye of a user, and a plurality of reflectors located within the substrate. Each of the plurality of reflectors is configured to intercept one or more light beams from the plurality of light beams, reflect light in the one or more light beams from the plurality of light beams to the eye of the user, and transmit light in a second wavelength range different from the first wavelength range to the eye of the user. The substrate is transparent to both light in the first wavelength range and light in the second wavelength range.

Abstract: Feature points included in input images are extracted and matching information indicating mapping relationships for feature points included in different input images is generated. A reference image is selected among the input images based on the matching information. Valid images are determined among the input images by excluding noise images from the input images based on the matching information. A two-dimensional bundle adjustment is performed to generate synchronized images by aligning the valid images to the reference image. A merged image is generated by merging the reference image and the synchronized images. Image merging performance is enhanced by selecting the reference image highly correlated with the other input images and estimating exact homography based on the reference image.

Abstract: A data handling or patching system operates to reduce redundant data within a data storage. Data files are compared, and a data difference is output. In files that have very similar data, the data difference between values is relatively small, and thus when a basic data file and a data difference file are stored, data redundancy is significantly reduced. The data difference of “diff” file can then be used to losslessly reproduce the data of either of the compared files. A first or primary port is dedicated for base quality transmissions on which the broadcasting client sends the lowest available quality. Additional or secondary ports enable transmission of higher than base quality data, sent as “diff's” of the base quality. The receiving client combines the “diff” data on the secondary ports with the base data of the first port, to produce higher quality media.

Abstract: A distributed object tracking system includes a plurality of image analysis devices and a cluster management service device connected to the plurality of image analysis devices, wherein each image analysis device analyzes an object in a corresponding real-time video stream to generate an analysis result for tracking the object, and the cluster management service device includes a tracking module to form a trajectory of the object according to the analysis result generated by each of the plurality of image analysis devices.

Abstract: Embodiments herein disclose a method for recommending an image capture mode by an electronic device. The method includes identifying, by the electronic device, at least one ROI displayed in a camera preview of the electronic device for capturing an image in a non-ultra-wide image capture mode. Further, the method includes determining, by the electronic device, that the at least one ROI is suitable to capture in an ultra-wide image capture mode. Further, the method includes providing, by the electronic device, at least one recommendation to switch to the ultra-wide image capture mode from the non-ultra-wide image capture mode for capturing the image.

Abstract: Provided in the present invention are a method for achieving a bullet time capturing effect and a panoramic camera. The method comprises: acquiring a panoramic video captured when a panoramic camera rotates around a capture target; acquiring from within the panoramic video hemispherical images close to the side of the capture target; splicing the hemispherical images to generate a spliced image; and fixing a viewpoint of the spliced image, thus achieving a bullet time capturing effect. According to the present invention, only one panoramic camera is needed to be able to capture the bullet time capturing effect, so that the capturing cost of the bullet time capturing effect in the present invention is low. Meanwhile, since the bullet time capturing effect is obtained by means of a panoramic video being captured when a panoramic camera rotates around a capture target and processing being carried out on the panoramic video, the precision is high.