Abstract: According to at least one embodiment, a photographing device includes a camera interface and a processor. The camera interface supplies a control signal to a camera and acquires a photographed image photographed by the camera. The processor causes the camera to photograph a wide area image in a detection region of target objects set as a photographing range, detects the target objects present in the wide area image photographed by the camera, determines a photographing order of the target objects detected from the wide area image, and causes the camera to photograph a narrow area image of one target object selected according to the photographing order.

Abstract: Provided is an imaging unit that includes two or more imaging devices that are different from each other in imaging direction, and a substrate formed with each of the imaging devices. The substrate has a coupler formed between the imaging devices. The imaging unit including the plurality of imaging devices is able to yield a high-quality image when capturing an image of a wide range.

Abstract: Example embodiments described herein therefore relate to an object-model based event detection system that comprises a plurality of sensor devices, to perform operations that include: generating sensor data at the plurality of sensor devices; accessing the sensor data generated by the plurality of sensor devices; detecting an event, or precursor to an event, based on the sensor data, wherein the detected event corresponds to an event category; accessing an object model associated with the event type in response to detecting the event, wherein the object model defines a procedure to be applied by the event detection system to the sensor data; and streaming at least a portion of a plurality of data streams generated by the plurality of sensor devices to a server system based on the procedure, wherein the server system may perform further analysis or visualization based on the portion of the plurality of data streams.

Abstract: Techniques, devices, and systems are described for determining and adjusting a perspective angle of a drone sensor such as a camera. A described drone system can include an aerial drone; a ground station; an actuator to adjust the drone camera's field of view; and a controller. The controller can be configured to receive an event associated with one or more spatial coordinates or zones, determine the camera's current perspective angle, determine a target perspective angle based on the event such that the target perspective angle will cause the camera to capture imagery from the one or more spatial coordinates or zones, and cause the actuator to adjust the camera from the current perspective angle to the target perspective angle.

Abstract: The present invention is applicable to the field of videos, and provides a panoramic video anti-shake method and a portable terminal. The method comprises: obtaining world coordinates of any reference point in a world coordinate system in real time, and simultaneously obtaining camera coordinates corresponding to the reference point in the portable terminal and an angular velocity value of a current state of a gyroscope in the portable terminal; smoothing the motion of a camera using an extended Kalman filter; decomposing the smoothed motion to synthesize virtual lens motion of a free lens mode, and calculating the rotation amount of the virtual lens; and re-projecting an original video to generate a stable video.

Abstract: One or more images of an object, each from a respective viewpoint, may be captured at a camera at a mobile computing device. The images may be compared to reference data to identify a difference between the images and the reference data. Image capture guidance may be provided on a display screen for capturing another one or more images of the object that includes the identified difference.

Abstract: A vehicular vision system includes a rear backup vehicle camera, a trailer camera disposed at a rear of a trailer, a display device disposed in the vehicle, and an electronic control unit (ECU) disposed in the vehicle. With the trailer not hitched to the vehicle and during a reversing maneuver of the vehicle, the ECU generates video images derived at least in part from image data captured by the rear backup vehicle camera and the display device displays the video images. With the trailer hitched to the vehicle, image data captured by the trailer camera is provided to the vehicle via data communication over powerline using a DC powerline, and the display device displays the video images derived at least in part from image data captured by the trailer camera for viewing by the driver of the vehicle during the driving maneuver of the vehicle with the trailer hitched thereto.

Abstract: Methods and apparatus for shear correction in spherical projections. Embedded devices generally lack the compute and/or memory resources to implement two-dimensional (2D) stitches for spherical projections. Objects (such as a mounting fixture) within a certain distance of the camera may experience a 2D “tear” or “shear” artifact when stitched. Various embodiments of the present disclosure perform two orthogonal 1D stitches: (i) latitudinally across the meridian and (ii) longitudinally along the meridian to approximate the effect of a 2D stitch. Notably, the 1D stitch may be less precise than a true 2D stitch, however the image portion being stitched (e.g., the camera mount) is not the user's subject of interest and can be rendered much more loosely without adverse consequence. Temporal smoothing optimizations are additionally disclosed.

Abstract: A bird's-eye view image generating device for a vessel generates a bird's-eye view image from a view point above a vessel by projective transformation of images obtained by cameras installed on the vessel into a bird's-eye view plane. Imaging regions to be respectively imaged by the cameras are positioned such that imaging regions adjacent to each other have an overlapping region. A method of calibrating the bird's-eye view image generating device includes acquiring calibration images by imaging a calibration marker with the cameras in which the calibration marker is positioned in the overlapping region in a calibration plane, and acquiring application parameters to be applied for projective transformation of the calibration images into the calibration plane so that images of the calibration marker included in the calibration images match each other.

Abstract: There is provided a computer implemented method for displaying a video stream of a scene (100) captured by a video capture device on a display of a client device.

Abstract: The present disclosure includes methods and systems for streaming high-performance virtual reality video using adaptive rate allocation. In particular, an adaptive rate allocation system partitions a panorama video into segments or tiles and assigns priorities to each tile or segment based on input (e.g., a viewport of field-of-view) from a user client device. Further, the adaptive rate allocation system streams each tile or segment to the user client device according to the adaptive rate allocation, which maximizes bandwidth efficiency and video quality. In this manner, the adaptive rate allocation system delivers higher quality content to regions in the panorama video where a user is currently looking/most likely to look.

Abstract: A method and apparatus is described comprising: obtaining first input data from a first camera of a multi-camera device; obtaining second input data from a second camera of the multi-camera device (wherein the second camera is orientated in a different direction to the first camera); defining a first region or object of interest for the first camera and/or a second region or object of interest for the second camera; tracking the first region or object of interest and/or the second region or object of interest; generating a first output data based on the first input data; generating a second output data based on the second input data; and generating a multi-camera output that includes the first and second output data.

Abstract: An image capture device may switch operation between a spherical capture mode or a non-spherical capture mode. Operation of the image capture device in the spherical capture mode includes generation of spherical visual content based on the visual content generated by multiple image sensors. Operation of the image capture device in the non-spherical capture mode includes generation of non-spherical visual content based on visual content generated by a single image sensor.

Abstract: The present invention discloses an object modeling and movement method. The method is applied to a mobile terminal, and the mobile terminal includes a color camera and a depth camera. The method includes: performing panoramic scanning on a target object by using the color camera and the depth camera, to obtain a 3D model of the target object; obtaining a target skeletal model; fusing the target skeletal model and the 3D model of the target object; obtaining a target movement manner; and controlling the target skeletal model in the target movement manner, to animate the 3D model of the target object in the target movement manner. This can implement integration from scanning, 3D reconstruction, skeletal rigging, to preset animation display for an object on one terminal, thereby implementing dynamization of a static object, and increasing interest in using the mobile terminal by a user.

Abstract: An optical system is provided. The optical system includes a first optical module, a second optical module and a third optical module. The first optical module is configured to connect at least one first optical member. The second optical module is configured to connect at least one second optical member. The third optical module is configured to connect a third optical member, wherein the third optical module is located between the first optical module and the second optical module.

Abstract: In certain embodiments, an electronic device comprises a camera; a tilt optical image stabilizer (OIS) configured to rotate the camera with respect to the electronic device, about at least one axis; and at least one processor operatively connected to the camera and the tilt OIS, wherein the at least one processor is configured to: operate the camera and the tilt OIS such that the camera is rotated about the at least one axis and captures an image, and synthesize a plurality of images captured by the camera.

Abstract: A computer vision processing device is provided which comprises memory configured to store data and a processor. The processor is configured to store captured image data in a first buffer and acquire access to the captured image data in the first buffer when the captured image data is available for processing. The processor is also configured to execute a first group of operations in a processing pipeline, each of which processes the captured image data accessed from the first buffer and return the first buffer for storing next captured image data when a last operation of the first group of operations executes.

Abstract: An image recording method in an image processing apparatus, includes the steps of acquiring, from a plurality of cameras, respective video images which the plurality of cameras start capturing in the sea before a first light that is lit in a first color is turned on and end capturing after a second light that is lit in a second color is turned on after the first tight is turned on, detecting, for each of the video images, a difference in luminance between chronologically adjacent frames in the video image, associating times of frames between the video images on the basis of the difference, and recording the video images with the associated times in a recording medium.

Abstract: Receive first context information (FCI) including entered in-field incident timeline information values from an in-field incident timeline application and a time associated with an entry of the FCI values. Access a mapping that maps in-field incident timeline information values to events having a pre-determined threshold confidence of occurring and identify an event associated with the received FCI. Determine a location associated with the entry of the FCI and a time period associated with the entry of the FCI. Access a camera location database and identify cameras that have a field of view including the location during the time period. Retrieve audio and/or video streams captured by the cameras during the time period. And provide the audio and/or video streams to machine learning training modules corresponding to machine learning models for detecting the event in and/or video streams for further training of the machine learning models.

Abstract: A first mirror has a first reflecting surface convexed in a first direction, a first apex, and a first fan shape. A second mirror has a second reflecting surface convexed in a second direction, a second apex, and a second fan shape. An imaging optical system forms images from a first light emitted from an object, reflected by the first reflecting surface, and subsequently further reflected by the second reflecting surface, and a second light emitted from the object and reflected by the second reflecting surface. The first and second fan shapes have interior angles of 180° or more. A center position of the image sensor is displaced with respect to an optical axis of the imaging optical system. A short side of a photo-receiving surface of the image sensor and a center line of the image of the first or second fan shape are approximately parallel.

Abstract: Methods for parameter alignment processing are described herein. An image capture device includes a first image capture device configured to capture a first image, a second image capture device configured to capture a second image, and an image signal processor connected to the first image capture device and to the second image capture device. The image signal processor is configured to apply, to the first image and the second image, at least two of a respective luminance lens shading (LLS) compensation factor, a respective color lens shading (CLS) compensation factor, a respective exposure difference compensation factor, a respective white balance compensation factor, a respective lens exposure correction (LEC) compensation factor, and a respective flare compensation factor, blend the compensated first image and the compensated second image to form a blended image, and output an image based on the blended image.

Abstract: The disclosure herein provides systems and methods for linking database entries of a network platform. The network platform provides a plurality of pages each dedicated to an item and including details of the item. A user-uploaded content can be linked to two or more of such pages or items provided on the network platform such that a navigable path is created among such pages or items. The linked pages or items may include an intermediary page or content that is linked to each of such pages or items.

Abstract: A display control system to generate a virtual environment in a vehicle includes an electronic control unit (ECU) configured to receive an input that corresponds to a selection of a video to be displayed on one or more display mediums provided in the vehicle. A relevance factor is determined between a current travel route of the vehicle and a travel route associated with the selected video. The relevance factor is determined in an event the vehicle is in motion along the current travel route. One or more video parameters of the selected video are adjusted based on the determined relevance factor. Display of at least the selected video on the one or more display mediums is controlled in the vehicle in motion in accordance with the adjusted one or more video parameters of the selected video.

Abstract: The present disclosure relates to an image labeling system, comprising: a support framework, the support framework being a polyhedral structure constructed by a plurality of support boards; at least two cameras mounted on at least two support boards of the plurality of support boards of the support framework; and a labeling device configured to receive two or more images to be processed taken by the at least two cameras, and to label the hand in the image to be processed.

Abstract: A system that has a plurality of monitors, a control unit, a first object and a second object is provided. The second object has one or more sensors operable to generate data and is remote from the first object. The control unit is configured to determine whether a first user is positioned on a first or on a second location of the first object and display a simulation of a second user onto the plurality of monitors based on the generated data. The second user is located remote from the first user and is displayed as being positioned in a different location on the first object than the first user on the first object. The control unit is further configured to activate the one or more heat generating devices to simulate a presence of the second user being positioned in the different location on the first object.

Abstract: A method for a mobile device to photograph a panoramic image includes: photographing, by a camera in the mobile device, a first image at a first time, and sensing, by a sensor in the mobile device, a first directing vector when the camera photographs the first image; sensing, by the sensor, an actually measured directing vector of the camera at a second time; photographing, by the camera, a second image, and sensing, by the sensor, a second directing vector when the camera photographs the second image, in case that a first trigger photographing threshold or a second trigger photographing threshold is reached; determining whether a photographing stop condition is satisfied, in case that the photographing stop condition is satisfied, generating a panoramic image based on the images photographed by the camera.

Abstract: Face authentication can easily be performed based on an input image including a mirror region reflected by a mirror without increasing a storage capacity of a database. With the database, for each face of a person to be authenticated, only one real front image is to be registered as a reference face image. A mirror image processing circuitry detects the mirror region from the input image and to subject a detected mirror region to lateral inversion processing to produce a processed image. A face detection processing circuitry detects a face image from the processed image to generate a detected face image. A face authentication processing circuitry compares the detected face image with the reference face image, to thereby perform face authentication.

Abstract: A method, a mixed reality (MR) system, and a recording medium for detecting a real-world light source in MR are provided. The method is applicable to the MR system having a computing apparatus and a head-mounted display (HMD). In the method, a plurality of light regions of a plurality of continuous images is analyzed, and each of the light regions is projected according to a coordinate position of the HMD corresponding to the plurality of continuous images to generate three-dimensional vectors. Then, the three-dimensional vectors are clustered to predict a directional light in a current image. Finally, a plurality of intersection points between the three-dimensional vectors is calculated, and a point light in the current image is predicted according to the intersection points.

Abstract: Methods, devices and systems are disclosed for improved depth perception in stereoscopic night vision devices. Among these are embodiments for aligning information overlays in the stereo view with associated objects, and for generating stereo information from single lenses or intensifiers. In some illustrative embodiments, a camera and position sensor are provided for at least two viewers, e.g., a pilot and a copilot, such that when a scene overlaps between viewers, the system produces a stereoptic scene, in which the users can more accurately determine a difference in depth between two or more distant objects. An illustrative binocular night vision system uses a high-resolution depth map to present binocular images to a user. In some embodiments, supplementary content can be overlaid, with an appropriate binocular disparity that is based on the depth map.

Abstract: A position information acquisition device for acquiring position information of a position acquisition target arranged in a space includes a processor configured to detect light that is based on identification information included in-common in captured images that are images of the space captured from a plurality of shooting directions that are different from each other, acquire a three-dimensional position in the space of the position information acquisition target identified by the identification information, based on detection positions of the detected light in the captured images, and position information of image capturing devices during capturing performed by the image capturing devices, acquire reliability degree information of the acquired three-dimensional position of the position information acquisition target, based on information relating to an imaging state of each image capturing device during capturing of the captured images, and store the acquired the reliability degree information in a storag

Abstract: Certain embodiments disclosed herein generate an image that is devoid of a person. Such an embodiment can includes using a camera to obtain a first image of a scene while a person is at a first location within the FOV of the camera, obtaining a second image of the scene while the person is at a second location within the FOV of the camera, and generating, based on the first and second images, a third image of the scene, such that the third image of the scene is devoid of the person and includes portions of the scene that were blocked by the person in the first and second images. Other embodiments disclosed herein determine spatial information for one or more items of interest within a graphical representation of a region generated based on one or more images of the region captured using a camera of a mobile device.

Abstract: A contact-free method of determining biometric parameters and physiological parameters of a subject of interest (20) to be examined by a medical imaging modality (10), comprising steps of taking (72) a picture by a first digital camera (52) including a total view of an examination table (44); applying (74) a computer vision algorithm or an image processing algorithm to the picture for determining a biometric parameter of the subject of interest (20) in relation to the examination table (44); taking (78) at least one picture with a second digital camera (58), whose field of view (60) includes a region of the subject of interest (20) that is related to the at least one determined biometric parameter; using data indicative of the determined biometric parameter to identify (82) a subset of pixels of the at least one picture taken by the second digital camera (58) that define a region of interest (64) from which at least one physiological parameter of the subject of interest (20) is to be determined, taking (84) a

Abstract: A display system comprises: a shooting unit configured to shoot a periphery of a vehicle; a display unit configured to display an image shot by the shooting unit; and a display control unit configured to switch a display mode of display in the display unit between a first display mode for displaying a first display region and a second display mode for displaying a second display region that is different from the first display region. When the display mode is switched to the second display mode in a state in which a display range of the display unit has been adjusted in the first display mode, the display control unit displays the second display region regardless of the adjustment of the display range.

Abstract: Based on a three-dimensional map in which three-dimensional information of a scene captured by an image capturing apparatus and a position and orientation of the apparatus are associated with each other and an image captured by the apparatus, a first position and orientation of the apparatus at the time of capturing the image is derived. The map is updated based on the captured image and the first position and orientation. A relative position and orientation between the first position and orientation and a second position and orientation of the apparatus derived by a method different from a method of deriving the first position and orientation or at a point of time different from a point of time of deriving the first position and orientation is derived. The map is corrected based on the relative position and orientation.

Abstract: Content delivery and playback methods and apparatus are described. The methods and apparatus are well suited for delivery and playback of content corresponding to a 360 degree environment and can be used to support streaming and/or real time delivery of 3D content corresponding to an event, e.g., while the event is ongoing or after the event is over. Portions of the environment are captured by cameras located at different positions. The content captured from different locations is encoded and made available for delivery. A playback device selects the content to be received based in a user's head position.

Abstract: The present invention provides a new and useful paradigm in wide area imaging, in which wide area imaging is provided by a step/dwell/image capture process and system to capture images and produce from the captured images a wide area image. The image capture is by a sensor that has a predetermined image field and provides image capture at a predetermined frame capture rate, and by a motorized step and dwell sequence of the sensor, where image capture is during a dwell, and the step and dwell sequence of the sensor is synchronized with the image capture rate of the sensor.

Abstract: The described positional awareness techniques employing visual-inertial sensory data gathering and analysis hardware with reference to specific example implementations implement improvements in the use of sensors, techniques and hardware design that can enable specific embodiments to provide positional awareness to machines with improved speed and accuracy.

Abstract: An image processing system includes a camera interface and a processor. The camera interface acquires a captured image from at least one camera that images an article. The processor acquires a basic shape of the article and acquires an image captured with imaging parameters corresponding to the basic shape from the at least one camera through the camera interface.

Abstract: A panoramic camera is provided with an orientation sensor to record orientation along with a panoramic image. The display or print image is selected from the captured panoramic image, a warped, non-scale-correct image. The selection of the display image is done using the orientation sensor. The orientation sensor data can be recorded with the panoramic image as metadata. The orientation sensor can also be used to control an external display and/or panoramic image selection during browsing.

Abstract: Systems, methods, and computer-readable storage media for how to select, suggest, and modify content, which is relevant to the user, on a user interface. The system does this by combining physiological data, location data, and historical data to create a multi-dimensional user state of the user, where at least one dimension is time. The system also identifies available content, ranks the available content based on the multi-dimensional user state, and transmits a user interface a suggestion for a top-ranked item within the ranked list of available content.

Abstract: Methods and systems for bandwidth efficient streaming and synching multimedia content at a desired quality of experience are described herein. One method includes: requesting, by a client device and from a server device, a multimedia file for streaming; receiving, at the client device and responsive to the request, a plurality of chunks of the multimedia file, wherein the chunks are of varying quality; streaming the multimedia file based on the received plurality of chunks; determining a first subset of the plurality of chunks that meet a predefined quality threshold, and a second subset of the plurality of chunks that do not meet the predefined quality threshold; requesting, by the client device and from the server device, a replacement chunk for each chunk of the second subset, wherein each replacement chunk meets the predefined quality threshold; and storing the multimedia file using the first subset and the replacement chunks.

Abstract: A detection apparatus includes a memory and a processor coupled to the memory. The processor configured to determine a position of each of a plurality of partial images relative to the wide-angle image, to extract, from among the plurality of partial images, a pair of partial images that are consecutive in an image-capturing order, that do not have an overlapping portion, and at least one of which includes an image of a damaged portion, to detect a region of the outside of the partial image to which a damaged portion is estimated to be continuous, as an image-capturing omission candidate region, to determine the image-capturing omission candidate region as an image-capturing omission region, in a case where the image-capturing omission candidate region is included in none of the other partial images, and to issue, based on the position, a notification of a position corresponding to the image-capturing omission region.

Abstract: An apparatus including an interface and a processor. The interface may be configured to receive first video frames of a first field of view captured by a first capture device and second video frames of a second field of view captured by a second capture device. The first capture device and the second capture device may have a symmetrical orientation with respect to a vehicle. The fields of view may have an overlapping region. The processor may be configured to select the capture devices to operate as a stereo pair of cameras based on the symmetrical orientation, receive the video frames from the interface, detect an object located in the overlapping region, perform a comparison operation on the object based on the symmetrical orientation with respect to the video frames and determine a distance of the object from the vehicle in response to the comparison operation.

Abstract: An image acquisition apparatus based on a miniature camera matrix, comprising an image generation circuit board and a miniature lens matrix, wherein the image generation circuit board comprises an image generation circuit matrix, various image generation circuits in the image generation circuit matrix all comprise a miniature photosensitive element, and various miniature photosensitive elements constitute a miniature photosensitive element matrix; and various miniature lenses in the miniature lens matrix are fixedly arranged on the image generation circuit board and correspond to the various miniature photosensitive elements on a one-to-one basis, and the axes of the various miniature lenses are respectively perpendicular to a plane where the image generation circuit board is located.

Abstract: In various embodiments, a client device can obtain user field of view information and recommended field of view information of a panoramic video. The client can then determine, based on the user field of view information and the recommended field of view information, that a field of view range corresponding to a recommended field of view is not within a range of a user field of view. The client can display an image corresponding to the user field of view and an image within the recommended field of view. An image corresponding to a recommended field of view can be prompted and presented, so that the user independently determines whether to switch a field of view.

Abstract: A system for generating multi-depth image sequence comprising a modulation array. The modulation array comprising a plurality of light modulators which may shift light incident upon the modulators by a number of degrees. The plurality of light modulators may shift light in concert according to a modulation shift pattern. The modulation shift pattern can be configured to focus incident light to a voxel or to form a 3-D image. One or more modulation shift patterns can be changed or cycled through to raster one or more image objects in one or more image depth planes.

Abstract: A method includes obtaining a video based on images detected with cameras mounted on a vehicle and displaying a portion of the video corresponding to a time offset and a viewing angle.

Abstract: A system and method are provided for aiding an operator in operating a vehicle. In one embodiment, a system includes a sensor system configured to generate sensor data sensed from an environment of the vehicle. The system further includes a control module configured to, by a processor, generate a bowl view image of the environment based on the sensor data, identify at least one of a double object and a missing object in the bowl view image, generate a second bowl view image of the environment by re-stitching the sensor data based on the at least one of double object and missing object, and generate display data based on the second bowl view image.

Abstract: Embodiments of the disclosure provides a method and an apparatus for synchronizing viewing angles in Virtual Reality (VR) live streaming. The method comprises: determining transmitting user's viewing angle information corresponding to image frames in a process of playing VR content on a transmitting device side; and providing the image frames in the VR content and the transmitting user's viewing angle information corresponding to the image frames to a VR receiving device such that, when displaying the VR content, the VR receiving device is configured to determine, based on the transmitting user's viewing angle information corresponding to a current image frame to be displayed and a preset number of preceding image frames, a display angle for the VR receiving device to display the current image frame to be displayed.

Abstract: A 360° view of an area is obtained by stitching together multiple images each of the images obtained at a different point of view. One of the points of view or each one of the points of view receives different angled views of different features in the image. Each feature in the image is therefore imaged from multiple different angles. The images are stitched together into a three-dimensional panorama which is optimized for display on a display where one image is intended for users left eye and another image is intended for the users right eye. The left eye sees features of the image from one field of view, and the right eye sees features of that same image from a different field of view, where each field in the image is shown to the different eyes at different points of view. Therefore, the different eyes perceive different parts of the depth of the image. And that last part into the specification and maybe into the claims.