Abstract: The disclosure relates to a method for the situational transmission of surroundings data of a vehicle, comprising the steps: determining a driving situation of the vehicle; determining relevant surroundings data from recorded surroundings data based on the driving situation, wherein the relevant surroundings data are a subset of the recorded surroundings data that are relevant to the driving situation; and providing the relevant surroundings data to an external data processing device.

Abstract: An imaging apparatus mountable on a moveable apparatus includes a plurality of lighting-imaging units, each configured to capture an image of a different area on an object in a direction intersecting with a movement direction of the moveable apparatus. The each of the plurality of lighting-imaging units includes a light source unit configured to illuminate a partial area on the object as a lighting area; and an image capture unit configured to capture an image of an image capture area set within the lighting area. The plurality of lighting-imaging units captures an image of a non-overlapped lighting area on the object where the lighting areas of the plurality of lighting-imaging units do not overlap with each other.

Abstract: A system for generating real-time panoramic video is disclosed. The system comprises a plurality of micro panoramic cameras which are enabled on a processing unit and which are configured to simultaneously capture video frames from each of the plurality of micro panoramic cameras, wherein the video frames captured by two consecutive camera sensors from the plurality of camera sensors include an overlapping field of view, synchronize and feed the captured images to the processing unit with equal predefined delay, stitch the video frames captured by each of the plurality of micro panoramic cameras and output a real-time panoramic video on a display.

Abstract: An electronic device including first and second housings rotated on a hinge unit, a display exposed to an outside through the first and second housings, first and second cameras disposed respectively in the first and second housings, at least one sensor, and at least one processor, is provided. The at least one processor is configured to obtain first and second images using the first camera and second cameras, respectively, generate a first panoramic image based on the first and second images, detect a rotation of at least one of the first housing or the second housing through the hinge unit using the at least one sensor, obtain at least one image using at least one of the first or second cameras while the at least one housing rotates, and generate a second panoramic image based on the first panoramic image and the at least one image.

Abstract: A multicamera panoramic imaging system having no parallax. In an example, the multicamera panoramic imaging system includes multiple discrete, imaging systems disposed in a side-by-side array, wherein a field of view of each discrete, imaging systems is conjoined with a field of view of each adjacent discrete imaging system, further wherein a stencil of chief rays at the edge of the field of view of any one of the discrete imaging systems will be substantially parallel to a stencil of chief rays at the edge of the field of view of any adjacent ones of the discrete imaging systems such that all of the substantially parallel stencils of chief rays appear to converge to a common point when viewed from object space. A method for forming an image of an object having no parallax.

Abstract: A sensor pod system includes one or more sensor pods with a plurality of sensors configured to collect data from an environment. A sensor pod may have an effective field of view created by individual sensors with overlapping fields of view. The sensor pod system may include sensors of different types and modalities. Sensor pods of the sensor pod system may be modularly installed on a vehicle, for example, an autonomous vehicle and collect and provide data of the environment during operation of the vehicle. A combination of techniques may be used to calibrate a sensor pod prior to installation in the vehicle and may be used to determine if the sensor pod is compatible with other sensor pods and may also be used to calibrate other sensors when integrating the sensor pod into the vehicle.

Abstract: A video display method for a video display device is provided. The video display method comprises: acquiring a plurality of captured images from each of a plurality of cameras for each frame; generating a plurality of correction images from the plurality of captured images by performing parallax correction in each of the plurality of captured images for each frame, the parallax correction being performed between images captured by adjacent cameras; and compositing the plurality of correction images to generate a 360° panoramic composite image for each frame. An amount of the parallax correction of each captured image in each frame is limited so that an amount of change from a previous amount of the parallax correction in a previous frame is within a range defined by a predetermined limitation value.

Abstract: A scalable tracking system processes video of a space to track the positions of people within a space. The tracking system determines local coordinates for the people within frames of the video and then assigns these coordinates to time windows based on when the frames were received. The tracking system then combines or clusters certain local coordinates that have been assigned to the same time window to determine a combined coordinate for a person during that time window.

Abstract: A method for estimating and adjusting crop residue parameters may include controlling an operation of a tillage implement as the implement is being towed by a work vehicle across the field to perform a tillage operation and receiving a pre-tilled image of an imaged portion of the field located to one side of a first section of the field as the implement is being towed across the first section of the field. The method may also include receiving a post-tilled image of the imaged portion of the field as the implement is being towed across the field, analyzing the pre-tilled and post-tilled images of the imaged portion of the field to estimate a crop residue parameter for the field, and, when the estimated parameter differs from a target associated with such parameter, actively adjusting the operation of the tillage implement in a manner designed to adjust the crop residue parameter.

Abstract: A multi-lens camera is disclosed in the embodiment of the present application. The multi-lens camera includes a main casing assembly, lenses, a lens regulator, a supporting mechanism and a transparent cover; wherein the transparent cover is mounted on the main casing assembly, and the lens regulator is mounted within a space formed by the main casing assembly and the transparent cover; the transparent cover includes a flat portion and a curved portion surrounding the flat portion; the lens regulator includes a fixing disc and at least two lens brackets, and each of the lens brackets includes a first bracket for mounting a lens; the first bracket is movably arranged on the fixing disc and is movable along the circumferential direction of the fixing disc. The solution described above can solve the problem of the transparent cover of the multi-lens camera having poor resistance to deformation as described in the background.

Abstract: Disclosed herein are various embodiments for an augmented reality interaction, modeling, and annotation system. An embodiment operates by displaying a digital model of an object within an interface of an augmented reality computing system, wherein the model is associated with a first set of dimensions corresponding to a size of the object and a second set of dimensions corresponding to a size of the digital model. A command to resize the digital model to a third set of dimensions different from the second set of dimensions is received from a user. The digital model is resized within the interface in accordance with the third set of dimensions. The resized digital model of the object is displayed in accordance with the third set of dimensions, wherein the first set of dimensions corresponding to the size of the object remains unchanged within the augmented reality computing system.

Abstract: An imaging system may include a plurality of networked imagers arranged in a geometric arrangement with respective fields of view covering part or all of a panoramic geometry, at least one inertial measurement unit (IMU) in communication with the networked imagers configured to generate orientation data indicating orientations of the plurality of networked imagers, and at least one processor in communication with the networked imagers and the at least one IMU. The at least one processor may be configured to receive a plurality of images from the plurality of networked imagers and combine the plurality of images into at least one combined image by positioning pixels of each of the plurality of images relative to pixels of the remaining plurality of images, associating the positioned pixels with the orientation data, and merging the oriented pixels of each of the plurality of images into the at least one combined image.

Abstract: A transparent cover of an optical camera system comprises a curved sidewall portion having an outer contour formed by the rotation of a preset continuous curve. The preset continuous curve comprises a first curve segment and a second curve segment, each having a curvature no more than a first preset value, wherein the first back focus offset of a curved surface corresponding to the first curve segment does not exceed the second preset value, and a second back focus offset of a curved surface corresponding to the second curve segment does not exceed a third preset value. A first line segment is formed by connecting an end point of the preset continuous curve with a center of a circle circumscribing edges of a camera, and an included angle between the first line segment and a boundary line between the first and second curve segments is greater than 0.

Abstract: The present disclosure provides a control method. The method includes acquiring a first trigger instruction; executing a first function module in response to the first trigger instruction, the first function module calling one or more first image acquisition devices; acquiring a second trigger instruction during the operation of the first function module; and executing a second function module in response to the second trigger instruction, the second function module calling one or more second image acquisition devices, and the first function module being different from the second function module. The one or more first image acquisition devices and the one or more second image acquisition devices are connected to a same electronic device.

Abstract: A semiconductor device includes an image acquisition circuit which acquires a plurality of captured image data obtained by capturing a plurality of images, an estimation source image generation circuit which cancels effects of initial color adjustment processing on each captured image data to generate image data of a plurality of estimation source images, a readjustment circuit which divides each estimation source image into a plurality of processing regions to perform color balance readjustment processing for each processing region, and an image synthesis circuit which synthesizes the image data of the plurality of estimation source images so that overlapping regions included in the estimation source images overlap each other to generate image data of a synthesized image.

Abstract: Predictive pre-fetching of streams for 360 degree video is described. User view orientation metadata is obtained for a 360 degree video stream that includes data for a plurality of viewports. Data corresponding to one or more high-resolution frames for a particular one of the viewports is pre-fetched based on the user view orientation metadata and those frames are displayed. The high resolution frames are characterized by a higher resolution than for remaining viewports.

Abstract: A video processing method includes: receiving an omnidirectional content corresponding to a sphere, obtaining projection faces from the omnidirectional content, and creating a projection-based frame by generating at least one padding region and packing the projection faces and said at least one padding region in a 360 VR projection layout. The projection faces packed in the 360 VR projection layout include a first projection face and a second projection face, where there is an image content discontinuity edge between the first projection face and the second projection face if the first projection face connects with the second projection face. The at least one padding region packed in the 360 VR projection layout includes a first padding region, where the first padding region connects with the first projection face and the second projection face for isolating the first projection face from the second projection face in the 360 VR projection layout.

Abstract: An image capturing system includes a first camera having a first lens, a second camera having a second lens, a third camera having a third lens, a fourth camera having a fourth lens, a fifth camera having a fifth lens, a sixth camera having a sixth lens, and a processor coupled to the six cameras. The processor generates an optimized image according to images captured by at least two of the six cameras. The first lens, the second lens, the third lens and the fourth lens are disposed adjacently. The first lens, the third lens, the fifth lens, and the sixth lens are disposed along a straight line. Fields of view of the first lens, the second lens, the third lens, and the fourth lens are the same.

Abstract: In a left and right pair of a first display device and a second display device that perform repositionable display, mutually different display contents can be visually recognized as a first video image and a second video image. Further, a display control portion controls the display content in accordance with at least one of the first video image and the second video image.

Abstract: The present invention relates to an apparatus and a method of stitching a real-time image. More specifically, stitching-related information is generated, a parallax occurrence region in an overlap region is tracked, and correction for reducing parallax occurring in the parallax occurrence region and correction of an image distortion occurring in a non-overlap region are performed for output.

Abstract: Provided is an apparatus for providing external panoramic view contents for an aircraft during flight by installing a plurality of cameras in a plurality of windows installed in an aircraft for displaying external panoramic views inside the aircraft while the aircraft flies in order for aircraft passengers to enjoy them. The apparatus includes a shooting unit having a plurality of cameras for shooting aircraft's external panoramic views; a control unit for receiving a plurality of images from the cameras and processing them; and a display unit comprising a single display and a multi-display including a plurality of sub-displays.

Abstract: Techniques for verifying identity of a human subject to an identification document are described. In some examples, a computing device may be connected to least two cameras oriented such that a first field of view is a substantially opposite direction from a second field of view. The device may receive images from the first camera that include a human subject. Second images from the second camera may include images of an ID document with a photograph of the human subject. The device may process the first images along with the respective, corresponding second images to determine respective 3D locations for at least one of cameras at the respective times the images were captured. Based on the sequence of 3D locations, along with the first images and the second images, the device may determine whether the human subject is a valid human subject.

Abstract: An automated system for mitigating risk from a wind farm. The automated system may include an array of a plurality of image capturing devices independently mounted in a wind farm. The array may include a plurality of low resolution cameras and at least one high resolution camera. The plurality of low resolution cameras may be interconnected and may detect a spherical field surrounding the wind farm. A server is in communication with the array of image capturing devices. The server may automatically analyze images to classify an airborne object captured by the array of image capturing devices in response to receiving the images.

Abstract: An optical imaging module utilizes electric conductors to reduce the overall thickness of an image sensor element. With the configuration of an auto lens assembly and a multi-lens frame, incident light passes through the auto lens assembly and is accurately focused on the image sensor element. Hereby, the image sensor element is thus fully imaged. Besides, the invention can ensure the image quality and prevent the element from deforming during encapsulation and causing the problems such as short circuit, and can reduce the size of the optical image capturing module.

Abstract: At least one combined image may be created from a plurality of images captured by a plurality of cameras. A sensor unit may receive the plurality of images from the plurality of cameras. At least one processor in communication with the sensor unit may correlate each received image with calibration data for the camera from which the image was received. The calibration data may comprise camera position data and characteristic data, and may translate the data about a translated virtual center point translated a predetermined distance in space from the virtual center point. The processor may combine at least two of the received images from at least two of the cameras into the at least one combined image by orienting the at least two images relative to one another based on the calibration data for the at least two cameras from which the images were received and merging the at least two aligned images into the at least one combined image.

Abstract: A wireless IPTV SMART TV is provided with plurality of wireless modem modules configured to receive a plurality of wireless broadband connection signals synchronized from a plurality of cellular data networks, to process the plurality of wireless broadband connection signals, identify a set of data corresponding to a strongest wireless broadband connection signal strength, and convert said data into IPTV signals based on said IPTV provider access.

Abstract: A scale transformation adjustment unit performs a scale transformation corresponding to a change of an image range with respect to an actual image by using a scale transformation by an optical zoom of an image pickup unit that generates the actual image, and generates a coordinate transformation matrix including the scale transformation.

Abstract: A camera simulation system or method or process for simulating performance of a camera for a vehicle includes providing a camera having a lens and imager and providing a learning algorithm. Image data is captured from a raw image input of the camera and the captured image data and raw image input are output from the camera. The output image data and the raw image input are provided to the learning algorithm. The learning algorithm is trained to simulate performance of the lens and/or the imager using the output captured image data and the raw image data input. The performance of the lens and/or the imager is simulated responsive to the learning algorithm receiving raw images.

Abstract: A method, apparatus and computer program product provide a signaling mechanism that could be utilized in conjunction with a media interface and exchange mechanism in a media processing pipeline defined in Moving Picture Experts Group-I (MPEG-I) Network-based media processing (NBMP). In particular, a method, apparatus and computer program product provide a NBMP media interface mechanism that enables virtual reality (VR) stitching within an NBMP-enabled system independent of stitching algorithm used.

Abstract: Techniques related to image rectification for fisheye images are discussed. Such techniques may include iteratively determining warpings for equirectangular images corresponding to the fisheye images using alternating feature mappings between neighboring ones of the equirectangular images until mean vertical disparities between the features are reduced below a threshold, and warping the equirectangular images to rectified equirectangular images.

Abstract: According to one embodiment, an image processing apparatus includes plural imaging units and a calibration unit. The imaging units capture an overlapping region. The calibration unit calibrates plural captured images and obtains plural calibrated images in which lens distortion in each of the captured images is corrected and corresponding positions of the captured images are aligned with each other horizontally and are adjusted to a surface perpendicular to a plane. The plural imaging units are arranged such that a baseline vector connecting optical centers of the imaging units is perpendicular to a normal vector of the plane.

Abstract: An optical image capturing module is provided, including a circuit assembly and a lens assembly. The circuit assembly may include a circuit substrate, a plurality of image sensor elements, a plurality of signal transmission elements, and a multi-lens frame. The image sensor elements may be connected to the circuit substrate. The signal transmission elements may be electrically connected between the circuit substrate and the image sensor elements. The multi-lens frame may be manufactured integrally and covered on the circuit substrate and the image sensor elements. A part of the signal transmission elements may be embedded in the multi-lens frame, whereas the other part may be surrounded by the multi-lens frame. The lens assembly may include a lens base, an auto-focus lens assembly, and a driving assembly.

Abstract: The present disclosure relates to omnipolar imaging for generating a substantially 360 degree by 180 degree stereo spherical view. The omnipolar imaging device comprises at least three wide angle lenses facing in a first direction and at least three wide angle lenses facing in a second direction opposite to the first direction, each lens connected to an image sensor. The lens are positioned so as to capture the substantially 360 degree by 180 degree view. The method of rendering the view comprises, for each pixel in an output image, selecting one set of lenses, i.e. the first set of lenses or the second set of lenses, selecting one lens from the selected set of lenses, and rendering the pixel in an output image from a corresponding point in an input image of the selected lens.

Abstract: Example implementations relate to processing a query of a database and a data stream. For example, a computing device may include a processor. The processor may receive a query associated with at least one of a database and a buffer storing streamed data from a data stream. The database may store database data previously stored in the buffer. The processor may identify a range associated with the query and generate a set of sub-queries including at least one of a buffer sub-query if the range is associated with the streamed data in the buffer and a database sub-query if the range is associated with the database data in the database. The processor may process the set of sub-queries and provide a query result of the query, where the query result is a combination of sub-query results of the set of sub-queries.

Abstract: A method is provided. The method includes one or more of receiving, by an image processing device, one or more photos of building locations at a building, extracting position coordinates comprising X and Y values in a 2D floor plan from the one or more photos, converting the position coordinates into 3D model coordinates, extracting model viewpoints from a 3D model of the building at the 3D model coordinates, and comparing each of the one or more photos with a corresponding model viewpoint. Each of the model viewpoints provides a view of the 3D model at a same viewing position as one of the one or more photos.

Abstract: An image processing apparatus communicable with an image capturing device that captures image data includes circuitry. The circuitry acquires the image data captured by the image capturing device. The circuitry acquires type data indicating a type of the image capturing device. The circuitry determines the type of the image capturing device based on the acquired type data. Based on the determined type of the image capturing device, the circuitry determine a type of image processing to be performed on the acquired image data, and performs the determined image processing on the acquired image data.

Abstract: A method for processing point clouds having variable spatial distributions of scan lines includes receiving a point cloud frame generated by a sensor configured to sense an environment through which a vehicle is moving. The point cloud frame includes scan lines arranged according to a particular spatial distribution. The method also includes either generating an enhanced point cloud frame with a larger number of points than the received point cloud frame, or constructing, by one or more processors and based on points of the received point cloud frame, a three-dimensional mesh. The method also includes generating, by performing an interpolation function on the enhanced point cloud frame or a virtual surface provided by the three-dimensional mesh, a normalized point cloud frame, and generating, using the normalized point cloud frame, signals descriptive of a current state of the environment through which the vehicle is moving.

Abstract: The embodiments of the present invention provide a panoramic sea view monitoring method, said method including: aligning any two adjacent monitoring cameras among a plurality of monitoring cameras, so that the any two adjacent monitoring cameras are located on the same physical horizontal plane in a field of view; obtaining monitoring images by using the plurality of aligned monitoring cameras and a depth-of-field camera to monitor a panoramic sea view; determining a horizontal spacing parameter and a vertical spacing parameter of the any two adjacent monitoring cameras; and using the horizontal spacing parameter and the vertical spacing parameter to combine the monitoring images in a pairwise manner, so as to construct a two-dimensional scene. The present invention also provides a panoramic sea view monitoring device, a server and a system. The present invention can reduce the complexity of the system while reducing the cost.

Abstract: An electronic device and a mode switching method thereof are disclosed. The electronic device includes a first body; a connecting body; a second body being connected to the first body through the connecting body. Based on the connecting body, the electronic device has at least three modes, wherein in a first mode the first body and the second body have a first relative positional relationship, in a second mode the first body and the second body have a second relative positional relationship, and in a third mode the first body and the second body have a third relative positional relationship. The electronic device can switch from the second mode to the first mode with a first manner, and switch from the third mode to the first mode with a second manner, wherein the first manner and the second manner are different.

Abstract: The disclosure includes a camera array comprising camera modules, the camera modules comprising a master camera that includes a processor, a memory, a sensor, a lens, a status indicator, and a switch, the switch configured to instruct each of the camera modules to initiate a start operation to start recording video data using the lens and the sensor in the other camera modules and the switch configured to instruct each of the camera modules to initiate a stop operation to stop recording, the status indicator configured to indicate a status of at least one of the camera modules. Lens distortion effects may be removed from the frames described by the video data. The camera modules of the camera array are configured to provide a 3× field of view overlap.

Abstract: A device for providing a realistic media content, includes: inward facing image acquisition unit configured to acquire multiple inward facing images that are taken by an inward method using multiple cameras arranged around an object; an outward facing image acquisition unit configured to acquire multiple outward facing images that are taken by an outward method using the multiple cameras arranged around a point; a background image generation unit configured to generate a 360° cylindrical image by stitching the multiple outward facing images and then convert the 360° cylindrical image into a 360° spherical image to generate a background image; a 3D object reconstruction unit configured to extract a region of the object from the multiple inward facing images to generate a 3D object; and a combined image transmission unit configured to combine the background image with the 3D object and transmit the combined image to a display device.

Abstract: A method of calibrating a camera array comprising a plurality of cameras configured to capture a plurality of images to generate a panorama, wherein the relative positions among the plurality of cameras are constant, the method comprising: moving the camera array from a first position to a second position; measuring a homogeneous transformation matrix of a reference point on the camera array between the first position and the second position; capturing images at the first position and the second position by a first camera and a second camera on the camera array; and determining a homogenous transformation matrix between the first camera and the second camera based on the images captured by the first camera and the second camera at the first position and the second position.

Abstract: A method of selecting capture configuration based on scene analysis and an image capturing device are provided. The method includes analyzing by a processor, a scene currently being captured by an image capturing device having a plurality of imaging sensors, identifying a current image capturing mode of the image capturing device, setting at least one capture parameter for the plurality of the imaging sensors, upon determining that the at least one capture parameter of the current image capturing mode has to be changed, and determining a timing sequence for triggering the plurality of imaging sensors to capture a plurality of image frames based on the set at least one capture parameter.

Abstract: A display apparatus is provided to display a plurality of different images with different characteristics of an object on a single screen while gradually and mutually converting the color images and an image display method using the same. The display apparatus includes a memory to store a plurality of color images with different characteristics of an object and a display unit to display a second color image while gradually converting a first color image displayed on the display unit into the second color image, the second color image having a different characteristic from that of the first color image.

Abstract: An automated system for mitigating risk from a wind farm. The automated system may include an array of a plurality of image capturing devices independently mounted in a wind farm. The array may include a plurality of low resolution cameras and at least one high resolution camera. The plurality of low resolution cameras may be interconnected and may detect a spherical field surrounding the wind farm. A server is in communication with the array of image capturing devices. The server may automatically analyze images to classify an airborne object captured by the array of image capturing devices in response to receiving the images.

Abstract: Various features for allowing a user to control a camera in an intuitive manner are described. Various features allow a user to control one or more camera settings via a touch screen. In some embodiments a rotating wheel is simulated on the display screen to show user selectable camera setting values with the values being displayed as if on the surface of the wheel with a currently selected value being closest to the user, e.g., in the center, and values above and below the currently selected value being shown using a smaller size as if further away from the user. A current setting for the feature being controlled is displayed near the center of the screen in some embodiments. A currently selected value is sometimes shown larger than other user selectable settings. The camera settings include an ISO setting, a focal length, e.g., zoom setting, and/or an exposure control setting.

Abstract: An image recording apparatus includes: a camera unit that includes an image capturing lens, an image sensor, and a plurality of antenna modules each of which has a communication antenna; and a main unit that rotatably supports the camera unit so that an image capturing direction of the camera unit is (i) directed toward an outside of a vehicle and (ii) rotatable in an up-down direction. The main unit is configured to be installed on a window glass of the vehicle inside a cabin of the vehicle.

Abstract: A control system controls an imaging device to generate an omnidirectional image based on a first image obtained using a first fisheye lens and a second image obtained using a second fisheye lens. The control system includes an evaluation value calculating unit configured to: calculate brightness values of the first and second images based on pixel values of pixels constituting the first and second images, and calculate, based on the brightness values, first and second exposure evaluation values for evaluating exposure of first and second imaging elements corresponding to the first and second fisheye lenses. The evaluation value calculating unit configured to do not use pixel values of pixels constituting an overlapping area in which there is overlapping of shooting ranges of the first and second images, during calculation of the brightness values of the first and second images.

Abstract: An optical apparatus includes a plurality of first image capturing optical system facing different directions. Each of the first image capturing optical systems includes a reflective element configured to bend an optical path to an image sensor. Optical paths in the first image capturing optical systems intersect with one another on an object side of each reflective element.

Abstract: A method and a terminal for focusing includes: a determining step, determining a first camera focus of two camera focuses of two cameras corresponding to a first touch point of two touch points and a second camera focus of the two camera focuses of the two cameras corresponding to a second touch point of the two touch points, respectively, when a shooting preview interface corresponding to the two cameras is displayed and the two touch points are detected on the shooting preview interface; and a focus adjustment step, adjusting position of the first camera focus and the second camera focus, respectively, according to a sliding trace of the first touch point and a sliding trace of the second touch point on the shooting preview interface, in which the first camera focus and the second camera focus are on a same straight line.