Abstract: A first image is generated by imaging a first three-dimensional virtual space including a predetermined object by a first virtual camera. In addition, a map object formed by a three-dimensional model corresponding to the first three-dimensional virtual space is generated, and an indicator object indicating the position of a predetermined object is placed on the map object. Then, a second image is generated by imaging the map object by a second virtual camera. At this time, the second image is generated such that, regarding the indicator object placed on the map object, the display manners of a part hidden by the map object and a part not hidden by the map object as seen from the second virtual camera are different from each other.

Abstract: Techniques for aligning images generated by an integrated camera physically mounted to an HMD with images generated by a detached camera physically unmounted from the HMD are disclosed. A 3D feature map is generated and shared with the detached camera. Both the integrated camera and the detached camera use the 3D feature map to relocalize themselves and to determine their respective 6 DOF poses. The HMD receives the detached camera's image of the environment and the 6 DOF pose of the detached camera. A depth map of the environment is accessed. An overlaid image is generated by reprojecting a perspective of the detached camera's image to align with a perspective of the integrated camera and by overlaying the reprojected detached camera's image onto the integrated camera's image.

Abstract: The discussion relates to virtual keyboard engagement. One example can define key volumes relating to keys of a virtual keyboard and detect finger movement of a user through individual key volumes. The example can detect parameter changes associated with detected finger movement through individual key volumes and build potential key sequences from detected parameter changes.

Abstract: Provided are an image sensor with one or more image receivers for image combining, and an imaging system and method therefor. The image sensor includes an image sensor array to generate first image data for a first image; a receiver to receive, into the image sensor, second image data for a second image; an image combination circuit coupled to the image sensor array and the receiver to receive the first image data and the second image data and combine the first image data and the second image data into combined image data for a single combined image, according to one or more image combination criteria, and at least one of the first image data and the second image data; and a transmitter coupled to the image combination circuit to transmit the combined image data for the combined image from the image sensor.

Abstract: A method for constructing a three dimensional (3D) data item in a bendable device. The method includes determining, by the bendable device, an inter-axial distance between at least two imaging sensors of the bendable device based on a biometric associated with eyes. Further, the method includes determining, by the bendable device, a bending angle of the bendable device based on the inter-axial distance. Further, the method includes constructing, by the bendable device, the 3D data item using the bending angle of the bendable device.

Abstract: A system for capturing Omni-Stereo videos using multi-sensor includes left cameras, right cameras and a viewing circle. A method of capturing omni stereo videos using multi-sensor approach includes steps of: capturing images of a scene using left cameras, capturing images of a scene using right cameras, processing each image from the left camera and right camera using a computation method, and obtaining a final omni stereo frame through the computation method.

Abstract: An electronic device is provided. The electronic device includes a first camera, a second camera, and a processor. The processor is configured to obtain a first image using the first camera and obtain a second image using the second camera, determine depth information corresponding to an external object, using the first image and the second image, when properties of the depth information meet a first specified condition, store the depth information in connection with the first image and the second image, and when the properties of the depth information meet a second specified condition, skip the storing of the depth information in connection with the first image and the second image.

Abstract: An image capturing apparatus has an image sensor and a mechanical shutter; a generation unit configured to generate a parallax image from signals acquired from the plurality of photoelectric converters, wherein by the image sensor and the mechanical shutter, a first shutter operation by a first front curtain and a first rear curtain, and a second shutter operation by a second front curtain and a second rear curtain are realized, and the generating unit generates more parallax images than the number of the plurality of photoelectric conversion units by using a first signal group acquired by the first shutter operation and a second signal group acquired by the second shutter operation.

Abstract: A driving support apparatus is provided to improve accuracy of the driving support such as a notification to the driver and the vehicle control. In the apparatus, a common parameter indicating a location of a lane boundary is calculated for the vehicle control, based on an actual boundary line where a location of the lane boundary line existing at both sides of the vehicle is actually measured. A common error is defined as an error between the location of an estimated boundary indicated by the common parameter and a location of the actual boundary line. In the case where the common error is larger than or equal to a common threshold in which an amount of the common error is set in advance, the apparatus determines that the travelling road where the vehicle travels is branched and stops the vehicle control using the common parameter.

Abstract: In some examples, a method includes determining, by a computing device, a plurality of regions of interest of an image for independently processing relative to a plane of interest; determining, by the computing device and for respective regions of interest of the plurality of regions of interest, a distance from objects within the respective regions of interest to the plane of interest; and processing, by the computing device and independently for the respective regions of interest, the respective regions of interest of the image based on the determined distance from the objects to the plane of interest.

Abstract: A projector projects an uncoded pattern of uncoded spots onto an object, which is imaged by a first camera and a second camera, 3D coordinates of the spots on the object being determined by a processor based on triangulation, the processor further determining correspondence among the projected and imaged spots based at least in part on a nearness of intersection of lines drawn from the projector and image spots through their respective perspective centers.

Abstract: A vehicle periphery monitoring apparatus mounted on a vehicle includes a first imaging unit that captures an image of a rear side and a diagonally backward, a distance detection unit that detects a distance from the vehicle to an object present in the rear side and the diagonally backward, based on the image captured by the first imaging unit, a course prediction unit that predicts a course of the object, based on transition of the distance to the object detected by the distance detection unit, and an entry prediction unit that predicts whether the object enters a door opening and closing area, based on the course of the object predicted by the course prediction unit and the door opening and closing area which is set on sides of the vehicle and defines a movable range in which side doors of the vehicle are opened and closed.

Abstract: The present disclosure is generally related to capturing a scene and projecting a virtual window to one or more observers. A virtual window may mimic the experience a viewer has when looking through a real window. In some embodiments, for a single observer looking at a digital display or digital screen, a head-tracking camera on the same side of the screen as the observer can determine the position of the observer relative to the screen. The camera may be a 3D camera, stereoscopic camera, a wide angle lens camera, or an array of cameras (e.g., two or more). A camera on the other side of the screen can then image the view on the other side of the screen and software can determine the correct portion of the view that should be displayed on the screen to the observer.

Abstract: A terminal having a camera and a method of processing an image in the camera are disclosed. The method includes collecting, using a camera, a user image captured at a user focal length and a link image captured at a selective focal length, and storing the user image and the link image by linking the link image with the user image. Using this method, a user can capture a subject and circumstances around the subject when the image is captured.

Abstract: A driver assistance system for a motor vehicle having a first assistance subsystem for capturing a first sub-area of an environment of the motor vehicle and having a second assistance subsystem for capturing a second sub-area of the environment. The first assistance subsystem is configured to generate a first image of the first sub-area and the second assistance subsystem is configured to generate a second image of the second sub-area. The driver assistance system has a display device for displaying at least the first image. The display device being configured to display a first augmented reality, the first augmented reality being generated by superimposition of the first image with first assistance information of the first assistance subsystem as the first augmented reality content and by superimposition with second assistance information of the second assistance subsystem as the second augmented reality content.

Abstract: An imaging system includes a plurality of imaging bodies, a moving part, and an imaging control unit. Each of the imaging bodies includes a first optical element that images a range containing a hemisphere that is centered at an optical axis and oriented in a first direction of the optical axis, and a second optical element that images a range containing a hemisphere that is centered at the optical axis and oriented in a second direction opposite to the first direction. The imaging bodies is arranged in a direction orthogonal to the optical axis. The moving part moves the imaging bodies on a straight line. The imaging control unit is configured to cause the imaging bodies to perform imaging in synchronization with each other, and acquire a taken image from each of the imaging bodies.

Abstract: A video system is provided. The video system, comprising: a plurality of imaging sensors each including an image signal processor; an image stitching engine analyzes un-stitched images generated by each of the plurality of imaging sensors. The un-stitched images are analyzed for a presence of face and then divided into a plurality of zones. A mapping function is implemented for each of the plurality of zones based on a number of consecutive frames in which presence of a face is analyses and a minimum number of frames in which a face was detected. A zoom engine determines a region of interest which includes a left edge and a right edge, wherein said left edge is set based on coordinates associated with a face detected in a left most zone of the unstitched images, and said right edge is set based on coordinates associated with a right most face detected in a right most zone of the unstitched images.

Abstract: A method for providing a real time, three-dimensional (3D) navigational map for platforms includes integrating at least two sources of multi-modal and multi-dimensional platform sensor information to produce a more accurate 3D navigational map. The method receives both a 3D point cloud from a first sensor on a platform with a first modality and a 2D image from a second sensor on the platform with a second modality different from the first modality, generates a semantic label and a semantic label uncertainty associated with a first space point in the 3D point cloud, generates a semantic label and a semantic label uncertainty associated with a second space point in the 2D image, and fuses the first space semantic label and the first space semantic uncertainty with the second space semantic label and the second space semantic label uncertainty to create fused 3D spatial information to enhance the 3D navigational map.

Abstract: A vehicle traveling environment detecting apparatus includes first to third stereo cameras, first to third image processors, and an image controller. The first stereo camera includes first and second cameras. The second stereo camera includes the first camera and a third camera. The third stereo camera includes the second camera and a fourth camera. The first to third image processors are configured to perform stereo image processing on first to third outside images and thereby determine first to third image processing information including first to third distance information, respectively. The first to third outside images are configured to be obtained through imaging of an environment outside the vehicle by the first to third stereo cameras, respectively. The image controller is configured to perform integration of the first image processing information, the second image processing information, and the third image processing information and thereby recognize a traveling environment of the vehicle.

Abstract: An electronic device is provided. The electronic device includes a first camera configured to include a first image sensor, a second camera configured to include a second image sensor, and a processor. The processor allows a pixel array of the first image sensor to have a difference of a first exposure start timing in units of at least one row and obtains a first image based on a first exposure period and a first read-out speed using the first camera, allows a pixel array of the second image sensor to have a difference of a second exposure start timing in units of at least one row and obtains a plurality of second images based on a second exposure period and a second read-out speed using the second camera, and generates a third image by synthesizing at least some of the plurality of second images.

Abstract: A display apparatus and a display method are provided. The display apparatus includes: a display device and an adjustable optical device, the display device includes a display screen, configured to display an image; the adjustable optical device is located at a side of the display screen which is used to display, the adjustable optical device is configured to adjust a distance between the display screen and a virtual image of the image formed by the adjustable optical device.

Abstract: The techniques disclosed herein improve the efficiency of a system by providing intelligent agents for managing data associated with objects that are displayed within mixed-reality and virtual-reality collaboration environments. Individual agents are configured to collect, analyze, and store data associated with individual objects in a shared view. The agents can identify real-world objects and virtual objects discussed in a meeting, collect information about each object and generate recommendations for each object based on the collected information. The recommendations can suggest modifications to the objects, provide resources for obtaining or modifying the objects, and provide actionable information allowing users to reach a consensus regarding an object. The data can be shared between different communication sessions without requiring users to manually store and present a collection of content for each object.

Abstract: In one embodiment, a method includes, by a computing device of a first sensor receiving synchronization information from a controller. The synchronization information being generated based on a clock of the controller. The method also includes determining, based on the synchronization information, a first offset between a first clock of the first sensor and the clock of the controller; storing the first offset; and synchronizing, based on the stored first offset and the first clock of the first sensor, a first data capture by the first sensor with a second data capture by a second sensor. The first data capture and the second data capture being requested by the controller.

Abstract: An image processing apparatus generates a left-eye viewpoint image and a right-eye viewpoint image, detects one or more pairs that are each a pair of a partial image of the left-eye viewpoint image and a partial image of the right-eye viewpoint image that are similar to each other, performs, for each of the one or more pairs, image adjustment processing for adjusting the three-dimensionality of one of or both of the partial images of the left-eye and right-eye viewpoint images, displays the left-eye viewpoint image or the left-eye viewpoint image after the image adjustment processing in a manner such that this image is capable of being observed with a left eye, and displays the right-eye viewpoint image or the right-eye viewpoint image after the image adjustment processing in a manner such that this image is capable of being observed with a right eye.

Abstract: A surround view system for a vehicle, comprising a camera positioned in or on the vehicle to capture the vehicle's surroundings, an evaluation unit processing images captured by the camera and a display displaying a top-view image generated by the evaluation unit. The evaluation unit obtains the top-view image by calculating a projection of the captured images onto a virtual projection surface and by calculating a top-view of the projection on the virtual projection surface. The virtual projection surface comprises a flat bottom part and a rising part adjacent to the flat bottom part, wherein, in an area comprising the rising part at one side of the vehicle over a length of the vehicle, a curvature of the virtual projection surface is zero in a longitudinal direction of the vehicle.

Abstract: A movable carrier auxiliary system includes an environment detecting device including an image capturing module, a storage module, and an operation module. The image capturing module is disposed on a movable carrier for capturing an environment image around the movable carrier. The storage module stores a plurality of image models. A control method thereof includes that the operation module is electrically connected to the image capturing module and the storage module to detect whether the environment image has an image that matches at least one of the image models or not, and to generate a corresponding detection signal.

Abstract: An image capture device in accordance with the present disclosure includes a cover coupled to a mount to surround a stereoscopic-camera unit. The stereoscopic-camera unit includes a circuit board coupled to a frame having a top brace, a bottom brace, and lens holders. The top brace and bottom brace each are formed a similar material as the circuit board (e.g., a FR4 material), such that the top and bottom braces share a similar coefficient of expansion with the circuit board.

Abstract: A camera module includes multiple camera units, a bracket, and multiple mounting rods. Each of the camera units includes a main body and a lens on the main body. The main body includes two protrusions. The two protrusions protrude from opposite sides of the main body. Each of the two protrusions includes a fixing hole. The bracket is mounted in an electronic device and includes multiple mounting holes and multiple mounting grooves disposing in a surface of the bracket. Each two of the multiple mounting grooves connect with corresponding mounting holes at opposite sides of the mounting holes. The mounting rods protrude from the mounting grooves. When the mounting holes receive the camera units, the corresponding mounting grooves receive the corresponding protrusions and the mounting rods pass through the corresponding fixing holes.

Abstract: An image processing device uses a first image captured by a first lens with an unknown focal length and a second image captured by a second lens with a known focal length to calculate the focal length of the first lens.

Abstract: Systems and methods for using electronic portal imaging devices (EPIDs) as absolute radiation beam measuring devices and as radiation beam alignment devices without implementation of elaborate and complex calibration procedures.

Abstract: Systems, and methods are provided herein for UAV video broadcasting. A method for video broadcasting may comprise: receiving broadcast data from a broadcasting end, wherein the broadcast data comprises video data collected by a plurality of unmanned aerial vehicles (UAVs), and wherein said UAVs are configured to be (1) operated in a coordinated manner and (2) in communication with one or more ground stations; receiving a user input from a viewing end, wherein the user input comprises one or more instructions configured for interacting with the broadcasting end; processing the user input from the viewing end; and transmitting the processed user input to the broadcasting end to adjust video broadcasting at the broadcasting end.

Abstract: An interactive 3D cursor facilitates selection and manipulation of a three-dimensional volume from a three-dimensional image. The selected volume image may be transparency-adjusted and filtered to remove selected tissues from view. Qualitative and quantitative analysis of tissues in a selected volume may be performed. Location indicators, annotations, and registration markers may be overlaid on selected volume images.

Abstract: A system includes a camera having a field of view, a cleaning apparatus positioned to clean the camera, and a computer communicatively coupled to the camera and the cleaning apparatus. The computer is programmed to detect an obstruction on the camera based on sensing a trajectory of an external light source relative to the field of view in data from the camera, and upon detecting the obstruction, activate the cleaning apparatus.

Abstract: The present disclosure provides an interaction system of three-dimensional space and a method for operating the same, comprising: determining visual field space according to an eye position of an operator and an angle at which the eye is watching, and determining absolute interaction space and relative interaction space according to respective joint positions of the operator and the visual field space, thereby achieving dividing of areas of the space; determining an operation that matches a current action and needs to be performed by the operator on a selected virtual object according to a relationship among the current action of the operator, the virtual object viewed by the operator and the absolute interaction space, such that when the operator makes the corresponding action, the operation matching the action of the operator is performed on the virtual object; outputting the generated corresponding three-dimensional image display signal to a three-dimensional image display device to complete somatosensory

Abstract: An electronic device includes a display configured to display a three-dimensional image, a camera configured to photograph a real image, and a controller configured to generate an image signal based on the real image and augmented reality (AR) image data and to provide the image signal to the display, the controller including a multi-view image generator configured to convert the AR image data into multi-view AR images, a graphics processor configured to compose each of the multi-view AR images with the real image to generate multi-view composition images, and a processor configured to control a multi-view virtual camera and the graphics processor, to convert the multi-view composition images into the image signal, and to provide the image signal to the display.

Abstract: The present application discloses a display apparatus including a display panel including a plurality of subpixels. Each subpixel comprises a first region for displaying a subpixel image. The display apparatus further includes a plurality of pixel adjustors each of which is configured to adjust the first region of a corresponding one subpixel to display an initial subpixel image. Additionally, the display apparatus includes a plurality of optical elements at a first side of the display panel. Each of the plurality of optical elements is associated with at least one subpixel to generate a virtual subpixel image at a second side of the display panel corresponding to the initial subpixel image displayed by the at least one subpixel. Each of the plurality of optical elements independently controls a distance of the virtual subpixel image relative to the display panel and the second side is opposite to the first side.

Abstract: A method and apparatus for a panning camera using multiple lenses having a common planar image plane. An imaging device is positioned across said image plane sampling a section each time. The sampled plane is an imaging representation of a very large angular scenery and it is sampled and displayed piece by piece by the imaging device. An instantaneous image of a said section is displayed or stored by a computing device. Installation of two or more said panning camera with an offset distance in between will be the basis of fast 3D measurement of scenery around the installed cameras. As the imaging device advances across said image plane it will pass across fields of view of multiple lenses. The present invention relates to high resolution very wide field of view panning camera without moving the external camera casing. Said imaging device could be a CCD, CMOS, FLIR or other imaging camera device.

Abstract: A method comprising: analysing an image to determine an image scene category; and generating an anonymized image based on a determined image scene category by applying a morphing model to the image as a whole, such that the anonymised image is between the image and a generic image associated with the identified scene category.

Abstract: A distributed system includes a plurality of storage systems and a network connecting the storage systems. Each storage system includes a host having a processor and a memory, and a storage device having a controller and a nonvolatile memory. When a first storage system receives, a second storage system, a write command, write data, and size information of the write data, the controller in the first storage system determines an address of the nonvolatile memory of the first storage system in which the write data are to be written, based on the write command and the size information, writes the write data in the nonvolatile memory associated with the address, and transmits the address to the second storage system, and the processor of the second storage system stores management data indicating correspondence between identification information of the write data and the address in the memory of the second storage system.

Abstract: Systems and methods are described for virtual and augmented reality. A position of a first user and a position of a second user in a physical space are received, wherein the positions are derived from detected infrared light from a plurality of cameras. An image corresponding to the first user is rendered at a first virtual position in a display device associated with the second user, wherein the first virtual position is determined based at least in part on a position of the first user in the physical space and on a determined viewpoint of the second user. An image corresponding to the second user is rendered at a second virtual position in a display device associated with the first user, wherein the second virtual position is determined based at least in part on a position of the second user in the physical space and on a determined viewpoint of the first user.

Abstract: Systems are provided for performing surface reconstruction with reduced power consumption. A surface mesh of an environment is generated, where the surface mesh is generated from multiple depth maps that are obtained of the environment. After the surface mesh is generated, a change detection image of that environment is captured while refraining from obtaining a new depth map of the environment. The change detection image is compared to the surface mesh. If a difference between the change detection image and the surface mesh is detected and if that difference satisfies a pre-determined difference threshold, then a new depth map of the environment is obtained. The surface mesh is then updated using the new depth map.

Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute for the point cloud. To compress the attribute information, multiple levels of detail are generated based on spatial information. Also, attribute values are predicted based on the level of details. A decoder follows a similar prediction process based on level of details. Also, attribute correction values may be determined to correct predicted attribute values and may be used by a decoder to decompress a point cloud compressed using level of detail attribute compression. In some embodiments, an update operation is performed to smooth attribute correction values taking into account an influence factor of respective points in a given level of detail on attributes in other levels of detail.

Abstract: A zoned time-of-flight (ToF) arrangement includes a sensor and a steerable light source that produces an illumination beam having a smaller angular extent than the field of view (FoV) of the sensor. The illumination beam is steerable within the sensor's FoV to optionally move through the sensor's FoV or dwell in a particular region of interest. Steering the illumination beam and sequentially generating a depth map of the illuminated region permits advantageous operations over ToF arrangements that simultaneously illuminate the entire sensor's FoV. For example, ambient performance, maximum range, and jitter are improved. Multiple steering alternative configurations are disclosed, including mechanical, electro optical, and electrowetting solutions.

Abstract: An exemplary data precision preservation system divides a depth representation into a first section and a second section separate from the first section. The system determines data bits representing numbers that correspond to a lowest non-null depth value and a highest non-null depth value represented in the first section, and converts an original set of depth values represented in the first section to a compressed set of depth values normalized based on the lowest and highest non-null depth values represented in the first section. The system then generates a dataset that includes data representative of the compressed set of depth values and an inverse view-projection transform that is based on the lowest and highest non-null depth values represented in the first section and is configured to facilitate conversion of the compressed set of depth values back to the original set of depth values. Corresponding systems and methods are also disclosed.

Abstract: The application relates to an appliance (1) for creating and monitoring a safety area (2) in a working space (3). The suggested appliance (1) comprises a recording device (4). The recording device (4) is configured to record images in a monitoring area (8) which encompasses the safety area (2). The appliance (1) further comprises an illumination device (5) which is configured to project lines or patterns which define the safety area (2), into the working space (3). Furthermore, the appliance (1) comprises an evaluation device (9) which is configured to evaluate the images which are recorded by the recording device (4), with respect to a violation of the safety area (2). The illumination device (5) is configured to project a temporally coded sequence (11, 11?, 11?, 11??, 11???) of the lines (6) or patterns into the working space (3).

Abstract: An apparatus to facilitate processing video bit stream data is disclosed. The apparatus includes one or more processors to encode surface normals data with point cloud geometry data included in the video bit stream data for reconstruction of objects within the video bit stream data based on the surface normals data and a memory communicatively coupled to the one or more processors.

Abstract: A method comprising: displaying to a user a current virtual scene of a virtual space from a current point of view at a current position, the virtual scene comprising a user-input artificial virtual object; mapping a three-dimensional gesture of the user to a corresponding three-dimensional gesture in the virtual space that interacts with the user-input artificial virtual object; and in response to determining that the corresponding three-dimensional gesture in the virtual space interacts with the user-input artificial virtual object, displaying to the user a new virtual scene of the virtual space from a new point of view at a new position different to the current position.

Abstract: Systems and methods for calibrating a sensor array for 3D depth sensing include the steps of providing multiple 3D sensors each for (i) illuminating a field of view of the sensor and (ii) generating an output array of pixelwise values indicative of distances to objects within the illuminated a field of view; sequentially causing each of the 3D sensors to generate an output array while other 3D sensors are illuminating their fields of view; and creating an interference matrix from the generated output arrays, the interference matrix indicating, for each of the 3D sensors, a degree of interference by other 3D sensors simultaneously active therewith.

Abstract: A monitoring system includes a plurality of entrance cameras that capture each of visitors from multiple different angles when the each of visitors enters a facility in which a plurality of intra-facility cameras are installed at respective prescribed positions, and a monitoring apparatus that accumulates visitor data which associates captured images of the each of visitors with identification information of the each of visitors, and monitors the each of visitors in the facility. The monitoring apparatus specifies one intra-facility camera installed at or near a position of detection of the abnormality as a near-abnormality-position intra-facility camera in response to a notice of detection of an abnormality in the facility, extracts one or more visitors found in a video captured by the near-abnormality-position intra-facility camera based on the visitor data; and employs the one or more visitors as security action target persons.

Abstract: A stereo vision measuring system and measuring method are provided. The system includes a main control device and at least two cooperation devices; each of the cooperation devices is a movable device, and is provided with an image acquiring part; the cooperation device is configured to acquire a first image of a first scene and first image information of the first image and transmit them to the main control device in a calibrating phase, and the cooperation device is further configured to acquire a second image of a second scene and second image information of the second image, and transmit the second image information to the main control device in a measuring phase; the main control device is configured to acquire parameter information of the image acquiring parts in the calibrating phase; the main control device is further configured to obtain three-dimensional reconstruction information of the second scene.