Abstract: In one embodiment, an image sensor includes a pixel array including a plurality of pixels, an analog-to-digital converter configured to convert analog pixel signals output from the pixels into digital signals, a first cluster configured to store a first group of digital signals among the digital signals and to output first image data, a second cluster configured to store a second group of digital signals among the digital signals and to output second image data, and at least one cluster switch connected to the first cluster and the second cluster, a first channel, and a second channel. The image sensor is configured to transmit at least one among the first image data and the second image data to at least one among the first channel and the second channel based on an operation mode.

Abstract: An imaging apparatus includes a first imaging unit, a second imaging unit, an orientation detection unit configured to detect an orientation of the imaging apparatus, a combining unit configured to superimpose an image captured by the second imaging unit on an image captured by the first imaging unit, and a control unit configured to control a position combining the image captured by the second imaging unit with the image captured by the first imaging unit. The control unit changes the combining position according to the orientation of the imaging apparatus that is detected by the orientation detection unit.

Abstract: An image generating device that generates a composite image based on partial images cut out from captured images having photographic subject regions partially overlapping with each other, includes: a correction device that corrects each target partial image by setting one of first and second adjacent partial images as a reference partial image; a generation device that generates first and second conversion tables for approximating a concentration characteristic of each target partial image in overlapping first and second common regions to the first and second adjacent partial images, respectively; and a mixture conversion device that converts a concentration of each target partial image to make an influence of the first conversion table larger as a position of a pixel is closer to the first adjacent partial image, and to make the influence of the second conversion table larger as the position of the pixel is closer to the second adjacent partial image.

Abstract: Systems and methods for the management of video calls are provided. A computing device dynamically determines which video stream, of multiple available video streams, is to be presented full-screen or otherwise most prominently during a video call when a user switches between cameras. The available video streams can include a video stream from a user-facing camera of the device, a video stream from a rear-facing camera of the device, or a video stream from another device. Video of the video call can also be annotated to identify individual items shown in the video, characteristics of the items, and the like. The annotations can be used to generate a summary report of the items in the video.

Abstract: Multiple cameras are arranged in an array at a pitch, roll, and yaw that allow the cameras to have adjacent fields of view such that each camera is pointed inward relative to the array. The read window of an image sensor of each camera in a multi-camera array can be adjusted to minimize the overlap between adjacent fields of view, to maximize the correlation within the overlapping portions of the fields of view, and to correct for manufacturing and assembly tolerances. Images from cameras in a multi-camera array with adjacent fields of view can be manipulated using low-power warping and cropping techniques, and can be taped together to form a final image.

Abstract: Systems and methods for digital video stabilization via constraint-based rotation smoothing are provided. Digital video data including a set of image frames having associated time stamps and a set of camera orientation data having associated time stamps may be provided. A smoothed set of camera orientation data may be generated by minimizing a rate of rotation between successive image frames while minimizing an amount of empty regions in a resulting set of smoothed image frames reoriented based on the smoothed set of camera orientation data.

Abstract: An image processing apparatus including an interface that receives an input identifying a subject, and a processor that generates a panoramic image based on captured image data so that the subject is positioned in a reference position in the panoramic image.

Abstract: This disclosure provides systems, methods and apparatus for tiltable camera modules. In one aspect, the tiltable camera module may be sequentially tilted through a range of positions to capture multiple images in different orientations. The images may then be combined to form a single composite image with a higher resolution and wider field of view than the individual images captured by the camera module. By including components which tilt a sensor assembly within a camera module, a simple camera module having a fixed field of view can be operated in a way that approximates features of a more complex camera module, and the operation of more complex camera modules can be further enhanced.

Abstract: A technique for generating a three-dimensional (3D) image using a plurality of terminals is provided. The technique includes performing calibration of a distance between lenses in a plurality of terminals by using view images of a two-dimensional (2D) object acquired by the plurality of terminals, acquiring view images of a 3D object while maintaining a lens distance between the plurality of terminals which is determined based on the result of the calibration, and processing the acquired view images of the 3D object in order to generate a 3D image of the 3D object. The 3D image allows a user to experience the same sense of depth as viewing the object in the real world.

Abstract: A video processing method, a video displaying method, and a video processing device are provided. The video processing device performs the video processing method and the video displaying method. The video processing method includes the following steps. First, receive a full frame according to a global frame rate. Then, according to a first local frame rate different from the global frame rate, determine whether to capture a first local frame from the global frame. Finally, combine the first local frame and the global frame to generate a synthesized frame. The video processing method, the video displaying method and the video processing device produce better quality and smaller file size of image data.

Abstract: A video coding device may identify a network abstraction layer (NAL) unit. The video coding device may determine whether the NAL unit includes an active parameter set for a current layer. When the NAL unit includes the active parameter set for the current layer, the video coding device may set an NAL unit header layer identifier associated with the NAL unit to at least one of: zero, a value indicative of the current layer, or a value indicative of a reference layer of the current layer. The NAL unit may be a picture parameter set (PPS) NAL unit. The NAL unit may be a sequence parameter set (SPS) NAL unit.

Abstract: A method for an access system for a vehicle includes the steps of recording a first optical information in a specific area surrounding the vehicle and detecting an object approaching the vehicle as a function of the recorded first optical information. As a function of detecting the approaching object, a second optical information in the surrounding area is recorded, and gesture information of the object is identified as a function of the second optical information. A locking device or door opening device of the access system is triggered as a function of gesture information.

Abstract: A mobile terminal including a camera configured to photograph a plurality of images; a touchscreen configured to display one of the plurality of the photographed images or a first synthetic image created from synthesizing at least two of the plurality of the photographed images together as a representative image; and a controller configured to receive a first touch input applied while the representative image is displayed, extract an image having a best resolution for an object or region selected by the first touch input from the plurality of the photographed images, and display the extracted image via the touchscreen.

Abstract: An image processing method is capable of performing a reconstruction for an input image so as to generate a plurality of output images having a plurality of focus positions different from each other, and the image processing method includes the steps of obtaining the input image that is an image containing information of an object space obtained from a plurality of points of view using an image pickup apparatus having an imaging optical system and an image pickup element including a plurality of pixels, and calculating a pixel shift amount of pixels that are to be combined by the reconstruction for a plurality of virtual imaging planes corresponding to the plurality of focus positions.

Abstract: Systems and methods for providing synchronized content are disclosed. The synchronized content may be content related to visual content captured by an imager of a mobile computing device. The mobile computer device may send the captured visual content to a content synchronization server that may identify the captured visual content, find relevant content associated with the captured visual content, synchronize the relevant content with the captured visual content, and send the synchronized relevant content to the client device.

Abstract: Various aspects of a method and device for video generation are disclosed herein. The method includes determination of direction and location information of the device in motion for a plurality of captured video frames. Based on the determined location information, a path of the device in motion is generated. For a captured video frame from the plurality of captured video frames, an angle between a first vector and a second vector is calculated. The first vector corresponds to the determined direction information associated with the captured video frame. The second vector corresponds to the generated path. The method further includes selection of the captured video frame, for the generation of the video, based on at least the calculated angle.

Abstract: A video conference is established between a first video device and a second video device. The first video device captures a first participant's images in the video conference. The first participant's image is also captured as part of the video conference via the second video device (i.e., there are duplicate images of the first participant's image being captured). The first participant's image is detected as being captured by the first video device and the second video device in the video conference. For example, the duplicate images can be determined based on facial recognition. In response to detecting that the first participant's image is being captured by the first video device and the second video device in the video conference, the process automatically forbears from displaying at least one of the first participant's image captured by the first and second video devices.

Abstract: An interactive input system comprises at least one imaging device configured to capture image frames of a region of interest comprising a background and at least one background feature. Processing structure is configured to compare the image frames to determine if the location of the at least one background feature has changed signifying system displacement.

Abstract: An image sensor includes pixels that accumulate charge during a first integration period and pixels that accumulate charge during shorter second integration periods when an image is captured. The pixels having the shorter second integration period accumulate charge at two or more different times during the first integration period. Charge is read out of the pixels associated with the first integration period at the end of the first integration period, while charge is read out of the pixels having the second integration period at the end of each second integration period.

Abstract: An autonomous moving apparatus and an autonomous movement system has a configuration which prevents disabled autonomous moving apparatuses from traveling unexpectedly during collection. An autonomous moving apparatus 1 includes a wheel locking unit 116 which locks the wheels at the time of stop, a manipulation unit 119 which is provided at a location where manipulation thereof is enabled from the outside of the autonomous moving apparatus 1, and a wheel lock releasing unit 118 which releases the lock of the wheels when the manipulation unit 119 is manipulated by force from the outside. In addition, the wheel lock releasing unit 118 releases the lock of the wheels when force equal to or more than a predetermined value is applied to the manipulation unit 119 and maintains the lock of the wheels when the force applied to the manipulation unit 119 is less than the predetermined value.

Abstract: Graphics processing is performed in which a decision is made in individual tiles whether or not to sample at a reduced sampling rate. A sampling pattern is selected from a set of sampling patterns having the same reduced sampling rate. The sampling pattern is dithered over a set of frames to reduce the visual appearance of visual artifacts via temporal color averaging.

Abstract: An electronic device including: an image sensor including plural sensors divided into groups; a multi-lens array including plural lenses configured to each form an image of a scene on a distinct group of the groups of pixel sensors; and a filter including plural color filter elements arranged in rows and columns. Each color filter element is associated with one of the lenses and the respective distinct group and configured to filter an image of the scene into one of plural color channels. A first group of pixel sensors can define a perspective of the scene for an image reconstruction, and the color filter elements in the row of the color filter element corresponding to the first group and the color filter elements in the column of the color filter element corresponding to the first group can filter the image of the scene into each of the plural color channels.

Abstract: Systems, methods, and computer program products for capturing and analyzing image data, preferably video data, are disclosed. The inventive concepts include using multiple frames of image data to generate a composite image, where the composite image may be characterized by a higher resolution than one or more of the individual frames used to generate the composite image, and/or absence of a blurred region present in one or more of the individual frames. Inventive techniques also include determining a minimum capture resolution appropriate for capturing images of particular objects for downstream processing, and optionally triggering generation of a composite image having sufficient resolution to facilitate the downstream processing in response to detecting one or more frames of image data are characterized by a resolution, and/or a region having a resolution, less than the minimum capture resolution appropriate for capturing images of those particular objects.

Abstract: In a method, a device, and a computer program for reducing the resolution of an input image, wherein input image shows a three-dimensional scene that was recorded by a surveillance camera, the distance between surveillance camera and objects in the three-dimensional scene is referred to as the object distance, and the resolution reduction is adjusted with consideration for the object distance in the three-dimensional scene and/or the perspective distortion of the three-dimensional scene.

Abstract: Image processing for productivity applications is provided. An image may be received by a computing device. The computing device may detect the edges comprising the received image and adjust the image based on a skew state of the detected edges. The computing device may then process the adjusted image to correct imbalances. The computing device may then assign an image classification to the processed image. The computing device may then adjust the processed image based on the assigned image classification.

Abstract: The present specification describes an endoscopy display system including an endoscope with a distal tip having at least three image capturing components, and a handle with an actuator that, when activated, generates a video processing command; a controller including a video processing system adapted to transmit commands to the three image capturing components and receive an image feed from each of said three image capturing components; and a display system, including at least one monitor that concurrently receives and concurrently visually displays each of said processed image feeds, where the video processing system is adapted to process each of said image feeds in accordance with the video processing command to cause at least one of changing a position of, zooming into or out of; recording; freezing; highlighting; or superimposing a navigation indicator upon the at least one of the processed image feeds.

Abstract: Disclosed herein is an image processing device including a subband dividing section configured to perform subband division of image data of a color whose pixel positions are alternately shifted from each other, the image data being included in image data output from an image pickup element of a pixel arrangement in which the pixel positions of at least one color of three primary colors are alternately shifted from each other in one of a horizontal direction and a vertical direction, with pixels of two upper and lower lines adjacent to each other or pixels of two left and right columns adjacent to each other as a unit.

Abstract: A method and apparatus for 3D video coding system are disclosed. Embodiments according to the present invention apply SAO process (sample adaptive offset process) to at least one dependent-view image of the processed multi-view images if processed multi-view images are received. Also embodiments according to the present invention apply the SAO process to at least one dependent-view image of the processed multi-view images or at least one depth map of the processed multi-view depth maps if both processed multi-view images and the processed multi-view depth maps are received. The SAO can be applied to each color component of the processed multi-view images or the processed multi-view depth maps. The SAO parameters associated with a target region in one dependent-view image or in one depth map corresponding to one view may share or may be predicted by second SAO parameters associated with a source region corresponding to another view.

Abstract: Exemplary embodiments provide systems and methods for autonomously valet parking a vehicle based on images obtained from a plurality of plenoptic (light field) cameras. According to one embodiment, an autonomous valet parking system comprises a plenoptic camera configured to: obtain an image external to a vehicle, and for the image, generate a depth map including location information for an object in the image; and a controller configured to: using the depth map, generate an occupancy map indicating whether each of a plurality of regions surrounding the vehicle is occupied; and using the occupancy map, control the vehicle to navigate to a desired parking space.

Abstract: An image coding method includes: writing, into a sequence parameter set, buffer description defining information for defining a plurality of buffer descriptions; selecting one of the buffer descriptions for each processing unit that is a picture or a slice, and writing buffer description selecting information for specifying the selected buffer description, into a first header of the processing unit which is included in the coded bitstream; and coding the processing unit using the selected buffer description, and the buffer description defining information includes long-term information for identifying, among a plurality of reference pictures indicated in the buffer descriptions, a reference picture to be assigned as a long-term reference picture.

Abstract: An exposure-control system and an associated exposure control method are provided. The exposure-control system includes: an image capturing unit configured to capture a long-exposure image and a short-exposure image with a first exposure value and a second exposure value, respectively; and a processor, configured to calculate histograms of the long-exposure image and the short-exposure image, and calculate an exposure ratio according to the calculated histograms, the first and second exposure values, wherein when the exposure ratio is smaller than a first threshold, the processor switches a current exposure mode to a low dynamic range mode. When the exposure ratio is larger than a second threshold, the processor switches the current exposure mode to a high dynamic range mode. When the exposure ratio is between the first threshold and the second threshold, the processor does not switch the current exposure mode.

Abstract: Disclosed are a method and an apparatus for implementing an active imaging system. A method of obtaining an image in an active imaging system including: dividing an imaging region, and determining a plurality of divided imaging regions; scanning each of the plurality of divided imaging regions based on a laser; collecting reflected light for each of the plurality of divided imaging regions, and generating a plurality of divided images by an image sensor; and generating a whole image for the imaging region based on the plurality of divided images.

Abstract: Methods and apparatus for implementing a camera having a depth which is less than the maximum length of the outer lens of at least one optical chain of the camera are described. In some embodiments a light redirection device, e.g., a mirror, is used to allow a relatively long optical chain with a relatively large non-circular outer lens. In some embodiments the light redirection device has a depth, e.g., front of camera to back of camera dimension, which is less than the maximum length of the aperture of the outer lens in the aperture's direction of maximum extent. Multiple optical chains with non-circular outer lenses arranged in different directions may and in some embodiments are used to capture images with the captured images being combined to generate a composite image.

Abstract: Systems and methods are described for generating restricted depth of field depth maps. In one embodiment, an image processing pipeline application configures a processor to: determine a desired focal plane distance and a range of distances corresponding to a restricted depth of field for an image rendered from a reference viewpoint; generate a restricted depth of field depth map from the reference viewpoint using the set of images captured from different viewpoints, where depth estimation precision is higher for pixels with depth estimates within the range of distances corresponding to the restricted depth of field and lower for pixels with depth estimates outside of the range of distances corresponding to the restricted depth of field; and render a restricted depth of field image from the reference viewpoint using the set of images captured from different viewpoints and the restricted depth of field depth map.

Abstract: A method for designing the spatial partition of a filter module used in an aperture-multiplexed imaging system. The filter module is spatially partitioned into filter cells, and the spatial partition is designed by considering data captured at the sensor in light of an application-specific performance metric.

Abstract: Systems and methods for image data compression in an array camera are disclosed. An array camera includes a processor, an array of cameras, and a compression module. The compression module is configured to receive image data from the array of pixels of a focal plane in a sequentially linear group of pixel data, analyze the received image data based upon truncation rules, compress the received data image based upon the analysis to generate compressed image data, and generate a bit mask identifying truncated image data in the compressed image data.

Abstract: A color correction device for an image sensor is provided. The image sensor is divided into regions. The color correction device includes a quantum efficiency (QE) measurement circuit, an addressing circuit, and a correction circuit. The QE measurement circuit generates a color signal according to a sensing signal from each pixel of the image sensor. The addressing circuit receives the color signal corresponding to each pixel, obtains a location of each pixel on the image sensor, and averages all of the color signals corresponding to the pixels whose locations are disposed in one of the regions to obtain an average color signal. The correction circuit receives the average color signal to obtain a color correction matrix of the one of the regions and corrects the color signals of the pixels whose locations are in the one of the regions by the color correction matrix.

Abstract: A method for generating and evaluating an image of a section of an object using an optical sensor. To generate a bright image, individual images are recorded of a section, of which individual images at least some individual images overlap at least in part in each case, and that to generate the image, the individual images or signals are aligned with respect to one another and superposed to form an overall image as the image of the at least one section, so that the evaluation of the overall image is substantially restricted to the overlapping regions of the individual images and/or the evaluation of the overall image or of a part thereof is brought about on the basis of the overlapping regions of the individual images having the latter.

Abstract: Methods and apparatus for coding occlusion layers, such as occlusion video data and occlusion depth data in 3D video, are disclosed.

Abstract: Systems and associated methods for generating custom media products along various story arcs are described. The story arcs correspond to sub-themes for organizing media content within a larger theme, or story, into a custom media product. The media content can include stock media content, guest-specific or custom media content, which can include rendered content. Embodiments utilize authoring tools and automated workflow mechanisms to take various forms of raw media content and create customized media products for individual guests or groups of guests.

Abstract: Example systems and methods enable an autonomous vehicle to request assistance from a remote operator when the vehicle's confidence in operation is low. One example method includes operating an autonomous vehicle in a first autonomous mode. The method may also include identifying a situation where a level of confidence of an autonomous operation in the first autonomous mode is below a threshold level. The method may further include sending a request for assistance to a remote assistor, the request including sensor data representative of a portion of an environment of the autonomous vehicle. The method may additionally include receiving a response from the remote assistor, the response indicating a second autonomous mode of operation. The method may also include causing the autonomous vehicle to operate in the second autonomous mode of operation in accordance with the response from the remote assistor.

Abstract: Provided is a method and apparatus of detecting a posture of a camera such as a surveillance or monitoring camera. The method includes acquiring an image captured by the camera, acquiring ground information about the ground in the image based on the image, and detecting the posture of the camera based on the ground information.

Abstract: A system for capturing aerial images, the system comprising at least one steerable camera module, the steerable camera module comprising a camera and a beam-steering mechanism in the optical path of the camera module whereby the pointing direction of the camera is time-multiplexed to provide a wider effective field of view, the beam-steering mechanism comprising a steerable mirror tilted with respect to an optical axis of the camera module, the steerable mirror adapted to spin about the optical axis to effect beam steering.

Abstract: Embodiments of the present invention provide improved systems and methods for matching scenes. In one embodiment, a processor for implementing robust feature matching between images comprises: a first process for extracting a first feature set from a first image projection and extracting a second feature set from a second image projection; a memory for storing the first feature set and the second feature set; and a second process for feature matching using invariant mutual relations between features of the first feature set and the second feature set; wherein the second feature set is selected from the second image projection based on the identification of similar descriptive subsets between the second image projection and the first image projection.

Abstract: A photography initiation apparatus and method for a built-in camera of a portable data processing device includes creating a shortcut icon for starting a photography apparatus on a locked screen of a portable data processing device. The method includes starting a photography process after the photography initiation apparatus is started. The photographing process includes creating a window on a screen; opening a built-in camera; setting a focal length of the built-in camera to a preset focal length; associating a viewfinder of the built-in camera with the created window; starting the viewfinder of the built-in camera and displaying an image of the viewfinder; sending, after a photography instruction is detected, a photography signal to the built-in camera; and starting a background process or invoking a background process that is already started.

Abstract: An environment map representative of lighting information of a real environment. As to enhance the impression of immersion into a virtual environment, the method comprises the steps of acquisition at real time of an image representative of a partial lighting information of said real environment from a digital optical acquisition device, said image comprising a plurality of pixels; and estimation of said environment map by extrapolation of at least a part of said pixels of said image, the extrapolation comprising the application of a first value corresponding to the mean value of the pixels of said image to at least a first part of the environment map.

Abstract: Methods and electronic devices for producing a zoomed image using a narrow field of view monochrome camera are described. In one aspect, the method includes: receiving a color image that is captured by a color camera; receiving an achromatic image that is captured by a monochrome camera with the monochrome camera having a narrower field of view than the color camera; and merging the color image and the achromatic image to produce an enhanced image.

Abstract: A dual sensor camera that uses two aligned sensors each having a separate lens of different focal length but the same f-number. The wider FOV image from one sensor is combined with the narrower FOV image from the other sensor to form a combined image. Up-sampling of the wide FOV image and down-sampling of the narrow FOV image is performed. The longer focal length lens may have certain aberrations introduced so that Extended Depth of Field (EDoF) processing can be used to give the narrow FOV image approximately the same depth of field as the wide FOV image so that a noticeable difference in depth of field is not see in the combined image.

Abstract: Provided is an image joining apparatus that creates a joined image by joining multiple consecutive still images on a time axis, the image joining apparatus including: a past image confirmation unit that confirms whether there is a past still image located before the previous still image in terms of time in at least a part of a portion to be joined to the target still image; an angle calculation unit that calculates an angle formed between a motion vector associated with the target still image and a motion vector associated with the past still image, when the past image confirmation unit has confirmed that the past still image is present; and a stop processing unit that stops joining of the target still image when the angle calculated by the angle calculation unit is equal to or greater than a predetermined angle.

Abstract: Provided is a digital image signal processing method, a recording medium for recording the method, and a digital image signal processing apparatus, in which a storage area of a memory may be efficiently used and an image desired by a user can be stored even when the storage area of the memory is insufficient. According to the present invention, a scene of an image may be recognized and a resolution and an image quality may be modified according to the recognized scene, thereby efficiently using the storage area of the memory.