Abstract: An imaging device includes an optical system, a plurality of imaging elements, an imaging unit, a comparison unit, and a correction unit. The optical system is configured to disperse light of a subject image. The imaging elements are configured to capture subject images dispersed by the optical system using a rolling shutter method. The imaging unit is configured to shift a slit range, which is between a front curtain and a rear curtain of the rolling shutter method, by at least one line in a sub-scanning direction between the plurality of imaging elements. The comparison unit is configured to calculate a level difference in units of lines between image signals output by the plurality of imaging elements by comparing signal levels of the image signals, and the correction unit configured to correct influence of a flash band on the image signals on the basis of the level difference.

Abstract: The present disclosure relates to a video processing method and apparatus, and a storage medium. The method is applied to a terminal and includes: a background frame for a time static special effect is determined from video frames in a video to be processed; for each of the video frames in the video, an image area, where a target object is located is acquired from the respective video frame and the image area is fused into the background frame to generate a special effect frame with the time static special effect.

Abstract: A camera array for a mediated-reality system includes a plurality of hexagonal cells arranged in a honeycomb pattern in which a pair of inner cells include respective edges adjacent to each other and a pair of outer cells are separated from each other by the inner cells. A plurality of cameras are mounted within each of the plurality of hexagonal cells. The plurality of cameras include at least one camera of a first type and at least one camera of a second type. The camera of the first type may have a longer focal length than the camera of the second type.

Abstract: An electronic device is disclosed that includes a display; a camera module; a communication module; and a processor. The processor can be set to use the communication module to obtain, from an external device, a plurality of images corresponding to a plurality of contents and data relating to at least part of the plurality of contents, and display, through the display, an image obtained using the camera module; display at least part of the plurality of images on a designated area on the display while displaying the image obtained using the camera module; and when an input associated with a first image from among the at least part of the plurality of images, use the data to display a graphic image on an area corresponding to a selected object included in the image obtained using the camera module.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for a multi-resolution image. The methods, systems, and apparatus include actions of obtaining an image, sectioning the image into unscaled sections and sections to downscale, generating downscaled sections from the sections to downscale, providing the unscaled sections and the downscaled sections to a server.

Abstract: A device includes an acquiring unit acquiring a plurality of images including a first image, a second image, and a third image; a region detecting unit comparing pixel values of the first image and the third image to detect a moving object region; and a compositing unit generating a composite image by synthesizing a target image selected from a plurality of images and the second image wherein the compositing unit performs a ghost removing process for pixels of the target image corresponding to the moving object region and pixels of the second image corresponding to the moving object region to bring the pixel values of one of these images closer to the pixel values of the other image, and synthesizes the target image and the second image after the ghost removing process.

Abstract: A video production method and apparatus, a storage medium, and a computer device are disclosed. The method includes: receiving a follow-shot instruction in a case that reference video content is played on a video play interface, the follow-shot instruction including a reference video identifier; displaying a first video display region and a second video display region on a terminal screen; playing the reference video content in the first video display region, and recording displayed real-time video content in the second video display region; and generating a target video based on the recorded real-time video content and the reference video content. The first video display region and the second video display region are displayed on the terminal screen, the reference video content is played in the first video display region, and the displayed real-time video content is recorded in the second video display region.

Abstract: A state of a display rack is evaluated accurately. An image processing device includes a detection unit configured to detect a change area related to a display rack from a captured image in which an image of the display rack is captured, a classification unit configured to classify a change related to the display rack in the change area, and an evaluation unit configured to evaluate a display state of goods, based on a classification result.

Abstract: Disclosed are an electronic device performing an audio zoom based on speaker detection using lip reading and a method for controlling the electronic device. According to an embodiment, the electronic device detects a direction of a sound source while recording a video and determines a speaker's direction via facial recognition and mouth shape recognition in the sound source direction. Microphone beamforming may be performed based on the speaker's direction. Thus, the accuracy of audio zoom may be enhanced.

Abstract: A display control apparatus comprising a display control unit configured to perform control to display a display item indicating a degree of focus; a first obtainment unit configured to obtain size information of an image to be recorded; a second obtainment unit configured to obtain a defocus amount for a focus detection region; a determination unit configured to determine the degree of focus based on the defocus amount and the size information of the image to be recorded; and a change unit configured to change a display style of the display item based on the degree of focus determined by the determination unit.

Abstract: A video editing program is taught by machine learning to conform a video sequence to a known style. For example, some famous filmmakers (e.g., Steven Spielberg, Michael Bay) have signature cinematic “takes” that appear in their acclaimed works. Such takes may involve use of subject tracking, placements and movements of people or objects in the scene, and lighting intensities or shadows in the scene. The editing program may be trained to recognize video sequences that can be modified to conform to one or more of such signature styles and to offer the modification to the user at the user's option.

Abstract: An optical module 1 includes: a mirror unit 2 including a base 21, a movable mirror 22, and a fixed mirror 16; a beam splitter unit 3 that is disposed on one side of the mirror unit 2 in a Z-axis direction; a light incident unit 4 that causes measurement light L0 to be incident to the beam splitter unit 3; a first light detector 6 that is disposed on the one side of the beam splitter unit 3 in the Z-axis direction, and detects interference light L1 of measurement light which is emitted from the beam splitter unit 3; a support 9 to which the mirror unit 2 is attached; a first support structure 11 that supports the beam splitter unit 3; and a second support structure 12 that is attached to the support 9 and supports the first light detector 6.

Abstract: This disclosure relates to methods, non-transitory computer readable media, and systems that generate a virtual long exposure image from a sequence of short exposure images portraying a moving object. In various embodiments, the image transformation system aligns two digital images in the sequence of short exposure images. The image transformation system can determine a motion vector path for the moving object between the first digital image and the second digital image. The image transformation system can also blend pixels along the motion vector path to generate a blended image representative of the motion of the moving object between the first digital image and the second digital image. The image transformation system can generate additional blended images based on consecutive pairs of images in the sequence of digital images and generates a virtual long exposure image by combining the first blended image with the additional blended images.

Abstract: This application discloses a repositioning method performed by an electronic device in a camera pose tracking process, belonging to the field of augmented reality (AR). The method includes: obtaining a current image acquired by the camera after an ith anchor image in a plurality of anchor images; selecting a target keyframe from a keyframe database according to Hash index information in a case that the current image satisfies a repositioning condition; performing second repositioning on the current image relative to the target keyframe; and calculating a camera pose parameter of a camera during acquisition of the current image according to a positioning result of the first repositioning and a positioning result of the second repositioning. In a case that there are different keyframes covering a surrounding area of a camera acquisition scene, it is highly probable that repositioning can succeed, thereby improving the success probability of a repositioning process.

Abstract: A display device includes: a display having transparency; a first detector which, in operation, detects a position indicated by an indicator on the display; a second detector which, in operation, detects position information and an orientation of the display; and a controller which, in operation, displays a virtual image corresponding to the position information and the orientation detected by the second detector on the display and changes a display mode of the virtual image according to the position indicated by the indicator and detected by the first detector.

Abstract: The invention relates to a method of representing a virtual object in a view of a real environment which comprises the steps of providing image information of a first image of at least part of a human face captured by a first camera, providing at least one human face specific characteristic, determining at least part of an image area of the face in the first image as a face region of the first image, determining at least one first light falling on the face according to the face region of the first image and the at least one human face specific characteristic, and blending in the virtual object on a display device in the view of the real environment according to the at least one first light. The invention also relates to a system for representing a virtual object in a view of a real environment.

Abstract: The present technology relates to an image processing device and method, an imaging device and a program capable of enhancing convenience in use. The image processing device includes a display controlling section that causes, while taking, as cutout images, regions different from each other in a plurality of images for synthesis whose imaging conditions are different from each other, a boundary line, which relates to a blend process to be performed when a plurality of cutout images is synthesized to generate a recording image, to be displayed and causes the displaying of at least one boundary line from among a plurality of boundary lines to be changed in response to an operation by a user. The present technology can be applied to a digital still camera.

Abstract: Aspects of the present disclosure are directed to providing an artificial reality environment with augments and surfaces. An “augment” is a virtual container in 3D space that can include presentation data, context, and logic. An artificial reality system can use augments as the fundamental building block for displaying 2D and 3D models in the artificial reality environment. For example, augments can represent people, places, and things in an artificial reality environment and can respond to a context such as a current display mode, time of day, a type of surface the augment is on, a relationship to other augments, etc. Augments can be on a “surface” that has a layout and properties that cause augments on that surface to display in different ways. Augments and other objects (real or virtual) can also interact, where these interactions can be controlled by rules for the objects evaluated based on information from the shell.

Abstract: Methods and systems for light field image encoding and decoding are disclosed. According to some embodiments, the method receives scene metadata and input light field images associated with a scene. The method further performs a first encoding operation on the scene metadata and the input light field images to generate reference views and reference disparity information. The method further performs a second encoding operation based on the reference views, the reference disparity information, and synthesized residuals to output encoded light field data, where the encoded light field data comprises encoded reference views, encoded reference disparity information, and encoded synthesized residuals. The method further randomly accesses and selects a group of reference views and corresponding disparity information from the encoded light field data based on one or more selected regions of interest.

Abstract: An apparatus and a method are achieved in which guide information for enabling a high-quality composite image to be captured is output. Included are a composite image generation unit that performs a process of combining a color image and a black-and-white image captured from different viewpoints, to generate a composite image, and a display information control unit that performs control such that auxiliary information regarding the composite image is displayed on a display unit. In a case where a subject is too close or in a case where a high-quality composite image cannot be generated due to an obstacle, the display information control unit outputs a proximity alert or an obstacle alert as warning information, and also displays a composite image adaptation level. Moreover, a composite image, a color image, and the like are displayed in parallel so that a user can select an image to be recorded.

Abstract: An image processing system includes: a receiving unit configured to receive an input of a plurality of image frames constituting a video from an imaging apparatus; a detection unit configured to detect a feature point included in an image frame to be processed in the plurality of image frames; and an output unit configured to output an output image obtained by superimposing an image frame to be processed of an area detected as a feature point on a background image generated from at least some of a plurality of image frames.

Abstract: There is provided an imaging device including: an image processing unit; a face recognition processing unit; a storage unit; and a composition processing unit for generating composite data by a composition process so that persons photographed in each of a plurality of image data are included in one image data. The face recognition processing unit recognizes a first person by performing a face recognition process on first image data. When second image data obtained by photographing a second person at the different photographing timing of the first image data, with the same background as the first image data, is recorded in the storage unit, the composition processing unit generates composite data in which the first person and the second person are superimposed on the same background.

Abstract: An example imaging system includes: a first imaging device oriented towards a central target to capture first video data representing the central target from a first angle of view; a set of further imaging devices oriented towards the central target to capture further video data representing the central target from further angles of view; and a control unit to: control the first imaging device and the set of further imaging devices to synchronously capture the first video data and the further video data; in response to a video request, provide, to a client device, a video stream of the first video data representing the central target from the first angle of view; and in response to an angle-change request, switch the video stream to second video data representing the central target, the second video data selected from the further video data.

Abstract: An endoscope apparatus includes: a display image selecting portion that selectively outputs one of a surgical image and a gastrointestinal image inputted via an input portion or outputs both of the surgical image and the gastrointestinal image; a combining portion that generates, when both of the surgical image and the gastrointestinal image are outputted by the display image selecting portion, a composite image for performing two-screen display of the surgical image and the gastrointestinal image; and a processor that performs image judgment processing, the processor detecting whether a high-luminance area formed by illumination light radiated at a time of image pickup by the gastrointestinal endoscope exists in the surgical image; and deciding, when detecting that the high-luminance area exists in the surgical image when the surgical image is displayed in one screen, a display method for causing two-screen display based on the composite image to be displayed.

Abstract: Some embodiments of the present disclosure provide a transmission module, a transmission mechanism, and a mobile terminal. The mobile terminal includes a terminal device, a driving mechanism, a transmission assembly and a mounting seat. The terminal device includes a front face, a rear face and a side peripheral face, and the terminal device defines a mounting groove. The driving mechanism is coupled to the terminal device. The transmission assembly includes a first pushing member and a second pushing member coupled to the first pushing member, and the first pushing member is coupled to the driving mechanism. The mounting seat is coupled to the first pushing member and the second pushing member, and the mounting seat is provided with a camera module. The driving mechanism enables the first pushing member to move from a first position to a third position via a second position.

Abstract: A processing circuitry is configured to generate a first analysis result based on a size of a partial area of a target area when the partial area is captured by only one of a first sensor or a second sensor, based on first image data for the target area captured by the first sensor and second image data for the target area captured by the second sensor, and generate first final image data or second final image data by using the first image data and the second image data, based on the first analysis result. A difference between the first final image data and the second final image data is based on a difference between a first characteristic of the first sensor and a second characteristic of the second sensor.

Abstract: First visual information defining first spherical visual content, second visual information defining second spherical visual content, and/or other information may be obtained. Presentation of the first spherical visual content on a display may be effectuated. A spherical transition between the first spherical visual content and the second spherical visual content may be identified. The spherical transition may define a change in presentation of visual content on the display from the first spherical visual content to the second spherical visual content based on a transitional motion within a spherical space and/or other information. A change in presentation of the first spherical visual content on the display to presentation of the second visual content on the display may be effectuated based on the spherical transition and/or other information. The change may be determined based on the transition motion within the spherical space and/or other information.

Abstract: A method includes obtaining multiple image frames of a scene using at least one sensor of an electronic device. The multiple image frames include a first image frame and a second image frame having a longer exposure than the first image frame. The method also includes generating a label map that identifies pixels in the multiple image frames that are to be used in an image. The method further includes generating the image of the scene using the pixels extracted from the image frames based on the label map. The label map may include multiple labels, and each label may be associated with at least one corresponding pixel and may include a discrete value that identifies one of the multiple image frames from which the at least one corresponding pixel is extracted.

Abstract: The present disclosure may provide a mobile terminal including a camera unit configured to acquire a plurality of images for which focuses are formed at different regions at the same time, a memory unit configured to store the plurality of images, a display unit configured to display a representative image among the plurality of images, and a controller configured to control the display unit such that the representative image among the plurality of images is converted to another image based on a touch input applied to the display unit.

Abstract: In a recording and reproducing apparatus and a recording and reproducing method for the recording and reproducing apparatus for recording and reproducing image information on a scene obtained through photographing, relative to a predetermined first recording medium and being capable of setting one or more chapters to each scene, a face recognizing process is executed for a photographed image based on the image information, an importance level of each chapter is set in accordance with a result of the face recognizing process for a very important person (VIP) set by a user, and each chapter having a relevant importance level among importance levels of respective chapters is selectively reproduced. A user can therefore find an object chapter and scene quickly and easily.

Abstract: A method includes obtaining multiple image frames of a scene using at least one sensor of an electronic device. The multiple image frames include a first image frame and a second image frame having a longer exposure than the first image frame. The method also includes generating a label map that identifies pixels in the multiple image frames that are to be used in an image. The method further includes generating the image of the scene using the pixels extracted from the image frames based on the label map. The label map may include multiple labels, and each label may be associated with at least one corresponding pixel and may include a discrete value that identifies one of the multiple image frames from which the at least one corresponding pixel is extracted.

Abstract: A method and waveform handling apparatus for capturing and storing data waveforms and metadata for analysis. The method includes receiving waveform data and metadata, the waveform data corresponding to a demodulated data burst, creating a waveform data record from the received waveform data, associating the waveform data with corresponding metadata, and creating a metadata record from the corresponding metadata. The method allows the waveform data in the waveform data record to be stored in a first data repository and the corresponding metadata in the metadata record to be stored in a second data repository, the waveform data and the corresponding metadata accessible for analysis.

Abstract: The present invention relates to a method for determining imaging location information and a device for performing same. A method for generating imaging position information may comprise the steps in which: a service server receives information on a plurality of frames from an image processing device; the service server determines each of a plurality of pieces of imaging location information on each of the plurality of frames; and the service server generates an image to be provided to user by post-processing the plurality of frames on the basis of the plurality of pieces of imaging location information.

Abstract: An electronic device is provided. The electronic device includes a memory storing instructions and at least one processor configured to execute the instructions. A home screen is displayed on a screen of the electronic device. In response to receiving a first user interaction for a first application of the electronic device, the first application is executed in the electronic device. A first user interface of the first application is displayed by superimposing the home screen on the first user interface, and the first user interface is visible through the home screen on the screen of the electronic device.

Abstract: In an approach for presenting information on an object to be observed, a processor obtains information from a sensor about an object. A processor predicts a time period in which the object is expected to be at a location and in a state, based on historical data, obtained from the sensor, associated with the object. A processor determines whether the object is at the location and in the state within the time period. A processor presents information to a user, wherein the information is about the object.

Abstract: The present disclosure provides an imaging control method and apparatus, an electronic device, and a readable storage medium. The imaging device includes a pixel unit array composed of a plurality of photosensitive pixel units, and the method includes: determining whether a shooting scene of the image device is a dim environment; determining an exposure ratio of a long exposure pixel to a short exposure pixel of the imaging device when the shooting scene is the dim environment; determining that the shooting scene is with a high dynamic range, when the exposure ratio is greater than a first exposure ratio threshold; controlling a pixel unit array of the imaging device to expose for a plurality of times with at least two exposure durations, to generate a plurality of first images; and composting the plurality of first images to generate a composited image.

Abstract: A feature determination apparatus and method adapted to multiple object sizes are provided. The apparatus individually supplies each of the object images to a convolution neural network having several convolution layers to generate multiple feature maps corresponding to each object image. The apparatus calculates a feature amount of each feature image of each object image. The apparatus determines an invalid layer start number of each object image according to a preset threshold and the feature amount corresponding to each object image. The apparatus determines a feature map extraction recommendation for each of a plurality of object sizes according to a size of each object image and the invalid layer start number of each object image.

Abstract: One embodiment of an apparatus includes a reference position receiving unit configured to receive intermediate or end panorama reference position information input by a user, and a control unit configured to control an imaging device to begin generating a plurality of images to be used to generate a panoramic image based on the intermediate or end panorama reference position information input by the user after the reference position receiving unit receives the intermediate or end panorama reference position information.

Abstract: There are provided systems and methods for digital image filtering and post-capture processing using user specific data. A computing device may include a camera that records media of a scene, including images or videos. A user may utilize the computing device to add filters, graphical overlays, or other effects to the recorded media, which may alter pixel data for pixels of the media or blend graphics into the media. When adding image effects to images, the device or a service provider that offers and image hosting and/or sharing platform may determine recommendations for particular image effects to use when recording and processing the image. The recommended effects may be based on effects used in past media, as well as user information, and may change an appearance of the output media in a particular way specific to the user, media, and/or scene.

Abstract: A method and an apparatus for generating a High Dynamic Range, HDR, image are proposed. The method comprises obtaining a set of two or more input images, the two or more input images including a reference image and one or more non-reference images; for each of the one or more non-reference images, performing an image analysis which comprises, for each region of a plurality of regions of the non-reference image, assessing whether the region of the non-reference image and a corresponding region of the reference image show the same image content and declaring the region of the non-reference image as valid or as invalid based on the assessment; and generating the HDR image by fusing the reference image and the one or more non-reference images, wherein the fusing comprises, for each of the one or more non-reference images, disregarding the invalid regions of the respective non-reference image.

Abstract: A measurement system includes: a measurement device configured to acquire a measurement data of a workpiece, a display configured to display a workpiece information corresponding to the workpiece, a reader configured to read the workpiece information displayed by the display; and a controller having a memory configured to store the workpiece information read by the reader and the measurement data of the workpiece acquired by the measurement device associated with each other.

Abstract: In order to, in a case where a composite image is to be generated that composites a background image and a person image, position the person image over the background easily, and allows the person and the background to receive light in an identical manner so that natural composition can be carried out, a control device for an electronic device includes: a person region extracting section configured to extract a person image from a narrow-angle image captured by a narrow-angle camera; a background region extracting section configured to extract a background image from a wide-angle image captured by a wide-angle camera; and an image composite section configured to make a composition of the background image and the person image, the narrow-angle camera and the wide-angle camera being aimed in respective directions on an identical side relative to a housing of the electronic device.

Abstract: A focus adjustment device, comprising a processor that, during rapid shooting of still pictures, displays an image or performs processing for storage as still picture data based on a pixel signal output as a result of the first imaging operation from the image sensor, generates focus adjustment data by performing focus detection based on a pixel signal output as a result of the second imaging operation, and executes focus control, wherein the processor computes focus movement amount based on the focus adjustment data, and if the focus movement amount is larger than a predetermined value, and focus control based on the focus movement amount and the first imaging operation are executed in parallel, prohibits processing for storage as a still picture on image data based on a pixel signal of the first imaging operation.

Abstract: Sensors, including time-of-flight sensors, may be used to detect objects in an environment. In an example, a vehicle may include a time-of-flight sensor that images objects around the vehicle, e.g., so the vehicle can navigate relative to the objects. Sensor data generated by the time-of-flight sensor can be impacted by glare. In some examples, corrected data is generated by quantifying glare. A glare region including pixels that are not associated with an object in a range of the time-of-flight sensor may provide glare intensity and glare depth values used to quantify the glare. The glare intensity and glare depth may be used to correct measured data.

Abstract: An object of the present invention is to realize an imaging device and recording control system in which the usability thereof can be improved dramatically. In an imaging device configured to output imaging data that is obtained as a result of imaging of an object, and a recording control system, the imaging device comprises a control means for recognizing a controlled state of an external recording device when a communication is enabled with the recording device through a communication means conforming to a predetermined transmission method and an input means for allowing the recording device to execute an application needed for a recording operation obtained by controlling the recording device, and the recording device records the imaging data obtained through the communication means when the application is executed by means of the input means.

Abstract: An electronic device for controlling a frame rate and a method therefor are provided. The electronic device includes an image sensor, and a processor. The processor is configured to sequentially obtain a first image, a second image, and a third image through the image sensor at a first time interval, generate a synthesized image by using the first image and the third image, identify a similarity between the second image and the synthesized image, sequentially obtain a fourth image, a fifth image, and a sixth image through the image sensor, at a second time interval long than the first time interval, based on the similarity being equal to or greater than a first threshold value, and sequentially obtain the fourth image, the fifth image, and the sixth image through the image sensor, at the first time interval, based on the similarity being less than a first threshold value.

Abstract: A resolution conversion of image data of a photographic image is performed, and based on information related to a distance from a focal plane in the photographic image and the resolution conversion, processing to control the sharpness of an image that the image data resulting from the resolution conversion represents is performed.

Abstract: Embodiments are generally directed to generating novel images of an object having a novel viewpoint and a novel lighting direction based on sparse images of the object. A neural network is trained with training images rendered from a 3D model. Utilizing the 3D model, training images, ground truth predictive images from particular viewpoint(s), and ground truth predictive depth maps of the ground truth predictive images, can be easily generated and fed back through the neural network for training. Once trained, the neural network can receive a sparse plurality of images of an object, a novel viewpoint, and a novel lighting direction. The neural network can generate a plane sweep volume based on the sparse plurality of images, and calculate depth probabilities for each pixel in the plane sweep volume. A predictive output image of the object, having the novel viewpoint and novel lighting direction, can be generated and output.

Abstract: Disclosed herein are various systems and methods for facilitating control of a tool or tools. The systems can allow a user to control multiple degrees of freedom. One such system allows a user to control multiple degrees of freedom of two tools simultaneously. Another such system allows a user to control multiple degrees of freedom with a single hand. Frames and rails for supporting and/or constraining movement of a tool or tools are also described herein.

Abstract: An optical module includes: a mirror unit having a movable mirror and a fixed mirror; a beam splitter unit; a light incident unit that causes measurement light to be incident to the beam splitter unit; a first light detector that detects interference light of the measurement light; a second light source that emits laser light; a second light detector that detects interference light of the laser light; a first mirror that allows the measurement light to be transmitted therethrough and reflects the laser light; a second mirror that reflects a part of the laser light and allows the remainder of the laser light to be transmitted therethrough; a third mirror that reflects the laser light; and a return light suppressing unit that suppresses the laser light from becoming return light, and is disposed on a side opposite to the second optical device with respect to the second mirror.