Abstract: A photographing method and an electronic device. The photographing method includes: receiving, by the electronic device, a first operation for triggering the electronic device to enter a large aperture mode; obtaining, by the electronic device, a distance value between the electronic device and a photographed target object in response to the first operation; enabling, by the electronic device in a case that a distance value does not exceed a first distance threshold, a first camera and a second camera to acquire the image of the target object; enabling, by the electronic device in a case that the distance value exceeds the first distance threshold, the first camera and a third camera to acquire the image of the target object; and displaying, by the electronic device, a preview image including the target object.

Abstract: To provide a device and a method of analyzing a change in the degree of focusing between a current image and a past image and outputting display data capable of identifying a change in the degree of focusing to a display unit. A focusing-degree change analysis unit that analyzes a change in a degree of focusing between a current image output from an image sensor and a past image output from the image sensor before the current image is output and a display control unit that generates display data enabling checking of a focusing-degree change state from the past image in units of pixel regions of the current image by using an analysis result of the focusing-degree change analysis unit are provided. Pixel classification information indicating which of (a) pixel approaching focusing, (b) pixel out of focusing, and (c) pixel with no change in the degree of focusing each pixel corresponds to is generated and output in units of pixels.

Abstract: An image capturing system includes an image capturing unit including an image capturing surface on which pixel blocks each including a plurality of pixels are two-dimensionally arranged, exposure parameters being separately settable for the pixel blocks, a determination unit configured to determine a first exposure parameter and a second exposure parameter so that a difference between the first exposure parameter and the second exposure parameter is greater than or equal to a predetermined value, an exposure control unit configured to set the first exposure parameter determined by the determination unit and the second exposure parameter determined by the determination unit alternately as the exposure parameters for the pixel blocks and configured to control image capturing by the image capturing unit, and a display unit configured to display an image captured by the image capturing unit.

Abstract: Provided is an information processing apparatus and an information processing method that enable appropriate recording of information written on a writing object. A region setting unit sets, in a writing image that shows the writing object on which written information is written, a writing region that includes the written information, and a recording control unit that controls recording of the writing image in response to a change in the writing region. The present disclosure can be applied to, for example, a board writing recording system.

Abstract: The present disclosure provides video special effect configuration method, device, equipment and storage medium, and relates to the technical field of special effect processing. The method includes: adding a variable update node in a first special effect event combination in response to a first setting operation of a user, in which an update manner of a target variable is set on the variable update node; adding a variable trigger node in a second special effect event combination in response to a second setting operation of the user, in which a judging condition of the target variable is set on the variable trigger node; and generating a configuration file of a video special effect according to the first and second special effect event combinations. The technical solution of the present disclosure allows the production of the video special effect to better fit in the action changes of the user.

Abstract: A camera array for a mediated-reality system includes a plurality of hexagonal cells arranged in a honeycomb pattern in which a pair of inner cells include respective edges adjacent to each other and a pair of outer cells are separated from each other by the inner cells. A plurality of cameras are mounted within each of the plurality of hexagonal cells. The plurality of cameras include at least one camera of a first type and at least one camera of a second type. The camera of the first type may have a longer focal length than the camera of the second type.

Abstract: An imaging apparatus includes an imaging unit, an operation unit configured to be operated by an operation in a first phase and an operation in a second phase, a recording control unit configured to record a moving image captured by the imaging unit in a moving image file in response to an operation performed on the operation unit, and a control unit configured to perform control to cause the imaging apparatus to display file information about the moving image file to be recorded by the recording control unit in response to performance of the operation in the first phase, and to cause the imaging apparatus to hide the file information that is displayed in response to the performance of the operation in the first phase, in response to performance of the operation in the second phase.

Abstract: A lower dynamic range visual content (21) of a virtual reality or VR scene represented in a curved shape form is adapted to a higher dynamic range display of the virtual reality scene. At least two planar key views (230) of the VR scene area obtained at least two parameter values (240) respectively associated with those planar key views are obtained, corresponding to at least one parameter adapted to expand a dynamic range of a visual content, and a higher dynamic range visual content (22) corresponding to the lower dynamic range visual content in at least part of the VR scene extending beyond the planar key views is determined, based on the parameter values. Applications to Inverse Tone Mapping.

Abstract: An image processing system includes a housing that forms a passage through which paper pieces pass, imaging units that capture images of the paper pieces passing through the housing, and an AI image processing apparatus that restores a restoration target on the basis of the images captured by the imaging unit so that the contents of the restoration target become viewable.

Abstract: A mobile phone having an application or system module operable to attach the mobile phone to a computing device as a wireless accessory to the computing device over a wireless connection between the mobile phone and the computing device, based at least in part on that the mobile phone is located within a predetermined proximity radius from the computing device, and a display device of the computing device is inactive.

Abstract: An information processing apparatus (10) includes: a deciding unit configured to decide alignment information to be used for alignment between a first image captured by a first imaging device and a second image captured by a second imaging device having an angle of view wider than an angle of view of the first imaging device, on the basis of imaging-related information related to imaging performed by the first imaging device; and an outputting unit configured to output the alignment information.

Abstract: Techniques for using motion data to generate a high resolution output color image from multiple images having sparse color information are disclosed. A camera generates multiple images. The camera's sensor is configured to have a sparse Bayer pattern. While the camera is generating the images, IMU data for each image is acquired. The IMU data indicates a corresponding pose the camera was in while the camera generated each image. The images and the IMU data are fed as input into a motion model. The motion model performs temporal filtering on the images and uses the IMU data to generate a red-only image, a green-only image, and a blue-only image. A high resolution output color image is generated by combining the red-only image, the green-only image, and the blue-only image.

Abstract: A combined multi-spectral and polarization (CMSP) sensor is disclosed that enhances contrast-to-noise ratio (CNR). The CMSP sensor comprises a multi-spectral and polarization (MSP) filter, a single focal plane array (FPA), and a controller. The FPA comprises a plurality of detectors and the MSP filter comprises at least a first bandpass filter having a first frequency range and a second bandpass filter having a second frequency range that is distinct from the first frequency range and a first polarization filter having a first polarization value and a second polarization filter having a second polarization value that is distinct from the first polarization value.

Abstract: The present invention concerns a method of encapsulating images in a file, wherein the method comprises determining a grouping type based on a capture mode of the images; generating a grouping data structure describing the images as a group, the grouping data structure comprising image identifiers of the images of the group; and embedding the grouping data structure, the grouping type and the images in the file.

Abstract: An image capable of confirming a focus position is generated without superimposing a peaking signal on a captured image. Therefore, an image processing apparatus according to the present technology includes an image signal generation unit that generates a plurality of image signals having frequency characteristics different from each other from one captured image signal, and a blending processing unit that blends the plurality of image signals on the basis of a blend ratio determined on the basis of a peaking signal for the one captured image signal.

Abstract: A camera lens smoothing method includes: obtaining a current video frame of a camera video and gyroscope information of the current video frame, and calculating a current first rotation matrix; conducting smoothing on the first rotation matrix, and calculating a third rotation matrix; conducting viewpoint decomposition on the current video frame according to the third rotation matrix, and calculating a fourth rotation matrix; and conducting 3D rotation on the current video frame according to the fourth rotation matrix, and rebuilding an anti-shake video.

Abstract: An optoelectronic device having a set of pixels wherein each pixel has a sub-pixel capable of emitting a primary light beam, a set of pixels each pixel being adjacent to a pixel wherein each secondary pixel has at least one secondary sub-pixel capable of emitting a secondary light beam, a set of optical systems arranged so as to be able to cover an entire pixel belonging to one of the sets and at least part of the sub-pixels of at least one of the adjacent pixels belonging to the other set, the number of pixels being greater than twice the number of optical systems. At least one movement mechanism applies a relative movement between the set and the sets according to a predetermined sequence.

Abstract: Among other things, embodiments of the present disclosure can help to automatically generate images displaying activity-based information and distribute such images to other users, such as members of a social network. The image may be modified based on activity data associated with other users and/or from other activity sensors.

Abstract: Techniques for synthesizing intermediary frames for long exposure images are disclosed. Video stream data, comprising a plurality of arriving frames, is received. An indication that the video stream data should be processed into a long exposure image that incorporates one or more synthesized frames is received. A set of arriving frames is used to generate at least one synthesized frame. At least one received frame is blended with the at least one generated synthesized frame to form a long exposure image. The long exposure image is provided as output.

Abstract: Methods and apparatus for metadata-based cinematography, production effects, shot selection, and/or other content augmentation. Effective cinematography conveys storyline, emotion, excitement, etc. Unfortunately, most amateur filmmakers lack the knowledge and ability to create cinema quality media. Various aspects of the present disclosure are directed to, among other things, rendering media based on instantaneous metadata. Unlike traditional post-processing techniques that rely on human subjectivity, some of the various techniques described herein leverage the camera's actual experiential data to enable cinema-quality post-processing for the general consuming public. Instantaneous metadata-based cinematography and shot selection advisories and architectures are also described.

Abstract: There is provided an imaging device including: an image processing unit; a face recognition processing unit; a storage unit; and a composition processing unit for generating composite data by a composition process so that persons photographed in each of a plurality of image data are included in one image data. The face recognition processing unit recognizes a first person by performing a face recognition process on first image data. When second image data obtained by photographing a second person at the different photographing timing of the first image data, with the same background as the first image data, is recorded in the storage unit, the composition processing unit generates composite data in which the first person and the second person are superimposed on the same background.

Abstract: An image processing system and a processing method of video stream are provided. The first image is obtained according to a parameter. The deformation correction procedure is performed on the first image, and the second image is generated. The identification detection procedure is performed on the second image, and a detected result is generated. Control information is generated according to the detected result. The parameter is adjusted according to the control information, and a third image is generated. The second image and the third image are output. Therefore, the subsequent application could be enhanced through the dual image outputs.

Abstract: Image pickup apparatuses, control methods and storage mediums for use therewith are provided herein. At least one image pickup apparatus includes: a display unit that displays an image generated by an imaging unit; an image processing unit that extracts in-focus areas from a plurality of images different in in-focus position that are generated by the imaging unit and that composites the extracted areas; and a control unit. The control unit acquires, out of image magnifications corresponding to the plurality of images different in in-focus position, a reference image magnification, and the image processing unit corrects the image to be displayed on the display unit based on an image magnification corresponding to the image to be displayed on the display unit and the reference image magnification.

Abstract: Images are captured with a sample object in various arrangements relative to lighting and a detector. The images are then combined image point by image point on the basis of a comparison of image point values of image points of said images. This achieves a reduction in interference, i.e. reflections and/or shadows can be reduced.

Abstract: A method includes obtaining a first preview picture collected by a camera, where an angle of view FOV of the camera is a first FOV value. The camera collects the first preview picture based on a second FOV value, and the second FOV value is less than the first FOV value. The method further includes adjusting the second FOV value to a third FOV value when it is detected that a quantity of at least one target human face in the first preview picture is greater than a first preset value, where the third FOV value is greater than the second FOV value, and the third FOV value is less than or equal to the first FOV value; and outputting an image that is photographed by the camera based on the third FOV value.

Abstract: System and method for reducing false negatives in object detection, including: extracting an object of interest from a respective image in a first set of training data that includes in distribution (ID) data. For each of the object of interest extracted from the respective image in the first set of training data: fusing the object of interest with an image from a second set of data that does not include any objects of interest to form a fused image; adding the fused image to the training data; and using the training data to train a detection model for object detection.

Abstract: A photographing method and apparatus are provided. The photographing method includes: identifying a photographing distance and a photographing angle with respect to the external device based on timings of signals transmitted and received through a communication connection; acquiring a scene image based on an output of a camera of the photographing device; identifying a current composition model based on the photographing distance, the photographing angle and the scene image; acquiring a set of photographing parameters that are associated with the current composition model; identifying a focal length based on the photographing distance and the current composition model; displaying a preview image based on the output of the camera, the photographing parameter and the current composition model; outputting the preview image as a photographing result based on a photographing instruction; and updating the set of photographing parameters based on the photographing parameter.

Abstract: A method for generating a three-dimensional image of an object, comprising receiving a set of input point cloud data from an imaging system, the set of input point cloud data comprising two or more input point clouds, determining, for each point in the respective input point clouds, a value of a quality parameter that reflects a degree of uncertainty in the three dimensional coordinates as specified for that point, generating an output point cloud for generating a three-dimensional representation of the object surface, wherein, for each point in the output point cloud, the coordinates of the respective point are computed based on the coordinate values of the points in the input point clouds, wherein the extent to which the coordinate values in the respective input point clouds are taken into consideration in the computation is determined based on the values of the quality parameter associated with those respective points.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by a messaging application, an image from a camera of a user device; receiving input that selects a user-customizable effects option for activating a user-customizable effects mode; in response to receiving the input, displaying an array of a plurality of effect options together with the image proximate to the user-customizable effects option; and applying a first effect associated with a first effect option of the plurality of effect options to the image.

Abstract: The present technology is a graphical user interface for a video recording system and method of recording a video while applying special effects in real time prior to and/or while recording. The interface is associated with an electronic device including a processor in communication with a camera and a memory unit. Inputs from the interface are utilized by the processing unit to determine if the native speed rate of the raw video data is to be changed, and if so then modifies at least one frame in the raw video data to create a modified video data at a modified speed rate that is different to the native speed rate. The system then generates an output video feed that is displayed in the graphical user interface. This allows for the continuous recording of video from the camera or video feed at different speed rates without altering camera operations or settings.

Abstract: An image capture apparatus according to an embodiment of the present technology includes an image generation unit, an edge detection unit, and a color control unit. The image generation unit generates a captured image by capturing a subject. The edge detection unit detects an edge portion included in the generated captured image. The color control unit controls a color of a highlighted display for highlighting the edge portion for each detected edge portion based on color information about the edge portion in the captured image.

Abstract: Shoppable video enables a viewer to identify and buy items appearing in a video. To retrieve information about the items in a frame of the video, the playback device generates a perceptual hash of that frame and uses that hash to query a first database storing perceptual hashes of different version of the video. The database query returns an identifier for the frame, which is then used to query a second database that store the item information. The results of this query are returned to the playback device, which shows them to the user, enabling the viewer to learn more about and possibly purchase the item. Using queries based on perceptual hashes of different versions of the video increases the likelihood of returning a match, despite formatting differences. And using separate hash and metadata databases makes it possible to update the metadata without changing the hashes.

Abstract: A capture setting for one or more image capture devices may be determined. The capture setting may define one or more aspects of operation for the image capture device(s). The aspect(s) of operation for the image capture device(s) may include one or more aspects of operation for a processor of the image capture device(s), an image sensor of the image capture device(s), and/or an optical element of the image capture device(s). A machine-readable optical code may be generated based on the capture setting and/or other information. The machine-readable optical code may convey the capture setting for the image capture device(s) such that a first image capture device capturing a first image including the machine-readable optical code may: (1) identify the machine-readable optical code within the first image; (2) determine the capture setting conveyed by the machine-readable optical code; and (3) operate in accordance with the capture setting.

Abstract: A zero-step user recognition and biometric access control system and method which comprises various sensors configured to capture a plurality of biometric data associated with a user, a database configured to store a plurality of user information including identifiable biometric data associated with the user, a biometric verification server configured to receive a plurality of biometric data from the sensors and user information from the database, and to return a confirmation of the user's identity, in order to provide real-time user recognition, authentication, and access control using biometric data.

Abstract: Methods and systems for rendering a virtual overlay in an extended reality (XR) environment are described. Image data is received, representing a current field of view (FOV) in the XR environment. A spatial boundary is defined in the current FOV, based on user input. An image label representing a region of interest (ROI) within the defined spatial boundary, and one or more object labels representing one or more objects within the defined spatial boundary are generated. At least one relevant virtual object is identified. The virtual object is relevant to a semantic meaning of the ROI based on the image label and/or the one or more object labels. Identification of the at least one relevant virtual object is outputted, to be renderable in the XR environment.

Abstract: The present disclosure relates to a method performed by a background blurring system (1) for provision of a video compression stream from a video camera (2) adapted for capturing a scene. The background blurring system identifies (1001) in a first image of the scene, at a first point in time, at least a first pixel comprised in a background of the first image. The background blurring system further determines (1002) a blurred pixel value for the at least first pixel. Moreover, the background blurring system provides (1003), subsequent the first point in time, the blurred pixel value in the video compression stream. The background blurring system furthermore identifies (1004) in a second image of the scene, at a subsequent second point in time, that the at least first pixel has altered to be comprised in a foreground of the second image.

Abstract: There is provided a Bluetooth system including multiple slave devices. When a first slave device among the multiple slave devices changes its connection to a different master device, the first slave device actively informs other slave devices among the multiple slave devices to connect to said different master device to realize the Bluetooth connection synchronization between the multiple slave devices.

Abstract: According to certain embodiments, an image sensor including a pixel, the pixel including a micro lens, a plurality of photodiodes, and a color filter disposed between the plurality of photodiodes and the micro lens; a processor operatively connected to the image sensor; and a memory operatively connected to the processor, wherein the memory stores one or more instructions that, when executed by the image sensor, cause the image sensor to perform a plurality of operations, the plurality of operations comprising: determining whether the image sensor is in a high-resolution mode; when the image sensor is in the high-resolution mode, calculating a disparity based on signals detected from the plurality of photodiodes; when the disparity is not greater than a threshold value, applying a first remosaic algorithm to the signals; and when the disparity is greater than the threshold value, applying a second remosaic algorithm to the signals.

Abstract: The present invention relates to a method for dynamic image content replacement in a video stream comprising generating a set of key image data (K) comprising a sequence of at least two different key images (K1, K2), periodically displaying said set of key image data (K) on a physical display, generating at least a first original video stream (O1) of a scene which includes said physical display by recording said scene with a camera, wherein said at least one video stream (O1) comprises key video frames (FK1, FK2), captures synchronously with displaying each of said at least two different key images (K1, K2) of said set of key image data (K) on said physical display, generating a mask area (MA) corresponding to an active area of said physical display visible in said key video frames from differential images (AFK) obtained from consecutive key video frames (FK1, FK2), generating at least one alternative video stream (V) by inserting of alternative image content (I) into the mask area (MA) of an original video s

Abstract: Methods and apparatus for metadata-based cinematography, production effects, shot selection, and/or other content augmentation. Effective cinematography conveys storyline, emotion, excitement, etc. Unfortunately, most amateur filmmakers lack the knowledge and ability to create cinema quality media. Various aspects of the present disclosure are directed to, among other things, rendering media based on instantaneous metadata. Unlike traditional post-processing techniques that rely on human subjectivity, some of the various techniques described herein leverage the camera's actual experiential data to enable cinema-quality post-processing for the general consuming public. Instantaneous metadata-based cinematography and shot selection advisories and architectures are also described.

Abstract: Disclosed are a depth image processing method, a depth image processing apparatus (10), and an electronic device (100). The depth image processing method is applied in the electronic device (100) including a depth image capturing apparatus (20) configured to capture an initial depth image. The depth image processing method includes: obtaining (01) target depth data for a number of regions of interest of the initial depth image; determining (02) whether the number of regions of interest is greater than a predetermined value; grouping (03), in response to the number of regions of interest being greater than the predetermined value, the number of regions of interest based on the target depth data to obtain a target depth of field; obtaining (04) a target blurring intensity based on the target depth of field; and blurring (05) the initial depth image based on the target blurring intensity to obtain a blurred depth image.

Abstract: The present disclosure relates to training and utilizing an image exposure transformation network to generate a long-exposure image from a single short-exposure image (e.g., still image). In various embodiments, the image exposure transformation network is trained using adversarial learning, long-exposure ground truth images, and a multi-term loss function. In some embodiments, the image exposure transformation network includes an optical flow prediction network and/or an appearance guided attention network. Trained embodiments of the image exposure transformation network generate realistic long-exposure images from single short-exposure images without additional information.

Abstract: In accordance with some embodiments, systems, methods, and media for motion adaptive imaging using single-photon image sensor data are provided. In some embodiments, the system comprises: an image sensor comprising single-photon detectors in an array; a processor programmed to: receive a sequence of photon frames, each comprising pixels having a value indicative of whether a photon was received during a frame period, each of the pixels corresponds to a pixel location; identify, for each of the pixel locations, changepoints, each indicative of a change in scene brightness; identify a photon frame in the sequence at which at least a threshold change in brightness has occurred based on the changepoints associated with each of the plurality of pixel locations; and generate a series of changepoint frames, wherein each changepoint frame is based on estimated brightness associated with each pixel location at a point in the sequence of photon frames.

Abstract: A method for processing interactive special effects for a video includes: acquiring a reference video containing a first special effect; acquiring a second special effect in interaction with the first special effect; and acquiring a video containing the second side effect by processing an image of the reference video according to the second special effect.

Abstract: Disclosed are a method and a system for enhancing sound and picture quality based on scene recognition, and a display. The method includes: recognizing a real scene reflected in a current screen of the display; calculating sound and picture quality enhancement parameters matching the real scene; and controlling the display to play sound and picture corresponding to the real scene according to best sound and picture quality corresponding to the sound and picture quality enhancement parameters.

Abstract: The description relates to cameras, such as security cameras, and providing guidance for positioning cameras to achieve desired goals. One example can receive an image of a scene overlaid with transparent indicators that reflect accuracy of object detection in individual regions of the image. The example can correlate input received from the user on the display relative to the regions. The example can analyze subsequent images of the scene with rules derived from the input from the user.

Abstract: According to various embodiments disclosed herein, an electronic device may include: a first housing; a second housing coupled to the first housing and configured to slide in a first direction or a second direction opposite the first direction with respect to the first housing between a first position at which at least a portion of the second housing is accommodated in the first housing and a second position at which the second housing protrudes from the first housing; an optical module comprising optical circuitry mounted on the second housing, the optical module configured to be rotated in response to sliding of the second housing to be disposed to face a rear side of the first housing at the first position and to face a front side of the first housing at the second position; and an elastic member comprising a flexible elastic material accommodated in the second housing and configured to provide an elastic force to the optical module.

Abstract: An information processing apparatus according to an embodiment of the present technology includes an acquisition unit and an execution unit. The acquisition unit acquires a plurality of estimation images captured from an identical spot under a plurality of exposure conditions different from each other, to estimate mobile object information including at least one of a location or a posture of a mobile object. The execution unit executes a process regarding estimation of the mobile object information on the basis of the plurality of acquired estimation images.

Abstract: Methods and apparatus provide for: capturing an image of a subject from a position; capturing a plurality of images of the subject from a plurality of further positions around the position such that the plurality of captured images of the subject are at least one of different in image quality and view angles than the image of the subject from the position; generating data to be output on a basis of the image captured from the position and the plurality of images captured from the plurality of further positions; synthesizing the image captured from the position and the plurality of images captured from the plurality of further positions; and changing a synthesis ratio according to an image synthesis position.

Abstract: The present disclosure relates to a signal processing device and an imaging device capable of improving an image quality of the imaging device that does not use an imaging lens. A signal processing device includes a restoration unit that restores one restored image by using a plurality of detection signal sets obtained by an imaging element in a plurality of states in which at least one of a position or orientation with respect to a subject is different, the imaging element that includes a plurality of pixel output units that receives incident light from the subject incident without an intervention of an imaging lens or a pinhole and each outputs one detection signal indicating an output pixel value modulated by an incident angle of the incident light, and outputs a detection signal set including a plurality of detection signals output from the plurality of pixel output units. The present disclosure is applicable to, for example, an imaging system that images using a plurality of imaging devices.