Abstract: Examples of the disclosure describe systems and methods for recording augmented reality and mixed reality experiences. In an example method, an image of a real environment is received via a camera of a wearable head device. A pose of the wearable head device is estimated, and a first image of a virtual environment is generated based on the pose. A second image of the virtual environment is generated based on the pose, wherein the second image of the virtual environment comprises a larger field of view than a field of view of the first image of the virtual environment. A combined image is generated based on the second image of the virtual environment and the image of the real environment.

Abstract: An example apparatus includes image processing circuitry to determine an uncovered region of a background image in a current video frame relative to the background image in a previous video frame, the uncovered region obscured in the previous video frame by a first foreground region of the previous video frame, and the uncovered region uncovered in the current video frame based on movement of a second foreground region in the current video frame relative to the first foreground region of the previous video frame, and encoder circuitry to generate an updated frame portion by encoding the second foreground region and dirty blocks of the background image corresponding to the uncovered region without encoding static blocks of the background image, the static blocks not corresponding to the uncovered region, and store the updated frame portion in the at least one memory.

Abstract: The disclosure is detecting an authentication target who is moving in a predetermined direction in a video; inputting a first image in which an entire body of the target; calculating characteristic information from an image of the entire body in the first image, comparing the calculated characteristic information with characteristic information of the entire body stored in first memory that stores characteristic information of entire bodies of targets, and extracting candidate information of the targets from the first memory based on a first authentication result; inputting a second image in which an iris of the target; and comparing characteristic information of irises stored in second memory that stores the characteristic information of the irises of targets with characteristic information of an iris from the second image, calculating a verification score, executing second authentication on the target in the second image based on the verification score, and outputting an authentication result.

Abstract: The disclosure is detecting an authentication target who is moving in a predetermined direction in a video; inputting a first image in which an entire body of the target; calculating characteristic information from an image of the entire body in the first image, comparing the calculated characteristic information with characteristic information of the entire body stored in first memory that stores characteristic information of entire bodies of targets, and extracting candidate information of the targets from the first memory based on a first authentication result; inputting a second image in which an iris of the target; and comparing characteristic information of irises stored in second memory that stores the characteristic information of the irises of targets with characteristic information of an iris from the second image, calculating a verification score, executing second authentication on the target in the second image based on the verification score, and outputting an authentication result.

Abstract: A shooting method includes: displaying, on the display, a shooting preview interface collected by a first camera; displaying, on the shooting preview interface, a first image composition and a second image composition that respectively correspond to a first subject and a second subject, where the first subject is different from the second subject; displaying a guide mark on the shooting preview interface, to guide a user to operate the electronic device, so that a framing range of the second camera and the first image composition meet a matching condition; and in response to meeting the matching condition, displaying a first recommended image including the first subject on the display, where the first recommended image is collected by a second camera, wherein an angle of view of the first camera is greater than an angle of view of the second camera.

Abstract: Disclosed is a method for providing custom visual settings on a device including a display and at least one camera. The method comprises displaying a video on the display of the device, the video including data specifying the camera settings and visual effects that were applied during capture of the video, displaying a camera effects shortcut, receiving user selection of the camera effects shortcut, and, based on receipt of user selection of the camera effects shortcut, displaying, on the display, a video feed from the at least one camera on the with the visual effects and camera settings specified by the data.

Abstract: An image gaze correction method, apparatus, electronic device, computer-readable storage medium, and computer program product related to the field of artificial intelligence technologies are provided. The image gaze correction method includes: acquiring an eye image from an image; performing feature extraction processing on the eye image to obtain feature information of the eye image; performing, based on the feature information and a target gaze direction, gaze correction processing on the eye image to obtain an initially corrected eye image and an eye contour mask; performing, by using the eye contour mask, adjustment processing on the initially corrected eye image to obtain a corrected eye image; and generating a gaze corrected image based on the corrected eye image.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by a messaging application, an image from a camera of a user device; receiving input that selects a user-customizable effects option for activating a user-customizable effects mode; in response to receiving the input, displaying an array of a plurality of effect options together with the image proximate to the user-customizable effects option; and applying a first effect associated with a first effect option of the plurality of effect options to the image.

Abstract: An avatar generating method and device, a terminal and a storage medium are provided. The avatar model corresponding to the target object is acquired by collecting a frame image of the target object, and the avatar of the target object is rendered based on the avatar model. The similarity between each part of a head of the avatar model and a corresponding part of a head of the target object meets a similarity condition, so that the avatar is generated based the feature of each part of the head of the target object, and different target objects correspond to different avatars.

Abstract: A computing device is provided, including a storage device configured to store image data and a processor coupled to a memory that stores instructions, which, upon execution by the processor, cause the processor to select a target image from the image data. The processor is further configured to display conversion possibility information that indicates that the target image can be converted into a larger image that has a larger field of view by stitching other images together with at least a portion of the target image and an associated selector. The processor is further configured to display the larger image upon receiving a user selection of the selector.

Abstract: A photographing method and an electronic device. The photographing method includes: receiving, by the electronic device, a first operation for triggering the electronic device to enter a large aperture mode; obtaining, by the electronic device, a distance value between the electronic device and a photographed target object in response to the first operation; enabling, by the electronic device in a case that a distance value does not exceed a first distance threshold, a first camera and a second camera to acquire the image of the target object; enabling, by the electronic device in a case that the distance value exceeds the first distance threshold, the first camera and a third camera to acquire the image of the target object; and displaying, by the electronic device, a preview image including the target object.

Abstract: To provide a device and a method of analyzing a change in the degree of focusing between a current image and a past image and outputting display data capable of identifying a change in the degree of focusing to a display unit. A focusing-degree change analysis unit that analyzes a change in a degree of focusing between a current image output from an image sensor and a past image output from the image sensor before the current image is output and a display control unit that generates display data enabling checking of a focusing-degree change state from the past image in units of pixel regions of the current image by using an analysis result of the focusing-degree change analysis unit are provided. Pixel classification information indicating which of (a) pixel approaching focusing, (b) pixel out of focusing, and (c) pixel with no change in the degree of focusing each pixel corresponds to is generated and output in units of pixels.

Abstract: An image capturing system includes an image capturing unit including an image capturing surface on which pixel blocks each including a plurality of pixels are two-dimensionally arranged, exposure parameters being separately settable for the pixel blocks, a determination unit configured to determine a first exposure parameter and a second exposure parameter so that a difference between the first exposure parameter and the second exposure parameter is greater than or equal to a predetermined value, an exposure control unit configured to set the first exposure parameter determined by the determination unit and the second exposure parameter determined by the determination unit alternately as the exposure parameters for the pixel blocks and configured to control image capturing by the image capturing unit, and a display unit configured to display an image captured by the image capturing unit.

Abstract: Provided is an information processing apparatus and an information processing method that enable appropriate recording of information written on a writing object. A region setting unit sets, in a writing image that shows the writing object on which written information is written, a writing region that includes the written information, and a recording control unit that controls recording of the writing image in response to a change in the writing region. The present disclosure can be applied to, for example, a board writing recording system.

Abstract: The present disclosure provides video special effect configuration method, device, equipment and storage medium, and relates to the technical field of special effect processing. The method includes: adding a variable update node in a first special effect event combination in response to a first setting operation of a user, in which an update manner of a target variable is set on the variable update node; adding a variable trigger node in a second special effect event combination in response to a second setting operation of the user, in which a judging condition of the target variable is set on the variable trigger node; and generating a configuration file of a video special effect according to the first and second special effect event combinations. The technical solution of the present disclosure allows the production of the video special effect to better fit in the action changes of the user.

Abstract: An imaging apparatus includes an imaging unit, an operation unit configured to be operated by an operation in a first phase and an operation in a second phase, a recording control unit configured to record a moving image captured by the imaging unit in a moving image file in response to an operation performed on the operation unit, and a control unit configured to perform control to cause the imaging apparatus to display file information about the moving image file to be recorded by the recording control unit in response to performance of the operation in the first phase, and to cause the imaging apparatus to hide the file information that is displayed in response to the performance of the operation in the first phase, in response to performance of the operation in the second phase.

Abstract: A camera array for a mediated-reality system includes a plurality of hexagonal cells arranged in a honeycomb pattern in which a pair of inner cells include respective edges adjacent to each other and a pair of outer cells are separated from each other by the inner cells. A plurality of cameras are mounted within each of the plurality of hexagonal cells. The plurality of cameras include at least one camera of a first type and at least one camera of a second type. The camera of the first type may have a longer focal length than the camera of the second type.

Abstract: A lower dynamic range visual content (21) of a virtual reality or VR scene represented in a curved shape form is adapted to a higher dynamic range display of the virtual reality scene. At least two planar key views (230) of the VR scene area obtained at least two parameter values (240) respectively associated with those planar key views are obtained, corresponding to at least one parameter adapted to expand a dynamic range of a visual content, and a higher dynamic range visual content (22) corresponding to the lower dynamic range visual content in at least part of the VR scene extending beyond the planar key views is determined, based on the parameter values. Applications to Inverse Tone Mapping.

Abstract: An image processing system includes a housing that forms a passage through which paper pieces pass, imaging units that capture images of the paper pieces passing through the housing, and an AI image processing apparatus that restores a restoration target on the basis of the images captured by the imaging unit so that the contents of the restoration target become viewable.

Abstract: A mobile phone having an application or system module operable to attach the mobile phone to a computing device as a wireless accessory to the computing device over a wireless connection between the mobile phone and the computing device, based at least in part on that the mobile phone is located within a predetermined proximity radius from the computing device, and a display device of the computing device is inactive.

Abstract: An information processing apparatus (10) includes: a deciding unit configured to decide alignment information to be used for alignment between a first image captured by a first imaging device and a second image captured by a second imaging device having an angle of view wider than an angle of view of the first imaging device, on the basis of imaging-related information related to imaging performed by the first imaging device; and an outputting unit configured to output the alignment information.

Abstract: Techniques for using motion data to generate a high resolution output color image from multiple images having sparse color information are disclosed. A camera generates multiple images. The camera's sensor is configured to have a sparse Bayer pattern. While the camera is generating the images, IMU data for each image is acquired. The IMU data indicates a corresponding pose the camera was in while the camera generated each image. The images and the IMU data are fed as input into a motion model. The motion model performs temporal filtering on the images and uses the IMU data to generate a red-only image, a green-only image, and a blue-only image. A high resolution output color image is generated by combining the red-only image, the green-only image, and the blue-only image.

Abstract: A combined multi-spectral and polarization (CMSP) sensor is disclosed that enhances contrast-to-noise ratio (CNR). The CMSP sensor comprises a multi-spectral and polarization (MSP) filter, a single focal plane array (FPA), and a controller. The FPA comprises a plurality of detectors and the MSP filter comprises at least a first bandpass filter having a first frequency range and a second bandpass filter having a second frequency range that is distinct from the first frequency range and a first polarization filter having a first polarization value and a second polarization filter having a second polarization value that is distinct from the first polarization value.

Abstract: The present invention concerns a method of encapsulating images in a file, wherein the method comprises determining a grouping type based on a capture mode of the images; generating a grouping data structure describing the images as a group, the grouping data structure comprising image identifiers of the images of the group; and embedding the grouping data structure, the grouping type and the images in the file.

Abstract: An image capable of confirming a focus position is generated without superimposing a peaking signal on a captured image. Therefore, an image processing apparatus according to the present technology includes an image signal generation unit that generates a plurality of image signals having frequency characteristics different from each other from one captured image signal, and a blending processing unit that blends the plurality of image signals on the basis of a blend ratio determined on the basis of a peaking signal for the one captured image signal.

Abstract: A camera lens smoothing method includes: obtaining a current video frame of a camera video and gyroscope information of the current video frame, and calculating a current first rotation matrix; conducting smoothing on the first rotation matrix, and calculating a third rotation matrix; conducting viewpoint decomposition on the current video frame according to the third rotation matrix, and calculating a fourth rotation matrix; and conducting 3D rotation on the current video frame according to the fourth rotation matrix, and rebuilding an anti-shake video.

Abstract: An optoelectronic device having a set of pixels wherein each pixel has a sub-pixel capable of emitting a primary light beam, a set of pixels each pixel being adjacent to a pixel wherein each secondary pixel has at least one secondary sub-pixel capable of emitting a secondary light beam, a set of optical systems arranged so as to be able to cover an entire pixel belonging to one of the sets and at least part of the sub-pixels of at least one of the adjacent pixels belonging to the other set, the number of pixels being greater than twice the number of optical systems. At least one movement mechanism applies a relative movement between the set and the sets according to a predetermined sequence.

Abstract: Among other things, embodiments of the present disclosure can help to automatically generate images displaying activity-based information and distribute such images to other users, such as members of a social network. The image may be modified based on activity data associated with other users and/or from other activity sensors.

Abstract: Techniques for synthesizing intermediary frames for long exposure images are disclosed. Video stream data, comprising a plurality of arriving frames, is received. An indication that the video stream data should be processed into a long exposure image that incorporates one or more synthesized frames is received. A set of arriving frames is used to generate at least one synthesized frame. At least one received frame is blended with the at least one generated synthesized frame to form a long exposure image. The long exposure image is provided as output.

Abstract: Methods and apparatus for metadata-based cinematography, production effects, shot selection, and/or other content augmentation. Effective cinematography conveys storyline, emotion, excitement, etc. Unfortunately, most amateur filmmakers lack the knowledge and ability to create cinema quality media. Various aspects of the present disclosure are directed to, among other things, rendering media based on instantaneous metadata. Unlike traditional post-processing techniques that rely on human subjectivity, some of the various techniques described herein leverage the camera's actual experiential data to enable cinema-quality post-processing for the general consuming public. Instantaneous metadata-based cinematography and shot selection advisories and architectures are also described.

Abstract: There is provided an imaging device including: an image processing unit; a face recognition processing unit; a storage unit; and a composition processing unit for generating composite data by a composition process so that persons photographed in each of a plurality of image data are included in one image data. The face recognition processing unit recognizes a first person by performing a face recognition process on first image data. When second image data obtained by photographing a second person at the different photographing timing of the first image data, with the same background as the first image data, is recorded in the storage unit, the composition processing unit generates composite data in which the first person and the second person are superimposed on the same background.

Abstract: An image processing system and a processing method of video stream are provided. The first image is obtained according to a parameter. The deformation correction procedure is performed on the first image, and the second image is generated. The identification detection procedure is performed on the second image, and a detected result is generated. Control information is generated according to the detected result. The parameter is adjusted according to the control information, and a third image is generated. The second image and the third image are output. Therefore, the subsequent application could be enhanced through the dual image outputs.

Abstract: Images are captured with a sample object in various arrangements relative to lighting and a detector. The images are then combined image point by image point on the basis of a comparison of image point values of image points of said images. This achieves a reduction in interference, i.e. reflections and/or shadows can be reduced.

Abstract: Image pickup apparatuses, control methods and storage mediums for use therewith are provided herein. At least one image pickup apparatus includes: a display unit that displays an image generated by an imaging unit; an image processing unit that extracts in-focus areas from a plurality of images different in in-focus position that are generated by the imaging unit and that composites the extracted areas; and a control unit. The control unit acquires, out of image magnifications corresponding to the plurality of images different in in-focus position, a reference image magnification, and the image processing unit corrects the image to be displayed on the display unit based on an image magnification corresponding to the image to be displayed on the display unit and the reference image magnification.

Abstract: A method includes obtaining a first preview picture collected by a camera, where an angle of view FOV of the camera is a first FOV value. The camera collects the first preview picture based on a second FOV value, and the second FOV value is less than the first FOV value. The method further includes adjusting the second FOV value to a third FOV value when it is detected that a quantity of at least one target human face in the first preview picture is greater than a first preset value, where the third FOV value is greater than the second FOV value, and the third FOV value is less than or equal to the first FOV value; and outputting an image that is photographed by the camera based on the third FOV value.

Abstract: System and method for reducing false negatives in object detection, including: extracting an object of interest from a respective image in a first set of training data that includes in distribution (ID) data. For each of the object of interest extracted from the respective image in the first set of training data: fusing the object of interest with an image from a second set of data that does not include any objects of interest to form a fused image; adding the fused image to the training data; and using the training data to train a detection model for object detection.

Abstract: A photographing method and apparatus are provided. The photographing method includes: identifying a photographing distance and a photographing angle with respect to the external device based on timings of signals transmitted and received through a communication connection; acquiring a scene image based on an output of a camera of the photographing device; identifying a current composition model based on the photographing distance, the photographing angle and the scene image; acquiring a set of photographing parameters that are associated with the current composition model; identifying a focal length based on the photographing distance and the current composition model; displaying a preview image based on the output of the camera, the photographing parameter and the current composition model; outputting the preview image as a photographing result based on a photographing instruction; and updating the set of photographing parameters based on the photographing parameter.

Abstract: A method for generating a three-dimensional image of an object, comprising receiving a set of input point cloud data from an imaging system, the set of input point cloud data comprising two or more input point clouds, determining, for each point in the respective input point clouds, a value of a quality parameter that reflects a degree of uncertainty in the three dimensional coordinates as specified for that point, generating an output point cloud for generating a three-dimensional representation of the object surface, wherein, for each point in the output point cloud, the coordinates of the respective point are computed based on the coordinate values of the points in the input point clouds, wherein the extent to which the coordinate values in the respective input point clouds are taken into consideration in the computation is determined based on the values of the quality parameter associated with those respective points.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by a messaging application, an image from a camera of a user device; receiving input that selects a user-customizable effects option for activating a user-customizable effects mode; in response to receiving the input, displaying an array of a plurality of effect options together with the image proximate to the user-customizable effects option; and applying a first effect associated with a first effect option of the plurality of effect options to the image.

Abstract: The present technology is a graphical user interface for a video recording system and method of recording a video while applying special effects in real time prior to and/or while recording. The interface is associated with an electronic device including a processor in communication with a camera and a memory unit. Inputs from the interface are utilized by the processing unit to determine if the native speed rate of the raw video data is to be changed, and if so then modifies at least one frame in the raw video data to create a modified video data at a modified speed rate that is different to the native speed rate. The system then generates an output video feed that is displayed in the graphical user interface. This allows for the continuous recording of video from the camera or video feed at different speed rates without altering camera operations or settings.

Abstract: An image capture apparatus according to an embodiment of the present technology includes an image generation unit, an edge detection unit, and a color control unit. The image generation unit generates a captured image by capturing a subject. The edge detection unit detects an edge portion included in the generated captured image. The color control unit controls a color of a highlighted display for highlighting the edge portion for each detected edge portion based on color information about the edge portion in the captured image.

Abstract: Shoppable video enables a viewer to identify and buy items appearing in a video. To retrieve information about the items in a frame of the video, the playback device generates a perceptual hash of that frame and uses that hash to query a first database storing perceptual hashes of different version of the video. The database query returns an identifier for the frame, which is then used to query a second database that store the item information. The results of this query are returned to the playback device, which shows them to the user, enabling the viewer to learn more about and possibly purchase the item. Using queries based on perceptual hashes of different versions of the video increases the likelihood of returning a match, despite formatting differences. And using separate hash and metadata databases makes it possible to update the metadata without changing the hashes.

Abstract: A capture setting for one or more image capture devices may be determined. The capture setting may define one or more aspects of operation for the image capture device(s). The aspect(s) of operation for the image capture device(s) may include one or more aspects of operation for a processor of the image capture device(s), an image sensor of the image capture device(s), and/or an optical element of the image capture device(s). A machine-readable optical code may be generated based on the capture setting and/or other information. The machine-readable optical code may convey the capture setting for the image capture device(s) such that a first image capture device capturing a first image including the machine-readable optical code may: (1) identify the machine-readable optical code within the first image; (2) determine the capture setting conveyed by the machine-readable optical code; and (3) operate in accordance with the capture setting.

Abstract: A zero-step user recognition and biometric access control system and method which comprises various sensors configured to capture a plurality of biometric data associated with a user, a database configured to store a plurality of user information including identifiable biometric data associated with the user, a biometric verification server configured to receive a plurality of biometric data from the sensors and user information from the database, and to return a confirmation of the user's identity, in order to provide real-time user recognition, authentication, and access control using biometric data.

Abstract: Methods and systems for rendering a virtual overlay in an extended reality (XR) environment are described. Image data is received, representing a current field of view (FOV) in the XR environment. A spatial boundary is defined in the current FOV, based on user input. An image label representing a region of interest (ROI) within the defined spatial boundary, and one or more object labels representing one or more objects within the defined spatial boundary are generated. At least one relevant virtual object is identified. The virtual object is relevant to a semantic meaning of the ROI based on the image label and/or the one or more object labels. Identification of the at least one relevant virtual object is outputted, to be renderable in the XR environment.

Abstract: The present disclosure relates to a method performed by a background blurring system (1) for provision of a video compression stream from a video camera (2) adapted for capturing a scene. The background blurring system identifies (1001) in a first image of the scene, at a first point in time, at least a first pixel comprised in a background of the first image. The background blurring system further determines (1002) a blurred pixel value for the at least first pixel. Moreover, the background blurring system provides (1003), subsequent the first point in time, the blurred pixel value in the video compression stream. The background blurring system furthermore identifies (1004) in a second image of the scene, at a subsequent second point in time, that the at least first pixel has altered to be comprised in a foreground of the second image.

Abstract: There is provided a Bluetooth system including multiple slave devices. When a first slave device among the multiple slave devices changes its connection to a different master device, the first slave device actively informs other slave devices among the multiple slave devices to connect to said different master device to realize the Bluetooth connection synchronization between the multiple slave devices.

Abstract: According to certain embodiments, an image sensor including a pixel, the pixel including a micro lens, a plurality of photodiodes, and a color filter disposed between the plurality of photodiodes and the micro lens; a processor operatively connected to the image sensor; and a memory operatively connected to the processor, wherein the memory stores one or more instructions that, when executed by the image sensor, cause the image sensor to perform a plurality of operations, the plurality of operations comprising: determining whether the image sensor is in a high-resolution mode; when the image sensor is in the high-resolution mode, calculating a disparity based on signals detected from the plurality of photodiodes; when the disparity is not greater than a threshold value, applying a first remosaic algorithm to the signals; and when the disparity is greater than the threshold value, applying a second remosaic algorithm to the signals.

Abstract: The present invention relates to a method for dynamic image content replacement in a video stream comprising generating a set of key image data (K) comprising a sequence of at least two different key images (K1, K2), periodically displaying said set of key image data (K) on a physical display, generating at least a first original video stream (O1) of a scene which includes said physical display by recording said scene with a camera, wherein said at least one video stream (O1) comprises key video frames (FK1, FK2), captures synchronously with displaying each of said at least two different key images (K1, K2) of said set of key image data (K) on said physical display, generating a mask area (MA) corresponding to an active area of said physical display visible in said key video frames from differential images (AFK) obtained from consecutive key video frames (FK1, FK2), generating at least one alternative video stream (V) by inserting of alternative image content (I) into the mask area (MA) of an original video s

Abstract: Methods and apparatus for metadata-based cinematography, production effects, shot selection, and/or other content augmentation. Effective cinematography conveys storyline, emotion, excitement, etc. Unfortunately, most amateur filmmakers lack the knowledge and ability to create cinema quality media. Various aspects of the present disclosure are directed to, among other things, rendering media based on instantaneous metadata. Unlike traditional post-processing techniques that rely on human subjectivity, some of the various techniques described herein leverage the camera's actual experiential data to enable cinema-quality post-processing for the general consuming public. Instantaneous metadata-based cinematography and shot selection advisories and architectures are also described.