Abstract: An image processing apparatus for an endoscope includes processing circuitry. The processing circuitry acquires a left image and right image. The processing circuitry generates a three-dimensional display image based on the left image and right image. The processing circuitry sets a first region in a part of the left image or right image. The first region is a region having a blur. The processing circuitry sets a second region in the left image or right image. The second region is a region where the user is performing treatment. The processing circuitry computes an overlapping region between the first region and the second region. The processing circuitry determines whether or not to notify the user based on the overlapping region. The processing circuitry generates information for notifying.

Abstract: An image capturing apparatus includes a pixel portion in which a plurality of pixel blocks are arranged, each pixel block including a predetermined number of pixels; a plurality of readout circuits arranged corresponding to the plurality of pixel blocks; a supply unit that supplies drive signals to the plurality of readout circuits; a setting unit that sets image capturing conditions for each of the plurality of pixel blocks; and a control unit that carries out control so that when the setting unit has set different image capturing conditions for a first pixel block and a second pixel block, the supply unit supplies a first drive signal to the readout circuits corresponding to the first pixel block, and supplies a second drive signal to the readout circuits corresponding to the second pixel block.

Abstract: Embodiments relate to image signal processors (ISP) that include binner circuits that down-sample an input image. An input image may include a plurality of pixels. The output image of the binner circuit may include a reduced number of pixels. The binner circuit may include a plurality of different operation modes. In a bin mode, the binner circuit may blend a subset of input pixel values to generate an output pixel quad. In a skip mode, the binner circuit may select one of the input pixel values as the output pixel pixel. The selection may be performed randomly to avoid aliasing. In a luminance mode, the binner circuit may take a weighted average of a subset of pixel values having different colors. In a color value mode, the binner circuit may select one of the colors in a subset of pixel values as an output pixel value.

Abstract: The present disclosure relates to a solid-state imaging element configured to inhibit an adverse effect, which is attributable to a light shielding film formed for disposing an OPB region, on the formation of a constituent other than the light shielding film of the solid-state imaging element, and an electronic device. According to a first aspect of the present disclosure, there is provided a solid-state imaging element, including: an effective pixel region in which a large number of pixels are vertically and horizontally arranged; and an OPB region formed by coating pixels around the effective pixel region with a light shielding film. Corners on at least one of an outer circumferential side and an inner circumferential side of the OPB region are formed into an arc shape. The present disclosure can be applied to, for example, a back-surface irradiation type CMOS image sensor.

Abstract: An image processing system includes: a plurality of imaging devices each of which includes an image processing unit that executes image processing including development processing of RAW data obtained by imaging; and an information processing device that acquires power supply information regarding power supply states of the plurality of imaging devices, selects the imaging device that executes the development processing according to the power supply state represented by the acquired power supply information, and causes the selected imaging device to execute the development processing.

Abstract: A solid-state imaging device includes a plurality of pixels each of which includes a photoelectric conversion unit that generates charges by photoelectrically converting light, and a transistor that reads a pixel signal of a level corresponding to the charges generated in the photoelectric conversion unit. A phase difference pixel which is at least a part of the plurality of pixels is configured in such a manner that the photoelectric conversion unit is divided into a plurality of photoelectric conversion units and an insulated light shielding film is embedded in a region for separating the plurality of photoelectric conversion units, which are divided, from each other.

Abstract: A single composite image is generated by selecting a pixel value for each pixel in any one of a plurality of captured images having been consecutively captured. A motion vector between at least two captured images among the plurality of captured images is calculated. Correction processing is performed, based on a motion vector corresponding to a pixel of interest in the composite image, on the pixel of interest or a pixel near the pixel of interest. The correction processing is performed by updating, using a bright pixel value, a pixel value of at least one pixel in a group of pixels associated with a path from the pixel of interest to a pixel indicated by the motion vector corresponding to the pixel of interest.

Abstract: A vehicle display device includes a conversion block that converts, based on correction data stored in a memory, an imaging pixel value of a specific pixel portion captured on a near side of at least one of a vanishing point or a horizon line in a camera image acquired by an outside camera into a correction pixel value in accordance with outside brightness detected by a brightness sensor, and a display control block that controls a virtual image display luminance of a display image displayed by a head-up display in correspondence with the correction pixel value converted from the imaging pixel value by the conversion block.

Abstract: Methods, computer program products, and systems are presented. The method computer program products, and systems can include, for instance: obtaining image data of an image representation that is being displayed on one or more viewing device during an image representation presentation session, the image representation provided by a moving video image representation having successive frames of image data, wherein the image representation is being viewed by one or more viewer user; performing object recognition on at least one frame of image data of the successive frames of image data, and generating a list of object representations within the at least one frame of image data, the list of object representations including identifiers for respective object representations included within the image representation.

Abstract: An electronic apparatus including an imaging unit, an operation unit, an output unit, and a control unit, wherein the control unit outputs a sound relating to a first warning using the output unit, in a case where a condition for issuing the first warning is satisfied, wherein the control unit stops outputting the sound relating to the first warning, in a case where an instruction is received by the operation unit, wherein the control unit doesn't output the sound relating to the first warning even when the condition for issuing the first warning is satisfied, in a case where the output of the sound relating to the first warning is stopped, and wherein the control unit outputs a sound relating to a second warning, when a condition for issuing the second warning is satisfied, in a case where the output of the sound relating to the first warning is stopped.

Abstract: To preferably transmit normal-frame-rate and high-frame-rate image data. A first ratio mixing processing is performed on two temporally-consecutive pictures in high-frame-rate image data to obtain basic-frame-rate image data, and a second ratio mixing processing is performed on the two temporally-consecutive pictures to obtain high-frame-rate image data of an extended frame. An encoding processing is performed on the reference-frame-rate image data to obtain a basic stream and an encoding processing is performed on the high-frame-rate image data of the extended frame to obtain an extended stream. A container including the basic stream and the extended stream in a predetermined format is transmitted.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for normalizing skin tone brightness are disclosed. In one aspect, a method includes the actions of receiving a color image that includes a representation of a face. The actions further include selecting a group of pixels in the color image that includes the representation of the face. The actions further include determining a brightness value that represents a brightness of the group of pixels in the color image that includes the representation of the face. The actions further include determining a brightness difference value. The actions further include comparing the brightness difference value to an upper threshold brightness difference value and a lower threshold brightness difference value. The actions further include determining whether to adjust a brightness of the color image that includes the representation of the face.

Abstract: A system includes an image sensor, an adjustable aperture, and a memory. THE memory includes computer executable instructions that, when executed by a processor, cause the system to perform operations including obtaining a first image via the image sensor based at least in part on a first aperture stop of the adjustable aperture, identifying a first pixel of the first image, identifying a second pixel of the first image, determining a second aperture stop of the adjustable aperture based at least in part on the first pixel, determining a third aperture stop of the adjustable aperture based at least in part on the second pixel, obtaining a second image via the image sensor based at least in part on the second aperture stop, and obtaining a third image via the image sensor based at least in part on the third aperture stop.

Abstract: The present technology relates to a solid-state imaging device, an electronic apparatus, a lens control method, and a vehicle capable of suppressing deterioration in quality of a captured image. A sub block includes a plurality of pixels of the same color, a block includes a plurality of sub blocks including different colors, and phase difference detection pixels are disposed at positions corresponding to each other in two or more sub blocks in a case in which the phase difference detection pixels are disposed in two or more sub blocks among the plurality of sub blocks configuring the block. For example, the present technology is able to be applied to a camera that calculates an amount of a deviation of a focus and performs focus control on a basis of a calculated defocus amount.

Abstract: Methods and systems are provided for the detecting and presenting of faint signals from a real-time interactive imager. A real-time view of a subject is controlled by a user by entering commands that move the subject or a camera used to record the real-time view. The rate of this movement is monitored, and when the rate descends below a preset value, a trigger is sent to the camera. In response to the trigger, the camera switches to a lower frame frequency for capturing the real-time view of the subject, thereby increasing the amount of light collected in each frame, and increasing the sensitivity of the camera to faint signals. The methods and systems are particularly relevant for surgical or biopsy imaging, in which both a higher frame rate preview image of a subject for 3D visualization, and a higher sensitivity fluorescence image of the subject for tumor margin assessment, are desired.

Abstract: A shift register is described. The shift register includes a plurality of cells and register space. The shift register includes circuitry having inputs to receive shifted data and outputs to transmit shifted data, wherein: i) circuitry of cells physically located between first and second logically ordered cells are configured to not perform any logical shift; ii) circuitry of cells coupled to receive shifted data transmitted by an immediately preceding logically ordered cell comprises circuitry for writing into local register space data received at an input assigned an amount of shift specified in a shift command being executed by the shift register, and, iii) circuitry of cells coupled to transmit shifted data to an immediately following logically ordered cell comprises circuitry to transmit data from an output assigned an incremented shift amount from a shift amount of an input that the data was received on.

Abstract: A method of WDR imaging. Exposure times (ETs) are set for first and second frames for an image sensor to avoid second frame saturating by setting a second ET>1/a PWM frequency applied to an LED illuminating a scene to generate second longer ET pixel data (PD). The first frame has first PD and a first ET<the second ET. A high and low intensity threshold are calculated from a full well capacity. Raw image signals are obtained originating from the image sensor of the scene. Flicker is detected by comparing the first and second frame intensity values to the high and low threshold to determine whether the first PD is flickering data. A WDR merge is performed by selecting weightings from the first and second PD for each pixel including increasing weighting of the second PD for flicker. A final image is formed from the weighted WDR merge.

Abstract: In a method of obtaining a wide dynamic range (WDR) image, a first subframe image having pixel data obtained with a first exposure time is generated by performing a first readout operation of a plurality of pixels of an image sensor. A second subframe image having pixel data obtained with a second exposure time and a third exposure time is generated by performing a second readout operation of the plurality of pixels. The first exposure time, the second exposure time and the third exposure time are different from one another. A current frame image having pixel data obtained from pixel exposures with the first exposure time, the second exposure time and the third exposure time is generated by combining the first subframe image with the second subframe image.

Abstract: An exposure method, an electronic device and a master-slave system are provided. The electronic device includes an image capturing circuit and a processor coupled to the image capturing circuit. The processor obtains an exposure command and a first quantity, controls the image capturing circuit to perform an exposure operation to capture an image according to the exposure command, and determines whether a quantity of the image reaches the first quantity. When the quantity of the image does not reach the first quantity, the processor performs the operation of controlling the image capturing circuit to perform the exposure operation to capture the image again. When the quantity of the image reaches the first quantity, the processor stops controlling the image capturing circuit to perform the exposure operation.

Abstract: An imaging control device includes: a controller that causes an imager to perform first imaging and further perform second imaging a plurality of times; and a dark image signal acquirer, the controller causes the imager to perform the second imaging in each of a plurality of exposure states where a quantity of light incident on the imager is greater than 0 and is different for each of the exposure states, by controlling the optical element, and the controller obtains, by controlling the movable lens at a time of the second imaging, a state where a first imaging condition value determined by a control state of the movable lens at the time of the second imaging is different from a second imaging condition value determined by a control state of the movable lens at a time of the first imaging.

Abstract: Techniques are disclosed for converting image frames, such as the image frames of a motion picture, from one aspect ratio to another while predicting the pan and scan framing decisions that a human operator would make. In one configuration, one or more functions for predicting pan and scan framing decisions are determined, at least in part, via machine learning using training data that includes historical pan and scan conversions. The training data may be prepared by extracting features indicating visual and/or audio elements associated with particular shots, among other things. Function(s) may be determined, using machine learning, that take such extracted features as input and output predicted pan and scan framing decisions. Thereafter, the image frames of a received video may be converted between aspect ratios on a shot-by-shot basis, by extracting the same features and using the function(s) to make pan and scan framing predictions.

Abstract: An image sensor is provided. The image sensor includes a pixel array including a plurality of pixels connected between a plurality of row lines and a plurality of column lines; an analog-to-digital converter configured to convert each of a plurality of column signals received through the plurality of column lines into a plurality of first digital signals, and convert a level of the plurality of row lines into a second digital signal; and a compensator configured to generate digital pixel data based on the plurality of first digital signals and the second digital signal.

Abstract: A method for demosaicing an image captured by an image sensor includes (a) computing, for each of a first plurality of interpolated pixel-values and based on neighboring primary pixel-values, a respective first confidence value; (b) generating a first thresholded mapping from a first coordinate mapping by removing each interpolated pixel-value having a first confidence value less than a threshold value; (c) repeating steps of computing and generating for a second and third sub-plurality of sensor pixels to yield a second and a third thresholded mapping; (d) determining high-confidence array-coordinates as array-coordinates included in all thresholded mappings, remaining array-coordinates being low-confidence array-coordinates; (e) forming a refined image including, at each high-confidence array-coordinate, a respective pixel-value-triplet including one primary pixel-value and two interpolated pixel-values; and (f) filling the refined image by assigning, for each low-confidence array-coordinate, a pixel-value

Abstract: In some examples, a computing device for processing data streams includes storage to store instructions and a processor to execute the instructions. The processor is to execute the instructions to receive respective data streams provided from a plurality of data producer sensors. The processor is also to execute the instructions to stagger a time of triggering of a first of the plurality of data producer sensors relative to a time of triggering of a second of the plurality of data producer sensors to minimize a concurrency of data frames of the data stream received from the first data producer sensor and data frames of the data stream received from the second of the plurality of data producer sensors. The processor is also to execute the instructions to process the data streams from the plurality of data producer sensors in a time-shared manner. The processor is also to execute the instructions to provide the processed data streams to one or more consumer of the processed data streams.

Abstract: Systems and methods for dynamically generating filtered audio responses based on the presence of one or more on-site participants are disclosed. In embodiments, a computer-implemented method comprises: identifying, by a computing device at a site, one or more on-site participants in a user session; receiving, by the computing device, input from a select participant of the one or more on-site participants; determining, by the computing device, context from the input; accessing, by the computing device, privacy settings of the select participant, wherein the privacy settings are associated with restricted participant data; determining, by the computing device, that the one or more participants match the restricted participant data associated with the context; and outputting, by the computing device, a filtered audio response, wherein the filtered audio response is based on the context of the input and the privacy settings of the select participant.

Abstract: An imaging apparatus includes a) an image sensor having a pixel unit with a plurality of pixels, a first memory unit, and a first rearrangement circuit; b) an information processing unit having a second memory unit, a second rearrangement circuit, and a control unit for simultaneously reading out a plurality of rows of image signals from the pixel unit, making the first rearrangement circuit rearrange image signals and then making the second rearrangement circuit rearrange image signals rearranged by the first rearrangement circuit to restore an order of the two-dimensional arrangement of the pixels in the pixel unit.

Abstract: Techniques using short depth circuits as quantum classifiers are described. In one embodiment, a system is provided that comprises: quantum hardware, a memory that stores computer-executable components and a processor that executes computer-executable components stored in the memory. In one implementation, the computer-executable components comprise a calibration component that calibrates quantum hardware to generate a short depth quantum circuit. The computer-executable components further comprise a cost function component that determines a cost function for the short depth quantum circuit based on an initial value for a parameter of a machine-learning classifier. The computer-executable components further comprise a training component that modifies the initial value for the parameter during training to a second value for the parameter based on the cost function for the short depth quantum circuit.

Abstract: An electronic device includes a motion detector operable to detect an at least partially periodic motion of the electronic device. An authentication system operable with the motion detector initiates an authentication process, such as by capturing one or more images or depth scans, to attempt to authenticate a user as an authorized user of the electronic device when the electronic device is most stationary along the at least partially periodic motion.

Abstract: An image processing apparatus includes a plurality of acquisition units configured to acquire distance distribution information about a subject included in the image, the plurality of acquisition units including a first acquisition unit configured to acquire the distance distribution information about the subject included in the image, based on parallax information about the image, and a second acquisition unit configured to acquire the distance distribution information about the subject included in the image, based on a feature quantity of the image different from the parallax information, and a determination unit configured to determine the acquisition unit which has acquired the distance distribution information with which a relighting process is to be performed, among the plurality of acquisition units.

Abstract: Systems and techniques for propagating spot healing edits from a source image to a target image include receiving a source image depicting a face with a healing region and a target image depicting the face. The face is detected in the source image including detecting facial feature points in the source image. The face is identified in the target image including detecting facial feature points in the target image. Facial feature point correspondence is determined between the facial feature points of the source image in the facial feature points of the target image. Region correspondence is determined between regions of the source image and regions of the target image using the facial feature point correspondence. The healing region of the face in the source image is transformed to a corresponding region of the face in the target image using the region correspondence.

Abstract: Provided are systems, methods, and computer-readable medium for including parameters that describe fisheye images in a 360-degree video with the 360-degree video. The 360-degree video can then be stored and/or transmitted as captured by the omnidirectional camera, without transforming the fisheye images into some other format. The parameters can later be used to map the fisheye images to an intermediate format, such as an equirectangular format. The intermediate format can be used to store, transmit, and/or display the 360-degree video. The parameters can alternatively or additionally be used to map the fisheye images directly to a format that can be displayed in a 360-degree video presentation, such as a spherical format.

Abstract: A target image capturing device according to an aspect of the present disclosure includes: a delay circuit configured to receive a timing signal from outside and output a first trigger signal at a timing delayed by a first delay time from the reception of the timing signal; an illumination light source configured to emit light based on the first trigger signal; an image capturing unit disposed to capture an image of a shadow of a target to be observed, which is generated when the target is irradiated with the light emitted from the illumination light source; a processing unit configured to perform image processing including processing of measuring a background luminance from the image captured by the image capturing unit; and a control unit configured to perform control to adjust the first delay time based on the background luminance.

Abstract: The present application discloses a method and system for processing image signals, the method and system sensing visible light bands of optical signals in an area to be imaged, via a first imaging unit, to generate a first image signal, wherein the first image signal includes color information; sensing at least infrared bands of optical signals in the area to be imaged, via a second imaging unit, to generate a second image signal, wherein the second image signal includes illumination information; and synthesizing the first image signal and the second image signal to generate a synthesized image with color information and illumination information. The present application can generate a synthesized image with a variety of advantages, and can meet the two monitoring requirements in low illumination and haze environment which are focused in the field of security.

Abstract: Systems and methods are described herein for tagging images for placement in a graphical layout based on image characteristics. The overall brightness of an image is determined and, if the overall brightness is below a threshold level of brightness, the image is tagged with a negative identifier indicating that the image cannot be dimmed. If the overall brightness exceeds the threshold level of brightness, then the image is tagged with a positive identifier indicating that the image can be dimmed. Similarly, the resolution of the image is determined and, if the resolution currently affects the image, the image is tagged with a negative identifier indicating that the image cannot be blurred. If the resolution does not affect the image, and further blurring will not affect the image, then the image is tagged with a positive identifier indicating that the image can be blurred.

Abstract: The present disclosure relates to a method and apparatus for providing a camera service by an electronic device. The electronic device may include a camera, a memory, and at least one processor, the processor configured to control the electronic device to: receive a camera shooting request; display a preview image of an external object obtained through the camera using first area information based on a first shooting mode in response to the shooting request; receive an input corresponding to a second shooting mode in the first shooting mode; and display the preview using second area information corresponding to the second shooting mode in response to the input.

Abstract: An information processing apparatus 14 includes a reception unit 22 that receives information based on a captured image obtained by an imaging device, an extraction unit 28 that extract a plurality of image data of which a degree of similarity with a subject specified by the information received by the reception unit 22 is equal to or greater than a predetermined value from a first image data group obtained by the bracket imaging and/or a second image data group obtained by non-bracket imaging which are accumulated in advance, a generation unit 30 that generates the imaging condition of the bracket imaging by using the plurality of image data extracted by the extraction unit 28, and a transmission unit 32 that transmits the imaging condition of the bracket imaging generated by the generation unit 30 to the imaging device.

Abstract: A method for processing image array data is provided, which may include the following steps: providing the image array data detected by a sensor at a first time point and including a plurality of first blocks, and each of the first blocks has a color table corresponding thereto; segmenting the image array data detected by a sensor at a second time point into a plurality of second blocks; comparing the image array data of each first block with the image array data of each second block to generate numerical difference information; and respectively allocating the color tables corresponding to the first blocks to the second blocks matching the first blocks according to the numerical difference information.

Abstract: A pass-through camera in a head-mounted device may capture image data for displaying on a display in the head-mounted device. However, only low-resolution image data may be needed to display low-resolution images in the periphery of the user's field of view on the display. Therefore, the pass-through camera may only capture high-resolution images that correspond to the portion of the user's field-of-view that is being directly viewed and may capture lower resolution image data that corresponds to the real-world objects in the user's peripheral vision. To enable the camera module to selectively capture high-resolution images, the pass-through camera may include an image sensor with two or more pixel densities, a distortion lens, and/or one or more planar or curved mirrors. Any of the components in the camera module may be adjusted to change which portion of a scene is captured with high-resolution image data.

Abstract: In one embodiment, a computing system accesses a three-dimensional (3D) model of an environment, the 3D model comprising a virtual representation of an object in the environment. The computing system accesses an image of the object captured by a camera from a camera pose. The computing system accesses material parameters associated with a material property for the virtual representation of the object. The computing system renders, using the 3D model, pixels associated with the virtual representation of the object based on the material parameters associated with the virtual representation of the object, the pixels being rendered from a virtual perspective corresponding to the camera pose. The computing system determines updated material parameters associated with the material property for the virtual representation of the object based on a comparison of the rendered pixels to corresponding pixels located in the image of the object.

Abstract: A treadmill includes a base including two rest zones and a running zone arranged between the two rest zones; a running track disposed in the running zone of the base enabling a user to exercise thereon; and a detection module. The detection module includes a light emitter emitting light to cover the two rest zones and the running zone, and at least one light sensor detecting a position and a speed of the user according to a reflected light from the user.

Abstract: Disclosed are an apparatus for recognizing a fingerprint, a display device, and the apparatus includes: a display panel, light sources, a supporting element, an optically-coupling element, a photo-detecting element on optical paths of the light sources, a processing element; the light sources, the supporting element are on side of a second surface of the display panel; the supporting element supports light sources so that light rays exiting light sources are incident obliquely onto the display panel; the optically-coupling element, the photo-detecting element are on the second surface; the photo-detecting element is on side of the optically-coupling element away from light sources; the optically-coupling element makes light rays emitted from light sources totally reflect in the display panel; the photo-detecting element detects exiting light after light rays exiting the light sources are reflected by the display panel, transmits detected signals to the processing element; the processing element determines a f

Abstract: The present application discloses various systems, methods and non-transitory computer-readable mediums that include a first device and a second device to perform processing on a digital image. According to one example, a second one or more edits made using the second device are user subjective and a first one or more edits made using the first device are user agnostic. The second one or more edits are reliant on the first one or more edits for processing flexibility to achieve a desired image attribute.

Abstract: A mobile device is provided. The mobile device includes multiple cameras and a processor configured to perform image processing on image data output from the cameras.

Abstract: A method and apparatus are provided. The method includes obtaining a panoramic video formed by plural panoramic picture frames, each being formed to record a scenery of a viewing angle. The panoramic video is divided into N viewing angle video sequences, each sequence being formed by areas that are in the panoramic picture frames, that do not overlap with each other, and that have a same horizontal viewing angle. The sum of the viewing angles of the N video sequences is a total horizontal viewing angle of the panoramic picture frame, N being a positive integer. The N video sequences are respectively encoded to obtain N respective groups of encoded data, and a viewing angle is determined. A viewing angle video sequence whose viewing angle comprises the determined viewing angle is selected, and encoded data of the selected viewing angle video sequence is transmitted.

Abstract: Provided is a control device including: an imaging control section that controls imaging in an imaging device; and a detecting section that detects a photographic subject on a basis of a first captured image in which a detection region set at a part within a field angle of the imaging device has been imaged. The imaging control section makes the imaging device perform imaging of the detection region or imaging of an acquisition region set within the field angle of the imaging device, and in a case where the photographic subject has been detected on a basis of the first captured image, the imaging control section makes the imaging device perform imaging of the acquisition region.

Abstract: The present disclosure relates to an imaging device, a method for manufacturing an imaging device, and an electronic device capable of reducing light entering an electric-charge holding unit in a back-illuminated imaging device. An imaging device includes: a photoelectric conversion unit; an electric-charge holding unit; a semiconductor substrate; a wiring layer; an insulation film layer; a first light-shielding film; and a second light-shielding film. The insulation film layer, the first light-shielding film, and the wiring layer are stacked on a second surface of the semiconductor substrate. The second light-shielding film includes: a first light-shielding portion extending from the first surface of the semiconductor substrate to a middle of the semiconductor substrate; a second light-shielding portion penetrating the semiconductor substrate; and a third light-shielding portion covering a part of the first surface of the semiconductor substrate.

Abstract: Methods and devices are described for image or video capture while in a manual mode. In some aspects, a device includes one or more processors. The device also includes a memory coupled to the one or more processors. The memory includes instructions that, when executed by the one or more processors, causes the device to generate a first image frame of a scene using manual mode settings and generate a second image frame of the scene using automatic mode settings different from the manual mode settings.

Abstract: A system may include a memory device to store instructions and data, and at least one processing device to execute the instructions stored in the memory device to: receive a background image and a digital object to be composited onto the background image in a mixed reality view, generate a 2D bounding region for the digital object, select a version of the background image at a pre-defined resolution, overlay the 2D bounding region on the selected version of the background image and obtain a set of samples of the colors of pixels of the selected version along a perimeter of the 2D bounding region, and determine a value for one or more digital lighting sources to illuminate the digital object in the mixed reality view, based, at least in part, on the set of samples.

Abstract: Some embodiments provide a novel compressive-sensing image capture device and a method of using data captured by the compressive-sensing image capture device. The novel compressive-sensing image capture device includes an array of sensors for detecting electromagnetic radiation. Each sensor in the sensor array has an associated mask that blocks electromagnetic radiation from portions of the sensor. In some embodiments, an array of passive masks is used to block a particular set of areas of each sensor in the sensor array. In some embodiments, the image capture device also includes an array of lenses corresponding to the sensors of the sensor array such that each sensor receives light that passes through a different lens. Some embodiments of the invention provide a dynamic mask array. In some embodiments, a novel machine trained network is provided that processes image capture data captured by the compressive-sensing image capture device to predict solutions to problems.

Abstract: A multi-aperture imaging system comprising a first camera with a first sensor that captures a first image and a second camera with a second sensor that captures a second image, the two cameras having either identical or different FOVs. The first sensor may have a standard color filter array (CFA) covering one sensor section and a non-standard color CFA covering another. The second sensor may have either Clear or standard CFA covered sections. Either image may be chosen to be a primary or an auxiliary image, based on a zoom factor. An output image with a point of view determined by the primary image is obtained by registering the auxiliary image to the primary image.