Abstract: Provided are a display device and method. The device includes: a processor, a display screen component, and a half-transmitting and half-reflecting mirror. The display screen component includes a close-range display screen and a long-range display screen. A distance from the close-range display screen to the half-transmitting and half-reflecting mirror is shorter than a distance from the long-range display screen to the half-transmitting and half-reflecting mirror. The processor is used for sending a close-range image among an image to the close-range display screen for display and sending a long-range image among the image to the long-range display screen for display. The half-transmitting and half-reflecting mirror is used for reflecting and transmitting light emitted from the close-range display screen and light emitted from the long-range display screen. By implementing the embodiment of the scheme, the realistic effect of an image may be enhanced.

Abstract: During control of a user interface via free-space motions of a hand or other suitable control object, switching between control modes can be facilitated by tracking the control object's movements relative to, and its contact with a “virtual touch plane or surface” (i.e., a plane, portion of a plane, and/or surface computationally defined in space, or corresponding to any physical surface).

Abstract: This invention provides a codec for depth compression and decompression in 3D-video streaming, recording and visualization applications. PROBLEM: Use of 3D-video imaging is relevant to a vast of data to be recorded into storage media and streamed in real-time through communication media with bandwidth limitations. Reduction of 3D-video data amount can be achieved by using variety of compression methods. Some conventional methods of 2D-video processing are applicable also for 3D-video streams. However, significant reduction of video data amount is relevant to use of lossy processing methods, operation-greedy algorithms, and challenges for visual quality of the processed 3D-videos. SOLUTION: The codec for 3D-video depth information compression and decompression, by employing depth similarities between neighboring rows of a single depth frame, and capabilities of rANS-algorithm to compress sets of values that have highly irregular distribution.

Abstract: Aspects of the subject disclosure may include, for example, a method, comprising: receiving, by a media processor including a processor, spherical audiovisual media content from a content delivery network; rendering, by the media processor, video for a point of view in the spherical audiovisual media content at a display device coupled to the media processor; receiving, from a remote control device coupled to the media processor, a control signal panning the point of view, resulting in a new field of view; and generating, by the media processor, audio signals from the spherical audiovisual media content corresponding to the new field of view, wherein the audio signals are adapted to audio reproduction equipment coupled to the media processor. Other embodiments are disclosed.

Abstract: An image capturing apparatus includes a first camera that captures a first image, a second camera that captures a second image, a lens cover that includes transparent parts and ridgelines and that covers the first camera and the second camera, and a processing circuit that identifies a pixel located in an area, in which it is necessary to interpolate a pixel value, in the first image, and generates an output image using the first image and interpolation pixel information for interpolating a pixel value of the identified pixel. Each ridgeline between adjacent parts of the lens cover is twisted with respect to a base line extending between a center of a first lens of the first camera and a center of a second lens of the second camera. An upper part of the lens cover opposes a base on which the first camera and the second camera are disposed.

Abstract: A lens assembly for a surveillance camera and the surveillance camera are provided. The lens assembly includes: a lens case; a lens body in which the lens case is received; a sensor circuit board having a sensor connected with the lens body, and being disposed in the lens case; and a flexible circuit board disposed inside the lens body facing the lens case, and being connected to the sensor circuit board, and bent at least once such that at least one portion of the flexible circuit board overlaps another portion thereof.

Abstract: A method for waking up a voice interaction function based on a gesture includes: acquiring an image of a user's gesture; determining whether the acquired image matches a preset image; and waking up a voice interaction function in response to the acquired image matching the preset image.

Abstract: An exemplary method includes a media content provider system acquiring, from a plurality of capture devices physically disposed at different vantage points in relation to a scene, a distinct set of two-dimensional (2D) color data and depth data (2D data) for each capture device included in the plurality of capture devices, each distinct set of 2D data representing a distinct unmeshed view of the scene as captured from a respective vantage point of a respective capture device included in the plurality of capture devices, acquiring metadata for each distinct set of 2D data, packaging each distinct set of 2D data into a transport stream such that the transport stream includes data representing each distinct unmeshed view of the scene as captured from each respective vantage point of each respective capture device, and providing the metadata and the transport stream for streaming to a media player device.

Abstract: Techniques are disclosed for detection-based wakeup of detection devices. A method may include generating a mapping that includes entries. Each entry may associate a respective detection result of a first detection device with a respective detection result of a second detection device. The method may further include transitioning the second detection device to a first power mode upon completing the generating. The method may further include determining, by the first detection device, that a first object of a first object type is detected based on the mapping. The method may further include transitioning the second detection device out of the first power mode when the first object of the first object type is determined to be detected. The method may further include performing, by the second detection device, at least one action based on the first object. Related systems and devices are also disclosed.

Abstract: Using two or more cameras attached to the eyewear, three-dimensional views with accurate and natural depth perception of the working area can be displayed for users, so that the user can maintain healthy sitting or standing posture while working on patients or objects located below horizontal eye level. Additional functions including eye protection, zoom-in, zoom-out, on-off, lighting control, overlapping, and teleconference capabilities are also supported using electronic, video and audio devices attached to the eyewear.

Abstract: There is provided a video processing system for use with a video having frames including a first frame and neighboring frames of the first frame. The system includes a memory storing a video processing application, and a processor. The processor is configured to execute the video processing application to sample scene points corresponding to an output pixel of the first frame of the frames of the video, the scene points including alternate observations of a same scene point from the neighboring frames of the first frame of the video, and filter the scene points corresponding to the output pixel to determine a color of the output pixel by calculating a weighted combination of the scene points corresponding to the output pixel.

Abstract: An image capture device in accordance with the present disclosure includes a cover coupled to a mount to surround a stereoscopic-camera unit. The stereoscopic-camera unit includes a circuit board coupled to a frame. A floating board-section of the circuit board accommodates expansion and contraction of the frame.

Abstract: The present invention provides a method and device for calibration, applied to the field of image processing. The method comprises: obtaining a first two-dimensional image of a calibration object with a marking point and a first depth map of the calibration object, obtaining calibrated three-dimensional model data of the calibration object, determining a first three-dimensional marking point in the first depth map corresponding to the marking point based on the marking point in the first two-dimensional image, determining a second three-dimensional marking point in the three-dimensional model data of the calibration object corresponding to the marking point based on the marking point in the first two-dimensional image, and determining a first matrix. By adoption of the method mentioned above, when the device for photographing the three-dimensional image is calibrated, it is simple and feasible, and the operation difficulty is small.

Abstract: One embodiment of the present invention sets forth a technique for determining a location of an object that is being manipulated or processed by a robot. The technique includes capturing a digital image of the object while the object is disposed by the robot within an imaging space, wherein the digital image includes a direct view of the object and a reflected view of the object, detecting a visible feature of the object in the direct view and the visible feature of the object in the reflected view, and computing a first location of the visible feature in a first direction based on a position of the visible feature in the direct view. The technique further includes computing a second location of the visible feature in a second direction based on a position of the visible feature in the reflected view and causing the robot to move the object to a processing station based at least in part on the first location and the second location.

Abstract: In one of the exemplary embodiments, the disclosure is directed to a depth estimation apparatus including a first type of sensor for generating a first sensor data; a second type of sensor for generating a second sensor data; and a processor coupled to the first type of sensor and the second type of sensor and configured at least for: processing the first sensor data by using two stage segmentation algorithms to generate a first segmentation result and a second segmentation result; synchronizing parameters of the first segmentation result and parameters of the second sensor data to generate a synchronized second sensor data; fusing the first segmentation result, the synchronized second sensor data, and the second segmentation result by using two stage depth estimation algorithms to generate a first depth result and a second depth result.

Abstract: Systems and methods for implementing array cameras configured to perform super-resolution processing to generate higher resolution super-resolved images using a plurality of captured images and lens stack arrays that can be utilized in array cameras are disclosed. An imaging device in accordance with one embodiment of the invention includes at least one imager array, and each imager in the array comprises a plurality of light sensing elements and a lens stack including at least one lens surface, where the lens stack is configured to form an image on the light sensing elements, control circuitry configured to capture images formed on the light sensing elements of each of the imagers, and a super-resolution processing module configured to generate at least one higher resolution super-resolved image using a plurality of the captured images.

Abstract: The present invention suggests a method of providing subtitles for a 360 content, the method comprising: generating 360 video data captured by at least one camera; stitching the 360 video data; projecting the 360 video data to a 2D image; encoding the 2D image into a video stream; generating a 360 subtitle Supplemental Enhancement Information (SEI) message for signaling a subtitle for the 360 content; inserting the 360 subtitle SEI message into the video stream; and generating a broadcast signal including the video stream, and transmitting the broadcast signal.

Abstract: An image recognition device, an image recognition method, and an image recognition unit which can achieve touch recognition with high accuracy. An image recognition device includes an image processing unit which carries out touch recognition, based on an image acquired by an image capturing device, the image capturing device being arranged in a second orthant or a third orthant, and based on a distance between a missing part generated on an image display surface due to light from a detection image display device being blocked by an object when the object is situated between the detection image display device and the image display surface, and the detection image situated on an epipolar line decided based on a positional relation between the image capturing device and the detection image display device and passing through the missing part, and displayed on the object.

Abstract: A camera system configuration generates 2D or 3D images capable of being stitched together to create panoramic images. The configuration detects a communication coupling of at least two cameras for capturing a sequence of images. The cameras themselves are configured such that their rolling shutters mitigate field of view artifacts from adjacent cameras (2D panoramas) and adjacent 3D camera pairs (3D panoramas) by allowing for the substantially temporally-aligned capture of light in overlap regions between adjacent cameras.

Abstract: A computer vision camera unit comprising first and second pairs, of image capture assemblies, both of which have an approximately same orientation to a first axis. The first and second pairs are optically focused to capture first and second fields of view that, at least, overlap each other. Providing the first and second pairs with imager chips of differing light sensitivity permits high dynamic range to be realized. Having the second field of view within the first field of view permits specialization, between the first and second pairs, similar to the roles of peripheral and foveal vision, found in biological stereo vision systems. The image capture assemblies can be organized in a rectangular configuration that implies third and fourth pairs, orthogonal to the first and second pairs. The orthogonal but interlocking nature, of the first and second pairs in relation to the third and fourth pairs, enables an autocalibration technique.

Abstract: Systems and methods may provide for using one or more stereoscopic devices for gesture control and tracking in a head mounted display (HMD). Each of the one or more stereoscopic devices may include a pair of dynamic vision sensors (DVS) arranged to have complementary fields of view (FOV) to detect one or more of a leading and a trailing edge of an object moving in a range or area to be detected. The DVS sensors determine how the object is moving based on a change in light intensity of pixels without having to detect, transfer, or process all of the pixels. The system and method may thereby provide motion tracking and gesture control functions at very low latency and processing bandwidth.

Abstract: The technology disclosed relates to automatically interpreting a gesture of a control object in a three dimensional sensor space by sensing a movement of the control object in the three dimensional sensor space, sensing orientation of the control object, defining a control plane tangential to a surface of the control object and interpreting the gesture based on whether the movement of the control object is more normal to the control plane or more parallel to the control plane.

Abstract: An imaging apparatus includes a first imaging element that receives light having passed through a first optical element and outputs an image which has a luminance value corresponding to intensity of the light and is processed as a reference image. A second imaging element receives light having passed through a second optical element and outputs an image which has a luminance value corresponding to intensity of the light and is processed as a reference image. A distance calculation device calculates a distance image on the basis of the reference image and the comparison image, and recognition device recognizes an object on the basis of the distance image calculated by the distance calculation apparatus, in which the optical elements or the imaging elements satisfy at least one of conditions in which transmittance of the first optical element is higher than transmittance of the second optical element.

Abstract: Described herein are various technologies pertaining to using a gesture to obtain contextually relevant information. Content within an area selected by a gesture is extracted. The extracted content and additional contextual information are packaged, optionally disambiguated, and provided to a search engine. Result(s) provided by the search engine are provided to a user to enrich the user experience.

Abstract: The present disclosure relates to an image processing apparatus and an image processing method that can improve performance at a time of performing special reproduction. A subsampling information determination section 204 decodes syntax per picture in a coded stream, and determines, from the decoded syntax (userdata of SEI), whether or not a picture which configures the coded stream is to be subsampled on the basis of subsampling information which is information associated with subsampling. A slice decoding section prohibits a slice from being decoded in a case in which the subsampling information determination section determines that the slice is to be subsampled. The present disclosure is applicable to, for example, an image processing apparatus that performs decoding.

Abstract: Disclosed is a multi-aperture camera system for improving depth accuracy through a focusing distance scan. The system includes a single optical system including a first aperture through which an RGB optical signal is input and a second aperture through which a non-RGB optical signal is input, the single optical system moving relative to an image sensor to be arranged at positions; an image sensor configured to obtain image sets corresponding to the positions as the single optical system moves to be arranged at the positions, wherein each image set includes an RGB image based on the RGB optical signal and a non-RGB image based on the non-RGB optical signal; and a depth determination unit configured to calculate a disparity in each image set to determine a depth of an object by using the disparity, wherein the first and second apertures have mutually intersecting central positions.

Abstract: A method and apparatus is provided for operating a mobile device having stored thereon a plurality of applications (“apps”) that are each configured to capture an image. The method includes receiving first user input data requesting invocation of a given one of the applications. The given application is launched by the user. After launching the given application a user interface is presented which serves as an entry point through which all of the image capture applications stored on the mobile device are made available to the user.

Abstract: In one embodiment, a system accesses pose probability models for predetermined parts of a body depicted in an image. Each of the pose probability models is configured for determining a probability of the associated predetermined body part being at a location in the image. The system determines a candidate pose that is defined by a set of coordinates representing candidate locations of the predetermined body parts. The system further determines a first probability score for the candidate pose based on the pose probability models and the set of coordinates of the candidate pose. A pose representation is generated for the candidate pose using a transformation model and the candidate pose. The system determines a second probability score for the pose representation based on a pose-representation probability model. The system selects the candidate pose to represent a pose of the body based on at least the first and second probability scores.

Abstract: An agricultural working machine, in particular a tractor, has at least one agricultural working unit for working a crop field including a multitude of useful plants, and a camera system which includes a 3D camera. The camera system is configured for generating with the 3D camera 3D information regarding the crop field by recording stereoscopic image pairs along two different viewing axes. The viewing axes proceed from optical centers of the 3D camera, which are connected to each other by a baseline that is inclined relative to the horizontal.

Abstract: An optical detecting apparatus for detecting a degree of freedom error of a spindle and has a standard bar and a sensor module, and is assembled between a spindle and a rotating platform of a powered machinery. The standard bar has a rod lens and a reflection face. The sensor module has two detecting groups, an oblique laser head, and a reflected spot displacement sensor. Each detecting group emits a laser light through the rod lens along the X-axis and the Y-axis of the powered machinery. The oblique laser head emits an oblique laser light to the reflected spot displacement sensor. When the spindle of the powered machinery generates errors after rotating, the sensor module receives the changes of the laser lights to obtain the displacement change signals of the standard bar for a calculation unit to detect the errors between the spindle and the rotating platform.

Abstract: This disclosure relates to providing flight control for an unmanned aerial vehicle based on opposing fields of view with overlap. The UAV may include a housing, a motor, a first image sensor, a second image sensor, a first optical element having a first field of view greater than 180 degrees, a second optical element having a second field of view greater than 180 degrees, and one or more processors. The first optical element and the second optical element may be carried by the housing such that a centerline of the second field of view is substantially opposite from a centerline of the first field of view, and a peripheral portion of the first field of view and a peripheral portion of the second field of view overlap. Flight control for the UAV may be provided based on parallax disparity of an object within the overlapping fields of view.

Abstract: To provide a medical observation device, information processing method, program, and video microscope device. A medical observation device including: a selection unit configured to select one reference camera from two or more cameras; a motion detection unit configured to detect a motion of the reference camera; a first correction information acquisition unit configured to acquire first correction information that lessens the motion of the reference camera; and a second correction information acquisition unit configured to acquire second correction information that lessens a motion of a camera other than the reference camera included in the two or more cameras using a method different from a method of the first correction information acquisition unit.

Abstract: The present disclosure relates generally to altering the cognitive load in an individual to affect the information and task processing of that individual. Specifically introducing movement in the peripheral visual field of the individual reduces the cognitive load, thereby allowing the user to be more efficient at the primary task or information processing. Included is a system comprising a support that is shaped to be positioned in front of a user and in the field of vision of the user. A central display screen is attached to the support and positioned proximate the central vision of the user. A computer readable memory medium is accessible by a processor and to instruct the central display screen to display both repetitive, non-biological movement and either information or an operating task on the central display screen.

Abstract: A video decoder assembles, in a buffer model, an access unit from a plurality of elementary streams of a video data stream. The video data stream may be a transport stream or a program stream. The same buffer model is used regardless of whether the elementary streams contain Scalable High Efficiency Video Coding (SHVC), Multi-View HEVC (MV-HEVC), or 3D-HEVC bitstreams. Furthermore, the video decoder decodes the access unit.

Abstract: This disclosure relates to advanced image signal processing technology including encoded signals and digital watermarking.

Abstract: The present technology relates to a playing apparatus, a playing method, an information processing apparatus, an information processing method, a program, and a recording medium that allow playing of appropriate HDR videos. A playing apparatus in an aspect of the present technology has a storage unit that has regions for storing a plurality of units of information indicating the state of the playing apparatus including preference information indicating the type of an HDR video to be preferentially played, out of a first HDR video that is essential in including in a content an HDR video as a video in a wider brightness range than a standard brightness range and a second HDR video that is capable of being included in the content. The playing apparatus acquires encoded data of the HDR video to be preferentially played indicated by the preference information, out of encoded data of the first HDR video and encoded data of the second HDR video, and decodes the acquired encoded data.

Abstract: It is possible to enable a reception side to easily recognize that metadata is inserted into an audio stream. A metafile including meta information for acquiring an audio stream into which metadata is inserted through a reception device is transmitted. The identification information indicating that the metadata is inserted into the audio stream is inserted into the metafile. At the reception side, it is possible to easily recognize that the metadata is inserted into the audio stream based on the identification information inserted into the metafile.

Abstract: Systems, apparatus and methods are described including operations for video coding including cross-layer cross-channel residual prediction.

Abstract: Embodiments of the present application disclose a sharing method and a sharing device. The method comprises: determining at least one piece of first information associated with a field of view of at least one user; and determining a transmission policy of at least one hologram of the at least one user at least according to the at least one piece of first information, wherein the transmission policy comprises: a sequence that is determined, for any one of the at least one user, at least according to a degree of association between a field of view of at least one other user among the at least one user and a field of view of the any user and is for transmitting at least one hologram of the any user to the at least one other user.

Abstract: Using one or more patterned markers inside the projector module of a three-dimensional (3D) camera to facilitate automatic calibration of the camera's depth sensing operation. The 3D camera utilizes epipolar geometry-based imaging in conjunction with laser beam point-scans in a triangulation-based approach to depth measurements. A light-sensing element and one or more reflective markers inside the projector module facilitate periodic self-calibration of camera's depth sensing operation. To calibrate the camera, the markers are point-scanned using the laser beam and the reflected light is sensed using the light-sensing element. Based on the output of the light-sensing element, the laser's turn-on delay is adjusted to perfectly align a laser light spot with the corresponding reflective marker. Using reflective markers, the exact direction and speed of the scanning beam over time can be determined as well.

Abstract: Stereoscopic image processing methods and apparatus are described. Left and right eye images of a stereoscopic frame are examined to determine if one or more difference reduction operations designed to reduce the luminance and/or chrominance differences between the left and right frames is within a range used to trigger a difference reduction operation. A difference reduction operation may involve assigning portions of the left and right frames to different depth regions and/or other region categories. A decision on whether or not to perform a difference reduction operation is then performed on a per regions basis with at the difference between the left and right eye portions of at least one region being reduced when a difference reduction operation is to be performed. The difference reduction process may, and in some embodiments is, performed in a precoder which processes left and right eye images of stereoscopic frames prior to stereoscopic encoding.

Abstract: The present invention discloses a television virtual touch control method and system. The television virtual touch control method is used in a television having a depth camera and includes the following steps: acquiring a human body image having depth information by the depth camera in real time; presetting an area excluding a hand area in a human body area as a reference area; extracting the depth information of the reference area and the hand area from the human body image; defining a virtual touch surface between the depth camera and the reference area at a first predetermined distance D1 from the reference area; and determining whether the hand area touches or penetrates through the virtual touch surface according to the depth information of the hand area, the depth information of the reference area and the first predetermined distance D1. The present invention has the beneficial effects of improving touch sensitivity and enhancing user experience.

Abstract: A method of generating a stereoscopic panorama is provided, the method comprising: processing a first right image, a second right image, a first left image, and a second left image to derive a right homography between the first right image and the second right image and a left homography between the first left image and the second left image; stitching the first right image with the second right image to generate a right panorama, the first left image with the second left image to generate a left panorama wherein the right homography is consistent with the left homography; and generating a stereo panorama using the right panorama and the left panorama.

Abstract: A display device includes a first display region, a second display region, a first lens, and a second lens. The first display region includes a first pixel subset and may display a first image. The first image includes a first sub-image corresponding to the first pixel subset and smaller than the first image. The second display region neighbors the first display region, includes a second pixel subset, and may display a second image. The second image includes a second sub-image corresponding to the second pixel subset and smaller than the second image. The second pixel subset is not identical to the first pixel subset. The first lens may show the first sub-image without providing the entire first image. The second lens may show the second sub-image without providing the entire second image when the first lens shows the first sub-image.

Abstract: A display device viewing angle compensation system includes a computing device that is coupled to a display device and an image capturing device. The computing device is configured to receive at least one image from the image capturing device, analyze the at least one image to detect a first user, and determine a first user viewing angle relative to the display screen. The computing device then determines at least one display screen output modification using the first user viewing angle. The computing device then applies the at least one display screen output modification to the display device to modify at least one display screen output provided on the display screen. The at least one display screen output modification may modify a display screen brightness output, a display screen contrast output and/or a display screen color output provided on the display screen.

Abstract: A transmitting method for transmitting encoded data obtained by hierarchically encoding a video image includes: generating an encoded stream that includes time information and the encoded data, the time information indicating a time at which decoding or displaying processing of the encoded data is performed, and transmitting the generated encoded stream, wherein the encoded data includes a plurality of sets each including a plurality of access units and the time information includes first time information which indicates a time at which the processing performed on a first access unit of the first set is performed and which is based on a reference clock, and second time information used to specify a time at which the processing performed on a second access unit of the second set is performed and which is based on the reference clock.

Abstract: The method of determination of a depth map of a scene comprises generation of a distance map of the scene obtained by time of flight measurements, acquisition of two images of the scene from two different viewpoints, and stereoscopic processing of the two images taking into account the distance map. The generation of the distance map includes generation of distance histograms acquisition zone by acquisition zone of the scene, and the stereoscopic processing includes, for each region of the depth map corresponding to an acquisition zone, elementary processing taking into account the corresponding histogram.

Abstract: A broadcast signal transmission method is disclosed. The broadcast signal transmission method according to one embodiment of the present invention comprises the steps of: processing video data and audio data; encoding a broadcast service component, including the video data and audio data, and service layer signaling (SLS) information on the broadcast service component on the basis of a delivery protocol; subjecting the broadcast service component, the SLS information, and service list table (SLT) information to IP packetization; and subjecting the broadcast service component, the SLS information, and the SLT information to physical layer processing.

Abstract: A camera system, an animal related system therewith, and a method for creating a 3D image of an object, the camera device including a 3D camera device to capture images of the object, a processing device to determine a 3D image from the captured images, and a mover device to move at least a part of the 3D camera device with a reciprocating movement. Providing a movement to the camera device provides a less noisy and more accurate 3D image of the object, in particular in a case of a soiled camera device.

Abstract: Provided is an imaging apparatus incorporating the “eye” of a professional photographer with photography equipment. The imaging apparatus obtains different sets of wireframes when photographing different objects. Each set of wireframes is keyed to a particular object and provides one or more of the proper framing, zooming/scaling, alignment, camera settings, and other characteristics with which to take professional-quality photographs of that particular object. The wireframes from a particular set of wireframes keyed to an object are sequentially presented on a display of the imaging apparatus. Each wireframe is overlaid atop a real-world view being captured by the apparatus camera in order to direct a shot of specific parts or aspects of the object. In some embodiments, each wireframe is also associated with post-processing routines that specify editing, adding effects or filters, or otherwise touching an image that is captured with the corresponding wireframe.