Abstract: An information processing apparatus for generating a virtual camera path by interpolation using a plurality of key frames to be a reference in the virtual camera path that indicates a path of a position of a virtual camera, comprising: a designation unit configured to accept a key frame designation operation in accordance with a user operation; a specifying unit configured to specify the number of frames between a first key frame that has already been set and a second key frame designated by the user operation; a change amount specifying unit configured to specify an amount of change per unit of time of a virtual camera parameter between the first and second key frames based on the number of frames specified by the specifying unit; and a notification unit configured to notify, to a user, the specified amount of change.

Abstract: An image processing apparatus comprising: an identifying unit that identifies, from multiple image capture apparatuses that capture images of an image capture space from multiple directions, two or more image capture apparatuses that capture images of a predetermined position in the image capture space; a camera path setting unit that sets multiple viewpoints that are based on the two or more image capture apparatuses identified by the identifying unit; a virtual viewpoint image generating unit that generates multiple viewpoint images corresponding to the multiple viewpoints based on three-dimensional shape data generated using multiple images captured by the multiple image capture apparatuses; and an image capture apparatus selecting unit that selects, from the two or more image capture apparatuses identified by the identifying unit, an image capture apparatus close to the position of the viewpoint corresponding to a viewpoint image designated by a user from the multiple viewpoint images.

Abstract: A system includes sensors and a tracking subsystem. The subsystem receives a first image feed from a first sensor and a second image feed from a second sensor. The field-of view of the second sensor at least partially overlaps with that of the first sensor. The subsystem detects an object in a frame from the first feed. The subsystem determines a first pixel position of the object. The subsystem determines a second pixel position of the object. Based on the first pixel position and the second pixel position, a global position for the object is determined in a space.

Abstract: A head-mounted display device includes an eye tracking sensor configured to obtain eye information by tracking both eyes of a user, a depth sensor configured to obtain depth information about one or more objects, and a processor configured to obtain information about a gaze point based on the eye information, and determine a measurement parameter of the depth sensor based on the information about the gaze point.

Abstract: A fingerprint detection apparatus includes a plurality of fingerprint detection units distributed in an array or disposed alternately, and each of the plurality of fingerprint detection units includes: one micro-lens configured to be disposed under the display screen; a plurality of optical sensing pixels, a center position of a photosensitive region of each of the plurality of optical sensing pixels being offset relative to a center position of the same optical sensing pixel; and at least one light shielding layer disposed between the one micro-lens and the plurality of optical sensing pixels, each of the at least one light shielding layer being provided with a hole corresponding to the plurality of optical sensing pixels. By offsetting photosensitive regions of the optical sensing pixels, the thickness of an optical fingerprint module can be reduced on the basis of improving a fingerprint identification effect on a dry finger.

Abstract: A system includes sensors onboard an autonomous vehicle, a processor, and a memory. The memory stores instructions for the processor to receive a first image pair from the sensors at a first time and a second image pair from the sensors at a second time. Each image pair includes at least one static feature in an environment of the autonomous vehicle. The memory also stores instructions to determine a distance travelled by the autonomous vehicle between the first and second times, and to determine a correction to a disparity map based on (1) a first disparity associated with the static feature(s) and the first image pair, (2) a second disparity associated with the static feature(s) and the second image pair, and (3) the distance travelled. The memory also stores instructions to cause the correction to be applied to the disparity map.

Abstract: A stereo pair camera system for depth estimation, including: a first camera disposed in a first position along a longitudinal axis, a lateral axis, and a vertical axis and having a first field of view; and a second camera disposed in a second position along the longitudinal axis, the lateral axis, and the vertical axis and having a second field of view; wherein the first camera is a of a first type and the second camera is of a second type that is different from the first type; and wherein the first field of view overlaps with the second field of view. Optionally, the first position is spaced apart from the second position along one or more of the longitudinal axis and the vertical axis. The depth estimation is used by one or more of a driver assist system and an autonomous driving system of a vehicle.

Abstract: In some examples, a system may receive, from at least one camera of a vehicle, at least one image including a road. The system may further receive vehicle location information including an indication of a location of the vehicle. In addition, the system may receive at least one of historical information from a historical database, or road anomaly information, where the road anomaly information is determined from at least one of a road anomaly database or real-time road anomaly detection. Based on the at least one image, the indication of the location of the vehicle, and the at least one of the historical information or the road anomaly information, the system may generate at least one of a disparity map or a disparity image.

Abstract: A reference object is used in measurement capturing features of the invention to calibrate a camera taking pictures of a user. The position of the reference object in the pictures of the user helps correct for rotations of the reference object that is held by the user. Once user measurements are captured, a total weighted variance is defined to identify correct size of apparel to the user. In addition to the variance, overall fit quality is determined by adding user body shape and fit anomalies of the apparel to the variance.

Abstract: A computer implemented method for warping virtual content includes receiving rendered virtual content data, the rendered virtual content data including a far depth. The method also includes receiving movement data indicating a user movement in a direction orthogonal to an optical axis. The method further includes generating warped rendered virtual content data based on the rendered virtual content data, the far depth, and the movement data.

Abstract: Embodiments relate to the field of terminals and disclose a camera switching method for a terminal, and the terminal. In those embodiments, when the terminal is installed with a plurality of cameras, automatic and dynamic switching between the cameras may be implemented based on a to-be-photographed object, thereby improving a photographing effect of the to-be-photographed object. In those embodiment, the terminal may display, in response to a first operation of enabling a photographing function by a user, a first photographing picture captured by a first camera, where the first photographing picture includes a to-be-photographed object. If the to-be-photographed object cannot be displayed completely in the first photographing picture, the terminal may switch from the first photographing picture to a second photographing picture captured by the second camera, and disabling the first camera, where an FOV of the second camera is larger than an FOV of the first camera.

Abstract: A visual positioning system for mobile devices includes at least one infrared camera, at least one infrared illumination source, and a processor that coordinates operation of the at least one camera and illumination sources. A flood IR infrared illumination source illuminates environmental objects for localization of the mobile device during a first camera exposure window, and a structured IR illumination source illuminate environmental objects for detection and mapping of obstacles during a second camera exposure window. A visual SLAM map is constructed with images obtained from a first camera, with a single map being useable for positioning and navigation across a variety of environmental lighting conditions.

Abstract: An autonomous robot system to enable flexible, safe, efficient, and automated movement of goods and materials in a dynamic environment including one or more dynamic objects (e.g., humans). The autonomous robot system includes a modular autonomous ground vehicle (AGV) including a vehicle management system having a safety management system. The safety management system includes one or more safety management controllers to perform safety functions to enable the modular AGV to operate safely and efficiently alongside humans in a dynamic environment (e.g., a warehouse or fulfillment facility).

Abstract: The multi-line laser three-dimensional imaging method and system is based on a random lattice. A multi-line laser is used and combined with a rotating mechanism to realize a large-view-field rapid scanning effect, such that the working efficiency is improved by orders of magnitude, and the deployment difficulty of the system is reduced. Due to the fact that within an imaging range, pattern features of the random lattice of each local area have uniqueness, a plurality of laser lines are extracted, position sequence numbers are distinguished, and noise points are reduced through mutual verification of the pattern features of the random lattice between adjacent images, such that the quality of three-dimensional point cloud data is greatly improved. The method and the system can be applied to industrial applications, such as disorderly grabbing, feeding and discharging, unstacking and stacking, logistics sorting and the like.

Abstract: A camera calibration information acquisition device acquires captured images of a camera calibration target from two or more cameras, detects, from each image, a coordinate of a feature point in the image, calculates—an internal parameter for each camera by using the feature point, calculates, for each camera, a magnitude of error in the coordinate of the feature point, calculates a value for an external parameter of the cameras by using the magnitude of the error, the coordinate of the feature point, and an error function set so that a penalty for error in calculating the external parameter decreases as the magnitude of the error in the coordinate of the feature point in the image increases.

Abstract: Implementations are disclosed for automatic commissioning, configuring, calibrating, and/or coordinating sensor-equipped modular edge computing devices that are mountable on agricultural vehicles. In various implementations, neighbor modular edge computing device(s) that are mounted on a vehicle nearest a given modular edge computing device may be detected based on sensor signal(s) generated by contactless sensor(s) of the given modular edge computing device. Based on the detected neighbor modular edge computing device(s), an ordinal position of the given modular edge computing device may be determined relative to a plurality of modular edge computing devices mounted on the agricultural vehicle. Based on the sensor signal(s), distance(s) to the neighbor modular edge computing device(s) may be determined. Extrinsic parameters of the given modular edge computing device may be determined based on the ordinal position of the given modular edge computing device and the distance(s).

Abstract: When an optical element is transparent, an observer is enabled to visually recognize a stereoscopic image having a stereoscopic effect. A display method for a stereoscopic image, using a display device provided with a transparent light guide plate, includes: emitting light to be recognized by the observer as a stereoscopic image (I1) from an optical element; and displaying the stereoscopic image (I1) on a stereoscopic image forming plane (P1) not parallel to an outgoing surface (21) of the optical element. In the display method, the observer is able to visually recognize a rear surface side of the display device through the optical element.

Abstract: Apparatus, including a retaining structure (54), positioned near a subject's eye that has a pupil with a diameter, an optical combiner (52A) mounted on the structure before the eye, and a pixelated screen (60A) having an array of variably transparent pixels coating the combiner. There is an image capturing device (68A) mounted on the structure to capture an image of a scene viewed by the eye, and a projector (64A) is mounted on the structure to project at least one of a portion of the captured image and a stored image onto a section of the screen at a selected location thereof. A processor (26) renders the screen section at least partially opaque, selects the section location in response to a region of interest in the scene identified by analysis of the captured image, and determines a dimension of the section in response to the pupil diameter.

Abstract: Techniques are described for passive three-dimensional (3D) image sensing based on chromatic differentiation for use in object verification. For example, multiple sub-images correspond to 3D feature regions of an object. The sub-images can be analyzed to obtain respective sets of feature depth measurements (e.g., depth, textural signatures, etc.) based on multiple differentiated chromatic components of raw image sensor data captured from the object. A verification signal can be output as a function of comparing the respective sets of feature depth measurements from the plurality of characteristic sub-images to previously stored feature depth expectations, such that the verification signal indicates whether an identity of the object is verified and/or whether the object is a spoof.

Abstract: Provided is an image sensor including a substrate, an element separation film provided on the substrate and having a mesh shape, a plurality of pixel regions formed by the element separation film, the plurality of pixel regions including a first pixel region and a second pixel region that is adjacent to the first pixel region, the element separation film being interposed between the first pixel region and the second pixel region, a first lens provided to extend along the first pixel region and the second pixel region, a first color filter configured to transmit light focused by the first lens to the first pixel region and the second pixel region, and a color filter grid forming a region in which the first color filter is provided, and at least partially overlapping the first pixel region and the second pixel region in a vertical direction.

Abstract: An unobstructed image portion of a captured image from a first camera of a camera pair, e.g., a stereoscopic camera pair including fisheye lenses, is combined with a scaled extracted image portion generated from a captured image from a second camera in the camera pair. An unobstructed image portion of a captured image from the second camera of the camera pair is combined with a scaled extracted image portion generated from a captured image from the first camera in the camera pair. As part of the combining obstructed image portions which were obstructed by part of the adjacent camera are replaced in some embodiments. In some embodiments, the obstructions are due to adjacent fisheye lens. In various embodiments fish eye lenses which have been cut to be flat on one side are used for the left and right cameras with the spacing between the optical axis approximating the spacing between the optical axis of a human person's eyes.

Abstract: A system including server(s) configured to: receive, from host device, visible-light images of real-world environment captured by visible-light camera(s); process visible-light images to generate three-dimensional (3D) environment model; receive, from client device, information indicative of pose of client device; utilise 3D environment model to generate reconstructed image(s) and reconstructed depth map(s); determine position of each pixel of reconstructed image(s); receive, from host device, current visible-light image(s); receive, from host device, information indicative of current pose of host device, or determine said current pose; determine, for pixel of reconstructed image(s), whether or not corresponding pixel exists in current visible-light image(s); replace initial pixel values of pixel in reconstructed image(s) with pixel values of corresponding pixel in current visible-light image(s), when corresponding pixel exists in current visible-light image(s); and send reconstructed image(s) to client devic

Abstract: Aspects of the present disclosure relate to systems, devices and methods for performing a surgical step or surgical procedure with visual guidance using an optical head mounted display. Aspects of the present disclosure relate to systems, devices and methods for displaying, placing, fitting, sizing, selecting, aligning, moving a virtual implant on a physical anatomic structure of a patient and, optionally, modifying or changing the displaying, placing, fitting, sizing, selecting, aligning, moving, for example based on kinematic information.

Abstract: A computer system displays a representation of a camera field of view and receives one or more inputs corresponding to a request to display the representation of the field of view based on a physical object at a first pose, a virtual object at a simulated second pose, and the one or more cameras at a third pose in a physical environment. In response, if a first portion of the virtual object corresponds to physical space that is occluded by the physical object, the system: displays the representation of the physical object; forgoes displaying the first portion of the virtual object; and, if a second portion of the virtual object corresponds to physical space that is not occluded, displays the second portion, including visually deemphasizing a displayed first region of the second portion relative to a displayed second region of the second portion of the virtual object.

Abstract: The embodiments provide a method for unmanned vehicle cruising, an unmanned vehicle and a storage medium, the method includes: in a state that a slow cruising function is started, cruising according to a preset cruising mode, and collecting running data through a sensing device, where the running data is data of an environment in which a vehicle locates, collected by the vehicle during a running process; and generating a map based on the collected running data. The embodiments of the present disclosure solve the problem that an unmanned vehicle in the prior art cannot update a map in time and, in particular, cannot develop a more suitable map according to different surrounding environments.

Abstract: The technology disclosed performs hand pose estimation on a so-called “joint-by-joint” basis. So, when a plurality of estimates for the 28 hand joints are received from a plurality of expert networks (and from master experts in some high-confidence scenarios), the estimates are analyzed at a joint level and a final location for each joint is calculated based on the plurality of estimates for a particular joint. This is a novel solution discovered by the technology disclosed because nothing in the field of art determines hand pose estimates at such granularity and precision. Regarding granularity and precision, because hand pose estimates are computed on a joint-by-joint basis, this allows the technology disclosed to detect in real time even the minutest and most subtle hand movements, such a bend/yaw/tilt/roll of a segment of a finger or a tilt an occluded finger, as demonstrated supra in the Experimental Results section of this application.

Abstract: A method and apparatus for outputting a three-dimensional (3D) image are provided. To output a 3D image, a stereo image is generated based on viewpoints of a user and rendered into a 3D image. Since the stereo image is generated based on the viewpoints of the user, the user views a different side of an object appearing in the 3D image depending on a viewpoint of the user.

Abstract: To provide a three-dimensional survey apparatus, a three-dimensional survey method, and a three-dimensional survey program which are capable of suppressing an occurrence of a data-deficient part. A three-dimensional survey apparatus includes a collimating ranging unit, a scanner unit, and a control calculation portion. If there is a data-deficient part where three-dimensional data is not acquired among a measurement object when the scanner unit acquires point cloud data, the control calculation portion executes control to replenish the three-dimensional data related to the data-deficient part having been acquired by the collimating ranging unit to the point cloud data having been acquired by the scanner unit.

Abstract: A dual-aperture camera comprising a first camera having a first sensor and a first image signal processor (ISP), the first camera operative to output a first stream of frames, a second camera having a second sensor and a second ISP, the second camera operative to output a second stream of frames, and a synchronization and operation control module configurable to control operation of one camera in a fully operational mode and operation of the other camera in a partially operational mode and to output an output of the fully operational camera as a dual-aperture camera output, whereby the partially operational mode of the other camera reduces a dual-aperture camera the power consumption in comparison with a full operational mode of the other camera.

Abstract: A system for calibrating stereo cameras using time-of-flight (ToF) includes a stereo camera system and a ToF sensor onboard a vehicle. The system receives stereo image data depicting a scene and ToF sensor data captured during stationary or moving operations of the vehicle. The system associates the ToF sensor data to the stereo image data by projection onto the stereo image data to filter out stereo depth errors. The system converts distance measurements based on the ToF sensor data to disparities in the stereo image data. The system further filters out the disparities between the ToF sensor and the stereo camera system using a voting scheme to populate a histogram with disparities. The system can select the peak of the histogram and correct the stereo image data with the disparity results in the peak, to correct stereo image data during operation of the vehicle.

Abstract: One disclosed example provides a method for displaying a hologram via a head-mounted display (HMD) device. The method comprises, via a camera system on the HMD device, acquiring image data capturing a surrounding environment by detecting illumination light output by a projector located on a case for the HMD device. A distance is determined from the HMD device to an object in the surrounding environment based upon the image data. The method further comprises displaying via the HMD device a hologram, the hologram comprising a left-eye image and a right-eye image each having a perspective based upon the distance determined.

Abstract: A disembarkation action determination device includes: an upper body movement detection section configured to detect for a first state in which an upper body of an occupant sitting on a vehicle seat has been lifted upright, based on a signal from a first sensor provided inside a vehicle cabin; a hand position detection section configured to detect for a second state in which a hand of the occupant sitting on the vehicle seat is in proximity to or contacting a door inside handle, based on a signal either from the first sensor or from a second sensor separate from the first sensor; and a disembarkation action determination section configured to determine that the occupant has initiated a disembarkation action in cases in which the first state has been detected by the upper body movement detection section and the second state has been detected by the hand position detection section.

Abstract: The microlens amplitude masks for flying pixel removal in time-of-flight imaging includes systems, devices, methods, and instructions for image depth determination, including receiving an image, adding noise to the image, determining a set of correlation images, each correlation image having a varying phase offset, for each pixel of the image, generating a masked pixel by applying a mask array, and for each masked pixel, determining the depth of the masked pixel to generate a depth map for the image on a per pixel basis.

Abstract: Provided is a method of calibrating a stereoscopic display device. The device includes a motor and a display panel, and the display panel is driven by the motor to rotate to realize a stereoscopic display. The method includes acquiring a control strategy of the motor and display parameters of the display panel matching the control strategy, wherein the control strategy indicates that each time the motor runs for a preset period of time, the motor is restarted; controlling the motor to run according to the control strategy, to calibrate the motor by restarting; and driving the display panel to display according to the display parameters in the rotation process of the motor.

Abstract: An image capture system is configured to align a field of view of the image capture component with a field of view of a user of the system. In some cases, the image capture system may adjust the field of view of the image data based at least in part on orientation and position data associated with the capture device.

Abstract: A photobooth that is suspended from a rigid non-moving structure, such as a ceiling, is disclosed. The photobooth may include a support structure that includes a non-movable section and a movable section. The non-movable section is not moved and remains fixed after installation relative to the ceiling. The movable section may comprise posts or brackets, may move relative to the non-movable section, and may include one or both of a camera or lighting. Further, to rigidize the support structure, a track may be attached to some or all of the posts or brackets, thereby rigidizing the structure and reducing jitter which may affect operation of the camera or lighting.

Abstract: A system, method, and computer program product for implementing video action recognition is provided. The method includes receiving a video stream comprising user movement actions. Skeleton points associated with a video representation of a user executing the user movement actions are extracted and categorized with respect to multiple digital levels. Initial visual windows points are generated within video frames and an average movement distance for the group of skeleton points are determined with respect to the video frames. In response, sizes for the visual windows are adjusted and feature vectors are extracted from the group of skeleton points. Point coordinates of the skeleton points are extracted and linked with the feature vectors. A convolutional neural network associated with linking the feature vectors with the point coordinates is generated and the video stream is enabled with respect to video action recognition associated with accurate presentation of the video stream.

Abstract: Provided are a computer program product, system, and method for rendering information in a gaze tracking device on controllable devices in a field of view to remotely control. A determination is made of a field of view from the gaze tracking device of a user based on a user position. Devices are determined in the field of view the user is capable of remotely controlling to render in the gaze tracking device. An augmented reality representation of information on the determined devices is rendered in a view of the gaze tracking device. User controls are received to remotely control a target device comprising one of the determined devices for which information is rendered in the gaze tracking device. The received user controls are transmitted to the target device to control the target device.

Abstract: A lidar system comprises a lidar transmitter and a control circuit. The lidar transmitter fires laser pulse shots into a field of view and comprises a variable amplitude scan mirror for directing the laser pulse shots at targeted range points in the field of view (FOV). The control circuit (1) controls changes in a tilt amplitude of the variable amplitude scan mirror and (2) schedules the laser pulse shots according to a plurality of criteria, including criteria that take into account a settle time arising from controlled changes in the tilt amplitude. These controlled changes can include (1) a first tilt amplitude corresponding to a wide FOV coverage zone within the FOV and (2) a second tilt amplitude corresponding to a narrow FOV coverage zone within the FOV, wherein the second tilt amplitude is less than the first tilt amplitude.

Abstract: A set of media items to be shared with users of a content sharing service is identified. Each of the set of media items corresponds to a video recording generated by a client device that depicts one or more objects corresponding to a real-world event at a geographic location. A positioning of the client device that generated the video recording corresponding to a respective media item of the set of media items is determined. The positioning is determined based on image features depicted in a set of frames of the video recording. A request for content associated with at least one of the real-world event or the geographic location is received from another client device connected to the content sharing service. The set of media items and, for each of the set of media items, an indication of the determined positioning of the client device that generated the corresponding video recording is provided in accordance with the request for content.

Abstract: Various implementations disclosed herein include devices, systems, and methods that tracks an electronic device by fusing tracking algorithms. In some implementations, at an electronic device having a processor, a method obtains pairs of first position data corresponding to a position of the electronic device in a first coordinate system obtained using a first technique and second position data in a second coordinate system obtained using a second technique. In some implementations, transformations for the respective pairs are determined that provide a positional relationship between the first coordinate system and the second coordinate system. In some implementations, a subset of the pairs is identified based on the transformations, and a combined transformation is determined based on the subset of the transformations. In some implementations, content is provided on the electronic device based on the combined transformation.

Abstract: Systems and methods are described herein to generate a 3D surface scan of a surface profile of a patient's anatomy. The 3D surface scan may be generated by reflections of structured light off the surface profile of the anatomy. The 3D surface scan may be used during intra-operative surgical navigation by a localization system. Optionally, a pre-operative medical image may also be registered to the localization system or used to enhance the 3D surface scan.

Abstract: A system for object recognition are provided in the present disclosure. The system may obtain a first image of an object that is captured by a camera configured to capture one or more images for use in an object recognition process under a first scenario; obtain a second image of the object that is captured under a second scenario; assess a degree of similarity between the first image of the object and at least one sample image; and determine a calibration function to calibrate the degree of similarity between the first image of the object and the at least one sample image based at least on a correlation between the second image of the object and the at least one sample image, wherein the calibration function is to be applied in association with the one or more images captured by the camera in the object recognition process.

Abstract: Devices disclosed herein feature a Wide camera with a Wide field of view (FOVw), a folded Tele camera with a Tele field of view (FOVT) smaller than the FOVw and including an optical path folding element (OPFE). The device may be configured to rotate the OPFE to thereby shift FOVT relative to FOVw in response to recognition of an object or subject of interest detected in FOVw or FOVT. The device can have high resolution in this overlapping FOV either by fusing the Wide and Tele images or by capturing and saving the Tele image.

Abstract: A stereo camera calibration method includes: controlling a stereo camera assembly to capture a sequence of stereo image pairs; simultaneously with each capture in the sequence, activating a rangefinder; responsive to each capture in the sequence, updating calibration data for point cloud generation by: detecting matching features in the stereo image pair, and updating a first portion of the calibration data based on the matched features; updating an alignment of the rangefinder relative to the stereo camera assembly, based on the updated first portion of the calibration data, and a detected position of a beam of the rangefinder in a first image of the stereo image pair; and updating a second portion of the calibration data based on the detected position of the beam of the rangefinder in the first image of the stereo image pair, the updated rangefinder alignment, and a depth measurement captured by the rangefinder.

Abstract: A system for generating complementary data for a visual display that includes one or plurality of wearable sensors that collect tracking data for a users position, orientation, and movement. The sensor(s) are in communication with at least one processor that may be configured to receive tracking data, identify missing tracking data, generate complementary data to substitute for missing tracking data, generate a 3D model comprised of tracking data and complementary data, and communicate the 3D model to a display. Complementary tracking data may be generated by comparison to a key pose library, by comparison to past tracking data, or by inverse kinematics.

Abstract: An electronic device estimates a depth map of an environment based on matching reduced-resolution stereo depth images captured by depth cameras to generate a coarse disparity (depth) map. The electronic device downsamples depth images captured by the depth cameras and matches sections of the reduced-resolution images to each other to generate a coarse depth map. The electronic device upsamples the coarse depth map to a higher resolution and refines the upsampled depth map to generate a high-resolution depth map to support location-based functionality.

Abstract: A free space input standard is instantiated on a processor. Free space input is sensed and communicated to the processor. If the free space input satisfies the free space input standard, a touch screen input response is invoked in an operating system. The free space input may be sensed using continuous implicit, discrete implicit, active explicit, or passive explicit approaches. The touch screen input response may be invoked through communicating virtual touch screen input, a virtual input event, or a virtual command to or within the operating system. In this manner free space gestures may control existing touch screen interfaces and devices, without modifying those interfaces and devices directly to accept free space gestures.

Abstract: Methods and apparatus relating to encoding and decoding stereoscopic (3D) image data, e.g., left and right eye images, are described. Various pre-encoding and post-decoding operations are described in conjunction with difference based encoding and decoding techniques. In some embodiments left and right eye image data is subject to scaling, transform operation(s) and cropping prior to encoding. In addition, in some embodiments decoded left and right eye image data is subject to scaling, transform operations(s) and filling operations prior to being output to a display device. Transform information and/or scaling information may be included in a bitstream communicating encoded left and right eye images. The amount of scaling can be the same for an entire scene and/or program.

Abstract: A camera device including first and second cameras, focal position information of the first camera and focal position information of the second camera are matched with each other. Also, the accuracy of the current focal position of the first camera is determined based on the phase difference of images obtained by the first camera when the first camera is auto-focused. Subsequently, when the accuracy of the current focal position of the first camera is low, an accurate focal position of the first camera is tracked by using the matched focal position information of the second camera. When an auto-focusing function of the first camera is activated, focal position movements are tracked by using the focal position information of the second camera as well as zoom tracking of the first camera, and thus, the accuracy can be improved.