Abstract: A cell culture incubator with an incubator cabinet has an internal chamber with a door opening from an external environment. An imager and a manipulator with a scraper are in the internal chamber. A controller is configured for controlling the manipulator to modulate the contact pressure between a scraping edge of the cell scraper and a surface of a cell culture vessel and a sensor is connected to the cell scraper that provides signal to the controller informative of a sensed pressure between a scraping edge of the cell scraper and the surface of a cell culture vessel. The controller controls the manipulator to increase or decrease the pressure between a scraping edge of the cell scraper and the surface of a cell culture vessel.

Abstract: An image capturing apparatus which a lens unit is interchangeable, comprises an image capturing unit which captures images using an image sensor, an synthesizing unit which synthesizes a plurality of images, and a controlling unit which controls predetermined synthesis processing for creating a synthetic image by causing the synthesizing unit to synthesize a plurality of images that have been obtained by the image capturing unit performing image capturing a plurality of times, wherein, if it is judged that a lens unit that has been replaced after a first image for the synthesis processing was acquired is a lens unit having an image circle that is different from that of a lens unit that was mounted before the replacement, the controlling unit controls the image capturing unit to not capture a new image for creating the synthetic image.

Abstract: The present application provides a video data processing method and device, a server, a terminal, and a storage medium. The method includes: determining a sphere region of an omnidirectional video, and one or more zoom regions of the sphere region on a projected picture of the omnidirectional video; and decoding and playing video data of the one or more zoom regions of the sphere region on the projected picture of the omnidirectional video, in response to a zoom operation on the sphere region of the omnidirectional video.

Abstract: A method for seamless transition from a 2D surround view to a 3D surround view. The method includes initializing the 2D-SRV processing chain, displaying the 2D surround view while waiting for HLOS handshake to complete and upon completion of a HLOS handshake, initializing a 3D-SRV processing chain and waiting for a 3D-SRV buffer output; disabling the 2D-SRV display pipeline and enabling a 3D-SRV display pipeline; enabling switchback monitor; atomically switching to 3D surround view seamlessly and glitch free; and displaying 3D surround view on a monitor. Another method includes detecting a crash in a HLOS and seamlessly switching to a 2D surround view from a 3D surround view.

Abstract: An electronic apparatus according to the present invention, includes at least one memory and at least one processor which function as: an acquisition unit configured to acquire a captured image; and a control unit configured to control so as to extract a partial range of an image acquired by the acquisition unit and record a moving image that is not a VR image in a storage, and control so as to record a still image that is a VR image in the storage based on the acquired image.

Abstract: An image capturing apparatus which a lens unit is interchangeable, comprises an image capturing unit which captures images using an image sensor, an synthesizing unit which synthesizes a plurality of images, and a controlling unit which controls predetermined synthesis processing for creating a synthetic image by causing the synthesizing unit to synthesize a plurality of images that have been obtained by the image capturing unit performing image capturing a plurality of times, wherein, if it is judged that a lens unit that has been replaced after a first image for the synthesis processing was acquired is a lens unit having an image circle that is different from that of a lens unit that was mounted before the replacement, the controlling unit controls the image capturing unit to not capture a new image for creating the synthetic image.

Abstract: Image pickup apparatuses, control methods and storage mediums for use therewith are provided herein. At least one image pickup apparatus includes: a display unit that displays an image generated by an imaging unit; an image processing unit that extracts in-focus areas from a plurality of images different in in-focus position that are generated by the imaging unit and that composites the extracted areas; and a control unit. The control unit acquires, out of image magnifications corresponding to the plurality of images different in in-focus position, a reference image magnification, and the image processing unit corrects the image to be displayed on the display unit based on an image magnification corresponding to the image to be displayed on the display unit and the reference image magnification.

Abstract: The present invention is directed to a threat detection and notification system which preferably comprises a LIDAR unit capable of detecting an object in its field of view during a first and subsequent refresh scans, and outputting point cloud data representative of the object detected in a refresh frame corresponding to every refresh scan. A server is operatively connected to the LIDAR unit and is capable of receiving the point cloud data and determining, for the object detected within each refresh frame, a predetermined set of object-specific attributes. A user control interface is operatively connected to the server and is capable of creating a watch zone defining an area of interest less than the LIDAR unit's field of view, and is further capable of defining a plurality of watch mode parameters associated with the watch zone.

Abstract: A space in which an augmented reality (AR) computer simulation is played is mapped by multiple cameras. An AR video game player can select a location in space from which the AR player wishes to have a view of the space, including himself. Using the mapping of the space a synthesized video is generated as if from a camera located at the location in space selected by the player.

Abstract: An image capture system provides automated prompts for aiding a user in capturing images for use in 3D model creation. While a user is preparing to capture an image, the system provides visual indications that indicate whether a quality-based condition is satisfied. Based on the visual indications, a user can determine whether an image, if captured, would likely be suitable for use in creating a 3D model. Determining if the quality-based condition is satisfied may include monitoring output generated by one or more sensors and comparing the output against a threshold value. Additionally, the system may analyze the visual content or metadata associated with an image to determine if the quality-based condition is satisfied and request user input to further identify certain image features that were identified by the system.

Abstract: Provided is a method of providing a plurality of images on the basis of meta information about a free viewpoint relation. In this case, the plurality of images includes a reference image and a surrounding image. Accordingly, a user at a remote site may view one piece of content at various viewpoints and the accessibility and convenience of use may be improved.

Abstract: A method including obtaining a first clean signal and a first processed signal dependent upon audio input at a first microphone; obtaining a second clean signal and a second processed signal dependent upon audio input at a second microphone; using the first clean signal and the second clean signal to enable further processing of at least the first processed signal and the second processed signal.

Abstract: Method and apparatus for overlaying themed imagery onto real-world objects in a head-mounted display device (HMDD). A computing device receives, from an HMDD, depth data that identifies distances from the HMDD to surfaces of a plurality of objects in a user space. The computing device detects at least one object in the user space based at least in part on the depth data. The computing device determines a classification of video content being presented on a display system of the HMDD. The computing device selects, based on the classification, a particular image theme from a plurality of different image themes, the image theme comprising one or more image textures. The computing device sends, to the HMDD, at least one image texture for overlaying the at least one object during presentation of the at least one object on the display system of the HMDD in conjunction with the video content.

Abstract: Hyper-hemispherical images may be combined to generate a rectangular projection of a spherical image having an equatorial stitch line along of a line of lowest distortion in the two images. First and second circular images are received representing respective hyper-hemispherical fields of view. A video processing device may project each circular image to a respective rectangular image by mapping an outer edge of the circular image to a first edge of the rectangular image and mapping a center point of the circular image to a second edge of the first rectangular image. The rectangular images may be stitched together along the edges corresponding to the outer edge of the original circular image.

Abstract: The present disclosure is related to an audience engagement system and method to display images on a display. The method includes detecting a gaze direction of a designated viewer, rendering a gaze object within an image on a gaze axis corresponding to the gaze direction, rendering an audience object within the image on a normal axis corresponding to a display axis, composting the audience object and the gaze object together in a composited image, and displaying the composited image on the display.

Abstract: An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes an obtaining unit configured to obtain a foreground image based on an object region including a predetermined object in a captured image for generating a virtual viewpoint image and a background image based on a region different from the object region in the captured image, wherein the obtained foreground image and the obtained background image having different frame rates, and an output unit configured to output the foreground image and the background image which are obtained by the obtaining unit and which are associated with each other.

Abstract: Affected areas of images captured by cameras that are experiencing one or more anomalies may be modified by inpainting portions of counterpart images onto the affected areas. Where a camera provided aboard an operating vehicle (e.g., an aerial vehicle) is experiencing an anomaly that adversely affects the quality of images captured thereby, counterpart images that are captured by other cameras (e.g., cameras provided aboard the vehicle or elsewhere) at the same time, or by the affected camera at an earlier time, may be used for inpainting. Portions of counterpart images may be selected for inpainting according to a transform function that takes into account a pose of an affected camera, dynamics of an operating vehicle or any other factors. Images that have been modified by inpainting may be utilized by an operating vehicle for any purpose, such as computer vision applications, navigation, guidance, or collision avoidance.

Abstract: Techniques are described for automated operations involving acquiring and analyzing information from an interior of a house, building or other structure, for use in generating and providing a representation of that interior. Such techniques may include using a user's mobile device to capture video data from multiple viewing locations (e.g., 360° video at each viewing location) within multiple rooms, and capturing data linking the multiple viewing locations (e.g.

Abstract: A method includes receiving two-dimensional video streams from a plurality of cameras, the two-dimensional video streams including multiple angles of a sporting event. The method further includes determining boundaries of the sporting event from the two-dimensional video streams. The method further includes identifying a location of a sporting object during the sporting event. The method further includes identifying one or more players in the sporting event. The method further includes identifying poses of each of the one or more players during the sporting event. The method further includes generating a three-dimensional model of the sporting event based on the boundaries of the sporting event, the location of the sporting object during the sporting event, and the poses of each of the one or more players during the sporting event. The method further includes generating a simulation of the three-dimensional model.

Abstract: There is provided an information processing apparatus, an information processing method, and a program that can alleviate a burden related to projector arrangement design. The information processing apparatus includes an arrangement control unit that outputs projector arrangement information associated with arrangement of a projector on the basis of a projection condition related to projection by the projector.

Abstract: Aspects of the present disclosure relate to generating turn-by-turn direction previews. In one aspect, one or more computing devices, may receive a request for a turn-by-turn direction preview. The one or more computing devices may generate a set of directions from a first geographic location to a second geographic location. Each turn of the directions may be associated with a corresponding waypoint. The one or more computing devices may then identify street level images corresponding with the waypoints, and display a preview of their associated turns by displaying their street level images and a map in between.

Abstract: A method for determining a fisheye camera shadow correction parameter, comprising: capturing and acquiring a raw image using a fisheye camera that is not installed in an outer housing; obtaining the raw image from the fisheye camera; performing statistics on luminance information and chrominance information in each block of the raw image; and calculating a correction parameter for the fisheye camera based on the luminance information and the chrominance information of each block.

Abstract: A method for compressing geometric data and video is disclosed. The method includes receiving video and associated geometric data for a physical location, generating a background video from the video, and generating background geometric data for the geometric data outside of a predetermined distance from a capture point for the video as a skybox sphere at a non-parallax distance. The method further includes generating a geometric shape for a first detected object within the predetermined distance from the capture point from the geometric data, generating shape textures for the geometric shape from the video, and encoding the background video and shape textures as compressed video along with the geometric shape and the background geometric data as encoded volumetric video.

Abstract: A method and a system for virtual reality, augmented reality, mixed reality, or 360-degree Video environment is disclosed. The system receives Video Streams associated to audio and video scenes to be reproduced and Audio Streams associated to audio and video scenes to be reproduced. There are provided a Video decoder which decodes signal from the Video Stream for the representation of the audio and video scene; an Audio decoder which decodes signal from the Audio Stream for the representation of the audio and video scene to the user; and a region of interest processor deciding, based e.g. on the user's viewport, head orientation, movement data, or metadata, whether an Audio information message is to be reproduced. At the decision, the reproduction of the Audio information message is caused.

Abstract: Disclosed is a data processing method, comprising: acquiring space information of audio acquisition devices of an acquisition device, an acquisition space corresponding to the acquisition device being formed into a geometry, the spatial orientation deployed by video acquisition devices of the acquisition device covering the entire geometry, and the setting orientation of each video acquisition device being correspondingly provided with N audio acquisition devices, wherein N is a positive integer; regarding the N audio acquisition devices provided corresponding to the setting orientation of each video acquisition device, encoding audio data acquired by the N audio acquisition devices according to the space information of the audio acquisition devices, to form M pieces of audio data, the M pieces of audio data carrying space information of audios. Embodiments of the present invention further provide an acquisition device, a data processing device, and a storage medium.

Abstract: A first video stream having video data of a first view, a second video stream having video data of a second view, and an audio stream having audio data of an object sound source and positional information based on the first view of the object sound source are generated. A container of a predetermined format including the first video stream, the second video stream, the audio stream, and position correction information for correcting the positional information of the object sound source to positional information based on the second view is transmitted. Thereby, it is possible to accurately perform 3D audio rendering even in a case that view switching is performed at a reception side.

Abstract: Intelligent beam forming for a range detection device of a vehicle. One system includes a range detection device including a detection array, and an electronic processor communicatively coupled to the detection array. The electronic processor is configured to receive image or video data from a camera having a field of view. The electronic processor is further configured to identify an area in the field of view of the camera, determine a first threat probability of the identified area, and determine that the first threat probability is greater than a threat level threshold. In response to determining that the first threat probability is greater than the threat level threshold, the electronic processor is configured to provide an instruction to the detection array to change a shape of a beam created by the detection array to focus the beam in a direction of the identified area.

Abstract: An exemplary image stitching recovery system detects a failed attempt by an image stitching system to generate a first panoramic image in a target location image set that includes a plurality of panoramic images each depicting a target location from a different respective locus point. The image stitching recovery system identifies a particular locus point at which a second panoramic image within the target location image set has been successfully generated, and identifies, based on a second set of control points that were used by the image stitching system to successfully generate the second panoramic image at the particular locus point, a first set of control points based upon which the first panoramic image is to be successfully generated. Subsequently, the image stitching recovery system directs the image stitching system to generate, based on the first set of control points, the first panoramic image in the target location image set.

Abstract: The embodiments herein provide an audio information label/acoustic tag for delivering product information and system and method for reading an audio information label/acoustic tag. Accordingly, an acoustic tag system comprising an acoustic tag associated with an object is disclosed. The acoustic tag comprises an acoustic reflector surface configured for generating a characteristic acoustic signal in response to receiving a trigger in the form of an ambient sound wave and wherein the characteristic acoustic signal is an encoded form of information relating to the object associated with the acoustic tag and a decoding application installed on a user device, the decoding application configured for receiving the characteristic acoustic signal, decoding the characteristic acoustic signal in order to obtain the information embedded within the characteristic acoustic signal and displaying the information so obtained.

Abstract: An operation apparatus has an operation member and generates a command for controlling driving of a movable optical member in a lens apparatus based on an operation amount of the operation member. The operation apparatus includes a display configured to display information, and a processor configured to specify location of the operation apparatus relative to the lens apparatus. The processor is configured to cause the display to perform display with an orientation corresponding to the specified location.

Abstract: Techniques are described for automated operations involving acquiring and analyzing information from an interior of a house, building or other structure, for use in generating and providing a representation of that interior. Such techniques may include using a user's mobile device to capture video data from multiple viewing locations (e.g., 360° video at each viewing location) within multiple rooms, and capturing data linking the multiple viewing locations (e.g.

Abstract: This application generally relates to defining, displaying and interacting with tags in a 3D model. In an embodiment, a method includes generating, by a system including a processor, a three-dimensional model of an environment based on sets of aligned three-dimensional data captured from the environment, and associating tags with defined locations of the three-dimensional model, wherein the tags are respectively represented by tag icons that are spatially aligned with the defined locations of the three-dimensional model as included in different representations of the three-dimensional model rendered via an interface of a device, wherein the different representations correspond to different perspectives of the three-dimensional model, and wherein selection of the tag icons causes the tags respectively associated therewith to be rendered at the device.

Abstract: A display method and an electronic device are provided. The display method comprises: displaying a source panorama; based on a viewing angle during displaying the source panorama, determining an initial viewing angle of the destination panorama; and in response to switching from the source panorama to the destination panorama, displaying an image of the destination panorama at the initial viewing angle.

Abstract: The system may include a chamber structure having a substantially oval or “egg” shaped outer shell. The system may also include an interior formed within the outer shell. A user area may be provided in the chamber structure substantially centered front to back and side to side within the outer shell. The system may also include at least one sound emitting device positioned to provide at least one person in the user area with a prescribed sound therapy. The system may also include at least one light emitting device selected to provide the person in the user area with a prescribed light therapy.

Abstract: According to one implementation, a floating image display system includes a computing platform including a central processing unit (CPU), a graphics processing unit (GPU), and a system memory storing a software code. The system also includes one or more display screens controlled by the GPU, and a rotor coupled to the one or more display screens and controlled by the CPU. The CPU executes the software code to render a two-dimensional (2D) graphic on the one or more display screens using the GPU, and to spin the rotor and the one or more display screens about a vertical axis parallel to a display surface of the one or more display screens at a predetermined spin rate to generate a floating image of the 2D graphic. The floating image appears to be a three-dimensional (3D) floating image of the 2D graphic to a user viewing the floating image.

Abstract: An image processing apparatus includes at least one processor configured to execute processes including: calculating a misalignment amount of each pixel of a reference image relative to a standard image; and combining the reference image converted based on the calculated amount with the standard image. The calculating includes: calculating a projection conversion matrix for each of planes with different misalignment amounts in the reference image; generating a plane map in which the plane to which each pixel of the reference image belongs and the matrix to be applied to each plane are selected based on a difference value between the standard image and each of the alignment images converted from the reference image by using each calculated matrix; suppressing a selection error of the matrix; and calculating the misalignment amount for each of the planes based on the plane map in which the selection error of the matrix is suppressed.

Abstract: A system for generating a virtual viewpoint image based a plurality of captured images obtained by a plurality of image capturing apparatuses includes a separation unit configured to separate an image of an object from one or more captured images among the plurality of captured images obtained by the plurality of image capturing apparatuses, and a display control unit configured to display on a display screen the separated image of the object.

Abstract: An exemplary embodiment provides an image processing apparatus. The image processing apparatus includes a first object control unit for changing an orientation or a direction of movement of a first object in a three-dimensional space, a virtual camera control unit for determining a direction of shooting of the virtual camera in the three-dimensional space, and a display data generation unit for generating display data based on the determined direction of shooting of the virtual camera. The virtual camera control unit includes a detection unit for detecting whether the first object is hidden by another object when viewed from the virtual camera and a first following change unit for increasing a degree of causing the direction of shooting of the virtual camera to follow the orientation or the direction of movement of the first object based on a result of detection.

Abstract: The present disclosure generally relates to a method for predicting at least one block of pixels of a view (170) belonging to a matrix of views (17) obtained from light-field data belong with a scene, According to present disclosure, the method is implemented by a processor and comprises for at least one pixel to predict of said block of pixels: —from said matrix of views (17), obtaining (51) at least one epipolar plane image (EPI) belong with said at least one pixel to predict, —among a set of bidirectional prediction modes, determining (52) at least one optimal bidirectional prediction mode from a set of previous reconstructed pixels neighbouring said at least one pixel to predict in said at least one epipolar plane image, —extrapolating (53) a prediction value of said at least one pixel to predict by using said at least one optimal bidirectional prediction mode.

Abstract: In a data processing system that includes a graphics processor and a video processor, graphics textures for use by the graphics processor are stored as encoded frames of video data. The video processor then decodes the video frames to reproduce the graphics texture(s) that the video frames encode, and stores the decoded graphics texture or textures in memory for use by the graphics processor. The graphics processor then reads the decoded graphics textures for use when generating its render outputs, such as output frames for display.

Abstract: One embodiment provides a method, including: receiving, using a camera, at least one panoramic video; determining, using an electronic device, a spatial location in the panoramic video associated with a selection by at least one viewer; obtaining, at the electronic device, a request by the at least one viewer to share the spatial location with at least one other viewer; and sending, using the electronic device, information associated with the spatial location to the at least one other viewer. Other aspects are described and claimed.

Abstract: The term instantaneous in this invention means that the roughly 180° horizontal visual field of view that a human senses in real time. The major novelty of the instantaneous 180° (i180°) 3D technology includes (a) a combination of multiple binocular and monocular fields of view for image acquisition, (b) a combination of binocular and monocular fields of view in content playback, (c) a multi-resolution scheme for sensing, processing, transmission, and playback, (d) a realization of physical consistency of the line of sight with minimal distortion of all projection lines between imaging and display, and (e) a method for two-way compatibility for systems with conventional binocular 3D and monocular 2D systems. In addition to applications in consumer electronics, the invention has potential applications in professional business, such as film industry, theaters, museums, advertisements, surgery, rehabilitation, and assistance to the handicapped and elderly.

Abstract: A sound system includes an acquisition unit configured to acquire a sound collection signal that includes sound collected from a sound collection target area, a plurality of generation units configured to generate a plurality of sound signal corresponding to a plurality of divided areas included in the sound collection target area based on a sound collection signal acquired by the acquisition unit, a determination unit configured to determine by which generation unit from among the plurality of generation units a sound signal corresponding to each of the plurality of divided areas is to be generated, and a control unit configured to control the plurality of generation units so that the sound signal corresponding to each of the divided areas is generated by a generation unit according to determination of the determination unit.

Abstract: In an information processing device including a display unit that is able to selectively display a multi-directional video and a data processing unit that executes video display control, the data processing unit applies a device-correspondent video display scheme recorded in video display control information and executes the video display process. The video display control information defines a type-based display scheme optimum for each type of information processing device executing a video display process. The data processing unit applies the display scheme associated with a type matching the type of the own device and executes the video display process.

Abstract: A depth camera assembly (DCA) includes a projector, a detector and a controller. The projector emits a tiled structured light (SL) pattern onto a local area. Each illumination source of the projector includes one or more light emitters and an augmented diffractive optical element (ADOE) designed with a pattern mask. The ADOE diffracts at least a portion of light beams emitted from the light emitters to form a first SL pattern projection having a field-of-view corresponding to a first tileable boundary. The pattern mask prevents projection of light that would otherwise be diffracted outside the first tileable boundary. The first SL pattern projection is combined with at least a second SL pattern projection into the tiled SL pattern illuminating objects in the local area. The detector captures images of the objects illuminated by the SL pattern. The controller determines depth information for the objects using the captured images.

Abstract: An imaging system and method for enabling the capture and rendering of an image without the latency and bandwidth requirements of the prior art is presented. Embodiments of the present invention employ a plurality of imagers that provide image data to a plurality of capture and hosting servers to which they are connected via a first communications bus. One or more rendering systems are interconnected to the plurality of servers via a second communications bus. The servers perform parallel processing of only raw image data necessary to satisfy individual rendering requests from the rendering systems. Since image processing is performed only on the image data required to render the particular view of interest, an entire high-resolution image is not formed to satisfy the rendering request and the desired image can be rendered with less latency and requires less bandwidth for transmission to the rendering system.

Abstract: A method for acquiring a panoramic image includes controlling a display screen of an electronic device to display a viewfinder frame and a direction indicator that indicates a movement direction for the electronic device, acquiring and processing a first image to obtain a first progress indicator, arranging the first progress indicator on a first side of and close to the viewfinder frame, acquiring and processing a second image to obtain a second progress indicator, arranging the second progress indicator on the first side of and close to the viewfinder frame and moving the first progress indicator away from the viewfinder frame, acquiring and processing a third image to obtain a third progress indicator, and arranging the third progress indicator on the first side of and close to the viewfinder frame and arranging the first progress indicator on a second side of and away from the viewfinder frame.

Abstract: A camera device and a display device are configured to enable changing direction of capturing a stereoscopic image using a camera pair, according to an operator's motion. The camera device includes a rotatable camera base on which the stereoscopic camera pair is mounted, a motor configured to rotate the camera base, and a communication interface arranged to receive a movement signal corresponding to the operator's motion. The display device transmits the movement signal to enable the camera device to align the image capture direction with the operator view, receives stereoscopic images covering more than the operator view from the camera device, and displays a sector of the stereoscopic images corresponding to the operator view.

Abstract: A head mounted display including: an enclosure accommodating a presentation section adapted to present a three-dimensional image and located in front of the eyes of a viewer when worn on the head of the viewer; and an imaging element provided in the enclosure and adapted to turn light external to the enclosure into an image, in which the imaging element images light that is vertically downward relative to the enclosure and forward in the direction of line of sight of the viewer when the enclosure is worn on the head of the viewer.

Abstract: A force measurement system is disclosed herein. The force measurement system includes a force measurement assembly configured to receive a subject thereon, a visual display device having an output screen, and one or more data processing devices operatively coupled to the force measurement assembly and the visual display device. In the one or more embodiments, the force measurement assembly is a static force plate and the visual display device is a head-mounted visual display device or a visual display device having an output screen configured to at least partially circumscribe three sides of a torso of the subject. In one or more other embodiments, the force measurement assembly is a displaceable force plate and the visual display device is a head-mounted visual display device.