Abstract: There is provided an information processing apparatus, an information processing method, and a program capable of easily obtaining a captured image with an appropriate angle of view with a small number of imaging apparatuses. The information processing apparatus includes: a view angle candidate setting unit configured to set a plurality of candidates for an angle of view from a captured image range that can be captured by a first imaging apparatus with respect to a predetermined imaging space; and an imaging view angle setting unit configured to set an imaging angle of view of the first imaging apparatus on a basis of the plurality of candidates for the angle of view. The present technology can be applied to, for example, a system that captures a television broadcast program, or the like.

Abstract: A client device adaptively streams a 360-degree video. A first segment is displayed based on a first viewing direction at a first time, where the first viewing direction is associated with a first viewport. The client requests a first base buffer segment based on the first viewport. The first base buffer segment has a presentation time after the first segment. At a second time, the viewing direction changes to a second viewing direction associated with a second viewport. The client requests, prior to the presentation time, a first viewport buffer segment based on the second viewport, with the same presentation time. The client device displays a second segment at the presentation time, wherein the second segment is either the first viewport buffer segment or the first base buffer segment. The client provides reports on viewport switching latency and on the most-requested segments.

Abstract: Multiple framings of a video may define different positionings of a viewing window at different moments within the video. The positionings of the viewing window defined by the multiple framings may be used as fixed positionings of the viewing window in a viewing path. The viewing path may define changes in the positioning of the viewing window between the fixed positionings. A presentation of the video may be generated to include the extents of the video within the viewing window.

Abstract: Some embodiments of an example method may include: receiving a manifest file for streaming content, the manifest file identifying one or more degrees of freedom representations of content; tracking bandwidth available; selecting a selected representation from the one or more degrees of freedom representations based on the bandwidth available; retrieving the selected representation; and rendering the selected representation. Some embodiments of the example method may include determining estimated download latency of the one or more degrees of freedom representations. Some embodiments of the example method may include tracking client capabilities. For some embodiments of the example method, selecting the selected representation may be based on the estimated download latency and/or the client capabilities.

Abstract: Provided are an information processing device, an information processing method, a reproduction processing device, and a reproduction processing method that provide a high-quality viewing experience to a user. A metadata generation unit generates transition identification information for identifying a second viewpoint that is a viewpoint position of a second video transitionable from a first video whose viewpoint position is a first viewpoint. A file generation unit generates a file including data of the first video data and the transition identification information.

Abstract: A cell culture incubator with an incubator cabinet has an internal chamber with a door opening from an external environment. An imager and a manipulator with a scraper are in the internal chamber. A controller is configured for controlling the manipulator to modulate the contact pressure between a scraping edge of the cell scraper and a surface of a cell culture vessel and a sensor is connected to the cell scraper that provides signal to the controller informative of a sensed pressure between a scraping edge of the cell scraper and the surface of a cell culture vessel. The controller controls the manipulator to increase or decrease the pressure between a scraping edge of the cell scraper and the surface of a cell culture vessel.

Abstract: An image capturing apparatus which a lens unit is interchangeable, comprises an image capturing unit which captures images using an image sensor, an synthesizing unit which synthesizes a plurality of images, and a controlling unit which controls predetermined synthesis processing for creating a synthetic image by causing the synthesizing unit to synthesize a plurality of images that have been obtained by the image capturing unit performing image capturing a plurality of times, wherein, if it is judged that a lens unit that has been replaced after a first image for the synthesis processing was acquired is a lens unit having an image circle that is different from that of a lens unit that was mounted before the replacement, the controlling unit controls the image capturing unit to not capture a new image for creating the synthetic image.

Abstract: The present application provides a video data processing method and device, a server, a terminal, and a storage medium. The method includes: determining a sphere region of an omnidirectional video, and one or more zoom regions of the sphere region on a projected picture of the omnidirectional video; and decoding and playing video data of the one or more zoom regions of the sphere region on the projected picture of the omnidirectional video, in response to a zoom operation on the sphere region of the omnidirectional video.

Abstract: A method for seamless transition from a 2D surround view to a 3D surround view. The method includes initializing the 2D-SRV processing chain, displaying the 2D surround view while waiting for HLOS handshake to complete and upon completion of a HLOS handshake, initializing a 3D-SRV processing chain and waiting for a 3D-SRV buffer output; disabling the 2D-SRV display pipeline and enabling a 3D-SRV display pipeline; enabling switchback monitor; atomically switching to 3D surround view seamlessly and glitch free; and displaying 3D surround view on a monitor. Another method includes detecting a crash in a HLOS and seamlessly switching to a 2D surround view from a 3D surround view.

Abstract: An electronic apparatus according to the present invention, includes at least one memory and at least one processor which function as: an acquisition unit configured to acquire a captured image; and a control unit configured to control so as to extract a partial range of an image acquired by the acquisition unit and record a moving image that is not a VR image in a storage, and control so as to record a still image that is a VR image in the storage based on the acquired image.

Abstract: An image capturing apparatus which a lens unit is interchangeable, comprises an image capturing unit which captures images using an image sensor, an synthesizing unit which synthesizes a plurality of images, and a controlling unit which controls predetermined synthesis processing for creating a synthetic image by causing the synthesizing unit to synthesize a plurality of images that have been obtained by the image capturing unit performing image capturing a plurality of times, wherein, if it is judged that a lens unit that has been replaced after a first image for the synthesis processing was acquired is a lens unit having an image circle that is different from that of a lens unit that was mounted before the replacement, the controlling unit controls the image capturing unit to not capture a new image for creating the synthetic image.

Abstract: Image pickup apparatuses, control methods and storage mediums for use therewith are provided herein. At least one image pickup apparatus includes: a display unit that displays an image generated by an imaging unit; an image processing unit that extracts in-focus areas from a plurality of images different in in-focus position that are generated by the imaging unit and that composites the extracted areas; and a control unit. The control unit acquires, out of image magnifications corresponding to the plurality of images different in in-focus position, a reference image magnification, and the image processing unit corrects the image to be displayed on the display unit based on an image magnification corresponding to the image to be displayed on the display unit and the reference image magnification.

Abstract: The present invention is directed to a threat detection and notification system which preferably comprises a LIDAR unit capable of detecting an object in its field of view during a first and subsequent refresh scans, and outputting point cloud data representative of the object detected in a refresh frame corresponding to every refresh scan. A server is operatively connected to the LIDAR unit and is capable of receiving the point cloud data and determining, for the object detected within each refresh frame, a predetermined set of object-specific attributes. A user control interface is operatively connected to the server and is capable of creating a watch zone defining an area of interest less than the LIDAR unit's field of view, and is further capable of defining a plurality of watch mode parameters associated with the watch zone.

Abstract: A space in which an augmented reality (AR) computer simulation is played is mapped by multiple cameras. An AR video game player can select a location in space from which the AR player wishes to have a view of the space, including himself. Using the mapping of the space a synthesized video is generated as if from a camera located at the location in space selected by the player.

Abstract: An image capture system provides automated prompts for aiding a user in capturing images for use in 3D model creation. While a user is preparing to capture an image, the system provides visual indications that indicate whether a quality-based condition is satisfied. Based on the visual indications, a user can determine whether an image, if captured, would likely be suitable for use in creating a 3D model. Determining if the quality-based condition is satisfied may include monitoring output generated by one or more sensors and comparing the output against a threshold value. Additionally, the system may analyze the visual content or metadata associated with an image to determine if the quality-based condition is satisfied and request user input to further identify certain image features that were identified by the system.

Abstract: Provided is a method of providing a plurality of images on the basis of meta information about a free viewpoint relation. In this case, the plurality of images includes a reference image and a surrounding image. Accordingly, a user at a remote site may view one piece of content at various viewpoints and the accessibility and convenience of use may be improved.

Abstract: A method including obtaining a first clean signal and a first processed signal dependent upon audio input at a first microphone; obtaining a second clean signal and a second processed signal dependent upon audio input at a second microphone; using the first clean signal and the second clean signal to enable further processing of at least the first processed signal and the second processed signal.

Abstract: Method and apparatus for overlaying themed imagery onto real-world objects in a head-mounted display device (HMDD). A computing device receives, from an HMDD, depth data that identifies distances from the HMDD to surfaces of a plurality of objects in a user space. The computing device detects at least one object in the user space based at least in part on the depth data. The computing device determines a classification of video content being presented on a display system of the HMDD. The computing device selects, based on the classification, a particular image theme from a plurality of different image themes, the image theme comprising one or more image textures. The computing device sends, to the HMDD, at least one image texture for overlaying the at least one object during presentation of the at least one object on the display system of the HMDD in conjunction with the video content.

Abstract: Hyper-hemispherical images may be combined to generate a rectangular projection of a spherical image having an equatorial stitch line along of a line of lowest distortion in the two images. First and second circular images are received representing respective hyper-hemispherical fields of view. A video processing device may project each circular image to a respective rectangular image by mapping an outer edge of the circular image to a first edge of the rectangular image and mapping a center point of the circular image to a second edge of the first rectangular image. The rectangular images may be stitched together along the edges corresponding to the outer edge of the original circular image.

Abstract: The present disclosure is related to an audience engagement system and method to display images on a display. The method includes detecting a gaze direction of a designated viewer, rendering a gaze object within an image on a gaze axis corresponding to the gaze direction, rendering an audience object within the image on a normal axis corresponding to a display axis, composting the audience object and the gaze object together in a composited image, and displaying the composited image on the display.

Abstract: Affected areas of images captured by cameras that are experiencing one or more anomalies may be modified by inpainting portions of counterpart images onto the affected areas. Where a camera provided aboard an operating vehicle (e.g., an aerial vehicle) is experiencing an anomaly that adversely affects the quality of images captured thereby, counterpart images that are captured by other cameras (e.g., cameras provided aboard the vehicle or elsewhere) at the same time, or by the affected camera at an earlier time, may be used for inpainting. Portions of counterpart images may be selected for inpainting according to a transform function that takes into account a pose of an affected camera, dynamics of an operating vehicle or any other factors. Images that have been modified by inpainting may be utilized by an operating vehicle for any purpose, such as computer vision applications, navigation, guidance, or collision avoidance.

Abstract: An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes an obtaining unit configured to obtain a foreground image based on an object region including a predetermined object in a captured image for generating a virtual viewpoint image and a background image based on a region different from the object region in the captured image, wherein the obtained foreground image and the obtained background image having different frame rates, and an output unit configured to output the foreground image and the background image which are obtained by the obtaining unit and which are associated with each other.

Abstract: Techniques are described for automated operations involving acquiring and analyzing information from an interior of a house, building or other structure, for use in generating and providing a representation of that interior. Such techniques may include using a user's mobile device to capture video data from multiple viewing locations (e.g., 360° video at each viewing location) within multiple rooms, and capturing data linking the multiple viewing locations (e.g.

Abstract: A method includes receiving two-dimensional video streams from a plurality of cameras, the two-dimensional video streams including multiple angles of a sporting event. The method further includes determining boundaries of the sporting event from the two-dimensional video streams. The method further includes identifying a location of a sporting object during the sporting event. The method further includes identifying one or more players in the sporting event. The method further includes identifying poses of each of the one or more players during the sporting event. The method further includes generating a three-dimensional model of the sporting event based on the boundaries of the sporting event, the location of the sporting object during the sporting event, and the poses of each of the one or more players during the sporting event. The method further includes generating a simulation of the three-dimensional model.

Abstract: There is provided an information processing apparatus, an information processing method, and a program that can alleviate a burden related to projector arrangement design. The information processing apparatus includes an arrangement control unit that outputs projector arrangement information associated with arrangement of a projector on the basis of a projection condition related to projection by the projector.

Abstract: Aspects of the present disclosure relate to generating turn-by-turn direction previews. In one aspect, one or more computing devices, may receive a request for a turn-by-turn direction preview. The one or more computing devices may generate a set of directions from a first geographic location to a second geographic location. Each turn of the directions may be associated with a corresponding waypoint. The one or more computing devices may then identify street level images corresponding with the waypoints, and display a preview of their associated turns by displaying their street level images and a map in between.

Abstract: A method for determining a fisheye camera shadow correction parameter, comprising: capturing and acquiring a raw image using a fisheye camera that is not installed in an outer housing; obtaining the raw image from the fisheye camera; performing statistics on luminance information and chrominance information in each block of the raw image; and calculating a correction parameter for the fisheye camera based on the luminance information and the chrominance information of each block.

Abstract: A method for compressing geometric data and video is disclosed. The method includes receiving video and associated geometric data for a physical location, generating a background video from the video, and generating background geometric data for the geometric data outside of a predetermined distance from a capture point for the video as a skybox sphere at a non-parallax distance. The method further includes generating a geometric shape for a first detected object within the predetermined distance from the capture point from the geometric data, generating shape textures for the geometric shape from the video, and encoding the background video and shape textures as compressed video along with the geometric shape and the background geometric data as encoded volumetric video.

Abstract: A method and a system for virtual reality, augmented reality, mixed reality, or 360-degree Video environment is disclosed. The system receives Video Streams associated to audio and video scenes to be reproduced and Audio Streams associated to audio and video scenes to be reproduced. There are provided a Video decoder which decodes signal from the Video Stream for the representation of the audio and video scene; an Audio decoder which decodes signal from the Audio Stream for the representation of the audio and video scene to the user; and a region of interest processor deciding, based e.g. on the user's viewport, head orientation, movement data, or metadata, whether an Audio information message is to be reproduced. At the decision, the reproduction of the Audio information message is caused.

Abstract: Disclosed is a data processing method, comprising: acquiring space information of audio acquisition devices of an acquisition device, an acquisition space corresponding to the acquisition device being formed into a geometry, the spatial orientation deployed by video acquisition devices of the acquisition device covering the entire geometry, and the setting orientation of each video acquisition device being correspondingly provided with N audio acquisition devices, wherein N is a positive integer; regarding the N audio acquisition devices provided corresponding to the setting orientation of each video acquisition device, encoding audio data acquired by the N audio acquisition devices according to the space information of the audio acquisition devices, to form M pieces of audio data, the M pieces of audio data carrying space information of audios. Embodiments of the present invention further provide an acquisition device, a data processing device, and a storage medium.

Abstract: A first video stream having video data of a first view, a second video stream having video data of a second view, and an audio stream having audio data of an object sound source and positional information based on the first view of the object sound source are generated. A container of a predetermined format including the first video stream, the second video stream, the audio stream, and position correction information for correcting the positional information of the object sound source to positional information based on the second view is transmitted. Thereby, it is possible to accurately perform 3D audio rendering even in a case that view switching is performed at a reception side.

Abstract: Intelligent beam forming for a range detection device of a vehicle. One system includes a range detection device including a detection array, and an electronic processor communicatively coupled to the detection array. The electronic processor is configured to receive image or video data from a camera having a field of view. The electronic processor is further configured to identify an area in the field of view of the camera, determine a first threat probability of the identified area, and determine that the first threat probability is greater than a threat level threshold. In response to determining that the first threat probability is greater than the threat level threshold, the electronic processor is configured to provide an instruction to the detection array to change a shape of a beam created by the detection array to focus the beam in a direction of the identified area.

Abstract: An exemplary image stitching recovery system detects a failed attempt by an image stitching system to generate a first panoramic image in a target location image set that includes a plurality of panoramic images each depicting a target location from a different respective locus point. The image stitching recovery system identifies a particular locus point at which a second panoramic image within the target location image set has been successfully generated, and identifies, based on a second set of control points that were used by the image stitching system to successfully generate the second panoramic image at the particular locus point, a first set of control points based upon which the first panoramic image is to be successfully generated. Subsequently, the image stitching recovery system directs the image stitching system to generate, based on the first set of control points, the first panoramic image in the target location image set.

Abstract: The embodiments herein provide an audio information label/acoustic tag for delivering product information and system and method for reading an audio information label/acoustic tag. Accordingly, an acoustic tag system comprising an acoustic tag associated with an object is disclosed. The acoustic tag comprises an acoustic reflector surface configured for generating a characteristic acoustic signal in response to receiving a trigger in the form of an ambient sound wave and wherein the characteristic acoustic signal is an encoded form of information relating to the object associated with the acoustic tag and a decoding application installed on a user device, the decoding application configured for receiving the characteristic acoustic signal, decoding the characteristic acoustic signal in order to obtain the information embedded within the characteristic acoustic signal and displaying the information so obtained.

Abstract: An operation apparatus has an operation member and generates a command for controlling driving of a movable optical member in a lens apparatus based on an operation amount of the operation member. The operation apparatus includes a display configured to display information, and a processor configured to specify location of the operation apparatus relative to the lens apparatus. The processor is configured to cause the display to perform display with an orientation corresponding to the specified location.

Abstract: Techniques are described for automated operations involving acquiring and analyzing information from an interior of a house, building or other structure, for use in generating and providing a representation of that interior. Such techniques may include using a user's mobile device to capture video data from multiple viewing locations (e.g., 360° video at each viewing location) within multiple rooms, and capturing data linking the multiple viewing locations (e.g.

Abstract: This application generally relates to defining, displaying and interacting with tags in a 3D model. In an embodiment, a method includes generating, by a system including a processor, a three-dimensional model of an environment based on sets of aligned three-dimensional data captured from the environment, and associating tags with defined locations of the three-dimensional model, wherein the tags are respectively represented by tag icons that are spatially aligned with the defined locations of the three-dimensional model as included in different representations of the three-dimensional model rendered via an interface of a device, wherein the different representations correspond to different perspectives of the three-dimensional model, and wherein selection of the tag icons causes the tags respectively associated therewith to be rendered at the device.

Abstract: A display method and an electronic device are provided. The display method comprises: displaying a source panorama; based on a viewing angle during displaying the source panorama, determining an initial viewing angle of the destination panorama; and in response to switching from the source panorama to the destination panorama, displaying an image of the destination panorama at the initial viewing angle.

Abstract: The system may include a chamber structure having a substantially oval or “egg” shaped outer shell. The system may also include an interior formed within the outer shell. A user area may be provided in the chamber structure substantially centered front to back and side to side within the outer shell. The system may also include at least one sound emitting device positioned to provide at least one person in the user area with a prescribed sound therapy. The system may also include at least one light emitting device selected to provide the person in the user area with a prescribed light therapy.

Abstract: According to one implementation, a floating image display system includes a computing platform including a central processing unit (CPU), a graphics processing unit (GPU), and a system memory storing a software code. The system also includes one or more display screens controlled by the GPU, and a rotor coupled to the one or more display screens and controlled by the CPU. The CPU executes the software code to render a two-dimensional (2D) graphic on the one or more display screens using the GPU, and to spin the rotor and the one or more display screens about a vertical axis parallel to a display surface of the one or more display screens at a predetermined spin rate to generate a floating image of the 2D graphic. The floating image appears to be a three-dimensional (3D) floating image of the 2D graphic to a user viewing the floating image.

Abstract: An image processing apparatus includes at least one processor configured to execute processes including: calculating a misalignment amount of each pixel of a reference image relative to a standard image; and combining the reference image converted based on the calculated amount with the standard image. The calculating includes: calculating a projection conversion matrix for each of planes with different misalignment amounts in the reference image; generating a plane map in which the plane to which each pixel of the reference image belongs and the matrix to be applied to each plane are selected based on a difference value between the standard image and each of the alignment images converted from the reference image by using each calculated matrix; suppressing a selection error of the matrix; and calculating the misalignment amount for each of the planes based on the plane map in which the selection error of the matrix is suppressed.

Abstract: A system for generating a virtual viewpoint image based a plurality of captured images obtained by a plurality of image capturing apparatuses includes a separation unit configured to separate an image of an object from one or more captured images among the plurality of captured images obtained by the plurality of image capturing apparatuses, and a display control unit configured to display on a display screen the separated image of the object.

Abstract: An exemplary embodiment provides an image processing apparatus. The image processing apparatus includes a first object control unit for changing an orientation or a direction of movement of a first object in a three-dimensional space, a virtual camera control unit for determining a direction of shooting of the virtual camera in the three-dimensional space, and a display data generation unit for generating display data based on the determined direction of shooting of the virtual camera. The virtual camera control unit includes a detection unit for detecting whether the first object is hidden by another object when viewed from the virtual camera and a first following change unit for increasing a degree of causing the direction of shooting of the virtual camera to follow the orientation or the direction of movement of the first object based on a result of detection.

Abstract: The present disclosure generally relates to a method for predicting at least one block of pixels of a view (170) belonging to a matrix of views (17) obtained from light-field data belong with a scene, According to present disclosure, the method is implemented by a processor and comprises for at least one pixel to predict of said block of pixels: —from said matrix of views (17), obtaining (51) at least one epipolar plane image (EPI) belong with said at least one pixel to predict, —among a set of bidirectional prediction modes, determining (52) at least one optimal bidirectional prediction mode from a set of previous reconstructed pixels neighbouring said at least one pixel to predict in said at least one epipolar plane image, —extrapolating (53) a prediction value of said at least one pixel to predict by using said at least one optimal bidirectional prediction mode.

Abstract: In a data processing system that includes a graphics processor and a video processor, graphics textures for use by the graphics processor are stored as encoded frames of video data. The video processor then decodes the video frames to reproduce the graphics texture(s) that the video frames encode, and stores the decoded graphics texture or textures in memory for use by the graphics processor. The graphics processor then reads the decoded graphics textures for use when generating its render outputs, such as output frames for display.

Abstract: One embodiment provides a method, including: receiving, using a camera, at least one panoramic video; determining, using an electronic device, a spatial location in the panoramic video associated with a selection by at least one viewer; obtaining, at the electronic device, a request by the at least one viewer to share the spatial location with at least one other viewer; and sending, using the electronic device, information associated with the spatial location to the at least one other viewer. Other aspects are described and claimed.

Abstract: The term instantaneous in this invention means that the roughly 180° horizontal visual field of view that a human senses in real time. The major novelty of the instantaneous 180° (i180°) 3D technology includes (a) a combination of multiple binocular and monocular fields of view for image acquisition, (b) a combination of binocular and monocular fields of view in content playback, (c) a multi-resolution scheme for sensing, processing, transmission, and playback, (d) a realization of physical consistency of the line of sight with minimal distortion of all projection lines between imaging and display, and (e) a method for two-way compatibility for systems with conventional binocular 3D and monocular 2D systems. In addition to applications in consumer electronics, the invention has potential applications in professional business, such as film industry, theaters, museums, advertisements, surgery, rehabilitation, and assistance to the handicapped and elderly.

Abstract: A sound system includes an acquisition unit configured to acquire a sound collection signal that includes sound collected from a sound collection target area, a plurality of generation units configured to generate a plurality of sound signal corresponding to a plurality of divided areas included in the sound collection target area based on a sound collection signal acquired by the acquisition unit, a determination unit configured to determine by which generation unit from among the plurality of generation units a sound signal corresponding to each of the plurality of divided areas is to be generated, and a control unit configured to control the plurality of generation units so that the sound signal corresponding to each of the divided areas is generated by a generation unit according to determination of the determination unit.

Abstract: In an information processing device including a display unit that is able to selectively display a multi-directional video and a data processing unit that executes video display control, the data processing unit applies a device-correspondent video display scheme recorded in video display control information and executes the video display process. The video display control information defines a type-based display scheme optimum for each type of information processing device executing a video display process. The data processing unit applies the display scheme associated with a type matching the type of the own device and executes the video display process.

Abstract: A depth camera assembly (DCA) includes a projector, a detector and a controller. The projector emits a tiled structured light (SL) pattern onto a local area. Each illumination source of the projector includes one or more light emitters and an augmented diffractive optical element (ADOE) designed with a pattern mask. The ADOE diffracts at least a portion of light beams emitted from the light emitters to form a first SL pattern projection having a field-of-view corresponding to a first tileable boundary. The pattern mask prevents projection of light that would otherwise be diffracted outside the first tileable boundary. The first SL pattern projection is combined with at least a second SL pattern projection into the tiled SL pattern illuminating objects in the local area. The detector captures images of the objects illuminated by the SL pattern. The controller determines depth information for the objects using the captured images.