Abstract: A method for storing multi-view data with depth order data. The method comprises obtaining image frames of a scene from an imaging system with a plurality of cameras, obtaining depth maps from the imaging system and/or the image frames and obtaining qualitative depth information relating to the depth of at least one object present in the scene relative to other objects in the scene, the qualitative depth information being additional to the information conveyed by the depth map. A depth order is determined for a set of at least two objects present in the scene based on the qualitative depth information, wherein the depth order determines the depth of an object relative to other objects with different depth orders. The image frames of the scene, the corresponding depth maps and the depth order for the objects in the scene are then stored as the multi-view data.

Abstract: The processing of a depth map comprises for at least a first pixel of the depth map performing the steps of: determining a set of candidate depth values (105) including other depth values of the depth map, determining (107) a cost value for each of the candidate depth values in response to a cost function; selecting (109) a first depth value in response to the cost values for the set of candidate depth values; and determining (111) an updated depth value for the first pixel in response to the first depth value. The set of candidate depth values comprises a first candidate depth value along a first direction which is further away from the first pixel than at least one pixel along the first direction which is not included in the set of candidate depth values or which has a higher cost function than the first candidate depth value.

Abstract: A method for storing data representative of virtual objects on a computer storage system. The method comprises storing constant data corresponding to physical properties of the virtual objects which will remain constant when the data is read. The constant data comprises one or more constant elements representative of physical properties of one or more of the virtual objects. The method also comprises storing variable data corresponding to physical properties of the virtual objects which are uncertain at the time of storing the data. The variable data comprises one or more variable elements representative of uncertain physical properties of one or more of the virtual objects and wherein each variable element comprises a range of values and a probability function for the range of values.

Abstract: An image synthesis system comprises receivers (201, 203, 205) receiving scene data describing at least part of a scene; object data describing a 3D object from a viewing zone having a relative pose with respect to the object, and a view pose in the scene. A pose determiner circuit (207) determines an object pose for the object in the scene in response to the scene data and the view pose; and a view synthesis circuit (209) generates a view image of the object from the object data, the object pose, and the view pose. A circuit (211) determines a viewing region in the scene which corresponds to the viewing zone for the object being at the object pose. The pose determiner circuit (207) determines a distance measure for the view pose relative to the viewing region and changes the object pose if the distance measure meets a criterion including a requirement that a distance between the view pose and a pose of the viewing region exceeds a threshold.

Abstract: Methods are provided for encoding and decoding image or video data comprising two or more views (10) of a scene. The encoding method comprises obtaining (11), for each of the two or more views, a respective block segmentation mask (12) of the view and block image data (13) of the view. The method further comprises generating (14) at least one packed frame (40) containing the two or more block segmentation masks and the block image data of the two or more views; and encoding (15) the at least one packed frame into at least one bitstream (16). Each view is divided into blocks of pixels (30), and the block segmentation mask indicates which blocks of pixels belong to an area of interest (31) in the view. The block image data comprises the blocks of pixels that belong to the area of interest. Also provided are a corresponding encoder, decoder, and bitstream.

Abstract: Methods of encoding and decoding immersive video are provided. In an encoding method, source video data comprising a plurality of source views is encoded into a video bitstream. At least one of the source views is down-sampled prior to encoding. A metadata bitstream associated with the video stream comprises metadata describing a configuration of the down-sampling, to assist a decoder to decode the video bitstream. It is believed that the use of down-sampled views may help to reduce coding artifacts, compared with a patch-based encoding approach. Also provided are an encoder and a decoder for immersive video, and an immersive video bitstream.

Abstract: An apparatus comprises receivers (201, 203) receiving texture maps and meshes representing a scene from a first and second view point. An image generator (205) determines a light intensity image for a third view point based on the received data. A first view transformer (207) determines first image positions and depth values in the image for vertices of the first mesh and a second view transformer (209) determines second image positions and depth values for vertices of the second mesh. A first shader (211) determines a first light intensity value and a first depth value based on the first image positions and depth value, and a second shader (213) determines a second light intensity value and a second depth value from the second image positions depth values. A combiner (215) generates an output value as a weighted combination of the first and second light intensity values where the weighting of a light intensity value increases for an increasing depth value.

Abstract: An apparatus comprises a receiver (301) for receiving an image representation of a scene. A determiner (305) determines viewer poses for a viewer with respect to a viewer coordinate system. An aligner (307) aligns a scene coordinate system with the viewer coordinate system by aligning a scene reference position with a viewer reference position in the viewer coordinate system. A renderer (303) renders view images for different viewer poses in response to the image representation and the alignment of the scene coordinate system with the viewer coordinate system. An offset processor (309) determines the viewer reference position in response to an alignment viewer pose where the viewer reference position is dependent on an orientation of the alignment viewer pose and has an offset with respect to a viewer eye position for the alignment viewer pose. The offset includes an offset component in a direction opposite to a view direction of the viewer eye position.

Abstract: A distribution system comprises an audio server (101) for receiving incoming audio from remote clients (103) and for transmitting audio derived from the incoming audio to the remote clients (103). An audio apparatus comprises an audio a receiver (401) which receives data comprising: audio data for a plurality of audio components representing audio from a remote client of the plurality of remote clients; and proximity data for at least one of the audio components. The proximity data is indicative of proximity between remote clients. A generator (403) of the apparatus generates an audio mix from the audio components in response to the proximity data. For example, an audio component indicated to be proximal to a remote client may be excluded from an audio mix for that remote client.

Abstract: An apparatus comprises a store (209) storing a set of anchor poses for a scene, as well as typically 3D image data for the scene. A receiver (201) receives viewer poses for a viewer and a render pose processor (203) determines a render pose in the scene for a current viewer pose of the viewer pose where the render pose is determined relative to a reference anchor pose. A retriever (207) retrieves 3D image data for the reference anchor pose and a synthesizer (205) synthesizes images for the render pose in response to the 3D image data. A selector selects the reference anchor pose from the set of anchor poses and is arranged to switch the reference anchor pose from a first anchor pose of the set of anchor poses to a second anchor pose of the set of anchor poses in response to the viewer poses.

Abstract: A distribution system comprises an audio server (101) for receiving incoming audio from remote clients (103) and for transmitting audio derived from the incoming audio to the remote clients (103). An audio apparatus comprises an audio a receiver (401) which receives data comprising: audio data for a plurality of audio components representing audio from a remote client of the plurality of remote clients; and proximity data for at least one of the audio components. The proximity data is indicative of proximity between remote clients. A generator (403) of the apparatus generates an audio mix from the audio components in response to the proximity data. For example, an audio component indicated to be proximal to a remote client may be excluded from an audio mix for that remote client.

Abstract: A method of encoding a video data signal (15) is provided, together with a method for decoding. The encoding comprises providing color information (51) for pixels in an image, providing a depth map with depth information (52) for the pixels, providing transition information (56, 57, 60, 70, 71) being representative of a width (63, 73) of a transition region (61, 72) in the image, the transition region (61, 72) comprising a depth transition (62) and blended pixels in which colors of a foreground object and a background object are blended, and generating (24) the video data signal (15) comprising encoded data representing the color information (51), the depth map (52) and the transition information (56, 57, 60, 70, 71). The decoding comprises using the transition information (56, 57, 60, 70, 71) for determining the width (63, 73) of the transition regions (61, 72) and for determining alpha values (53) for pixels inside the transition regions (61, 72).

Abstract: Methods of encoding and decoding video data are provided. In an encoding method, source video data comprising one or more source views is encoded into a video bitstream. Depth data of at least one of the source views is nonlinearly filtered and downsampled prior to encoding. After decoding, the decoded depth data is up-sampled and nonlinearly filtered.

Abstract: The present invention relates to a device (100) for determining a vital sign of a subject by use of PPG. The device comprises a processing unit (110) configured to obtain multiple first detection signals derived from electromagnetic radiation (90) from multiple measurement spots (30) on a skin region (12) of the subject illuminated by one or more illumination spots (20), wherein the electromagnetic radiation (90) enters the skin region (12) at the one or more illumination spots (20) and exits the skin region (12) at the multiple measurement spots (30). The processing unit (110) further obtains 3D image information (130) of the skin region (12) which allows determining the actual spot distance (15) between the measurements spots (30) and an illumination spot (20), respectively. This information can be used to interpret the PPG signal more precisely as without having the 3D image information only a projected distance can be determined if the skin surface is tilted.

Abstract: An image synthesis system comprises receivers (201, 203, 205) receiving scene data describing at least part of a scene; object data describing a 3D object from a viewing zone having a relative pose with respect to the object, and a view pose in the scene. A pose determiner circuit (207) determines an object pose for the object in the scene in response to the scene data and the view pose; and a view synthesis circuit (209) generates a view image of the object from the object data, the object pose, and the view pose. A circuit (211) determines a viewing region in the scene which corresponds to the viewing zone for the object being at the object pose. The pose determiner circuit (207) determines a distance measure for the view pose relative to the viewing region and changes the object pose if the distance measure meets a criterion including a requirement that a distance between the view pose and a pose of the viewing region exceeds a threshold.

Abstract: An apparatus for evaluating a quality for image capture comprises a stored (101) for storing a model of a scene and a capture circuit (105) for generating virtual captured images for a camera configuration by rendering from the model. A depth generation circuit (107) generates model depth data from the model and a depth estimation circuit (111) generates estimated depth data from the virtual captured images. A first synthesis circuit (109) and a second synthesis circuit (113) generates first and second view images for test poses by processing the virtual captured images based on the model depth data or estimated depth data respectively. A reference circuit (103) generates reference images for the f test poses by rendering based on the model. A quality circuit (115) generates a quality metric based on a comparison of the first view images, the second view images, and the reference images.

Abstract: A method is provided for selecting a transparency setting and color values of pixels in a virtual image. The virtual image can be formed by combining reference images taken at different angles to produce the virtual image that views an object at a new, uncaptured angle. The method includes determining for each pixel of the virtual image, what information it carries from the reference view images. The information of the pixel is used to define a pixel category, and the category is used to select, based on logical conditions, what information will be displayed by the pixel and to set the color of the pixels.

Abstract: Methods of encoding and decoding immersive video are provided. In an encoding method, source video data comprising a plurality of source views is encoded into a video bitstream. At least one of the source views is down-sampled prior to encoding. A metadata bitstream associated with the video stream comprises metadata describing a configuration of the down-sampling, to assist a decoder to decode the video bitstream. It is believed that the use of down-sampled views may help to reduce coding artifacts, compared with a patch-based encoding approach. Also provided are an encoder and a decoder for immersive video, and an immersive video bitstream.

Abstract: A method of encoding a video data signal (15) is provided, together with a method for decoding. The encoding comprises providing color information (51) for pixels in an image, providing a depth map with depth information (52) for the pixels, providing transition information (56, 57, 60, 70, 71) being representative of a width (63, 73) of a transition region (61, 72) in the image, the transition region (61, 72) comprising a depth transition (62) and blended pixels in which colors of a foreground object and a background object are blended, and generating (24) the video data signal (15) comprising encoded data representing the color information (51), the depth map (52) and the transition information (56, 57, 60, 70, 71). The decoding comprises using the transition information (56, 57, 60, 70, 71) for determining the width (63, 73) of the transition regions (61, 72) and for determining alpha values (53) for pixels inside the transition regions (61, 72).

Abstract: A client and server are provided with the same digital image of a slice of a biological material, which has been applied with a staining substance. The server is used for pre-processing the digital image and provides results of the pre-processing to the client in turn of a request. The server is configured to classify each pixel of the digital image, wherein the pixel is classified as stained, The client is configured to determine the region of interest at the digital image, and request data related to the classification of the pixels at the region of interest at the server. The server can provide the classification results related to the classification of the pixels at the region of interest at the digital image to the client.