Abstract: Described herein is a method of processing audio content for rendering in a three-dimensional audio scene, wherein the audio content comprises a sound source at a source position, the method comprising: obtaining a voxelized representation of the three-dimensional audio scene, wherein the voxelized representation indicates volume elements in which sound can propagate and volume elements by which sound is occluded; generating a two-dimensional projection map for the audio scene based on the voxelized representation by applying a projection operation to the voxelized representation that projects onto a horizontal plane; and determining parameters indicating a virtual source position of a virtual sound source based on the source position, a listener position, and the projection map, to simulate, by rendering a virtual source signal from the virtual source position, an impact of acoustic diffraction by the three-dimensional audio scene on a source signal of the sound source at the source position.

Abstract: An optical system for a display device for head mounting is described. In particular a Maxwellian display device, with an enlarged eye-box is described. The optical system includes a beam forming element configured to converge multiple sets of light beams into at least two points of convergence (e.g., on an exit pupil of the optical system or of the display device using the optical system), and at least one optical arrangement comprising an input for input light beams, at least one beam splitter and at least three reflectors. The at least one beam splitter and at least three reflectors are positioned to form the multiple sets of the light beams from the input light beams such that the multiple sets of the light beams have equally long beam paths from the input to the beam forming element. Each point of convergence is a convergent viewing point for a user, thus enlarging the eye-box.

Abstract: Described is a method of modelling a Doppler effect when rendering audio content for a 6 degrees of freedom (6DoF) environment on a user side. In particular, the method may comprise obtaining first parameter values of one or more first parameters indicative of an allowable range of pitch factor modification values. The method may further comprise obtaining a second parameter value of a second parameter indicative of a desired strength of the to-be-modelled Doppler effect. The method may yet further comprise determining a pitch factor modification value based on a relative velocity between a listener and an audio source in the audio content, and the first and second parameter values, using a predefined pitch factor modification function. Particularly, the predefined pitch factor modification function may have the first and second parameters and may be a function for mapping relative velocities to pitch factor modification values.

Abstract: The present disclosure provides a an image processing device for providing a plurality of enhanced partial images which together represent an enhanced three-dimensional, 3D, image, wherein each enhanced partial image is a two-dimensional, 2D, image associated with one of a plurality of focal planes. The image processing device includes processing circuitry configured to receive or generate a plurality of initial partial images, which together form an initial 3D image, wherein each initial partial image is a 2D image associated with one of the plurality of focal planes; and to generate, from each of the initial partial images, an enhanced partial image by generating a blurred version of the initial partial image; and blending the initial partial image with the blurred version of the initial partial image.

Abstract: The present invention provides a device comprising circuitry configured to obtain a plurality of initial two-dimensional, 2D, images which together represent an initial three-dimensional, 3D, image, wherein each initial 2D image is associated with one of a plurality of focal planes. The device is further configured to generate one or more blurred versions of each of the initial 2D images on one or more of the focal planes other than its associated focal plane; generate a high passed version of each of the initial 2D images on its associated focal plane; and generate a plurality of final 2D images by generating for each focal plane a final 2D image based on the high passed version of the initial 2D image associated with that focal plane and one or more blurred versions generated on that focal plane from one or more of the other initial 2D images.

Abstract: A method of modelling extended audio objects for audio rendering in a virtual or augmented reality environment is described. The method comprises obtaining an extent representation indicative of a geometric form of an extended audio object and information relating to one or more first audio sources that are associated with the extended audio object. Furthermore, the method comprises obtaining a relative point on the geometric form of the extended audio object based on a user position in the virtual or augmented reality environment. The method also comprises determining an extent parameter for the extent representation based on the user position and the relative point and determining positions of one or more second audio sources, relative to the user position, for modelling the extended audio object. In addition, the method comprises outputting a modified representation of the extended audio object for modelling the extended audio object.

Abstract: A method for performing gain control on audio signals is provided. In some implementations, the method involves determining downmixed signals associated with one or more downmix channels associated with a current frame of an audio signal to be encoded. In some implementations, the method involves determining whether an overload condition exists for an encoder. In some implementation, the method involves determining a gain parameter. In some implementations, the method involves determining at least one gain transition function based on the gain parameter and a gain parameter associated with a preceding frame of the audio signal. In some implementations, the method involves applying the at least one gain transition function to one or more of the downmixed signals. In some implementations, the method involves encoding the downmixed signals in connection with information indicative of gain control applied to the current frame.

Abstract: A method (700) for rendering an audio signal of an audio source (211, 212, 213) in a virtual reality rendering environment (180) is described. The method (700) comprises determining (701) whether or not a directivity pattern (232) of the audio source (211, 212, 213) is to be taken into account for a listening situation of a listener (181) within the virtual reality rendering environment (180). Furthermore, the method (700) comprises rendering (702) an audio signal of the audio source (211, 212, 213) without taking into account the directivity pattern (232) of the audio source (211, 212, 213), if it is determined that the directivity pattern (232) of the audio source (211, 212, 213) is not to be taken into account for the listening situation of the listener (181).

Abstract: A focus tunable optical system includes a compound lens, which includes a plurality of focus tunable lenses. Further, the focus tunable optical system comprises a controller, which is configured to shift a focus of the compound lens from a first focal plane to a second focal plane. To this end, the controller is configured to apply, individually to each focus tunable lens of the plurality of the focus tunable lenses, a control signal having a first value for the first focal plane and a second value for the second focal plane.

Abstract: Described herein is a method of processing audio content for rendering in a three-dimensional audio scene, wherein the audio content comprises a sound source at a source position, the method comprising: obtaining a voxelized representation of the three-dimensional audio scene, wherein the voxelized representation indicates volume elements in which sound can propagate and volume elements by which sound is occluded; generating a two-dimensional projection map for the audio scene based on the voxelized representation by applying a projection operation to the voxelized representation that projects onto a horizontal plane; and determining parameters indicating a virtual source position of a virtual sound source based on the source position, a listener position, and the projection map, to simulate, by rendering a virtual source signal from the virtual source position, an impact of acoustic diffraction by the three-dimensional audio scene on a source signal of the sound source at the source position.

Abstract: A multifocal display device has a focus tunable lens, a controller, and a storage. The controller selectively tunes the focus of the lens to a plurality of focal planes of different index during a frame per A focal plane of lower index has a shorter focal distance. The storage stores a plurality of focal plane groups, each group including the plurality of focal planes in a different sequence. The controller selects a first group and tunes, during a first frame period, the focus of the lens to each one of the focal planes in the first group according to their sequence, and selects a second group from groups allowed by a selection rule, and tunes, during a second frame period, the focus of the lens to each one of the focal planes in the second group according to their sequence.

Abstract: A method for encoding an input signal comprising signal frames into quantized bits is disclosed, the method comprises generating, for each frame of the input signal, a signal matrix comprising matrix coefficients obtained from that frame, grouping the matrix coefficients of each signal matrix into a plurality of partition vectors, and for each partition vector, selecting one vector quantization scheme from among a plurality of vector quantization schemes and quantizing that partition vector according to the selected vector quantization scheme to obtain the quantized bits. In an adaptive mode, the method comprises grouping differently the matrix coefficients obtained from different frames, and/or selecting different vector quantization schemes for partition vectors obtained from different frames.

Abstract: A focus tunable optical system includes a lens assembly. The lens assembly includes: focus tunable lenses (FTLs) coaxially disposed along an optical axis, each FTL contributing to an optical power of the lens assembly; and a controller configured to control the optical power of the lens assembly by applying to each FTL a respective control signal, thereby generating a periodic optical response of the respective FTL. The optical response of each FTL is substantially different from the optical response of any other FTL of the plurality of FTLs.

Abstract: An image transmission device of a multifocal display system is described, for transmitting a set of N composite images based on a set of N primary images to an image reception device. N is greater or equal 2, and each of the N primary images has a focus distance associated therewith. The image transmission device includes processing circuitry configured to partition each of the N primary images into image portions and generate the N composite images by placing each image portion of each of the N primary images into one of the N composite images such that each of the N composite images comprises image portions from two or more of the N primary images. A communication interface transmits the N composite images to the image reception device (103).

Abstract: The present disclosure provides a device, in particular a multifocal display device. The device includes: a display element configured to generate an image; and a controller configured to control the display element according to at least a first bit sequence provided over a first determined time period and a second bit sequence provided over a second determined time period, in order to generate the image with one or more colors, the bit sequences including for each color a number of bits of different significance. Moreover, the device is configured to generate the first bit sequence from an original bit sequence based on discarding at least one bit of a color and to generate the second bit sequence from the original bit sequence based on discarding at least one other bit of the color.

Abstract: The disclosure relates to a retinal display apparatus for generating an image on the retina of an eye of a user, wherein the retinal display apparatus is configured to generate multiple light beams, each light beam conveying an instance of the image, wherein the multiple light beams correspond one-to-one to multiple potential orientations of the eye of the user. Moreover, the disclosure relates to a corresponding method.

Abstract: A device and method perform Simultaneous Localization and Mapping (SLAM). The device includes at least one processor configured to perform the SLAM method, which includes the following operations. Preprocess, in a first processing stage, a received data sequence including multiple images recorded by a camera and sensor readings from multiple sensors in order to obtain a frame sequence. Each frame of the frame sequence includes a visual feature set related to one of the images at a determined time instance and sensor readings from that time instance. Sequentially process, in a second processing stage, each frame of the frame sequence based on the visual feature set and the sensor readings included in that frame in order to generate a sequence mapping graph. Merge, in a third processing stage, the sequence mapping graph with at least one other graph, in order to generate or update a full graph.

Abstract: The present invention provides a device comprising circuitry configured to obtain a plurality of initial two-dimensional, 2D, images which together represent an initial three-dimensional, 3D, image, wherein each initial 2D image is associated with one of a plurality of focal planes. The device is further configured to generate one or more blurred versions of each of the initial 2D images on one or more of the focal planes other than its associated focal plane; generate a high passed version of each of the initial 2D images on its associated focal plane; and generate a plurality of final 2D images by generating for each focal plane a final 2D image based on the high passed version of the initial 2D image associated with that focal plane and one or more blurred versions generated on that focal plane from one or more of the other initial 2D images.

Abstract: An optical system for a display device for head mounting is described. In particular a Maxwellian display device, with an enlarged eye-box is described. The optical system includes a beam forming element configured to converge multiple sets of light beams into at least two points of convergence (e.g., on an exit pupil of the optical system or of the display device using the optical system), and at least one optical arrangement comprising an input for input light beams, at least one beam splitter and at least three reflectors. The at least one beam splitter and at least three reflectors are positioned to form the multiple sets of the light beams from the input light beams such that the multiple sets of the light beams have equally long beam paths from the input to the beam forming element. Each point of convergence is a convergent viewing point for a user, thus enlarging the eye-box.

Abstract: The present disclosure provides a device, in particular a multifocal display device. The device includes: a display element configured to generate an image; and a controller configured to control the display element according to at least a first bit sequence provided over a first determined time period and a second bit sequence provided over a second determined time period, in order to generate the image with one or more colors, the bit sequences including for each color a number of bits of different significance. Moreover, the device is configured to generate the first bit sequence from an original bit sequence based on discarding at least one bit of a color and to generate the second bit sequence from the original bit sequence based on discarding at least one other bit of the color.