Patents by Inventor Martin Prins
Martin Prins has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11778258Abstract: The invention provides a streaming client with a streaming presentation of an event, with said presentation being obtained by dynamically switching between a plurality of media streams which represent different recordings of the event. For that purpose, source data is obtained from a plurality of stream sources. The source data is constituted by content data and/or metadata of concurrent portions of the plurality of media streams. By applying a quality assessment function to the source data, a quality score is assigned to each one of the concurrent portions. This allows selection data to be generated which enables the streaming client to access a selected one of the concurrent portions of a respective media stream. For example, a segment may be selected which provides a highest quality score. By doing so, it is therefore not required anymore for a consumer to manually switch between different media streams.Type: GrantFiled: April 30, 2019Date of Patent: October 3, 2023Assignee: Koninklijke KPN N.V.Inventors: Martin Prins, Omar Aziz Niamut, Emmanuel Thomas, Ray Van Brandenburg, Hans Maarten Stokking
-
Patent number: 11582383Abstract: A method and processor system are provided which analyze a depth map, which may be obtained from a range sensor capturing depth information of a scene, to identify where an object is located in the scene. Accordingly, a region of interest may be identified in the scene which includes the object, and image data may be selectively obtained of the region of interest, rather than of the entire scene containing the object. This image data may be acquired by an image sensor configured for capturing visible light information of the scene. By only selectively obtaining the image data within the region of interest, rather than all of the image data, improvements may be realized in the computational complexity of a possible further processing of the image data, the storage of the image data and/or the transmission of the image data.Type: GrantFiled: November 9, 2018Date of Patent: February 14, 2023Assignees: KONINKLIJKE KPN N.V., NEDERLANDSE ORGANISATIE VOOR TOEGEPAST-NATUURWETENSCHAPPELIJK ONDERZOEK TNOInventors: Frank Ter Haar, Nanda van der Stap, Hans Maarten Stokking, Martin Prins, Simon Gunkel
-
Patent number: 11317135Abstract: A method of determining a group of user devices suitable for contributing user content to an interactive media broadcast may comprise: —transmitting a set of requirements to a first plurality of user devices (13), each user device having a set of capabilities, the set of requirements relating to using at least part of the user content in the interactive media broadcast, —transmitting an invitation to a second plurality of user devices (13), the invitation being configured to cause a user device to produce a conditional response if the set of capabilities of the user device matches the set of requirements, and —identifying a group of user devices from which a conditional response was received. The method may further comprise selecting a group of user devices from the identified user devices. The selected group of user devices may include all identified user devices. The media broadcast may include an interactive television broadcast.Type: GrantFiled: December 21, 2017Date of Patent: April 26, 2022Assignees: KONINKLIKE KPN N.V., NEDERLANDSE ORGANISATIE VOOR TOEGEPAST-NATUURWETENSCHAPPELIJK ONDERZOEK TNOInventors: Martin Prins, Hans Maarten Stokking, Simon Gunkel
-
Patent number: 11265359Abstract: A system and method are provided for managing a concurrent streaming of a first media stream (031) and a second media stream (032). The media streams (031, 032) represent different recordings of an event. The concurrent streaming of the media streams (031, 032) is enabled by a resource having a resource limitation (080). To address this resource limitation, when it is determined that the resource limitation is exceeded by the concurrent streaming of the first media stream (031) streaming to a first streaming client (041) and the second media stream (032) streaming to a second streaming client (042), the first media stream (031) is selected for substituting the second media stream (032) in the streaming to the second streaming client (042). As a result of the substitution, the first and the second streaming client (041, 042) stream the same media stream rather than different media streams.Type: GrantFiled: October 13, 2015Date of Patent: March 1, 2022Assignees: Koninklijke KPN N.V., Nederlandse Organisatie Voor Toegepast-Natuurwetenschappelijk Onderzoek TNOInventors: Emmanuel Thomas, Martin Prins, Omar Aziz Niamut, Hans Maarten Stokking
-
Patent number: 11146604Abstract: A content distribution system is provided comprising a content client and a content server connected through a network. The content server is configured to send the content client a session description comprising at least one media description to enable it to receive over the network a content item. The system comprises a network monitor for monitoring network traffic going through the network, and a recommender for marking in dependency upon the network monitor, one or more of the media descriptions in the session description to obtain a marked session description. The marked media description recommends the content client to prefer certain content above others in view of the current network condition. For example, if available bandwidth is low, content is recommended which requires low bandwidth. Network congestion is thereby avoided for all users of the system.Type: GrantFiled: April 3, 2018Date of Patent: October 12, 2021Assignee: Koninklijke KPN N.V.Inventors: Anton Havekes, Peter-Jan Doets, Victor Klos, Robert-Enrst Kooij, Martin Prins
-
Patent number: 11119719Abstract: Systems and methods for screen sharing are provided. The screen sharing may comprise providing image data from a sender system to a receiver system. The receiver system may be a Virtual Reality [VR] system configured to render the image data in a virtual environment by projecting the image data onto a virtual canvas. At the sender system, visual content may be identified to share with the receiver system. The rendering or display of the virtual environment by the receiver may impose legibility constraints on the visual content. An adjusted version of the visual content may be generated which provides improved legibility when viewed in the virtual environment. The image data representing the adjusted version may then be provided to the receiver system. Accordingly, the legibility of the visual content shared by the sender system may be improved when rendered, displayed and subsequently viewed by a user in the virtual environment.Type: GrantFiled: June 29, 2018Date of Patent: September 14, 2021Assignees: KONINKLIKE KPN N.V., NEDERLANDSE ORGANISATIE VOOR TOEGEPAST-NATUURWETENSCHAPPELIJK ONDERZOEK TNOInventors: Martin Prins, Emmanuel Thomas, Hans Maarten Stokking, Hendrikus Nathaniël Hindriks
-
Patent number: 11089214Abstract: A system and method are provided for generating an output video, such as a video panorama, from a plurality of video streams representing different recordings of a scene. The plurality of video streams may be analyzed to identify at least one part of at least one of the plurality of video streams which is to be used in the output video, thereby identifying a contributing part of a video stream. Orchestration metadata may be generated identifying the contributing part. The orchestration metadata may be provided to a stream source from which the video stream originated to enable the stream source to selectively stream the contributing part of the video stream. Effectively, a selection of the stream's video data may be made to avoid or reduce unnecessary bandwidth usage.Type: GrantFiled: December 16, 2016Date of Patent: August 10, 2021Assignees: KONINKLIJKE KPN N.V., NEDERLANDSE ORGANISATIE VOOR TOEGEPAST-NATUURWETENSCHAPPELIJK ONDERZOEK TNOInventors: Hans Maarten Stokking, Emmanuel Thomas, Omar Aziz Niamut, Martin Prins
-
Patent number: 11087527Abstract: Some embodiments involve obtaining access to a number of omnidirectional images each representing a different viewpoint relative to a scene, and to metadata indicating a physical relation between the respective viewpoint and a physical object in the scene. Viewer data may be obtained that is indicative of a current physical relation between a viewpoint of the user and a same type of physical object in a current viewing environment of the user. An omnidirectional image may then be selected for display by comparing the viewer data to the metadata of the omnidirectional images. In other embodiments, an omnidirectional image may be selected, e.g., from omnidirectional images or by being the only available image, and the user may be instructed to assume a viewpoint in which the physical relation to the physical object in the user's current viewing environment corresponds to the physical relation as indicated by the selected image's metadata.Type: GrantFiled: November 29, 2018Date of Patent: August 10, 2021Assignees: Koninklijke KPN N.V., Nederlandse Organisatie voor Toegepast-Natuurwetenschappelijk Onderzoek TNOInventors: Hans Maarten Stokking, Simon Norbert Bernhard Gunkel, Martin Prins, Hendrikus Nathaniel Hindriks
-
Patent number: 11082662Abstract: Systems and methods are provided for generating and rendering an enhanced audiovisual recording of a user, which may be used for multiuser communication, e.g., in Virtual Reality. Such an enhanced recording may be generated by determining a face orientation of the user in the audiovisual recording, and generating orientation data specifying an orientation which represents said determined face orientation. During rendering, the audio data may be rendered based on the orientation data, namely by rendering the audio data as a spatial audio source having a spatial direction which is congruent with the face orientation of the user in a visual representation of the user. Accordingly, the spatial direction of the voice of the user may better match the user's face direction in the user's visual representation.Type: GrantFiled: December 19, 2018Date of Patent: August 3, 2021Assignees: KONINKLIJKE KPN N.V., NEDERLANDSE ORGANISATIE VOOR TOEGEPAST-NATUURWETENSCHAPPELIJK ONDERZOEK TNOInventors: Martin Prins, Hans Maarten Stokking, Simon Norbert Bernhard Gunkel, Hendrikus Nathaniël Hindriks
-
Patent number: 11037321Abstract: A system and method are provided for determining a size of a virtual object in a virtual environment. The virtual object may represent an object in physical space. The system and method may obtain image data of the object from a camera, obtain camera metadata indicative of an angle of view of the camera, estimate an object distance between the object and the camera, and estimate a physical size of the object in physical space by determining an image size of the object in the image data, and determining a relation between the image size and the physical size of the object on the basis of the camera metadata and the object distance. Accordingly, the size of the virtual object in the virtual environment may be determined in accordance with the physical size of the object. Virtual objects may thus be given realistic relative sizes in the virtual environment. A further advantage may be that there is no need for a calibrated system of multiple cameras and a calibrated rendering environment.Type: GrantFiled: December 1, 2017Date of Patent: June 15, 2021Assignees: Koninklijke KPN N.V., Nederlandse Organisatie Voor Toegepast-Natuurwetenschappelijk Onderzoek TNOInventors: Hans Maarten Stokking, Martin Prins
-
Publication number: 20210112193Abstract: A method and processor system are provided which analyze a depth map, which may be obtained from a range sensor capturing depth information of a scene, to identify where an object is located in the scene. Accordingly, a region of interest may be identified in the scene which includes the object, and image data may be selectively obtained of the region of interest, rather than of the entire scene containing the object. This image data may be acquired by an image sensor configured for capturing visible light information of the scene. By only selectively obtaining the image data within the region of interest, rather than all of the image data, improvements may be realized in the computational complexity of a possible further processing of the image data, the storage of the image data and/or the transmission of the image data.Type: ApplicationFiled: November 9, 2018Publication date: April 15, 2021Inventors: Frank Ter Haar, Nanda van der Stap, Hans Maarten Stokking, Martin Prins, Simon Gunkel
-
Publication number: 20210044779Abstract: A system and method are provided for facilitating multiuser communication in a Virtual Reality [VR] environment (10). The multiuser communication may involve a VR device configured to render the VR environment (10) to a local user (5), a plurality of remote communication devices which enable respective remote users to participate in the multiuser communication, and a camera (120) configured to record video of the local user (5) and to transmit the video as part of communication data to the plurality of remote communication devices for remote rendering of the video.Type: ApplicationFiled: August 28, 2017Publication date: February 11, 2021Inventors: Martin Prins, Hans Maarten Stokking, Robert Koenen
-
Publication number: 20200401362Abstract: Systems and methods for screen sharing are provided. The screen sharing may comprise providing image data from a sender system to a receiver system. The receiver system may be a Virtual Reality [VR] system configured to render the image data in a virtual environment by projecting the image data onto a virtual canvas. At the sender system, visual content may be identified which is to be shared with the receiver system. The rendering or display of the virtual environment by the receiver may impose legibility constraints on the visual content. Accordingly, an adjusted version of the visual content may be generated which provides improved legibility when viewed in the virtual environment. The image data representing the adjusted version of the visual content may then be provided to the receiver system.Type: ApplicationFiled: June 29, 2018Publication date: December 24, 2020Inventors: Martin Prins, Emmanuel Thomas, Hans Maarten Stokking, Hendrikus Nathaniël Hindriks
-
Publication number: 20200394157Abstract: Methods and systems for enabling content distribution from a first device to a second device are disclosed. A first device is configured to receive content and computer program script from a content source. The computer program script enables a content owner to define permissions that control the use and access of the content. The computer program script or a derivation thereof is provided from the first device to a second device, wherein said second device is communicably connected to the first device. On the basis of the computer program script, a template is generated by the second device for presenting the content. The second device transmits a request for the content and the content is retrieved from the first device in accordance with the permissions.Type: ApplicationFiled: August 28, 2020Publication date: December 17, 2020Inventors: Anton Havekes, Martin Prins, Victor Klos, Peter-Jan Doets
-
Publication number: 20200382747Abstract: Systems and methods are provided for generating and rendering an enhanced audiovisual recording of a user, which may be used for multiuser communication, e.g., in Virtual Reality. Such an enhanced recording may be generated by determining a face orientation of the user in the audiovisual recording, and generating orientation data specifying an orientation which represents said determined face orientation. During rendering, the audio data may be rendered based on the orientation data, namely by rendering the audio data as a spatial audio source having a spatial direction which is congruent with the face orientation of the user in a visual representation of the user. Accordingly, the spatial direction of the voice of the user may better match the user's face direction in the user's visual representation.Type: ApplicationFiled: December 19, 2018Publication date: December 3, 2020Inventors: Martin Prins, Hans Maarten Stokking, Simon Norbert Bernhard Gunkel, Hendrikus Nathaniël Hindriks
-
Patent number: 10788888Abstract: A method of facilitating capturing visual information at a first location (1) for display at a second location (2) is disclosed. At the first location, a virtual reality device (11) can be configured to render visual information representing a virtual environment, and at least one capturing device (12) can be configured to capture information representing a real environment comprising the virtual reality device (11). At the second location, at least one monitor (21) can be configured to render the information captured by the at least one capturing device (12). The method comprises determining an orientation of at least one capturing device (12) relative to the virtual reality device (11), and providing in the virtual environment a visual indication of said orientation.Type: GrantFiled: June 6, 2017Date of Patent: September 29, 2020Assignees: KONINKLIJKE KPN N.V., NEDERLANDSE ORGANISATIE VOOR TOEGEPAST-NATUUWETENSCHAPPELIJK ONDERZOEK TNOInventors: Martin Prins, Hans Maarten Stokking, Emmanuel Thomas, Omar Aziz Niamut, Mattijs Oskar Van Deventer
-
Publication number: 20200195999Abstract: A method of determining a group of user devices suitable for contributing user content to an interactive media broadcast may comprise: —transmitting a set of requirements to a first plurality of user devices (13), each user device having a set of capabilities, the set of requirements relating to using at least part of the user content in the interactive media broadcast, —transmitting an invitation to a second plurality of user devices (13), the invitation being configured to cause a user device to produce a conditional response if the set of capabilities of the user device matches the set of requirements, and —identifying a group of user devices from which a conditional response was received. The method may further comprise selecting a group of user devices from the identified user devices. The selected group of user devices may include all identified user devices. The media broadcast may include an interactive television broadcast.Type: ApplicationFiled: December 21, 2017Publication date: June 18, 2020Inventors: Martin Prins, Hans Maarten Stokking, Simon Gunkel
-
Publication number: 20190378289Abstract: A system and method are provided for determining a size of a virtual object in a virtual environment. The virtual object may represent an object in physical space. The system and method may obtain image data of the object from a camera, obtain camera metadata indicative of an angle of view of the camera, estimate an object distance between the object and the camera, and estimate a physical size of the object in physical space by determining an image size of the object in the image data, and determining a relation between the image size and the physical size of the object on the basis of the camera metadata and the object distance. Accordingly, the size of the virtual object in the virtual environment may be determined in accordance with the physical size of the object. Virtual objects may thus be given realistic relative sizes in the virtual environment. A further advantage may be that there is no need for a calibrated system of multiple cameras and a calibrated rendering environment.Type: ApplicationFiled: December 1, 2017Publication date: December 12, 2019Inventors: Hans Maarten Stokking, Martin Prins
-
Publication number: 20190273960Abstract: The invention provides a streaming client with a streaming presentation of an event, with said presentation being obtained by dynamically switching between a plurality of media streams which represent different recordings of the event. For that purpose, source data is obtained from a plurality of stream sources. The source data is constituted by content data and/or metadata of concurrent portions of the plurality of media streams. By applying a quality assessment function to the source data, a quality score is assigned to each one of the concurrent portions. This allows selection data to be generated which enables the streaming client to access a selected one of the concurrent portions of a respective media stream. For example, a segment may be selected which provides a highest quality score. By doing so, it is therefore not required anymore for a consumer to manually switch between different media streams.Type: ApplicationFiled: April 30, 2019Publication date: September 5, 2019Inventors: Martin Prins, Omar Aziz Niamut, Emmanuel Thomas, Ray Van Brandenburg, Hans Maarten Stokking
-
Publication number: 20190230331Abstract: A method of facilitating capturing visual information at a first location (1) for display at a second location (2) is disclosed. At the first location, a virtual reality device (11) can be configured to render visual information representing a virtual environment, and at least one capturing device (12) can be configured to capture information representing a real environment comprising the virtual reality device (11). At the second location, at least one monitor (21) can be configured to render the information captured by the at least one capturing device (12). The method comprises determining an orientation of at least one capturing device (12) relative to the virtual reality device (11), and providing in the virtual environment a visual indication of said orientation.Type: ApplicationFiled: June 6, 2017Publication date: July 25, 2019Inventors: Martin PRINS, Hans Maarten STOKKING, Emmanuel THOMAS, Omar Aziz NIAMUT, Mattijs Oskar VAN DEVENTER