Patents by Inventor Martin Prins

Martin Prins has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11778258
    Abstract: The invention provides a streaming client with a streaming presentation of an event, with said presentation being obtained by dynamically switching between a plurality of media streams which represent different recordings of the event. For that purpose, source data is obtained from a plurality of stream sources. The source data is constituted by content data and/or metadata of concurrent portions of the plurality of media streams. By applying a quality assessment function to the source data, a quality score is assigned to each one of the concurrent portions. This allows selection data to be generated which enables the streaming client to access a selected one of the concurrent portions of a respective media stream. For example, a segment may be selected which provides a highest quality score. By doing so, it is therefore not required anymore for a consumer to manually switch between different media streams.
    Type: Grant
    Filed: April 30, 2019
    Date of Patent: October 3, 2023
    Assignee: Koninklijke KPN N.V.
    Inventors: Martin Prins, Omar Aziz Niamut, Emmanuel Thomas, Ray Van Brandenburg, Hans Maarten Stokking
  • Patent number: 11582383
    Abstract: A method and processor system are provided which analyze a depth map, which may be obtained from a range sensor capturing depth information of a scene, to identify where an object is located in the scene. Accordingly, a region of interest may be identified in the scene which includes the object, and image data may be selectively obtained of the region of interest, rather than of the entire scene containing the object. This image data may be acquired by an image sensor configured for capturing visible light information of the scene. By only selectively obtaining the image data within the region of interest, rather than all of the image data, improvements may be realized in the computational complexity of a possible further processing of the image data, the storage of the image data and/or the transmission of the image data.
    Type: Grant
    Filed: November 9, 2018
    Date of Patent: February 14, 2023
    Assignees: KONINKLIJKE KPN N.V., NEDERLANDSE ORGANISATIE VOOR TOEGEPAST-NATUURWETENSCHAPPELIJK ONDERZOEK TNO
    Inventors: Frank Ter Haar, Nanda van der Stap, Hans Maarten Stokking, Martin Prins, Simon Gunkel
  • Patent number: 11317135
    Abstract: A method of determining a group of user devices suitable for contributing user content to an interactive media broadcast may comprise: —transmitting a set of requirements to a first plurality of user devices (13), each user device having a set of capabilities, the set of requirements relating to using at least part of the user content in the interactive media broadcast, —transmitting an invitation to a second plurality of user devices (13), the invitation being configured to cause a user device to produce a conditional response if the set of capabilities of the user device matches the set of requirements, and —identifying a group of user devices from which a conditional response was received. The method may further comprise selecting a group of user devices from the identified user devices. The selected group of user devices may include all identified user devices. The media broadcast may include an interactive television broadcast.
    Type: Grant
    Filed: December 21, 2017
    Date of Patent: April 26, 2022
    Assignees: KONINKLIKE KPN N.V., NEDERLANDSE ORGANISATIE VOOR TOEGEPAST-NATUURWETENSCHAPPELIJK ONDERZOEK TNO
    Inventors: Martin Prins, Hans Maarten Stokking, Simon Gunkel
  • Patent number: 11265359
    Abstract: A system and method are provided for managing a concurrent streaming of a first media stream (031) and a second media stream (032). The media streams (031, 032) represent different recordings of an event. The concurrent streaming of the media streams (031, 032) is enabled by a resource having a resource limitation (080). To address this resource limitation, when it is determined that the resource limitation is exceeded by the concurrent streaming of the first media stream (031) streaming to a first streaming client (041) and the second media stream (032) streaming to a second streaming client (042), the first media stream (031) is selected for substituting the second media stream (032) in the streaming to the second streaming client (042). As a result of the substitution, the first and the second streaming client (041, 042) stream the same media stream rather than different media streams.
    Type: Grant
    Filed: October 13, 2015
    Date of Patent: March 1, 2022
    Assignees: Koninklijke KPN N.V., Nederlandse Organisatie Voor Toegepast-Natuurwetenschappelijk Onderzoek TNO
    Inventors: Emmanuel Thomas, Martin Prins, Omar Aziz Niamut, Hans Maarten Stokking
  • Patent number: 11146604
    Abstract: A content distribution system is provided comprising a content client and a content server connected through a network. The content server is configured to send the content client a session description comprising at least one media description to enable it to receive over the network a content item. The system comprises a network monitor for monitoring network traffic going through the network, and a recommender for marking in dependency upon the network monitor, one or more of the media descriptions in the session description to obtain a marked session description. The marked media description recommends the content client to prefer certain content above others in view of the current network condition. For example, if available bandwidth is low, content is recommended which requires low bandwidth. Network congestion is thereby avoided for all users of the system.
    Type: Grant
    Filed: April 3, 2018
    Date of Patent: October 12, 2021
    Assignee: Koninklijke KPN N.V.
    Inventors: Anton Havekes, Peter-Jan Doets, Victor Klos, Robert-Enrst Kooij, Martin Prins
  • Patent number: 11119719
    Abstract: Systems and methods for screen sharing are provided. The screen sharing may comprise providing image data from a sender system to a receiver system. The receiver system may be a Virtual Reality [VR] system configured to render the image data in a virtual environment by projecting the image data onto a virtual canvas. At the sender system, visual content may be identified to share with the receiver system. The rendering or display of the virtual environment by the receiver may impose legibility constraints on the visual content. An adjusted version of the visual content may be generated which provides improved legibility when viewed in the virtual environment. The image data representing the adjusted version may then be provided to the receiver system. Accordingly, the legibility of the visual content shared by the sender system may be improved when rendered, displayed and subsequently viewed by a user in the virtual environment.
    Type: Grant
    Filed: June 29, 2018
    Date of Patent: September 14, 2021
    Assignees: KONINKLIKE KPN N.V., NEDERLANDSE ORGANISATIE VOOR TOEGEPAST-NATUURWETENSCHAPPELIJK ONDERZOEK TNO
    Inventors: Martin Prins, Emmanuel Thomas, Hans Maarten Stokking, Hendrikus Nathaniël Hindriks
  • Patent number: 11089214
    Abstract: A system and method are provided for generating an output video, such as a video panorama, from a plurality of video streams representing different recordings of a scene. The plurality of video streams may be analyzed to identify at least one part of at least one of the plurality of video streams which is to be used in the output video, thereby identifying a contributing part of a video stream. Orchestration metadata may be generated identifying the contributing part. The orchestration metadata may be provided to a stream source from which the video stream originated to enable the stream source to selectively stream the contributing part of the video stream. Effectively, a selection of the stream's video data may be made to avoid or reduce unnecessary bandwidth usage.
    Type: Grant
    Filed: December 16, 2016
    Date of Patent: August 10, 2021
    Assignees: KONINKLIJKE KPN N.V., NEDERLANDSE ORGANISATIE VOOR TOEGEPAST-NATUURWETENSCHAPPELIJK ONDERZOEK TNO
    Inventors: Hans Maarten Stokking, Emmanuel Thomas, Omar Aziz Niamut, Martin Prins
  • Patent number: 11087527
    Abstract: Some embodiments involve obtaining access to a number of omnidirectional images each representing a different viewpoint relative to a scene, and to metadata indicating a physical relation between the respective viewpoint and a physical object in the scene. Viewer data may be obtained that is indicative of a current physical relation between a viewpoint of the user and a same type of physical object in a current viewing environment of the user. An omnidirectional image may then be selected for display by comparing the viewer data to the metadata of the omnidirectional images. In other embodiments, an omnidirectional image may be selected, e.g., from omnidirectional images or by being the only available image, and the user may be instructed to assume a viewpoint in which the physical relation to the physical object in the user's current viewing environment corresponds to the physical relation as indicated by the selected image's metadata.
    Type: Grant
    Filed: November 29, 2018
    Date of Patent: August 10, 2021
    Assignees: Koninklijke KPN N.V., Nederlandse Organisatie voor Toegepast-Natuurwetenschappelijk Onderzoek TNO
    Inventors: Hans Maarten Stokking, Simon Norbert Bernhard Gunkel, Martin Prins, Hendrikus Nathaniel Hindriks
  • Patent number: 11082662
    Abstract: Systems and methods are provided for generating and rendering an enhanced audiovisual recording of a user, which may be used for multiuser communication, e.g., in Virtual Reality. Such an enhanced recording may be generated by determining a face orientation of the user in the audiovisual recording, and generating orientation data specifying an orientation which represents said determined face orientation. During rendering, the audio data may be rendered based on the orientation data, namely by rendering the audio data as a spatial audio source having a spatial direction which is congruent with the face orientation of the user in a visual representation of the user. Accordingly, the spatial direction of the voice of the user may better match the user's face direction in the user's visual representation.
    Type: Grant
    Filed: December 19, 2018
    Date of Patent: August 3, 2021
    Assignees: KONINKLIJKE KPN N.V., NEDERLANDSE ORGANISATIE VOOR TOEGEPAST-NATUURWETENSCHAPPELIJK ONDERZOEK TNO
    Inventors: Martin Prins, Hans Maarten Stokking, Simon Norbert Bernhard Gunkel, Hendrikus Nathaniël Hindriks
  • Patent number: 11037321
    Abstract: A system and method are provided for determining a size of a virtual object in a virtual environment. The virtual object may represent an object in physical space. The system and method may obtain image data of the object from a camera, obtain camera metadata indicative of an angle of view of the camera, estimate an object distance between the object and the camera, and estimate a physical size of the object in physical space by determining an image size of the object in the image data, and determining a relation between the image size and the physical size of the object on the basis of the camera metadata and the object distance. Accordingly, the size of the virtual object in the virtual environment may be determined in accordance with the physical size of the object. Virtual objects may thus be given realistic relative sizes in the virtual environment. A further advantage may be that there is no need for a calibrated system of multiple cameras and a calibrated rendering environment.
    Type: Grant
    Filed: December 1, 2017
    Date of Patent: June 15, 2021
    Assignees: Koninklijke KPN N.V., Nederlandse Organisatie Voor Toegepast-Natuurwetenschappelijk Onderzoek TNO
    Inventors: Hans Maarten Stokking, Martin Prins
  • Publication number: 20210112193
    Abstract: A method and processor system are provided which analyze a depth map, which may be obtained from a range sensor capturing depth information of a scene, to identify where an object is located in the scene. Accordingly, a region of interest may be identified in the scene which includes the object, and image data may be selectively obtained of the region of interest, rather than of the entire scene containing the object. This image data may be acquired by an image sensor configured for capturing visible light information of the scene. By only selectively obtaining the image data within the region of interest, rather than all of the image data, improvements may be realized in the computational complexity of a possible further processing of the image data, the storage of the image data and/or the transmission of the image data.
    Type: Application
    Filed: November 9, 2018
    Publication date: April 15, 2021
    Inventors: Frank Ter Haar, Nanda van der Stap, Hans Maarten Stokking, Martin Prins, Simon Gunkel
  • Publication number: 20210044779
    Abstract: A system and method are provided for facilitating multiuser communication in a Virtual Reality [VR] environment (10). The multiuser communication may involve a VR device configured to render the VR environment (10) to a local user (5), a plurality of remote communication devices which enable respective remote users to participate in the multiuser communication, and a camera (120) configured to record video of the local user (5) and to transmit the video as part of communication data to the plurality of remote communication devices for remote rendering of the video.
    Type: Application
    Filed: August 28, 2017
    Publication date: February 11, 2021
    Inventors: Martin Prins, Hans Maarten Stokking, Robert Koenen
  • Publication number: 20200401362
    Abstract: Systems and methods for screen sharing are provided. The screen sharing may comprise providing image data from a sender system to a receiver system. The receiver system may be a Virtual Reality [VR] system configured to render the image data in a virtual environment by projecting the image data onto a virtual canvas. At the sender system, visual content may be identified which is to be shared with the receiver system. The rendering or display of the virtual environment by the receiver may impose legibility constraints on the visual content. Accordingly, an adjusted version of the visual content may be generated which provides improved legibility when viewed in the virtual environment. The image data representing the adjusted version of the visual content may then be provided to the receiver system.
    Type: Application
    Filed: June 29, 2018
    Publication date: December 24, 2020
    Inventors: Martin Prins, Emmanuel Thomas, Hans Maarten Stokking, Hendrikus Nathaniël Hindriks
  • Publication number: 20200394157
    Abstract: Methods and systems for enabling content distribution from a first device to a second device are disclosed. A first device is configured to receive content and computer program script from a content source. The computer program script enables a content owner to define permissions that control the use and access of the content. The computer program script or a derivation thereof is provided from the first device to a second device, wherein said second device is communicably connected to the first device. On the basis of the computer program script, a template is generated by the second device for presenting the content. The second device transmits a request for the content and the content is retrieved from the first device in accordance with the permissions.
    Type: Application
    Filed: August 28, 2020
    Publication date: December 17, 2020
    Inventors: Anton Havekes, Martin Prins, Victor Klos, Peter-Jan Doets
  • Publication number: 20200382747
    Abstract: Systems and methods are provided for generating and rendering an enhanced audiovisual recording of a user, which may be used for multiuser communication, e.g., in Virtual Reality. Such an enhanced recording may be generated by determining a face orientation of the user in the audiovisual recording, and generating orientation data specifying an orientation which represents said determined face orientation. During rendering, the audio data may be rendered based on the orientation data, namely by rendering the audio data as a spatial audio source having a spatial direction which is congruent with the face orientation of the user in a visual representation of the user. Accordingly, the spatial direction of the voice of the user may better match the user's face direction in the user's visual representation.
    Type: Application
    Filed: December 19, 2018
    Publication date: December 3, 2020
    Inventors: Martin Prins, Hans Maarten Stokking, Simon Norbert Bernhard Gunkel, Hendrikus Nathaniël Hindriks
  • Patent number: 10788888
    Abstract: A method of facilitating capturing visual information at a first location (1) for display at a second location (2) is disclosed. At the first location, a virtual reality device (11) can be configured to render visual information representing a virtual environment, and at least one capturing device (12) can be configured to capture information representing a real environment comprising the virtual reality device (11). At the second location, at least one monitor (21) can be configured to render the information captured by the at least one capturing device (12). The method comprises determining an orientation of at least one capturing device (12) relative to the virtual reality device (11), and providing in the virtual environment a visual indication of said orientation.
    Type: Grant
    Filed: June 6, 2017
    Date of Patent: September 29, 2020
    Assignees: KONINKLIJKE KPN N.V., NEDERLANDSE ORGANISATIE VOOR TOEGEPAST-NATUUWETENSCHAPPELIJK ONDERZOEK TNO
    Inventors: Martin Prins, Hans Maarten Stokking, Emmanuel Thomas, Omar Aziz Niamut, Mattijs Oskar Van Deventer
  • Publication number: 20200195999
    Abstract: A method of determining a group of user devices suitable for contributing user content to an interactive media broadcast may comprise: —transmitting a set of requirements to a first plurality of user devices (13), each user device having a set of capabilities, the set of requirements relating to using at least part of the user content in the interactive media broadcast, —transmitting an invitation to a second plurality of user devices (13), the invitation being configured to cause a user device to produce a conditional response if the set of capabilities of the user device matches the set of requirements, and —identifying a group of user devices from which a conditional response was received. The method may further comprise selecting a group of user devices from the identified user devices. The selected group of user devices may include all identified user devices. The media broadcast may include an interactive television broadcast.
    Type: Application
    Filed: December 21, 2017
    Publication date: June 18, 2020
    Inventors: Martin Prins, Hans Maarten Stokking, Simon Gunkel
  • Publication number: 20190378289
    Abstract: A system and method are provided for determining a size of a virtual object in a virtual environment. The virtual object may represent an object in physical space. The system and method may obtain image data of the object from a camera, obtain camera metadata indicative of an angle of view of the camera, estimate an object distance between the object and the camera, and estimate a physical size of the object in physical space by determining an image size of the object in the image data, and determining a relation between the image size and the physical size of the object on the basis of the camera metadata and the object distance. Accordingly, the size of the virtual object in the virtual environment may be determined in accordance with the physical size of the object. Virtual objects may thus be given realistic relative sizes in the virtual environment. A further advantage may be that there is no need for a calibrated system of multiple cameras and a calibrated rendering environment.
    Type: Application
    Filed: December 1, 2017
    Publication date: December 12, 2019
    Inventors: Hans Maarten Stokking, Martin Prins
  • Publication number: 20190273960
    Abstract: The invention provides a streaming client with a streaming presentation of an event, with said presentation being obtained by dynamically switching between a plurality of media streams which represent different recordings of the event. For that purpose, source data is obtained from a plurality of stream sources. The source data is constituted by content data and/or metadata of concurrent portions of the plurality of media streams. By applying a quality assessment function to the source data, a quality score is assigned to each one of the concurrent portions. This allows selection data to be generated which enables the streaming client to access a selected one of the concurrent portions of a respective media stream. For example, a segment may be selected which provides a highest quality score. By doing so, it is therefore not required anymore for a consumer to manually switch between different media streams.
    Type: Application
    Filed: April 30, 2019
    Publication date: September 5, 2019
    Inventors: Martin Prins, Omar Aziz Niamut, Emmanuel Thomas, Ray Van Brandenburg, Hans Maarten Stokking
  • Publication number: 20190230331
    Abstract: A method of facilitating capturing visual information at a first location (1) for display at a second location (2) is disclosed. At the first location, a virtual reality device (11) can be configured to render visual information representing a virtual environment, and at least one capturing device (12) can be configured to capture information representing a real environment comprising the virtual reality device (11). At the second location, at least one monitor (21) can be configured to render the information captured by the at least one capturing device (12). The method comprises determining an orientation of at least one capturing device (12) relative to the virtual reality device (11), and providing in the virtual environment a visual indication of said orientation.
    Type: Application
    Filed: June 6, 2017
    Publication date: July 25, 2019
    Inventors: Martin PRINS, Hans Maarten STOKKING, Emmanuel THOMAS, Omar Aziz NIAMUT, Mattijs Oskar VAN DEVENTER