Patents by Inventor Yury Degtyarev
Yury Degtyarev has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 10805662Abstract: A server device and method are provided for use in predictive server-side rendering of scenes based on client-side user input. The server device may include a processor and a storage device holding instructions for an application program executable by the processor to receive, at the application program, a current navigation input in a stream of navigation inputs from a client device over a network, calculate a predicted future navigation input based on the current navigation input and a current application state of the application program, render a future scene based on the predicted future navigation input to a rendering surface, and send the rendering surface to the client device over the network.Type: GrantFiled: November 25, 2019Date of Patent: October 13, 2020Assignee: Microsoft Technology Licensing, LLCInventors: David Chiyuan Chu, Eduardo Alberto Cuervo Laffaye, Johannes Peter Kopf, Alastair Wolman, Yury Degtyarev, Kyungmin Lee, Sergey Grizan
-
Patent number: 10762692Abstract: Embodiments of the present disclosure can provide systems, methods, and computer-readable medium for providing virtual lighting adjustments to image data. A number of source images may be generated to individually depict solid colors of a color space (e.g., RGB color space). Virtual lighting adjustments associated with a virtual lighting mode may be applied to each source image to generate a corresponding target image. The source images and the target images may be utilized to train a model to identify pixel modifications to be applied to image data. The modifications may be associated with a virtual lighting mode. Subsequently, a user may obtain image data (e.g., an image or video) select a virtual lighting mode via an image data processing application. The previously trained model may be utilized to modify the image to apply the virtual lighting effects associated with the selected virtual lighting mode.Type: GrantFiled: September 6, 2019Date of Patent: September 1, 2020Assignee: Apple Inc.Inventors: Yury Degtyarev, Frederic Cao, Garrett M. Johnson
-
Patent number: 10750139Abstract: A head mounted display device including a processor configured to compute a rendered rendering surface of a predicted scene having a predicted user viewpoint, the predicted user viewpoint being a prediction of a viewpoint that a user will have at a point in time that was predicted for the user of the head mounted display device prior to the point in time, receive, from the user input device, a subsequent user navigation input near the point in time in the stream of user input, determine an actual user viewpoint based on the subsequent user navigation input, determine a user viewpoint misprediction based on the predicted user viewpoint and the actual user viewpoint, and reconstruct a viewport for the actual user viewpoint from the rendered rendering surface.Type: GrantFiled: May 23, 2017Date of Patent: August 18, 2020Assignee: Microsoft Technology Licensing, LLCInventors: David Chiyuan Chu, Eduardo Alberto Cuervo Laffaye, Johannes Peter Kopf, Alastair Wolman, Yury Degtyarev, Kyungmin Lee, Sergey Grizan
-
Publication number: 20200092599Abstract: A server device and method are provided for use in predictive server-side rendering of scenes based on client-side user input. The server device may include a processor and a storage device holding instructions for an application program executable by the processor to receive, at the application program, a current navigation input in a stream of navigation inputs from a client device over a network, calculate a predicted future navigation input based on the current navigation input and a current application state of the application program, render a future scene based on the predicted future navigation input to a rendering surface, and send the rendering surface to the client device over the network.Type: ApplicationFiled: November 25, 2019Publication date: March 19, 2020Applicant: Microsoft Technology Licensing, LLCInventors: David Chiyuan Chu, Eduardo Alberto Cuervo Laffaye, Johannes Peter Kopf, Alastair Wolman, Yury Degtyarev, Kyungmin Lee, Sergey Grizan
-
Publication number: 20200082607Abstract: Embodiments of the present disclosure can provide systems, methods, and computer-readable medium for providing virtual lighting adjustments to image data. A number of source images may be generated to individually depict solid colors of a color space (e.g., RGB color space). Virtual lighting adjustments associated with a virtual lighting mode may be applied to each source image to generate a corresponding target image. The source images and the target images may be utilized to train a model to identify pixel modifications to be applied to image data. The modifications may be associated with a virtual lighting mode. Subsequently, a user may obtain image data (e.g., an image or video) select a virtual lighting mode via an image data processing application. The previously trained model may be utilized to modify the image to apply the virtual lighting effects associated with the selected virtual lighting mode.Type: ApplicationFiled: September 6, 2019Publication date: March 12, 2020Applicant: Apple Inc.Inventors: Yury Degtyarev, Frederic Cao, Garrett M. Johnson
-
Patent number: 10491941Abstract: A server device and method are provided for use in predictive server-side rendering of scenes based on client-side user input. The server device may include a processor and a storage device holding instructions for an application program executable by the processor to receive, at the application program, a current navigation input in a stream of navigation inputs from a client device over a network, calculate a predicted future navigation input based on the current navigation input and a current application state of the application program, render a future scene based on the predicted future navigation input to a rendering surface, and send the rendering surface to the client device over the network.Type: GrantFiled: August 30, 2017Date of Patent: November 26, 2019Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: David Chiyuan Chu, Eduardo Alberto Cuervo Laffaye, Johannes Peter Kopf, Alastair Wolman, Yury Degtyarev, Kyungmin Lee, Sergey Grizan
-
Patent number: 10467803Abstract: Embodiments of the present disclosure can provide systems, methods, and computer-readable medium for providing virtual lighting adjustments to image data. A number of source images may be generated to individually depict solid colors of a color space (e.g., RGB color space). Virtual lighting adjustments associated with a virtual lighting mode may be applied to each source image to generate a corresponding target image. The source images and the target images may be utilized to train a model to identify pixel modifications to be applied to image data. The modifications may be associated with a virtual lighting mode. Subsequently, a user may obtain image data (e.g., an image or video) select a virtual lighting mode via an image data processing application. The previously trained model may be utilized to modify the image to apply the virtual lighting effects associated with the selected virtual lighting mode.Type: GrantFiled: September 11, 2018Date of Patent: November 5, 2019Assignee: Apple Inc.Inventors: Yury Degtyarev, Frederic Cao, Garrett M. Johnson
-
Publication number: 20170366838Abstract: A server device and method are provided for use in predictive server-side rendering of scenes based on client-side user input. The server device may include a processor and a storage device holding instructions for an application program executable by the processor to receive, at the application program, a current navigation input in a stream of navigation inputs from a client device over a network, calculate a predicted future navigation input based on the current navigation input and a current application state of the application program, render a future scene based on the predicted future navigation input to a rendering surface, and send the rendering surface to the client device over the network.Type: ApplicationFiled: August 30, 2017Publication date: December 21, 2017Applicant: Microsoft Technology Licensing, LLCInventors: David Chiyuan Chu, Eduardo Alberto Cuervo Laffaye, Johannes Peter Kopf, Alastair Wolman, Yury Degtyarev, Kyungmin Lee, Sergey Grizan
-
Publication number: 20170257609Abstract: A head mounted display device including a processor configured to compute a rendered rendering surface of a predicted scene having a predicted user viewpoint, the predicted user viewpoint being a prediction of a viewpoint that a user will have at a point in time that was predicted for the user of the head mounted display device prior to the point in time, receive, from the user input device, a subsequent user navigation input near the point in time in the stream of user input, determine an actual user viewpoint based on the subsequent user navigation input, determine a user viewpoint misprediction based on the predicted user viewpoint and the actual user viewpoint, and reconstruct a viewport for the actual user viewpoint from the rendered rendering surface.Type: ApplicationFiled: May 23, 2017Publication date: September 7, 2017Applicant: Microsoft Technology Licensing, LLCInventors: David Chiyuan Chu, Eduardo Alberto Cuervo Laffaye, Johannes Peter Kopf, Alastair Wolman, Yury Degtyarev, Kyungmin Lee, Sergey Grizan
-
Patent number: 9756375Abstract: A server device and method are provided for use in predictive server-side rendering of scenes based on client-side user input. The server device may include a processor and a storage device holding instructions for an application program executable by the processor to receive, at the application program, a current navigation input in a stream of navigation inputs from a client device over a network, calculate a predicted future navigation input based on the current navigation input and a current application state of the application program, render a future scene based on the predicted future navigation input to a rendering surface, and send the rendering surface to the client device over the network.Type: GrantFiled: January 22, 2015Date of Patent: September 5, 2017Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: David Chiyuan Chu, Eduardo Alberto Cuervo Laffaye, Johannes Peter Kopf, Alastair Wolman, Yury Degtyarev, Kyungmin Lee, Sergey Grizan
-
Patent number: 9686520Abstract: A client device and method are provided for reconstructing a viewport from a rendered rendering surface of a predicted user viewpoint in order to reduce user perceived latency of the network. The client device may execute instructions to: receive, from a server device over a network, a rendered rendering surface of a predicted scene having a predicted user viewpoint, receive, from the user input device, a subsequent user navigation input in the stream of user input, determine an actual user viewpoint based on the subsequent user navigation input, determine a user viewpoint misprediction based on the predicted user viewpoint and the actual user viewpoint, and reconstruct a viewport for the actual user viewpoint from the rendered rendering surface.Type: GrantFiled: January 22, 2015Date of Patent: June 20, 2017Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: David Chiyuan Chu, Eduardo Alberto Cuervo Laffaye, Johannes Peter Kopf, Alastair Wolman, Yury Degtyarev, Kyungmin Lee, Sergey Grizan
-
Patent number: 9661312Abstract: A client device and method are provided for use in synthesizing a second eye viewport using interleaving in order to reduce bandwidth costs. The client device may comprise a user input device that receives a stream of user input, a stereoscopic display device, a processor, and a storage device holding instructions for a client application program, executable by the processor to obtain, at a view interpolation module of the client application program, a current rendered rendering surface representing a current view of a scene for a first eye of a user and a previously rendered rendering surface representing a past view of the scene for a second eye of the user, synthesize and display a current second eye viewport representing a current view of the scene for the second eye of the user based on the current rendered rendering surface and the previously rendered rendering surface.Type: GrantFiled: January 22, 2015Date of Patent: May 23, 2017Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: David Chiyuan Chu, Eduardo Alberto Cuervo Laffaye, Johannes Peter Kopf, Alastair Wolman, Yury Degtyarev, Kyungmin Lee, Sergey Grizan
-
Publication number: 20160219267Abstract: A client device and method are provided for use in synthesizing a second eye viewport using interleaving in order to reduce bandwidth costs. The client device may comprise a user input device that receives a stream of user input, a stereoscopic display device, a processor, and a storage device holding instructions for a client application program, executable by the processor to obtain, at a view interpolation module of the client application program, a current rendered rendering surface representing a current view of a scene for a first eye of a user and a previously rendered rendering surface representing a past view of the scene for a second eye of the user, synthesize and display a current second eye viewport representing a current view of the scene for the second eye of the user based on the current rendered rendering surface and the previously rendered rendering surface.Type: ApplicationFiled: January 22, 2015Publication date: July 28, 2016Inventors: David Chiyuan Chu, Eduardo Alberto Cuervo Laffaye, Johannes Peter Kopf, Alastair Wolman, Yury Degtyarev, Kyungmin Lee, Sergey Grizan
-
Publication number: 20160217760Abstract: A client device and method are provided for reconstructing a viewport from a rendered rendering surface of a predicted user viewpoint in order to reduce user perceived latency of the network. The client device may execute instructions to: receive, from a server device over a network, a rendered rendering surface of a predicted scene having a predicted user viewpoint, receive, from the user input device, a subsequent user navigation input in the stream of user input, determine an actual user viewpoint based on the subsequent user navigation input, determine a user viewpoint misprediction based on the predicted user viewpoint and the actual user viewpoint, and reconstruct a viewport for the actual user viewpoint from the rendered rendering surface.Type: ApplicationFiled: January 22, 2015Publication date: July 28, 2016Inventors: David Chiyuan Chu, Eduardo Alberto Cuervo Laffaye, Johannes Peter Kopf, Alastair Wolman, Yury Degtyarev, Kyungmin Lee, Sergey Grizan
-
Publication number: 20160219325Abstract: A server device and method are provided for use in predictive server-side rendering of scenes based on client-side user input. The server device may include a processor and a storage device holding instructions for an application program executable by the processor to receive, at the application program, a current navigation input in a stream of navigation inputs from a client device over a network, calculate a predicted future navigation input based on the current navigation input and a current application state of the application program, render a future scene based on the predicted future navigation input to a rendering surface, and send the rendering surface to the client device over the network.Type: ApplicationFiled: January 22, 2015Publication date: July 28, 2016Inventors: David Chiyuan Chu, Eduardo Alberto Cuervo Laffaye, Johannes Peter Kopf, Alastair Wolman, Yury Degtyarev, Kyungmin Lee, Sergey Grizan