Abstract: A method for creating a non-riggable model of a face of a person, the method includes obtaining video and depth information regarding the face of the person, wherein different images of the video are acquired by a camera at different camera locations; and for each image of the different images repeating the steps of: separating face information from background information; determining translation and rotation parameters that represent the different camera locations; and generating the non-riggable model of the face of the person based on the face information and the translation and rotation parameters.

Abstract: A method for updating a current three dimensional (3D) model of a person, that method may include calculating current locations, within a two-dimensional (2D) space, of current face landmark points of a face of a person within a first image; the calculating is based on the current 3D model, and one or more current acquisition parameters of a 2D camera; wherein the current 3D model of the person is located within a 3D space; calculating second locations, within the 2D space, of second face landmark points of the face of the person within a second image that follows the first image; calculating correspondences between the current locations and the second locations; calculating, based on the correspondences, locations of the second face landmark points within the 3D space; and modifying the current 3D model based on the locations of the second face landmark points within the 3D space.

Abstract: Various of the disclosed embodiments relate to systems and methods for determining and for presenting surgical examination data of an internal body structure, such as a large intestine. For example, various of the disclosed methods may create a three-dimensional computer model using the examination data and then coordinate playback of the examination data based upon the reviewer's interaction with the model. In some embodiments, the model's rendering may be adjusted to reflect various aspects of the examination, including scoring metrics, identified landmarks, and lacunae in the surgical examination review.

Abstract: Various of the disclosed embodiments contemplate systems and methods for assessing structural complexity within an intra-surgical environment. For example, in some embodiments, surface characteristics from three-dimensional models of a patient interior, such as a colon, bronchial tube, esophagus, etc. may be used to infer the surface's level of complexity. Once determined, complexity may inform a number of downstream operations, such as assisting surgical operators to identify complex regions requiring more thorough review, the automated recognition of healthy or unhealthy tissue states, etc. While some embodiments apply to generally cylindrical internal structures, such as a colon or branching pulmonary pathways, etc., other embodiments may be used within other structures, such as inflated laparoscopic regions between organs, joints, etc. Various embodiments also consider graphical and feedback indicia for representing the complexity assessments.

Abstract: A method for conducting a three dimensional (3D) video conference between multiple participants, the method may include receiving direction of gaze information regarding a direction of gaze of each participant within a representation of a virtual 3D video conference environment that is associated with the participant; determining, for each participant, updated 3D participant representation information within the virtual 3D video conference environment, that reflects the direction of gaze of the participant; and generating, for at least one participant, an updated representation of virtual 3D video conference environment, the updated representation of virtual 3D video conference environment represents the updated 3D participant representation information for at least some of the multiple participants.

Abstract: A method for creating a variable model of a face of a person, the method comprises: obtaining a non-riggable model of the face of the person; performing a first approximation process that comprises generating an intermediate variable model that approximates the non-riggable model, using an interactive variable model infrastructure; wherein the generating comprises iteratively changing shape parameters of the intermediate model until fulfilling a proximity condition; and performing a second approximation process that comprises generating the variable model, by iteratively modifying vertices.

Abstract: A method for generating an avatar having expressions that mimics expressions of a person, the method may include obtaining expression parameters that represent an expression of the person; generating, in real time, a texture map of a face of the person, the texture map of the face of the person represents the expression of the person, wherein the generating is based on the expression parameters, wherein the generating comprises (i) determining, using a neural network and based on the expression parameters, weights, and (ii) calculating a weighted sum of a set of base texture maps, wherein the set of base texture maps belongs to a group of base texture maps that spans different acquired texture maps, the acquired texture maps are calculated based on images of arbitrary expressions made by the person; and rendering the avatar using the texture map.

Abstract: A method for creating a non-riggable model of a face of a person, the method includes obtaining video and depth information regarding the face of the person, wherein different images of the video are acquired by a camera at different camera locations; and for each image of the different images repeating the steps of: separating face information from background information; determining translation and rotation parameters that represent the different camera locations; and generating the non-riggable model of the face of the person based on the face information and the translation and rotation parameters.

Abstract: A method for conducting a three dimensional (3D) video conference between multiple participants, the method may include determining, for each participant, updated 3D participant representation information within the virtual 3D video conference environment, that represents participants; wherein the determining comprises estimating 3D participant representation information of one or more hidden areas of a face of a participant that are hidden from the camera that captures at least one visible area of the face of the participant; and generating, for at least one participant, an updated representation of virtual 3D video conference environment, the updated representation of virtual 3D video conference environment represents the updated 3D participant representation information for at least some of the multiple participants.

Abstract: A method for conducting a three dimensional (3D) video conference between multiple participants, the method may include determining, for each participant and multiple times during the 3D video conference, updated 3D participant representation information within the virtual 3D video conference environment; and generating, for at least one participant and multiple times during the 3D video conference, an updated representation of a virtual 3D video conference environment, the updated representation of virtual 3D video conference environment represents the updated 3D participant representation information for at least some of the multiple participants; and wherein the 3D participant representation information comprises a 3D model and one or more texture maps.