Abstract: An apparatus and a method by which a content such as an advertisement corresponding to a user at the reception apparatus side can be selectively outputted to the reception apparatus are provided. A transmission apparatus transmits signaling data (MPD) having a user information setting region, a control information file capable of being accessed or generated applying user information-set data generated by a process for the MPD, and a user information-corresponding advertisement capable of being acquired and reproduced on the basis of description data of the control information file. The reception apparatus sets user information to the user information setting region of the MPD, applies the generated user information-set data to acquire a control information file of a user information-corresponding advertisement, applies the description data of the acquired control information file to acquire the user information-corresponding advertisement, and outputs the user information-corresponding advertisement.

Abstract: The present invention teaches a system, method and computer program for enabling local or regional merchants to participate in an automated cause marketing (ACM) program using mobile devices. The ACM program that may provide benefits to several parties involved in fundraising for one or more supported organizations, including one or more supported organizations, advertising providers, merchants, and individuals. Merchants are able to access enhanced analytics regarding their transactions with members and non-members of the ACM program and can use these enhanced analytics to realize an increased number of or revenue from transactions with members. The present invention also teaches a system and method for enabling advertising providers to acquire and analyze data associated with consumers-merchant transactions. The present invention provides the above features optimally using mobile devices.

Abstract: This disclosure describes a vehicle-motion-analysis system that can align axes for a provider device and a corresponding transportation vehicle based on the provider device's location and motion data as a basis for generating driving-event scores for particular driving events. In particular, the disclosed systems can generate axes-rotation parameters that align axes of a provider device with axes of a transportation vehicle. In addition, the disclosed systems can identify motion paths, motion patterns, or other driving behaviors that occur during particular driving events. Further, the disclosed systems can generate driving-event scores for such driving events and can customize a graphical user interface based on the driving-event scores to reflect a provider rating and/or a location rating.

Abstract: A computer-aided design system enables physical articles to be customized via printing or embroidering and enables digital content to be customized and electronically shared. A user interface may be generated that includes an image of a model of an article of manufacture and user customizable design areas that are graphically indicated on the image corresponding to the model. A design area selection may be received. In response to an add design element instruction and design element specification, the specified design element is rendered in the selected design area on the model image. Customization permissions associated with the selected design area are accessed, and using the customization permissions, a first set of design element edit tools are selected and rendered. User edits to the design element may be received and rendered in real time. Manufacturing instructions may be transmitted to a printing system.

Abstract: An effective stock keeping unit (SKU) management system encodes catalog data into an embedding per catalog item. An embedding space is created by encoding catalog item data into an embedding per catalog item. The embedding is created by generating an index, where a number of rows represents a number of catalog items and a number of columns represents a number of fields associated with each catalog item. The index is then denormalized using customer groups and transformed by compressing the number of columns, to create the embedding space. In some configuration, a machine learning model is trained using catalog data. In the embedding space, item similarity is encoded by clustering catalog SKUs into groups in the embedding space, by placing similarly related items close to each other in the embedding space. Catalog items are then searched for in the embedding, with the closest clusters searched for a particular catalog item.

Abstract: A method and a system to present samples of products to customers by transporting the samples to the customer's location with an autonomous vehicle. The sample can be a product, a component of a product, a material or a device to gather information in defining the product. The autonomous vehicle is adapted for off road travel and may enter buildings, it can be carried to a nearby location by a street adapted vehicle. Information may be transmitted electronically but physical presence is essential. The customer or the customer's agent receives a presentation of the product definer and a selection of a final product is made. In other cases the autonomous vehicle delivery separate or installed technical equipment to examine the presentation location and assist in the final product selection. For example, photographs from multiple locations can measure a room for installation of carpets or draperies, etc.

Abstract: An online concierge system may determine recommended search terms for a user. The online concierge system may receive a request from a user to view a user interface configured to receive a search query. The online concierge system retrieves long-term activity data including previous search terms entered by the user while searching for items to add to an online shopping cart. For each previous search term, the online concierge system retrieves categorical search terms corresponding to one or more categories to which the previous search term was mapped. The online concierge system determines a set of nearby categorical search terms and sends, for display via a client device, the set of nearby categorical search terms as recommended search terms.

Abstract: Techniques are generally described for displaying outfit recommendations using a recurrent neural network. In various examples, a computing device may receive a first state vector representing an outfit comprising at least one fashion item. First image data depicting a second fashion item of a first item category may be received. A recurrent neural network may generate a first output feature vector based on the first state vector, the first image data, a first attribute vector, and the first item category. The first output feature vector may be compared to other feature vectors representing other fashion items in the first category to determine distances between the first output feature vector and the other feature vectors. A set of fashion items may be recommended and displayed based on the distances between the first output feature vector and the other feature vectors.

Abstract: A special programs computer, which executes the program on a non-transitory computer readable medium, stores one or more programs and the graphical user interface on a computing device with a touch screen display, a memory, at least one camera configured to input information about an item and one or more processors to execute one or more programs stored in the memory. The touch screen device is operatively connected to one or more database servers via a wired or wireless network. Unlike traditional registries, the special computer systems herein allow for sharing individual selected items (at the item level) off a list with one or more selected individuals and also prevents the gift receiver from being notified that the gifted item has been purchased for them until a later date while simultaneously preventing display of the item to other users after its purchased.

Abstract: A social gift registry provides tools to aid those planning for major milestones in life to engage a network of friends, family, and others in communicating information about the life event, helping to identify and track gifts for the celebrants, and enabling the management of the activities involved in the celebration.

Abstract: Systems and related methods providing for online ordering of menu items from a merchant are discussed herein. Circuitry may be configured to generate an online menu based on menu information stored in a menu database. The menu information may be also configured to facilitate point-of-sale functionality at the merchant, such as by a point-of-sale device. The online menu may be provided to a consumer device. An online order may be received from the consumer device. The circuitry may be configured to process the online order, such as by facilitating a reservation, order preparation, and payment.

Abstract: Apparatus and associated methods relate to an automatic ordering method including a network-connected machine-readable code scanner identifying a product, and a network-connected weigh scale identifying a current weight of the product, the method further triggering an automatic order process when the current weight crosses a predetermined threshold. In an illustrative example, the automatic order process may send a signal to a user's network-connected personal device containing a notification that the product's current weight has crossed the predetermined threshold. The user may be presented one or more options, for example, regarding product purchase. In some examples, user setup selections may provide input to a function that determines the predetermined weight threshold. Various examples may include a network server. Online merchants providing online ordering of the product may also connect to the network server, for example.

Abstract: A system for leveraging email to complete an online checkout from a customer accessing a third party vendor website is disclosed. The system may store customer information including a name, email address, shipping address, and billing information. The system may receive a request for a purchase from the third party vendor including a customer email address and an item to be purchased. The system may authenticate the customer email address. The system may send a first email to the customer email address requesting authorization to complete a purchase. The system may receive a second email, from the customer email address, encoded with the token and confirming or canceling the purchase. The system may authenticate the second email using the customer email address and the token. And the system may transmit a confirmation of purchase of the at least one item to the third party vendor website.

Abstract: Systems, methods, and computer-readable storage media for creating an open loop prepaid gift account. The system identifies a request to purchase an open loop prepaid gift account which can be used to make a purchase at a merchant, presents a menu from which a customer can select the merchant, and receives a selection. Based on the selection, the system presents an option to load funds onto the open loop prepaid gift account and, upon receipt of payment, creates the open loop prepaid gift account and loads the open loop prepaid gift account with money, wherein information associated with the open loop prepaid gift account is encoded onto a physical card, and wherein merchant information is printed on the physical card according to an authorization from the merchant, the merchant information including at least one of a legal name, a trade name, a logotype, and a marketing tagline of the merchant.

Abstract: Systems, methods, and apparatuses for enrolling a user with a product of an institution are provided. One or more processors of a user device perform operations including: establishing a short-range communication channel with a computing device associated with an institution based on a tap exchange; providing information to the computing device over the short-range communication channel, the information associated with an enrollment of a user with a product of the institution; and automatically ceasing the short-range communication channel based on at least one of a predetermined time period or a location of the user device.

Abstract: Systems and methods are provided for assessing an account takeover risk for one or more accounts of an individual. The account security procedures for each of a number of services with which the user has an account may be analyzed. Publicly accessible information regarding the user may also be collected and analyzed. The collected information and security procedures may be compared in order to determine one or more vulnerabilities to hostile account takeover of one or more of the analyzed accounts. An alert may be generated regarding a determined takeover risk, which may include suggested actions for remedying the risk.

Abstract: An example operation may include one or more of receiving, via a host platform, a payment authorization request message for a payment transaction of a digital wallet hosted by the host platform from a payment gateway of an electronic payment network, verifying that a payment account in the digital wallet has sufficient funds to satisfy an amount of the payment transaction and transmitting a payment authorization response to the payment gateway, pausing clearing and settling of the authorized payment transaction, executing a blockchain transaction via a blockchain ledger of a cryptocurrency network to exchange fiat currency from the payment account for cryptocurrency based on the amount of the payment transaction, prior to a due date of the authorized payment transaction, executing a second blockchain transaction to exchange the cryptocurrency for a new amount of fiat currency, and settling the authorized payment transaction based on the new amount of fiat currency received from the second blockchain transacti

Abstract: In some embodiments, a method includes storing data associated with fungible assets in a distributed ledger database. The method includes dividing fungible tokens into a first set of groups of fungible tokens based on the data and sending, via the distributed ledger-based network and based on an asymmetric cryptography key pair, each group of fungible tokens from the first set of groups of fungible tokens to a communication device from the first set of communication devices to cause the second plurality of communication devices to send, to a designated recipient communication device, non-fungible tokens for each group of fungible tokens from the second set of groups of fungible tokens. The first set of groups of fungible tokens is divided into a second set of groups of fungible tokens and received at a second set of communication devices.

Abstract: Methods and apparatuses are described for automatic data-driven optimization of a target outcome using machine learning. A server generates a first feature dataset and applies a trained outcome prediction model to the first feature dataset as input to generate a second feature data set and a first predicted value for a target outcome. The server displays the first predicted value on a client device. The server receives input corresponding to one or more preferences or constraints from the client device and adjusts the trained outcome prediction model based upon the received input to incorporate the one or more preferences or constraints. The server applies the adjusted outcome prediction to the second feature dataset as input to generate a third feature data set a second predicted value for the target outcome. The server displays the second predicted value on the client device.

Abstract: Methods and systems for locational visualization of financial statements are described. In an example, a method may receive, in a financial institution system, a request to display a record associated with a financial transaction, determine a location of a merchant associated with the financial transaction using merchant information, request, from an online mapping service, a customizable map interface associated with the location of the merchant, receive the customizable map interface, and display the customizable map interface integrated into the record associated with the financial transaction.

Abstract: Systems and methods for determining how to dispatch power to a property from a generator are provided. According to certain aspects, a controller associated with the generator may retrieve or access a set of data indicating time of use rates associated with utility power, performance characteristics of the generator, and/or energy usage data. Based on the data, the controller may determine a set point corresponding to when it may be beneficial to dispatch generator power to the property instead of utility power. At the set point, the controller may facilitate supplementing power from utility power with power from the generator. Additionally, the controller may collect usage and performance data associated with dispatch of the generator power.

Abstract: Some embodiments are directed to a regulatory compliance tool implemented via a back-end application computer server. A location based regulatory compliance data store may contain electronic records associated with a set of locations. Each electronic record may include, for example, an electronic record identifier and at least one regulatory compliance parameter. The computer server may receive, from a user via an interactive graphical user interface display, a set of task indications associated with regulatory compliance. The computer server may also receive, from the user, a selected location from a set of potential locations. The computer server may then retrieve, from the location based regulatory compliance data store, information about the at least one regulatory compliance parameter associated with the selected location. The computer server may then update the display based on the retrieved information about the at least one regulatory compliance parameter associated with the selected location.

Abstract: A system for high definition (HD) image recognition of criminals is disclosed. The system includes a plurality of cameras, an image recognition server, investigator user devices, a computing device, a database, and a network. At least one processor of the image recognition server is configured to receive a plurality of photographs of a first individual, perform image processing of the plurality of photographs to extract a first set of physical features, store feature data regarding the first set of physical features in the database, receive suspect data regarding a suspected individual from a first investigator user device, match the suspect data with the feature data stored in the database, and transmit an alert to the computing device in the prison, wherein the alert activates a mobile application on each investigator user device to display match data identifying the suspected individual as the first individual based on the feature data.

Abstract: A model training method and apparatus for image recognition, and a non-transitory storage medium are provided. The model training method includes: obtaining a multi-label image training set including a plurality of training images each annotated with a plurality of sample labels; selecting target training images from the multi-label image training set for training a current model; performing label prediction on each target training image using the current model, to obtain a plurality of predicted labels of the each target training image; obtaining a cross-entropy loss function corresponding to the plurality of sample labels of the each target training image, a positive label loss being greater than a negative label loss and having a weight greater than 1; converging the predicted labels and the sample labels of the each target training image according to the cross-entropy loss function, and updating parameters of the current model, to obtain a trained model.

Abstract: A processor for optimizing partial writes to compressed blocks is configured to identify that a write request targets less than an entirety of a compressed block of pixel data, identify, based on a compression key, a compressed segment of the compressed block of pixel data that includes a target of the write request, and decompress, responsive to the write request, only the identified compressed segment of the compressed block of pixel data.

Abstract: A split hierarchy graphics processor system including a master node executing a virtual reality (VR) application responsive to input from a client device received over a network to generate primitives for in a VR environment. The graphics processor system including render nodes performing rendering based on the primitives for views into the VR environment taken from a location in the VR environment, the views corresponding to a grid map of the VR environment. Each of the render nodes renders, encodes and streams a corresponding sequence of frames of a corresponding view to the client device. The processor system including an asset library storing input geometries for the objects used for building the VR environment, wherein the objects in the asset library are accessible by the master node and the render nodes.

Abstract: A drone is used to map difficult transition spaces within buildings such as staircases between different levels of a multi-level building. The mapping technique used may vary based on the type of building space. For instance, for linear staircases, an orthogonal trajectory path or a smooth trajectory path may be used to map the transition space. The orthogonal trajectory path and the smooth trajectory path may be derived, at least in part, on initial and terminating points provided by a user. For circular staircases, a user may move the drone from the initial point to the terminating point, and the drone may determine a trajectory path based on the user's movement of the drone from the initial point to the terminating point.

Abstract: Aspects of the disclosure provide methods and apparatuses of virtual prop allocation and provide non-transitory computer-readable storage mediums storing instructions for virtual prop allocation. A method of virtual prop allocation includes obtaining a geographic location and state information of at least one terminal device participating in a first scene, and determining a first virtual prop associated with the first scene based on the geographic location and the state information of the at least one terminal device participating in the first scene. Further, the method includes determining geographic location information for releasing the first virtual prop, and transmitting, to a first terminal device in the at least one terminal device, the geographic location information for releasing the first virtual prop.

Abstract: Image generation using a hierarchical, model-based system includes generating a first region of an image using a first neural network model. The first region of the image is provided to a second neural network model as input. A second region of the image is generated using the second neural network model. The second region of the image shares a boundary with at least a portion of the first region of the image.

Abstract: An augmented reality interventional system which provides contextual overlays (116) to assist or guide a user (101) or enhance the performance of the interventional procedure by the user that uses an interactive medical device (102) to perform the interventional procedure. The system includes a graphic processing module (110) that is configured to generate at least one contextual overlay on an augmented reality display device system (106). The contextual overlays may identify a component (104) or control of the interactive medical device. The contextual overlays may also identify steps of a procedure to be performed by the user and provide instructions for performance of the procedure. The contextual overlays may also identify a specific region of the environment to assist or guide the user or enhance the performance of the interventional procedure by identifying paths or protocols to reduce radiation exposure.

Abstract: Embodiments of the present disclosure relate to learning dense correspondences for images. Systems and methods are disclosed that disentangle structure and texture (or style) representations of GAN synthesized images by learning a dense pixel-level correspondence map for each image during image synthesis. A canonical coordinate frame is defined and a structure latent code for each generated image is warped to align with the canonical coordinate frame. In sum, the structure associated with the latent code is mapped into a shared coordinate space (canonical coordinate space), thereby establishing correspondences in the shared coordinate space. A correspondence generation system receives the warped coordinate correspondences as an encoded image structure. The encoded image structure and a texture latent code are used to synthesize an image. The shared coordinate space enables propagation of semantic labels from reference images to synthesized images.

Abstract: Accelerated filtered back projection for computed tomography image reconstruction. In an embodiment, a filtered back projection is performed on a sinogram. The back projection may comprise transitioning the sinogram to a linogram using linear interpolation, and performing an inverse Fast Hough Transform on the linogram to produce a reconstructed CT image. Filtering in the filtered back projection may use an infinite impulse response (IIR) filter.

Abstract: An image processing apparatus that generates a three-dimensional image as a subtraction image from a first medical image and a second medical image which are three-dimensional images obtained by imaging a subject, the image processing apparatus includes an acquisition unit configured to acquire the first medical image and the second medical image, a determination unit configured to determine a resolution of the subtraction image, and, a subtraction image generation unit configured to generate the subtraction image having the resolution determined by the determination unit, wherein the determination unit determines a resolution of at least one axial direction among three axial directions configuring the resolution of the subtraction image, based on a resolution of the first medical image and a predetermined first resolution.

Abstract: Computer processing techniques are described for reducing streaks in computed tomography (CT) images. According to an embodiment, computer-implemented method comprises obtaining, by a system comprising a processor, a pair of CT images reconstructed from a same set of projection data, the pair comprising a first image reconstructed from the projection data using a standard reconstruction process and a second image reconstructed from the projection data using a filtering reconstruction process that results in the second image comprising a first reduced level of streaks relative to the first image. The method further comprises generating, by the system, a third image by fusing a first subset of pixels extracted from one or more non-uniform areas in the first image and a second subset of pixels extracted from one or more uniform areas in the second image, wherein the third image comprises a second reduced level of streaks relative to the first image.

Abstract: A display device of the present invention includes a display controller executing display control processing of controlling an operation of a predetermined display destination to cause the display destination to display a plurality of N-dimensional graphs. The plurality of N-dimensional graphs include a first graph and a second graph. When a predetermined condition related to acquisition of fixed value change information including auxiliary explanatory variable information designating one or more of auxiliary explanatory variables as objects to be changed in value, and information indicating current variable values is satisfied, the display control processing includes processing of updating the first graph and the second graph to be displayed on the display destination to a changed graph due to changing of values of the auxiliary explanatory variables indicated by the auxiliary explanatory variable information to the current variable values indicated by the fixed value change information.

Abstract: An object of the present disclosure is to, in a case of adding a double-page spread in editing of a plurality of albums, determine a criterion for creating the double-page spread to be added to automatically create and add the double-page spread. A program is provided which causes a computer to function as an editing unit configured to edit layouts of a plurality of albums each having an attribute of a common double-page spread common to all of the albums and an attribute of an individual double-page spread in each of the albums as double-page spread attributes. The editing unit automatically creates a double-page spread based on one or more criteria corresponding to the attributes, and adds the created double-page spread to one album among the plurality of album.

Abstract: A floor plan image generating methodology is provided. The methodology includes: acquiring a boundary of a target building and a layout constraint of the target building; outputting multiple first floor plan images according to the layout constraint of the target building; selecting multiple second floor plan images from the multiple first floor plan images; applying a layout constraint of each of the second floor plan images to the boundary of the target building, and obtaining a layout of the target building corresponding to each of the multiple second floor plan images; inputting the layout of the target building and the boundary of the target building into a floor plan image generating network; and obtaining a predicted floor plan image of the target building outputted by the floor plan image generating network.

Abstract: Systems and methods are provided for enhanced animation generation based on generative modeling. An example method includes training models based on faces and information associated with persons, each face being defined based on location information associated with facial features, and identity information for each person. The modeling system being trained to reconstruct expressions, textures, and models of persons.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: capturing a video that depicts a person; identifying a set of skeletal joints of the person depicted in the video; storing a movement vector representing previously captured three-dimensional (3D) movement of the set of skeletal joints of the person depicted in the video; receiving input that selects a 3D avatar; and animating, based on the movement vector, the 3D avatar to mimic the previously captured 3D movement of the set of skeletal joints of the person depicted in the video.

Abstract: There is a method of computing a stylized, animatable representation of a subject from a family of stylized animatable representations. The method comprises: accessing a realistic representation of the subject; computing a mesh mapping using a model that was formed using a data set of training examples which pair realistic representations of other subjects with instances of the family. The method also comprises applying the mesh mapping to the realistic representation of the subject to produce a target mesh; and selecting the stylized animatable representation from the family, by assessing closeness of the target mesh with instances of the family.

Abstract: A method for managing a multi-user animation platform is disclosed. A three-dimensional space within a computer memory is modeled. An avatar of a client is located within the three-dimensional space, the avatar being graphically represented by a three-dimensional figure within the three-dimensional space. The avatar is responsive to client input commands, and the three-dimensional figure includes a graphical representation of client activity. The client input commands are monitored to determine client activity. The graphical representation of client activity is then altered according to an inactivity scheme when client input commands are not detected. Following a predetermined period of client inactivity, the inactivity scheme varies non-repetitively with time.

Abstract: A method of generating an intermediate layer comprises generating local surface properties for a graphics object from parameter image maps, generating a first object image surface layer based on the local surface properties, storing intermediate surface results as an object image layer from the object local surface properties, and rendering a second object image surface layer based on the stored intermediate surface results.

Abstract: A method includes accessing a scene graph defining a spatial relationship of a plurality of first bounding boxes associated with a plurality of virtual objects in a field of view of a user of an artificial reality (AR) device; accessing a second bounding box associated with a first bounding box of the plurality of first bounding boxes; determining, based on the second bounding box, a subregion within a sensing region of a depth sensor; obtaining first depth data within the subregion; generating, based on the first depth data, a three-dimensional model for one or more real objects; determining a visibility of a first virtual object in the AR environment associated with the first bounding box based on the three-dimensional model for the one or more real objects; and generating an output image of an AR environment based on the determined visibility of the first virtual object.

Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that generate a height map for a digital object portrayed in a digital image and further utilizes the height map to generate a shadow for the digital object. Indeed, in one or more embodiments, the disclosed systems generate (e.g., utilizing a neural network) a height map that indicates the pixels heights for pixels of a digital object portrayed in a digital image. The disclosed systems utilize the pixel heights, along with lighting information for the digital image, to determine how the pixels of the digital image project to create a shadow for the digital object. Further, in some implementations, the disclosed systems utilize the determined shadow projections to generate (e.g., utilizing another neural network) a soft shadow for the digital object. Accordingly, in some cases, the disclosed systems modify the digital image to include the shadow.

Abstract: Systems, apparatuses, and methods for preemptively reserving buffer space for primitives and positions in a graphics pipeline are disclosed. A system includes a graphics pipeline frontend with any number of geometry engines coupled to corresponding shader engines. Each geometry engine launches shader wavefronts to execute on a corresponding shader engine. The geometry engine preemptively reserves buffer space for each wavefront prior to the wavefront being launched on the shader engine. When the shader engine executes a wavefront, the shader engine exports primitive and position data to the reserved buffer space. Multiple scan converters will consume the primitive and position data, with each scan converter consuming primitive and position data based on the screen coverage of the scan converter. After consuming the primitive and position data, the scan converters mark the buffer space as freed so that the geometry engine can then allocate the freed buffer space to subsequent shader wavefronts.

Abstract: A computer-based system for generating customized character figures and customized stories. The system utilizes input data and transforms the data to display interactive character figures in an immersive digital form or in a physical form and generates a corresponding story to which the user can relate.

Abstract: Techniques are disclosed relating to object and mesh shaders executed by a graphics processor. In some embodiments, a device includes buffer circuitry and shader circuitry configured to execute graphics programs. Control circuitry may: generate object shader work and mesh shader work for the shader circuitry, receive output information generated by a mesh shader that indicates a number of vertices and primitives to be output by the mesh shader, allocate, based on the output information and after execution of at least a portion of the mesh shader, a region of the buffer circuitry for storage of the vertices to be output by the mesh shader, and store the vertices output by the mesh shader in the allocated region. Disclosed techniques may advantageously provide efficient use of limited buffer resources.

Abstract: Embodiments provide for three-dimensional cloth modeling are provided. A first mesh comprising a plurality of faces defined by a plurality of edges is accessed, and a render mesh is generated using quadrangulated tessellation of the first mesh, where the render mesh comprises quad faces. One or more attributes of the plurality of faces of the first mesh are transferred to one or more of the quad faces of the render mesh using a stochastic transfer operation. The render mesh is displayed via a graphical user interface (GUI).

Abstract: A method of three-dimensional reconstruction of human heads using a single photo in the form of polygonal mesh, with animation and realistic rendering capabilities for novel head poses is provided. The method includes encoding, by using a first convolutional neural network, a single source image into a neural texture; estimating, by a pre-trained detailed expression capture and animation (DECA) system, a face shape, a facial expression, and a head pose by using the single source image and a target image, and providing an initial mesh; providing a predicted mesh of a head mesh based on the initial mesh and the neural texture; rendering a human image by using the predicted mesh.

Abstract: According to one aspect, a system for augmented reality visualization of benign paroxysmal position vertigo (BPPV) disorder. The system includes a camera configured to capture an image sequence, a processing unit configured to generate at least one virtual model of an inner ear, wherein the at least one virtual model of the inner ear comprises an accurate anatomical representation of a real human inner ear; and a display configured to display the at least one virtual model of the inner ear over the image sequence.