Abstract: An interactive device is provided including a user interface arranged to define at least one display request including at least localization and display data, a network interface for transmitting a Web page data request correlated with a display request, a memory to receive the Web page data including mapping and/or object data. The device includes a Web interpreter for displaying a Web page, a three dimensional (“3D”) engine for calculating three-dimensional display data, and a display engine for displaying Web page data in three dimensions. The Web interpreter includes a driver operating in execution cycles for determining a list including at least one operation that may be a request for object and/or mapping data or processing by the 3D engine or the display engine of the received data, the driver executing the operation(s) according to the order of the operations, the number of requests, and the duration of the execution cycle.

Abstract: A three-dimensional shape estimation method includes generating a set of three-dimensional shape data for a flight range of a movable object based on a plurality of first images captured by a movable object, detecting a loss area based on the set of three-dimensional shape data for the flight range, generating a flight route for imaging the loss area, acquiring a plurality of second images that are captured in a horizontal direction toward the loss area with imaging ranges partially overlapped while the movable object moves along the flight route, and generating three-dimensional shape data for the loss area based on the plurality of second images.

Abstract: Systems, methods, and non-transitory computer readable media can obtain a user interface (UI) component of a production system, wherein the UI component is associated with one or more properties. Each of the one or more properties can be mapped to a graphical user interface (GUI) element for display in a user interface of a design application. A value of a property of the one or more properties can be set based on user input from a GUI element associated with the property. A rendering of the UI component can presented in the user interface based on the set value of the property.

Abstract: In a case where operations to a player character are restricted and a virtual camera is controlled according to event data, motion of the user's head, which is detected by an HMD 300, is reflected on the direction of the virtual camera that is set based on the event data. As a result, even in a situation where the user cannot operate the player character as he/she wants, images displayed on the HMD 300 move together with motion of the head. Therefore, it is possible to reduce occurrence of simulator sickness.

Abstract: Methods, systems, and apparatus, including medium-encoded computer program products, for computer aided design of structures include, in one aspect, a method for producing continuous (G2) NURBS surfaces from arbitrary subdivision surface meshes, the method including: obtaining a control mesh of a subdivision surface; obtaining limit surface patches subdivided from the control mesh using at least two levels around any extraordinary regions of the control mesh; discarding discontinuous surface patches, which include a star point; producing replacement surface patches for the discarded patches using adjacent surface patches, wherein the replacement surface patches are curvature continuous with each other and with the adjacent surface patches; combining each of the replacement surface patches with at least one non-discarded surface patch generated from a same polygon of the control mesh as the replacement surface patch; and processing the combined surface patches for output by a physical device.

Abstract: A method for inspecting defects of a machining path is provided. The method includes the following steps. Firstly, a contour mold with a plurality of surface nodes is generated according to a machining program code. Next, a normal vector of each surface node of the contour mold is calculated. Then, a tangent vector of a block of the machining program code corresponding to the normal vector is calculated. Afterwards, an error information is obtained according to a relation between the normal vector and the tangent vector. When the error information is greater than a predetermined value, a defect information is shown on the contour mold.

Abstract: Systems and methods for determining a geographic location of an environment from an image including an annotation on a mobile device without GPS, with no network access, and with no access to peripheral devices or media is described. Open source data indictive of the earth's surface may be obtained and combined into grids or regions. Elevation data may be used to create skyline models at grid points on the surface. An image of an environment may be obtained from a camera on a mobile device. The user of the mobile device may trace a skyline of the environment depicted in the image. The annotation may be used to create reduced regions for edge detection analysis. The edge detection analysis may detect the skyline. The detected skyline may be compared to the skyline models to determine a most likely location of the user.

Abstract: A method for implementing a graphics pipeline. The method includes generating a plurality of bones for an object defining positioning relationships between the bones. The method includes determining a subsystem of bones from the plurality of bones for the object. The method includes determining a foveal region when rendering an image of the virtual scene including the object, wherein the foveal region corresponds to where an attention of a user is directed. The method includes determining that at least one portion of the object is located in a peripheral region for the image. The method includes animating the object by applying a transformation to the subsystem of bones.

Abstract: Scalable volumetric reconstruction is described whereby data from a mobile environment capture device is used to form a 3D model of a real-world environment. In various examples, a hierarchical structure is used to store the 3D model where the structure comprises a root level node, a plurality of interior level nodes and a plurality of leaf nodes, each of the nodes having an associated voxel grid representing a portion of the real world environment, the voxel grids being of finer resolution at the leaf nodes than at the root node. In various examples, parallel processing is used to enable captured data to be integrated into the 3D model and/or to enable images to be rendered from the 3D model. In an example, metadata is computed and stored in the hierarchical structure and used to enable space skipping and/or pruning of the hierarchical structure.

Abstract: An electronic device, an avatar facial expression system, and a controlling method thereof are provided. The electronic device includes a sensor part that is attached in the facial part of a user and detects a facial electromyography signal according to a facial expression, a processor that extracts a feature based on the facial electromyography signal and determines a data value of an avatar's facial movement corresponding to the extracted feature, and a display that controls a facial movement of the avatar based on the data value of the avatar's facial movement and displays a facial expression of the avatar corresponding to the facial expression of the user.

Abstract: A method of deriving one or more medical scene model characteristics for use by one or more software applications is disclosed. The method includes receiving one or more sensor data streams. Each sensor data stream of the one or more sensor data steams includes position information relating to a medical scene. A medical scene model including a three-dimensional representation of a state of the medical scene is dynamically updated based on the one or more sensor data streams. Based on the medical scene model, the one or more medical scene model characteristics are derived.

Abstract: Methods and systems for connection-driven generation of robotic user interfaces and modification of robotic properties include detecting a connection of a robotic peripheral to a robot; obtaining a peripheral property set corresponding to the robotic peripheral, wherein the peripheral property set includes one or more properties of the robotic peripheral; modifying, based on the peripheral property set, a robotic property set that includes one or more properties of the robot to provide a modified robotic property set; generating, during runtime, a robotic graphical user interface (“RGUI”) dynamically based on the peripheral property set, wherein the RGUI provides at least one user-accessible interface to control the robot and the robotic peripheral; and controlling, based on the modified robotic property set, the robot and the robotic peripheral in response to user input received via the RGUI.

Abstract: A method comprising computing a plurality of curved, wherein the curved lines correspond to a boundary of a graphical shape, computing buffers, and subdividing the curved lines to form a plurality of monotonic curved lines, computing a polygon for each curved line, wherein each polygon covers a line segment, calculating a signed distance for each pixel between the pixel and a point on the line segment extending across the relevant polygon that is closest to the pixel, reading from the buffer a stored signed distance for the relevant pixel and if the signed distance is less than the stored signed distance, writing the signed distance to the distance buffer, using the one or more signed distances to calculate one or more blending factors and using the one or more blending factors to blend the polygon thereby rendering the graphical shape.

Abstract: The disclosure notably relates to a computer-implemented method for extracting a feature tree from a mesh. The method includes providing a mesh, computing a geometric and adjacency graph of the provided mesh, wherein each node of the graph represents one region of the mesh and comprises a primitive type and parameters of the region, each connection between two nodes is an intersection between the respective surfaces of the regions represented by the two connected nodes. The method also includes instantiating for each node of the graph, a surface based on the identified primitive type and parameters of the region.

Abstract: Systems and techniques for processing and/or transmitting three-dimensional (3D) data are presented. A partitioning component receives captured 3D data associated with a 3D model of an interior environment and partitions the captured 3D data into at least one data chunk associated with at least a first level of detail and a second level of detail. A data component stores 3D data including at least the first level of detail and the second level of detail for the at least one data chunk. An output component transmits a portion of data from the at least one data chunk that is associated with the first level of detail or the second level of detail to a remote client device based on information associated with the first level of detail and the second level of detail.

Abstract: In one implementation, a method of generating a three-dimensional object is performed by a device including one or more processors, non-transitory memory, one or more input devices, and a display. The method includes detecting a first set of one or more user inputs indicative of a two-dimensional profile and detecting a second set of one or more user inputs indicative of a two-dimensional floor plan. The method includes generating, based on the two-dimensional profile and the two-dimensional floor plan, a three-dimensional object and displaying the three-dimensional object.

Abstract: Systems and methods are provided for receiving an image from a camera of a mobile device, analyzing the image to determine a subject of the image, segmenting the subject of the image to generate a mask indicating an area of the image comprising the subject of the image, applying a bokeh effect to a background region of the image to generate a processed background region, generating an output image comprising the subject of the image and the processed background region, and causing the generated output image to display on a display of the mobile device.

Abstract: One example of a method includes receiving a three-dimensional (3D) mesh model of an object having a first mesh density. The method includes receiving a model selection for rebuilding the (3D) mesh model of the object. The method includes rebuilding the (3D) mesh model of the object based on the model selection to provide a simplified (3D) mesh model of the object having a second mesh density less than the first mesh density.

Abstract: Determining GPS coordinates of some image point(s) positions in at least two images using a processor configured by program instructions. Receiving position information of some of the positions where an image capture device captured an image. Determining geometry by triangulating various registration objects in the images. Determining GPS coordinates of the image point(s) positions in at least one of the images. Saving GPS coordinates to memory. This system and method may be used to determine GPS coordinates of objects in an image.

Abstract: An end-user system in accordance with the present disclosure includes a communication device configured to communicate with a server, a display screen, one or more processors, and at least one memory storing instructions which, when executed by the processor(s), cause the end-user system to access a physical world geographical location from a user, access two-dimensional physical world map data for a region surrounding the physical world geographical location, render for display on the display screen a three-dimensional mirrored world portion based on the two-dimensional physical world map data and render an avatar at a mirrored world location corresponding to the physical world geographical location, access geotagged social media posts which have geotags in the region and which the user is permitted to view, and render the geotagged social media posts as three-dimensional objects in the mirrored world portion.

Abstract: In one aspect, a method for establishing a smooth geometric model based on data of a medical image includes: inputting or reading the data of the medical image; establishing a three-dimensional medical image voxel model based on the data of the medical image; smoothing the three-dimensional medical image voxel model; and establishing a three-dimensional voxel phantom tissue model based on the smoothed three-dimensional medical image voxel model. In another aspect, a method for establishing a smooth geometric model based on data of a medical image includes: inputting or reading the data of the medical image; establishing a three-dimensional voxel phantom tissue model based on the data of the medical image; and smoothing the three-dimensional voxel phantom tissue model.

Abstract: Techniques for generating and using digital markups on digital images are presented. In an embodiment, a method comprises receiving, at an electronic device, a digital layout image that represents a form of a product for manufacturing a reference product; generating a digital markup layout by overlaying the digital markup image over the digital layout image; based on the digital markup layout, generating one or more manufacturing files comprising digital data for manufacturing the reference product; receiving a digital reference image of the reference product manufactured based on the one or more manufacturing files; identifying one or more found markup regions in the digital reference image; based on the found markup regions, generating a geometry map and an interactive asset image; based on, at least in part, the geometry map, generating a customized product image by applying a user pattern to the interactive asset image.

Abstract: The technical result obtained herein is providing the ability to display an output image having the actual texture of the photo or video image, simplifying the implementation by eliminating the need to store a database of reference textures of objects, enabling texturizing of a 3D model areas invisible on the 2D object. A feature-based ORB-SLAM algorithm can be used for image processing using sparse point cloud. An advantageous solution is provided that allows to improve the efficiency of the texturizing process and therefore allows to use the ORB-SLAM algorithm on mobile devices by reducing computational intensity of the overall process. In order to achieve these advantages, a system of preliminary image processing is implemented. Said preliminary image processing allows to identify the most promising areas for detecting object features on the images coming from the camera.

Abstract: The techniques disclosed herein improve the efficiency of a system by providing intelligent management of content that is associated with objects displayed within communication sessions. The participants can generate a content object associated with a 3D object. The content object may be in the form of 3D virtual object such as an arrow pointing to the table, a text box of an annotation, etc. The content object may also include functional features that collect and display information voting agent. The system can generate a data structure that associates the object with the content object. The data structure enables a system to maintain an association between the object and the content object when various operations are applied to either object. Thus, if a remote computer sends a request for the content object, the associated object is delivered with the content object.

Abstract: Provided are a design assistance device, a design assistance system, a server, and a design assistance method that can display shapes and specification information of a plurality of items included in an item group so that a user can easily view the items. The design assistance device includes: a three-dimensional data acquisition unit that acquires three-dimensional data of an item group including a plurality of items; a display data generation unit that generates two-dimensional display data including a two-dimensional display representing an appearance of the item group and specification information of at least one of the items in one observation direction in the three-dimensional data; and a display mode determination unit that determines a display mode of the specification information in the two-dimensional display based on a shape of each of the items as well as relative positions and relative orientations between the items as viewed in the one observation direction.

Abstract: The present invention relates to tomosynthesis. In order to further facilitate and improve the generation of three-dimensional image data, an X-ray imaging system (10) for calibration-free tomosynthesis is provided. The system comprises an imaging arrangement (12) with an X-ray detector unit (14) and an X-ray unit (16) comprising a plurality of X-ray sources (18). The system also comprises an image processing unit (20), an object receiving space (22), and a moving unit (24) for providing a relative movement between the imaging arrangement and an object of interest arranged at least partially in the object receiving space. The X-ray sources are provided in a known spatial relationship; the X-ray detector unit and the X-ray unit are also provided in a known spatial detector-sources-relationship. The moving unit provides a relative movement between the object of interest and the imaging arrangement in order to provide a plurality of system-to-object positions.

Abstract: A virtual fabrication environment for semiconductor device structures that includes the use of virtual metrology measurement data to optimize a virtual fabrication sequence is described. Further, calibration of the virtual fabrication environment is performed by comparing virtual metrology data generated from a virtual fabrication run with a subset of measurements performed in a physical fabrication environment. Additionally, virtual experiments conducted in the virtual fabrication environment of the present invention generate multiple device structure models using ranges of process and design parameter variations for an integrated process flow and design space of interest.

Abstract: A system includes one or more memory devices storing instructions, and one or more processors configured to execute the instructions to perform steps of a method for providing an interactive virtual environment. The system may receive environmental data, and augment the environmental data by adding virtual environmental data. The system may then provide this virtual environment to two or more devices. The system can then receive user input, and modify the virtual environment in response to those inputs.

Abstract: Various embodiments enable curves to be drawn around 3-D objects by intelligently determining or inferring how the curve flows in the space around the outside of the 3-D object. The various embodiments enable such curves to be drawn without having to constantly rotate the 3-D object. In at least some embodiments, curve flow is inferred by employing a vertex position discovery process, a path discovery process, and a final curve construction process.

Abstract: Systems and methods are disclosed for directed image capture of a subject of interest, such as a home. Directed image capture can produce higher quality images such as more centrally located within a display and/or viewfinder of an image capture device, higher quality images have greater value for subsequent uses of captured images such as for information extraction or model reconstruction. Graphical guide(s) facilitate content placement for certain positions and quality assessments for the content of interest can be calculated such as for pixel distance of the content of interest to a centroid of the display or viewfinder, or the effect of obscuring objects. Quality assessments can further include instructions for improving the quality of the image capture for the content of interest.

Abstract: Systems and methods are disclosed for partitioning an animatable model. The system may include a non-transitory computer-readable medium operatively coupled to processors. The non-transitory computer-readable medium may store instructions that, when executed, cause the processors to perform a number of operations. One operation may include obtaining an animatable model. The animatable model may include a geometry matrix. Another operation may include obtaining user input to partition an animatable model into multiple partitions. The user input may include a connected curve in the geometry matrix. Yet another operation may include partitioning the animatable model into the multiple partitions based on the user input. Individual ones of the multiple partitions may include a partition geometry matrix and a corresponding partition animatable model.

Abstract: An optical imaging and processing system includes an optical connection and an optical element disposed at a first end of the optical connection. The first end of the optical connection is configured to extend into a turbine component interior such that the optical element is disposed within the turbine component interior. The system also includes a photodiode array disposed at a second end of the optical connection, where the optical element is configured to transmit a video stream of the turbine component interior to the photodiode array as the optical element is moved within the turbine component interior between multiple vantage points. The system also includes a processor coupled to the photodiode array, wherein the processor is configured to process the video stream to generate a three-dimensional model of at least a portion of the turbine component interior without utilizing a previously defined three-dimensional model input of the turbine component interior.

Abstract: Apparatus and method for ray tracing acceleration using a grid primitive.

Abstract: A haptic device includes a display configured to display an image, a haptic output device configured to generate a haptic effect to a user when the user interacts with the display, and a processor configured to receive information related to the image displayed on the display. The processor is also configured to create a friction based haptic effect map associated with the image displayed on the display, and generate a signal to the haptic output device to output the haptic effect when the user interacts with the display when the image is displayed on the display, the haptic effect being configured to simulate a feel of the image in three dimensions.

Abstract: High definition, color images, animations, and videos for diagnostic and personal imaging applications are described along with methods, devices and systems for creating the images, as well as applications for using the images, animations and videos.

Abstract: Disclosed herein is a method for receiving point cloud data, including receiving a bitstream containing the point cloud data, and decoding the point cloud data. Disclosed herein is a method for transmitting point cloud data, including encoding the point cloud data, and transmitting a bitstream containing the point cloud data.

Abstract: Methods, apparatuses, media, and devices for generating multi-angle free-perspective video data are provided. The method for generating multi-angle free-perspective video data includes: acquiring multiple frame-synchronized videos, wherein shooting angles of the multiple frame-synchronized videos are different; parsing a respective video of the multiple frame-synchronized videos to obtain an image combination at a respective frame moment of multiple frame moments, wherein the image combination includes multiple frame-synchronized frame images; determining depth data of a respective frame image in the image combination based on the image combination at the respective frame moment; and generating a stitched image corresponding to the respective frame moment, wherein the stitched image includes a first field storing pixel data of the respective frame image in the image combination, and a second field storing the depth data of the respective frame image in the image combination.

Abstract: A multi-view interactive digital media representation (MVIDMR) of an object can be generated from live images of an object captured from a camera. Selectable tags can be placed at locations on the object in the MVIDMR. When the selectable tags are selected, media content can be output which shows details of the object at location where the selectable tag is placed. A machine learning algorithm can be used to automatically recognize landmarks on the object in the frames of the MVIDMR and a structure from motion calculation can be used to determine 3-D positions associated with the landmarks. A 3-D skeleton associated with the object can be assembled from the 3-D positions and projected into the frames associated with the MVIDMR. The 3-D skeleton can be used to determine the selectable tag locations in the frames of the MVIDMR of the object.

Abstract: A mobile robotic device receives point cloud data corresponding to an internal space of a facility and processes the data to generate a map of the facility that enables the mobile robotic device to move within the internal space. The processing of the point cloud data includes segmentation of the data into planar primitives that are identified as ceiling, floor, or wall primitives. Openings in the wall primitives are identified as doors or occlusions. Viewpoints for the processed planar primitives are generated and a complex cell data structure is generated with vertices representing faces of the structure and edges representing walls. After an energy minimization of the complex cell structure is performed, adjacent regions of space are evaluated for merger and a map of the internal space is generated. The mobile robotic device moves through the internal space of the facility with reference to the map.

Abstract: According to one embodiment, a plurality of spatial publishing objects (SPOs) is provided in a multidimensional space in a user interface. Each of the plurality of spatial publishing objects is associated with digital media data from at least one digital media source. The user interface has a field for the digital media data. A user is provided via the user interface with a user presence that is optionally capable of being represented in the user interface relative to the plurality of spatial publishing objects. The digital media data associated with the at least one spatial publishing object are combined to generate a media output corresponding to the combined digital media data.

Abstract: A computer-implemented method and system for modeling an outer surface, such as skin. The method includes, under the control of one or more computer systems configured with executable instructions, defining a plurality of microstructures such as microstructures to be displayed in microstructure locations on a geometric model of a character or inanimate object, and generating a volumetric mesh including the plurality of microstructures. The volumetric mesh is configured to be applied to the geometric model as an outer surface (e.g., skin) covering the geometric model.

Abstract: A graphics processor that rasterises input primitives to generate graphics fragments to be processed and renders the graphics fragments to generate a first, higher resolution version of a render output. When processing of a render output is stopped before the render output is finished, the first resolution version of the render output is downsampled to a second, lower resolution and the downsampled data elements at the second resolution are written out together with a set of difference values indicative of the differences between the data elements at the first resolution and the downsampled data elements at the second resolution. Then, when processing of the render output is resumed, these values can be loaded in and used to reconstruct the array of data elements at the first resolution for use when continuing processing of the render output.

Abstract: A method for the additive manufacturing of a receptacle for storing and/or transporting a product includes three-dimensionally capturing the external form of the product, compiling a computer-readable data set with information about the captured external form of the product, and additively manufacturing the receptacle. In a computer-controlled manner on the basis of the compiled data set, a modelling material is deposited in layers, liquefied and cured. The receptacle is formed having an internal structure which surrounds a receiving chamber that is adapted to the external form of the product.

Abstract: A method for creating a digital 3D representation of a physical object, the physical object comprising an object surface; wherein the method comprises: obtaining input data, the input data including a plurality of captured images of the physical object and surface normal information of the object, the captured images being captured by an image capturing device, the surface normal information representing object surface normals associated with respective parts of the object surface; creating a digital 3D representation of the object surface; wherein creating the digital 3D representation is based on at least the obtained plurality of captured images and the obtained surface normal information.

Abstract: This invention provides a method, system, and computer program to visualize texture (crystal orientation distribution) heterogeneity in polycrystalline aggregate part in large length scale. This is a critical representation step for microstructure characterization, useful in effective behavior simulation, risk analysis and hotspot identification. In contrast to orientation image map where each color component represents a crystal orientation, each color in this macrotexture map represents a set of texture. Different color represent different texture and similar texture shall have similar color. This method will provide a critical tool in evaluating texture heterogeneity of components, leading to a first-hand understanding of property heterogeneity and anisotropy. For an experienced user, these maps serve the same purpose in identifying high risk locations in the investigated component as medical imaging maps do for diagnosis purpose.

Abstract: A three-dimensional data generating apparatus includes an input curve receiving unit configured to receive input of a curve indicating a relationship between a height and a distance from an outline of a target area to each position within the target area, a three-dimensional shape of the target area being generated from a two-dimensional image; and a three-dimensional data generating unit configured to calculate the height at each of the positions within the target area in accordance with the distance, the distance being calculated from a point on the outline to a corresponding position of the positions, and to generate data representing the three-dimensional shape of the target area based on the calculated height.

Abstract: A virtual fabrication environment for semiconductor device structures that includes the use of virtual metrology measurement data to optimize a virtual fabrication sequence is described. Further, calibration of the virtual fabrication environment is performed by comparing virtual metrology data generated from a virtual fabrication run with a subset of measurements performed in a physical fabrication environment. Additionally, virtual experiments conducted in the virtual fabrication environment of the present invention generate multiple device structure models using ranges of process and design parameter variations for an integrated process flow and design space of interest.

Abstract: A method of performing adaptive shading of image frames by a graphics processing unit (GPU) includes determining, by the GPU, a first shading rate based on determining that a change in a plurality of underlying assets between a first image frame and a second image frame is above a first threshold; determining, by the GPU, a second shading rate based on determining that one or more viewports in the second image frame is similar to one or more viewports in the first image frame; determining, by the GPU, a third shading rate based on determining that a quality reduction filter is used; and selecting, by the GPU, a shading rate from among the first shading rate, the second shading rate, and the third shading rate for the first image frame.

Abstract: In various examples there is a computer-implemented method for forming an optimized three-dimensional model for a three-dimensional graphics image. The method comprises: obtaining the three-dimensional graphics image, the three-dimensional graphics image represented as at least one polygon mesh having a plurality of vertices connected by edges. The method selects one or more of the vertices to be removed by collapse decimation operation, the selection based on an amount of change in the polygon mesh introduced as a result of the decimation operation. The amount of change is computed using information about intersections where two different faces of the polygon mesh pass through one another.

Abstract: A method for processing data, a server and a computer storage medium are provided. The method includes: three-Dimensional (3D) video data is received from a terminal, and an initial model is established based on the 3D video data; the initial model is matched with models in a preset model set, here, the preset model set includes overall models of multiple target objects; and indication information is sent to the terminal based on a matching result.