Abstract: Systems and methods are described for replacing a background portion of an image. An illustrative method includes receiving a first image, identifying a background portion of the first image and a subject portion of the first image, retrieving metadata associated with the first image, determining, based on the metadata, a geographic location where the first image was captured, retrieving a plurality of other images captured at the geographic location, selecting a second image from the plurality of other images, wherein the second image is associated with metadata indicating that the second image was captured during a predetermined time period, and generating for display a third image comprising the subject portion of the first image placed over the second image.

Abstract: A network storage service is disclosed that is configured to provide functionality for enabling individual chunks of an object to be downloaded from the storage service while other chunks of the same object are being uploaded to the storage service. The storage service maintains status data for uploads of storage objects identifying chunks that have completed uploading, chunks that are currently uploading, and chunks that are pending upload. The storage service exposes the status data to client computing devices such as, for instance, via a network services application programming interface. The client computing devices can utilize the status data to download chunks of an object as soon as the chunks have been completely uploaded to the storage service. The storage service can be accessed by way of a content distribution network point of presence in some configurations.

Abstract: The present disclosure is directed toward systems and methods for generating and providing an augmented reality overlay for display in connection with an augmented reality display device. For example, systems and methods described herein identify a user being viewed through an augmented reality display device, and builds an augmented reality overlay for the user that is displayed on a view of the user through the augmented reality display device. Systems and methods described herein build the augmented reality overlay based on the location of the augmented reality display device, and on other networking system information including a networking system relationship between the user wearing the augmented reality display device and the user who is being looked at through the augmented reality display device.

Abstract: Systems and methods are disclosed for creating an interactive tool for determining and displaying a functional relationship between a vascular network and an associated perfused tissue. One method includes receiving a patient-specific vascular model of a patient's anatomy, including at least one vessel of the patient; receiving a patient-specific tissue model, including a tissue region associated with the at least one vessel of the patient; receiving a selected area of the vascular model or a selected area of the tissue model; and generating a display of a region of the tissue model corresponding to the selected area of the vascular model or a display of a portion of the vascular model corresponding to the selected area of the tissue model, respectively.

Abstract: In augmented reality self-guided tour, different augmented reality views are received in a mobile computing device. One of the views presents a holographic animation of a tourable three-dimensional structure with multiple activatable points of interest disposed thereon. A geographic location of the device relative to the structure is determined and a camera of the device retrieves an image of a surrounding portion of the environment so as to compute a position in the image at which to render the animation. The animation is then projected in the display at the computed position. Upon selecting an activatable point of interest, it is determined if the geographic location matches that of the selected point of interest. If so, a different animation associated with the selected point of interest is projected in the display at the computed position.

Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for generating a three-dimensional scene based on a natural language phrase. For example, the disclosed system can analyze a natural language phrase to determine dependencies involving entities and commands in the natural language phrase. The disclosed system can then use the dependencies to generate an entity-command representation of the natural language phrase. Additionally, the disclosed system can generate a semantic scene graph for the natural language phrase from the entity-command representation to indicate contextual relationships of the entities and commands. Furthermore, the disclosed system generates the requested three-dimensional scene by using at least one scene of a plurality of available three-dimensional scenes identified using the semantic scene graph of the natural language phrase.

Abstract: A technology which enables identifying, via a computer, a vessel in a third image. The third image is obtained from a subtraction of a second image from a first image. The second image and the first image are aligned within an imaging space. The first image is post-contrast. The second image is pre-contrast. The technology enables determining, via the computer, a voxel intensity mean value of a segment of the vessel in the third image. The technology enables obtaining, via the computer, a fourth image from a division of the third image by the voxel intensity mean value. The technology enables applying, via the computer, a filter onto the fourth image. The technology enables generating, via the computer, a filter mask based on the fourth image.

Abstract: Systems and methods for conveying virtual content in an augmented reality environment comprising images of virtual content superimposed over physical objects and/or physical surroundings visible within a field of view of a user as if the images of the virtual content were present in the real world. Exemplary implementations may: obtain user information for a user associated with a presentation device physically present at a location of the system; compare the user information with the accessibility criteria for the virtual content to determine whether any portions of the virtual content are to be presented to the user based on the accessibility criteria and the user information for the user; and facilitate presentation of the virtual content to the user via presentation device of user based on the virtual content information, the field of view, and the correlations between the multiple linkage points and the reference frame of the virtual content.

Abstract: An imaging (e.g., with an optical coherence tomography system) method that includes 1) acquiring repeated B-scans in a manner consistent with forming images, 2) processing the acquired images according to a variable interscan time analysis (VISTA) method, and 3) generating and displaying a color-mapped image pixel color of the color-mapped image fluid flow speed, or a related quantity.

Abstract: A graphics processing pipeline (30) includes a programmable fragment shader (40) that is operable to, in response to a “test” instruction included in a fragment shader program that it is executing, trigger, if appropriate, the performance of an alpha-to-coverage operation (41), a late stencil test (42), and a late depth test (43) for a fragment being processed, and to then return updated coverage information to the fragment shader (40). This allows alpha-to-coverage and late stencil and depth test operations to be triggered and performed during shader execution, rather than having to wait until shader execution has been completed before performing those operations.

Abstract: Embodiments are described to perform an operation comprising determining a position of an augmented reality and/or virtual reality (AR/VR)-capable device relative to a position of a tracking point, determining a first arrangement of a first plurality of graphical user interface (GUI) elements associated with an application based on the position of the AR-capable device relative to the tracking point, and generating, by operation of a processor, a GUI comprising the first plurality of GUI elements arranged according to the first arrangement within a volume of a cylinder.

Abstract: In one embodiment, a method includes detecting one or more objects in an image, generating at least one mask for each of the detected objects, wherein each of the masks is defined by a perimeter, classifying the detected objects, receiving gesture input in relation to the image, determining whether one or more locations associated with the gesture input correlate with any of the masks, and providing feedback regarding the image in response to the gesture input. Each of the masks may include data identifying the corresponding detected object, and the perimeter of each mask may correspond to a perimeter of the corresponding detected object. The perimeter of the corresponding detected object may separate the detected object from one or more portions of the image that are distinct from the detected object.

Abstract: A network device includes a plurality of ports; a switch configured to switch data frames between the plurality of ports; and a processor configured to obtain one or more measurement values based on network traffic associated with the data frames, responsive to detection of a threshold-crossing event of a measurement value, wherein the threshold-crossing event is one of an indication and a precursor of one or more of an abnormal and unexpected event associated with the network traffic, cause collection of a plurality of time series of measurement values of the network traffic by one or more components in the network device, and send a combination of the plurality of time series as a telemetric data stream for analysis by a network management system related to the abnormal/unexpected event.

Abstract: Systems and methods for conveying virtual content in an augmented reality environment comprising images of virtual content superimposed over physical objects and/or physical surroundings visible within a field of view of a user as if the images of the virtual content were present in the real world. Exemplary implementations may: obtain user information for a user associated with a presentation device physically present at a location of the system; compare the user information with the accessibility criteria for the virtual content to determine whether any portions of the virtual content are to be presented to the user based on the accessibility criteria and the user information for the user; and facilitate presentation of the virtual content to the user via presentation device of user based on the virtual content information, the field of view, and the correlations between the multiple linkage points and the reference frame of the virtual content.

Abstract: A robot system includes a robotic arm having an end effector configured to perform a work to a work object, a memory part storing information that causes the end effector to move as scheduled route information, a motion controller configured to operate the robotic arm by using the scheduled route information to move the end effector, a route correcting device configured to generate, by being manipulated, manipulating information to correct a route of the end effector during movement, a camera configured to image the work object, an image generator configured to generate a synthesized image by synthesizing a scheduled route of the end effector obtained from the scheduled route information with a captured image sent from the camera, and a monitor configured to display the synthesized image.

Abstract: Systems and methods are disclosed that may be implemented to indicate real time availability of individual key assemblies for user input to an information handling system. In one embodiment, the disclosed systems and methods may be implemented to retract an individual key assembly of a user input device (e.g., such as keyboard matrix, game controller, game pad, computer mouse, etc.) when the key assembly is, or becomes, unavailable for input to a user application (e.g., such as a computer game) that is executing on a host programmable integrated circuit (e.g., such as host CPU) of an information handling system. Such a retracted key assembly may then be extended when it becomes available for input to the user application.

Abstract: An exemplary virtual reality media provider system receives two-dimensional (“2D”) video data for surfaces of first and second objects located in a natural setting. The 2D video data is captured by first and second capture devices disposed at different positions with respect to the objects. The system distinguishes the first object from the second object by performing a plurality of techniques in combination with one another. The plurality of techniques include determining that the first object is moving in relation to the second object; and determining that, from a vantage point of at least one of the different positions, a representation of the first object captured within the 2D video data does not overlap with a representation of the second object. Based on the received 2D video data and the distinguishing of the first and second objects, the system generates an individually-manipulable volumetric model of the first object.

Abstract: A device for determining the surface topology and associated color of a structure, such as a teeth segment, includes a scanner for providing depth data for points along a two-dimensional array substantially orthogonal to the depth direction, and an image acquisition means for providing color data for each of the points of the array, while the spatial disposition of the device with respect to the structure is maintained substantially unchanged. A processor combines the color data and depth data for each point in the array, thereby providing a three-dimensional color virtual model of the surface of the structure. A corresponding method for determining the surface topology and associate color of a structure is also provided.

Abstract: Image quality degradation of an output image can be reduced. A control unit includes a correction intensity determination unit that determines a first magnification for reducing a reduction region including a subject and a second magnification for enlarging an enlargement region and an image correction unit that corrects an input image by using the first magnification and the second magnification. The correction intensity determination unit determines the first magnification based on the second magnification and the widths of a first region and a second region in the input image.

Abstract: A virtual reality or mixed reality system configured to preform object detection using a monocular camera. The system configured to make the user aware of the detected objects by showing edges or lines of the object within a virtual scene. Thus, the user the user is able to avoid injury or collision while immersed in the virtual scene. In some cases, the system may also detect and correct for drift in the six degree of freedom pose of the user using corrections based on the current motion of the users.

Abstract: One embodiment provides for a general-purpose graphics processor comprising a hardware graphics rendering pipeline configured to perform multisample anti-aliasing, the hardware graphics rendering pipeline including a pixel processing unit configured to generate pixel color data in a graphics processing pipeline, the pixel processing unit to output color data to a multisample render target, the multisample render target to store multiple sample locations for each pixel in a set of pixels. The general-purpose graphics processor further comprises a memory allocator to allocate memory to store color data associated with the multisample render target, the memory allocator to merge a memory allocation for multiple pixels having a sample associated with a same color value.

Abstract: A method, system and computer program product for visualizing analysis results of contents. Contents collected from various kinds of communication tools are read into memory. The contents are analyzed to obtain analysis results, where the analysis results include information on user groups, information on topics and degrees of involvement of users with the topic. Furthermore, user objects assigned according to the degree of involvement are dynamically displayed for a designated period of time and for each topic using the analysis results, where the displaying of each of the user objects is modified according to the degree of involvement and the information on a user group. A communication volume object which represents a communication volume between users may be further displayed between the user objects associated with these users and displayed so as to be different depending on the communication volume.

Abstract: A method and system provide the ability to modify a three-dimensional (3D) model. The 3D model is obtained and arbitrary faces of the model are selected. Shape modification operations to be performed are prescribed. A deformation lattice is constructed by setting up a lattice structure with control points. A space of the 3D model is mapped to a space of the lattice structure. The deformation lattice is evaluated by deforming the lattice using a selected set of control points. The evaluated deformed model is then output.

Abstract: Techniques are presented for constructing a digital representation of a physical environment. In some embodiments, a method includes obtaining image data indicative of the physical environment; receiving gesture input data from a user corresponding to at least one location in the physical environment, based on the obtained image data; detecting at least one discontinuity in the physical environment near the at least one location corresponding to the received gesture input data; and generating a digital surface corresponding to a surface in the physical environment, based on the received gesture input data and the at least one discontinuity.

Abstract: A drawing apparatus includes a drawing head drawing a pattern on the surface of a target nail of a hand or foot; and a processor. The processor controls the drawing head to scan a plurality of times across an area on the surface of the nail and to draw the pattern on the area during each of the plurality of scanning operations of the drawing head based on a curvature of the nail.

Abstract: An image processing apparatus and method are provided. The image processing method may generate a mask for preventing a virtual light source from being sampled on an area of a current image frame based on virtual light source information of a previous image frame, applying the mask to the current image frame, sampling the virtual light source in the current image frame to which the mask is applied, and rendering the current image frame based on the virtual light source sampled in the current image frame.

Abstract: A technique for generating virtual models of plants in a field is described. Generally, this includes recording images of plants in-situ; generating point clouds from the images; generating skeleton segments from the point cloud; classifying a subset of skeleton segments as unique plant features using the images; and growing plant skeletons from skeleton segments classified as unique plant feature. The technique may be used to generate a virtual model of a single, real plant, a portion of a real plant field, and/or the entirety of the real plant field. The virtual model can be analyzed to determine or estimate a variety of individual plant or plant population parameters, which in turn can be used to identify potential treatments or thinning practices, or predict future values for yield, plant uniformity, or any other parameter can be determined from the projected results based on the virtual model.

Abstract: A spatial indexing system receives a sequence of images depicting an environment, such as a floor of a construction site, and performs a spatial indexing process to automatically identify the spatial locations at which each of the images were captured. The spatial indexing system also generates an immersive model of the environment and provides a visualization interface that allows a user to view each of the images at its corresponding location within the model.

Abstract: According to one embodiment, an information processing device includes a camera and a processing circuit. The camera takes first distance images of an object for a plurality of angles. The processing circuit generates a three-dimensional model of the object based on the first distance image, and generates an extracted image indicating a specific region of the object corresponding to the plurality of angles based on the three-dimensional model.

Abstract: Techniques and devices for access to high frame-rate radar data via a circular buffer are described. In some implementations, a radar sensor collects radar data regarding objects detected by a radar field and stores the data to a circular buffer. A data manager monitors the circular buffer and processes data requests from multiple applications. Through use of the described techniques and devices, the multiple applications can efficiently access the requested radar frame data from the circular buffer, reducing both memory requirements and processor resource usage associated with providing the requested data.

Abstract: A system and a method on an integrated circuit are provided herein. The system may include: a plurality of defined data processing dedicated areas to perform computational functions relating to a corresponding plurality of natural user interface features, to obtain the plurality of user interface features based on scene features detected by a plurality of sensors within a defined period of time; a central processing unit configured to carry out software instructions to support the computational functions of the dedicated areas; and at least one defined area for synchronized data management, to receive signals corresponding to detected scene features from the plurality of sensors and to route the signals to suitable dedicated areas of the plurality of dedicated areas to provide real-time acquiring of user interface features.

Abstract: Methods and devices for generating reference data for adjusting a digital representation of a head region, and methods and devices for adjusting the digital representation of a head region are disclosed. In some arrangements, training data are received. A first machine learning algorithm generates first reference data using the training data. A second machine learning algorithm generates second reference data using the same training data and the first reference data generated by the first machine learning algorithm.

Abstract: Embodiments of the present disclosure provide a method and a device for processing a video, an electronic device and a storage medium. The method includes: performing target recognition on each frame in an input video to obtain M frames containing a first face image, in which M is an integer greater than 1; replacing the first face image in the M frames with a target face image to obtain M first output frames; performing feature point locating on the first face image in a first frame in the M frames to obtain a first feature point set; extracting a target feature point set corresponding to a target region from the first feature point set; and performing image synthesis according to the target feature point set and the M first output frames to obtain M second output frames.

Abstract: Techniques to facilitate communication between users in an industrial application associated with an industrial automation environment are disclosed herein. In at least one implementation, a graphical user interface (GUI) associated with the industrial application is displayed on a display system of the computing system. The computing system engages in a peer-to-peer communication session with a remote computing system, wherein the peer-to-peer communication session is displayed within the GUI of the industrial application. Industrial data associated with the industrial application is displayed within the peer-to-peer communication session.

Abstract: A method and system generate an inferential network. Records of searches of a network of linked nodes are stored. Each of the nodes is connected to another one of the nodes by a link. Further, each of the records includes: 1) search terms used in a corresponding search; and 2) results of the corresponding search. The results correspond to nodes of the network. The stored records are analyzed to infer relationships between pairs of nodes of the network. Each of the relationships is inferred from the behavior of one of the nodes of a pair of nodes relative to the other node of the pair of nodes. Inferential nodes corresponding to the nodes of the pairs of nodes are generated, and inferential links between the inferential nodes are generated. The inferential links correspond to the inferred relationships.

Abstract: A system and method providing semi-private conversation using an area microphone between one local user in a group of local users and a remote user. The local and remote users may be in different physical environments, using devices coupled by a network. A conversational relationship is defined between a local user and a remote user. The local user's voice is isolated from other voices in the environment, and transmitted to the remote user. Directional output technology may be used to direct the local user's utterances to the remote user in the remote environment.

Abstract: A multi-layer display may include a first screen and a second screen arranged in a substantially parallel manner, with the first screen and the second screen including an array of pixels and the second screen overlapping the first screen, a light configured to provide light to the first screen and the second screen of the multi-layer display system, and a processing system comprising at least one processor and memory. The processing system may be configured to apply perspective distortion to automatically bake the desired aspects of perspective into a physically thin object. To achieve this, the object's vertices are moved along lines drawn through a fixed point in space (a primary viewpoint). From this viewpoint, regardless of any perspective distortion applied, the object will appear to not change.

Abstract: In graphics processing data is received representing one or more vertices for a scene in a virtual space. A projection of the vertices onto a screen space of a display device is performed. A density of the vertices is adjusted for selected portions of the screen space, such that a lower density of vertices is present in selected portions of the screen space. Primitive assembly is performed on the vertices to generate a one or more primitives in screen space from the projection of the vertices onto the screen space. A finished frame is then generated by performing pixel processing to assign pixel values to the pixel or pixels that are part of the corresponding primitives. In some implementations, the finished frame can be stored in the memory or displayed on the display device.

Abstract: Participants can compete in a physical environment, such as by piloting a car around a track. The competition is recorded in a video. Participants can interact physically with each other and with the race environment, such as by steering into one another and navigating the race environment. Participants can also interact virtually, such as “shooting” one another with digitally rendered weapons. Both real and virtual interactions affect the outcome of the competition. The video is programmatically altered to show special effects and is programmatically edited to select physical and virtual interactions, changes, which had the largest effect on the outcome of the competition. The programmatically altered video may be played back during game play and the programmatically edited video may be played back after the competition.

Abstract: There is provided a display controlling apparatus which comprises: an obtaining unit configured to obtain virtual camera path information related to a movement path of a virtual viewpoint related to a virtual viewpoint video image generated based on a plurality of shot images obtained by shooting a shooting target area with a plurality of cameras; a generating unit configured to generate a virtual camera path image representing the plurality of movement paths including first and second movement paths of the virtual viewpoint, based on the virtual camera path information obtained by the obtaining unit; and a display controlling unit configured to display the virtual camera path image generated by the generating unit, on a display screen.

Abstract: In various embodiments, a Data Processing System for Generating Interactive User Interfaces and Interactive Game Systems Based on Spatiotemporal Analysis of Video Content may be configured to: (1) enable a user to select one or more players participating in a substantially live (e.g., live) sporting or other event; (2) determine scoring data for each of the one or more selected players during the sporting or other event; (3) track the determined scoring data; (4) generate a custom (e.g., to the user) user interface that includes the scoring data; and (5) display the custom user interface over at least a portion of a display screen (e.g., on a mobile computing device) displaying one or more video feeds of the sporting or other event. In this way, the system may be configured to convert a video feed of a sporting event into an interactive game.

Abstract: Briefly, methods and apparatus to provide image content to, and display image content on, variable refresh rate displays with reduced input lag. The methods and apparatus allow for image tearing, or the displaying of image content from more than one video frame, when the render rate of a provided video frame falls outside the display refresh rate range of a variable refresh rate display when the display is refreshing with a previous frame (e.g. the display is in active refresh), thus reducing the input lag of the content of the provided video frame. The methods and apparatus may also prevent image tearing when the render rate of provided video frames is within the display refresh rate range of a display.

Abstract: A method of remotely controlling a device at a location is provided. A dataset is received from each of a plurality of different locations, comprising at least one data value of at least one monitorable device at the respective location. Based on the dataset, a user interface can be generated, comprising a primary interface element having plurality of matrix positions mapped to a surface of a sphere. In the user interface, an interactive object icon is displayed which is representative of a monitorable device positioned at the respective matrix position. A scale of each interactive object icon is indicative of the data value of the said monitorable device. After receiving a user input at an interactive object icon, a processor retrieves and displays the data value of a monitorable device associated with the interactive object icon, and a device is controlled at the location to perform a physical function.

Abstract: A method for planning an orthopedic procedure including positioning a virtual implant component relative to a 3D volume of scan data of a patient is disclosed. A 3D volume of scan data of a patient, which includes scan data of a bony anatomy of the patient, is provided. A first 2D view of scan data is generated from the 3D volume of the scan data, wherein the 2D view of scan data comprises a first a portion of the bony anatomy. First positional information for the virtual implant component is defining relative to the first 2D view. A second 2D view of scan data is generated from the 3D volume of scan data, wherein the second 2D view of scan data is provided from the 3D volume of scan data at an angle relative to the first 2D view of scan data and comprises a second portion of the bony anatomy. Second positional information for the virtual implant component is defined relative to the second 2D view of scan data.

Abstract: A method for creating a multimedia presentation element, comprises selecting a presentation element icon; adding information to a presentation element box defined by a presentation boundary within a first multimedia element of the multi-media presentation having a plurality of multimedia elements, the presentation element boundary resulting from the selection of the presentation element icon; and associating the presentation element box with the first multimedia element such that the presentation element box remains associated to the first multimedia element during navigation from different multimedia elements of the plurality of multimedia elements, is described herein.

Abstract: Methods and devices for processing image frames is described. The techniques presented herein leverage known characteristics of the optical transfer component in order to modify the resource allocation for rendering the subset of pixels whose contribution to the final rendered image is less than a contribution threshold. Thus, in situations where the deflection of light from the lens may impact the contribution of the one or more subset of pixels of an image frame towards the final rendered image, the image processing techniques presented here may either omit or deprioritize the identified subset of pixels in order to conserve valuable resources (e.g., dedicate less processing time and memory to rendering the identified subset of pixels).

Abstract: A system and method for detecting and fixing robotic process automation failures, including collecting tasks from at least one client computerized device, processing the tasks via robotic process automation, collecting tasks that failed to complete per task type, recording successful execution steps per each of the failed tasks, evaluating the recorded successful execution steps with respect to the failed task types, and providing selected execution steps that best fix the failed tasks, thereby fixing the robotic process automation failures.

Abstract: Systems and methods for conveying virtual content in an augmented reality environment comprising images of virtual content superimposed over physical objects and/or physical surroundings visible within a field of view of a user as if the images of the virtual content were present in the real world. Exemplary implementations may: obtain user information for a user associated with a presentation device physically present at a location of the system; compare the user information with the accessibility criteria for the virtual content to determine whether any portions of the virtual content are to be presented to the user based on the accessibility criteria and the user information for the user; and facilitate presentation of the virtual content to the user via presentation device of user based on the virtual content information, the field of view, and the correlations between the multiple linkage points and the reference frame of the virtual content.

Abstract: An apparatus and method are described for culling commands in a tile-based renderer. For example, one embodiment of an apparatus comprises: a command buffer to store a plurality of commands to be executed by a render pipeline to render a plurality of tiles; visibility analysis circuitry to determine per-tile visibility information for each of the plurality of tiles and to store the visibility information for a first tile in a first storage, the visibility information specifying either that all of the commands associated with rendering the first tile can be skipped or identifying individual commands associated with rendering the first tile that can be skipped; and a render pipeline to read the visibility information from the first storage to determine whether to execute or skip one or more of the commands from the command buffer to render the first tile.

Abstract: The present disclosure relates to an augmented reality display system. The augmented reality display system includes an augmented reality mirror, a display device, a scanning setup and a data processing system. The data processing system receives the first set of data of a user and collects the second set of data associated with the user. Moreover, the data processing system analyzes the first and second set of data in real time and estimates the position of each feature of the body of the user. Also, the data processing system slices each feature of the body of the user to measures a set of feature metrics. Further, the data processing system create one or more feature metric databases. Moreover, the data processing system maps the feature metric database with a pre-defined set of products. The data processing system overlay and display the information related to the fitness, health and apparel.