Abstract: Computerized systems, methods, kits, and computer-readable media storing code for implementing the methods are provided for interacting with a physical object in an augmented reality (AR) environment generated by an AR system. One such system includes: a plurality of neuromuscular sensors able to sense a plurality of neuromuscular signals from a user, and at least one computer processor. The neuromuscular sensors are arranged on one or more wearable devices worn by the user to sense the neuromuscular signals. The at least one computer processor is or are programmed to: determine, based at least in part, on the neuromuscular signals sensed by the neuromuscular sensors, information about an interaction of the user with the physical object in the AR environment generated by the AR system; and instruct the AR system to provide feedback based, at least in part, on the information about the interaction of the user with the physical object.

Abstract: Embodiments provide systems, methods, and computer storage media for generating stroke predictions based on prior strokes and a reference image. An interactive drawing interface can allow a user to sketch over, or with respect to, a reference image. A UI tool such as an autocomplete or workflow clone tool can access or identify a set of prior strokes and a target region, and stroke predictions can be generated using an iterative algorithm that minimizes an energy function considering stroke-to-stroke and image-patch-to-image-patch comparisons. For any particular future stroke, one or more stroke predictions may be initialized based on the set of prior strokes. Each initialized prediction can be improved by iteratively executing search and assignment steps to incrementally improve the prediction, and the best prediction can be selected and presented as a stroke prediction for the future stroke. The process can be repeated to predict any number of future strokes.

Abstract: Method and system for displaying a medical image. For example, a computer-implemented method for displaying a medical image includes acquiring an original image of a target; obtaining a lesion region in the original image; selecting a region of interest in the original image based on at least the lesion region, the region of interest including the lesion region; obtaining a plurality of planar images of the region of interest from the original image of the target based on at least a predetermined setting; generating an animated display by grouping the plurality of planar images based on at least a predetermined order; and displaying the animated display related to the region of interest including the lesion region.

Abstract: A server machine modifies an augmented reality (AR) object in response to fulfillment of a condition. The machine provides, to a user device, object data that defines the AR object. The object data specifies a physical geolocation of the AR object, a presentation attribute of the AR object, a conditional modification program, and a trigger condition for execution of the conditional modification program. The object data causes the user device to present the AR object with a first appearance, located at the physical geolocation. The machine detects fulfillment of the trigger condition, and in response, the machine executes the conditional modification program. This modifies the object data by modifying the presentation attribute. The machine provides, to the user device, the modified object data, which causes the user device to present the AR object with a second appearance based on the modified presentation attribute.

Abstract: Disclosed is an electronic device including a memory that stores content-related information, a display that outputs a screen associated with the content, a camera module that photographs a surrounding environment of the electronic device, and a processor that is electrically connected to the memory, the display, and the camera module, wherein the processor may activate the camera module based on a change in physical quantity acting on the electronic device in a state where at least a part of a screen area of the display is turned off, and output a first display object associated with an arbitrary object on the display of which the at least a part of the screen area is turned off when information related to the arbitrary object recognized by the activated camera module is present in the memory. Various embodiments understood through the disclosure may be possible.

Abstract: [Object] It is desirable to provide a technology of enabling a user to easily comprehend one target object whose AR information is presented to the user. [Solution] Provided is a display control device, including: a display control unit configured to control display of information related to a target object located in a field of view of a user, in which, in a case in which it is determined that at least a part of the target object is shielded by another object on the basis of a position of the user, the display control unit controls display of an image related to the target object such that the target object shielded in the field of view is displayed in a form different from a form visually recognized by the user.

Abstract: There is provided an information processing apparatus, an information processing method, and a program capable of allowing a user to more intuitively perform operations for synthesis, the information processing apparatus including: a control unit configured to generate a synthesized object model by synthesizing a first object model and a second object model, and cause the generated synthesized object model to be displayed in association with an image corresponding to the first object model or the second object model. The control unit causes the first object model or the second object model to be moved, for the synthesis, in response to an input based on a user's motion with respect to a screen on which an object model or an image corresponding to the object model is displayed.

Abstract: Methods, systems, and computer program products are described for obtaining, from a first tracking system, an initial three-dimensional (3D) position of an electronic device in relation to image features captured by a camera of the electronic device and obtaining, from a second tracking system, an orientation associated with the electronic device. Responsive to detecting a movement of the electronic device, obtaining, from the second tracking system, an updated orientation associated with the detected movement of the electronic device, generating and providing a query to the first tracking system, the query corresponding to at least a portion of the image features and including the updated orientation and the initial 3D position of the electronic device, generating, for a sampled number of received position changes, an updated 3D position for the electronic device and generating a 6-DoF pose using the updated 3D positions and the updated orientation for the electronic device.

Abstract: A system comprises a teleoperational assembly including an operator control system and a plurality of manipulators. A first manipulator is configured to control a medical instrument in a surgical environment. A second manipulator is configured to control an imaging instrument. The system further comprises a processing unit configured to: display an image of a field of view of the surgical environment captured by the imaging instrument; determine a position of a distal portion of the medical instrument in an image coordinate space; determine an initial position for a badge associated with the distal portion; determine a badge placement boundary, which is inside the image, for the image by determining a viewable space boundary for the image; and adjust the badge from the initial position to a display position within the badge placement boundary by determining an inset boundary between the badge placement boundary and the viewable space boundary.

Abstract: Methods, systems, and devices for medical imaging are described. Examples may include an augmented reality (AR) server receiving a set of medical imaging data acquired by at least a first imaging modality. The set of medical imaging data may include a visual representation of a biological structure of a body. Next, the medical imaging data can be used to render an isolated anatomical model of a least a portion of the biological structure. The isolated anatomical model can be received by an AR viewing device such as AR glasses. The AR viewing device may display on a display of the AR viewing device, a first view perspective of the isolated anatomical model in a first orientation. The first orientation may be based on a position of the first AR viewing device relative to the body. Examples include displaying a virtual position of the medical instrument in the AR viewing device.

Abstract: A method for generating augmented reality content on the fly including the following steps: reading of a real image by the user device; identifying a scenario associated beforehand with the real image; producing augmented reality content, on the user device, by executing the scenario on the real image; and reading of the content by the mobile user device; the production step including deleting, in the entire video, the pixels of a predetermined colour provided as display parameter, in the scenario. A system implementing such a method is also provided.

Abstract: Systems and methods for displaying a cursor and a focus indicator associated with real or virtual objects in a virtual, augmented, or mixed reality environment by a wearable display device are disclosed. The system can determine a spatial relationship between a user-movable cursor and a target object within the environment. The system may render a focus indicator (e.g., a halo, shading, or highlighting) around or adjacent objects that are near the cursor. The focus indicator may be emphasized in directions closer to the cursor and deemphasized in directions farther from the cursor. When the cursor overlaps with a target object, the system can render the object in front of the cursor (or not render the cursor at all), so the object is not occluded by the cursor. The cursor and focus indicator can provide the user with positional feedback and help the user navigate among objects in the environment.

Abstract: Provided are a computer system, a remote control notification method and a program. This computer system acquires an image of an IoT device, determines, from the acquired image, the IoT device which is capable of being remotely controlled by a user who visually confirms the image, and, in a position where the image of the IoT device determined to be remotely controllable is captured, displays with augmented reality that remote control is possible. Further, the computer system pre-stores images of the remotely controllable IoT device, and, on the basis of the pre-stored images of the IoT device, determines that the IoT device is remotely controllable through image recognition which involves comparing the pre-stored images with the acquired image.

Abstract: An electronic device according to one embodiment of the present disclosure may comprise a display, memory, and at least one processor configured to be connected electrically to the display and the memory. The at least one processor may execute instructions stored in the memory to: display a first screen generated by a first application on the display, provide first attribute information of at least one object included in the first screen to a second application in response to a screen switching event for displaying a second screen generated by the second application, and generate, by the second application, the second screen including the at least one object based on the first attribute information.

Abstract: A virtual or augmented reality device is provided. The virtual or augmented reality device may include at least one visualization device and at least one computer that may be communicatively linked. The external computer may further include a central processing unit and a video adaptor. The video adaptor may supply multiple data stream to the visualization device. The virtual or augmented reality device may also include at least two displays that may be connected to the visualization device.

Abstract: A method of constructing a map including a plurality of lanes and a system thereof are provided. The method includes: for each of the plurality of lanes, constructing corresponding lane geometry data based on a plurality of polyline segments; and generating a lane content for the respective lane based on the lane geometry data.

Abstract: A server machine modifies an augmented reality (AR) object in response to fulfillment of a condition. The machine provides, to a user device, object data that defines the AR object. The object data specifies a physical geolocation of the AR object, a presentation attribute of the AR object, a conditional modification program, and a trigger condition for execution of the conditional modification program. The object data causes the user device to present the AR object with a first appearance, located at the physical geolocation. The machine detects fulfillment of the trigger condition, and in response, the machine executes the conditional modification program. This modifies the object data by modifying the presentation attribute. The machine provides, to the user device, the modified object data, which causes the user device to present the AR object with a second appearance based on the modified presentation attribute.

Abstract: A method for offline-service multi-user interaction based on augmented reality (AR) includes scanning, by an AR client terminal of a user, an offline service label at an offline service site. Information of the offline service label is transmitted to a server terminal. Based on the information of the offline service label, the server terminal establishes a service group including the user and a second user that scanned the offline service label. In response to transmitting the information of the offline service label, service data is received from the server terminal. The service data includes information related to the user and information related to the second user. Based on the service data, a service interactive interface is outputted. The service interactive interface displays the information related to the user and the information related to the second user at a position corresponding to the offline service label in an AR scene.

Abstract: Techniques are provided for strategy-based graph simplification. In an embodiment, a computer provides configurable strategies that simplify edges of a graph. A client selects and configures a strategy subset of the configurable strategies to define a particular simplification scheme. The computer simplifies a graph by applying the strategy subset to the graph. In embodiments, predefined classes or other application programming interface (API) is provided to clients to obtain and customize strategy instances, such as with a factory or builder. Strategy instances may be imperative or declarative. A service implementation, such as a graph engine, may be embedded or remoted. Techniques herein provide for reuse and optimization.

Abstract: A real-time virtual reality (VR) acceleration method, includes: obtaining an input image (101); partitioning an output image buffer into M rows and N columns of rectangular grid blocks (103); calculating, according to an algorithm integrating anti-distortion, anti-dispersion, and asynchronous time warping (ATW), vertex coordinates of input image grid blocks corresponding to the output image buffer grid blocks (105); calculating two-dimensional mapping coefficients of each pair of grid blocks in the output image buffer and the input image (107); calculating, according to the two-dimensional mapping coefficients, coordinates of an output image pixel corresponding to an input image pixel (109); selecting at least four pixels adjacent to the coordinates of the input image pixel, to calculate the output image pixel value (111); and outputting an image after anti-distortion, anti-dispersion, and ATW (113).