Abstract: Systems and methods are described in which the location of a tap on the body of a handheld device is determined in real time using data streams from an embedded inertial measurement unit (IMU). Taps may be generated by striking the handheld device with an object (e.g., a finger), or by moving the handheld device in a manner that causes it to strike another object. IMU accelerometer, gyroscopic and/or orientation (relative to the magnetic and/or gravitational pull of the earth) measurements are examined for signatures that distinguish a tap at a location on the body of the device compared with signal characteristics produced by taps at other locations. Neural network and/or numerical methods may be used to perform such classifications.

Abstract: A method for displaying infrastructure information on a multi-focal plane augmented reality display of a vehicle includes receiving infrastructure data. The infrastructure data includes information about a location of at least one infrastructure along a route of the vehicle. The method further includes receiving vehicle-location data. The vehicle-location data includes information about a location of the vehicle. The method further includes determining a position of the vehicle relative to the location of the least one infrastructure using the infrastructure data and the vehicle-location data. The method further includes transmitting a command signal to the multi-focal plane augmented reality display to display a virtual image showing the infrastructure information of the infrastructure on the multi-focal plane augmented reality display.

Abstract: The present disclosure provides a method of positioning vertebra in a CT image, an apparatus, a computer device, and a computer readable storage medium. The method includes: pre-processing vertebra CT image data; inputting the pre-processed vertebra CT image data into a pre-trained neural network to obtain regression results of heat maps of key points corresponding to the pre-processed vertebra CT image data; regressing of 3D heat maps corresponding to the positions of the key points of the vertebra mass center based on the regression results of the heat maps of the key points and the pre-processed vertebra CT image data; serving 3D heat maps corresponding to the positions of the key points of the vertebra mass center as labels, and networked regressing 3D heat map information to position the vertebra. Effects caused by scanning machine difference and scanning noise are avoided, and the vertebra with complex forms is accurately positioned.

Abstract: An interactive method for a movable platform, an interactive system, a movable platform and a storage medium including the interactive method. The interactive method may include projecting three-dimensional point cloud data collected by a sensor into image data collected by a camera for fusion processing to obtain a fused image; rendering the fused image to determine a three-dimensional visualization image of a surrounding environment where the movable platform is located; and outputting the three-dimensional visualization image of the surrounding environment where the movable platform is located on a display interface.

Abstract: An augmented reality collaboration system comprises a first system configured to display virtual content, comprising: a structure comprising a plurality of radiation emitters arranged in a predetermined pattern, and a user device comprising: one or more sensors configured to sense outputs of the plurality of radiation emitters, and one or more displays; one or more hardware processors; and a non-transitory machine-readable storage medium encoded with instructions executable by the one or more hardware processors to, for the user device: determine a pose of the user device with respect to the structure based on the sensed outputs of the plurality of radiation emitters, and generate an image of virtual content based on the pose of the user device with respect to the structure, wherein the image of the virtual content is projected by the one or more displays of the user device in a predetermined location relative to the structure.

Abstract: A method by a rendering device includes receiving a request to render multiple surfaces corresponding to multiple virtual objects to be concurrently displayed on an augmented-reality (AR) headset. The method further includes that the AR headset is connected to the rendering device via a wireless link. In response to a determination that a network quality of the wireless link is below a threshold condition, the method further includes selecting a first subset of the multiple surfaces that are higher priority than a second subset of the plurality of surfaces. The method includes transmitting the first subset of multiple surfaces to the AR headset for display and transmitting the second subset of multiple surfaces to the AR headset for display after transmitting the first subset. This method includes rendering the surfaces in accordance with a set of rendering parameters so as to satisfy one or more network constraints.

Abstract: Systems and methods for receiving data characterizing a plurality of images of a surgical region that includes a first target tissue. The plurality of images include a plurality images associated with visible light images, a plurality of images associated with a first wavelength and a plurality of images associated with the second wavelength that is different from the first wavelength. The method also includes generating a first scene by at least overlaying a first set of images of the plurality of images. The first set of images are temporally contiguous and include a first image associated with the first wavelength, a second image associated with visible light, and a third image associated with the second wavelength. The image further includes generating a second scene by at least overlaying a second set of images of the plurality of images. The second set of images are temporally contiguous.

Abstract: The present disclosure discloses a sticker processing method, an apparatus, an electronic device and a computer-readable storage medium. The method includes: acquiring an image and a sticker; determining a target reference line, where the target reference line is used to identify an adding position of the sticker in the image; detecting a position change of the sticker in the image in response to a user's moving operation on the sticker; determining a final attachment state of a preset reference line on the sticker and the target reference line according to the position change; and moving the sticker to the adding position if the final attachment state is an attached state.

Abstract: In an embodiment, an augmented reality display is provided that incorporates a prescription lens for the wearer. In an embodiment, an image is generated from a display and directed into the edge of the prescription lens, and the lens acts as a waveguide. The image is internally reflected within the prescription lens, and is directed to the wearer by an image combiner embedded within the prescription lens. In an embodiment, the augmented reality display can be adjusted for many common vision problems including myopia, hyperopia, astigmatism, and presbyopia.

Abstract: The present disclosure discloses a sticker processing method, an apparatus, an electronic device and a computer-readable storage medium. The method includes: acquiring an image and a sticker; determining a target reference line, where the target reference line is used to identify an adding position of the sticker in the image; detecting a position change of the sticker in the image in response to a user's moving operation on the sticker; determining a final attachment state of a preset reference line on the sticker and the target reference line according to the position change; and moving the sticker to the adding position if the final attachment state is an attached state.

Abstract: A method and system for authoring a three-dimensional (3D) presentation can involve dividing a scene into a grid of equals-sized segments or non-equally sized segments, wherein one or more 360-degree cameras record the scene from a center of each segment, and a size of the each segment is proportional to a complexity of an environment captured in the scene. One or more objects can be created within the scene for a user interaction with a 3D presentation of the scene in the context of a video stream. A logical center of the object(s) can be used as a center point for recording a 360-degree video by the one or more 360-degree cameras for use as a low fidelity background video when the user interacts with the 3D presentation of the scene. The 3D presentation can be based on a 3D model.

Abstract: A method for constructing a real-geographic-space scene in real time based on a panoramic-video technique is provided. By using a measuring robot and the attitude sensors, accurately determining the geographic coordinates and the attitudes of the cameras, where the cameras may be installed in a fixed or stringing manner, where in the fixing type a plurality of neighboring videos at the same moment undergo orthographic correction and splicing, and in the stringing type the cameras are installed to a guiding device and may locally, independently and quickly move and shoot, and the videos of the neighboring cameras are spliced in real time; and fusing the videos, the geographic coordinates and the environment sounds that satisfy the delay time, to form a scene video streaming.

Abstract: A text display method, a text display apparatus, an electronic device and a storage medium are disclosed. A real scene image and a to-be-displayed text are acquired, motion track data for texts is invoked, the to-be-displayed text is processed with a dynamic special effect, and the text which has been subject to the dynamic special effect processing is displayed on a real scene image, thus realizing a function of displaying a text with dynamic special effect in augmented reality display, making the text display effect more vivid. The display method can be widely used in various application scenarios to bring users a better visual and sensory experience.

Abstract: A terminal device (10) includes a transceiver (110), a camera (140), a display (130), and a processor (150). The processor (150) determines a first synchronization signal whose radio quality satisfies a predetermined threshold from a plurality of synchronization signals beamformed and transmitted from the base station (20), and reports the first synchronization signal to the base station (20). The processor (150) superimposes a virtual object corrected by using correction information on a captured image of the camera (140) and displays the image on the display (130). The correction information is information for indicating a position of an area covered by the first synchronization signal with respect to a real object. The correction information includes information regarding a direction of the virtual object to be displayed on the display (130) in the area and a distance from the real object to the area.

Abstract: A peripheral image display device is configured to: acquire wheel speeds of a vehicle; determine a slip state or a non-slip state of a wheel of the vehicle based on the acquired wheel speeds; acquire multiple camera images from respective cameras; store, as a past image, the camera image indicating a range in a traveling direction of the vehicle; generate a peripheral image indicating a periphery of the vehicle by synthesizing the camera images, display the peripheral image on a display. In the non-slip state, the peripheral image display device displays a transparent image showing, in a transparent manner, a portion under a floor of the vehicle using the past image selected based on current wheel speeds is. In the slip state, the peripheral image display device deactivates the display of the transparent image.

Abstract: Provided are a tour guiding method and apparatus, an electronic device and a storage medium. The method includes receiving a video stream collected by a user in a current location area of a target scenic spot and sent by an application device; determining, based on the collected video stream and prestored three-dimensional point cloud data of the target scenic spot, an augmented-reality-based content resource package corresponding to the current location area, where the augmented-reality-based content resource package includes at least six-degrees-of-freedom attitude data of the application device; and sending the augmented-reality-based content resource package corresponding to the current location area to the application device to enable the application device to provide the augmented-reality-based content resource package corresponding to the front location area for the user.

Abstract: A guidance display system includes an AR display device and a server. The AR display device includes a display unit and a display control unit configured to display, on the display unit, an augmented reality image in which an image of a virtual object for guidance is superimposed on scenery of a real world. The server is wirelessly connected to the display device. The server includes a theme park-specific character storage unit, a 3D model extraction unit, and a transmission unit. The theme park-specific character storage unit stores character information set for a theme park. The 3D model extraction unit extracts the character of the theme park set as the destination, as a virtual object for guidance. The transmission unit transmits the image data of the extracted virtual object for guidance to the display control unit of the AR display device.

Abstract: A vehicle navigation system includes an electronic control unit. The electronic control unit receives image data regarding a source of a traffic jam on a roadway from a plurality of sensors of a plurality of vehicles in a mesh network. Moreover, the electronic control unit generates a bird's eye view of the traffic jam based on the image data, wherein the bird's eye view includes a graphical representation of the source of the traffic jam and a graphical representation of vehicles on the roadway within the traffic jam. A display device displays the bird's eye view.

Abstract: A mixed reality system, comprising: a data acquisition device configured to acquire real-world data; an output device for providing the real-world data to a user; and a processing circuitry configured to: obtain (a) data acquired by the data acquisition device, and (b) information of one or more virtual entities having properties enabling determination of simulated effects of the virtual entities on the data; determine the simulated effects of the virtual entities on the data utilizing the properties; and provide the user with output on the output device being a manipulation of the data reflecting the simulated effects.

Abstract: A medical instrument display includes an image storage that stores a plurality of image data of a medical instrument, a data analyzer that searches a plurality of image data stored in the image storage on a certain condition, and a display controller that causes a display to display a first medical instrument image that has been selected from thumbnail images, the thumbnail images being based on a plurality of the image data obtained by the search, and a second medical instrument image in good order, the second medical instrument image being different from the first medical instrument image.