Abstract: In one implementation, a method of generating an affordance linked to an SR representation of an item is performed in a device including one or more processors, a non-transitory memory, and one or more displays. The method includes identifying an item; generating an affordance-item pair that corresponds to the item; detecting an input selecting the affordance-item pair; and displaying, on the one or more displays, a simulated reality (SR) environment that includes an SR representation of the item in response to detecting the user input selecting the affordance-item pair. In some implementations, the method includes obtaining an image data frame that includes the item.

Abstract: Provided is an information processing device that includes a position acquisition section that acquires a position of a virtual object in a real space, having been determined on the basis of a recognition result of a real space corresponding to an image captured by an imaging device, and a display control section that controls display of at least a boundary of the virtual object, on the basis of the position of the virtual object, and a feature of a real object that resides in the real space and is away from the position of the virtual object.

Abstract: A planar placement system can generate virtual surfaces (e.g., floors, walls) to simulate items in an augmented reality display. The system can generate the virtual surfaces using image feature tracking and plane intersection approaches that create an accurate visual simulation. The items simulated can be variable items that have unit data (e.g., rolls of wallpaper) that can be simulated on the virtual surfaces, and unit data can be displayed and updated in real time or near real time on a mobile device, such as a user's smartphone.

Abstract: A multiuser, collaborative augmented reality (AR) system employs individual AR devices for viewing real-world anchors, that is, physical models that are recognizable to the camera and image processing module of the AR device. To mitigate ambiguous configurations when used in the collaborative mode, each anchor is registered with a server to ensure that only uniquely recognizable anchors are simultaneously active at a particular location. The system permits collaborative AR to span multiple sites, by associating a portal with an anchor at each site. Using the location of their corresponding AR device as a proxy for their position, AR renditions of the other participating users are provided. This AR system is particularly well suited for games.

Abstract: An image processing apparatus comprises an image obtaining unit that obtains image data based on image capturing by a plurality of image capture apparatuses configured to capture images in an imaging area from different positions, and a panoramic image generation unit that generates, based on the image data obtained by the image obtaining unit, a panoramic image including images in directions within a predetermined range based on a specific position in the imaging area, the panoramic image having an enlargement rate of an image in a specific direction included in the predetermined range which is larger than the enlargement rates of images in other directions.

Abstract: An augmented reality AR system and method for a retail experience include a waveguide apparatus that includes a planar waveguide and at least one optical diffraction element The AR retail system and method recognizes user location in a retail establishment, retrieves data corresponding to the retail establishment and generates virtual content relating to the retail establishment based on the retrieved data. The AR retail system and method creates a virtual user interface in a user's field of view. Virtual content is displayed on the virtual user interface while the user is engaged in retail activity and may be based on user input. The AR retail system and method may provide entertainment, facilitate the shopping experience, offer virtual coupons, render games based on locations throughout a store or based on a shopping list, provide information about food choices such as calorie counts, and identify metadata associated with items.

Abstract: In some embodiments, environmental characteristics of a first real-world route in a first real-world environment (in which a vehicle is located) may be determined. A match between the first real-world route in the first real-world environment and a second real-world route in a second real-world environment may be determined based on similarities between the environmental characteristics of the first real-world route and environmental characteristics of the second real-world route. While the vehicle is on the first real-world route, virtual reality content representative of the second real-world route may be obtained for a virtual reality presentation within the vehicle on the first real-world route based on the determined match between the first real-world route and the second real-world route. While the vehicle is on the first real-world route, the virtual reality content representative of the second real-world route may be presented via one or more output devices of the vehicle.

Abstract: The invention relates to a communication system and a method for providing a virtual meeting of a first user (U1, U2, U3, U4) and a second user (U1, U2, U3, U4), comprising a first communication device (12, 14, 16, 18, 24, 26, 28, 32, 34) with a first display device (12a, 14a, 16a, 18a, 24a, 26a, 28a, 32a) associated with the first user (U1, U2, U3, U4), and a second communication device (12, 14, 16, 18, 24, 26, 28, 32, 34) with a second display device (12a, 14a, 16a, 18a, 24a, 26a, 28a, 32a) associated with the second user (U1, U2, U3, U4).

Abstract: An electronic sports playbook distribution and management system includes a first device. A memory coupled to a processor of the first device stores instructions that, when executed by the processor, cause the processor to generate sports playbook content. The processor is configured to determine an action (e.g., a pass, a dribbling, a cut, a screen, etc.) associated with an object (e.g., a player, etc.) based on attributes of the object (e.g., does the player have the ball?, etc.) and the path (e.g., where does the path end?, etc.). The processor is further configured to transmit, to a server, a datafile of sports playbook content including at least (a) the object, (b) the path associated with the object, and (c) the action. The system may further include a second electronic device configured to obtain the sports playbook content from the server and display a graphical representation of the sports playbook content.

Abstract: An apparatus for controlling digital signage according to an embodiment of the present invention includes a memory, a display, and a controller. The controller selects a background graphic image to which a virtual digital signage is installed with reference to the memory, selects at least one of the number or size of the virtual digital signage with reference to the memory, designates a specific location, in the selected background graphic image, in which the virtual digital signage is installed with reference to the memory, and selects a source video which is displayed through the virtual digital signage in the specific location with reference to the memory.

Abstract: An operating method in a virtual environment through a wearable device is disclosed, wherein the wearable device has a motion sensor, the virtual environment has an operated object and a virtual device corresponding to the wearable device, the corresponding virtual device has a first operational data constraint, and the operated object has a second operational data constraint. The operating method comprises the following steps of: using the motion sensor to generate a motion sensed data; causing the corresponding virtual device to generate a derived data according to the motion sensed data, wherein the derived data indicates an interaction relationship between the virtual device and the operated object; and when the virtual device separated from the operated object under the interaction relationship, moving the operated object in accordance with the derived data.

Abstract: Some embodiments include a computer-implemented method for tracking a gaze of a user that can include receiving image data that includes a plurality of eye landmarks that identify a perimeter of a user's eye, applying dynamic thresholding to the image data, determining a convex hull based on the dynamically thresholded and image data, computing and fitting an ellipse along a boundary of the convex hull, the ellipse corresponding to an iris of the user's eye, updating the image data with the computed ellipse, computing a refined ellipse by reapplying the dynamic thresholding and determining the convex hull using the updated image data, and determining a gaze direction of the user based in part on a position of the refined ellipse relative to the perimeter of the user's eye.

Abstract: Provided are a user interface device and a control method thereof for supporting easy and accurate selection of overlapped objects. The user interface device is a device for providing a user interface applied to a three-dimensional (3D) virtual space in which a plurality of virtual objects is created, and includes a gaze sensor unit to sense a user's gaze, an interaction sensor unit to sense the user's body motion for interaction with the virtual object in the 3D virtual space, a display unit to display the 3D virtual space, and a control unit to, when the user's gaze overlaps at least two virtual objects, generate projection objects corresponding to the overlapped virtual objects, wherein when an interaction between the projection object and the user is sensed, the control unit processes the interaction as an interaction between the virtual object corresponding to the projection object and the user.

Abstract: A computer-implemented virtual pop-up space comprises a traversable 3D representation of a real-world location, wherein the traversable 3D representation renders a first avatar of a first user. The inventive concept further provides a virtual interface configured to enable a user transaction through the first avatar within the traversable 3D representation of the real-world location.

Abstract: A foldable device and a method of controlling the same are provided. The foldable device includes: a flexible display which includes a main display area and an edge display area; and a controller which is configured to determine, based on an angle at which the foldable device is unfolded, a range of a partial activation area of the main display area, wherein the range of the partial activation area is partially bounded by a boundary between the edge display area and the main display area.

Abstract: An electronic device including a non-flat display surface and an image display method thereof are provided. The method is adapted for the electronic device having the non-flat display surface, and a display device of the electronic device is disposed under a non-flat cover. A plurality of edge display pixels in an edge display region of the display device is grouped into at least one pixel group according to a tilt state of an edge of the non-flat cover. Image data is adjusted according to a quantity of the at least one pixel group, to drive a display panel to display according to the adjusted image data. The edge display pixels in the pixel group are configured to display a same image pixel.

Abstract: The measurement result display apparatus of the present invention includes: a storage unit for storing shape information and a predetermined measurement result with respect to an object to be measured; a three-dimensional sensor for detecting shape information of an object existing in a three-dimensional space; a display unit configured so that the object detected by the three-dimensional sensor can be visually recognized and configured to be capable of displaying predetermined information; and a display control unit for displaying the predetermined measurement result of a target object on the display unit so as to be visually recognized together with the object, using the object to be measured whose shape information is detected by the three-dimensional sensor as the target object.

Abstract: Systems and methods are provided rendering a three-dimensional volume. Scan data representing an anatomical object of a patient is acquired. A boundary of the object is identified in the scan data. A first lightmap is positioned inside the boundary of the object. A second lightmap is positioned outside the boundary of the object. The three-dimensional volume of the object is rendered from the scan data with lighting based on the first lightmap and second lightmap.

Abstract: Eyewear having a camera capturing images, and an image processor configured to process the images and display the processed image in both controlled and uncontrolled regions on the display. In an example, the image processor applies a vignette gradient to soften edges of the displayed image in the uncontrolled regions, which compensates for any discoloration in the uncontrolled regions. The uncontrolled regions may be located above and below the controlled region.

Abstract: Particular embodiments described herein present a technique for mesh simplification. A computing system may receive a request to render an image of a virtual scene including a virtual object. The system may determine one or more positions of the virtual object relative to one or more of a foveal focus point or a lens, respectively. The system may determine a screen coverage size of the virtual object. The system may then determine a simplification level for the virtual object based on the determined position(s) and the screen coverage size of the virtual object. The system may generate a mesh representation of the virtual object based on the determined simplification level, where the number of polygons used in the mesh representation depends on the determined simplification level. The system may render the image of the virtual scene using at least the generated mesh representation of the virtual object.