Abstract: Embodiments of the present disclosure relate to the field of spatial positioning, and disclose a method and apparatus for spatial positioning based on augmented reality. In the embodiments of the present disclosure, the augmented reality based method for spatial positioning including: acquiring an offset angle of a dual-camera coordinate system relative to a world coordinate system, wherein the world coordinate system is a coordinate system that is preset by using a known target position of a positioning photosphere as a reference coordinate; acquiring an actual position of the positioning photosphere in the world coordinate system; calculating a coordinate value of the dual camera in the world coordinate system in accordance with the offset angle, the actual position of the positioning photosphere, and the target position; and determining a position of a virtual object in a virtual space in the world coordinate system in accordance with the coordinate value of the dual camera in the world coordinate system.

Abstract: In an augmented reality (AR) system, a controller receives an image from a camera, obtains a camera distance index, and receives an instruction to display an object onto the image on a display. In response, the controller retrieves real world dimensions of the object, obtains an AR position of the object in an AR coordinate system, and calculates a distance scaling factor based on the distance index and a depth between a viewpoint and the object. The controller transforms the AR position and the real world dimensions of the object into a display position in a display coordinate system and calculates display dimensions for the object based on the distance scaling factor and the real world dimensions of the object. The controller generates a display object image by scaling the object image to the display dimensions and displays the display object image onto the display at the display position.

Abstract: An image processing apparatus includes a calculation circuit configured to calculate a disparity between images, a determination circuit configured to determine a pixel position at which intensive disparity retrieval is to be performed based on distribution statistics of the disparity, an interpolation circuit configured to generate an interpolated image by performing interpolation at pixel positions at which intensive disparity retrieval is to be performed, and an output circuit configured to output a corrected disparity with which the distance to the object is determined. The calculation circuit calculates a first disparity based on the first and second images and generate distribution statistics from the first disparity in the first image, and calculates a second disparity based on the second image and the interpolated image generated from the first image by the interpolation circuit. The output circuit generates the corrected disparity based on differences between the first and second disparities.

Abstract: A setting apparatus sets a virtual viewpoint corresponding to a virtual viewpoint image that is generated based on images obtained by image capturing from a plurality of directions. The setting apparatus includes one or more hardware processors, and one or more memories that store instructions executable by the one or more hardware processors to cause the setting apparatus to determine a common image capturing area that is included within each of a plurality of fields of view, of a plurality of image capturing apparatuses used for obtaining at least a part of the plurality of captured images, and to cause a graphical user interface (GUI), used for setting the virtual viewpoint, to identifiably display the determined common image capturing area. In addition, the setting apparatus sets of the virtual viewpoint according to a user input based on the GUI identifiably displaying the determined common image capturing area.

Abstract: This patent provides a method for performing advanced volume rendering strategies. In tandem volume rendering, the volume is divided and a first portion of the volume undergoes a first volume rendering strategy and a second portion undergoes a second volume rendering strategy. Additional volume rendering strategies disclosed herein include preemptive volume rendering.

Abstract: The present technology relates to an image processing device, an image processing method, and a program that enable refocusing accompanied by desired blurring. A light collection processing unit performs a light collection process to generate a processing result image focused at a predetermined distance, by shifting the pixels of images of a plurality of viewpoints in accordance with a shift amount and integrating the pixel values. In the light collection process, the pixels are shifted in accordance with a corrected shift amount obtained by correcting the shift amount with correction coefficients for the respective viewpoints. The present technology can be applied in a case where a refocused image is obtained from images of a plurality of viewpoints, for example.

Abstract: A mapping system, method and computer program product are provided to apply texture, such as windows and doors, to the visual representation of a plurality of buildings. In the context of a method, images of each of a plurality of buildings are analyzed to detect building texture for one or more faces of the buildings. A representation of the building texture is spread to visual representations of one or more faces of a respective building that do not have a detected texture. The building texture may be spread from another face of the same building that has detected texture and is of a corresponding size to the face of the building without detected texture. Or, the building texture may be spread from a face of a neighboring building has a detected texture and is of a corresponding size to the face of the building without detected texture.

Abstract: Techniques related to generating a virtual view of a scene from a position between positions of known input images for presentation to a viewer are discussed. Such techniques include applying a convolution mask that approximates an inverse of a linear combination of at least the horizontal and vertical convolution matrices representative of gradient detection in the input images to a virtual intermediate gradient image that is a combination of at least an interpolated virtual image at the position, an interpolated horizontal gradient map at the position, and an interpolated vertical gradient map at the position to generate a final virtual image for the position.

Abstract: Techniques are provided for enhancing the targeting, selection, review, and presentation of online social network (OSN) data pertinent to an evidence context. In one formulation, a concept taxonomy is determined from a request frame relating to targeted OSN data. The concept taxonomy is transformed into query terms for searching targeted OSN data stored in an OSN data collection; a review set of OSN data entities aligned with the request frame is formulated. In another formulation, a presentation model is generated corresponding to an evidence context which is populated with OSN data entities in a review set; the presentation model is displayed on a user interface. Indications of relevance by a user on the user interface change content or properties of the OSN data entities in the review set.

Abstract: An apparatus comprises receiver (101) receiving a light intensity image, confidence map, and image property map. A filter unit (103) is arranged to filter the image property map in response to the light intensity image and the confidence map. Specifically, for a first position, the filter unit (103) determines a combined neighborhood image property value in response to a weighted combination of neighborhood image property values in a neighborhood around the first position, the weight for a first neighborhood image property value at a second position being dependent on a confidence value for the first neighborhood image property value and a difference between light intensity values for the first position and for the second position; and determines a first filtered image property value for the first position as a combination of a first image property value at the first position in the image property map and the combined neighbor image property value.

Abstract: Systems and methods for dynamically calibrating an array camera to accommodate variations in geometry that can occur throughout its operational life are disclosed. The dynamic calibration processes can include acquiring a set of images of a scene and identifying corresponding features within the images. Geometric calibration data can be used to rectify the images and determine residual vectors for the geometric calibration data at locations where corresponding features are observed. The residual vectors can then be used to determine updated geometric calibration data for the camera array. In several embodiments, the residual vectors are used to generate a residual vector calibration data field that updates the geometric calibration data. In many embodiments, the residual vectors are used to select a set of geometric calibration from amongst a number of different sets of geometric calibration data that is the best fit for the current geometry of the camera array.

Abstract: An event interface system facilitates the creation and deployment of a first blockchain object and a second blockchain object on a first blockchain and a second blockchain respectively. The system also provides an interface between the first blockchain object and the second blockchain object via the event hub. Additionally, the system can allow interaction between blockchain objects on a private blockchain and a participant on the system.

Abstract: A method for determining image values in marked pixels of at least one projection image is provided. The at least one projection image is part of a projection image set provided for reconstruction of a three-dimensional image dataset and acquired in each case using a projection geometry in an acquisition procedure. The image values are determined through evaluation of at least one epipolar consistency condition that is to be at least approximately fulfilled, that results from the projection geometries of the different projection images of the projection image set, and that requires the agreement of two transformation values in transformation images determined from different projection images by Radon transform and subsequent derivation as a condition transformation.

Abstract: A Multifunctional Peripheral (MFP) includes a display unit that displays information and a printer that prints an image on a recording medium, and when data printable by the printer exists in a specific location, a preview combination home screen including a preview of an image based on the data is displayed on the display unit.

Abstract: In some examples, a system includes a range sensor configured to receive signals reflected from objects in an environment and generate two or more successive scans of the environment at different times. The system also includes a camera configured to capture two or more successive camera images of the environment, wherein each of the two or more successive camera images of the environment is captured by the camera at a different location within the environment. The system further includes processing circuitry configured to generate a three-dimensional map of the environment based on the two or more successive scans and the two or more successive camera images.

Abstract: A computing device may include a processor, a plurality of input devices communicatively coupled to the processor of the computing device, a voice recognition device to detect audible input from a user, and a profile manager to manage application specific profiles for the plurality of input devices and, when executed by the processor, establish an application specific profile based on the audible input received by the voice recognition device.

Abstract: Apparatus, systems, methods, and articles of manufacture are disclosed for assigning a color to a point in three-dimensional (3D) video. An example system includes an aggregator to access data from real cameras, the data including spatial coordinates and colors for a plurality of two-dimensional (2D) points in video data captured by the real cameras. The aggregator is to create a point cloud correlating the 2D points to the 3D points. The example system also includes a selector to select a subset of the real cameras based on a position of a virtual camera. In addition, the example system includes an analyzer to: select a point from the point cloud in a field of view of the virtual camera; select one of the subset of real cameras having a non-occluded view of the point and a perspective closest to that of the virtual camera; and assign a color to the point based on color data associated with the selected one of the real cameras.

Abstract: Embodiments described herein provide an apparatus comprising a processor to divide a first image projection into a plurality of regions, the plurality of regions comprising a plurality of points, determine an accuracy rating for the plurality of regions, and apply one of a first rendering technique to a first region in the plurality of regions when the accuracy rating for the first region in the plurality of regions fails to meet an accuracy threshold or a second rendering technique to the first region in the plurality of regions when the accuracy rating for the first region in the plurality of regions meets an accuracy threshold, and a memory communicatively coupled to the processor. Other embodiments may be described and claimed.

Abstract: In one embodiment, a method includes receiving, from the first user, a request to create a joint virtual space to use with one or more second users, determining a first area in a first room associated with the first user based at least in part on space limitations associated with the first room and locations of one or more items in the first room, retrieving information associated with one or more second rooms for each of the second users, creating, based on first area of the first room and the information associated with each of the second rooms, the joint virtual space, and providing access to the joint virtual space to the first user and each of the one or more second users.

Abstract: A projection device viewpoint image of a three-dimensional projection target is acquired, a three-dimensional model corresponding to the projection target is prepared as projection contents, the three-dimensional model is converted into a two-dimensional image that coincides with the projection device viewpoint image, and the two-dimensional image that coincides with the projector viewpoint image is projected to the projection target.

Abstract: A biological model creation apparatus sets a plurality of control points respectively corresponding to a plurality of target points set on a plurality of valve annuli of a specified heart, on a plurality of valve annuli in a mesh model of a heart. Then, the biological model creation apparatus determines the positions of the control points in the mesh model on the basis of a first and second evaluation value regarding the positions of the plurality of control points. The first evaluation value indicates a degree of matching to relative positions among target points belonging to the same valve annulus. The second evaluation value indicates a degree of matching to relative positions among target points belonging to different valve annuli. Then, the biological model creation apparatus deforms the mesh model such that the positions of the plurality of control points coincide with the positions of their corresponding target points.

Abstract: Various aspects of the subject technology relate to systems, methods, and machine-readable media for automated detection of emergent behaviors in interactive agents of an interactive environment. The disclosed system represents an artificial intelligence based entity that utilizes a trained machine-learning-based clustering algorithm to group users together based on similarities in behavior. The clusters are processed based on a determination of the type of activity of the clustered users. In order to identify new categories of behavior and to label those new categories, a separate cluster analysis is performed using interaction data obtained at a subsequent time. The additional cluster analysis determines any change in behavior between the clustered sets and/or change in the number of users in a cluster. The identification of emergent user behavior enables the subject system to treat users differently based on their in-game behavior and to adapt in near real-time to changes in their behavior.

Abstract: In one embodiment, a computing system accesses a tracking record of a real-world object during a first movement session. The first tracking record comprises a plurality of locations of the real-world object relative to a first user. The system determines a display position of a virtual object representing the real-world object on a display screen of the second user based on the tracking record of the real-world object and the current location of the second user. Based on the determined position of the virtual object on the display screen, the system displays the virtual object on the display screen.

Abstract: Intuitively understandable visual representations of personal budgeting information are provided by creating proportionate bubble graphics for portions of a budget, each graphic having a visual size depiction proportionate to its percentage of the total budget being considered.

Abstract: Methods and systems are described in some examples for changing the traversal of an acceleration data structure in a highly dynamic query-specific manner, with each query specifying test parameters, a test opcode and a mapping of test results to actions. In an example ray tracing implementation, traversal of a bounding volume hierarchy by a ray is performed with the default behavior of the traversal being changed in accordance with results of a test performed using the test opcode and test parameters specified in the ray data structure and another test parameter specified in a node of the bounding volume hierarchy. In an example implementation a traversal coprocessor is configured to perform the traversal of the bounding volume hierarchy.

Abstract: A system includes a display, a processor, and memory storing instructions that cause the processor to receive a request to scale one or more objects of on a model depicted on the display, identify the one or more objects of the model, determine one or more model parameters of the model, such that the model parameters include information indicative of the one or more objects, the model, the display, or any combination thereof, calculate a size for the one or more objects of the model based on the one or more model parameters; and scale the one or more objects based on the size for the objects.

Abstract: Provided is a stereo matching method and apparatus. A stereo matching apparatus may generate a disparity map by transforming a disparity map of a previous frame based on determined motion information of a camera between the previous frame and the current frame, calculate a confidence for the generated disparity map, and adjust a disparity map corresponding to the current frame based on the confidence and the generated disparity map.

Abstract: A method for improving user interaction with a virtual environment includes presenting a virtual environment to a user, measuring a first position of a user's gaze relative to a virtual environment, receiving a magnification input, and changing a magnification of the virtual environment centered on the first position and based on the magnification input.

Abstract: An exemplary depth capture system emits a first structured light pattern onto a surface of an object included in a real-world scene using a first structured light emitter included within the depth capture system. The depth capture system also emits, concurrently with the emitting of the first structured light pattern, a second structured light pattern onto the surface of the object using a second structured light emitter included within the depth capture system. The emitting of the second structured light pattern is different than the emitting of the first structured light pattern. The depth capture system detects the first and second structured light patterns using one or more optical sensors included within the depth capture system. Based on the detection of the structured light patterns, the depth capture system generates depth data representative of the surface of the object included in the real-world scene.

Abstract: Methods and systems for securely entering credentials via a head-mounted display device are described herein. A display of a head-mounted device may display, in a first arrangement, a plurality of graphical user interface (GUI) elements. Each of the plurality of GUI elements may indicate a different character of a plurality of characters. The head-mounted device may receive a first user selection of a GUI element from the plurality of GUI elements displayed in the first arrangement. The method may comprise storing the first user selection of the GUI element. After receiving the first user selection of the GUI element, the plurality of GUI elements may be displayed on the display of the head-mounted device and in a second arrangement different from the first arrangement. The head-mounted device may receive a second user selection of a GUI element from the plurality of GUI elements displayed in the second arrangement.

Abstract: Systems, methods, and non-transitory computer-readable media can determine at least one request to access a content item, wherein the content item was composed using a set of camera feeds that capture at least one scene from a set of different positions. A viewport interface can be provided on a display screen of the computing device through which playback of the content item is presented, the viewport interface being configured to allow a user operating the computing device to virtually navigate the at least one scene by changing i) a direction of the viewport interface relative to the scene or ii) a zoom level of the viewport interface. A navigation indicator can be provided in the viewport interface, the navigation indicator being configured to visually indicate any changes to a respective direction and zoom level of the viewport interface during playback of the content item.

Abstract: Techniques of rendering images includes generating signed distance values (SDVs) along a ray from a specified viewpoint in terms of projected distances along that ray from given depth images. For each pixel in an image of from the perspective of the specified viewpoint, a ray is traced into the three-dimensional scene represented by the image. An iterative step is performed along the ray, obtaining in each iteration a three-dimensional world-space point p. The result is the signed distance sj as measured from depth view Dj. If the absolute value of the signed distance sj is greater than some truncation threshold parameter, the signed distance sj is replaced by a special undefined value. The defined signed-distance values are aggregated to obtain an overall signed distance s. Finally, the roots or zero set (isosurface) of the signed distance field is determined.

Abstract: Provided is a process executed by a robot, including: traversing, to a first position, a first distance in a backward direction; after traversing the first distance, rotating 180 degrees in a first rotation; after the first rotation, traversing, to a second position, a second distance in the second direction; and after traversing the second distance, rotating 180 degrees in a second rotation such that the field of view of the sensor points in the first direction.

Abstract: A method for performing auto-exposure (AE) control in a depth sensing system includes: performing a rough pattern detection on a first reference frame to obtain a rough pattern detection result regarding a known pattern that is projected by the depth sensing system and calculating a pattern brightness mean; performing a depth decoding process with respect to a second reference frame that is derived based on the pattern brightness mean, thereby to obtain a depth decoding result; performing a mapping process according to the depth decoding result to obtain a mapping result; performing a fine pattern detection on the second reference frame according to the mapping result and the rough pattern detection result to obtain a fine pattern detection result; calculating a frame brightness mean according to the fine pattern detection result; and performing an AE control process over the depth sensing system according to the frame brightness mean.

Abstract: The present technology relates to artificial reality systems. Such systems provide projections a user can create to specify object interactions. For example, when a user wishes to interact with an object outside her immediate reach, she can use a projection to select, move, or otherwise interact with the distant object. The present technology also includes object selection techniques for identifying and disambiguating between objects, allowing a user to select objects both near and distant from the user. Yet further aspects of the present technology include techniques for interpreting various bimanual (two-handed) gestures for interacting with objects. The present technology further includes a model for differentiating between global and local modes for, e.g., providing different input modalities or interpretations of user gestures.

Abstract: According to embodiments of the invention, methods, and a computer system for configuring navigational controls in a geometric environment are disclosed. The method may include obtaining a data set for geometric representation on a display, forming one or more reference surfaces, calculating a fit score and a confidence score using one or more of the reference surfaces, and configuring the navigational system to a control scheme when a computational operation on the fit score and the confidence score is outside of a threshold value. The control scheme may be a geometric control scheme, a planar control scheme, and a roaming control scheme.

Abstract: A method for scalable and secure vehicle to everything communications may include receiving, at a communications management device, telematics data from a plurality of vehicles. The method may further include segregating the plurality of vehicles into initial clusters based on the telematics data, and dividing the initial clusters into binary space partitions having various sizes, where the size of each binary space partition is based on a maximum number of vehicles in the binary space partition. The method may include determining, for a selected vehicle within an associated binary space partition, a metric representing a suitability of communications between the selected vehicle and other vehicles in the associated binary space partition, receiving updated telematics data from the plurality of vehicles, shifting the initial clusters based on the updated telematics data, and updating the binary space partition based on the shifted clusters.

Abstract: Aspects of the subject disclosure may include, for example, a processing system including a processor and a memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations, including detecting a vehicle, obtaining a demographic profile for an occupant of the vehicle, obtaining a directed advertisement for the vehicle based on the demographic profile of the occupant, generating a message for the vehicle based on the directed advertisement, and broadcasting the message to the vehicle, wherein an on-board device of the vehicle receives the message. Other embodiments are disclosed.

Abstract: An information processing device decides a viewpoint position and generates a virtual viewpoint image based on the decided viewpoint position by using a plurality of images shot by a plurality of imaging apparatuses. The information processing device includes a determining unit configured to determine a scene related to the virtual viewpoint image to be generated, and a deciding unit configured to decide the viewpoint position related to the virtual viewpoint image in the scene determined by the determining unit, based on the scene determined by the determining unit.

Abstract: Apparatus and method for a hierarchical beam tracer.

Abstract: An image taken of a three-dimensional virtual space including a virtual designating object and an object arranged therein is displayed. When the position of the virtual designating object does not coincide with the object, the virtual designating object is arranged in a predetermined orientation. The position of the virtual designating object is determined based on an acquired designated position on a two-dimensional image, which is generated from the three-dimensional virtual space taken by a virtual camera. When the position of the virtual designating object corresponds to the object, the displayed orientation of the virtual designating object is based on the position.

Abstract: A graphical user interface controlling application executing in a computational device performs operations in which in response to displaying images of a first plurality of elements rendered in a first size surrounded by images of a second plurality of elements rendered in a second size that is smaller than the first size, a request to zoom in is received. In response to receiving the request to zoom in, one or more images are erased, and images of the second plurality of elements rendered in the first size are displayed.

Abstract: A graphical user interface controlling application executing in a computational device performs operations in which in response to displaying images of a first plurality of elements rendered in a first size surrounded by images of a second plurality of elements rendered in a second size that is smaller than the first size, a request to zoom in is received. In response to receiving the request to zoom in, one or more images are erased, and images of the second plurality of elements rendered in the first size are displayed.

Abstract: A method comprises producing image frames representing evolution of a scene in a field of view of a virtual camera in a virtual environment; and rendering in the image frames an appearance of movement of an environment element in the scene in correspondence with movement of the virtual camera within the virtual environment. In another method the virtual environment may include a virtual camera, an object of interest and an environment element of which at least a portion is located between the virtual camera and the object of interest. The method may comprise producing a sequence of image frames representing evolution of a scene, and over the course of multiple image frames, rendering an appearance of movement of the portion of the environment element to expose more of the object of interest in at least part of the scene previously occupied by the portion of the environment element that was moved.

Abstract: The technology disclosed uses a combination of an object detector and an object tracker to process video sequences and produce tracks of real-world images categorized by objects detected in the video sequences. The tracks of real-world images are used to iteratively train and re-train the object detector and improve its detection rate during a so-called “training cycle”. Each training cycle of improving the object detector is followed by a so-called “training data generation cycle” that involves collaboration between the improved object detector and the object tracker. Improved detection by the object detector causes the object tracker to produce longer and smoother tracks tagged with bounding boxes around the target object. Longer and smoother tracks and corresponding bounding boxes from the last training data generation cycle are used as ground truth in the current training cycle until the object detector's performance reaches a convergence point.

Abstract: An image processing system is provided that includes an image capturing apparatus configured to generate a plurality of captured images and at least one information processing apparatus connected to the image capturing apparatus. The information processing apparatus includes processing circuitry configured to input at least a first captured image and a second captured image from among the plurality of captured images, acquire first conversion data to be used for converting the first captured image and second conversion data to be used for converting the second captured image, and generate an output image by stitching converted images generated by converting the first captured image based on the first conversion data and the second captured image based on the second conversion data.

Abstract: Circuits and method for multiplying floating point operands. An exponent adder circuit sums a first exponent and a second exponent and generates an output exponent. A mantissa multiplier circuit multiplies a first mantissa and a second mantissa and generates an output mantissa. A first conversion circuit converts the output exponent and output mantissa into a fixed point number. An accumulator circuit sums contents of an accumulation register and the fixed point number into an accumulated value and stores the accumulated value in the accumulation register.

Abstract: Methods and apparatus to encode and/or decode normals of geometric representations of surfaces are disclosed herein. An example method includes receiving a plurality of points, each point representing a normal to the surface and being arranged within a tile; generating a plurality of regions within the tile, each region including points of the plurality of points; retrieving a first and second point, the first point representing a first normal and the second point representing a second normal, the first point being outside of a specified baseline region; performing a point transformation operation on the first point to produce a transformed first point of the baseline region and performing the point transformation on the second point to produce a transformed second point; generating a difference between the transformed first point and the transformed second point to produce a difference value; and encoding the difference value.

Abstract: An exemplary depth data generation system accesses first and second depth maps of a real-world scene, the depth maps independently captured using first and second depth map capture techniques, respectively. The first and second depth maps include, respectively, first and second depth data points both representative of a same physical point on a surface of an object in the real-world scene. Based on the first and second depth map capture techniques and based on an attribute of the surface of the object, the system assigns a first confidence value to the first depth data point and a second confidence value to the second depth data point. Based on the first and second confidence values, the system converges the first and second depth maps to form a converged depth map of the real-world scene that includes a third depth data point representing the physical point on the surface of the object.

Abstract: An image processing apparatus includes: an image obtaining unit configured to obtain images of an image capturing target area from a plurality of directions; an information obtaining unit configured to obtain viewpoint information; a determination unit configured to determine a pixel value of a particular area in a virtual viewpoint image according to a virtual viewpoint at a first time indicated by the viewpoint information, based on a pixel value of an obtained image based on image capturing by a first image capturing apparatus at a second time, and a pixel value of an obtained image based on image capturing by a second image capturing apparatus at the first time, wherein the particular area is not captured by the first image capturing apparatus at the first time; and a generation unit configured to generate a virtual viewpoint image in accordance with the determination of the pixel value.