Abstract: Examples are described for overlaying primitives, arranged as concentric circles, in circular images onto respective mesh models to generate rectangular images representative of a 360-degree video or image. Portions of the rectangular images are blended to generate a stitched rectangular image, and image content for display is generated based on the stitched rectangular image.

Abstract: An image perspective conversion method includes acquiring a first image, partitioning a predetermined region on the first image into a plurality of polygonal sub-regions, acquiring a plurality of first coordinates corresponding to the plurality of polygonal sub-regions, converting the plurality of first coordinates into a plurality of second coordinates according to a world coordinate system, and interpolating a plurality of pixels among the plurality of second coordinates for generating a second image.

Abstract: A collaboration system including a spatial event map that can be published as an electronic document by a collaboration server and consumed by a consuming workstation. The electronic document is self-contained, and includes a viewer that has a module for rendering each of the graphical target types in the workspace onto a screen space. The system includes a server-side data processor that maintains the spatial event map which locates events in a workspace. The spatial event map includes a log of events, entries in the log having a location of a graphical target of the event in the workspace and a time.

Abstract: An approach is provided that selects three attributes that correspond to objects included in a dataset, where each of the three attributes is assigned to a different coordinate value (x, y, and z coordinates). The approach creates a simulated three dimensional (3D) scene of the objects on a display screen by using the x, y, and z coordinate values corresponding to the attributes of each of the objects. The approach further displays, on a 2D screen, a gyroscopic graphical user interface (GUI) that provides three dimensional (3D) control of the simulated 3D scene. In the approach, a gesture from a user receiving at the gyroscopic GUI. Responsively, the approach adjusts the 3D scene displayed on the 2D screen based on the gesture that was received.

Abstract: Systems and methods for dynamically calibrating an array camera to accommodate variations in geometry that can occur throughout its operational life are disclosed. The dynamic calibration processes can include acquiring a set of images of a scene and identifying corresponding features within the images. Geometric calibration data can be used to rectify the images and determine residual vectors for the geometric calibration data at locations where corresponding features are observed. The residual vectors can then be used to determine updated geometric calibration data for the camera array. In several embodiments, the residual vectors are used to generate a residual vector calibration data field that updates the geometric calibration data. In many embodiments, the residual vectors are used to select a set of geometric calibration from amongst a number of different sets of geometric calibration data that is the best fit for the current geometry of the camera array.

Abstract: The present application discloses a method and apparatus for detecting a vehicle contour based on point cloud data. The method includes: acquiring to-be-trained point cloud data; generating label data corresponding to points in the to-be-trained point cloud data in response to labeling on the points in the to-be-trained point cloud, the labeling used to indicate whether each of the points in the to-be-trained point cloud data is on a vehicle contour; training a fully convolutional neural network model based on the points in the to-be-trained point cloud data and the label data corresponding to the points in the to-be-trained point cloud data, to obtain a vehicle detection model; and acquiring to-be-detected point cloud data, and obtaining a detection result corresponding to each to-be-detected point in the to-be-detected point cloud data based on the vehicle detection model. The implementation may achieve an accurate detection of the vehicle contour.

Abstract: A method of rendering content items on a display via an electronic device involves mapping linked content items to a three-dimensional object defined by layout data. The layout data is then transmitted to an electronic device for display.

Abstract: Systems and methods are provided for processing and disseminating video data. A video disseminating portal is provided to show orders for video data, including status information of each order. A control in the portal is provided to launch a video display interface to preview or play an ordered video data. A video cropping tool in the video display interface allows a user to define one more areas within the ordered video data. The cropped video is generated along a pan path. In some embodiments, the cropped video is generated with variable zoom and orientation. The one or more defined areas are used to generate corresponding one or more cropped videos, which are derived from the ordered video data. The location and area of a cropped video is displayed in context of the ordered video and can be previewed using the video display interface. A cropped video is also displayed as an entry in the portal in relation to the entry for the ordered video data.

Abstract: Various embodiments provide techniques for geographic navigation via one or more block views. According to some embodiments, a block view can include a visual image of a geographic location that is visually similar to a panoramic image. In some example implementations, a block view can be scrolled to navigate images of a geographic location. In one or more embodiments, a bubble view can be displayed of one or more locations within the block view. The bubble view can include a zoomed image of one or more aspects of a block view. Further to some embodiments, a map view can be utilized along with the block view and/or the bubble view. The map view can include a two-dimensional representation of the geographic location from an aerial perspective, and can include a more general level of detail concerning the geographic location, such as streets, cities, states, bodies of water, and so on.

Abstract: Methods, systems and computer program products for emulating a laser pointer with a mobile device are provided. Aspects include determining a position of the mobile device in a room having a display screen, determining a location of the display screen in the room, and determining an orientation of the mobile device. Aspects also include calculating a line vector originating from the mobile device and modifying a display on the display screen to include an indicator of a point at which the line vector intersects the display screen based on a determination that the line vector intersects the display screen.

Abstract: Peripheral visualizations are based on various attributes associated with a scene. Characteristics of elements in a scene are determined. Based on these characteristics, the salience of the elements is determined. When the element is salient, then this determination also includes a saliency magnitude of the element. Thereafter, the embodiments determine whether the element's saliency magnitude exceeds a particular saliency threshold. If the magnitude does exceed this threshold, then the embodiments render a corresponding peripheral visualization with the peripheral display(s) proximate the salient element(s).

Abstract: A cross-linkable nitrile rubber composition has a carboxyl group-containing nitrile rubber (A) with an iodine value of 120 or less, polyamine cross-linking agent (B), and at least one compound (C) selected from an aliphatic alcohol (c1) having 1 to 9 carbon atoms, hydroxyl group-containing aromatic compound (c2), and nitrogen-containing heterocyclic compound (c3).

Abstract: A procedure to calibrate a depth-disparity mapping for a plenoptic imaging system. In one aspect, one or more test objects located at known field positions and known depths are presented to the plenoptic imaging system. The plenoptic imaging system captures plenoptic images of the test objects. The plenoptic images include multiple images of the test objects captured from different viewpoints. Disparities for the test objects are calculated based on the multiple images taken from the different viewpoints. Since the field positions and depths of the test objects are known, a mapping between depth and disparity as a function of field position can be determined.

Abstract: The present disclosure relates to methods and systems that may improve and/or modify images captured using multiscopic image capture systems. In an example embodiment, burst image data is captured via a multiscopic image capture system. The burst image data may include at least one image pair. The at least one image pair is aligned based on at least one rectifying homography function. The at least one aligned image pair is warped based on a stereo disparity between the respective images of the image pair. The warped and aligned images are then stacked and a denoising algorithm is applied. Optionally, a high dynamic range algorithm may be applied to at least one output image of the aligned, warped, and denoised images.

Abstract: Processor based systems and methods of defining a scenario event comprising the steps of identifying an event having an event attribute and generalizing the event attribute to define a generalized event whereby the generalized event is the scenario event. In some embodiments, the steps further comprise identifying a first and second event, generalizing a first and second event attribute to define a first and second generalized event and connecting the first and second generalized event in a continuous envelope to create a scenario envelope. Processor based systems and methods of monitoring an activity comprising the steps of monitoring an activity having an activity attribute and comparing the activity attribute to an event envelope to determine a status of the activity relative to the event envelope.

Abstract: A method uses a two-dimensional (2D) camera in two different positions to provide first and second 2D images having three common cardinal points. It further uses a three-dimensional (3D) measuring device to measure two 3D coordinates. The first and second 2D images and the two 3D coordinates are combined to obtain a scaled 3D image.

Abstract: A system and method generates a broadcast image. The method includes receiving a first image captured by a first camera having a first configuration incorporating a first center of projection. The method includes determining a first mapping from a first image plane of the first camera onto a sphere. The method includes determining a second mapping from the sphere to a second image plane of a second virtual camera having a second configuration incorporating the first center of projection of the first configuration. The method includes generating a second image based upon the first image and a concatenation of the first and second mappings.

Abstract: Multiple 3D perspectives are captured on a multilayered two dimensional display. Features on a 3D model are identified and transformed to an edge wireframe snapshot and layering information from an attached components list on a foreground layer.

Abstract: Provided is a residual stress estimation method and a residual stress estimation device which are capable of setting an appropriate analysis range without depending on a user's experience. The residual stress estimation device displays analysis results in which strain generated in a structure is analyzed. A user determines a position and a size of an analysis range based on the analysis results, and inputs the determined position and size of the analysis range and a measured value of residual stress of a cut piece of the structure at a measurement point to the residual stress estimation device. The residual stress estimation device estimates distribution of inherent strain in the analysis range to approximate the inherent strain distribution obtained from the input measured value of the residual stress of the cut piece, thereby estimating the residual stress of the structure based on the inherent strain.

Abstract: A computer-implemented method for generating a three-dimensional (3-D) model of a user. A plurality of images of a user are obtained. An angle of view relative to the user pictured in at least one of the plurality of images is calculated. It is determined whether the calculated angle of view matches a predetermined viewing angle. Upon determining the calculated angle of view matches the predetermined viewing angle, at least one of the plurality of images is selected.

Abstract: Techniques for area of interest subscription are described herein. In some examples, a requestor, such as a client or other component, may be focused on a particular area of interest within a virtual space. A requestor may, for example, provide information indicating its area of interest within the virtual space. This information may then be used to determine one or more sub-spaces that are at least partially included within the area of interest. The requestor may then be subscribed to each sub-space that is at least partially included within the area of interest. When subscribed to a sub-space, object registration information indicating one or more objects that are registered to the sub-space may be received from one or more sub-space components that are associated with the sub-space.

Abstract: A user device receives an image stream from the user side of the user device and an image stream from a target side of the user device. The user device acquires a coordinate system for the user, acquires its own coordinate system, and relates the two coordinate systems to a global coordinate system. The user device then determines whether the user has moved and/or whether the user device has moved. Movement of the user and/or the user device is used as input modalities to control the user's interactions in the augmented reality environment.

Abstract: A virtual display controller is configured to generate a virtual viewing location within a three-dimensional virtual interface within a virtual environment. Computer pointer input is translated to coordinates on a three-dimensional virtual interface, and interactions with objects and virtualized displays within that interface are passed back to the clients populating those objects.

Abstract: A staged camera traversal for navigating a virtual camera in a three dimensional environment is provided. The staged camera traversal can include a launch stage and an approach stage. During the launch stage, the tilt angle can be decreased towards zero tilt (i.e. straight down) with respect to the vertical. During an approach stage, the tilt angle of the virtual camera can be increased from about zero tilt towards the tilt angle associated with a target location. In certain implementations, the staged camera traversal can further include a traversal stage occurring between the launch stage and the approach stage. The tilt angle of the virtual camera can be maintained at about zero tilt during the traversal stage. The approach path of the virtual camera can be aligned along a view direction associated with the target destination during the approach stage.

Abstract: The present invention provides a method of binocular depth perception based on active structured light, adopting a coded pattern projector to project a coded pattern for structured light coding of the projective space or target object (characteristic calibration), then obtaining the coded pattern by means of two cameras on the same baseline and respectively located symmetrically on both sides of the coded pattern projector, after preprocessing and projection shadow detection, estimating the block matching movement in two modes based on the image blocks (binocular block matching and automatic matching) to obtain the offset of the optimal matching block, finally working out the depth value according to the formula for depth calculation and compensating the depth of the projection shadows to generate high-resolution and high-precision depth information.

Abstract: A position and rotation information acquisition unit 730 acquires information relating to a position and a rotation of the head of a user who wears a head-mounted display unit 100. A coordinate transformation unit 740 and a panorama image processing unit 750 generate an image to be displayed on the head-mounted display unit using the information relating to the position and the rotation acquired at a certain point of time by the position and rotation information acquisition unit 730. A correction processing unit 780 corrects the generated image using updated information relating to the position and the rotation at a different point of time.

Abstract: A computing system causes a plurality of display devices to display user interfaces containing portions of a canvas shared by a plurality of users. The canvas is a graphical space containing discrete graphical elements located at arbitrary locations within the canvas. Each of the discrete graphical elements graphically represents a discrete resource. When a user interacts with a resource in the set of resources, the computing system modifies the canvas to include an interaction element indicating that the user is interacting with the resource. The computer system then causes the display devices to update the user interfaces such that the user interfaces reflect a substantially current state of the canvas. In this way, the users may be able to understand which ones of the users are interacting with which ones of the resources.

Abstract: A novel electronic system provides fast three-dimensional model generation, social content sharing of dynamic three-dimensional models, and monetization of the dynamic three-dimensional models created by casual consumers. In one embodiment, a casual consumer utilizes a dedicated real-time 3D model reconstruction studio with multiple camera angles, and then rapidly create dynamic 3D models with novel computational methods performed in scalable graphics processing units. In another embodiment, uncalibrated multiple sources of video recording of a targeted object are provided by a plurality of commonly-available consumer video recording devices (e.g. a smart phone, a camcorder, a digital camera, etc.) located at different angles, after which the uncalibrated multiple sources of video recording are transmitted to a novel cloud computing system for real-time temporal, spatial, and photometrical calibration and 3D model reconstruction.

Abstract: Some embodiments provide a user interface that includes a top page having an x-axis and a y-axis that extend at least partially along horizontal and vertical directions, and an imaginary z-axis that extends into the depth of the top page. The user interface of some embodiments includes a first subpage that is accessible from a top page and a second subpage, which is further in depth along the z-axis than the first subpage, that is accessible from the first subpage. The top page may change in appearance throughout the duration of time when at least the first subpage is shown to place focus away from the top page.

Abstract: A method of interacting with a simulated object the method comprising: generating a simulation of the object; displaying the simulation on a first display device; interacting with the simulation on the first display device; capturing a representation of the simulation from the first display device for display on a second display device; displaying the representation of the simulation on the second display device; interacting with the representation of the simulation on the second display device.

Abstract: A system and method of capturing a stereoscopic pair of images for use in forming a 3-D image of an object at a desired perceived position in a scene projected onto a dome surface. The first one of the stereoscopic pair of images is captured when the object is offset to the right of the desired perceived position in the scene. The second one of the stereoscopic pair of images is captured when the object is offset to the left of the desired perceived position in the scene. In this manner, positive parallax can be captured in front of a viewer, upward in an arc through the zenith of the dome, and beyond to the back of the dome. The system and method allows scenes projected onto a dome surface to contain positive parallax, and therefore allows objects to appear to be located beyond the dome surface when viewed in 3-D stereo, which was previously not possible.

Abstract: An imaging system is configured to identify an object represented by a plurality of preliminary images. The preliminary images are each associated with a different camera imaging channel, and include different image information. An object distance is determined based on the difference in preliminary image information. An object shift is determined based on the object distance and a pre-determined relationship between object shift and object distance. The object shift is applied to the portions of one or more preliminary images representing the object to form shifted preliminary images, and the shifted preliminary images are combined to form a final image.

Abstract: A method for building a depth map is operable on a mobile device having a single camera integrated therewith. The method includes capturing a plurality of images of a given view using movement of the mobile device between images, capturing data regarding the movement of the mobile device during capture of the plurality of images, determining a relative position of the mobile device corresponding to each of the plurality of images, and building a depth map using the plurality of images and the relative position corresponding to each of the plurality of images.

Abstract: Interior scan and exterior photos are jointly visualized in medical imaging. One or more cameras are mounted to the internal medical scanner, allowing a photograph to be taken while or in temporal proximity to when the internal region of the patient is scanned. An image associating the exterior photographs with the interior region of the patient is presented to assist in diagnosis. Due to the spatial and temporal proximity, the image may be a visualization formed by combining the photograph and interior scan data.

Abstract: Systems and methods for reducing motion blur in images or video in ultra low light with array cameras in accordance with embodiments of the invention are disclosed. In one embodiment, a method for synthesizing an image from multiple images captured using an array camera includes capturing image data using active cameras within an array camera, where the active cameras are configured to capture image data and the image data includes pixel brightness values that form alternate view images captured from different viewpoints, determining sets of corresponding pixels in the alternate view images where each pixel in a set of corresponding pixels is chosen from a different alternate view image, summing the pixel brightness values for corresponding pixels to create pixel brightness sums for pixel locations in an output image, and synthesizing an output image from the viewpoint of the output image using the pixel brightness sums.

Abstract: One embodiment of the present invention sets forth a technique for managing graphics processing resources in a tile-based architecture. The technique includes storing a release packet associated with a graphics processing resource in a buffer and initiating a replay of graphics primitives stored in the buffer and associated with the graphics processing resource. The technique further includes, for each tile included in a plurality of tiles and processed during the replay, reading the release packet and determining whether the tile is a last tile processed during the replay. The technique further includes determining not to transmit the release packet to a screen-space pipeline and continuing to read graphics data stored in the buffer if the tile is not the last tile to be processed during the replay, or transmitting the release packet to the screen-space pipeline if the tile is the last tile to be processed during the replay.

Abstract: One embodiment of the present invention sets forth a technique for correcting color values. The technique includes downsampling first color space values to generate downsampled color space values and upsampling the downsampled color space values to generate second color space values. The technique further includes modifying at least one component value included in the downsampled color space values based on a first component value included in the first color space values, a second component value included in the second color space values, and an approximation of a nonlinear transfer function.

Abstract: Apparatus and methods for disparity cost computation for a stereoscopic image. In an example, a method includes computing partial path matching costs for multiple disparities of pixels of multiple parallelogram blocks of an image in a forward pass direction. Between computing the partial path matching costs of the pixels of adjacent parallelogram blocks, the method includes computing partial path matching costs for the plurality of disparities of pixels along a boundary edge of a corresponding rectangular tile using paths that are external to the rectangular tile and computing partial path matching costs the disparities for all of the pixels of the corresponding rectangular tile. The method also includes computing total aggregated disparity costs for each disparity of the pixels of the image using the partial path matching costs computed for the pixels in the parallelogram blocks and in the rectangular tiles.

Abstract: A system operable to generate a surround view based on image data, where the image data may include image data associated with surroundings of an object, such as a vehicle. The system may also be operable to project the surround view inversely onto a bowl-shaped projection surrounding the object. Further, the system may be operable to generate a virtual user view via a virtual camera position, where the virtual camera position is on a first horizontal ellipse that is about the bowl-shaped projection at a first height. Also, the system is operable to determine a viewing direction from the virtual camera position that points at a location on a second horizontal ellipse that is about the bowl-shaped projection at a second height. The second height may be lower than the first height and the second horizontal ellipse may be smaller than the first horizontal ellipse.

Abstract: A method and device for displaying an image are provided. The method includes acquiring block importance values of a plurality of blocks corresponding to an image, determining a reference region including at least one block among the plurality of blocks based on the acquired block importance values and a predetermined reference, determining a main region that includes the reference region and has a predetermined shape and a predetermined size, based on the block importance values, and displaying a portion of the image corresponding to the main region.

Abstract: An interpolation processing unit 31 performs an interpolation process of a decimated pixel in an image signal. A signal generation pixel determination unit 32 calculates a feature value of a pixel of interest from the image signal to which the interpolation process is performed by the interpolation processing unit 31, and determines whether the pixel of interest is a decimated pixel or a non-decimated pixel on the basis of the calculated feature value, and generates signal generation pixel determination information indicating a determination result. A signal generation control unit 34 performs control to stop signal generation operation of the pixel that is determined to be the decimated pixel by the signal generation pixel determination information generated by the signal generation pixel determination unit 32, at a time of subsequent generation of an image signal.

Abstract: A multi-pulse transformer with multiple taps provides a constant magnitude voltage output to a variable speed chiller's compressor motor over a range of input voltages. The 3-phase transformer includes primary windings and a plurality of secondary windings. The secondary windings are electromagnetically coupled with the associated primary winding. The primary windings include taps for receiving multiple input AC voltages and the secondary windings have a single output terminal for supplying a predetermined output voltage which, after rectification produces a DC multi-pulse waveform for powering a DC link of a variable speed drive. Alternatively the 3-phase transformer includes multiple taps on the secondary windings. Each of the primary windings has a terminal for receiving an input AC voltage. The taps of the secondary windings provide an output voltage that is converted to a multi-pulse waveform for powering a DC link of a variable speed drive.

Abstract: Enhanced removing of noise and outliers from one or more point sets generated by image-based 3D reconstruction techniques is provided. In accordance with the disclosure, input images and corresponding depth maps can be used to remove pixels that are geometrically and/or photometrically inconsistent with the colored surface implied by the input images. This allows standard surface reconstruction methods (such as Poisson surface reconstruction) to perform less smoothing and thus achieve higher quality surfaces with more features. In some implementations, the enhanced point-cloud noise removal in accordance with the disclosure can include computing per-view depth maps, and detecting and removing noisy points and outliers from each per-view point cloud by checking if points are consistent with the surface implied by the other input views.

Abstract: Systems, methods, and computer readable media to promote a graphics context when rendering a digital image content with dynamic ranges and/or color gamut outside the current graphics context. Various embodiments render digital image content based on a graphics context that corresponds to an initial image rendering format. During the rendering process a determination is made that indicates the quality of the digital image content exceeds the graphics context's initial capabilities. The various embodiments can select an updated image rendering format based on the quality of the digital image and expand the graphic context's capabilities to correspond with the updated image rendering format.

Abstract: A method and computing device for displaying surgical path data are provided. The computing device includes an input device, a display, a memory and a processor. The memory stores (i) an image of a volume of patient tissue having an outer surface, and (ii) anatomical data defining anatomical features of the volume. The processor receives an identifier of a target location within the volume; generates a plurality of paths from the outer surface to the target location, each path having a start point located on the outer surface, and an end point at the target location; for each of the plurality of paths, determines a score based on a comparison between the path and the anatomical data; and controls the display to present the outer surface and, at the locations of the start points, indications of the respective scores of the paths corresponding to the start points.

Abstract: A system and method may display an image stream, where an original image stream may be divided into two or more subset images streams, each subset image stream being displayed simultaneously or substantially simultaneously. The images may be displayed fused. The images may be collected from an ingestible capsule traversing the GI tract.

Abstract: The perception of a displayed image is altered for viewers moving relative to the position of the display system screen, thereby imparting a sense of three-dimensional immersion in the scene being displayed. A display generator generates a scene having foreground and background elements, and a display screen displaying the scene. A sensor detects the position of a viewer relative to the display screen, and a processor is operative to shift the relative position of the foreground and background elements in the displayed scene as a function of viewer position, such that the viewer's perspective of the scene changes as the viewer moves relative to the display screen. The foreground and background elements may be presented in the form of multiple superimposed graphics planes, and/or a camera may be used to record the scene through panning at sequential angles.

Abstract: Examples of time-of-flight (“TOF”) simulation of multipath light phenomena are described. For example, in addition to recording light intensity for a pixel during rendering, a graphics tool records the lengths (or times) and segment counts for light paths arriving at the pixel. Such multipath information can provide a characterization of the temporal light density of light that arrives at the pixel in response to one or more pulses of light. The graphics tool can use stratification and/or priority sampling to reduce variance in recorded light path samples. Realistic, physically-accurate simulation of multipath light phenomena can, in turn, help calibrate a TOF camera so that it more accurately estimates the depths of real world objects observed using the TOF camera. Various ways to improve the process of inferring imaging conditions such as depth, reflectivity, and ambient light based on images captured using a TOF camera are also described.

Abstract: Techniques are provided for integrated content presentation via cells arranged geometrically in a cellular environment. Users can navigate various orientations and zoom states of the cellular environment to access information via different applications, different media types, different visual representations and from different underlying content sources. The information can be organized according to various logical relationships. Upon receiving an indication of a zoom state associated with a cell or a group of cells arranged in the cellular environment, a content reference at that zoom state is retrieved. Further, the content reference is resolved to retrieve and output content, including a visual representation associated with the zoom state.

Abstract: An image processing system defines an M×N grid for each of source and destination images. The system selects a pixel location in a grid location in the destination image. The system forms a bounding box using two diagonally opposite vertices of the grid location. The system forms a quadrilateral connecting vertices of the grid location. The system determines whether the selected pixel location falls inside or outside the quadrilateral in the bounding box. If the selected pixel location falls inside the quadrilateral in the bounding box, the system determines coordinates of the selected pixel location as percentages of two sides of the quadrilateral connected to one of the diagonally opposite vertices. The system locates a pixel in a corresponding grid location in the source image using the coordinates. The system maps the pixel found in the source image to the selected pixel location in the destination image.