Abstract: Apparatus and methods are described including a processor (20) configured to receive first and second sets of extraluminal images of a lumen, the second set being acquired while an endoluminal device is being moved through the lumen. The processor designates at least one of the first set of images as a roadmap image, and designates, within the lumen in the roadmap image, a roadmap pathway (42). A plurality of features (44, 46, 48, 50) that are visible within at least some of the second set of extraluminal images are identified, and an arrangement of three or more of the features within the image are compared to a shape of at least a portion of the roadmap pathway. Based upon the comparing, the identified features are mapped to locations along the roadmap pathway within the roadmap image. Other applications are also described.

Abstract: The present disclosure relates to a device for verifying estimated depth information. The device obtains an image of a scene, wherein the image comprises at least one object of interest having a set of points, obtains a height information for at least one point from the set of points of the object of interest, and estimates a first depth information for the at least one point, based on the obtained height information and detects a corresponding position of the at least one point in the obtained image. The device further receives, from another device, a second depth information for the at least one point, and determines a validity of the estimated second depth information, based on determining a measure of dissimilarity between the first depth information and the second depth information for the at least one point.

Abstract: Various embodiments of systems and methods allow a system to identify subsets of items by mixing and matching identified features in one or more other items. A system can identify features of items in an item database. The system can then calculate “fingerprints” of these features which are vectors describing the characteristics of the features. The system can present a collection of items and a user can select an item of the collection. The user can then select positive features to include in a search and/or negative features to include in the search. The system can then do a search of the database for items that contain features similar to those positive features and do not contain features similar to those negative features. The user can select features through a variety of means.

Abstract: Techniques are generally described for predicting text relevant to image data. In various examples, the techniques may include receiving image data comprising a first portion. The first portion of the image data may correspond to a first plurality of pixels when rendered on the display. Text data comprising a first text related to the first portion of the image data may be received. A first vector representation of the first portion of the image data may be determined. In some examples, a correspondence between the first portion of the image data and the first text may be determined based at least in part on the first vector representation. A first identifier of the first portion of image data may be stored in a data structure in association with a second identifier of the first text.

Abstract: Techniques for providing an in-place scrolling feature are described herein. Input via a user interface may be received to update first images of first items to second images of second items where the first images are presented in a focus location of the user interface. Feature vectors may be calculated for each image associated with the first items and the second items using a neural network algorithm. The feature vectors may include a plurality of values that represent each image of the first items and the second items. Candidate images may be determined from the second images based on a distance in a feature vector space between the feature vectors of the candidate images and the feature vectors of the second images. The user interface may be updated to transition from presenting the first images to a portion of the candidate images in the focus location of the user interface.

Abstract: Apparatus and methods are described for use with a tool that is inserted into a portion of a body of a subject that undergoes cyclic motion. The apparatus and methods include using an imaging device, acquiring a plurality of images of the tool inside the portion of the body, at respective phases of the cyclic motion. Using at least one computer processor, an extent of movement of the tool with respect to the portion of the body that is due to the cyclic motion of the portion of the body is determined. In response thereto, an output is generated that is indicative of the determined extent of the movement of the tool with respect to the portion of the body. Other applications are also described.

Abstract: Apparatus and methods are described for use with a tool that is inserted into a portion of a body of a subject that undergoes cyclic motion. The apparatus and methods include using an imaging device, acquiring a plurality of images of the tool inside the portion of the body, at respective phases of the cyclic motion. Using at least one computer processor, an extent of movement of the tool with respect to the portion of the body that is due to the cyclic motion of the portion of the body is determined. In response thereto, an output is generated that is indicative of the determined extent of the movement of the tool with respect to the portion of the body. Other applications are also described.

Abstract: Techniques for prioritizing images associated with an item to display an appropriate image based on a query are described herein. For example, an attention score for an item attribute in an image of an item may be generated based at least in part on a model that uses one or more images of the item. The item attribute for the item associated with a query may be obtained. A plurality of items may be determined based at least in part on the item attribute being associated with the plurality of items where an individual item of the plurality of items includes a plurality of images of the item. The plurality of images of the individual item may be ranked based at least in part on corresponding attention scores associated with each image of the plurality of images.

Abstract: Apparatus and methods are described including a processor (20) configured to receive first and second sets of extraluminal images of a lumen, the second set being acquired while an endoluminal device is being moved through the lumen. The processor designates at least one of the first set of images as a roadmap image, and designates, within the lumen in the roadmap image, a roadmap pathway (42). A plurality of features (44, 46, 48, 50) that are visible within at least some of the second set of extraluminal images are identified, and an arrangement of three or more of the features within the image are compared to a shape of at least a portion of the roadmap pathway. Based upon the comparing, the identified features are mapped to locations along the roadmap pathway within the roadmap image. Other applications are also described.

Abstract: Apparatus and methods are described including a processor (20) configured to receive first and second sets of extraluminal images of a lumen, the second set being acquired while an endoluminal device is being moved through the lumen. The processor designates at least one of the first set of images as a roadmap image, and designates, within the lumen in the roadmap image, a roadmap pathway (42). A plurality of features (44, 46, 48, 50) that are visible within at least some of the second set of extraluminal images are identified, and an arrangement of three or more of the features within the image are compared to a shape of at least a portion of the roadmap pathway. Based upon the comparing, the identified features are mapped to locations along the roadmap pathway within the roadmap image. Other applications are also described.

Abstract: Techniques for providing an in-place scrolling feature are described herein. Input via a user interface may be received to update first images of first items to second images of second items where the first images are presented in a focus location of the user interface. Feature vectors may be calculated for each image associated with the first items and the second items using a neural network algorithm. The feature vectors may include a plurality of values that represent each image of the first items and the second items. Candidate images may be determined from the second images based on a distance in a feature vector space between the feature vectors of the candidate images and the feature vectors of the second images. The user interface may be updated to transition from presenting the first images to a portion of the candidate images in the focus location of the user interface.

Abstract: Various embodiments of systems and methods allow a system to identify subsets of items by mixing and matching identified features in one or more other items. A system can identify features of items in an item database. The system can then calculate “fingerprints” of these features which are vectors describing the characteristics of the features. The system can present a collection of items and a user can select an item of the collection. The user can then select positive features to include in a search and/or negative features to include in the search. The system can then do a search of the database for items that contain features similar to those positive features and do not contain features similar to those negative features. The user can select features through a variety of means.

Abstract: Various embodiments of systems and methods allow a system to identify subsets of items by mixing and matching identified features in one or more other items. A system can identify features of items in an item database. The system can then calculate “fingerprints” of these features which are vectors describing the characteristics of the features. The system can present a collection of items and a user can select an item of the collection. The user can then select positive features to include in a search and/or negative features to include in the search. The system can then do a search of the database for items that contain features similar to those positive features and do not contain features similar to those negative features. The user can select features through a variety of means.

Abstract: Techniques for prioritizing images associated with an item to display an appropriate image based on a query are described herein. For example, an attention score for an item attribute in an image of an item may be generated based at least in part on a model that uses one or more images of the item. The item attribute for the item associated with a query may be obtained. A plurality of items may be determined based at least in part on the item attribute being associated with the plurality of items where an individual item of the plurality of items includes a plurality of images of the item. The plurality of images of the individual item may be ranked based at least in part on corresponding attention scores associated with each image of the plurality of images.

Abstract: Apparatus and methods are described for use with an endoluminal data-acquisition device configured to be moved through a lumen, the device having a radiopaque marker coupled thereto. While the device is being moved through the lumen (a) endoluminal data points of the lumen are acquired using the device, (b) contrast agent is continuously injected into the lumen, and (c) angiographic images of the device are acquired. It is determined that endoluminal data points correspond to respective locations within the lumen, by determining locations of the radiopaque marker within the angiographic images of the lumen, by performing image processing on the angiographic images, the locations of the radiopaque marker within the angiographic images of the lumen corresponding to respective endoluminal data points. Other applications are also described.

Abstract: Apparatus and methods are described for use with an endoluminal data-acquisition device having a radiopaque portion coupled thereto, including, while the endoluminal data-acquisition device is being moved through the lumen, acquiring a plurality of endoluminal data points of the lumen using the endoluminal data-acquisition device. A combined extraluminal image of the lumen is generated that contains images of the radiopaque portion at first and second locations within the lumen, by co-registering first and second extraluminal images with each other. At least one location on the combined extraluminal image is identified as corresponding to a location within the lumen at which a given one of the endoluminal data points was acquired, by identifying the first and second locations of the radiopaque portion within the combined extraluminal image. An output is generated, in response thereto. Other applications are also described.

Abstract: Apparatus and methods are described for use with an input angiogram image of a device inserted inside a portion of subject's body, the angiogram image being acquired in the presence of contrast agent. At least one processor (11) includes background-image-generation functionality (13) configured to generate a background image in which a relative value is assigned to a first pixel with respect to a second pixel, at least partially based upon relative values of surroundings of the first pixel and the surroundings of the second pixel in the input image. Cleaned-image-generation functionality (14) generates a cleaned image in which visibility of the radiopaque portions of the device is increased relative to the input image, by dividing the input image by the background image. Output-generation functionality (15) drives a display (16) to display an output based upon the cleaned image. Other applications are also described.

Abstract: Apparatus and methods are described including acquiring a plurality of image frames of a portion of a subject's body. At least one of the image frames is designated as a baseline image frame, a shape of the portion in the first baseline image frame being designated as a baseline shape. A non-baseline-shape image frame is deformed, such that the shape of the portion becomes more similar to the baseline shape of the portion than when the portion in the non-baseline-shape image frame is not deformed. A composite image is formed that is of higher clarity with respect to anatomy of the portion, relative to each of the acquired image frames, by averaging at least the deformed non-baseline-shape image frame with the baseline image frame. The composite image is displayed on a display. Other applications are also described.

Abstract: Apparatus and methods are described for use with an endoluminal data-acquisition device having a radiopaque portion coupled thereto, including, while the endoluminal data-acquisition device is being moved through the lumen, acquiring a plurality of endoluminal data points of the lumen using the endoluminal data-acquisition device. A combined extraluminal image of the lumen is generated that contains images of the radiopaque portion at first and second locations within the lumen, by co-registering first and second extraluminal images with each other. At least one location on the combined extraluminal image is identified as corresponding to a location within the lumen at which a given one of the endoluminal data points was acquired, by identifying the first and second locations of the radiopaque portion within the combined extraluminal image. An output is generated, in response thereto. Other applications are also described.

Abstract: Apparatus and methods are described for use with a tool that is inserted into a portion of a body of a subject that undergoes cyclic motion. The apparatus and methods include using an imaging device, acquiring a plurality of images of the tool inside the portion of the body, at respective phases of the cyclic motion. Using at least one computer processor, an extent of movement of the tool with respect to the portion of the body that is due to the cyclic motion of the portion of the body is determined. In response thereto, an output is generated that is indicative of the determined extent of the movement of the tool with respect to the portion of the body. Other applications are also described.