Abstract: Recorded video is accessed from printed notes or summaries derived from the video. Summaries may be created automatically by analyzing the recorded video, and annotations are made by a user on a device for note-taking with digital ink and video. The notes and/or summaries are printed along with data glyphs that provide time based indexes or offsets into the recorded video. The indexes or offsets are retrieved by scanning the glyph on the printout. The glyph information can be embedded in the printouts in many ways. One method is to associate block glyphs with annotations or images on the printed pages. Another method is to provide an address carpet in an annotated timeline. Yet another method is to provide a two-dimensional address carpet with X-Y position mapped to time which can be used to provide selected access to the video. The accessed video may be played back on the note-taking device on a pen computer, or on a summary interface on a Web browser-type device.

Abstract: An embedded data code comprises periodic tiles having occlusions. In one embodiment, each tile is comprised of glyphs encoding a first code system. The occlusions are comprised of information, such as glyphs encoding a second code system, graphics, or text. The occlusions may occur periodically in each tile. A reading device may be used to capture an image of a portion of the substrate that includes a tile. A processor then analyzes the image to determine the tile code pattern and decode the tiled code.

Abstract: A system and method for generating information based on decoded embedded data from a substrate is implemented by reading embedded data from a substrate, decoding the embedded data to determine registration of the substrate relative to a reference in an apparatus, and developing and presenting human-sensible information based on the registration information. In one embodiment, the human-sensible information is visual information registered with the substrate. The human-sensible information may also comprise, for example, tactile, audible, or other sensory information.

Abstract: A viewport lens displays registered information registered using embedded data. An image capture device captures an image from the substrate that includes embedded data. The embedded data in the captured image is decoded to create information regarding the substrate, such as location, orientation, or a label. Based on the information regarding the substrate, information is generated that is registered with the substrate. In one embodiment, the information is registered with the substrate by optically combining the generated information with substrate information in a viewport lens.

Abstract: A mouse incorporating a camera captures an image of embedded data from a substrate under the mouse. The embedded data in the image is decoded to determine address or location information coded in the embedded data. Based on the decoded information and other user input signals, such as mouse button selection signals, the computer executes operations. The mouse also has a display controlled by the computer for providing visual feedback to a user. The display might generate an image of the substrate area under the mouse, making it appear to the user as if they are looking through the mouse directly onto the substrate. The display may also generate visual feedback regarding operations occurring in the computer, such as selection or other computer operations.

Abstract: A method of decoding a plurality of glyphs comprising the steps of scanning a group of glyphs to form image data for expected glyph locations, assigning for each location a first value indicative of the likelihood that location contains a glyph in a first state, assigning for each location a second value indicative of the likelihood that location contains a glyph in a second state, determining the difference between the first and second values for each potential glyph location, establishing a distribution analysis of the determined differences and using that distribution analysis at least in part to control decoding of the plurality of glyphs.

Abstract: An angular orientation of a lattice image pattern is found by forming a composite image of superimposed portions of a lattice image by aligning centroids of a lattice element in each portion, and determining a lattice axis from a line fit through centroids of lattice elements in the composite image. The composite image is formed by selecting a seed pixel, finding a local minimum near the seed pixel and then finding a centroid based on the local minimum. From the centroid, it is determined whether the glyph centroid has sufficient contrast to be included in the composite image. The composite image is formed by superimposing subsamples of the lattice image based on glyph centroids. The composite image is then analyzed to determine a lattice axis through centroids in the composite image, and determining a quadrant image based on the lattice axis.

Abstract: A system and method for generating information based on decoded embedded data from a substrate is implemented by reading embedded data from a substrate, decoding the embedded data to determine registration of the substrate relative to a reference in an apparatus, and developing and presenting human-sensible information based on the registration information. In one embodiment, the human-sensible information is visual information registered with the substrate. The human-sensible information may also comprise, for example, tactile, audible, or other sensory information.

Abstract: A viewport lens displays registered information registered using embedded data. An image capture device captures an image from the substrate that includes embedded data. The embedded data in the captured image is decoded to create information regarding the substrate, such as location, orientation, or a label. Based on the information regarding the substrate, information is generated that is registered with the substrate. In one embodiment, the information is registered with the substrate by optically combining the generated information with substrate information in a viewport lens.

Abstract: An embedded data code comprises periodic tiles having occlusions. In one embodiment, each tile is comprised of glyphs encoding a first code system. The occlusions are comprised of information, such as glyphs encoding a second code system, graphics, or text. The occlusions may occur periodically in each tile. A reading device may be used to capture an image of a portion of the substrate that includes a tile. A processor then analyzes the image to determine the tile code pattern and decode the tiled code.

Abstract: Apparatus, methods, and articles of manufacture consistent with the present invention provide a user interface for data processing systems wherein occlusion glyph code tilings are used to facilitate the accurate extraction of user selection information from a substrate while presenting user interface graphics to the user. The tiled code system in the present invention is comprised of tiles, with tiled code regions and occlusion regions. In one embodiment, a first tiled code system facilitates robust decoding of the substrate with a suitable image capture. The occlusions are comprised of user interface graphics for user selection and information, such as glyphs encoding a second code system. The occlusion regions occur periodically in each tile. The tiled code pattern can be used to implement a graphical user interface. A user uses a selection device to capture an image of a portion of the substrate that includes portions of tiled codes to complete a tile.

Abstract: A user interface is implemented using visual indicia and a background for the visual indicia that encodes address information. The background appears visually as a stipple pattern, but is implemented using glyphs which form an address carpet that encodes address information uniquely identifying each location of the user interface. An image capture device is used to capture an area of the address carpet that is at or near visual indicia of interest to the user while selecting a location in the visual indicia. The image capture device captures the area of interest, and transmits the image area to a computer for processing. The computer first determines the proper orientation of the image, and then decodes the information encoded by the glyphs. The decoding results in an X, Y address identifying the location of the captured area in the address carpet and, by reference, the address of the selected location. Based on the address, the computer may perform an operation associated with the area.

Abstract: A camera pen is made from a pen-like housing contains a camera and has a button for sending a signal to a computer which directs the camera to capture an image. The pen-like housing includes landing gear on one end. The landing gear has an opening which forms a flat surface that is angled such that when a user places the camera pen on a surface, the angle at which the pen rests on the surface is ergonomically comfortable for the user. Furthermore, the camera is oriented toward the opening so that when the user presses the button indicating a desire to capture an image, the camera captures the image in the opening. By combining a camera with a pen-like device, the user can comfortably capture image information from a surface.

Abstract: A captured image includes a portion of a set of two-dimensional address codes. The portion of address codes can be decoded to determine a discrete pointer uniquely defining the portion. The captured image is first processed to determine the orientation of the portion, and then decoded based on the orientation to determine the discrete pointer. To determine the orientation of the portion, the portion is first analyzed to determine values at discrete locations within the portion. The values at each location form a matrix of binary data. The values of the matrix are then correlated to determine an orientation of the captured portion of two dimensional address codes. After determining the orientation of the portion, the values can be further analyzed to determine a discrete pointer that identifies the location of the portion within the address space defined by the two-dimensional address codes.

Abstract: An optically readable record for storing encoded information comprises (1) a recording medium, (2) a self-clocking data code for encoding the information, with this data code being composed of glyphs that are written in a two dimensional code field on the recording medium on centers that are spatially distributed in nominal accordance with a predetermined spatial formatting rule. The glyphs are defined by respective symbols that are selected from a finite set of optically discriminable symbols to encode the information. Further, there is at least one additional glyph pattern that is written on the recording medium in nominal accordance with the aforementioned spatial formatting rule, with this additional code pattern being discriminable from the data code and being selected to disambiguate data codes that are rotated and/or reflected.

Abstract: A self-clocking glyph code is provided for encoding n-bit long digital values (where n>1) in a logically ordered sequence of composite glyphs that are written, printed, or otherwise recorded on a hardcopy recording medium in accordance with a predetermined spatial formatting rule. As used herein, a "composite glyph" is a graphical symbol that has a plurality of predefined, substantially orthogonal, graphical characteristics; each of which is capable of assuming any one of a plurality of predefined graphical states. An n-bit long digital value is distributively encoded in a glyph of this type by decomposing its n-bits, prior to or during the encoding, into a plurality of shorter, ordered, non-overlapping bit strings. The digital values of these bit strings, in turn, are encoded in the states of respective graphical characteristics of the composite glyph in a predetermined logical order, thereby preserving the logical ordering of the bit strings.

Abstract: An optically readable record for storing encoded information comprises (1) a recording medium, (2) a self-clocking data code for encoding the information, with this data code being composed of glyphs that are written in a two dimensional code field on the recording medium on centers that are spatially distributed in nominal accordance with a predetermined spatial formatting rule, where the glyphs are defined by respective symbols that are selected from a finite set of optically discriminable symbols to encode the information, and (3) a self-clocking synchronization code pattern that is written on the recording medium to fully frame at least a portion of the data code, with this the synchronization code pattern defining multiple paths of self-clocking glyphs for reaching any given glyph of synchronization code pattern from any other glyph thereof.

Abstract: An optically readable record for storing encoded information comprises (1) a recording medium, (2) a self-clocking data code for encoding the information, with this data code being composed of glyphs that are written in a two dimensional code field on the recording medium on centers that are spatially distributed in nominal accordance with a predetermined spatial formatting rule, where the glyphs are defined by respective symbols that are selected from a finite set of optically discriminable symbols to encode the information, and (3) at least one additional glyph pattern that is written on said recording medium in nominal accordance with the spatial formatting rule, the additional code pattern providing physical addressing information for random access from any given location within the glyph pattern to any other given location within the same glyph pattern or another glyph pattern on the same or a differnt recording medium.