Abstract: This application is directed to a method for automatically identifying and transferring relevant image data implemented at a server with a processor and memory including one or programs executable by the processor. The server obtains content items from a personal content collection of a user, analyzes the content items to identify attributes associated with the images, generates rule sets based on the identified attributes, applies the generated rule sets to a plurality of unclassified images, identifies a first set of one or more of the unclassified images, associates each image of the first set with the content items and stores the first set in the personal content collection. A second set of unclassified images is placed in a candidate list to be periodically, without user intervention, monitored and updated for storing in the personal content collection. The generated rule sets are updated after images are stored in the content collection.

Abstract: Automatically scanning multiple document sheets with a camera includes receiving a video stream while the camera is pointed at the multiple document sheets, detecting presence of a first top page of the multiple document sheets based on the video stream, taking a still photograph of the first top page in response to detecting presence of the first top page, detecting presence of a second top page based on the video stream by confirming that the second top page is different from the first top page and by waiting a predetermined amount of time for an image of the second top page to stabilize, and taking a still photograph of the second top page in response to detecting presence of the second top page. Detecting the pages may include determining that the camera is pointing at the stack of documents and a detected page is not obstructed.

Abstract: This application is directed to recognizing unstructured information based on hints provided by structured information. A computer system obtains unstructured information collected from a handwritten or audio source, and identifies one or more terms from the unstructured information. The one or more terms includes a first term that is ambiguous. The computer system performs a recognition operation on the first term to derive a first plurality of candidate terms for the first term, and obtains first contextual information from an information template associated with the unstructured information. In accordance with the first contextual information, the computer system selects a first answer term from the first plurality of candidate terms, such that the first term is recognized as the first answer term.

Abstract: Enhancing image quality of an initial full image of a document includes subdividing the initial full image of the document into a number of segments, determining at least one of the segments for enhancement, directing a user to take photographs with a smartphone to provide a separate segment image for the at least one of the segments by presenting on a screen of the smartphone a view of the document having lines superimposed thereon corresponding to the segments, and merging the separate segment image to provide an enhanced full image. The number of segments may depend upon a size of text in the initial full image and a desired height of text in the enhanced full image. The view of the document having lines superimposed thereon corresponding to the segments may provide a target to the user for photographing the at least one of the segments.

Abstract: Enhancing image quality of an initial full image of a document includes subdividing the initial full image of the document into a number of segments, directing a user to take photographs with a smartphone to provide a separate segment image for each of the segments by presenting on a screen of the smartphone a view of the document having lines superimposed thereon corresponding to the segments, and merging the separate segment images to provide an enhanced full image. The number of segments may depend upon a size of text in the initial full image and a desired height of text in the enhanced full image. The initial full image may be provided by a photograph taken by the user with the smartphone. The view of the document having lines superimposed thereon corresponding to the segments may provide a target to the user for photographing the segments.

Abstract: Automatically scanning multiple document sheets with a camera includes receiving a video stream while the camera is pointed at the multiple document sheets, detecting presence of a first top page of the multiple document sheets based on the video stream, taking a still photograph of the first top page in response to detecting presence of the first top page, detecting presence of a second top page based on the video stream by confirming that the second top page is different from the first top page and by waiting a predetermined amount of time for an image of the second top page to stabilize, and taking a still photograph of the second top page in response to detecting presence of the second top page. Detecting the pages may include determining that the camera is pointing at the stack of documents and a detected page is not obstructed.

Abstract: Mitigating glare in connection with photographing a document using a camera includes assessing a first amount of glare that would result if a user were to take a snapshot at a first camera position and lighting conditions, if the first amount of glare is below a predetermined threshold, taking a snapshot with the camera, and, if the first amount of glare is above the predetermined threshold, continuously prompting the user to adjust a position of the camera and taking the snapshot when the camera is in a second position and a second amount of glare, different from the first amount of glare, is below the predetermined threshold. The lighting conditions may include effects of external lighting sources. The user may adjust the external lighting sources before taking the snapshot. The lighting conditions may include effects of an internal light source of the camera.

Abstract: Handling data for a photographic image, includes detecting a reference pattern in the data, detecting at least one sticker in the data, determining an action associated with the at least one sticker, and performing the action on the data. The reference pattern may be a uniform grid pattern of dots preprinted on paper. A paper type may be determined according to the reference image. Determining an action associated with the at least one sticker may depend, at least in part, on the paper type. Detecting a particular one of the stickers may cause data for the photographic image to be stored in a particular location. Detecting a particular one of the stickers may cause data for the photographic images to be assigned particular tags used for organizing and searching.

Abstract: Providing access to digitally published data includes creating a note having at least a portion that is handwritten by a first user, converting handwriting of the note into a content access identifier that varies according to the portion that is handwritten by the first user, associating the content access identifier with the digitally published data, and making the digitally published data available to a second user by making the note available to the second user. The digitally published data may be written to a public database and/or a private database. A portion of the note may be pre-printed. A pre-printed distinguishing pattern on the note may indicate that handwritten content corresponds to a content access identifier. The pre-printed portion may be a regular dotted pattern. The note may have a known identifiable color and size.

Abstract: A method and system for on-the-run processing of source data is disclosed. In one embodiment, the system includes an input device to trace the moving object, such as a pen, an on-the-run filter, coupled to the input device, to perform denoising of the source data without noticeable shrinkage of the trace using recursive reparameterization filtering, and a storage device, coupled to the on-the-run filter, to compress and store the data.

Abstract: Adjusting data for photographed images includes detecting a reference image in the data, where the reference image contains a detectable uniformity and adjusting the data according to the reference image. The reference image may be a uniform grid pattern of dots preprinted on paper. A paper type may be determined prior to adjusting the data according to the reference image. The paper type may be determined according to spacing and/or patterns of the dots, and/or layout of page areas covered with dots. Adjusting the data may include removing effects corresponding to a folded corner, a removed corner, an obstructed corner, lens flare spots, and/or a shadow. Positional coordinates of the data may be adjusted by normalizing the grid through a non-linear transformation that eliminates curvature of the grid and/or distortions based on perspective.

Abstract: Handling data for a photographic image, includes detecting a reference pattern in the data, detecting at least one sticker in the data, determining an action associated with the at least one sticker, and performing the action on the data. The reference pattern may be a uniform grid pattern of dots preprinted on paper. A paper type may be determined according to the reference image. Determining an action associated with the at least one sticker may depend, at least in part, on the paper type. Detecting a particular one of the stickers may cause data for the photographic image to be stored in a particular location. Detecting a particular one of the stickers may cause data for the photographic images to be assigned particular tags used for organizing and searching.

Abstract: Adjusting data for photographed images includes detecting a reference image in the data, where the reference image contains a detectable uniformity and adjusting the data according to the reference image. The reference image may be a uniform grid pattern of dots preprinted on paper. A paper type may be determined prior to adjusting the data according to the reference image. The paper type may be determined according to spacing and/or patterns of the dots, and/or layout of page areas covered with dots. Adjusting the data may include removing effects corresponding to a folded corner, a removed corner, an obstructed corner, lens flare spots, and/or a shadow. Positional coordinates of the data may be adjusted by normalizing the grid through a non-linear transformation that eliminates curvature of the grid and/or distortions based on perspective.

Abstract: In one embodiment, a method for encoding source data includes defining a source polygon using a parametric representation associated with the source data, and identifying one or more portions of the source polygon. The method further includes passing a filter throughout the entire sequence of the samples representing the source polygon, and performing a piecewise, portion by portion, re-parameterization of the source polygon using the corresponding portions of the filtered polygon to obtain an updated sequence of samples representing the source polygon. The passing of the filter and the performance of the piecewise re-parameterization are then iteratively repeated until a convergence condition is satisfied, to provide encoded data.

Abstract: In one embodiment, a method for curve generation includes forming an initial interpolation polygon using samples within input data as interpolation knots, and upsampling the interpolation polygon by inserting extra samples in each segment between interpolation knots. A filter is then passed throughout a sequence of samples representing the upsampled interpolation polygon. Next, the interpolation polygon is substituted with the filtered polygon converted into a next interpolation polygon using segment-by-segment transformations, where segments of the filtered polygon are delimited by consecutive samples corresponding to interpolation knots, and each segment is transformed to fit between respective interpolation knots. Further, the passing of the filter and the substitution of the current interpolation polygon are repeated until a predefined condition is satisfied, to provide fitting curves.

Abstract: A system and method for providing an e-mail service for handling electronic ink input. Text input and drawing input is received from a client as text electronic ink input and drawing electronic ink input. Handwritten characters from the text electronic ink input are recognized and electronic ink text data is generated. Draw tool configuration information based on selections at the client is received and applied to the drawing electronic ink input to generate electronic ink drawing data. An electronic ink display is created based on the electronic ink text data and the electronic ink drawing data. The text input from the client may also include keystroke text input. The keystroke computer readable code is converted into electronic ink text data. In addition, the input from the client may include electronic ink gestures. The electronic ink gestures are interpreted, and based on the interpretation a gesture action is called to operate on the electronic ink display.

Abstract: In an electronic-mail computing system having a display and a pointing device for entering geometric elements in a geometric document, additional writing space is inserted in an existing geometric document having original space with one or more original geometric elements. This is accomplished by creating a boundary line or split line and inserting open or free space at the boundary line in the document. Further, an insertion of a boundary line in the midst of a geometric elements of a document to split the elements and add free space is accomplished by grouping geometric elements split by the boundary line or split line and then locating grouped geometric elements on one side or the other of the split line before space is inserted at the split line. The split line on the geometric document is detected, and original geometric elements crossed by the split line are detected and identified as crossed geometric elements.