Abstract: The invention relates to a method implemented by a computing device for processing math and text in handwriting, comprising: identifying symbols by performing handwriting recognition on a plurality of strokes; classifying, as a first classification, first symbols as either a text symbol candidate or a math symbol candidate with a confidence score reaching a first threshold; classifying, as a second classification, second symbols other than first symbols as either a text symbol candidate or a math symbol candidate with a respective confidence score by applying predefined spatial syntactic rules; updating or confirming, as a third classification, a result of the second classification by establishing semantic connections between symbols and comparing the semantic connections with the result of the second classification; and recognising each symbol as either text or math based on a result of said third classification.

Abstract: A method for processing lists in handwriting, comprising: initially classifying each of a plurality of text lines as a distinct text item which is not part of a list; and a classification process comprising a pattern detection in each text line for classifying each text line starting with a predetermined list symbol as a distinct list item which is part of a list; determining an item indentation of each text item with respect to a reference position and determining for each list item a text indentation representing the indentation of text comprised in said list item; and a merging step for merging, as part of a same text item, or as part of a same list item, if predefined conditions are met. A text structure data model may then be generated based on a result of the merging process.

Abstract: The invention relates to methods and devices for managing document layout of an electronic document. In a particular embodiment, a method implemented by a computing devices comprises: displaying in an electronic document a block containing at least one item; in response to a first finger gesture of two or more fingers defining at least two selection points, determining a space line specifying an initial position from which a space is to be managed in the electronic document; in response to a second finger gesture of two or more fingers defining a movement of the selected points along a first orientation, monitoring a current position of the space line moving over time; and performing a space management based on the current position of the space line along the first orientation, comprising creating and/or reducing a space in the electronic document.

Abstract: A system, method and computer program product for guiding hand-drawing of diagrams including text and non-text elements on a computing device are provided. The computing device has a processor and a non-transitory computer readable medium for detecting and recognizing hand-drawing diagram element input under control of the processor. Display is performed, on an interactive display of the computing device, of a guide element associated with at least one diagram element of displayed handwriting diagram input. The guide element is configured with a depiction of the at least one diagram element in recognized form.

Abstract: A system, method and computer program product for use in managing collaboration on documents having digital ink on a network of computing devices is disclosed. Each computing device has a processor and at least one system application for processing handwriting input under control of the processor. The system application displays, on a display associated with one of the computing devices, a document having digital ink based on a journal of the document, defines the journal to have journal entries associated with at least handwriting input to the document represented by the digital ink, and communicates the journal entries of the journal with one or more of the other networked computing devices displaying the document. The handwriting input associated with the journal entries is handwriting input to the document via the input interface of any of the computing devices displaying the document based on the communicated journal entries.

Abstract: The invention concerns a method comprising: detecting strokes of digital ink input on a computing device in a free handwriting format; detecting a text block from said strokes; performing text recognition on each text line of said text block, including extracting text lines from the text block and generating model data that associate each stroke of the text block with a character, a word and a text line of the text block; normalizing each text line from the free handwriting format into a structured format to comply with a document pattern. The normalization may comprise for each text line: computing a transform function to transform said text line into the structured format; applying the transform function to the text line; and updating the model data of said text line based on the transform function.

Abstract: The invention relates to a method in a computing device for hand-drawing elements, comprising: detecting input elements hand-drawn on an input surface; displaying the input elements in digital ink on a display device; classifying input digital ink as text or non-text and predefining blocks of input elements; selecting one or more input element according to a first selection mode triggered by a first gesture or according to a second selection mode triggered by a second gesture to select input elements within a selection area. Once selection is made, editing may be performed on the selected input elements in a different manner depending of which of the first and second selection mode is used.

Abstract: A system, method and computer program product for use in managing collaboration on documents having digital ink on a network of computing devices is disclosed. Each computing device has a processor and at least one system application for processing handwriting input under control of the processor. The system application displays, on a display associated with one of the computing devices, a document having digital ink based on a journal of the document, defines the journal to have journal entries associated with at least handwriting input to the document represented by the digital ink, and communicates the journal entries of the journal with one or more of the other networked computing devices displaying the document. The handwriting input associated with the journal entries is handwriting input to the document via the input interface of any of the computing devices displaying the document based on the communicated journal entries.

Abstract: A system, method and computer program product for use in editing digital documents with handwriting input to a computing device are provided. The computing device is connected to an input device in the form of an input surface. A user is able to provide input by applying pressure to or gesturing above the input surface using either his or her finger or an instrument such as a stylus or pen. The present system and method monitors the input strokes. The computing device further has a processor and at least one application for recognizing the handwriting input under control of the processor. The at least one system application is configured to cause display of, on a display interface of a computing device, first digital ink in accordance with document content, detect handwriting input as one or more editing gestures with respect to the document content, and, cause display of, on the display interface, second digital ink in accordance with handwriting input.

Abstract: The invention concerns a method implemented by a device for displaying strokes of digital ink in a display area and for performing text line extraction to extract text lines from the strokes. In particular, the text line extraction may involve slicing the display area into strips, ordering for each strip the strokes into ordered lists which form collectively a first set of ordered lists, forming for each strip a second set of ordered lists by filtering out from the ordered lists of the first set strokes which are below a given size threshold, and performing a neural net analysis based on said first and second sets to determine for each stroke a respective text line to which it belongs.

Abstract: A system, method and computer program product for use in providing a linguistic resource for input recognition of multiple input types on a computing device are provided. The computing device is connected to an input interface. A user is able to provide input by applying pressure to or gesturing above the input interface using a finger or an instrument such as a stylus or pen. The computing device has an input management system for recognizing the input. The input management system is configured to allow setting, in the computing device memory, parameters of a linguistic resource for a language model of one or more languages, and cause recognition of input to the input interface of the different input types using the linguistic resource. The resource parameters are set to optimize recognition performance characteristics of each input type while providing the linguistic resource with the pre-determined size.

Abstract: A system, method, and computer program product for managing editing of content on computing devices are provided. An input field for accepting input of a first type is displayed on an interface. An interaction field for accepting input of a second type displayed in place of the input field based on detection of a first interaction with the interface is displayed on the interface, wherein the interaction field displays first content based on the first input type. A second interaction with the first content is detected based on recognition of the second type input. The first content is modified based on detected second interaction.

Abstract: A system, method and computer program product for hand-drawing diagrams including text and non-text elements on a computing device are provided. The computing device has a processor and a non-transitory computer readable medium for detecting and recognizing hand-drawing diagram element input under control of the processor. Display of input diagram elements in interactive digital ink is performed on a display device associated with the computing device. One or more of the diagram elements are associated with one or more other of the diagram elements in accordance with a class and type of each diagram element. The diagram elements are re-displayed based on one or more interactions with the digital ink received and in accordance with the one or more associations.

Abstract: Disclosed is a device for inputting symbols in an entry field. An example of the device includes an interface unit having a touch screen and a module for processing graphics objects. The module may include a detection unit for detecting a start and an end of a current graphics object being input; a storage unit for storing graphics data corresponding to the input graphics object; a recognition unit for generating a list of candidate strings of symbols from the graphics data, each candidate string being associated with a pertinence value; and an insertion unit for inserting into the entry field a string selected by the user from the list, a data group comprising the graphics data, the candidate strings, the pertinence values, and an identifier of the selected string being stored during a predetermined duration.

Abstract: The invention relates to a method on a computing device comprising: displaying in a display area graphical objects, this display area comprising a structured text section with text objects and block sections with text or non-text objects; locating an initiation point from which starts a user selection gesture; determining a selection path forming a selection area; and selecting each graphical object contained within the selection area. If the initiation point is located in the structured text section, a first mode may be selected thereby allowing the selection path to be drawn in the display area to select any graphical object. If the initiation point is located within a target block section among the block sections, a second mode may be selected, thereby confining the selection path within the target block section.

Abstract: A system, method and computer program product for guiding hand-drawing of diagrams including text and non-text elements on a computing device are provided. The computing device has a processor and a non-transitory computer readable medium for detecting and recognizing hand-drawing diagram element input under control of the processor. Display is performed, on an interactive display of the computing device, of a guide element associated with at least one diagram element of displayed handwriting diagram input. The guide element is configured with a depiction of the at least one diagram element in recognized form.

Abstract: A system, method and computer program product for use in recognizing content associated with handwritten stroke input to a computing device is provided. The computing device is connected to an input interface. A user is able to provide input by applying pressure to or gesturing above the input interface using a finger or an instrument such as a stylus or pen. The computing device has an input management system for recognizing content defined by the input. The input management system is configured to detect input of a handwritten stroke with respect to the interactive key layout, characterize the detected handwritten stroke by a reference stroke by determining a sequence of reference points associated with a sequence of interactive keys of the interactive key layout, assign probability scores to candidate characters, and cause recognition of sequences of characters by applying a language model in accordance with the assigned probability scores.

Abstract: A system, method and computer program product for use in providing interactive ink from handwriting input to a computing device are provided. The computing device is connected to an input device in the form of an input surface. A user is able to provide input by applying pressure to or gesturing above the input surface using either his or her finger or an instrument such as a stylus or pen. The present system and method monitors the input strokes. The computing device further has a processor and an ink management system for recognizing the handwriting input under control of the processor.

Abstract: A system, method and computer program product for managing typesetting of digital ink structured content on computing devices. Each computing device has a processor and at least one system application for recognizing handwriting input under control of the processor. The system application determines dimensional information of at least digital ink text elements of structured content, calculates a first font size for each typeset ink text element respectively corresponding to the digital ink text elements based on at least part of the dimensional information, categorizes the typeset ink text elements into one or more categories of the structured content, determines a second font size for each typeset ink text element based on the first font size of each typeset ink text element of the respective category, and display, on a display associated with the computing device, the typeset ink text elements at the respective determined second font sizes.

Abstract: A system, method and computer program product for hand-drawing diagrams including text and non-text elements on a computing device are provided. The computing device has a processor and a non-transitory computer readable medium for detecting and recognizing hand-drawing diagram element input under control of the processor. Display of input diagram elements in interactive digital ink is performed on a display device associated with the computing device. One or more of the diagram elements are associated with one or more other of the diagram elements in accordance with a class and type of each diagram element. The diagram elements are re-displayed based on one or more interactions with the digital ink received and in accordance with the one or more associations.