Abstract: Methods for projecting, detecting, and processing digital notes. The digital notes can be displayed on a mixed reality device combined with physical notes in the same space. Physical notes can be automatically detected in view of a camera and converted to a corresponding digital note, and if the note has an obstruction the obstruction is removed in the digital note. Digital notes can be projected onto a wall and, upon detecting a change in scene, a new scene is projected onto the wall with the detected change. Physical notes can be automatically detected in view of a camera and converted to a corresponding digital note along with a recorded audio associated with the digital note.

Abstract: Methods for managing notes, either digital notes or images of physical notes. One feature uses multiple drawing layers divided into tiles to render drawing operations. The tiles with drawing changes are rendered in new tiles while tiles without changes are used from a previous drawing layer. This feature accommodates redo and undo commands by pushing or popping a layer on the history stack of layers. Another feature uses a displayed plus button that expands upon touch to display actions. A user can touch an action to select it and, upon releasing the touch, the action is executed with respect to displayed boards of digital notes. Another feature receives a 3D model of notes from a video scan and uses a transformation matrix to convert the notes in the 3D model to corresponding digital notes.

Abstract: Methods for managing notes, either digital notes or images of physical notes. One feature uses multiple drawing layers divided into tiles to render drawing operations. The tiles with drawing changes are rendered in new tiles while tiles without changes are used from a previous drawing layer. This feature accommodates redo and undo commands by pushing or popping a layer on the history stack of layers. Another feature uses a displayed plus button that expands upon touch to display actions. A user can touch an action to select it and, upon releasing the touch, the action is executed with respect to displayed boards of digital notes. Another feature receives a 3D model of notes from a video scan and uses a transformation matrix to convert the notes in the 3D model to corresponding digital notes.

Abstract: A method for collaboration using notes among multiple users during a video conferencing session or other networked session. An image or video of individual physical notes are obtained via a user device such as a mobile phone with a digital camera. The physical notes are converted to corresponding digital notes displayed on the user device. A user identifies with the user device a location on a shared digital screen or board, and the location can be shown using an icon on the shared screen or board. The user can then electronically transfer with the user device one or more of the digital notes to the location on the shared screen or board. All of the users can thus privately create their own digital notes and transfer those notes to the shared screen or board for viewing and collaboration among the users during the session.

Abstract: A method for collaboration using digital notes. A facilitator starts a session during a video conferencing with participants and can share a screen with the participants. The screen displays a code, a session ID, and a link. Participants join the session by scanning the code with a camera, entering the session ID, or accessing the link. During the session, the participants can create digital notes or scan physical notes to have them converted to digital notes. The facilitator then receives the digital notes sent from the participants during the session and moves the digital notes to a group on the facilitator's screen. Since the facilitator's screen is shared with the participants, any participant can view the digital notes in the group from all of the participants for collaboration as controlled by the facilitator.

Abstract: Methods for managing notes, either digital notes or images of physical notes. One feature uses multiple drawing layers divided into tiles to render drawing operations. The tiles with drawing changes are rendered in new tiles while tiles without changes are used from a previous drawing layer. This feature accommodates redo and undo commands by pushing or popping a layer on the history stack of layers. Another feature uses a displayed plus button that expands upon touch to display actions. A user can touch an action to select it and, upon releasing the touch, the action is executed with respect to displayed boards of digital notes. Another feature receives a 3D model of notes from a video scan and uses a transformation matrix to convert the notes in the 3D model to corresponding digital notes.

Abstract: Methods for managing notes, either digital notes or images of physical notes. The methods use optical character recognition to convert handwritten content into characters and icons. The methods also determine sizes of non-square physical notes when imaged by a camera from various angles. For curled notes or damaged notes such as a note missing a corner, the methods detect and process edges of a physical note in an image and, using the detected edges, convert the image of the physical note into a corresponding digital note without curl or damage.

Abstract: At least some aspects of the present disclosure feature a computing device configured to display visual representations of digital notes and one or more group images representing one or more groups on a user interface, where each group may include one or more digital notes. The computing device is further configured to receive one or more user inputs via the user interface and change the compositions of the groups based on the received user inputs.

Abstract: In one example, a method includes receiving a digital note of a plurality of digital notes generated based on image data comprising a visual representation of a scene that includes a plurality of physical notes such that each of the plurality of digital notes respectively corresponds to a particular physical note of the plurality of physical notes, wherein each of the physical notes includes respective recognizable content. In this example, the method also includes receiving user input indicating a modification to one or more visual characteristics of the digital note. In this example, the method also includes editing, in response to the user input, the one or more visual characteristics of the digital note. In this example, the method also includes outputting, for display, a modified version of the digital note that includes the one or more visual characteristics.

Abstract: Techniques for creating and manipulating software notes representative of physical notes are described. A computing device includes a processor, an image collection module executable by the processor and configured to receive an input image of an environment having a plurality of overlapping physical notes, and an image processing engine executable by the processor and configured to process the input image with the computing device to identify the plurality of overlapping physical notes in the input image. The image processing engine determines a boundary of each note in the plurality of overlapping physical notes in the input image, and generates a plurality of digital notes corresponding to the determined boundary of each of the overlapping physical notes identified in the input image.

Abstract: At least some aspects of the present disclosure feature a computing device configured to display visual representations of digital notes and one or more group images representing one or more groups on a user interface, where each group may include one or more digital notes. The computing device is further configured to receive one or more user inputs via the user interface and change the compositions of the groups based on the received user inputs.

Abstract: At least some aspects of the present disclosure feature a computing device configured to display visual representations of digital notes and one or more group images representing one or more groups on a user interface, where each group may include one or more digital notes. The computing device is further configured to receive one or more user inputs via the user interface and change the compositions of the groups based on the received user inputs.

Abstract: Techniques are described for creating and manipulating software notes representative of physical notes. A computing device is described that includes a processor and an image collection module executable on the processor and configured to receive an input image of an environment having a plurality of physical notes. An image processing engine executable on the processor is configured to identify the plurality of physical notes in the input image and generate, for each of the physical notes, a corresponding digital note. The image processing engine is further configured to identify an indication of one or more groups of the plurality of identified notes in the input image and group the plurality of digital notes according to the indication.

Abstract: Techniques are described for creating and manipulating software notes representative of physical notes. A computing device comprises a processor and a note identification module executable on the processor and configured to separate an input image into a plurality of channelized input images. Each of the channelized input images are associated with a different color. The note identification module is configured to apply edge detection and feature extraction to identify polygons within each of the channelized input images and select, from the polygons from the channelized input images, a representative polygon for each of the physical notes in the input image.

Abstract: Techniques for creating and manipulating software notes representative of physical notes are described. A computing device includes a processor, an image collection module executable by the processor and configured to receive an input image of an environment having a plurality of overlapping physical notes, and an image processing engine executable by the processor and configured to process the input image with the computing device to identify the plurality of overlapping physical notes in the input image. The image processing engine determines a boundary of each note in the plurality of overlapping physical notes in the input image, and generates a plurality of digital notes corresponding to the determined boundary of each of the overlapping physical notes identified in the input image.

Abstract: Techniques for creating and manipulating software notes representative of physical notes are described. A computing device includes a processor, an image collection module executable by the processor and configured to receive an input image of an environment having a plurality of overlapping physical notes, and an image processing engine executable by the processor and configured to process the input image with the computing device to identify the plurality of overlapping physical notes in the input image. The image processing engine determines a boundary of each note in the plurality of overlapping physical notes in the input image, and generates a plurality of digital notes corresponding to the determined boundary of each of the overlapping physical notes identified in the input image.

Abstract: In one example, a method includes receiving a digital note of a plurality of digital notes generated based on image data comprising a visual representation of a scene that includes a plurality of physical notes such that each of the plurality of digital notes respectively corresponds to a particular physical note of the plurality of physical notes, wherein each of the physical notes includes respective recognizable content. In this example, the method also includes receiving user input indicating a modification to one or more visual characteristics of the digital note. In this example, the method also includes editing, in response to the user input, the one or more visual characteristics of the digital note. In this example, the method also includes outputting, for display, a modified version of the digital note that includes the one or more visual characteristics.