Abstract: Systems and methods are provided for controlling robotic movement of a tool based on one or more virtual boundaries. The system comprises a tool and a manipulator to support the tool. A control system controls operation of the manipulator and movement of the tool based on a relationship between the tool and the one or more virtual boundaries associated with a target site. The control system includes a boundary handler to determine whether the tool is in compliance with the one or more virtual boundaries or is in violation of the one or more virtual boundaries.

Abstract: Robotic surgical systems and methods for guiding a tool along a path using hybrid automated/manual control. A manipulator supports a surgical tool and a sensor measures forces/torques applied to the tool. A control system commands the manipulator to perform an automated advancement of the tool along a predetermined tool path in a first path direction and according to a predetermined feed rate. During the automated advancement, an input is received from the sensor in response to user applied forces/torques to the tool. The control system evaluates an effect of the sensor input on the automated advancement of the tool to determine an effective feed rate and an effective path direction for the tool with respect to the tool path. The control system determines a commanded action for the manipulator and the tool with respect to the tool path based on the effective feed rate and effective path direction.

Abstract: A method for generating at least one segment of a video by an electronic device is provided. The method includes identifying at least one of a context associated with the video and an interaction of a user in connection with the video, analyzing at least one parameter in at least one frame of the video with reference to at least one of the context and the interaction of the user, wherein the at least one parameter includes at least one of a subject, an environment, an action of the subject, and an object, determining the at least one frame in which a change in the at least one parameter occurs, and generating at least one segment of the video comprising the at least one frame in which the parameter changed as a temporal boundary of the at least one segment.

Abstract: A robotic surgical system includes a kinematic chain defined by components of a manipulator and a surgical tool including an energy applicator. At least one controller identifies that one or more components of the kinematic chain other than the energy applicator is either experiencing or will experience an undesired orientational motion. The at least one controller changes operation of the manipulator to mitigate for the present or expected undesired orientational motion.

Abstract: Embodiments herein disclose a method and electronic device for predicting multi-modal drawings. The method includes: receiving, by the electronic device, at least one of a text input and strokes of a drawing and determining, by the electronic device, features associated with the text input and features associated with the strokes of the drawing. The method includes classifying, by the electronic device, the features associated with the text input and the features associated with the strokes of the drawing into one of a dominant feature and a non-dominant feature and performing, by the electronic device, early concatenation or late concatenation of the features based on the classification; classifying, by the electronic device, the strokes of the drawing based on the concatenation into a category using a deep neural network (DNN) model; and predicting, by the electronic device, primary drawings corresponding to the category.

Abstract: A computer-implemented surgical planning method is provided. The method includes obtaining anatomical data of an anatomical volume and path data including a tool path along which a tool will move. The method also includes obtaining tool data; merging the path data and the anatomical data; and for a point of the tool path, identifying a location of the point, loading a geometry of the tool at the location, identifying an intersection between the tool and the anatomical volume at the location, determining density values of the anatomical data within the intersection, computing a tool contact factor related to the intersection, setting a planned feed rate factor for the tool based on the density values and the tool contact factor, associating the planned feed rate factor with the point; and outputting cut plan data including the planned feed rate factor associated with the point of the tool path.

Abstract: A method includes defining a virtual object and defining a first point and a second point associated with a virtual representation of a surgical tool. Movement of the virtual representation of the surgical tool corresponds to movement of the surgical tool in real space. The method includes controlling a robotic device coupled to the surgical tool to constrain the first point to the virtual object, determining that the first point is at a threshold position along the virtual object, and controlling the robotic device to guide the second point to the virtual object.

Abstract: Embodiments herein disclose a method and electronic device for predicting multi-modal drawings. The method includes: receiving, by the electronic device, at least one of a text input and strokes of a drawing and determining, by the electronic device, features associated with the text input and features associated with the strokes of the drawing. The method includes classifying, by the electronic device, the features associated with the text input and the features associated with the strokes of the drawing into one of a dominant feature and a non-dominant feature and performing, by the electronic device, early concatenation or late concatenation of the features based on the classification; classifying, by the electronic device, the strokes of the drawing based on the concatenation into a category using a deep neural network (DNN) model; and predicting, by the electronic device, primary drawings corresponding to the category.

Abstract: Systems and methods are provided for guiding movement of a tool. The system includes a tool and a manipulator. A guide handler obtains a target state for the tool and generates virtual constraints based on the target state and a current state of the tool. A constraint solver calculates a constraint force adapted to attract the tool toward the target state or repel the tool away from the target state based on the virtual constraints. A virtual simulator simulates dynamics of the tool in a virtual simulation based on the constraint force and input from one or more sensors, to output a commanded pose. The control system commands the manipulator to move the tool based on the commanded pose to thereby provide haptic feedback to the user that guides the user toward placing the tool at the target state or away from the target state.

Abstract: A surgical system comprising a tool for engaging a target site, a manipulator configured to support the tool, and a sensing system configured to detect one or more system conditions associated with one or more of the tool, the manipulator, the target site, or combinations thereof. A controller is coupled to the manipulator and to the sensing system is configured to operate the manipulator between: a first mode to maintain alignment of the tool with respect to the target site according to a first constraint criteria, and a second mode to maintain alignment of the tool with respect to the target site according to a second constraint criteria different from the first constraint criteria. The controller changes operation of the manipulator from the first mode to the second mode in response to determining that at least one of the one or more system conditions satisfies a predetermined condition.

Abstract: Systems and methods are provided for controlling robotic movement of a tool based on one or more virtual boundaries. The system comprises a tool and a manipulator to support the tool. A control system controls operation of the manipulator and movement of the tool based on a relationship between the tool and the one or more virtual boundaries associated with a target site. The control system includes a boundary handler to determine whether the tool is in compliance with the one or more virtual boundaries or is in violation of the one or more virtual boundaries.

Abstract: An apparatus and method for generating a customized content are provided. An apparatus for generating a customized content, may include: at least one memory configured to store one or more instructions; at least one processor configured to execute the one or more instructions to: (1) obtain an input from a user; (2) detect, from the input, at least one feature and modality of the input among a plurality of modalities comprising a text format, a sound format, a still image format, and a moving image format; (3) determine a mode of the customized content, from a plurality of modes, based on the at least one feature and the modality of the input, the plurality of modes including an image mode and a text mode; and (4) generate the customized content based on the determined mode, and a display configured to display the customized content.