Abstract: This disclosure relates to attention shifting of a robot in a group conversation with two or more attendees, wherein at least one of them is a speaker. State of the art has dealt with several aspects of Human-Robot Interaction (HRI) including responding to a source of sound at a time, addressing a fixed viewing area or determining who is the speaker based on eye gaze direction. However, attention shifting to make the conversation human-like is a challenge. The present disclosure uses audio-visual perception for speaker localization. Only qualified direction of arrivals (DOAs) are used for the audio perception. Further the audio perception is complimented by visual perception employing real time face detection and lip movement detection. Use of HRI rules, clustering of the DOAs, dynamic adjustment of rotation of the robot and a dynamically updated knowledge repository enriches the robot with intelligence to shift attention with minimum human intervention.

Abstract: Any technical error with robotic arms that are used to automatically perform object packing can affect quality and efficiency with which the packing is being carried out, and this in turn affects space utilization when a large quantity of objects are to be accommodated in tight packing spaces. This disclosure relates generally to automated object packing and more specifically to an object packing mechanism in which corrections are made when placement of object is identified as violating one or more regulations. The system packs objects by calculating ICP-BCP pairs for each empty space in a packing space. After packing each object, the system checks whether placement of the object violates one or more regulations, and if any violation is found, then the system determines and executes one or more corrective action to correct placement of the object that violates the regulation.

Abstract: This disclosure provides systems and methods for robotic task planning when a complex task instruction is provided in natural language. Conventionally robotic task planning relies on a single task or multiple independent or serialized tasks in the task instruction. Alternatively, constraints on space of linguistic variations, ambiguity and complexity of the language may be imposed. In the present disclosure, firstly dependencies between multiple tasks are identified. The tasks are then ordered such that a dependent task is always scheduled for planning after a task it is dependent upon. Moreover, repeated tasks are masked. Thus, resolving task dependencies and ordering dependencies, a complex instruction with multiple interdependent tasks in natural language facilitates generation of a viable task execution plan. Systems and methods of the present disclosure finds application in human-robot interactions.

Abstract: Robotic platform for tele-presence applications has gained paramount importance, such as for remote meetings, group discussions, and the like and has sought much attention. There exist some robotic platforms for such tele-presence applications, these lack efficacy in communication and interaction between remote person and avatar robot deployed in another geographic location thus adding network overhead. Embodiments of the present disclosure for edge centric communication protocol for remotely maneuvering tele-presence robot in geographically distributed environment.

Abstract: Parameters specific to robot, environment, target objects and their inter-relations need to be considered by a robot to estimate cost of a task. As the existing task allocation methods assume a single utility value for a robot-task pair, combining heterogeneous parameters is a challenge. In applications like search and rescue, manual intervention may not be possible in real time. For such cases, utility calculation may be a hindrance towards automation. Also, manufacturers follow their own nomenclature and units for robotic specifications. Only domain experts can identify semantically similar terms and perform necessary conversions. Systems and methods of the present disclosure provide a structured semantic knowledge model to store and describe data in a uniform machine readable format such that semantics of those data can be interpreted by the robots and utility computation can be autonomous to make task allocation autonomous, semantic enabled and capable of self-decision without human intervention.

Abstract: This disclosure relates generally to human-robot interaction (HRI) to enable a robot to execute tasks that are conveyed in a natural language. The state-of-the-art is unable to capture human intent, implicit assumptions and ambiguities present in the natural language to enable effective robotic task identification. The present disclosure provides accurate task identification using classifiers trained to understand linguistic and semantic variations. A mixed-initiative dialogue is employed to resolve ambiguities and address the dynamic nature of a typical conversation. In accordance with the present disclosure, the dialogues are minimal and directed to the goal to ensure human experience is not degraded. The method of the present disclosure is also implemented in a context sensitive manner to make the task identification effective.

Abstract: This disclosure relates to attention shifting of a robot in a group conversation with two or more attendees, wherein at least one of them is a speaker. State of the art has dealt with several aspects of Human-Robot Interaction (HRI) including responding to a source of sound at a time, addressing a fixed viewing area or determining who is the speaker based on eye gaze direction. However, attention shifting to make the conversation human-like is a challenge. The present disclosure uses audio-visual perception for speaker localization. Only qualified direction of arrivals (DOAs) are used for the audio perception. Further the audio perception is complimented by visual perception employing real time face detection and lip movement detection. Use of HRI rules, clustering of the DOAs, dynamic adjustment of rotation of the robot and a dynamically updated knowledge repository enriches the robot with intelligence to shift attention with minimum human intervention.

Abstract: Systems and methods of the present disclosure address the capacity constrained vehicle routing (CVRP) problem that may be applied to a warehouse scenario wherein multi-robot task allocation is required. Conventional methods can solve CVRP instances up to 100 nodes. In the present disclosure, a nearest-neighbor based Clustering And Routing (nCAR) approach is provided that makes the systems and methods of the present disclosure scalable wherein the number of nodes can be in the range of several hundreds to several thousands within an order wave.

Abstract: System and method is provided for scheduling of a set of non-preemptive tasks by partitioning, the set of non-preemptive tasks either as a set of schedulable tasks or as a set of non-schedulable tasks; sorting, by a scheduling technique, the set of non-preemptive tasks partitioned; determining, by the scheduling technique, a possibility of execution of each of the set of schedulable tasks; and scheduling the set of schedulable tasks and the set of non-schedulable tasks upon determining the possibility of execution of each of the set of schedulable tasks.

Abstract: Systems and methods for optimizing scheduling of non-preemptive tasks in a multi-robot environment are provided. Traditional systems and methods cite scheduling of preemptive task(s) allocation but such scheduling techniques generally do not provide for an efficient scheduling in the multi-robot environment since tasks are preemptive. Additionally, critical parameters like deadline and performance loss are not considered.

Abstract: A method and a robotic system for online localized fatigue-state detection of a subject in a co-working environment using a non-intrusive approach is disclosed. A force sensor, mounted on the robotic system is capable of capturing effective force applied by local muscles of the subject co-working with the robotic system, providing a non-intrusive sensing. The captured force is analyzed on-line by the robotic system 102 to detect current fatigue state of the subject and proactively predict the future state of the subject. Thus, enables alerting the subject before time avoiding any possible accident.

Abstract: Parameters specific to robot, environment, target objects and their inter-relations need to be considered by a robot to estimate cost of a task. As the existing task allocation methods assume a single utility value for a robot-task pair, combining heterogeneous parameters is a challenge. In applications like search and rescue, manual intervention may not be possible in real time. For such cases, utility calculation may be a hindrance towards automation. Also, manufacturers follow their own nomenclature and units for robotic specifications. Only domain experts can identify semantically similar terms and perform necessary conversions. Systems and methods of the present disclosure provide a structured semantic knowledge model to store and describe data in a uniform machine readable format such that semantics of those data can be interpreted by the robots and utility computation can be autonomous to make task allocation autonomous, semantic enabled and capable of self-decision without human intervention.

Abstract: A method and a robotic system for online localized fatigue-state detection of a subject in a co-working environment using a non-intrusive approach is disclosed. A force sensor, mounted on the robotic system is capable of capturing effective force applied by local muscles of the subject co-working with the robotic system, providing a non-intrusive sensing. The captured force is analyzed on-line by the robotic system 102 to detect current fatigue state of the subject and proactively predict the future state of the subject. Thus, enables alerting the subject before time avoiding any possible accident.

Abstract: Systems and methods for scheduling non-preemptive tasks in a multi-robot environment is provided. Traditional systems and methods facilitating preemptive task(s) allocation in a multi-processor environment are not applicable in the multi-robot environment since tasks are preemptive. Additionally, critical parameters like deadline and performance loss are not considered. Embodiments of the present disclosure provide for scheduling of a set of non-preemptive tasks by partitioning, the set of non-preemptive tasks either as a set of schedulable tasks or as a set of non-schedulable tasks; sorting, by a scheduling technique, the set of non-preemptive tasks partitioned; determining, by the scheduling technique, a possibility of execution of each of the set of schedulable tasks; and scheduling the set of schedulable tasks and the set of non-schedulable tasks upon determining the possibility of execution of each of the set of schedulable tasks.

Abstract: Systems and methods for generating control system solutions for robotics environments is provided. The traditional systems and methods provide robotics solutions but specialized to only a particular robotic application, domain, and selected structure.

Abstract: Systems and methods of the present disclosure address the capacity constrained vehicle routing (CVRP) problem that may be applied to a warehouse scenario wherein multi-robot task allocation is required. Conventional methods can solve CVRP instances up to 100 nodes. In the present disclosure, a nearest-neighbor based Clustering And Routing (nCAR) approach is provided that makes the systems and methods of the present disclosure scalable wherein the number of nodes can be in the range of several hundreds to several thousands within an order wave.