Abstract: Currently available live media distribution systems have to continuously maintain multiple peer-to-peer (P2P) connections which further increases the computational load of robot. Present disclosure provides a method and a system for managing multimedia exchange in tele-robotics using dew computing. The system first identifies a dew signaling server wherein a tele-presence robot device present in enterprise network offer to act as dew signaling server. The system then establishes first P2P connection between dew interface and dew signaling server. Thereafter, system establishes second P2P connection between dew signaling server and cloud media manager present in public cloud server. Further, system identifies computing device present in enterprise network as dew media manager. The system then establishes third P2P connection between dew media manager and the cloud media manager via the cloud signaling server.

Abstract: The present disclosure relates to methods and systems for establishing an edge-inclusive real-time multimedia tele-conferencing using tele-robots. Conventional techniques employ a WebSocket connection for the robot-to-edge device (R2E) connection which may not meet expected real-time behaviour. The present disclosure provides a resource-friendly application protocol using WebRTC that enables the same tele-robotic WebRTC session to fork the live feed of the tele-robot for consumption by the edge device. According to the present disclosure, a peer-to-peer connection is established between the plurality of peers by the cloud signaling server, based on the type of the unique type identifier.

Abstract: The disclosure relates generally to methods and systems for quality of experience (QoE)-centric adaptive bitrate encoding for a live video stream. Conventional QoE aware Adaptive Bit Rate (ABR) scheme may not be suitable for live interactive streams especially in bandwidth limited practical situations and does not address the core issues inherent in present ABR schemes. The present models the adaptation as a context specific multi-model tuning mechanism and provides a dual adaptation control for spatial encoding of each frame. This involves defining a starting region of potential attention by the user based on a standard estimate of eye-foveation with respect to the field of view (FOV) and then adapting it through a foveal-breathing technique. Further, a median based sparsification of quantized DCT coefficient matrix for each minimum coded unit (MCU) of a frame is introduced to satisfy channel bit budget without compromising the quality of the foveal region.

Abstract: The present disclosure addresses an issue of inherent delay in a cloud-centric architecture in a scenario where multiple remote users join a teleoperation session with a robot such that any one of the users may take exclusive control of the robot and remotely maneuver it as the avatar of a current master. A Web Real-Time Communication (WebRTC) based signaling protocol with a hybrid topology for a multi-user session is provided, wherein Audio-Visual (A/V) data streaming happens over a public cloud while each master creates an on-demand peer-to-peer (P2P) channel with the robot for a desired duration of maneuvering the robot that represents the avatar of the current master. Thus, low-latency delivery of control commands results in good user experience. The provided method and system may be applied to teleoperation sessions like telemedicine sessions.

Abstract: This disclosure relates generally to navigation of a tele-robot in dynamic environment using in-situ intelligence. Tele-robotics is the area of robotics concerned with the control of robots (tele-robots) in a remote environment from a distance. In reality the remote environment where the tele robot navigates may be dynamic in nature with unpredictable movements, making the navigation extremely challenging. The disclosure proposes an in-situ intelligent navigation of a tele-robot in a dynamic environment. The disclosed in-situ intelligence enables the tele-robot to understand the dynamic environment by identification and estimation of future location of objects based on a generating/training a motion model. Further the disclosed techniques also enable communication between a master and the tele-robot (whenever necessary) based on an application layer communication semantic.

Abstract: This disclosure relates generally to method and system for live video streaming with integrated encoding and transmission semantics. The system receives a set of frames associated with a live video stream encoded to generate a set of data fragments using a reference encoder and a delta encoder. Transmitter unit of the live video streaming protocol transmits each packet of the set of full frames and the set of delta frames in sequence with a payload specific header based on a packet mode. Further, the receiver unit receives each packet of the full frames and each packet of the delta frames based on the packet mode to reconstruct an original sequence from the foreground pixels by estimating a total number of packets expected at each frame interval and loss incurred in each packet of the set of full frames and the set of delta frames.

Abstract: This disclosure relates generally to method and system for live video streaming with integrated encoding and transmission semantics. The system receives a set of frames associated with a live video stream encoded to generate a set of data fragments using a reference encoder and a delta encoder. Transmitter unit of the live video streaming protocol transmits each packet of the set of full frames and the set of delta frames in sequence with a payload specific header based on a packet mode. Further, the receiver unit receives each packet of the full frames and each packet of the delta frames based on the packet mode to reconstruct an original sequence from the foreground pixels by estimating a total number of packets expected at each frame interval and loss incurred in each packet of the set of full frames and the set of delta frames.

Abstract: The present disclosure addresses an issue of inherent delay in a cloud-centric architecture in a scenario where multiple remote users join a teleoperation session with a robot such that any one of the users may take exclusive control of the robot and remotely maneuver it as the avatar of a current master. A Web Real-Time Communication (WebRTC) based signaling protocol with a hybrid topology for a multi-user session is provided, wherein Audio-Visual (A/V) data streaming happens over a public cloud while each master creates an on-demand peer-to-peer (P2P) channel with the robot for a desired duration of maneuvering the robot that represents the avatar of the current master. Thus, low-latency delivery of control commands results in good user experience. The provided method and system may be applied to teleoperation sessions like telemedicine sessions.

Abstract: This disclosure relates generally to navigation of a tele-robot in dynamic environment using in-situ intelligence. Tele-robotics is the area of robotics concerned with the control of robots (tele-robots) in a remote environment from a distance. In reality the remote environment where the tele robot navigates may be dynamic in nature with unpredictable movements, making the navigation extremely challenging. The disclosure proposes an in-situ intelligent navigation of a tele-robot in a dynamic environment. The disclosed in-situ intelligence enables the tele-robot to understand the dynamic environment by identification and estimation of future location of objects based on a generating/training a motion model. Further the disclosed techniques also enable communication between a master and the tele-robot (whenever necessary) based on an application layer communication semantic.

Abstract: This disclosure relates generally to method and system for enhancing Quality of experience (QoE) for rendering live interactive videos in real-time. The conventional methods utilize an additional field in packet header to determine which packet sequences were lost, so that the receiver could request a retransmission. Due to unpredictable delay and loss, the receiver may not get the end-of-frame packet which has been sent using best-effort. The disclosed method and system introduced an additional indicator to identify an expected maximum number of packets transmitted for each frame, and further determine the distribution of loss so that the rendering unit can intelligently decide on whether to allow the frame to display, or to drop it without using any additional retransmission or error-concealment strategy, thereby enhancing the QoE of reception at the receiver.

Abstract: The disclosure generally relates to methods and systems for maintaining quality of experience (QoE) in real-time live video streaming. Conventional techniques in achieving the QoE employ either additional bandwidth of the network or compromise on a latency of the network. The present disclosure provides a rendering algorithm to compensate for lost entropy without attempting to regain exact lost packet(s) information. The rendering algorithm enhance the QoE by regaining structural continuity of the lost packet(s) information despite variations in the end-to-end transmission channel. A segmentation algorithm is employed to segment each frame into one or more packets, so that each packet should only have integer number of MCU blocks. The rendering algorithm to identify the lost packets and to compensate the lost information. The present disclosure provides a loss resilient solution to maintain the QoE without trading off the bandwidth efficiency and the network latency.