Abstract: Example implementations relate to a role-based autoscaling approach for scaling of nodes of a stateful application in a large scale virtual data processing (LSVDP) environment. Information is received regarding a role performed by the nodes of a virtual cluster of an LSVDP environment on which a stateful application is or will be deployed. Role-based autoscaling policies are maintained defining conditions under which the roles are to be scaled. A policy for a first role upon which a second role is dependent specifies a condition for scaling out the first role by a first step and a second step by which the second role is to be scaled out in tandem. When load information for the first role meets the condition, nodes in the virtual cluster that perform the first role are increased by the first step and nodes that perform the second role are increased by the second step.

Abstract: Embodiments described herein are generally directed to caching and data access improvements in a large scale data processing environment. According to an example, an agent running on a first worker node of a cluster receives a read request from a task. The worker node of the cluster to which the data at issue is mapped is identified. When the first worker node is the identified worker node, it is determined whether its cache contains the data; if so, the data is fetched from a remote data lake and the agent locally caches the data; otherwise, when the identified worker node is another worker node of the compute cluster, the data is fetched from a remote agent of that worker node. The agent responds to the read request with cached data, data returned by the remote data lake, or data returned by the remote data agent as the case may be.

Abstract: Secured data access in virtual data processing is described. An example includes instructions to receive a request from an application in a compute node of a compute cluster in a virtual data processing environment to access a secured data source for a user, the virtual data processing environment including a multiple secured data sources that are accessible by compute nodes of the virtual compute cluster; fetch a credential in a current application context and forward the credential for validation; validate the credential with a credential authority; and, upon successfully validating the credential, authenticate the user at the secured data source and establish a connection with the secured data source.

Abstract: Example implementations relate to a role-based autoscaling approach for scaling of nodes of a stateful application in a large scale virtual data processing (LSVDP) environment. Information is received regarding a role performed by the nodes of a virtual cluster of an LSVDP environment on which a stateful application is or will be deployed. Role-based autoscaling policies are maintained defining conditions under which the roles are to be scaled. A policy for a first role upon which a second role is dependent specifies a condition for scaling out the first role by a first step and a second step by which the second role is to be scaled out in tandem. When load information for the first role meets the condition, nodes in the virtual cluster that perform the first role are increased by the first step and nodes that perform the second role are increased by the second step.

Abstract: Embodiments described herein are generally directed to caching and data access improvements in a large scale data processing environment. According to an example, an agent running on a first worker node of a cluster receives a read request from a task. The worker node of the cluster to which the data at issue is mapped is identified. When the first worker node is the identified worker node, it is determined whether its cache contains the data; if so, the data is fetched from a remote data lake and the agent locally caches the data; otherwise, when the identified worker node is another worker node of the compute cluster, the data is fetched from a remote agent of that worker node. The agent responds to the read request with cached data, data returned by the remote data lake, or data returned by the remote data agent as the case may be.

Abstract: Described herein are systems, methods, and software to migrate virtual nodes of a data processing cluster. In one implementation, a management system monitors an executing data processing cluster on one or more first hosts to determine when the data processing cluster satisfies migration criteria. Once satisfied, the management system selects one or more second hosts to support the data processing cluster based on accommodation data associated with the hosts. After selection, the management system may initiate operations to migrate the data processing cluster from the one or more first hosts to the one or more second hosts.

Abstract: Example implementations relate to a role-based autoscaling approach for scaling of nodes of a stateful application in a large scale virtual data processing (LSVDP) environment. Information is received regarding a role performed by the nodes of a virtual cluster of an LSVDP environment on which a stateful application is or will be deployed. Role-based autoscaling policies are maintained defining conditions under which the roles are to be scaled. A policy for a first role upon which a second role is dependent specifies a condition for scaling out the first role by a first step and a second step by which the second role is to be scaled out in tandem. When load information for the first role meets the condition, nodes in the virtual cluster that perform the first role are increased by the first step and nodes that perform the second role are increased by the second step.

Abstract: Described herein are systems, methods, and software to enhance the management of virtual nodes in a computing environment. In one example, a method includes identifying a transition event for a first version of a virtual node executing on a first host, identifying a second host to support a second version of the virtual node, and initiating execution of the second version of the virtual node on the second host. In some implementations, the virtual node comprises a non-persistent portion on the executing host and a persistent portion on a second storage element.

Abstract: Described herein are systems, methods, and software to enhance the management of virtual nodes in a computing environment. In one example, a method includes identifying a transition event for a first version of a virtual node executing on a first host, identifying a second host to support a second version of the virtual node, and initiating execution of the second version of the virtual node on the second host. In some implementations, the virtual node comprises a non-persistent portion on the executing host and a persistent portion on a second storage element.

Abstract: Described herein are systems, methods, and software to migrate virtual nodes of a data processing cluster. In one implementation, a management system monitors an executing data processing cluster on one or more first hosts to determine when the data processing cluster satisfies migration criteria. Once satisfied, the management system selects one or more second hosts to support the data processing cluster based on accommodation data associated with the hosts. After selection, the management system may initiate operations to migrate the data processing cluster from the one or more first hosts to the one or more second hosts.

Abstract: Described herein are systems, methods, and software to enhance the management of virtual nodes in a computing environment. In one example, a method includes identifying a transition event for a first version of a virtual node executing on a first host, identifying a second host to support a second version of the virtual node, and initiating execution of the second version of the virtual node on the second host. In some implementations, the virtual node comprises a non-persistent portion on the executing host and a persistent portion on a second storage element.

Abstract: Described herein are systems, methods, and software to enhance the management of virtual nodes in a computing environment. In one example, a method includes identifying a transition event for a first version of a virtual node executing on a first host, identifying a second host to support a second version of the virtual node, and initiating execution of the second version of the virtual node on the second host. In some implementations, the virtual node comprises a non-persistent portion on the executing host and a persistent portion on a second storage element.

Abstract: The present invention provides a content delivery network routing method, system, and user terminal. The method includes: receiving, by a CDN routing device, a first service request sent by a user terminal, where the first service request carries a first uniform resource locator URL and a domain name; returning, by the CDN routing device, a redirection response message to the user terminal, where the redirection response message carries a second URL, and the domain name; and receiving, by the cache node, a second service request sent by the user terminal, and returning a header field indication to the user terminal. Therefore, when the user terminal accesses content accelerated by a CDN, the user terminal can obtain cookie information corresponding to a domain name, which is advantageous to network-side authentication and user login information management.

Abstract: Embodiments of the present invention provide a method for ensuring quality of service of an Internet Protocol television live broadcast service, and the method includes: detecting a live broadcast packet received from an original multicast group (100); if detecting that the live broadcast packet has an error or a loss, joining a multicast group corresponding to a delay multicast stream sent by a retransmission server, and receiving a delay retransmission packet from the delay multicast stream (102); and recovering the live broadcast packet according to the received delay retransmission packet (104). Correspondingly, a terminal and a retransmission server are provided. Once the terminal detects that the original packet has a loss or an error, the terminal directly receives a packet from a delay packet stream sent by the retransmission server for recovering, thereby avoiding a NACK storm, simplifying the processing of the retransmission server, and improving the retransmission efficiency.

Abstract: System and methods for storage object distribution using dynamic policy controls are provided. An embodiment method deleting an object in a distributed storage system includes receiving, from a client, a delete request for an object, retrieving, by a primary datacenter, an object metadata list corresponding to the object to be deleted, and inserting, by the primary datacenter, a delete marker on a top of a stack data structure in an object metadata list.

Abstract: System and methods for storage object distribution using dynamic policy controls are provided. An embodiment method deleting an object in a distributed storage system includes receiving, from a client, a delete request for an object, retrieving, by a primary datacenter, an object metadata list corresponding to the object to be deleted, and inserting, by the primary datacenter, a delete marker on a top of a stack data structure in an object metadata list.

Abstract: The present invention provides a content delivery network routing method, system, and user terminal. The method includes: receiving, by a CDN routing device, a first service request sent by a user terminal, where the first service request carries a first uniform resource locator URL and a domain name; returning, by the CDN routing device, a redirection response message to the user terminal, where the redirection response message carries a second URL, and the domain name; and receiving, by the cache node, a second service request sent by the user terminal, and returning a header field indication to the user terminal. Therefore, when the user terminal accesses content accelerated by a CDN, the user terminal can obtain cookie information corresponding to a domain name, which is advantageous to network-side authentication and user login information management.

Abstract: Embodiments of the present invention provide a method for ensuring quality of service of an Internet Protocol television live broadcast service, and the method includes: detecting a live broadcast packet received from an original multicast group (100); if detecting that the live broadcast packet has an error or a loss, joining a multicast group corresponding to a delay multicast stream sent by a retransmission server, and receiving a delay retransmission packet from the delay multicast stream (102); and recovering the live broadcast packet according to the received delay retransmission packet (104). Correspondingly, a terminal and a retransmission server are provided. Once the terminal detects that the original packet has a loss or an error, the terminal directly receives a packet from a delay packet stream sent by the retransmission server for recovering, thereby avoiding a NACK storm, simplifying the processing of the retransmission server, and improving the retransmission efficiency.

Abstract: The present invention discloses a media playback method and system, a CDN device, and an advertising server. The method includes: receiving, by a CDN device, a program playback request sent by a user terminal; if the program playback request carries a user identifier of a user in the CDN device, querying, by the CDN device, a corresponding relation between the user identifier and personalized information according to the user identifier to obtain the personalized information of the user; obtaining, by the CDN device, a link of advertisement content that corresponds to the user from an advertising server, wherein the link of the advertisement content is obtained by the advertising server according to the personalized information of the user and a preset advertisement configuration policy; and sending, by the CDN device or the advertising server, advertisement content corresponding to the link of the advertisement content to the user terminal.