Abstract: In various example embodiments, a system, computer readable medium and method for schema update engine dynamically updating a target data storage system. Incoming data records are received. A front-end schema of the incoming data records is identified. The front-end schema and the current target schema are compared. Based on identifying a difference between the front-end schema and the current target schema, the current target schema is updated in order to be identical to the front-end schema. The current target data file is closed and the incoming data records are stored in a new target data file according to the updated target schema.

Abstract: In various example embodiments, a system, computer readable medium and method for schema update engine dynamically updating a target data storage system. Incoming data records are received. A front-end schema of the incoming data records is identified. The front-end schema and the current target schema are compared. Based on identifying a difference between the front-end schema and the current target schema, the current target schema is updated in order to be identical to the front-end schema. The current target data file is closed and the incoming data records are stored. in a new target data file according to the updated target schema.

Abstract: In various example embodiments, a system, computer readable medium and method for schema update engine dynamically updating a target data storage system. Incoming data records are received. A front-end schema of the incoming data records is identified. The front-end schema and the current target schema are compared. Based on identifying a difference between the front-end schema and the current target schema, the current target schema is updated in order to be identical to the front-end schema. The current target data file is closed and the incoming data records are stored in a new target data file according to the updated target schema.

Abstract: In various example embodiments, a system, computer-readable medium and method to aggregate data from multiple data streams according to an aggregation function. The data streams are received and partitioned according to consecutive extraction time windows. For each extraction time window, and for each received data stream, at least one aggregatable value is computed, the aggregatable value being computed based on the values of the records of the data stream having a timestamp that is included in the extraction time window. The at least one aggregatable value is stored in association with the extraction time window. A consolidated aggregation value is computed by applying a consolidation function on the aggregatable values stored in association with the extraction time windows included in a consolidation time window.

Abstract: In various example embodiments, a system, computer readable medium and method for schema update engine dynamically updating a target data storage system. Incoming data records are received. A front-end schema of the incoming data records is identified. The front-end schema and the current target schema are compared. Based on identifying a difference between the front-end schema and the current target schema, the current target schema is updated in order to be identical to the front-end schema. The current target data file is closed and the incoming data records are stored in a new target data file according to the updated target schema.

Abstract: A method and system for building an elastic cloud web server farm. The method includes registering a web application on a serving cloud and copying the web application to a distributed store. A load of the web application is specified, and a plurality of nodes is added for the web application based on the load. A web server corresponding to a node of the plurality of nodes is then initialized. A web request is received from a user and a web server is selected from a list of available web servers to process the web request. The web request is further transmitted to the web server. A web response, based on the web request, is transmitted back to the user. The system includes a central registry, a distributed store, a process coordinator, one or more web servers, and a router.

Abstract: A method and system for building an elastic cloud web server farm. The method includes registering a web application on a serving cloud and copying the web application to a distributed store. A load of the web application is specified, and a plurality of nodes is added for the web application based on the load. A web server corresponding to a node of the plurality of nodes is then initialized. A web request is received from a user and a web server is selected from a list of available web servers to process the web request. The web request is further transmitted to the web server. A web response, based on the web request, is transmitted back to the user. The system includes a central registry, a distributed store, a process coordinator, one or more web servers, and a router.

Abstract: A method and system for building an elastic cloud web server farm. The method includes registering a web application on a serving cloud and copying the web application to a distributed store. A load of the web application is specified, and a plurality of nodes is added for the web application based on the load. A web server corresponding to a node of the plurality of nodes is then initialized. A web request is received from a user and a web server is selected from a list of available web servers to process the web request. The web request is further transmitted to the web server. A web response, based on the web request, is transmitted back to the user. The system includes a central registry, a distributed store, a process coordinator, one or more web servers, and a router.

Abstract: A method and system for building an elastic cloud web server farm. The method includes registering a web application on a serving cloud and copying the web application to a distributed store. A load of the web application is specified, and a plurality of nodes is added for the web application based on the load. A web server corresponding to a node of the plurality of nodes is then initialized. A web request is received from a user and a web server is selected from a list of available web servers to process the web request. The web request is further transmitted to the web server. A web response, based on the web request, is transmitted back to the user. The system includes a central registry, a distributed store, a process coordinator, one or more web servers, and a router.

Abstract: Online batch processing. A job request is received from a user for processing. The job request includes a job configuration and a plurality of operations to process the data. The job configuration is extracted from the job request and stored in a configuration cache. A metadata configuration code is extracted from the job configuration and stored in a code cache. A runtime configuration code is extracted from the job configuration and stored in an instance cache. This allows information to be obtained from the configuration cache, the code cache and the instance cache for processing subsequent job requests with the similar job configuration and the plurality of operations. The data is fetched from at least one of the job request and an external storage device. The plurality of operations is executed on the data to generate a result. The result is provided to the user through at least one of an output stream and the external storage device.

Abstract: Feed Processing. An example method of processing a feed stored in a storage device includes receiving an input feed. Each record of the feed is associated with one or more unique identifiers. A first unique identifier for each record of the input feed is then generated. Each record of the input feed and each record of the feed is grouped as changed or not changed based on the first unique identifier for each record of the input feed and a first unique identifier for each record of the feed. A second unique identifier for each record of the input feed grouped as changed is also generated. Each record of the input feed grouped as changed and each record of the feed grouped as changed are then regrouped based on the second unique identifier for each record of the input feed and a second unique identifier for each record of the feed. Further, the feed is updated based on the regrouping, whereby a user accessing a record from the storage device obtains updated version of the record.

Abstract: Online batch processing. A job request is received from a user for processing . The job request includes a job configuration and a plurality of operations to process the data. The job configuration is extracted from the job request and stored in a configuration cache. A metadata configuration code is extracted from the job configuration and stored in a code cache. A runtime configuration code is extracted from the job configuration and stored in an instance cache. This allows information to be obtained from the configuration cache, the code cache and the instance cache for processing subsequent job requests with the similar job configuration and the plurality of operations. The data is fetched from at least one of the job request and an external storage device. The plurality of operations is executed on the data to generate a result. The result is provided to the user through at least one of an output stream and the external storage device.

Abstract: This patent discloses a computing platform to process structured data. The computer platform may include a component layer having a workflow engine to execute a workflow definition. The workflow engine may receive feed data from a user system. The workflow engine may send a business logic application and feed data to a distributed computation environment to batch process the feed data through the business logic application as part of executing the workflow definition.

Abstract: A method for distributing code resident on a remote application server to a local server. When a client requests information, a request handler on the local server handles the request. If the information is available on the local server, the request handler satisfies the request using this information. If the information is not available locally, the request handler accesses the remote application server to obtain the requested information. The request handler forwards the information to the client and caches it on the local server. Where the information cannot be transferred to the local application server, the request handler establishes a proxy to the remote application server that forwards a client request to the remote application server and a response from the remote application server to the client. The client communicates transparently with the remote application server via the proxy on the local application server.

Abstract: A computing environment includes an application server code resident on a remote application server that can be distributed by a local server. A request for information by a client is serviced by a request handler on the local application server. If the information is available on the local application server, the request handler satisfies the request. If the information is not available locally, the request handler can access the remote application server. When the information is copied to the local application server, the request handler retains a copy of the information and forwards a copy to the client. Where the information cannot be transferred to the local application server, the request handler can establish a proxy to the remote server and a response from the remote application server to the client. The client communicates with the remote application server via the proxy on the local application server and is unaware of the remote application server.

Abstract: A method for distributing code resident on a remote application server to a local server. When a client requests information, a request handler on the local server handles the request. If the information is available on the local server, the request handler satisfies the request using this information. If the information is not available locally, the request handler accesses the remote application server to obtain the requested information. The request handler forwards the information to the client and caches it on the local server. Where the information cannot be transferred to the local application server, the request handler establishes a proxy to the remote application server that forwards a client request to the remote application server and a response from the remote application server to the client. The client communicates transparently with the remote application server via the proxy on the local application server.

Abstract: A method and apparatus for sharing resources in a network environment. An application running on a client can access a resource on a remote computer by submitting a request via an Internet browser. The request is analyzed, converted to proper format and is transferred over the network lines to a server that can satisfy the request. For security reasons, an application may not be authorized to submit a request directly to a server on the Internet. If a requesting application has a trusted status, then its request for connecting to the server is granted. If a request submitted by an application to a server is denied, then a server that entrusts the application is identified, and the request is submitted to that server. A program code called a “servlet” is implemented on that server to accept the requests submitted by a trusted application. The submitted requests are analyzed by the servlet and are forwarded to a resource server that can satisfy the requests.

Abstract: A method and apparatus for authenticating users. Prior art mechanisms require each individual application (running on an “application server”) that the user is accessing to provide for the ability to use the various authentication mechanisms. One or more embodiments of the invention externalize the authentication mechanism from the application in the form of a login server. Only the login server needs to be configured to handle authentication mechanisms. The application server checks if a request has an active and valid session (e.g., a valid session may exist when there is active communication between a client and server that has not expired). If there is not a valid session, the application server redirects the user to the login server. The login server attempts to authenticate the user using any desired authentication mechanism. Once authenticated, the login server redirects the user back to the application server.

Abstract: A method and apparatus for authenticating users. Prior art mechanisms require each individual application (running on an “application server”) that the user is accessing to provide for the ability to use the various authentication mechanisms. One or more embodiments of the invention externalize the authentication mechanism from the application in the form of a login server. Only the login server needs to be configured to handle authentication mechanisms. The application server checks if a request has an active and valid session (e.g., a valid session may exist when there is active communication between a client and server that has not expired). If there is not a valid session, the application server redirects the user to the login server. The login server attempts to authenticate the user using any desired authentication mechanism. Once authenticated, the login server redirects the user back to the application server.

Abstract: A method and apparatus for sharing resources in a network environment. Typically, a computer linked to the Internet may have resources or may provide services, that are usable by other computers. A user, using one or more embodiments of the invention, can access those resources or services as if they were locally situated. An application running on a client can access a resource on a remote computer by submitting a request via an Internet browser. The request is analyzed, converted to proper format and is transferred over the network lines to a server that can satisfy the request. For security reasons, an application may not be authorized to submit a request directly to a server on the Internet. For example, limitations have been implemented that prohibit a requesting application from obtaining access to resources of a server computer unless that application is a trusted application. If a requesting application has a trusted status, then its request for connecting to the server is granted.