SYSTEM AND METHOD FOR GATHERING AND PERFORMING COMPLEX ANALYSES ON POWER DATA FROM MULTIPLE REMOTE SOURCES
The invention encompasses data analytics, and more specifically, encompasses the efficient gathering and management of data, and the execution of data analysis solutions on complex power and pricing.
Latest VERSIFY SOLUTIONS, INC. Patents:
- Aggregator, monitor, and manager of distributed demand response
- AGGREGATOR, MONITOR, AND MANAGER OF DISTRIBUTED MICRO-GENERATORS
- AGGREGATED MICRO-GENERATOR ENERGY SOURCES FOR DELIVERING ENERGY TO A POWER GRID
- Aggregator, monitor, and manager of distributed micro-generators
- SYSTEM AND METHOD FOR MANAGING AND MONITORING RENEWABLE ENERGY POWER GENERATION
This application is a continuation of U.S. patent application Ser. No. 12/399,682, filed on Mar. 6, 2009, which claims the benefit of priority to U.S. provisional patent application No. 61/064,483, filed on Mar. 7, 2008, both of which are incorporated herein by reference in their entirety.
FIELD OF THE INVENTIONThe invention encompasses data analytics, and more specifically, encompasses the efficient gathering and management of data, and the execution of data analysis solutions on complex power and pricing.
DISCUSSION OF THE RELATED ARTIn the power trading markets, power traders demand accurate, powerful, robust, and reliable data analysis systems. Power markets are comprised of Independent System Operators (ISO) and Regional Transmission Organizations (RTO), each of which is responsible for a specific geographical region that receives power transmission from one or more power generators. Each ISO/RTO is comprised of one or more regional power market, which can be considered as “assigned” to a subset geographical power region of its parent set's (i.e., ISO/RTO) region. Moreover, one or more power “nodes” exist within each of the regional power markets and, accordingly, belong to that specific regional power market. Within each ISO/RTO regional power market, power prices are: (a) established, (b) tracked, and (c) published according to supply and demand fundamentals, as power is traded and eventually generated. For each power node within a specific ISO/RTO regional power market, power prices vary individually. Therefore, for purposes of the power trading markets, power is typically traded on an hourly basis at each node, in a dutch-type auction market. Moreover, there is also a “day ahead” (DA) market that allows traders to bid/offer power into the market on a DA basis. With respect to the DA market, the ISO/RTO for the specific geographical region that is affected by one or more given DA trades determines the final DA price for each power node on which a bid/offer is placed. Subsequently, on an hourly basis, each ISO/RTO alerts each power trader who placed a bid/offer into its market(s) as to which DA trades were executed.
As for the operation of the actual power generation markets, which significantly affects the decisions made by power traders as well as the trading positions they choose to exercise, power generation may become disrupted in real time due to multiple factors. Some of these factors include, for example, power congestion, weather-related conditions, unexpected generator/transmission outages, or even differences between forecasted and actual power demand (i.e., power “load”). These factors taken in the aggregate, or individually, can easily disrupt the power grid. Therefore, as a direct proximate cause, these factors have a significant impact on power traders' decisions to exercise certain trade and/or develop certain trading strategies. Furthermore, whether the impact on the power grid is positive or negative, its root cause(s) simply translates into a proportionally weighed causal factor that “drives one or more power nodes' prices.
Additionally, every power node in an ISO/RTO market is assigned an actual “real time” (RT) price. Similar to the way in which DA trading is performed, the RT prices are also capable of being traded in a real time market (sometimes referred to as a “spot market”), as prices are published hourly by the appropriate ISO/RTO. Coupled together, the DA and RT prices are commonly known as Locational Marginal Pricing (LMP) data. LMP data is considered to be vital for power traders engaged in active trading, as well as for developing trading strategies, across various ISO/RTO markets. Accordingly, correlation between LMP data, power data, and the causal factors affecting at least this data from a recent or historical data analysis perspective would provide power traders valuable insight into the market. From a historical data perspective, the correlations between power data and LMP data in the power trading markets, according to causal factors, would assist the power trader in determining how the market would react in similar situations in the future because power trading markets tend to mimic their past/historical performance(s) when the same/similar causal factors are presented.
However, current data analysis systems that are tailored towards power traders for use in the power or energy trading markets only offer very limited data analysis capabilities. First, current data analysis systems do not make use of the full set of available power and price data. Moreover, these systems operate in a static manner and do not support dynamic data gathering, management, and analysis methodologies. Second, current data analysis systems also do not have the capability to gather, manage, and analyze data such that certain cause and effect scenarios can be determined accurately. For example, using current systems, power data such as power pricing data from the various markets cannot be managed and analyzed, in view of usage, congestion, weather-related conditions, and transmission outages, such that cause and effect factors are properly linked and identified to inform power traders to make appropriate market decisions.
SUMMARY OF THE INVENTIONAccordingly, the invention encompasses systems and methods for gathering and performing analyses on power data from multiple remote sources that substantially obviates one or more problems due to limitations and disadvantages of the related art.
An encompassed feature of the invention is a powerful, efficient, and robust power data management and analysis capabilities to allow power traders to make well-informed, confident trades, as well as to develop similar trading strategies.
Another encompassed feature of the invention is an efficient power data management solution that seamlessly retrieves, formats, and analyzes large quantities of power data from many remote sources, and provides various reports.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be apparent from the description, or may be learned by practice of the invention. The embodiments and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
To achieve these and other advantages and in accordance with the purpose of the invention, as embodied and broadly described, the systems and methods for gathering and performing complex analyses on power data from multiple remote sources includes a system, including a data gathering unit to gather power data and locational marginal pricing (LMP) data from a plurality of remote power data sources and to convert the power data and the LMP data into a common data format; a data analysis unit to correlate the power data with the LMP data based on causal factors; a database to store at least the gathered power data and the LMP data, the converted power data and the LMP data, and the correlated data of causal factors; and a display unit to display at least one of the converted power data and the LMP data, and the correlated data of causal factors.
Another illustrative embodiment of the invention encompasses methods including the steps of: gathering power data and LMP data from a plurality of remote power data sources and converting the power data and the LMP data into a common data format; correlating the power data with the LMP data based on causal factors; storing at least the gathered power data and the LMP data, the converted power data and the LMP data, and the correlated data of causal factors; and displaying at least one of the converted power data and the LMP data, and the correlated data of causal factors.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed.
The accompanying drawings, which are included to provide a further understanding of the illustrative embodiments of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention.
The invention encompasses a system including:
a data gathering unit to gather power data and locational marginal pricing (LMP) data from a plurality of remote power data sources and to convert the power data and the LMP data into a common data format;
a data analysis unit to correlate the power data with the LMP data for identifying causal factors;
a database to store at least the gathered power data and the LMP data, the converted power data and the LMP data, and the correlated data of causal factors; and
a display unit to display at least one of the converted power data and the LMP data, and the correlated data of causal factors.
In certain illustrative embodiments, the data gathering unit gathers power data and LMP data over a network.
In certain illustrative embodiments, the system further comprises an access unit to grant access to one or more remote users.
In certain illustrative embodiments, the one or more remote users are power traders in at least one power trading market.
In certain illustrative embodiments, the system further comprises a remote user device.
In certain illustrative embodiments, the display unit transmits display signals to the remote user device.
In certain illustrative embodiments, the system further comprises a price reporting unit to generate at least one price summary report.
In certain illustrative embodiments, the price summary report is presented based on filter criteria, the filter criteria including at least one of a price report type, start date, end date, day type, hour type, independent system operator (ISO) type, node type, delta value, standard deviation value, rank-by value, and LMP type.
In certain illustrative embodiments, the system further comprises a chart analysis unit to compare at least one of the converted power data and the LMP data and the correlated data of causal factors and to generate at least one chart analysis report.
In certain illustrative embodiments, the chart analysis report is generated based on filter criteria, the filter criteria including at least one of a start date, an end date, a day type, a hour type, a time zone type, a plurality of node types, a plurality of ISO/zone types, a plurality of weather types, and a compare nodes type.
In certain illustrative embodiments, the system further comprises a price look-back unit to retrieve the converted power data and the LMP data, and the correlated data of causal factors according to at least look-back criteria.
In certain illustrative embodiments, the look-back criteria includes at least one of a temperature value, a load value, an outage value, an ISO type, a weather type, a forecast date, a day value, a hour type, a matching hour value, a start date, and an end date.
In certain illustrative embodiments, the look-back criteria includes at least one of a fuel index type, a fuel index price, a constraint type, and a transmission outage type.
In certain illustrative embodiments, the retrieved data is passed to a price reporting unit to generate at least one price look-back report according to filter criteria.
In certain illustrative embodiments, the filter criteria includes at least a price report type.
In certain illustrative embodiments, the system further comprises a look-back results unit to display the retrieved data according to at least one of a date value, a day value, an average load forecast value, an outage value, an actual outage value, an average temperature value, a spot fuel value, and a price report type.
In certain illustrative embodiments, the system further comprises a compare node unit to compare nodes to the retrieved data.
In certain illustrative embodiments, the price report type includes at least one of a scouting summary, scouting detail, hourly spread, hourly averages, node ranking, top nodes, LMP breakdown, day ahead (DA) constraints, constraint frequency, weather forecast, weather forecast versus actual forecast, fuel prices, financial transmission rights (FTR) monthly auction, RSG/OP reserves, and transmission outages.
In another embodiment, the invention encompasses a computer-implemented method, including the steps of:
gathering power data and locational marginal pricing (LMP) data from a plurality of remote power data sources and converting the power data and the LMP data into a common data format;
correlating the power data with the LMP data for identifying causal factors;
storing at least the gathered power data and the LMP data, the converted power data and the LMP data, and the correlated data of causal factors; and
displaying at least one of the converted power data and the LMP data, and the correlated data of causal factors.
In certain illustrative embodiments, the gathering of power data and LMP data from a plurality of remote power data sources is performed over a network.
In certain illustrative embodiments, the computer-implemented further comprises the step of granting access to one or more remote users.
In certain illustrative embodiments, the one or more remote users are power traders in at least one power trading market.
In certain illustrative embodiments, the displaying step further comprises displaying signals on a remote user device.
In certain illustrative embodiments, the displaying signals are transmitted to the remote user device.
In certain illustrative embodiments, the computer-implemented method further comprises the step of generating at least one price summary report.
In certain illustrative embodiments, the price summary report is generated based on filter criteria, the filter criteria including at least one of a price report type, start date, end date, day type, hour type, independent system operator (ISO) type, node type, delta value, standard deviation value, rank-by value, and LMP type.
In certain illustrative embodiments, the computer-implemented method further comprises the step of comparing at least one of the converted power data and the LMP data and the correlated data of causal factors and generating at least one chart analysis report.
In certain illustrative embodiments, the chart analysis report is generated based on filter criteria, the filter criteria including at least one of a start date, an end date, a day type, a hour type, a time zone type, a plurality of node types, a plurality of ISO/zone types, a plurality of weather types, and a compare nodes type.
In certain illustrative embodiments, the computer-implemented method further comprises the step of retrieving the converted power data and the LMP data, and the correlated data of causal factors according to at least look-back criteria.
In certain illustrative embodiments, the look-back criteria includes at least one of a temperature value, a load value, an outage value, an ISO type, a weather type, a forecast date, a day value, a hour type, a matching hour value, a start date, and an end date.
In certain illustrative embodiments, the look-back criteria includes at least one of a fuel index type, a fuel index price, a constraint type, and a transmission outage type.
In certain illustrative embodiments, the computer-implemented method further comprises the step of passing the retrieved data and generating at least one price summary report according to filter criteria.
In certain illustrative embodiments, the filter criteria includes at least a price report type.
In certain illustrative embodiments, the computer-implemented method further comprises the step of displaying the retrieved data according to at least one of a date value, a day value, an average load forecast value, an outage value, an actual outage value, an average temperature value, a spot fuel value, and a price report type.
In certain illustrative embodiments, the computer-implemented method further comprises the step of comparing nodes to the retrieved data.
In certain illustrative embodiments, the price report type includes at least one of a scouting summary, scouting detail, hourly spread, hourly averages, node ranking, top nodes, LMP breakdown, day ahead (DA) constraints, constraint frequency, weather forecast, weather forecast versus actual forecast, fuel prices, financial transmission rights (FTR) monthly auction, RSG/OP reserves, and transmission outages.
In another embodiment, the invention encompasses a computer-readable storage medium, storing one or more programs configured for execution by one or more processors, the one or more programs comprising instructions to:
gather power data and locational marginal pricing (LMP) data from a plurality of remote power data sources and convert the power data and the LMP data into a common data format;
correlate the power data with the LMP data for identifying causal factors;
store at least the gathered power data and the LMP data, the converted power data and the LMP data, and the correlated data of causal factors; and
display at least one of the converted power data and the LMP data, and the correlated data of causal factors.
Reference will now be made in detail to the embodiments of the invention, examples of which are illustrated in the accompanying drawings. Wherever possible, like reference numbers will be used for like elements.
As further illustrated in
Because the data formats (also referred to as data schemas) of the data stores 21-25 may not be consistent among the data stores 21-25, the data gathering unit 31 implements a plurality of customized routines to convert the power and price data into at least one common data format. To accurately complete the data formatting routine, the data gathering unit 31 is regularly updated with the latest customized routines that include data format changes on each data store. Accordingly, the data gathering unit 31 normalizes data from the disparate remote data sources for efficient data handling by other units within the system layer 30. Additionally data gathering unit 31 acts as a layer of abstraction that insulates/encapsulates the other units from having to undergo changes as data stores may edit their respective data formats. The data gathering unit 31 may also implement the actual data format changes that should be made as data stores edit their respective data formats. Alternatively, the data gathering unit 31 may invoke outside procedures, which are updated as any edits are made to the data formats. Further, the outside procedures may be executed via the master data store 32, or any other data store that supports the procedures' successful execution. The data gathering unit 31 may, in some instances, execute on an hourly basis because the ISO/RTO markets publish and/or update their data at such time intervals. In a one day period the ISO/RTO markets could publish and/or update their data—in different data formats—at least twenty-four (24) times; this frequency factor when multiplied by the number of ISO/RTO markets, five (5) of which are shown in the exemplary embodiment of
After the data gathering unit 31 gathers and normalizes the data from the data stores 21-25, the gathered power and price data converted to a common data format are sent from the data gathering unit 31 to the master data store 32 for storage and later retrieval/query access by other units of the system layer 30. The master data store 32 may be implemented using any type of data base management system (DBMS) such as, for example, SQL Server™, Oracle™, or Access™. However, other DBMS or data storage solutions (e.g., files, memory, etc.) may be used without departing from the scope of the invention.
The master data store 32 includes power data, price data (including locational marginal pricing (LMP) data), and causal factors data obtained from the various remote power data sources 20. In an exemplary embodiment, the gathered power data and price data from each ISO/RTO region may be logically/physically stored together, while the same data may be stored separately from another ISO/RTO region's data. Furthermore, with each of the various ISO/RTO databases, the power and price data is partitioned according to a month of the year to which it applies. As a consequence of this multi-tiered data organization and storage scheme, the queries applied against each tier of data may only traverse a specific ISO/RTO region's data according to a specific month of the year, and not necessarily the entire depth and breadth of ISO/RTO region data that is available on the master data store 32. Of course, one of ordinary skill in the art will recognize that queries (like those written using the structure query language, SQL) can be broadened or narrowed accordingly and do not have to conform to this specific implementation. For example, SQL or other types of queries may be written in such a way as to combine months or ISO/RTO regions/markets in order to broaden the scope of their data coverage. Similarly, the queries may also be limited to narrower subsets of data within a month, regional power markets within an ISO/RTO region/market, and/or even to specific power nodes within regional power markets; these queries may also be further executed alone or in combination with other query elements for access to an even narrower set of data, as long as those other elements are defined and available in the database schema.
As depicted in the exemplary embodiment of
As further illustrated in the exemplary embodiment of
The data analysis unit 34 performs analyses on power data and price data to correlate them individually or in the aggregate with one or more causal factors. It is these analyses and other similar ones that are processed by the data analysis unit 34, verified against a power trader user's 43 access permission(s), and may then be sent via either the access unit 33 or display unit 35 to the power trader access unit 41. The transmission of the results of these analyses, and similar ones, may be performed directly, or over a LAN or WAN 60 (whether wired or wireless). Once transmitted to the one or more power trader access units 41 and to the power trader user(s) 43 in one or more power trading markets 40, the results may then be displayed over a processing/display device 42 like a laptop, PDA, mobile telephone, or other similar processing/display device, capable of running a power trader access unit 41 and/or capable of receiving the results from the access unit 33 or display unit 35. A power trader access unit 41 may be an internet browser like those offered by Microsoft, Netscape, or Mozilla (e.g., Internet Explorer™, Navigator™, Firefox™), a standalone application, or may be a port capable of sending and receiving data, whether that port be a direct-connection type port, or a network-connection type port. In accordance with the exemplary embodiment of
Further, as illustrated in the exemplary embodiment of
Power traders 43 in one or more power trading markets 40 are capable of accessing several features through the power trader access unit 41 as it interfaces with the access unit 33 and/or the display unit 35. The features are specifically aimed at customizing queries against the master data store 32, selecting one of several types of features for customizing the queries, and receiving several kinds of reports for display via the power trader access unit 41 and a processing/display device 42.
The features for customizing queries and the kinds of reports are embodied in
An exemplary embodiment of each of the price report types, listed above, is illustrated in
The features and capabilities of the price look-back feature, as well as some of the other features of the exemplary embodiment, provide power trader users 43 with powerful tools to at least retrieve and analyze the most proper and accurate historical power and price data, which serve as a reliable indicator for today's power prices and market performance. In addition, power trader users 43 are also able to at least analyze accurate cause-and-effect scenarios that permit the traders to make confident, informed trades, as well as to develop successful power market trading strategies.
The exemplary embodiments described herein not only manage, track, and analyze power and pricing data, but the analysis capabilities aid power traders in determining the causal factors that drive specific ISO/RTO power trading markets. In fact, a system and method are provided for, among other things, evaluating supply and demand fundamentals, power data, pricing data, causal factors, and determining a “real time” (RT) price.
It will be apparent to those skilled in the art that various modifications and variations can be made in the system and method for gathering and performing complex analyses on power data from multiple remote sources, of the present invention, without departing form the spirit or scope of the invention. Thus, it is intended that the invention cover the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents.
Claims
1. (canceled)
2. A system, comprising:
- a processor;
- a display unit; and
- a non-transitory data storage device that includes instructions when executed by the processor comprising:
- a data gathering unit to gather power data and locational marginal pricing (LMP) data from a plurality of remote power data sources, wherein the power data includes real-time power data; and
- a data analysis unit to correlate the real-time power data with the LMP data for identifying causal factors.
3. The system of claim 2, wherein the data gathering unit converts the power data and the LMP data into a common data format.
4. The system of claim 3, further comprising a database to store at least the gathered real-time power data and the LMP data, the converted power data and the LMP data, and the correlated data of causal factors.
5. The system of claim 2, wherein the data gathering unit gathers the power data and LMP data over a network.
6. The system of claim 2, further comprising an access unit to grant access to one or more remote users.
7. The system of claim 6, wherein the one or more remote users are power traders in at least one power trading market.
8. The system of claim 2, further comprising a remote user device.
9. The system of claim 2, wherein the display unit transmits display signals to the remote user device.
10. The system of claim 2, further comprising a price reporting unit to generate at least one price summary report.
11. The system of claim 10, wherein the price summary report is presented based on filter criteria, the filter criteria including at least one of a price report type, start date, end date, day type, hour type, independent system operator (ISO) type, node type, delta value, standard deviation value, rank-by value, and LMP type.
12. The system of claim 3, further comprising a chart analysis unit to compare at least one of the converted power data and the LMP data and the correlated data of causal factors and to generate at least one chart analysis report.
13. The system of claim 12, wherein the chart analysis report is generated based on filter criteria, the filter criteria including at least one of a start date, an end date, a day type, a hour type, a time zone type, a plurality of node types, a plurality of ISO/zone types, a plurality of weather types, and a compare nodes type.
14. The system of claim 3, further comprising a price look-back unit to retrieve the converted power data and the LMP data, and the correlated data of causal factors according to at least look-back criteria.
15. The system of claim 14, wherein the look-back criteria includes at least one of a temperature value, a load value, an outage value, an ISO type, a weather type, a forecast date, a day value, a hour type, a matching hour value, a start date, and an end date.
16. The system of claim 14, wherein the look-back criteria includes at least one of a fuel index type, a fuel index price, a constraint type, and a transmission outage type.
17. The system of claim 14, wherein the retrieved data is passed to a price reporting unit to generate at least one price look-back report according to filter criteria.
18. The system of claim 17, wherein the filter criteria includes at least a price report type.
19. The system of claim 12, further comprising a look-back results unit to display the retrieved data according to at least one of a date value, a day value, an average load forecast value, an outage value, an actual outage value, an average temperature value, a spot fuel value, and a price report type.
20. The system of claim 14, further comprising a compare node unit to compare nodes to the retrieved data.
21. The system of claim 11, wherein the price report type includes at least one of a scouting summary, scouting detail, hourly spread, hourly averages, node ranking, top nodes, LMP breakdown, day ahead (DA) constraints, constraint frequency, weather forecast, weather forecast versus actual forecast, fuel prices, financial transmission rights (FTR) monthly auction, RSG/OP reserves, and transmission outages.
Type: Application
Filed: Nov 4, 2013
Publication Date: Jul 10, 2014
Applicant: VERSIFY SOLUTIONS, INC. (Chadds Ford, PA)
Inventors: David IPPOLITO (Glen Mills, PA), David KUCHARCZUK (Chadds Ford, PA)
Application Number: 14/071,268
International Classification: G06Q 50/06 (20060101); G06Q 40/00 (20060101);