This process refers to the Midwest ISO, but I’m sure other ISOs have a similar process. Thanks goes to Jason Watters at MISO Client Relations for pointing me to the data.
- Visit MISO “Library” page.
- Click “Market Reports“
- Choose “Summary,” from the Report Type field.
- Select “Include Archived Files.”
- The Report Name “Daily Regional Forecast and Actual Load” gives you access to the load data.
- The Report Name “wind” gives you access to the wind generation data.
The wind data should be easy enough to download and collate by hand and then import into matlab or R or whatever.
Regarding the load data, it’s kind of a pain to download the ~1000 (and growing) files by hand, so I highly recommend the DownloadThemAll! firefox extension for this. Moreover, the format of this data is somewhat clumsy to work with: separate excel files for each day (containing hourly predicted and actual load information for the previous day and only predicted load information for the day itself). I used the following steps to get all the hourly data together, in a similar format as the wind generation data:
- Make sure you have OpenOffice installed.
- Download PyODConverter, and read the instructions on the website.
- Write a script to run the convert command on all files. Just to peeve my unix friends, I did this as a windows batch script: loopFiles.bat 🙂
- Write a script to concatenate the files and remove the unwanted information. In this case, I used Cygwin and piped together a couple of bash commands to do the job in a snap:
head -q -n 31 *.xls.csv | grep ",,," -v | grep "Market Day" -v > winddata.csv
- Depending on your needs, you may want to combine the date and hour fields into a single timestamp. This can be done a number of ways, but it’s easy enough to use Excel or OpenOffice to do the formatting for you. Remember, the numerical representation of dates is in days.
And there you have it! Years of hourly wind generation and grid load data at your fingertips.