evaluate.py

Overview

This script runs the trained net on test data and evaluates the result. It provides several graphs as outputs that show the performance of the trained model. The output path can be changed under the the "evaluation_path": option in the corresponding config file.

Inputs

• ./data/<path_to_data_csv>.csv
• ./oracles/model_station

Outputs

• ./oracles/<name_of_evaluation_folder>/

Example Output Files

The output consists of the actual load prediction graph split up into multiple .png images and a metrics plot containing information about the model’s performance. Plots of the predicted load at different hours

Metrics plot with results of evaluation

Summarized Description of Performance Metrics

If you need more details on which deterministic and probabilistic metrics we take to quantify if the produced forecast is considered “good” or “bad”, please take a look at the Tutorial Notebook.

Reference Documentation

If you need more details, please take a look at the docs for this script.