2025-01-17 Community meeting notes

5 min

Introduction

Bart

10 min

Co-coding followups

Bart

• Making weather providers configurable: Is complete and merged.

  • Followup: A new release must be made.

• Unit test is failing on main branch related to holiday features.

• Create get_weather_data: is also complete.

  • Followup: A new release must be made.

• Followup: There are a lot of PRs that need to be reviewed / merged.

  • KTP has a task on their board to do this.

15 min

Progress at Alliander

Bart

• Alliander is currently testing GBLinear model.

  • GBLinear model is just one linear model, but trained using boosting.

  • Model is not decisively better.

  • Model identifies correct high importance features (compared to linear model).

  • Model is much faster.

  • Q (Christian): How are improvements measured?

    • Alliander benchmarked on a few locations comparing: rMAE, Precision and Recall for different quantiles.

    • Peak metrics are based on congestion limit.

    • When forecast exceeds the congestion limit, a peak is predicted.

• MFFBAS extrapolation:

  • Updating MFFBAS profiles 2024->2025 had distributional shift in some profile features.

  • Because linear model extrapolates, this may cause problems with bad predictions.

  • RTE is using an additive model which supports non-linear extrapolation.

10 min

RTE update

 Maxime

• Developed InfluxDB based checks on data completeness.

  • Q (Maxime): Are there plans to remove MLFlow as a hard dependency?

    • RTE has no experience with MLOps and wants to explore alternatives before making a decision on which technology to choose.

  • Followup: No plans right now, but it will be considered in OpenSTEF plans.

10 min

RTE international update

Jan Maarten

• Will have a new internship 2025 — timeline unknown.

  • Will involve OpenSTEF, Dagster 

  • Goal to set up training/prediction pipeline.

  • Check data quality of RTE for congestion management usage.

10 min

Sigholm

Christian and Jan Maarten

• The PR's in review have been fixed: Awaiting to be merged.

• Jan Maarten was working on a personal setup of OpenSTEF and Dagster:

  • Followup (Egor): Send some information / slides for resources how to use Dagster for OpenSTEF.

5 min

Pull Requests

 Bart