In this article, you can read about what Mestro does to detect and address stalled data imports and data gaps.

Mestro has extensive experience in energy data collection from various sources and handles millions of measurement values daily from hundreds of actors using several different data transfer technologies. Some data streams are more high-tech than others, but something they all have in common is that they occasionally stop or that gaps occur int he data stream. This can happen due to a variety of factors, which may lie with the data sender (e.g., the utility company), the receiver (Mestro), or one of its subcontractors/intermediaries (e.g., mail or server hosts).

To manage interruptions in data traffic, Mestro monitors all data streams on a monthly basis. This occurs in the middle of each month and covers the data from the previous month. For example, data from January is checked in mid-February. The reason the check is done in the middle of the month is to ensure that all data from all operators has been received for the previous month.

Errors that are discovered are analyzed by Mestro, and appropriate actions are taken. If the error lies with Mestro, it is addressed internally, and if the error is due to the data provider, they are contacted. If any action is required from you as a customer, you will be contacted. The following steps describe the work process:

• All meters are reviewed automatically to detect those with interrupted data streams, or where the data stream stopped and then restarted, leading to gaps in energy statistics.
• The results of the automated detection are sorted and prioritized for action. Operators with the largest number of recipient meters in the Mestro portal are prioritized over those with fewer meters, but all are managed.
• Once all meters have been reviewed, actions are taken to restart the data streams, which may include Mestro contacting data providers or handling issues that have arisen within our own data collection chain.
• If any action is required from the customer, they will be contacted. This may include situations such as a missing or outdated power of attorney, missing log in credentials for a robot, or the need to create an API key.
• If a meter still has gaps or is still stalled despite Mestro’s actions (e.g., the grid company has been contacted but failed to restart the data export), further action will be taken during the next monthly monitoring. In this way, Mestro reminds the data provider until the problem is resolved.
  
  

  FAQ

  • How do I know if my meter with missing data has been handled?
    All meters for which Mestro automatically collects data are checked for data gaps and stoppages every month. The results of the check lead to actions for all affected measurement points. An example of such an action is Mestro contacting the relevant data provider.
  • How often do you email utility companies about stops in data transfer?
    Once a month. Other actors who export data to Mestro are also contacted regarding stops and gaps, such as sub-meter system operators, with the same frequency.
  • How often are reminders sent?
    If a data provider does not restart the export after Mestro has contacted them, the affected measurement point will be included in the next month’s detection of meters that have stopped or have data gaps, and the data provider will be contacted again.
  • What should I do if I have questions?
    You are always welcome to contact Mestro support if you have questions about our work with monitoring data streams. However, generally, no individual interventions are made for specific meters. All gaps and halted data streams are gathered monthly, after which utility companies and other actors are contacted.
  • Can I as a customer follow the work with my stalled meters?
    In the Mestro portal, there are reports to visualize data coverage in your portfolio, so you know which meters are receiving data export and which are not, and when data is potentially missing. If you, as a customer, need to take action (e.g., update a power of attorney or provide new login credentials), you will be contacted by Mestro.
  • Where can I read about disturbances in data transfer from, for example, grid companies?
    In the case of larger operational issues, such as when a particular grid company’s data transfer is down or something else in the collection chain has gone wrong, this is communicated via banners in the Mestro portal. If you, as a customer, want to subscribe to operational notifications, please contact your Customer Success Manager or Mestro Support. Here, you can read about historical and ongoing operational disturbances.
  • How is prioritization handled between different data sources that have stopped?
    When it comes to taking action to get the data stream up and running again or to fill a gap in the statistics due to a stoppage, data sources with the most recipient meters in the Mestro portal are prioritized over those with fewer measurement points. This means that data streams from large grid companies are prioritized over smaller actors. However, Mestro acts on all data stoppages monthly, both for large and small actors.
  • When during the month is the detection of data gaps and stalled meters done? How long should I wait for my meter to receive data again?
    Data import to your meter in the Mestro portal happens in different ways depending on the data source, which also affects the ability to control it. For some measurement points, high-resolution data is sent frequently (e.g., 15-minute values sent daily from Swedish grid companies), while for others, low-resolution data is sent less frequently (e.g., monthly values sent two weeks after the end of the month from smaller district heating companies), and everything in between. The detection of data gaps and stalled meters is done in the middle of the month, after which data providers are contacted. This means that a meter can be stalled anywhere from 1 day to 6 weeks before the data provider is contacted, depending on when the stoppage occurs during the month. This is followed by the data provider’s response time, which can vary and is outside of Mestro's control. If the stoppage is due to an expired power of attorney, the customer’s lead time to get the power of attorney signed is added to the time. Most providers are quick to respond, which means that data transfer is quickly resumed after an interruption.
  • I don’t have time to wait! What can I do to speed up the process?
    If you don't have time to wait for the data provider to restart the data export, you can, if you have access to the data, manually input the data into your meter yourself. Read more about how here
  • Does Mestro do anything to monitor data collection between the monthly checks?
    Mestro continuously detects overall deviations in data collection and acts on them directly. This can be the case if a certain actor has problems affecting all their data exports or if there’s an internal issue in Mestro’s data collection engine or support systems (e.g., mail server).