Starting January 16th around 5pm CET, our systems started to have a partial gradual increase in latency in processing certain events, like manual setpoint changes, for the Line X devices. This increasing latency was unfortunately missed by our automated monitoring as these were delays and not outright failures. Therefore, the fix was applied after it was noticed in-person by one of our engineers on the evening of January 18th. There was no distinctive underlying failure, our systems just reached a point where processing power was not enough for the increasing load.
We apologise for the inconvenience caused and to avoid such situations in the future we’ve updated our monitoring to closely track delays in processing. Thank you!