When Sidekiq was restarted, the scheduler's time was reset and jobs were executed later. Now we trigger the HeartbeatJob straight after a Sidekiq boot and we shouldn't see any false alarms in our monitoring.
This setting was removed in Sidekiq 6.0, logs are handled a bit differently now. The logging works though 👍