I'm using a normal wired router.
There are no other data transfers while the problem was happening.
I doubt the problem is my router or else I'd be getting the problem all the time. And the problem wouldn't suddenly vanish all on it's own. That doesn't sound like a router issue to me.
It sounds much like this issue: »SUDDENLY High latency an packet loss to gateway