May just be the server provider. Seen that before. Bandwidth is a problem sometimes.
There's just too many folks online with your internet provider. (Time-Warner is really bad for that sometimes.)