I am pretty sure this is the same problem I usually get.

Sometimes I get a connection refusal or a connection timeout and it wont let me connect. There is no reason why I should receive those errors when I do, but it happens, and all you can do is wait it out.