Thanks.
I was able to replicate the issue of connecting, processing ,etc. and its due to packet loss on the server. I will be replacing the server soon. This explains why sometimes is good (there's no packet loss - and I just happened to test while there was no packet loss by just mere coincidence), and then like right now it stalls because there's a lot of it.