If you are experiencing long delays when connecting to Ubuntu through SSH, this is most likely a protocol issue investigate this site.
In your SSH_CONFIG file, set:
GSSAPIAuthentication no
Restart the ssh daemon, and you should be quickly connecting to your Ubuntu server from now on.