http://unix.stackexchange.com/questions/5621/how-to-speed-my-too-slow-ssh-login
Edit your "/etc/ssh/ssh_config" and comment out these lines:
GSSAPIAuthentication yes GSSAPIDelegateCredentials no