I was having issues when I added my ssh-key in some servers under my user, it wasn’t working, actually it was failing, after a quick research I found a work-around for that, basically permission as always.
chmod 700 ~/.ssh
chmod 600 ~/.ssh/authorized_keys
REFERENCES: https://gist.github.com/grenade/6318301