Looking for effective alternative to ssh-copy-id which fails if you do not have the private part of the key?

To my surprise, I discovered that ssh-copy-id fails if you do not have the private part of the key, making it not usable for deploying someone else key.

I an looking for a reliable way to deploy these keys, so it must not create duplicate entries if you run it twice.