Copy directory with SCP

I'm trying to copy directory from local drive to remote server with -r parameter, however I'm getting:

scp: System error: 1633648 (Failed to retrieve error string (err:317))

This is the syntax I use:

scp -i ~/.ssh/id_rsa -r temp username@http://remoteserver:/%username%/ext

Yes, I'm using identity file, so that it wouldn't prompt me for password. Anybody knows why am I getting the error?