You are right!
I got help from sysadmin to add first key.
Then I tested ssh-copy-id which worked (no surprise).
But there is a bit of a catch 22, when you need an installed key to be able to install a key.
I can’t even paste text in VNC, so that option is not valid.
How am I supposed to log in first time?