CSR creation for Azure Website

I have hosted an ASp.net core web application as an Azure Website. Since you cannot do a remote desktop connection and create a CSR file, Im at a loss as to how to create one for this file.

As mentioned here

Must CSRs be generated on the server that will host the SSL certificate?"

But where are the private keys and public keys mentioned in the article.