sshd_config по сравнению с authorized_keys управляют параметром

Use the Match command in your sshd_config to apply different rules to the jenkins user than you do to other users:

• Match: Introduces a conditional block. If all of the criteria on the Match line are satisfied, the keywords on the following lines override those set in the global section of the config file, until either another Match line or the end of the file.

See the sshd_config man page for complete documentation.