Implementing SSO with on-site system

I manage data on the customer's site with an on-premise system(running with Debian or Fedora). To access the data remotely, I have to log into a different server with a different credential to access the on-premise system. My question is that is it possible to implement SSO with the on-premise system that is running standalone?(Sorry if this is confusing, can provide clarifications)