EC2 virtual machines with virtual audio devices when headless (no remote desktop)

Hello, I work for a VR company and want to use amazon windows EC2 instances to test our clients and servers at scale. Our client requires both a playback and recording device with 48000 Hz 2 channel frequency in order to function properly. My question is, is there a way to configure an AWS Windows EC2 AMI such that it has audio drivers (virtual or otherwise) when operating headless (without a remote desktop connection)? Please let me know if you need any more information from me.