Issue sending email updates to encrypted SNS topic

I have an SES configuration set that is sending updates to an SNS topic.
I would like to encrypt that topic but I somehow need to give permission to SES to access the KMS key.
I don't think I can attach a policy to the SES service directly and I can't edit the policy on the default KMS key.

Does anyone know how to achieve this setup?

Thanks,
Arthur