Enable `mysqlx` plugin on RDS

I'm using the MySQL 8.0 C++ connector and need to enable the mysqlx plugin on my RDS instance, otherwise I cannot connect my code. When I do SHOW plugins it shows up as installed, but disabled.

There doesn't seem to be any documentation anywhere explaining how to enable it or why it's disabled.