I have solved this. It was nothing to do with Route 53.
I am using Wordpress - there is a setting inside wordpress admin that allows you to set the domain. By changing this it stopped showing the IP.
My domain on Route 53 is not reaching my server created on AWS LightsailAccepted Answerasked 2 months ago
Route 53 not displaying domain name.asked 24 days ago
How to link a Lightsail DNS to a domain name I bought on Route 53asked 5 years ago
Domain setup on Route 53 + Lightsail Serverasked 9 months ago
Dynamic DNS (IP) for Route 53 DomainAccepted Answerasked 9 months ago
Route 53 Registered Domain Not ResolvingAccepted Answerasked 4 years ago
Route 53 configuration issueasked 2 days ago
Route 53 showing IP in browser instead of my domain nameasked 2 years ago
Can I use Route 53 with an .ai domain name?asked 6 years ago
New route 53 domainasked 2 years ago