net::ERR_ABORTED 404 from WOFF/WOFF2 file

I'm trying to host my portfolio to the S3 bucket, but I keep getting an error 404 because of the Google font I used. Is there any way to fix this? I did some research, it said I need to edit my web.config file. (https://hotcakescommerce.zendesk.com/hc/en-us/articles/210926903-HTTP-404-Not-Found-Error-with-woff-or-woff2-Font-Files) I'm using React Vite. Do I need to edit vite.config? If so, how do I do it? Any references?