What to look at for resolving Nice DCV 404 errors

I've got an EC2 instance setup with Nice DCV. I have setup port access in my security rules and created a session in nice dcv. However, whenever I try to connect to the session via the browsed, I get an HTTP ERROR 404. I can't seem to find any information in the Nice DCV docs about causes of 404 except for the session resolver which I'm not using. How can I go about resolving this issue?

Below is the output from dcv list-sessions -j

[
  {
    "id" : "cloud9-session",
    "owner" : "ubuntu",
    "num-of-connections" : 0,
    "creation-time" : "2022-09-23T12:58:40.919860Z",
    "last-disconnection-time" : "",
    "licenses" : [
      {
        "product" : "dcv",
        "status" : "licensed",
        "check-timestamp" : "2022-09-23T12:58:42.540422Z",
        "expiration-date" : ""
      },
      {
        "product" : "dcv-gl",
        "status" : "licensed",
        "check-timestamp" : "2022-09-23T12:58:42.540422Z",
        "expiration-date" : ""
      }
    ],
    "licensing-mode" : "EC2",
    "storage-root" : "",
    "type" : "virtual",
    "status" : "running",
    "x11-display" : ":0",
    "x11-authority" : "/run/user/1000/dcv/cloud9-session.xauth",
    "display-layout" : [
      {
        "width" : 800,
        "height" : 600,
        "x" : 0,
        "y" : 0
      }
    ]
  }
]

This is the output from dcv get-config

[connectivity]
web-use-https = false
web-port = 8080
web-extra-http-headers = [('test-header', 'test-value')]

[security]
authentication = 'none'

This is the output from systemctl status dcvserver

● dcvserver.service - NICE DCV server daemon
     Loaded: loaded (/lib/systemd/system/dcvserver.service; enabled; vendor preset: enable>
     Active: active (running) since Fri 2022-09-23 12:58:40 UTC; 18min ago
   Main PID: 715 (dcvserver)
      Tasks: 6 (limit: 76196)
     Memory: 39.9M
     CGroup: /system.slice/dcvserver.service
             ├─715 /bin/bash /usr/bin/dcvserver -d --service
             └─724 /usr/lib/x86_64-linux-gnu/dcv/dcvserver --service

Sep 23 12:58:40 ip-10-0-0-115 systemd[1]: Starting NICE DCV server daemon...
Sep 23 12:58:40 ip-10-0-0-115 systemd[1]: Started NICE DCV server daemon.

I'm trying to access the page with http://<public ip>:8080 I've also tried including the #session_id part in the url and using the windows client with no luck.

My operating system is Ubuntu 20.04 with a custom AMI running in a g4dn.4xlarge machine.