Cross Account S3 Access without internet or VPC peering

We have Account A where an EC2 instance runs in a private subnet with no route to NAT gateway or Internet Gateway. We don't want internet to work on this EC2 instance.

We have another Account B where an S3 bucket exists. No VPC peering exists between Account A and Account B.

If we give permissions to a user to access this bucket from Account B, can we access S3 bucket from EC2 instance in Account A? If I create a VPC endpoint in Account A or B, will it help?