timesteam influxdb setup with kafka connect / normal python code

Hello was trying to setuptimestream influxdb data ingestion from kafka .. I had to give Influxdb is have public access, meaning i can open the directly UI when I am adding my IP to inbound rule for 8086 in same sg...

We have tried two ways, first with kafka connect jar, then with running a small python script. in both we have faced different issue..

**First used kafka connect: **

Using https://github.com/awslabs/amazon-timestream-tools/tree/mainline/integrations/kafka_connector .. I cloned the repo & build the jar kafka-connector-timestream-1.0-SNAPSHOT-jar-with-dependencies.jar .. in aws msk connector ,

connector.class=software.amazon.timestream.TimestreamSinkConnector
timestream.database.name=timestream-influxdb-test-turjo  ## This table name if not provided, it was giving error table name is empty.. so gave a dummy name. 
timestream.table.name=data_table
timestream.schema.s3.bucket.name=timestream-influx-config
tasks.max=2
topics=topicname
timestream.influxdb.bucket=data_kf
timestream.ingestion.endpoint=https://<VPC ENDPOINT for timestream interface gateway>
aws.region=eu-west-2
timestream.schema.s3.key=schema_def/schema.json
timestream.influxdb.url=https://<INFLUX DB ENDPOINT>:8086
timestream.target.liveanalytics=false
timestream.influxdb.token=<INFLUXDBTOKEN>
timestream.influxdb.org=ea
value.converter=org.apache.kafka.connect.json.JsonConverter
key.converter=org.apache.kafka.connect.storage.StringConverter
timestream.target.influxdb=true

both msk & influxdb are in same vpc, sg assigned.. in sg 8086 port is open for self connection(in source same sg is given)

**ISSUE: ** timestream influxdb does not have database or table .. database name i had given the database instance name that comes under influxdata base list.. timestream.database.name=timestream-influxdb-test-turjo timestream.table.name=data_table

But we are getting error timestream-influxdb-test-turjo does not exists. [Worker-0c5283c0533854bb9] [2025-05-16 11:56:11,861] ERROR [influxdbconnector12|task-0] ERROR::AWSServiceClientObjectsValidator::validateTimestreamDatabase (software.amazon.timestream.utility.AWSServiceClientObjectsValidator:89)

Question 1: Could someone please help what should be the database name & table for influx db.. After login to InfluxDB UI, I dont any see database or Table name... it looks like database & table came are part of timestream liveanalytics.. but I am using timestream influxdb.. so why we need to configure those ?

**Running with Python : **

As with kafka connect, we were facing above issue, tried with simple python code to push dummy data to influx that worked.. bucket = "BUCKET" org = "ORG" token = "TOKEN" url="https://<INFLUX ENDPOINT>" client = influxdb_client.InfluxDBClient( url=url, token=token, org=org ) write_api = client.write_api(write_options=SYNCHRONOUS) p = influxdb_client.Point("my_measurement").tag("location", "Prague").field("temperature", 15.3) write_api.write(bucket=bucket, org=org, record=p)

**Question 2: ** Here we faced connectivity issue from ec2 to influx endpoint.. Ec2 & influx were in same vpc . sg group has 8086 port open for self group & also ec2 private IP separately. Influxdb was made publiclyAccessible True, so that the UI can be opened.. If it was made private,Then UI button was disabled. If I add ec2 public IP to sg group inbound rule, then it works.. But with ec2 private IP sg group inbound rule, it is not able to connect to the influx end point.. connection timeout..

I had created one VPC interface endpoint also having following policy.. { "Statement": [ { "Action": "", "Effect": "Allow", "Principal": "", "Resource": "*" } ] }

How do I make ec2 private IP to connect to influxdb.. not connect via public ??