By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post

Display name set for the Redis traces is not shown in the Xray

0

Hi, I have Redis calls and have set the display names for these calls using options available in OpenTelemetry Instrumentation and have used the OTEL collector. In XRay these Redis are coming up as Remote. Please refer the images uploaded for reference XRay Trace for Redis

whereas when using other tools like Jaeger Exporter/Zipkin it is showing the name Jaeger trace

ZipKin trace Zipkin trace

Could you please let us know how we get the display name?

Topics
Developer Tools
Tags
AWS X-Ray
Language
English
rePost-User-2903888
asked a year ago352 views
9 Answers
0

Hi, Thanks for checking this. But if you see the traces in Jaeger it concatenates the peer.service and display name and both will be shown. Can something like this be done. And also, why it shows Remote for the Redis traces. Can this be changed to show the display name?

rePost-User-2903888
answered a year ago
  • XRay-Dev-xiami
    a year ago

    Jaeger and Zipkin have separate fields to store peer.servce and Span name in their data model. In X-Ray, we only have one slot, so we chose to use peer.service by following OTel Spec here. The Remote is another field(namespace) used in X-Ray to determine the downstream service is a AWS resource or regular remote service, so we can't override it.

0

Jaeger and Zipkine stores peer.service and Display/Span Name in 2 separate fields in their data model. In X-Ray, we currently only have one slot and we took peer.service by following OTel Spec here.

We can't override Remote because it is another field in X-Ray model for indicating the downstream service is a AWS resource or not.

AWS
XRay-Dev-xiami
answered a year ago
  • rePost-User-2903888
    a year ago

    Hi, If this is the case, can you try to override the Remote with whatever is being set as the Display name. If this can be done it would be really helpful. Thanks

0

Could you post the Raw data shown on your X-Ray console? (screenshot-1)

AWS
XRay-Dev-xiami
answered a year ago
0

Please find the Raw data below:

{
    "Id": "1-63732f1c-c530d825c328d355d4dcf6ae",
    "Duration": 0.433,
    "LimitExceeded": false,
    "Segments": [
        {
            "Id": "64a14de737d505e1",
            "Document": {
                "id": "64a14de737d505e1",
                "name": "Configuration Auth Service",
                "start_time": 1668493084.5164244,
                "trace_id": "1-63732f1c-c530d825c328d355d4dcf6ae",
                "end_time": 1668493084.9496284,
                "fault": false,
                "error": false,
                "throttle": false,
                "http": {
                    "request": {
                        "url": "http://localhost:5454/api/config-auth/list",
                        "method": "GET",
                        "user_agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36 Edg/107.0.1418.35"
                    },
                    "response": {
                        "status": 200,
                        "content_length": 0
                    }
                },
                "aws": {
                    "xray": {
                        "auto_instrumentation": false
                    }
                },
                "metadata": {
                    "default": {
                        "http.route": "api/config-auth/list",
                        "otel.resource.service.instance.id": "bf2f4c25-a6fe-4ecc-9251-abdbfbf5c00d",
                        "otel.resource.service.namespace": "1.0",
                        "otel.resource.service.name": "Configuration Auth Service"
                    }
                },
                "subsegments": [
                    {
                        "id": "4b1341a9e1369b0e",
                        "name": "127.0.0.1:6379",
                        "start_time": 1668493084.652434,
                        "end_time": 1668493084.6678195,
                        "fault": false,
                        "error": false,
                        "throttle": false,
                        "aws": {
                            "xray": {
                                "auto_instrumentation": false
                            }
                        },
                        "metadata": {
                            "default": {
                                "db.redis.database_index": 0,
                                "db.statement": "GET",
                                "db.system": "redis",
                                "peer.service": "127.0.0.1:6379",
                                "db.redis.flags": "None"
                            }
                        },
                        "namespace": "remote"
                    }
                ]
            }
        },
        {
            "Id": "3b24d2773bbeef0f",
            "Document": {
                "id": "3b24d2773bbeef0f",
                "name": "127.0.0.1:6379",
                "start_time": 1668493084.652434,
                "trace_id": "1-63732f1c-c530d825c328d355d4dcf6ae",
                "end_time": 1668493084.6678195,
                "parent_id": "4b1341a9e1369b0e",
                "inferred": true
            }
        }
    ]
}
rePost-User-2903888
answered a year ago
0

Thanks, it looks the Span name received by X-Ray is "name": "127.0.0.1:6379", Could you please help to follow to configuration example below that enables OTel Collector debugging logs and send us the otel collector logs after reproducing the issue again?

Example of OTel Collector config with debugging logs enabled.

Please note to have customer configure logging exporter and telemetry section at the bottom of the configuration file.

exporters:
  logging:
    loglevel: debug
  awsxray:
    region: 'us-west-2' 
service:
  pipelines:
    traces:
      receivers: [otlp]
      processors: [batch]
      exporters: [logging, awsxray, jaeger, zipkin]

  telemetry:
    logs:
      level: debug
AWS
XRay-Dev-xiami
answered a year ago
0

Please find the logs below:

2022/11/24 05:28:40 ADOT Collector version: v0.22.0
2022/11/24 05:28:40 found no extra config, skip it, err: open /opt/aws/aws-otel-collector/etc/extracfg.txt: no such file or directory
2022-11-24T05:28:40.411Z	info	service/telemetry.go:118	Setting up own telemetry...
2022-11-24T05:28:40.412Z	info	service/telemetry.go:159	Serving Prometheus metrics	{"address": ":8888", "level": "basic"}
2022-11-24T05:28:40.412Z	info	components/components.go:30	In development component. May change in the future.	{"kind": "exporter", "data_type": "traces", "name": "logging", "stability": "in development"}
2022-11-24T05:28:40.412Z	debug	components/components.go:28	Beta component. May change in the future.	{"kind": "exporter", "data_type": "traces", "name": "awsxray", "stability": "beta"}
2022-11-24T05:28:40.412Z	debug	awsutil@v0.61.0/conn.go:60	Using proxy address: 	{"kind": "exporter", "data_type": "traces", "name": "awsxray", "proxyAddr": ""}
2022-11-24T05:28:40.413Z	debug	awsutil@v0.61.0/conn.go:137	Fetch region from commandline/config file	{"kind": "exporter", "data_type": "traces", "name": "awsxray", "region": "us-east-1"}
2022-11-24T05:28:40.413Z	debug	awsxrayexporter@v0.61.0/xray_client.go:51	Using Endpoint: %s	{"kind": "exporter", "data_type": "traces", "name": "awsxray", "endpoint": "https://xray.us-east-1.amazonaws.com"}
2022-11-24T05:28:40.413Z	debug	components/components.go:28	Stable component.	{"kind": "processor", "name": "batch/traces", "pipeline": "traces", "stability": "stable"}
2022-11-24T05:28:40.413Z	debug	components/components.go:28	Beta component. May change in the future.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "stability": "beta"}
2022-11-24T05:28:40.413Z	info	memorylimiterprocessor/memorylimiter.go:113	Memory limiter configured	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "limit_mib": 100, "spike_limit_mib": 20, "check_interval": 1}
2022-11-24T05:28:40.413Z	debug	components/components.go:28	Stable component.	{"kind": "receiver", "name": "otlp", "pipeline": "traces", "stability": "stable"}
2022-11-24T05:28:40.414Z	info	service/service.go:112	Starting aws-otel-collector...	{"Version": "v0.22.0", "NumCPU": 12}
2022-11-24T05:28:40.414Z	info	extensions/extensions.go:42	Starting extensions...
2022-11-24T05:28:40.414Z	info	pipelines/pipelines.go:74	Starting exporters...
2022-11-24T05:28:40.414Z	info	pipelines/pipelines.go:78	Exporter is starting...	{"kind": "exporter", "data_type": "traces", "name": "logging"}
2022-11-24T05:28:40.414Z	info	pipelines/pipelines.go:82	Exporter started.	{"kind": "exporter", "data_type": "traces", "name": "logging"}
2022-11-24T05:28:40.414Z	info	pipelines/pipelines.go:78	Exporter is starting...	{"kind": "exporter", "data_type": "traces", "name": "awsxray"}
2022-11-24T05:28:40.414Z	info	pipelines/pipelines.go:82	Exporter started.	{"kind": "exporter", "data_type": "traces", "name": "awsxray"}
2022-11-24T05:28:40.414Z	info	pipelines/pipelines.go:86	Starting processors...
2022-11-24T05:28:40.414Z	info	pipelines/pipelines.go:90	Processor is starting...	{"kind": "processor", "name": "batch/traces", "pipeline": "traces"}
2022-11-24T05:28:40.414Z	info	pipelines/pipelines.go:94	Processor started.	{"kind": "processor", "name": "batch/traces", "pipeline": "traces"}
2022-11-24T05:28:40.414Z	info	pipelines/pipelines.go:90	Processor is starting...	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces"}
2022-11-24T05:28:40.414Z	info	pipelines/pipelines.go:94	Processor started.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces"}
2022-11-24T05:28:40.414Z	info	pipelines/pipelines.go:98	Starting receivers...
2022-11-24T05:28:40.414Z	info	pipelines/pipelines.go:102	Receiver is starting...	{"kind": "receiver", "name": "otlp", "pipeline": "traces"}
2022-11-24T05:28:40.414Z	info	zapgrpc/zapgrpc.go:174	[core] [Server #1] Server created	{"grpc_log": true}
2022-11-24T05:28:40.414Z	info	otlpreceiver/otlp.go:70	Starting GRPC server on endpoint 0.0.0.0:4317	{"kind": "receiver", "name": "otlp", "pipeline": "traces"}
2022-11-24T05:28:40.414Z	info	pipelines/pipelines.go:106	Receiver started.	{"kind": "receiver", "name": "otlp", "pipeline": "traces"}
2022-11-24T05:28:40.414Z	info	service/service.go:129	Everything is ready. Begin running and processing data.
2022-11-24T05:28:40.414Z	info	zapgrpc/zapgrpc.go:174	[core] [Server #1 ListenSocket #2] ListenSocket created	{"grpc_log": true}
2022-11-24T05:28:41.413Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:28:42.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:28:43.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:28:44.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:28:45.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:28:46.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:28:47.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:28:48.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:28:49.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:28:50.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:28:51.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:28:52.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:28:53.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:28:54.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:28:55.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:28:56.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:28:57.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:28:58.413Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:28:59.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:29:00.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:29:01.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:29:02.413Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:29:03.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:29:04.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:29:05.413Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:29:06.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:29:07.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:29:08.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:29:09.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:29:10.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:29:11.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:29:12.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:29:13.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:29:14.413Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:29:15.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:29:16.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:29:17.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:29:18.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:29:19.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:29:20.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:29:21.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:29:22.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:29:23.413Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:29:24.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:29:25.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:29:26.413Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:29:27.413Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 6}
2022-11-24T05:29:28.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 7}
2022-11-24T05:29:29.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 7}
2022-11-24T05:29:30.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 7}
2022-11-24T05:29:31.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 7}
2022-11-24T05:29:32.413Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 7}
2022-11-24T05:29:33.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 7}
2022-11-24T05:29:34.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 7}
2022-11-24T05:29:35.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 7}
2022-11-24T05:29:36.413Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 7}
2022-11-24T05:29:37.414Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"k
rePost-User-2903888
answered a year ago
0

I can't find any tracing data traffic from the attached otel collector logs. Could you try to reproduce the problem by generating the same tracing traffic?

I see the logging debug mode is enabled, please make sure also enable the logging exporter as well while reproducing the issue. Thanks

exporters:
  logging:
    loglevel: debug
AWS
XRay-Dev-xiami
answered a year ago
0

Hi, The traces were missing in the previous logs maybe because it was automatically trimmed based on character limit. Please find the complete logs below:

2022-11-28T09:43:58.908Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 7}
2022-11-28T09:43:59.908Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 7}
2022-11-28T09:44:00.908Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 7}
2022-11-28T09:44:01.908Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 7}
2022-11-28T09:44:02.907Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 7}
2022-11-28T09:44:03.907Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 7}
2022-11-28T09:44:04.908Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 7}
2022-11-28T09:44:05.908Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 7}
2022-11-28T09:44:06.908Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 7}
2022-11-28T09:44:07.907Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 7}
2022-11-28T09:44:08.908Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 7}
2022-11-28T09:44:09.908Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 7}
2022-11-28T09:44:10.908Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 7}
2022-11-28T09:44:11.907Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 7}
2022-11-28T09:44:14.908Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 8}
2022-11-28T09:44:15.908Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 8}
2022-11-28T09:44:16.907Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 8}
2022-11-28T09:44:17.908Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 8}
2022-11-28T09:44:18.908Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 8}
2022-11-28T09:44:19.907Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 8}
2022-11-28T09:44:20.908Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 8}
2022-11-28T09:44:21.908Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 8}
2022-11-28T09:44:22.907Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 8}
2022-11-28T09:44:23.907Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 8}
2022-11-28T09:44:24.908Z	debug	memorylimiterprocessor/memorylimiter.go:279	Currently used memory.	{"kind": "processor", "name": "memory_limiter", "pipeline": "traces", "cur_mem_mib": 8}
2022-11-28T09:44:25.813Z	info	TracesExporter	{"kind": "exporter", "data_type": "traces", "name": "logging", "#spans": 6}
2022-11-28T09:44:25.823Z	info	ResourceSpans #0
Resource SchemaURL: 
Resource attributes:
     -> cluster-id: STRING(cluster11)
     -> service.name: STRING(Subscription Service)
     -> service.version: STRING(1.0)
     -> service.instance.id: STRING(4829d291-5be3-4753-812e-469b6fb90d1a)
ScopeSpans #0
ScopeSpans SchemaURL: 
InstrumentationScope OpenTelemetry.Instrumentation.AspNetCore 1.0.0.0
Span #0
    Trace ID       : 638482cfc9c3dc2ece8e7ff7339d37f1
    Parent ID      : 
    ID             : 978af278aedfa0d5
    Name           : /_framework/aspnetcore-browser-refresh.js
    Kind           : SPAN_KIND_SERVER
    Start time     : 2022-11-28 09:43:43.7498405 +0000 UTC
    End time       : 2022-11-28 09:43:43.7556469 +0000 UTC
    Status code    : STATUS_CODE_UNSET
    Status message : 
Attributes:
     -> http.host: STRING(localhost:5448)
     -> http.method: STRING(GET)
     -> http.target: STRING(/_framework/aspnetcore-browser-refresh.js)
     -> http.url: STRING(http://localhost:5448/_framework/aspnetcore-browser-refresh.js)
     -> http.user_agent: STRING(Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36 Edg/107.0.1418.42)
     -> tenant-id: STRING()
     -> http.status_code: INT(200)
Span #1
    Trace ID       : 638482cfc1222fc76913d31fc0fe3c50
    Parent ID      : 
    ID             : 7c0105201a8d1cdf
    Name           : /swagger/index.html
    Kind           : SPAN_KIND_SERVER
    Start time     : 2022-11-28 09:43:43.2103974 +0000 UTC
    End time       : 2022-11-28 09:43:43.7593815 +0000 UTC
    Status code    : STATUS_CODE_UNSET
    Status message : 
Attributes:
     -> http.host: STRING(localhost:5448)
     -> http.method: STRING(GET)
     -> http.target: STRING(/swagger/index.html)
     -> http.url: STRING(http://localhost:5448/swagger/index.html)
     -> http.user_agent: STRING(Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36 Edg/107.0.1418.42)
     -> tenant-id: STRING()
     -> http.status_code: INT(200)
Span #2
    Trace ID       : 638482cf151913f8124618cb547fdead
    Parent ID      : 
    ID             : 132bb66ba83a7a33
    Name           : /_vs/browserLink
    Kind           : SPAN_KIND_SERVER
    Start time     : 2022-11-28 09:43:43.8112161 +0000 UTC
    End time       : 2022-11-28 09:43:43.8519618 +0000 UTC
    Status code    : STATUS_CODE_UNSET
    Status message : 
Attributes:
     -> http.host: STRING(localhost:5448)
     -> http.method: STRING(GET)
     -> http.target: STRING(/_vs/browserLink)
     -> http.url: STRING(http://localhost:5448/_vs/browserLink)
     -> http.user_agent: STRING(Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36 Edg/107.0.1418.42)
     -> tenant-id: STRING()
     -> http.status_code: INT(200)
Span #3
    Trace ID       : 638482d0ea03b13249f5b69bd0145813
    Parent ID      : 
    ID             : 56455d7ab1f3c596
    Name           : /swagger/v1/swagger.json
    Kind           : SPAN_KIND_SERVER
    Start time     : 2022-11-28 09:43:44.0201279 +0000 UTC
    End time       : 2022-11-28 09:43:44.2749485 +0000 UTC
    Status code    : STATUS_CODE_UNSET
    Status message : 
Attributes:
     -> http.host: STRING(localhost:5448)
     -> http.method: STRING(GET)
     -> http.target: STRING(/swagger/v1/swagger.json)
     -> http.url: STRING(http://localhost:5448/swagger/v1/swagger.json)
     -> http.user_agent: STRING(Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36 Edg/107.0.1418.42)
     -> tenant-id: STRING()
     -> http.status_code: INT(200)
ResourceSpans #1
Resource SchemaURL: 
Resource attributes:
     -> cluster-id: STRING(cluster11)
     -> service.name: STRING(Subscription Service)
     -> service.version: STRING(1.0)
     -> service.instance.id: STRING(4829d291-5be3-4753-812e-469b6fb90d1a)
ScopeSpans #0
ScopeSpans SchemaURL: 
InstrumentationScope OpenTelemetry.Instrumentation.AspNetCore 1.0.0.0
Span #0
    Trace ID       : 638482e72ca5904381f365069a544279
    Parent ID      : 
    ID             : c4de9b9883e011f5
    Name           : api/subscription/fhir
    Kind           : SPAN_KIND_SERVER
    Start time     : 2022-11-28 09:44:07.9094061 +0000 UTC
    End time       : 2022-11-28 09:44:10.4817234 +0000 UTC
    Status code    : STATUS_CODE_UNSET
    Status message : 
Attributes:
     -> http.host: STRING(localhost:5448)
     -> http.method: STRING(GET)
     -> http.target: STRING(/api/subscription/fhir)
     -> http.url: STRING(http://localhost:5448/api/subscription/fhir?callbackOption=MessageQueue)
     -> http.user_agent: STRING(Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36 Edg/107.0.1418.42)
     -> tenant-id: STRING()
     -> http.route: STRING(api/subscription/fhir)
     -> http.status_code: INT(200)
ScopeSpans #1
ScopeSpans SchemaURL: 
InstrumentationScope OpenTelemetry.StackExchange.Redis 1.0.0.5
Span #0
    Trace ID       : 638482e72ca5904381f365069a544279
    Parent ID      : c4de9b9883e011f5
    ID             : cf3b96fc20af7a3e
    Name           : Redis Trace
    Kind           : SPAN_KIND_CLIENT
    Start time     : 2022-11-28 09:44:10.4446537 +0000 UTC
    End time       : 2022-11-28 09:44:10.4547204 +0000 UTC
    Status code    : STATUS_CODE_UNSET
    Status message : 
Attributes:
     -> db.system: STRING(redis)
     -> db.redis.flags: STRING(None)
     -> db.statement: STRING(GET)
     -> net.peer.ip: STRING(127.0.0.1)
     -> net.peer.port: INT(6379)
     -> db.redis.database_index: INT(0)
     -> peer.service: STRING(127.0.0.1:6379)
Events:
SpanEvent #0
     -> Name: Enqueued
     -> Timestamp: 2022-11-28 09:44:10.4532496 +0000 UTC
     -> DroppedAttributesCount: 0
SpanEvent #1
     -> Name: Sent
     -> Timestamp: 2022-11-28 09:44:10.4532713 +0000 UTC
     -> DroppedAttributesCount: 0
SpanEvent #2
     -> Name: ResponseReceived
     -> Timestamp: 2022-11-28 09:44:10.4544331 +0000 UTC
     -> DroppedAttributesCount: 0
	{"kind": "exporter", "data_type": "traces", "name": "logging"}
2022-11-28T09:44:25.823Z	debug	awsxrayexporter@v0.61.0/awsxray.go:56	TracesExporter	{"kind": "exporter", "data_type": "traces", "name": "awsxray", "type": "awsxray", "name": "awsxray", "#spans": 6}
2022-11-28T09:44:25.823Z	debug	awsxrayexporter@v0.61.0/awsxray.go:68	request: {
  TraceSegmentDocuments: [
    "{\"name\":\"Subscription Service\",\"id\":\"978af278aedfa0d5\",\"start_time\":1669628623.7498405,\"service\":{\"version\":\"1.0\"},\"trace_id\":\"1-638482cf-c9c3dc2ece8e7ff7339d37f1\",\"end_time\":1669628623.755647,\"http\":{\"request\":{\"method\":\"GET\",\"url\":\"http://localhost:5448/_framework/aspnetcore-browser-refresh.js\",\"user_agent\":\"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36 Edg/107.0.1418.42\"},\"response\":{\"status\":200,\"content_length\":0}},\"fault\":false,\"error\":false,\"throttle\":false,\"aws\":{\"xray\":{\"auto_instrumentation\":false}},\"metadata\":{\"default\":{\"otel.resource.cluster-id\":\"cluster11\",\"otel.resource.service.instance.id\":\"4829d291-5be3-4753-812e-469b6fb90d1a\",\"otel.resource.service.name\":\"Subscription Service\",\"otel.resource.service.version\":\"1.0\",\"tenant-id\":\"\"}}}\n",
    "{\"name\":\"Subscription Service\",\"id\":\"7c0105201a8d1cdf\",\"start_time\":1669628623.2103975,\"service\":{\"version\":\"1.0\"},\"trace_id\":\"1-638482cf-c1222fc76913d31fc0fe3c50\",\"end_time\":1669628623.7593815,\"http\":{\"request\":{\"method\":\"GET\",\"url\":\"http://localhost:5448/swagger/index.html\",\"user_agent\":\"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36 Edg/107.0.1418.42\"},\"response\":{\"status\":200,\"content_length\":0}},\"fault\":false,\"error\":false,\"throttle\":false,\"aws\":{\"xray\":{\"auto_instrumentation\":false}},\"metadata\":{\"default\":{\"otel.resource.cluster-id\":\"cluster11\",\"otel.resource.service.instance.id\":\"4829d291-5be3-4753-812e-469b6fb90d1a\",\"otel.resource.service.name\":\"Subscription Service\",\"otel.resource.service.version\":\"1.0\",\"tenant-id\":\"\"}}}\n",
    "{\"name\":\"Subscription Service\",\"id\":\"132bb66ba83a7a33\",\"start_time\":1669628623.811216,\"service\":{\"version\":\"1.0\"},\"trace_id\":\"1-638482cf-151913f8124618cb547fdead\",\"end_time\":1669628623.8519619,\"http\":{\"request\":{\"method\":\"GET\",\"url\":\"http://localhost:5448/_vs/browserLink\",\"user_agent\":\"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36 Edg/107.0.1418.42\"},\"response\":{\"status\":200,\"content_length\":0}},\"fault\":false,\"error\":false,\"throttle\":false,\"aws\":{\"xray\":{\"auto_instrumentation\":false}},\"metadata\":{\"default\":{\"otel.resource.cluster-id\":\"cluster11\",\"otel.resource.service.instance.id\":\"4829d291-5be3-4753-812e-469b6fb90d1a\",\"otel.resource.service.name\":\"Subscription Service\",\"otel.resource.service.version\":\"1.0\",\"tenant-id\":\"\"}}}\n",
    "{\"name\":\"Subscription Service\",\"id\":\"56455d7ab1f3c596\",\"start_time\":1669628624.020128,\"service\":{\"version\":\"1.0\"},\"trace_id\":\"1-638482d0-ea03b13249f5b69bd0145813\",\"end_time\":1669628624.2749486,\"http\":{\"request\":{\"method\":\"GET\",\"url\":\"http://localhost:5448/swagger/v1/swagger.json\",\"user_agent\":\"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36 Edg/107.0.1418.42\"},\"response\":{\"status\":200,\"content_length\":0}},\"fault\":false,\"error\":false,\"throttle\":false,\"aws\"
rePost-User-2903888
answered a year ago
0

From the logs, we can see the Redis Span has an attribute peer.service: STRING(127.0.0.1:6379) and X-Ray exporter take it as the highest priority as the remote service name by overriding the Span name Redis Trace. Here is the related code. I'll follow up with my team if we should take the Span name as the higher priority instead of peer.service attributes.

ScopeSpans SchemaURL: 
InstrumentationScope OpenTelemetry.StackExchange.Redis 1.0.0.5
Span #0
    Trace ID       : 638482e72ca5904381f365069a544279
    Parent ID      : c4de9b9883e011f5
    ID             : cf3b96fc20af7a3e
    Name           : Redis Trace
    Kind           : SPAN_KIND_CLIENT
    Start time     : 2022-11-28 09:44:10.4446537 +0000 UTC
    End time       : 2022-11-28 09:44:10.4547204 +0000 UTC
    Status code    : STATUS_CODE_UNSET
    Status message : 
Attributes:
     -> db.system: STRING(redis)
     -> db.redis.flags: STRING(None)
     -> db.statement: STRING(GET)
     -> net.peer.ip: STRING(127.0.0.1)
     -> net.peer.port: INT(6379)
     -> db.redis.database_index: INT(0)
     -> peer.service: STRING(127.0.0.1:6379)
AWS
XRay-Dev-xiami
answered a year ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content