Thanks for the code. It seems to work with that manually. I need to report Cisco that the zero-code instrumentation is not working as expected. I don't have privileges to open a case for that. ... View more

Can you share your instrumented code? ... View more

Hi bishida, Any other sugestion? ... View more

Changed everything as mentioned before, but no data collected into O11y Cloud. ... View more

The env variable OTEL_EXPORTER_OTLP_TRACES_HEADERS has not been created. Regarding the OTEL_OTLP_EXPORTER_ENDPOINT it was set tot http://localhost:4317. Now I chnaged to 4318. Regarding SPLUNK_ACCESS_TOKEN, I have not changed this value to the new one. Changed now. I will restart the application and generates traffic again. Let you know. ... View more

In metrics finder we can't see anything about the service.name. As far as I know my PHP is using zero code instrumentation. I have generated a lot of traffic and nothing. I performed a purchase, items in a cart and etc. Nothing of these spans are being reflected into O11y Cloud. I don't about splunk HEC. I'm just starting using Splunk O11y. I need to study more about the http event collector.     ... View more

This is /var/log/syslog. It's a loop this log. Always the same Dec 14 10:19:27 PCWIN11-LPOLLI otelcol[211214]: #011go.opentelemetry.io/collector/processor/batchprocessor@v0.113.0/batch_processor.go:535 Dec 14 10:19:27 PCWIN11-LPOLLI otelcol[211214]: go.opentelemetry.io/collector/processor/batchprocessor.(*shard[...]).sendItems Dec 14 10:19:27 PCWIN11-LPOLLI otelcol[211214]: #011go.opentelemetry.io/collector/processor/batchprocessor@v0.113.0/batch_processor.go:261 Dec 14 10:19:27 PCWIN11-LPOLLI otelcol[211214]: go.opentelemetry.io/collector/processor/batchprocessor.(*shard[...]).startLoop Dec 14 10:19:27 PCWIN11-LPOLLI otelcol[211214]: #011go.opentelemetry.io/collector/processor/batchprocessor@v0.113.0/batch_processor.go:221 Dec 14 10:19:27 PCWIN11-LPOLLI otelcol[211214]: 2024-12-14T10:19:27.551+0100#011warn#011batchprocessor@v0.113.0/batch_processor.go:263#011Sender failed#011{"kind": "processor", "name": "batch", "pipeline": "logs", "error": "sending queue is full"} Dec 14 10:19:28 PCWIN11-LPOLLI otelcol[211214]: 2024-12-14T10:19:28.109+0100#011info#011internal/retry_sender.go:126#011Exporting failed. Will retry the request after interval.#011{"kind": "exporter", "data_type": "logs", "name": "splunk_hec", "error": "HTTP 404 \"Not Found\"", "interval": "44.55953462s"} Dec 14 10:19:28 PCWIN11-LPOLLI otelcol[211214]: 2024-12-14T10:19:28.555+0100#011error#011internal/base_exporter.go:130#011Exporting failed. Rejecting data.#011{"kind": "exporter", "data_type": "logs", "name": "splunk_hec", "error": "sending queue is full", "rejected_items": 77} Dec 14 10:19:28 PCWIN11-LPOLLI otelcol[211214]: go.opentelemetry.io/collector/exporter/exporterhelper/internal.(*BaseExporter).Send Dec 14 10:19:28 PCWIN11-LPOLLI otelcol[211214]: #011go.opentelemetry.io/collector/exporter@v0.113.0/exporterhelper/internal/base_exporter.go:130 Dec 14 10:19:28 PCWIN11-LPOLLI otelcol[211214]: go.opentelemetry.io/collector/exporter/exporterhelper.NewLogsRequest.func1 Dec 14 10:19:28 PCWIN11-LPOLLI otelcol[211214]: #011go.opentelemetry.io/collector/exporter@v0.113.0/exporterhelper/logs.go:138 Dec 14 10:19:28 PCWIN11-LPOLLI otelcol[211214]: go.opentelemetry.io/collector/consumer.ConsumeLogsFunc.ConsumeLogs Dec 14 10:19:28 PCWIN11-LPOLLI otelcol[211214]: #011go.opentelemetry.io/collector/consumer@v0.113.0/logs.go:26 Dec 14 10:19:28 PCWIN11-LPOLLI otelcol[211214]: github.com/open-telemetry/opentelemetry-collector-contrib/exporter/splunkhecexporter.(*perScopeBatcher).ConsumeLogs Dec 14 10:19:28 PCWIN11-LPOLLI otelcol[211214]: #011github.com/open-telemetry/opentelemetry-collector-contrib/exporter/splunkhecexporter@v0.113.0/batchperscope.go:50 Dec 14 10:19:28 PCWIN11-LPOLLI otelcol[211214]: github.com/open-telemetry/opentelemetry-collector-contrib/pkg/batchperresourceattr.(*batchLogs).ConsumeLogs Dec 14 10:19:28 PCWIN11-LPOLLI otelcol[211214]: #011github.com/open-telemetry/opentelemetry-collector-contrib/pkg/batchperresourceattr@v0.113.0/batchperresourceattr.go:172 Dec 14 10:19:28 PCWIN11-LPOLLI otelcol[211214]: go.opentelemetry.io/collector/internal/fanoutconsumer.(*logsConsumer).ConsumeLogs Dec 14 10:19:28 PCWIN11-LPOLLI otelcol[211214]: #011go.opentelemetry.io/collector/internal/fanoutconsumer@v0.113.0/logs.go:73 Dec 14 10:19:28 PCWIN11-LPOLLI otelcol[211214]: go.opentelemetry.io/collector/processor/processorhelper.NewLogs.func1 Dec 14 10:19:28 PCWIN11-LPOLLI otelcol[211214]: #011go.opentelemetry.io/collector/processor@v0.113.0/processorhelper/logs.go:66 Dec 14 10:19:28 PCWIN11-LPOLLI otelcol[211214]: go.opentelemetry.io/collector/consumer.ConsumeLogsFunc.ConsumeLogs Dec 14 10:19:28 PCWIN11-LPOLLI otelcol[211214]: #011go.opentelemetry.io/collector/consumer@v0.113.0/logs.go:26 Dec 14 10:19:28 PCWIN11-LPOLLI otelcol[211214]: go.opentelemetry.io/collector/processor/batchprocessor.(*batchLogs).export Dec 14 10:19:28 PCWIN11-LPOLLI otelcol[211214]: #011go.opentelemetry.io/collector/processor/batchprocessor@v0.113.0/batch_processor.go:535 Dec 14 10:19:28 PCWIN11-LPOLLI otelcol[211214]: go.opentelemetry.io/collector/processor/batchprocessor.(*shard[...]).sendItems Dec 14 10:19:28 PCWIN11-LPOLLI otelcol[211214]: #011go.opentelemetry.io/collector/processor/batchprocessor@v0.113.0/batch_processor.go:261 Dec 14 10:19:28 PCWIN11-LPOLLI otelcol[211214]: go.opentelemetry.io/collector/processor/batchprocessor.(*shard[...]).startLoop Dec 14 10:19:28 PCWIN11-LPOLLI otelcol[211214]: #011go.opentelemetry.io/collector/processor/batchprocessor@v0.113.0/batch_processor.go:221 Dec 14 10:19:28 PCWIN11-LPOLLI otelcol[211214]: 2024-12-14T10:19:28.555+0100#011warn#011batchprocessor@v0.113.0/batch_processor.go:263#011Sender failed#011{"kind": "processor", "name": "batch", "pipeline": "logs", "error": "sending queue is full"} Dec 14 10:19:35 PCWIN11-LPOLLI systemd-resolved[121]: Clock change detected. Flushing caches.   This is /var/log/dmesg. Not so helpful. [ 0.537467] kernel: Adding 4194304k swap on /dev/sdb. Priority:-2 extents:1 across:4194304k [ 1.252079] kernel: clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x25a399d04c4, max_idle_ns: 440795206293 ns [ 1.256080] kernel: clocksource: Switched to clocksource tsc [ 2.039875] kernel: IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready [ 2.700859] kernel: hv_pci 1da5db4a-ecd2-4832-aa94-05f9e3555f64: PCI VMBus probing: Using version 0x10004 [ 2.703245] kernel: hv_pci 1da5db4a-ecd2-4832-aa94-05f9e3555f64: PCI host bridge to bus ecd2:00 [ 2.703785] kernel: pci_bus ecd2:00: root bus resource [mem 0xc00000000-0xe00001fff window] [ 2.704246] kernel: pci_bus ecd2:00: No busn resource found for root bus, will use [bus 00-ff] [ 2.705198] kernel: pci ecd2:00:00.0: [1af4:105a] type 00 class 0x088000 [ 2.707331] kernel: pci ecd2:00:00.0: reg 0x10: [mem 0xe00000000-0xe00000fff 64bit] [ 2.709397] kernel: pci ecd2:00:00.0: reg 0x18: [mem 0xe00001000-0xe00001fff 64bit] [ 2.711072] kernel: pci ecd2:00:00.0: reg 0x20: [mem 0xc00000000-0xdffffffff 64bit] [ 2.714335] kernel: pci_bus ecd2:00: busn_res: [bus 00-ff] end is updated to 00 [ 2.714818] kernel: pci ecd2:00:00.0: BAR 4: assigned [mem 0xc00000000-0xdffffffff 64bit] [ 2.716490] kernel: pci ecd2:00:00.0: BAR 0: assigned [mem 0xe00000000-0xe00000fff 64bit] [ 2.718167] kernel: pci ecd2:00:00.0: BAR 2: assigned [mem 0xe00001000-0xe00001fff 64bit] [ 2.727428] kernel: virtiofs virtio1: Cache len: 0x200000000 @ 0xc00000000 [ 2.789025] kernel: memmap_init_zone_device initialised 2097152 pages in 20ms [ 2.800876] kernel: FS-Cache: Duplicate cookie detected [ 2.803571] kernel: FS-Cache: O-cookie c=00000005 [p=00000002 fl=222 nc=0 na=1] [ 2.804522] kernel: FS-Cache: O-cookie d=000000003e7c27de{9P.session} n=0000000049c81f03 [ 2.805210] kernel: FS-Cache: O-key=[10] '34323934393337353730' [ 2.806200] kernel: FS-Cache: N-cookie c=00000006 [p=00000002 fl=2 nc=0 na=1] [ 2.806933] kernel: FS-Cache: N-cookie d=000000003e7c27de{9P.session} n=00000000ccf62711 [ 2.807563] kernel: FS-Cache: N-key=[10] '34323934393337353730' [ 3.062342] kernel: scsi 0:0:0:2: Direct-Access Msft Virtual Disk 1.0 PQ: 0 ANSI: 5 [ 3.115930] kernel: sd 0:0:0:2: Attached scsi generic sg2 type 0 [ 3.216153] kernel: sd 0:0:0:2: [sdc] 2147483648 512-byte logical blocks: (1.10 TB/1.00 TiB) [ 3.260507] kernel: sd 0:0:0:2: [sdc] 4096-byte physical blocks [ 3.265571] kernel: sd 0:0:0:2: [sdc] Write Protect is off [ 3.273898] kernel: sd 0:0:0:2: [sdc] Mode Sense: 0f 00 00 00 [ 3.275831] kernel: sd 0:0:0:2: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 3.284253] kernel: sd 0:0:0:2: [sdc] Attached SCSI disk [ 3.297655] kernel: EXT4-fs (sdc): mounted filesystem with ordered data mode. Opts: discard,errors=remount-ro,data=ordered. Quota mode: none.[ 3.862735] kernel: misc dxg: dxgk: dxgkio_is_feature_enabled: Ioctl failed: -22 [ 3.874190] kernel: misc dxg: dxgk: dxgkio_query_adapter_info: Ioctl failed: -22 [ 3.877247] kernel: misc dxg: dxgk: dxgkio_query_adapter_info: Ioctl failed: -22 [ 3.879783] kernel: misc dxg: dxgk: dxgkio_query_adapter_info: Ioctl failed: -22 [ 3.881239] kernel: misc dxg: dxgk: dxgkio_query_adapter_info: Ioctl failed: -2 [ 4.763755] unknown: WSL (2) ERROR: WaitForBootProcess:3352: /sbin/init failed to start within 10000 [ 4.763760] unknown: ms [ 4.781653] unknown: WSL (2): Creating login session for luizpolli If you need something. Let me know. ... View more

The logs that I found are /var/log/apache2/access.log and error.log. I don't know how to attach all logs here. ... View more

Nothing.   ... View more

Done. Follow the outputs. luizpolli@PCWIN11-LPOLLI:~$ cat /etc/php/8.1/apache2/php.ini|grep OTEL OTEL_RESOURCE_ATTRIBUTES="deployment.environment=prod,service.version=1.0" OTEL_EXPORTER_OTLP_ENDPOINT="http://localhost:4317" OTEL_SERVICE_NAME=shopping OTEL_PHP_AUTOLOAD_ENABLED=true luizpolli@PCWIN11-LPOLLI:~$ env|grep OTEL OTEL_RESOURCE_ATTRIBUTES=deployment.environment=prod,service.version=1.0 OTEL_EXPORTER_OTLP_ENDPOINT=http://localhost:4317 OTEL_SERVICE_NAME=shopping OTEL_PHP_AUTOLOAD_ENABLED=true luizpolli@PCWIN11-LPOLLI:~$ sudo systemctl restart apache2 luizpolli@PCWIN11-LPOLLI:~$ sudo systemctl status apache2 ● apache2.service - The Apache HTTP Server Loaded: loaded (/lib/systemd/system/apache2.service; enabled; vendor preset: enabled) Active: active (running) since Fri 2024-12-13 19:02:36 CET; 5s ago Docs: https://httpd.apache.org/docs/2.4/ Process: 211814 ExecStart=/usr/sbin/apachectl start (code=exited, status=0/SUCCESS) Main PID: 211818 (apache2) Tasks: 7 (limit: 18994) Memory: 14.7M CGroup: /system.slice/apache2.service ├─211818 /usr/sbin/apache2 -k start ├─211819 /usr/sbin/apache2 -k start ├─211820 /usr/sbin/apache2 -k start ├─211821 /usr/sbin/apache2 -k start ├─211822 /usr/sbin/apache2 -k start ├─211823 /usr/sbin/apache2 -k start └─211824 /usr/sbin/apache2 -k start Dec 13 19:02:36 PCWIN11-LPOLLI systemd[1]: Starting The Apache HTTP Server... Dec 13 19:02:36 PCWIN11-LPOLLI systemd[1]: Started The Apache HTTP Server. luizpolli@PCWIN11-LPOLLI:~$   ... View more

Hi bishida, The token has been rotated. As a matter fact i tried to setup directly, but it was configured with otel collector before with the same result on env variables. Image below. The idea is to configure locally running on an otel collector instance. As mentioned before, even locally at otel collector or directly to o11y cloud is not working. ... View more