Distributed Tracing View

[sandyuce]

Hi All,

We have logs from IIS Servers and application service k8s pod logs which details TraceId, SpanId and parentSpanID for all incoming requests.

In detail, request traverses as below:
Browser -> IIS -> ServiceA -> ServiceB, response back to ServiceA -> IIS -> Browser.

Except at IIS, a new span would be created on every service component. Logs will also include parentSpanID as per original spanId. Hence, we would almost have below logging.

IIS : TR1 SP1
Type=request ServiceA : TR1 SP2 parentSpan=SP1
Type=request ServiceB : TR1 SP3 parentSpan=SP2
Type=response ServiceA : TR1 SP2 parentSpan=SP1
Type=response ServiceB : TR1 SP3 parentSpan=SP2

I am trying to setup a tracer view where we can see duration or failure of each span generated for a given traceId.

Any thoughts on how to accomplish it.
Are there any Splunk Apps developed for viewing distributed tracing ?

Thanks.
Saurabh