Dashboards & Visualizations

We are using AWS cluster need to monitor it's job waiting time.

ahujahitu
New Member

we have aws EMR cluster where we need to check for job waiting time with respect to time, we need to create chart x-axis as time and y-axis as job waiting time.

raw data is like this.

{"tsu":16381197,"app":"log.prod","hst":"ip-100-**-***-***.us","lvl":"INFO","ctr":"spark-***","kns":"prod","cid":"******","pod":"data-driver","env":"prod","cna":"prod-1","msg":"21/11/28 17:15:50 INFO GenerationExecutor$: sent metrics: data.job_waiting_time: 124"}

 

need data.job_waiting_time: 124 in y-axis and x-axis need time or I think we can use log time also 21/11/28 17:15:50.

Labels (3)
0 Karma
Did you miss .conf21 Virtual?

Good news! The event's keynotes and many of its breakout sessions are now available online, and still totally FREE!