About uptoNoGood

uptoNoGood · ‎08-27-2020

Hi We have multiple automated tests running with different IDs and jenkins build number. One testid, build can have multiple tests too. Each test goes through some stages which are not common across different tests. test1 can have stage a,b,c and test2 can have d,e,f I want to chart duration of these stages for each test over testID/build number e.g. i want to see how duration of stage A for test 1 is changing across different testiD t1, t2, t3 or build b1,b2,b3. I can chart avg duration for stages by test but not across testids/build this is how I do it for avg duration for stages by test: index=dx_campaign_utf_jenkins_console source=job/test-pipeline-perf/* test testId stage | rex field=_raw "test=(?<test_name>[^\]]*)]" | rex field=source "job/test-pipeline-perf/(?<build_number>.*)/console" | stats min(_time) as startTime max(_time) as endTime by test_name, stage, testId, build_number | eval duration = (endTime-startTime) | eval duration = if(duration == 0, 1, duration) | eval duration = duration/60 | chart avg(duration) by test_name, stage I can do it individually for each testname if I search for each and create different chart for each, is it possible to chart stages duration per test per testid using chart and trellis layout? Since test names can change, I don't want to keep my query specific

uptoNoGood · ‎08-18-2020

Hi I have a query which I use for generating a timeline visualization: is there a way to get an image for this visualization using an API. We need to attach this image to a test report we send at the end of the tests. As everything is happening in an automated env, we need to get this via an API. This visualization gets generated using Timeline visualization Splunk app (not sure if that's relevant here)

uptoNoGood · ‎07-13-2020

Thanks @niketn that worked perfectly.

uptoNoGood · ‎07-13-2020

Hi @niketn Thanks. I tried them both on my local setup and I can now create timelines. I just had one more query, do you know if its possible to do grouping of events in Timeline - Custom Visualization app. The image they have provided as an example of timeline shows event description too but the example query has no such column in final table command

uptoNoGood · ‎07-09-2020

Hi @richgalloway This was giving syntax error. Did you mean mvfilter(match(stageName, "\/apps")? I wasn't aware of multi fields, after your reply I tried on multiple multi field options and ended up using a combination of mvexpand, table and spath : index=dx_campaign_utf_jenkins_statistics host="<hostname>" event_tag=job_event type=completed job_name=orchestration-pipeline "stages{}.name"="*" | spath output=stagesmf path=stages{} | table stagesmf, build_number | mvexpand stagesmf | rename stagesmf as _raw | spath path=duration | spath path=name | spath path=start_time | table name, duration, start_time, build_number | where NOT like(name, "%.groovy") problem with working with multi fields was that any filter only removed values from one column, so i had to separate these out early to get filtering to work

uptoNoGood · ‎07-09-2020

Thanks @niketn I have asked our admin to install both apps so I can try it out. From docs, it seems like these should do the job. Thanks.

uptoNoGood · ‎07-09-2020

Hi, We have a jenkins pipeline and I am writing a query to visualize duration of various stages across different builds. When using jenkins splunk plugin, its giving some values which arent actually stage names. If I try to remove those out in search itself, it returns empty data as all stages seem to be in a single statistics raw event. If i later try to use where on it that too doesnt work. Sort also doesnt work on numerice duration values Query I am using is : index=dx_campaign_utf_jenkins_statistics host="<hostname>" event_tag=job_event type=completed job_name=orchestration-pipeline "stages{}.name"="*" | rename stages{}.duration as stageduration | rename stages{}.name as stageName | table stageName, stageduration, build_number Query returns result like : How do i remove stages like /apps, com ones ?

uptoNoGood · ‎07-09-2020

hello, We have some tests running as part of our CI/CD pipeline. These go through different stages like preparation, execution, report, cleanup etc.. I need to create a time line for these stages per test execution so that user can at any time check the timeline and find out at what stage is the test at. I have been able to chart duration for stages using : search | rex field=source "job/test-stage-test/(?<build_number>.*)/console" | stats values(start_time) as startTime values(end_time) as endTime by stage, test, build_number | eval duration = (endTime-startTime)/1000 | chart avg(duration) by test, stage So like the data above i have start time, end time for all stages for every test per build How do I create timeline for it with y axis as time and stages stacked per test per build on x-axis with bar starting at start time for test and each stage bar starting at its starting time and ending at its end time. 1____test 1 : stage1____ _______t1 :stage 2____ __t1:stage 3___ _____t2:stage1___ ___t3:stage1____ 2 ____test1:stage1___ _______t1:stage2_____ ___________________________________________time______________________________________ Is it possible to do this kind of chart, I have tried multiple timechart options but non worked.

Posts	8
Solutions	1
Karma Given	6
Karma Received	1
Member Since	‎07-05-2020

Online Status	Offline
Date Last Visited	‎08-28-2020 07:55 AM

how do I chart with 3 or more fields

Export chart as image via API

Not able to remove entries from table row

Chart timeline of Stages in a Test

how do I chart with 3 or more fields

Export chart as image via API

Re: Chart timeline of Stages in a Test

Re: Chart timeline of Stages in a Test

Re: Not able to remove entries from table row

Re: Chart timeline of Stages in a Test

Not able to remove entries from table row

Chart timeline of Stages in a Test