topic Re: v9.1 upgrade issues - Top tool bar shows Loading.... in Splunk Enterprise

v9.1 upgrade issues - Why does Top tool bar shows Loading?

GrantMacRae — Tue, 15 Aug 2023 19:35:07 GMT

Has anyone had this issue after upgrading to v9.1 from v 9.04, The top toolbar shows Loading.... but never loads?

The issue happened on our Search Head / Indexer & to the Deployment server.

I have also installed a full Splunk instance on to a virgin server & this has the same issue.

Edit - Ticket logged - CASE [3258488]

Re: v9.1 upgrade issues - Top tool bar shows Loading....

isoutamo — Tue, 04 Jul 2023 07:40:09 GMT

I haven't seen this, but it seems that Splunk has withdrawn 9.1.0 version and currently the newest one is 9.0.5. 9.1.0 seems to have some other issues too and I think that there is no reason to upgrade it before it (or 9.1.0.1) will be available.

r. Ismo

Re: v9.1 upgrade issues - Top tool bar shows Loading....

isoutamo — Fri, 07 Jul 2023 08:12:05 GMT

9.1.0.1 has just released. Maybe it fix this? At least I didn't get anymore file integrity check warnings.

Re: v9.1 upgrade issues - Top tool bar shows Loading....

GrantMacRae — Fri, 07 Jul 2023 08:18:25 GMT

I've just upgraded the Virgin installation from 9.1 to 9.1.0.1, Like you the integrity checks have gone, but I still have the toolbar issue.

I'm going to remove everything, reboot & try a fresh install of 9.1.0.1 to see what happens.

Re: v9.1 upgrade issues - Top tool bar shows Loading....

isoutamo — Fri, 07 Jul 2023 08:20:37 GMT

You also need to check that all files are owned by your splunk OS user. Time by time there are situations when there are some files owned by root and this can cause issues.

Re: v9.1 upgrade issues - Top tool bar shows Loading....

GrantMacRae — Fri, 07 Jul 2023 08:25:38 GMT

The fresh install of 9.1.0.1 worked perfectly, I rekon that there must be other issues with this update.

I'm going to roll back the search head / indexer & deployment server back to 9.0.4 & upgrade from there.

Glad I always keep full backups prior tho changing anything!

Re: v9.1 upgrade issues - Top tool bar shows Loading....

GrantMacRae — Fri, 07 Jul 2023 08:27:04 GMT

Good point - I've been caught out with that in the past, all files & the Splunkd service are owned by my Splunk OS user.

Re: v9.1 upgrade issues - Top tool bar shows Loading....

isoutamo — Fri, 07 Jul 2023 08:34:33 GMT

Good to have backups 😉

IMHO: If I was in your place, I will go to 9.0.5 and wait couple of weeks before go to 9.1.0.1 if possible 😉 Or even wait until 9.1.1 or 9.1.2. are published and tested by users.

Re: v9.1 upgrade issues - Top tool bar shows Loading....

dhatch — Tue, 25 Jul 2023 17:06:48 GMT

Any news on your case? I am seeing the same thing on my 9.1.0.1 deployments.

Re: v9.1 upgrade issues - Top tool bar shows Loading....

GrantMacRae — Wed, 26 Jul 2023 06:56:38 GMT

I eventually reverted back to 9.0.4, Running fine atm with no issues. I found that the 9.1.0.1 upgrade on top of the 9.1.0.0 didn't fix the issue. For me, I had the toolbar issue, the file integrity checks & the weirdest issue of all was that my indexing rate went through the roof. Increasing 5 fold.

Will wait till the stable version of 9.2 comes out.

Re: v9.1 upgrade issues - Top tool bar shows Loading....

akyz — Thu, 27 Jul 2023 18:57:52 GMT

I'm getting the same thing. Checked permissions, ownership, and issue still stands. Working on downgrading to 9.0.5 now. I have a case open as well 3276705/

Re: v9.1 upgrade issues - Top tool bar shows Loading....

zkrieger — Tue, 15 Aug 2023 16:21:01 GMT

Not sure why Splunk hasnt posted yet. This is with the development team now and being researched. No solution yet. If you have the issue, open a ticket so they can track it and notify you when a fix is available.

Re: v9.1 upgrade issues - Top tool bar shows Loading....

dhatch — Tue, 15 Aug 2023 17:58:47 GMT

Still happening on 9.1.0.2. I finally got around to opening a case on it.

Re: v9.1 upgrade issues - Why does Top tool bar shows Loading?

dglass0215 — Wed, 30 Aug 2023 18:59:04 GMT

I see they just released 9.1.1 today. Wondering if anyone can confirm if this issue is fixed in 9.1.1? Additionally if anyone who opened a case could respond, I'd like to hear what support is suggesting as I am currently experiencing this on some important screens.

Thanks,

David

Re: v9.1 upgrade issues - Why does Top tool bar shows Loading?

dhatch — Wed, 30 Aug 2023 19:23:31 GMT

I have a case open on it. But all they are doing is suggesting clearing client caches and refreshing the server by issuing the: http://<host>:<mport>/debug/refresh

None of that works at all. I've tried different clients, different browsers, incognito mode, etc. Nothing attempted makes any difference.

I really hope that someone figured it out and fixed it in the 9.1.1 code.

Re: v9.1 upgrade issues - Why does Top tool bar shows Loading?

zkrieger — Wed, 30 Aug 2023 19:25:44 GMT

the ticket i had open was closed. you can generally work around the issue, if you can get the proper URL you need to do what you want to do and enter it directly.

the issue is known and being repaired, but there is no notice of a resolution yet.

Re: v9.1 upgrade issues - Why does Top tool bar shows Loading?

GerryUmbach — Tue, 19 Sep 2023 17:54:52 GMT

We just upgraded today to v9.1.1 and are experiencing this "Loading" issue as well.

It's too bad that I didn't see this post, we would have delayed our upgrade in favour of another version.

Has anyone received guidance on the fix for this, or is everyone reverting back to a previous version?

Re: v9.1 upgrade issues - Why does Top tool bar shows Loading?

akyz — Tue, 19 Sep 2023 18:18:12 GMT

Only guidance I received was to downgrade however since Splunk doesn't support "downgrades" they provide no guidance. I ended up uninstalling and reinstalling 9.1, confirmed the issue was resolved after a clean install. Then proceeded to restore items/apps/config files 1 by 1.

Re: v9.1 upgrade issues - Why does Top tool bar shows Loading?

dhatch — Tue, 19 Sep 2023 18:46:16 GMT

Working with TAC, we figured out a solution for the Loading... issue.

There is an issue with the browser properly displaying the toolbar, this is mitigated by adjusting the web.conf file

There are a couple of places where I had to edit the file.

$Splunk_Home\etc\system\default\web.conf

$Splunk_Home\etc\system\local\web.conf

$Splunk_Home\var\run\splunk\merged\web.conf

You want to find the "minify_js" and set it to false.

minify_js = false

By default, it will be set to "true"

Restart the Splunk service, flush your browser cache and you should be good to go!

(if it does not work, there might be another web.conf file with the minify_js still set to true. Search through and adjust as needed)

Re: v9.1 upgrade issues - Why does Top tool bar shows Loading?

GerryUmbach — Wed, 20 Sep 2023 14:48:25 GMT

Thanks a bunch dhatch, we're back in business!