each panel is a search, the searches are executed / dispatched when opening the dash and pending cpu availability as well as results, visualizations etc.
even if dispatched at the exact same moment, some searches will take longer then others. not all searches / panels are equal.
to avoid this, you can save panels reports, or add saved reports as panels.
another option is to schedule reports and then use | loadjob command for example