The order of views / dashboards is based on the file name on disk.
The file name won't affect the name shown in the nav menu - that is set within the file by your label.
Numerically prefixing each dashboard / view name is the simplest case, and is easy to make a naming convention for using in sub-menus etc also. Eg for a flat life "01_hits_over_time.xml" "02_less_important_hist.xml". For sub-menus something like "apache-01-hits.xml", "apache-02-errors.xml" "os-01-syslog.xml" "os-02-secure.xml" ...
You can't easily rename views/dashboards via Splunk Web [you need to clone, set new name, then delete the old]. Remember when you move, or add/modify, files via the file-system you need to fully refresh the app for the files to get re-read [click the splunk logo top right is the simplest way, or set your location bar to the base of your app eg yoursplunkserver/app/yourapp/]
It depends on how you've designed the dashboard. If you've created it via Splunk Web (the UI) then rearranging the order of the "views" (i'm assuming you mean panels) is easy: you can just turn on the Dashboard Editor by clicking Edit at the top right of the panel and dragging & dropping the panels into the positions you want them to be in. Go here for more info:
You can also use the drag and drop method if you've used simple XML to code the dashboard.
If you created the dashboard in advanced XML you'll need to go into the advanced XML and move the code for the panels around into the correct configuration of rows and columns. This is a bit trickier. You can find help here: http://docs.splunk.com/Documentation/Splunk/5.0/AdvancedDev/AdvancedDashboard#Lay_out_your_panels
Ah, that makes more sense. You've created 10 dashboards and you want to control the order in which they display in the Views menu.
What you want to do is set up the navigation XML for your views (or edit it if it already exists). The instructions are in this topic: http://docs.splunk.com/Documentation/Splunk/5.0/AdvancedDev/BuildNavigation
You can change the order in which your 10 dashboards are listed, create nested groups (categorizing your dashboards into like groups, essentially), change the title of the menu from "Dashboards & Views" to just "Dashboards" or something more descriptive, and more.
Thanks mattness for your quick reply.
I am not talking about the panels inside the dashboard. I want to sort the order which appears when we click on "Views" dropdown when you launch an app.