when you create splunk app especially to distributed environment, quite often you must divide it to app part (dashboards, alerts, reports etc.) and to TA for collecting/ ingesting data in. You should tell on your installation instructions that both have needed and how and where to install those.
You cannot pack those to one package. Instead of create one for App and second for TA. This is the way if you are storing those to splunkbase. Of course if you are delivering those by some other method, you coul combine those e.g. to one tar package.