I don't think any python file which is modified through backend will replicate. In such changes, you should go with the deployer. Deployer will take care of that.
The changes that the cluster replicates
These are the main types of configuration changes that the cluster replicates:
Runtime changes or additions to knowledge objects, such as saved searches, lookup tables, and dashboards. For example, when a user in Splunk Web defines a field extraction, the cluster replicates that field extraction to all search heads in the cluster.
Runtime changes to users and roles. See Add users to the search head cluster.
Please check the below document for more information about replication.