I haven't found a definitive answer in any of the docs yet. Is it possible to utilize Splunk Smartstore when everything is in Splunk Cloud and we do not have an on-prem Enterprise?
Not only is it possible, it's mandatory. You don't have to worry about it, though, because Splunk manages it for you.
