Twitter X: Simple Hashtag Saving, Export, Data Visualization, and Analysis.

[LuureAmet]

Greetings Splunk's!

My use case is quite straightforward:

We aim to save and monitor (secondarily) some rare hashtags from the Twitter platform (unsure if it's possible on Facebook and other platforms).

1. We would like hashtags related posts to be chronologically arranged from the beginning to end, viewable in HTML format, and exportable to Excel (at minimum). 

Additionally, if possible: 2. It would be ideal to see statistics on which accounts/dates used the hashtags the most.

1. Further possibilities include analyzing post comments, likes, and the followers/following of the posters—if feasible, in the future.

We've downloaded the following software for our Linux platform: https://download.splunk.com/products/splunk/releases/9.1.2/linux/splunk-9.1.2-b6b9c8185839-linux-2.6...

As our programming skills are non-existent (but we can follow instructions well), we wonder if it's possible to set up this workflow and what possibilities exist related to it all. We find it challenging to comprehend the possibilities available.

Is it simple for non-programmers to follow, or does it require a robust infrastructure or extra investment for certain use cases (perhaps payment to Twitter)?
Some user cases might be achievable through multiple other easy methods?

We'd like the workflow to be more of a "set and forget" with the ability to easily change the hashtag/search word in the future if possible. We are currently in a 14/60 day trial (unsure if it's 60 or 14 days and what is included in that) and would like to know the future cost after the free usage ends.

While our use case is culturally important. As hastags are not so big, it likely generates a small amount of results. However, we'd like to understand the potential costs if the hashtag were to trend, resulting in thousands of daily results (e.g., 5% with images). What would be the approximate cost for saving 5000+ results per day/month?
What is the limits here?

Is Splunk the right tool for this kind of work? Are there pre-made templates or samples/posts to guide this type of work? AI directed us to this software when we sought help with saving hashtags.

Please feel free to provide thorough explanations for any part of our questions and include links to samples. We are comfortable copying and pasting and editing scripts but cannot follow programming logic ourselves. Are there any requirements for the Twitter API? Such as a separate account login to avoid posing a threat to our main account (as it seems X does not allow browsing the site without logging in anymore).

If there are sample user cases related to my needs and what is possible, I would also like to see screens or videos about it

Thank you for all the help and patience.

splunk@arvutiministeerum.ee - Extra information can be sent to our email as well. 

// Is 'Knowledge Management' the correct spot for that post? Feel free to transfer it if there is a more appropriate sub-forum. //

Margus

[inventsekar]

>>>As our programming skills are non-existent (but we can follow instructions well), we wonder if it's >>>possible to set up this workflow and what possibilities exist related to it all. We find it challenging to >>>comprehend the possibilities available.

>>>Is it simple for non-programmers to follow, or does it require a robust infrastructure or extra investment >>>for certain use cases (perhaps payment to Twitter)?
>>>Some user cases might be achievable through multiple other easy methods?

1) yep, Splunk does not require programming skills at all (95% of the Splunk tasks can be done without programming).
2) Splunk is a very simple, easy to use tool.. best one for non-programmers, IT managers and Decision makers. that is why Splunk is the market leader for a decade. 
3) for twitter hashtag sentiment analysis, you dont need any extra payment or anything. for Proof of a Concept, you can use the free splunk. For production environment, you can get a Splunk License, which is also very cheap. 

>>>While our use case is culturally important. As hastags are not so big, it likely generates a small amount of >>>results. However, we'd like to understand the potential costs if the hashtag were to trend, resulting in >>>thousands of daily results (e.g., 5% with images). What would be the approximate cost for saving 5000+ >>>results per day/month? What is the limits here?

this task looks like a simple task, Splunk can handle very easily. 

>>> Is Splunk the right tool for this kind of work? Are there pre-made templates or samples/posts to guide >>> this type of work? AI directed us to this software when we sought help with saving hashtags.

Splunk is the best tool for these kind of tasks. there are hundreds of pre-made templates (dashboards). the AI's suggestion of using Splunk... you can understand how right Splunk for this task. 

>>> Are there any requirements for the Twitter API?
the twitter to Splunk integration is the bit troublesome task in this project.
There were great Splunk apps for tweets integration to Splunk(for example - https://splunkbase.splunk.com/app/1162 , but recently(around one or two years), these apps got some troubles and they are not working(i have tested this around 2 months ago).

Pls check this app - https://splunkbase.splunk.com/app/4619 

all looks good with this app.. let me test this one and update you back. 

Questions -
1) may i know how you have the tweets and hashtags details... 
I assume you have the tweets and hashtags as an excel sheet. do you have this excel sheet or you dont have it yet. 

2) the tweets should be sent to Splunk automatically or someone will download the tweets and upload it to Splunk manually