Support proxy option in webtools add-on

[ssanplunk]

Hi.
I checked the issue below, but I couldn't find proxy option in the code.
https://github.com/bentleymi/ta-webtools/issues/17

Is the proxy option (-x or --proxy) of linux curl available on the WebTools Add-on?

If there is another way that I don't know, please share it.

@jkat54 Webtools Add-on 

[livehybrid · Accepted solution]

Just to confirm, I have added a HTTP_PROXY and HTTPS_PROXY and this TA then routes the requests over the proxy.

Ive also made a pull request to the app author's Git repo to enable proxy support directly in the command, as I think there are other usecases where customers are unable to set the HTTP_PROXY and HTTPS_PROXY env variables. Feel free to use the curl.py from the pull request which will allow you to use proxy param: https://github.com/bentleymi/ta-webtools/pull/34/files

Please let me know how you get on and consider adding karma to this or any other answer if it has helped.
Regards

Will

[ssanplunk]

Thanks for your support! I'll test it using the full request code and share it with you.

[jkat54]

I'm the author and I want to say thanks for your contribution. 

[livehybrid]

Hi @ssanplunk 

This app actually uses the python Requests library under the hood and looking through the curl.py script (where it emulates curl requests via SPL command) it does not reference proxy anywhere, and also doesnt support passing additional flags, therefore unfortunately it is not currently possible to pass the curl proxy option to the command.

Please let me know how you get on and consider adding karma to this or any other answer if it has helped.
Regards

Will

[PickleRick]

The requests module uses environment variables. So as long as the environment from which the process is spawned has those variables set, the module should use the proxy.

See https://requests.readthedocs.io/en/latest/user/advanced/#proxies

[jkat54]

Indeed the app does not support the proxy in the code.

however some have had success in the past by setting a system wide proxy.

https://docs.splunk.com/Documentation/Splunk/9.4.1/Admin/Bestbestpracticesforproxyserver

https://unix.stackexchange.com/questions/213737/how-do-i-set-systemwide-connection-over-a-proxy-serv...

[jkat54]

Ref: https://community.splunk.com/t5/All-Apps-and-Add-ons/Is-there-any-way-to-get-TA-webtools-curl-to-use...