It would be beneficial to enhance the [webscraper.py](https://github.com/theopenconversationkit/tock/blob/a14ea89ca0330fee01a00700f996a49944f8d5bd/gen-ai/orchestrator-server/src/main/python/tock-llm-indexing-tools/webscraper.py) file to use proxies. This would help bypass certain restrictions and improve scraping performance.
It would be beneficial to enhance the webscraper.py file to use proxies.
This would help bypass certain restrictions and improve scraping performance.