A leading financial firm in the US recognized the need to optimize its data processing workflows for increased efficiency and agility. The existing reliance on external sources, such as files and third-party tools like Alteryx and Tidal, posed challenges in terms of additional time, effort, and costs. To address these challenges and enhance operational efficiency, they sought to reduce their dependency on external sources and streamline their data pipelines.