- worked with handling high volume data, building data pipelines, and building some
robust APIs for internal tools at Dataweave
- I was wearing multiple hats, being part of the delivery team, building the ETL pipeline
and building APIs for the report generator tool.
- Responsible for writing python scripts to scrape large scale data from the websites and provide real time analytics to the clients.
- Was playing key role in developing internal tools that helps to make people work easily inside the organisation
- Successfully crawled over 250 websites, and provided insigths to the client from the extracted data on daily basis.
