Data extraction is a common task in IT world for retrieving data from a data source and preparing it for further processing or storage. In this article, I thought of building a simple API that would demonstrate the extraction of data from an external API and preparing them for processing. This use case can help data science engineers in building similar data extraction capability with very minimal effort.

We will use COVID19 API which is free API that would provide the current stats on COVID in each country. In order for processing the data returned by COVID19 API it will be converted to CSV format with only the extracted set of fields. This API flow will be developed using Kumologica.

Kumologica is a free low-code development tool to build serverless integrations. You can learn more about Kumologica in this medium article or subscribe to our YouTube channel for the latest videos.

---

Use Case

The API flow will accept the country name as the parameter. Using the country name the flow will invoke COVID19 API to get the current stats for that particular country. The response JSON data from COVID19 API will be filtered to specific data structure which will then be converted to CSV format. The CSV content will be placed on to Amazon S3 bucket for further processing.

#integration #aws #microservice #aws lambda #data extraction #low code #kumologica