Using Lambda as a bridge to enable data flow from SQS queue in Account X to Kinesis Data Stream in Account Y

Let’s take a look at the different AWS services that are in play here.

AWS Simple Queue Service: Simple Queue Service (SQS) is a managed distributed queue service that allows messages to be sent and received [and optionally persisted] between applications or services.

AWS Kinesis Data Streams: AWS offers a data streaming service in the form of Kinesis Data Streams which can be used to collect data in real-time and provide it to downstream consumers for further processing.

AWS Lambda: Lambda is a server-less compute service that can be used to execute a chunk of code that processes the data upon specified triggers from other AWS services.

AWS Identity & Access Management: The Identity & Access Management (IAM) service enables users to use permissions to access various AWS services based upon the group or user or role and the policies attached to them.

#aws #data-engineering #aws lambda #sqs and kinesis