Alycia  Klein

Alycia Klein

1590895500

Combine AWS Step Functions with CloudWatch Events using aws-cdk

AWS Step Functions allow one to execute & coordinate long-running processes. Step Functions fall into serverless AWS services, and the platform manages the function execution state completely.
In the example below we will use the following AWS services:
The example demonstrates how Step Functions manage execution of a process, which involves external events e.g. human interaction.

#workflow #aws-step-functions #aws-cdk #aws-lambda

What is GEEK

Buddha Community

Combine AWS Step Functions with CloudWatch Events using aws-cdk
Alycia  Klein

Alycia Klein

1590895500

Combine AWS Step Functions with CloudWatch Events using aws-cdk

AWS Step Functions allow one to execute & coordinate long-running processes. Step Functions fall into serverless AWS services, and the platform manages the function execution state completely.
In the example below we will use the following AWS services:
The example demonstrates how Step Functions manage execution of a process, which involves external events e.g. human interaction.

#workflow #aws-step-functions #aws-cdk #aws-lambda

Rory  West

Rory West

1619214480

ETL Orchestration on AWS with AWS Step Functions

In the latest years, the engineering, governance, and analysis of data has become a very common talking point.

The need for data-driven decision-making, in fact, has grown the need of collecting and analyzing data in many ways and AWS has shown a particular interest in this field developing multiple tools for achieving these business goals.

Before being able to allow the figure of the data analyst to explore and visualize the data, a crucial step is needed. This procedure is commonly identified as ETL (extract, transform, and load) and, usually, it’s far from being simple.

#aws-step-functions #aws #etl #aws-lambda

Rory  West

Rory West

1619244240

An overview of CloudWatch Metrics for AWS Lambda

Learn how to monitor CloudWatch Metrics for AWS Lambda Functions

In this article, I am going to discuss about AWS Lambda execution and monitoring using the CloudWatch metrics. AWS Lambda lets you run your applications on the cloud without having to provision any servers. All you need to do is write your code using your preferred programming language and deploy your code to AWS Lambda. You can then directly run your programs using the resources provided by AWS. At the time of writing this article, AWS Lambda supports programs written in Java, NodeJS, C#, PowerShell, Python, Ruby and Go.

#aws #aws-cloudwatch #aws-lambda #cloud-computing #cloudwatch

PANDAS: Most Used Functions in Data Science

Most useful functions for data preprocessing

When you get introduced to machine learning, the first step is to learn Python and the basic step of learning Python is to learn pandas library. We can install pandas library by pip install pandas. After installing we have to import pandas each time of the running session. The data used for example is from the UCI repository “https://archive.ics.uci.edu/ml/datasets/Heart+failure+clinical+records

  1. Read Data

2. Head and Tail

3. Shape, Size and Info

4. isna

#pandas: most used functions in data science #pandas #data science #function #used python data #most used functions in data science

Evil  David

Evil David

1597190370

Creating a Instance Scheduler using AWS CDK

The AWS CDK is a software development framework used to define cloud infrastructure as code and provision it through CloudFormation. The CDK integrates fully with AWS services and allows developers to use a high-level construct to define cloud infrastructure in code.

In this article, we will build a CDK version of AWS EC2 Instance Scheduler solution that enables us to easily configure custom start and stop schedules for our Amazon EC2 and Amazon RDS instances.

The Architecture

By the end of this article, we will have a pipeline to deploy a serverless solution that starts and stops Amazon EC2 instances in an autoscaling group and Amazon RDS instances based on a schedule.

Here’s the architecture diagram:

Image for post

Through the article we will be covering the following actions:

  • Deploying an AWS Step Function with two parallel tasks.
  • Creating an SNS topic to send notifications.
  • Creating a Cloudeatch event rule which will trigger Step Function based on a schedule.
  • Creating a CI/CD pipeline with CodeBuild and CodePipeline.

Prerequisites

To deploy the CDK application, there are a few prerequisites that need to be met:

  • Setup an AWS account.
  • Install the latest aws-cli.
  • Install AWS CDK CLI.
  • Deploy a multi-AZ WordPress website with RDS (optional).

#aws #step-functions #serverless #cdk