Install/Configure Hadoop HDFS,YARN Cluster and integrate Spark with it

In our current scenario, we have 4 Node cluster where one is master node (HDFS Name node and YARN resource manager) and other three are slave nodes (HDFS data node and YARN Node manager)

How We Used Terraform to Create and Manage a HA AKS Kubernetes Cluster in Azure

Learn how to use Terraform to manage a Azure AKS Kubernetes cluster with Azure AD integration and Calico network policies enabled.

How to Install and Configure Kubectl: A Tutorial

Kubectl is a command-line tool for Kubernetes. It allows us to execute Kubernetes operations via the API. We can use Kubectl to deploy apps, check logs as well as manage all the other resources of the cluster.In this article, we will review Kubectl, and outline its installation, configuration, and use.

Start Mongo DB Cluster on localhost

Starting mongo as a standalone single instance is straight forward. But on production environments, mongo db is always running in clustered format. So how to replicate the same clustered format mongo db on your local machine or on staging instances or for testing purposes becomes critical.

Cluster vs PM2 vs Worker Threads — масштабируем правильно

Cluster vs PM2 vs Worker Threads . Попробуем сравнить несколько разных подходов к масштабированию — какой из них эффективнее? Собираем стенд в Docker и стреляем по нему из Autocannon Исходный ...

Whose Cluster Is It Anyway?

Examine some of the ways that enterprises might divide and assign responsibiity to teams in the managment of clusters. We can outline a common scenario; implementing a Kubernetes cluster in a company often starts as a proof of concept.

Kubernetes Cluster Management: Size and Resources

Kubernetes cluster management can be demanding. This article helps you manage your cluster resources properly, especially in an autoscaling environment. While there is a general awareness that resources are never limitless – even in a huge cluster as a service solution, we do not often consider the exact layout of the cluster resources. And the general idea of virtualization and containerization makes it seem like resources are treated as a single, huge pool – which may not always be true. Let’s see how it looks.

Implement Clustering in CloudHub

To ensure High Availability (HA), fault tolerance (FT), scaling, and performance for the application, a cluster can be set up in Mule which acts as a single unit to provide the mentioned capabilities. The instances in a cluster are called nodes that communicate and share a distributed memory grid. Mule uses an active-active model to cluster Mule Runtime engines.

Whose Cluster Is It Anyway?

While researching how enterprises adopt Kubernetes, we can outline a common scenario; implementing a Kubernetes cluster in a company often starts as a proof of concept.

How To Install Elasticsearch on CentOS/RHEL 8 – TecAdmin

Elasticsearch is flexible and powerful open-source, distributed real-time search and analytics engine. Using a simple set of APIs provides the ability for full-text search. Elastic search is freely available under the Apache 2 license, which provides the most flexibility. This tutorial will help you to setup Elasticsearch single node cluster on CentOS 8 and RedHat 8 systems.

Using Kubernetes Jobs and the Kubernetes python client to train your models

In this article will Use Kubernetes Jobs and the Kubernetes python client to train your models . There are a lot of different ways to train machine learning models, one of them is to run the training on a Kubernetes cluster. The advantage is that most companies have a Kubernetes cluster at hand and large resources or GPUs can be allocated easily and on demand.

How To Manage Local Kubernetes Testing with KIND Tool

If you've spent days (or even weeks?) trying to spin up a Kubernetes cluster for learning purposes or to test your application, then your worries are over.

Are the clusters good?

Understanding how to evaluate clusters. Clustering is defined as finding natural groups in the data. But this definition is inherently subjective.

Testing Ansible Roles for Multiple Hosts or Clusters with Molecule

How to use Molecule for creating Ansible Roles for multiple hosts, multiple test scenarios and configure the host groups and host variables. In order to write and test Ansible roles for multiple hosts/clusters, it is important to use tools that are efficient and automated .Luckily, the Molecule project for Ansible is the perfect tool for this use case

Orchestration With Docker-Swarm

The world is constantly being attracted towards containers and its orchestration especially in large and dynamic environments which has also led to the rising

A Data Science/Big Data Laboratory — part 2 of 4

Assembling a Data Science/Big Data Laboratory in a Raspberry Pi 4 or VMs cluster with Hadoop, Spark, Hive, Kafka, Zookeeper and PostgreSQL

A Data Science/Big Data Laboratory -part 4 of 4

Assembling a Data Science/Big Data Laboratory in a Raspberry Pi 4 or VMs cluster with Hadoop, Spark, Hive, Kafka, Zookeeper and PostgreSQL

What, Why, and How Cloudstate?

Reading Time: 4 minutes This article talks about the Lightbend's Cloudstate which is used for serverless computing.

Kubernetes vs Docker

Linux-primarily based boxes to construct programs keeps developing, Docker Swarm vs. whilst both of that technology copes with containers, at a far better appearance, they're not absolutely competitors. Kubernetes and Docker operate at exclusive...