Recently I was looking into how to deploy an Apache Flink cluster that uses RocksDB as the backend state and found a lack of detailed documentation on the subject. I was able to piece together how to deploy this from the Flink documentation and some stack overflow posts but there wasn’t a clear how-to guide anywhere. My goal with this post is to show a step by step guide for how to do this as of Flink 1.11.0. This guide can be followed with minimal modifications for AWS deployments. I will note the changes.

#azure-kubernetes-service #azure #docker #apache-flink #data-engineering #rocksdb

Running Apache Flink with RocksDB on Azure Kubernetes Service
8.95 GEEK