HTAP Made Live — from the Engineering Perspective

HTAP Made Live — from the Engineering Perspective

HTAP Made Live — from the Engineering Perspective, Ed will talk about TiDB and its columnar storage engine TiFlash from the perspective of engineering design, and explain how TiDB utilizes and extends Raft protocol to eliminate the impact of OLAP workload on OLTP, to achieve an industrial-grade HTAP database, and give relevant benchmarks and user cases.

Hybrid OLTP and OLAP (HTAP) require processing transactional and analytical queries in isolation to remove the interference between them. To achieve this, it is necessary to maintain two replicas of data specified for the two types of queries. However, it is challenging to provide a consistent view for the two replicas within a storage system, because the storage system should allow analytical requests to efficiently read consistent and fresh data from transactional workloads and also scale to large data sizes with high availability.

To solve this problem, we propose a Raft-based HTAP database: TiDB. We design a multi-Raft storage system to materialize updates from transactional requests and to synchronize Raft logs with additional nodes that transform row format to column format, forming a column store. This store is dedicated to analytical queries to efficiently read fresh and consistent data. Based on this storage system, we build an SQL engine to process large-scale distributed transactions and expensive analytical queries which optimally read row-format and column-format replicas of data.

In this talk, Ed will talk about TiDB and its columnar storage engine TiFlash from the perspective of engineering design, and explain how TiDB utilizes and extends Raft protocol to eliminate the impact of OLAP workload on OLTP, to achieve an industrial-grade HTAP database, and give relevant benchmarks and user cases.

developer programming

Bootstrap 5 Complete Course with Examples

Bootstrap 5 Tutorial - Bootstrap 5 Crash Course for Beginners

Nest.JS Tutorial for Beginners

Hello Vue 3: A First Look at Vue 3 and the Composition API

Building a simple Applications with Vue 3

Deno Crash Course: Explore Deno and Create a full REST API with Deno

How to Build a Real-time Chat App with Deno and WebSockets

Convert HTML to Markdown Online

HTML entity encoder decoder Online

How long does it take to develop/build an app?

This article covers A-Z about the mobile and web app development process and answers your question on how long does it take to develop/build an app.

Developer Career Path: To Become a Team Lead or Stay a Developer?

For a developer, becoming a team leader can be a trap or open up opportunities for creating software. Two years ago, when I was a developer, ... by Oleg Sklyarov, Fullstack Developer at Skyeng company

Tracking a Developer’s Journey From Documentation Visit

Measuring website activity provides only half the story. See how to best track the developer's journey and what funnel stages makes sense for API-first products

Offshore Software Development - Best Practices

To make the most out of the benefits of offshore software development, you should understand the crucial factors that affect offshore development.

Hire Ruby on Rails Developer | Hire RoR Developer

#1 Ruby on Rails development company. Hire Ruby on rails developer or a team to build secure, scalable and complex web solutions with a quick turnaround time.