Platform Engineering at HubSpot with Tech Lead Gowtam Lal [DevOps Deployed Ep. 01]

Platform Engineering at HubSpot with Tech Lead Gowtam Lal [DevOps Deployed Ep. 01]

I had the chance to chat with Gowtam Lal, a Tech Lead at HubSpot to learn about how platform engineering operates within their organization.

I had the chance to chat with Gowtam Lal, a Tech Lead at HubSpot to learn about how platform engineering operates within their organization.

We cover everything from how they use Apache Mesos + Singularity to schedule and manage and schedule 13k+ deployable to how they build systems to manage 50TB of log ingestion every day!


Berkeley Mesos paper: https://people.eecs.berkeley.edu/~alig/papers/mesos.pdf

Hubspot Engineering blog: https://product.hubspot.com/blog/topic/engineering


Timestamps: 00:00 - Intro 01:00 - What is DevOps? 01:48 - What is HubSpot? 03:47 - Team size 04:12 - Platform engineering team 06:11 - Runtime infrastructure 06:44 - Microservice architecture 07:25 - Tooling 08:02 - Apache Mesos + Singularity 10:44 - Monoglot organization (Java) 14:44 - Hiring approach 16:20 - Bootstrapping a new service 20:00 - Java dependency management 22:55 - Monitoring, alerting, and dashboards 25:00 - Logging infrastructure 26:43 - HubSpot scale starting to break community endorsed solutions! 28:00 - Diagnosing the logging challenges 29:00 - Process of rolling out major feature/change 30:44 - Testing strategy 32:22 - Building opinionated solutions 34:38 - Rollout and planning (+ load testing pipeline) 36:17 - Risk assessment across components 37:00 - Feature flag to enable runtime configuration of log emission 38:01 - Major lessons learned (vetted application stack empowers developer productivity) 40:44 - What's next on the roadmap? 43:40 - Go check out the HubSpot engineering blog!


Join the Community: šŸ’¬ Discord: https://discord.gg/asRqkZdv4S šŸ’» GitHub: https://github.com/sidpalas/devops-directive šŸ„ Twitter: https://twitter.com/sidpalas šŸ‘Øā€šŸ’¼ LinkedIn: https://www.linkedin.com/in/sid-palas/ šŸŒ Website: https://devopsdirective.com


Community size at time of posting:

  • Subscribers: 11327
  • Channel Views: 274911

hubspot devops devops deployed

What is Geek Coin

What is GeekCash, Geek Token

Best Visual Studio Code Themes of 2021

Bootstrap 5 Tutorial - Bootstrap 5 Crash Course for Beginners

Nest.JS Tutorial for Beginners

Hello Vue 3: A First Look at Vue 3 and the Composition API

How to Extend your DevOps Strategy For Success in the Cloud?

DevOps and Cloud computing are joined at the hip, now that fact is well appreciated by the organizations that engaged in SaaS cloud and developed applications in the Cloud. During the COVID crisis period, most of the organizationsĀ have startedĀ using cloudĀ computingĀ services and implementing a cloud-first strategy to establish their remote operations. Similarly, the extended DevOps strategy will make the development process more agile with automated test cases.

Measuring DevOps Metrics: A How-To Guide

DevOps is supposed to help streamline the process of taking code changes and getting them to production for users to enjoy. But what exactly does it mean for the process to be "streamlined"? One way to answer this is to start measuring metrics.

What Is DevOps and Is Enterprise DevOps Any Good?

What is DevOps? How are organizations transitioning to DevOps? Is it possible for organizations to shift to enterprise DevOps? Read more to find out!

DevOps Basics: What You Should Know

What is DevOps? What are the goals it helps achieves? What are its benefits? This article has answers!

DevOps Services Company | DevOps Consulting Services & Solutions

Get comprehensive DevOps services to accelerate go-to-market time & enhance quality of software products. 15+Yrs Exp, 500+ Staff, 13800+ Projects, 6800+ Clients.