What Caused Microsoft Teams and Other Services to Go Down on March 15 2021?

On March 15 2021, Microsoft teams alongside many other services experienced a global outage.

Microsoft has released a ROOT cause ANALYSIS of the incident. In this video we will summarize what caused the outage and what Microsoft did to resolve it.

Microsoft services rely on Azure active directory for authentication and authorization.

Each service gets a token and verifies the token with a signing key 🔑 to make sure the token is still valid. And as part of automated security hygiene, Microsoft does a key rotation and invalidate keys that is no longer used.

There was a bug in the automated key rotation that removed a signing key that was not supposed to be removed. Unfortunately, this key signed so many tokens that are being used by many services

As a result of that removal, the metadata about the keys has been downloaded by all services, and all those tokens were marked as invalid (key is no longer trusted).

Users connecting to these services started to get errors because of this.

Microsoft engineering quickly realized that and reverted the metadata to force the key to be trusted again

However, because each service already cached that knowledge that the key was untrusted it wouldn’t refresh the new metadata (cache invalidation is the most difficult problem)

That exacerbated the problem, some services went down while others remain untrusting those token

Engineers finally pushed a fix to force a refresh of keys metadata to force services to pull new metadata and trust the key again

This is when the services started coming back to normal,

RCA
https://status.azure.com/en-us/status/history/

Slides for this video
https://payhip.com/b/RoCa

#developer

What is GEEK

Buddha Community

What Caused Microsoft Teams and Other Services to Go Down on March 15 2021?
Chet  Lubowitz

Chet Lubowitz

1595429220

How to Install Microsoft Teams on Ubuntu 20.04

Microsoft Teams is a communication platform used for Chat, Calling, Meetings, and Collaboration. Generally, it is used by companies and individuals working on projects. However, Microsoft Teams is available for macOS, Windows, and Linux operating systems available now.

In this tutorial, we will show you how to install Microsoft Teams on Ubuntu 20.04 machine. By default, Microsoft Teams package is not available in the Ubuntu default repository. However we will show you 2 methods to install Teams by downloading the Debian package from their official website, or by adding the Microsoft repository.

Install Microsoft Teams on Ubuntu 20.04

1./ Install Microsoft Teams using Debian installer file

01- First, navigate to teams app downloads page and grab the Debian binary installer. You can simply obtain the URL and pull the binary using wget;

$ VERSION=1.3.00.5153
$ wget https://packages.microsoft.com/repos/ms-teams/pool/main/t/teams/teams_${VERSION}_amd64.deb

#linux #ubuntu #install microsoft teams on ubuntu #install teams ubuntu #microsoft teams #teams #teams download ubuntu #teams install ubuntu #ubuntu install microsoft teams #uninstall teams ubuntu

Fannie  Zemlak

Fannie Zemlak

1599854400

What's new in the go 1.15

Go announced Go 1.15 version on 11 Aug 2020. Highlighted updates and features include Substantial improvements to the Go linker, Improved allocation for small objects at high core counts, X.509 CommonName deprecation, GOPROXY supports skipping proxies that return errors, New embedded tzdata package, Several Core Library improvements and more.

As Go promise for maintaining backward compatibility. After upgrading to the latest Go 1.15 version, almost all existing Golang applications or programs continue to compile and run as older Golang version.

#go #golang #go 1.15 #go features #go improvement #go package #go new features

Microsoft Development Services in Ahmedabad

Looking for Microsoft Development Services in Ahmedabad?

We at DataPierce offers our best Microsoft technology-based development services. Our vast years experienced developers serve their experience to fulfil your business needs with the affordable rates.

For Getting More Information or Discuss your ideas with an Expert @ - http://www.datapierce.com/contact-us/

#microsoft #microsoft-development #microsoft-development-technologies #microsoft-development-service

Top Microsoft big data solutions Companies | Best Microsoft big data Developers

An extensively researched list of top Microsoft big data analytics and solution with ratings & reviews to help find the best Microsoft big data solutions development companies around the world.
An exclusive list of Microsoft Big Data consulting and solution providers, after examining various factors of expert big data analytics firms and found the equivalent matches that boast the ace qualities with proven fineness in data analytics. For business growth and enterprise acceleration getting inputs from the whole data of the organization have become necessary, thus we bring to you the most trustworthy Microsoft Big Data consultants and solutions providers for your assistance.
Let’s take a look at the List of Best Microsoft big data solutions Companies.

#microsoft big data solutions development companies #microsoft big data analytics and solution #microsoft big data consultants #microsoft big data developers #microsoft big data #microsoft big data solution providers

What Caused Microsoft Teams and Other Services to Go Down on March 15 2021?

On March 15 2021, Microsoft teams alongside many other services experienced a global outage.

Microsoft has released a ROOT cause ANALYSIS of the incident. In this video we will summarize what caused the outage and what Microsoft did to resolve it.

Microsoft services rely on Azure active directory for authentication and authorization.

Each service gets a token and verifies the token with a signing key 🔑 to make sure the token is still valid. And as part of automated security hygiene, Microsoft does a key rotation and invalidate keys that is no longer used.

There was a bug in the automated key rotation that removed a signing key that was not supposed to be removed. Unfortunately, this key signed so many tokens that are being used by many services

As a result of that removal, the metadata about the keys has been downloaded by all services, and all those tokens were marked as invalid (key is no longer trusted).

Users connecting to these services started to get errors because of this.

Microsoft engineering quickly realized that and reverted the metadata to force the key to be trusted again

However, because each service already cached that knowledge that the key was untrusted it wouldn’t refresh the new metadata (cache invalidation is the most difficult problem)

That exacerbated the problem, some services went down while others remain untrusting those token

Engineers finally pushed a fix to force a refresh of keys metadata to force services to pull new metadata and trust the key again

This is when the services started coming back to normal,

RCA
https://status.azure.com/en-us/status/history/

Slides for this video
https://payhip.com/b/RoCa

#developer