How Twitter Runs Presto at Scale in the Cloud

Beinan Wang, Ph.D. - Twitter - Presto Community Track - Percona Live 2021

Presto is a widely adopted federated SQL engine for federated querying across multiple data sources. With Presto, you can perform ad hoc querying of data in place.

In this session, Twitter engineer Beinan Wang will share how they use Presto at scale with over 3K Presto workers and 10 million queries and a highly-scalable query predictor service. At Twitter, this service helps improve the performance of Presto clusters and provides expected execution statistics on Business Intelligence dashboards. ∎

Video

Link: https://youtu.be/CoNgDcyl-IE

Speakers

Beinan Wang, Ph.D.

Twitter, Sr. Software Engineer

Beinan builds large scale distributed SQL systems (presto&hive) for Twitter’s data platform team.

See all talks by Beinan Wang, Ph.D. »

Did you like this post? Why not read more?

Percona Community Live June 21 - Day 1

You are invited to participate in the first day of the Percona Community Live stream! Learn about VictoriaMetrics, flexible Indexing with Postgres, PostgreSQL backups, database resiliency, and many other things on June 21st. Join us on June 22nd and June 23d for more amazing content!

Percona University Istanbul 2024

Percona University is an ongoing series of community-driven database meetups, bringing together open-source enthusiasts from around the world. On September 7th, we landed in Istanbul, the vibrant cultural and economic hub of Türkiye, for a day of learning, networking, and meaningful connections.

Percona University Limassol 2024

On April 20th, 2024, people who love working with databases came together in Cyprus for something special - the Percona University Limassol. Percona put on this event to help folks dive deep into the latest database tech.