Loading…
FoundationDB Summit 2018 has ended
Back To Schedule
Monday, December 10 • 2:20pm - 2:50pm
Snowcannon: Synchronous Data Replication in FDB - Markus Pilman + David Youngworth, Snowflake Computing

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
Feedback form is now closed.
The current FDB disaster recovery solution uses asynchronous replication, therefore failover might result in data loss.  

For Snowflake, this is an unacceptable business risk.

Snowcannon is a synchronous, distributed queueing system built within FDB.  An FDB cluster can synchronously replicate transactions to Snowcannon, and Snowcannon asychronously pushes these transactions to a secondary cluster.  The queueing system has three benefits: (1) It can replay rollbacks and redos (2) It allows us to bring down the secondary cluster for maintenance while the primary remains online. (3) In the event that both primary and secondary cluster fails, it allows recovery from backups with zero data loss.

This talk will go over the design of Snowcannon, including the replication protocol, failover switch, queueing architecture, and the quorum protocol.
Speakers
avatar for Markus Pilman

Markus Pilman

Software Engineer, Snowflake
Markus Pilman is the engineering lead of the FoundationDB team at Snowflake Computing. He joined Snowflake two years ago after graduating as a Doctor of Sciences from ETH Zurich.He was the author or co-author of and presenter of several papers in the academic database community.
avatar for David Youngworth

David Youngworth

Software Engineer, Snowflake Computing
David Youngworth joined the FoundationDB team at Snowflake Computing nearly 2 years ago.  He is a core developer on the Snowcannon project, Snowflake's synchronous replication engine and HA failover solution, among other FoundationDB related projects. He has a variety of systems... Read More →

Monday December 10, 2018 2:20pm - 2:50pm PST
3AB, Washington State Convention Center
  Session, Advanced

Attendees (12)