Past NUS DYOM!

This is a group study course on Distributed Systems based on the 6.824 course material

This website serves as a store for our discussion notes and/or questions that arise.

General Info/Notices

Our next session would be held on Tuesday 1-2 p.m., venue TBC.

This is a discussion session with Prof Seth, so please come prepared :)

Contributing

Check out the source branch for how you can contribute your notes to this repo :D

Schedule

Week 1 (13-19 Jan)

LEC 1: Introduction

Preparation: Read MapReduce (2004)

Assigned: Lab 1: MapReduce

LEC 2: RPC and Threads, Crawler, K/V

Preparation: Do Online Go tutorial (FAQ) (Question)

Week 2 (20-26 Jan)

LEC 3: GFS

Preparation: Read GFS (2003) (FAQ) (Question)

Assigned: Lab 2: Raft

Week 3 (27 Jan - 2 Feb)

Teach Seth:

Sean

Jiaxiu

John

Shaowei

Remote Helpers:

LEC 4: Primary-Backup Replication

Preparation: Read Fault-Tolerant Virtual Machines (2010) (FAQ) (Question)

Week 4 (3-9 Feb)

LEC 5: Fault Tolerance: Raft

Preparation: Read Raft (extended) (2014), to end of Section 5 (FAQ) (Question)

Teach Seth:

Joel

Julius

Jolene

Jiaxiu

Remote Helpers:

Week 5 (10-16 Feb)

LEC 6: Fault Tolerance: Raft

Preparation: Read Raft (extended) (2014), Section 6 to end (FAQ) (Question)

LEC 7: Spinnaker

Preparation: Read Spinnaker (2011) (including Appendices) (FAQ) (Question)

Week 6(17-23 Feb)

LEC 8: Zookeeper

Preparation: Read ZooKeeper (2010) (FAQ) (Question)

Assigned: Lab 3: KV Raft

Teach Seth:

Joel

Arsalan

Yu Jia

Guo Wei

Remote Helpers:

Week 7 (2-8 Mar)

LEC 10: Distributed Transactions

Preparation: Read 6.033 Chapter 9, just 9.1.5, 9.1.6, 9.5.2, 9.5.3, 9.6.3 (FAQ) (Question)

LEC 11: Optimistic Concurrency Control

Preparation: Read FaRM (2015) (FAQ) (Question)

Week 8 (9-15 Mar)

LEC 12: Big Data: Spark

Preparation: Read Spark (2012) (FAQ) (Question)

Assigned: Lab 4: Sharded KV

Teach Seth:

Julius

Arsalan

Guo Wei

Yu Jia

Adam

Remote Helpers:

Week 9 (16-22 Mar)

LEC 13: Big Data: Naiad

Preparation: Read Naiad (2013) (FAQ) (Question)

LEC 14: Distributed Machine Learning: Parameter Server

Preparation: Read Parameter Server (2014) (FAQ) (Question)

Week 10 (23-29 Apr)

LEC 15: Cache Consistency: Frangipani

Preparation: Read Frangipani (FAQ) (Question)

Teach Seth:

John

Shaowei

Rahul

Donald

Adam

Remote Helpers:

Week 11 (30 Mar - 5 Apr)

LEC 16: Cache Consistency: Memcached at Facebook

Preparation: Read Memcached at Facebook (2013) (FAQ) (Question)

LEC 19: Peer-to-peer, DHTs

Preparation: Read Chord (2001) and Trackerless Bittorrent

Preparation: Read AnalogicFS experience paper (FAQ) (Question)

Week 12 (6-12 Apr)

LEC 20: Dynamo

Preparation: Read Dynamo (2007) (FAQ) (Question)

LEC 21: Peer-to-peer: Bitcoin

Preparation: Read Bitcoin, summary (FAQ) (Question)

Week 13 (13-19 Apr)

No details.

Deadlines

DateTask
Week 1 (19 Jan)Lab 1
Week 2 (26 Jan)Lab 2A
Week 3 (2 Feb)Lab 2B
Week 4 (9 Feb)Lab 2C
Week 5 (16 Feb)Lab 3A
Recess (1 Mar)Homework 1
Week 8 (15 Mar)Lab 3B
Week 10 (29 Mar)Lab 4A
Week 12 (12 Apr)Lab 4B
Week 13 (19 Apr)Homework 2