Distributed Data Infrastructure

---

Project Advisor: Professor Alexei Kotelnikov

Team Members: Keshav Subramaniyam, Jason Zhiyuan Zhang, Samyak Agarwal, Anna Kotelnikov, Gyana Deepika Dasara

---

Objective Of This Project

The objective of the project "Distributed Data Infrastructure focuses in general on developing a Ceph file system as well as stress testing the system's robustness and resilience. In order for us, to be able to accomplish this goal, we are learning multiple concepts such as the Linux operating systems, file systems, networking, as well as Ansible.

Week 1

---

• Understood the goal of the project.
• Installed packages and wired a cluster of 8 servers.
• Got familiar with Linux.

Week 2

---

• Installed Debian Linux
• Solidified our understanding with networking as well as the Network File Systems (NFS).

Week 3

---

• Went over Shell Scripting and Python Scripting
• Worked With Distributed File Systems
• Performance Testing for ZFS and also MDRAID

Week 4

---

• Focus on Ceph installation
• Did some troubleshooting relating to OSDs

Presentation Links

• Week 1: ​https://docs.google.com/presentation/d/1-KpBGlFWiV0LEJFXrU6Nk_VxNchvado48oIbh6KHOdk/edit#slide=id.p
• Week 2: ​https://docs.google.com/presentation/d/1Pujv2HFNYLHuhLFh_0tSRZg4yv6gs8nNNyNNcMXD8s8/edit#slide=id.p
• Week 3: ​https://docs.google.com/presentation/d/1uBwrVGlGCIyD_Ex1miklX3PFOZ2JsUqF-Jm7kR1JiSY/edit#slide=id.p
• Week 4: ​https://docs.google.com/presentation/d/1VeIosZZ-GPm8SnB294C6rbX2b-hYHRSArvzhm4MPiY4/edit#slide=id.p