Changes between Version 53 and Version 54 of Other/Summer/2023/Distributed


Ignore:
Timestamp:
Aug 7, 2023, 4:46:48 PM (11 months ago)
Author:
krs227
Comment:

Legend:

Unmodified
Added
Removed
Modified
  • Other/Summer/2023/Distributed

    v53 v54  
    116116**Summary**
    117117   - Ceph one node manual installation
    118    - Created lxc ansible containers
     118   - Created lxc Ansible containers
    119119   - Worked with Ansible playbooks
    120120
    121121**Idea Of Our Progress This Week**
    122 
    123 
    124 Here is how the Ceph diagram works:
    125    1. Data arrives to the file system/pool
    126    2. Splits into chunks (pool groups)
    127    3. Metadata and replicas are created and then stored into OSDs.
    128 
    129 [[Image(Ceph diagram.png)]]
     122This week, we spent most of our time focusing on the manual side installation of Ceph. In order for us to do it, we set up the manager as well as the monitor service setup. We also set up the dashboard, storage pool, file system, and also the CephFS setup. After that, we went over Ansible tasks and went. over how to work with Ansible tasks using yaml scripts which are also known as the Ansible playbooks. We then created playbooks in order for us to be able to fix hostname tasks. After that, the final thing that we did was to setup the LXC ansible container in order for us to test further configurations. We used passwordless sudo, deployed Ceph on one node, and created an Ansible playbook in order for us to mount the Ceph FS.
    130123
    131124**Week Resources**
    132    - Ceph Installation On One Node: https://linuxcourse.rutgers.edu/Winlab_Internship_2023/html/Ceph_one_node.html
    133    - Building Ceph: https://docs.ceph.com/en/quincy/install/build-ceph/
    134    - How Ceph Works: https://www.youtube.com/watch?v=HJivYTJ9Y54
    135    - Data Security: https://www.youtube.com/watch?v=HJivYTJ9Y54
    136    - Self Balancing and Self Healing: https://www.youtube.com/watch?v=jBWVcJYNjeA&t=8s
     125   - Ceph One Node Manual Installation: https://linuxcourse.rutgers.edu/Winlab_Internship_2023/html/Ceph_manual_installation.html
     126   - Ansible Configuration Management: https://linuxcourse.rutgers.edu/Winlab_Internship_2023/html/Ansible_configuration.html
     127   - Ansible Management LXC Setup: https://linuxcourse.rutgers.edu/Winlab_Internship_2023/html/Ansible_installation.html
     128
     129== **Week 6**
     130**Summary**
     131   - Ceph one node manual installation
     132   - Created lxc Ansible containers
     133   - Worked with Ansible playbooks
     134
     135**Idea Of Our Progress This Week**
     136This week, we spent most of our time focusing on the manual side installation of Ceph. In order for us to do it, we set up the manager as well as the monitor service setup. We also set up the dashboard, storage pool, file system, and also the CephFS setup. After that, we went over Ansible tasks and went. over how to work with Ansible tasks using yaml scripts which are also known as the Ansible playbooks. We then created playbooks in order for us to be able to fix hostname tasks. After that, the final thing that we did was to setup the LXC ansible container in order for us to test further configurations. We used passwordless sudo, deployed Ceph on one node, and created an Ansible playbook in order for us to mount the Ceph FS.
     137
     138== **Week 10**
     139**Summary**
     140   - Further Benchmarking
     141   - Created the poster
     142   - Worked on the final presentation for the program
     143
     144**Idea Of Our Progress This Week**
     145We did not do very much this week except for finalizing the portfolio for the project and also doing some final run throughs and testing as well. The main work that we did do however was to work with a 3 node Ceph cluster. We ran benchmarks on 3 node Ceph clusters and ran fio as well on a mounted file system on node08. The final thing that we did was to model disaster recovery.
     146**Week Resources**
     147   - Three Node Ceph Cluster: https://linuxcourse.rutgers.edu/Winlab_Internship_2023/html/three_node_cluster.html
    137148
    138149== **Presentation Links**
     
    146157https://docs.google.com/presentation/d/11OnqS8HUQT1ipjDuqICwsVQrfv0_AZFqHEjgwRpKNZw/edit#slide=id.g25ab189147e_3_5
    147158- Week 8 (July 24 - July 28): [Slides]
    148 - Week 9 (July 31 - August 4): [Slides]
    149 - Week 10 (August 7 - August 11): [Slides]
    150 - Open House: [Slides]
     159- Week 9 (July 31 - August 4): https://docs.google.com/presentation/d/1-mlnMaOQyuYR4uzl357ZnpLlohKaLmN6NtvcZnTCSzU/edit#slide=id.p
     160- Final Presentation: https://docs.google.com/presentation/d/1-GlYdTUVjstotg2bEqquZz5WvsGXw3R0301GuNqOkq0/edit#slide=id.g258895db9c7_2_20
     161- Poster: https://docs.google.com/presentation/d/1MDlNHecW9MYjAh-Vn4cb5j_hOdwMYN3i/edit#slide=id.p1
    151162
    152163