Changes between Version 2 and Version 3 of Other/Summer/2025/r3


Ignore:
Timestamp:
Jun 16, 2025, 3:45:22 PM (7 days ago)
Author:
jam1092
Comment:

Legend:

Unmodified
Added
Removed
Modified
  • Other/Summer/2025/r3

    v2 v3  
    1818=== Sub-Groups: ===
    1919
    20 ||= Learning to Help (L2H) =||= Feature Extraction for Distributed Systems =||
     20||= Learning to Help (L2H) =||= Feature Extraction for Distributed Systems (PCA) =||
    2121||  The recently proposed Learning to Help (L2H) model proposed training a server model given a fixed local (client) model. This differs from the Learning to Defer (L2D) framework which trains the client for a fixed (expert) server.  L2H demonstrates its applicability in a number of different scenarios of practical interest in which access to the server may be limited by cost, availability, or policy.|| Implement a distributed feature extraction method, specifically Principal Component Analysis (PCA), on the Orbit testbed. Enable multiple nodes in the Orbit network to collaboratively learn the eigenvectors to reduce the dimensions of new data samples. This compressed data will then be fed into a pre-trained machine learning model for inference. The central idea is that collaboration among nodes can speed up the process of learning these eigenvectors improving the efficiency of our learning or inference tasks.
    2222||
     23
     24== Progress ==
     25
     26=== Week 1 ===
     27[https://docs.google.com/presentation/d/1vpTfC3btD_fo2PTWTjl_F7GIQ_yFmAVL1vh2xrC8-Us/edit?usp=drive_link Week 1 Slides]
     28
     29- Read the L2H paper
     30- Read the PCA paper
     31
     32=== Week 2 ===
     33[https://docs.google.com/presentation/d/1HQLzoaZy9GAZdUuAKzWyq4eZfQxWejc9XjZ0i7Q0ZDQ/edit?usp=sharing Week 2 Slides]
     34
     35- Finished all given papers
     36- Reviewed ML Concepts
     37- Practiced Cosmos (Linux, Vim, etc.)
     38- Set up IDE
     39- Set up project Gitlab
     40
     41=== Week 3 ===
     42[https://docs.google.com/presentation/d/1CoeVqW_KkwaUJu5cP5dy_3ICegnhyhhBIlqUHjwtDFQ/edit?usp=sharing Week 3 Slides]
     43
     44- Officially split into sub-groups \\ - L2H (Joshua & Madhav) \\ - PCA (Aayan, Nihal, & Hasan)
     45
     46||= L2H=||= PCA=||
     47|| - Designed Model Architecture based on the paper \\ - Trained all the models \\ - Ran L2H system on one node \\  - Ran multiclass L2H across nodes || - Created an example distributed system framework \\ - Implemented some fault handling features for reliability/robustness \\ - Created a number guessing game with a resilient central node and subnode architecture \\ - Wrote simulation of ORBIT distributed environment using Docker ||
     48
     49=== Week 4 ===
     50[https://docs.google.com/presentation/d/1vpTfC3btD_fo2PTWTjl_F7GIQ_yFmAVL1vh2xrC8-Us/edit?usp=drive_link Week 4 Slides]
     51
     52||= L2H=||= PCA=||
     53|| - Read the L2H paper || - Read the PCA paper ||
    2354
    2455== Useful Links: ==