Changes between Version 2 and Version 3 of Other/Summer/2025/r3
- Timestamp:
- Jun 16, 2025, 3:45:22 PM (7 days ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
Other/Summer/2025/r3
v2 v3 18 18 === Sub-Groups: === 19 19 20 ||= Learning to Help (L2H) =||= Feature Extraction for Distributed Systems =||20 ||= Learning to Help (L2H) =||= Feature Extraction for Distributed Systems (PCA) =|| 21 21 || The recently proposed Learning to Help (L2H) model proposed training a server model given a fixed local (client) model. This differs from the Learning to Defer (L2D) framework which trains the client for a fixed (expert) server. L2H demonstrates its applicability in a number of different scenarios of practical interest in which access to the server may be limited by cost, availability, or policy.|| Implement a distributed feature extraction method, specifically Principal Component Analysis (PCA), on the Orbit testbed. Enable multiple nodes in the Orbit network to collaboratively learn the eigenvectors to reduce the dimensions of new data samples. This compressed data will then be fed into a pre-trained machine learning model for inference. The central idea is that collaboration among nodes can speed up the process of learning these eigenvectors improving the efficiency of our learning or inference tasks. 22 22 || 23 24 == Progress == 25 26 === Week 1 === 27 [https://docs.google.com/presentation/d/1vpTfC3btD_fo2PTWTjl_F7GIQ_yFmAVL1vh2xrC8-Us/edit?usp=drive_link Week 1 Slides] 28 29 - Read the L2H paper 30 - Read the PCA paper 31 32 === Week 2 === 33 [https://docs.google.com/presentation/d/1HQLzoaZy9GAZdUuAKzWyq4eZfQxWejc9XjZ0i7Q0ZDQ/edit?usp=sharing Week 2 Slides] 34 35 - Finished all given papers 36 - Reviewed ML Concepts 37 - Practiced Cosmos (Linux, Vim, etc.) 38 - Set up IDE 39 - Set up project Gitlab 40 41 === Week 3 === 42 [https://docs.google.com/presentation/d/1CoeVqW_KkwaUJu5cP5dy_3ICegnhyhhBIlqUHjwtDFQ/edit?usp=sharing Week 3 Slides] 43 44 - Officially split into sub-groups \\ - L2H (Joshua & Madhav) \\ - PCA (Aayan, Nihal, & Hasan) 45 46 ||= L2H=||= PCA=|| 47 || - Designed Model Architecture based on the paper \\ - Trained all the models \\ - Ran L2H system on one node \\ - Ran multiclass L2H across nodes || - Created an example distributed system framework \\ - Implemented some fault handling features for reliability/robustness \\ - Created a number guessing game with a resilient central node and subnode architecture \\ - Wrote simulation of ORBIT distributed environment using Docker || 48 49 === Week 4 === 50 [https://docs.google.com/presentation/d/1vpTfC3btD_fo2PTWTjl_F7GIQ_yFmAVL1vh2xrC8-Us/edit?usp=drive_link Week 4 Slides] 51 52 ||= L2H=||= PCA=|| 53 || - Read the L2H paper || - Read the PCA paper || 23 54 24 55 == Useful Links: ==