Changes between Version 90 and Version 91 of Other/Summer/2023/Inference

Timestamp:

Jul 30, 2023, 9:16:09 PM (11 months ago)

Author:

tm897

Comment:

—

Other/Summer/2023/Inference

@@ -13 +13 @@
 == Overview
 As machine learning models become increasingly advanced and complex, running these models on less powerful devices is becoming increasingly difficult, especially when accounting for latency. However, it is also not efficient to run everything using only the cloud as it creates too much traffic. A viable solution to this problem is edge computing, where we use the edge (the networks in between user devices and the cloud) for computation. 
+
+
+1. Trained a small and large Neural Networks (DENSENET & Mobilenet V2) on the CIFAR10 dataset 
+2. Performed PCA and SVM on NNs to familiarize ourselves with PyTorch 
+3. Loaded the MNIST database (image) onto an orbit node 
+4. Connected 2 nodes with client-server architecture and extracted data for time and accuracy measurements 
+5. Compared performances of both neural networks on the CIFAR10 dataset
+  * Established connection between two nodes 
+  * Communicated test data between nodes to compare accuracy and delay between our NN models
+6. Worked with professors/mentors and read papers to understand the concepts of early exit, split computing, accuracy/latency tradeoff, and distributed deep neural networks over the edge cloud 
+7.Split the NN ResNet 18 using split computing onto two different devices and ran an inference across a network 
+8. Used Network Time Protocol (NTP) and sent data in "packages" (chunks) to collect latency and delay data
+9.Explored different research questions with the data collected: __________
+10. Limited CPU power in terminal to imitate mobile devices
+11. Implemented different threshold values based on confidence for sending the data to the edge and server for inference
+  * Generated graphs for threshold vs latency, accuracy vs latency, ____ (LINK TO GRAPHS)
+9. Retrained neural network to achieve 88% accuracy and collected new graphs (LINK)
+10. Introduced a delay in the inference as well as data transfer to simulate a queue 
 
 == Week 1
@@ -51 +69 @@
 == Week 4
 **Summary**
-  * Created and Trained a ‘Small’ and ’Large’ Neural Networks
-  * Compared their performances on the CIFAR10 dataset
+  * Compared performances of both neural networks on the CIFAR10 dataset
   * Established connection between two nodes 
   * Communicated test data between nodes to compare accuracy and delay between our NN models