Implementation of Deep Learning unit tests, as well as paths to the 2d data for windows users in the UNet jupyter notebook.

Unit tests have been implemented for classes and functions that relate to Deep Learning tasks such as defining Models, Hyperparameters, Datasets / Dataloaders, as well as the training process.

The process is documented in the following notion file:
https://www.notion.so/qim-dtu/Unit-tests-to-DL-funtions-e8ad1fc1aa134da2ab26474cc6480ca2

the following scripts have been made under qim3d/tests/:

• models/test_unet.py (unit tests for UNet() and Hyperparameters())
• utils/test_augmentations.py (unit tests for Augmentations() and ValueErrors)
• utils/test_data.py (unit tests for Dataset() class, resizing of images with crop, padding, prepare_datasets() and prepare_dataloaders())
• utils/test_models.py (unit tests for output of model_summary() and inference())

Problem:

• Some deep learning tests require considerably more time to run (around 15s to 20s) especially when a Dataloader is involved. This is the case for prepare_dataloaders() as well as the model_summary(). Should they still be included?
• I couldn't think of a way to test the train_model() function, since that requires training a DL model, and would also take too much time.

qim3d/tests/utils/test_models.py

+import qim3d
+from os import name
+
+# unit test for model summary()
+def test_model_summary():
+    if name == 'nt':
+        path = '//home.cc.dtu.dk/3dimage/projects/2023_STUDIOS_SD/analysis/data/Belialev2020/side'
+    else:
+        path = '/dtu/3d-imaging-center/projects/2023_STUDIOS_SD/analysis/data/Belialev2020/side'
+
+    unet = qim3d.models.UNet(size = 'small')
+    augment = qim3d.utils.Augmentation()
+    train_set,val_set,test_set = qim3d.utils.prepare_datasets(path,0.1,unet,augment)
+    train_loader,_,_ = qim3d.utils.prepare_dataloaders(train_set,val_set,test_set,
+                                                                           batch_size = 1,num_workers = 1,
+                                                                           pin_memory = False)
+    summary = qim3d.utils.model_summary(train_loader,unet)
+
+    assert summary.input_size[0] == (1,1,256,256)
+
+# unit test for inference()
+def test_inference():
+    if name == 'nt':
+        path = '//home.cc.dtu.dk/3dimage/projects/2023_STUDIOS_SD/analysis/data/Belialev2020/side'
+    else:
+        path = '/dtu/3d-imaging-center/projects/2023_STUDIOS_SD/analysis/data/Belialev2020/side'
+
+    unet = qim3d.models.UNet(size = 'small')
+    augment = qim3d.utils.Augmentation()
+    train_set,_,_ = qim3d.utils.prepare_datasets(path,0.1,unet,augment)
+
+    _, targ,_ = qim3d.utils.inference(train_set,unet)
+
+    assert tuple(targ[0].unique()) == (0,1)