Add files using upload-large-folder tool
Browse filesThis view is limited to 50 files because it contains too many changes. See raw diff
- .gitattributes +3 -0
- README.md +25 -0
- checksums.sha256 +74 -0
- dataset_sources.md +10 -0
- experiments/external_ood/raw_scores/raw_scores_remote_inventory.csv +26 -0
- experiments/external_ood/results_json/external_ood_results.json +1 -0
- experiments/external_ood/tables/external_ood_table.tex +20 -0
- experiments/k_ablation/results_json/k_ablation_results.json +47 -0
- experiments/k_ablation/tables/k_ablation_table.tex +21 -0
- experiments/main_training/figures/confusion_matrix.png +0 -0
- experiments/main_training/figures/three_seed_auroc.png +0 -0
- experiments/main_training/tables/main_results_table.tex +24 -0
- experiments/scoring_method/figures/scoring_method_comparison.png +0 -0
- experiments/scoring_method/figures/scoring_methods_full.png +0 -0
- experiments/scoring_method/results_json/scoring_method_results.json +36 -0
- experiments/scoring_method/tables/scoring_method_table.tex +20 -0
- experiments/separation_loss_ablation/figures/separation_loss_ablation.png +0 -0
- experiments/separation_loss_ablation/figures/separation_loss_ablation_final.png +3 -0
- experiments/separation_loss_ablation/results_json/separation_loss_results.json +21 -0
- experiments/separation_loss_ablation/tables/separation_loss_table.tex +24 -0
- experiments/timestep_strategy/figures/error_vs_timestep.png +3 -0
- experiments/timestep_strategy/figures/timestep_strategy_comparison.png +3 -0
- experiments/timestep_strategy/results_json/timestep_strategy_results.json +367 -0
- experiments/timestep_strategy/tables/timestep_strategy_table.tex +15 -0
- manifest.csv +75 -0
- missing_checkpoints.md +20 -0
- models/raw_scores/seed123_cifar100_scores.pt +3 -0
- models/raw_scores/seed123_cifar10_id_scores.pt +3 -0
- models/raw_scores/seed123_cifar10_ood_scores.pt +3 -0
- models/raw_scores/seed123_fashionmnist_scores.pt +3 -0
- models/raw_scores/seed123_food101_scores.pt +3 -0
- models/raw_scores/seed123_stl10_scores.pt +3 -0
- models/raw_scores/seed123_svhn_scores.pt +3 -0
- models/raw_scores/seed123_textures_scores.pt +3 -0
- models/raw_scores/seed42_cifar100_scores.pt +3 -0
- models/raw_scores/seed42_cifar10_id_scores.pt +3 -0
- models/raw_scores/seed42_cifar10_ood_scores.pt +3 -0
- models/raw_scores/seed42_fashionmnist_scores.pt +3 -0
- models/raw_scores/seed42_food101_scores.pt +3 -0
- models/raw_scores/seed42_places365_scores.pt +3 -0
- models/raw_scores/seed42_stl10_scores.pt +3 -0
- models/raw_scores/seed42_svhn_scores.pt +3 -0
- models/raw_scores/seed42_textures_scores.pt +3 -0
- models/raw_scores/seed456_cifar100_scores.pt +3 -0
- models/raw_scores/seed456_cifar10_id_scores.pt +3 -0
- models/raw_scores/seed456_cifar10_ood_scores.pt +3 -0
- models/raw_scores/seed456_fashionmnist_scores.pt +3 -0
- models/raw_scores/seed456_food101_scores.pt +3 -0
- models/raw_scores/seed456_stl10_scores.pt +3 -0
- models/raw_scores/seed456_svhn_scores.pt +3 -0
.gitattributes
CHANGED
|
@@ -33,3 +33,6 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
experiments/timestep_strategy/figures/error_vs_timestep.png filter=lfs diff=lfs merge=lfs -text
|
| 37 |
+
experiments/timestep_strategy/figures/timestep_strategy_comparison.png filter=lfs diff=lfs merge=lfs -text
|
| 38 |
+
experiments/separation_loss_ablation/figures/separation_loss_ablation_final.png filter=lfs diff=lfs merge=lfs -text
|
README.md
ADDED
|
@@ -0,0 +1,25 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
library_name: pytorch
|
| 3 |
+
tags:
|
| 4 |
+
- conditional-diffusion
|
| 5 |
+
- out-of-distribution-detection
|
| 6 |
+
- cifar10
|
| 7 |
+
- thesis
|
| 8 |
+
license: mit
|
| 9 |
+
---
|
| 10 |
+
|
| 11 |
+
# CIFAR-10 Conditional Diffusion OOD Models
|
| 12 |
+
|
| 13 |
+
This Hugging Face package contains the model-release side of the CIFAR-10/OOD thesis experiments. Exact final CIFAR checkpoints referenced by the thesis were not present in the local `ssh00` folder; they are therefore documented in `missing_checkpoints.md` rather than replaced by uncertain local weights.
|
| 14 |
+
|
| 15 |
+
## Reported Thesis Results
|
| 16 |
+
- Within-CIFAR audited AUROC: 98.98%.
|
| 17 |
+
- External OOD audited AUROC range: 90.50% to 96.97% across CIFAR-100, Places365, FashionMNIST, SVHN, and Textures.
|
| 18 |
+
- Separation loss effect: lambda 0.02 reaches 99.03% +/- 0.07% AUROC, versus 80.25% for lambda 0.
|
| 19 |
+
|
| 20 |
+
## Contents
|
| 21 |
+
- `raw_scores/`: auditable score tensors available locally.
|
| 22 |
+
- `results_json/`: ablation/evaluation JSON artifacts.
|
| 23 |
+
- `tables/` and `figures/`: thesis table and figure artifacts.
|
| 24 |
+
- `dataset_sources.md`: dataset provenance and expected sources.
|
| 25 |
+
- `missing_checkpoints.md`: exact absent checkpoint provenance from thesis documentation.
|
checksums.sha256
ADDED
|
@@ -0,0 +1,74 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
94bd424b0dffdd61783b0593d9fdf677abc7fdaaf4f89babab6303f29315c9c8 dataset_sources.md
|
| 2 |
+
24edb189e279970cd95ac5e6e02709eaa068fdec7f4a5fd0d95cb5947237559e experiments/external_ood/raw_scores/raw_scores_remote_inventory.csv
|
| 3 |
+
eea96e85415d707344682bc9740402ef7536ad20cdfab4f15d18e4ad7169fbc3 experiments/external_ood/raw_scores/seed123_cifar100_scores.pt
|
| 4 |
+
fe6e549a6882414c135e31cb587fe0fa96c1ce8d1499929f26e54fb0f574e2ff experiments/external_ood/raw_scores/seed123_cifar10_id_scores.pt
|
| 5 |
+
5db6e8d654d19a04903a63a028bf3eee04cbfb2ad11388e38008ed79c779c540 experiments/external_ood/raw_scores/seed123_cifar10_ood_scores.pt
|
| 6 |
+
c36a3aaa549d85e0d051bffd39aaa41f3becd1c5a77d256440cc6cec85eca94a experiments/external_ood/raw_scores/seed123_fashionmnist_scores.pt
|
| 7 |
+
efea6c9959a2e1eb8c8f45ec805640e2e9788e3f1335adf2c5f8ffd87456406f experiments/external_ood/raw_scores/seed123_food101_scores.pt
|
| 8 |
+
99f782f861fd1967d3114512f3609567d462c82a3bf94fa50b06e84b9fe8ba37 experiments/external_ood/raw_scores/seed123_stl10_scores.pt
|
| 9 |
+
18467a14e7aa7acb41c6867dac363dc8c01d45aa9f8049e4f7e86f3b0af37c43 experiments/external_ood/raw_scores/seed123_svhn_scores.pt
|
| 10 |
+
3348acbae4bac9d891c40e7f87584ca2003e8185f55a2db31589a11bc7202e6a experiments/external_ood/raw_scores/seed123_textures_scores.pt
|
| 11 |
+
01da976c1ef147ce098120dc72dca4309b039d3deb0582312f19f450a6b9b923 experiments/external_ood/raw_scores/seed42_cifar100_scores.pt
|
| 12 |
+
f45329e41b35cfb442143379ebdc9d96f488a5f04776ee3d0b4243dec458a757 experiments/external_ood/raw_scores/seed42_cifar10_id_scores.pt
|
| 13 |
+
64599a919c1dc17d4633ad6024d29d9e6f549fbf491420c9dedae234240e1d39 experiments/external_ood/raw_scores/seed42_cifar10_ood_scores.pt
|
| 14 |
+
e2595689d4c135e9968f99117b83739f5805eb520e19378caf6800d7ac1cb037 experiments/external_ood/raw_scores/seed42_fashionmnist_scores.pt
|
| 15 |
+
f7c37c628db9b479196923024de79410d3a5bcf15419698657237df36b2beb1b experiments/external_ood/raw_scores/seed42_food101_scores.pt
|
| 16 |
+
fa05e2f8e7c80f1dcf3f056aedf5f319e4fb6b87e54ccbd9c6c10326ddab271c experiments/external_ood/raw_scores/seed42_places365_scores.pt
|
| 17 |
+
63bc986fe2d1750424b3d161056b4deb448580a3665c0265070728173142adad experiments/external_ood/raw_scores/seed42_stl10_scores.pt
|
| 18 |
+
1d4b841177293ab8ba149b22d031c8af7e79938dcbaf798d4546c396fffba50f experiments/external_ood/raw_scores/seed42_svhn_scores.pt
|
| 19 |
+
8b5a2cf6d56c7c4ee7ee1db6f0a169ec8af01adaa2d65a0fa24430f3dd9f5d38 experiments/external_ood/raw_scores/seed42_textures_scores.pt
|
| 20 |
+
6f5eff496e89464f01af6dac0a09e9b9ea4c2333cec255654bc9a72c9acc7ba6 experiments/external_ood/raw_scores/seed456_cifar100_scores.pt
|
| 21 |
+
eca890ba2edb578cd2a1f6549295f4212e7287c180e02e8477f751845f7cd579 experiments/external_ood/raw_scores/seed456_cifar10_id_scores.pt
|
| 22 |
+
3d464ff0c432a15cb6c32fce045b7f2088f91ba6a080ff2d4b27a6bb73dea089 experiments/external_ood/raw_scores/seed456_cifar10_ood_scores.pt
|
| 23 |
+
089afd7bc9661058659d07869e2c1400bbce7366df49d4507390d2852fd6692e experiments/external_ood/raw_scores/seed456_fashionmnist_scores.pt
|
| 24 |
+
5905ea30ce29afc2b3eea511585a3f5e1cc95d1df3a1150fedada9c17f23e545 experiments/external_ood/raw_scores/seed456_food101_scores.pt
|
| 25 |
+
6ebfbb38187ca20426cbdaa3547f81aa5e4d3830a69c6e623d8a06bfe82fbf8f experiments/external_ood/raw_scores/seed456_stl10_scores.pt
|
| 26 |
+
bbe9b31182ed334606cc8156122ad6f4da2459e90961d7f1c60ae58e271e8107 experiments/external_ood/raw_scores/seed456_svhn_scores.pt
|
| 27 |
+
711b930fb46112f7a5dcfb236947140f0970f65f24524f3bfe80fe25ecdd5adc experiments/external_ood/raw_scores/seed456_textures_scores.pt
|
| 28 |
+
44136fa355b3678a1146ad16f7e8649e94fb4fc21fe77e8310c060f61caaff8a experiments/external_ood/results_json/external_ood_results.json
|
| 29 |
+
5ca1db6bdaf482963ef0fe870c0ac658430166ea323f98d5d4396384fb7815b7 experiments/external_ood/tables/external_ood_table.tex
|
| 30 |
+
dd6a6d029a7b6e24d12cfb4c01d0b279f8170f6ac1abf2a93d06adb143be037a experiments/k_ablation/figures/k_ablation.png
|
| 31 |
+
de1233a80f4884990cb8e26199cb9045ce983d445d1412525fcde04ccc09348d experiments/k_ablation/results_json/k_ablation_results.json
|
| 32 |
+
452b9391922d95550512e83359e699d6a1cc4a62c0be75220fdbe347794bd7cd experiments/k_ablation/tables/k_ablation_table.tex
|
| 33 |
+
5b147b2037cd3c01ea0df4a5a207a815eec966ef50cff9b673e61ed56f71b9b6 experiments/main_training/figures/calibration_curves.png
|
| 34 |
+
c5f6fe6eeed8a320d3920d590de92ba42f9069cec328170678b60d21fbd0ba94 experiments/main_training/figures/confusion_matrix.png
|
| 35 |
+
7709d10b29f9bdf00eb996d5e1fc73d628b43dd765cb103d0fc4eb10d98c9465 experiments/main_training/figures/per_class_performance.png
|
| 36 |
+
319619262a6386632c67e6e55c5f49220c73ba3278b17cc067ed5e03d6aefb1f experiments/main_training/figures/roc_curves_cifar10.png
|
| 37 |
+
93a3552bddfe6dcf7e93e4ee7059bd00b791af7579b6fcf5803327677ebe1f99 experiments/main_training/figures/score_distributions.png
|
| 38 |
+
c38c43e9308fb7206eda29fbaa41cf1a66bfc4f9c8b3072f84eb5877f241b427 experiments/main_training/figures/score_distributions_all.png
|
| 39 |
+
50f96dfd443b95060c4aa444d1846e0b6ce1cc3655558442bd9304396cd88099 experiments/main_training/figures/three_seed_auroc.png
|
| 40 |
+
5f7834a313dc74778c202922da35aec4a65323baf455c40345389e0c179addf1 experiments/main_training/figures/training_curves.png
|
| 41 |
+
cff71f40235d7ea6e6f348b8ed7c40404d72fbae3cd6eb1509920fc2b5459cee experiments/main_training/tables/main_results_table.tex
|
| 42 |
+
f0a02d1dde9dd5fdc5bf45cdb17ff7fa0772093ea4cd917dbaa251b4ad276268 experiments/scoring_method/figures/scoring_method_comparison.png
|
| 43 |
+
d4a2b5e497467e04e3044fcfd39cf0d4740ca62b65df2a913f4413c1ff902586 experiments/scoring_method/figures/scoring_methods_full.png
|
| 44 |
+
23b5d33e0dda98829b7d451bade41ee79f247c7bedf2730406fb46f0ea9a2c17 experiments/scoring_method/results_json/scoring_method_results.json
|
| 45 |
+
cb2a2e16208af9fad5847b03cd4cfc757ebf897457196bd72798d7e4ef54fdfc experiments/scoring_method/tables/scoring_method_table.tex
|
| 46 |
+
821da978cc9a33c27cc553dfb604d4acdfcd01b48052d4db781350c1e33ad9b2 experiments/separation_loss_ablation/figures/sep_loss_dual.png
|
| 47 |
+
ac1dd26568bd55e07d36d24851c3b53b5ef25bf3a05c1940d60faee9489a98ff experiments/separation_loss_ablation/figures/separation_loss_ablation.png
|
| 48 |
+
98bf9835ea7128b6d713cec915473e9b1a2e655e365bc6cf9120ceeae49b9b8e experiments/separation_loss_ablation/figures/separation_loss_ablation_final.png
|
| 49 |
+
e45576da94da72317429cdfee8f82426ec5f57747def9ecd98840b63d6bc83e8 experiments/separation_loss_ablation/figures/separation_loss_ablation_updated.png
|
| 50 |
+
38f6d1492b523c65546396366080188c44b2b237f93b6d64d72414cb7c7666b2 experiments/separation_loss_ablation/results_json/separation_loss_results.json
|
| 51 |
+
288027d2aee72c4493909db18aed87172acc5858e72c40c85b5cb2e21a9e230b experiments/separation_loss_ablation/tables/separation_loss_table.tex
|
| 52 |
+
dbb86d9641b596aacfd13cb556e4aafcb96acde80d337d93b7d302fc993fb60c experiments/timestep_strategy/figures/error_vs_timestep.png
|
| 53 |
+
5931e3b4e6bb84ef99dbb15d8a2a42d37c1a716eeff57c06afe950c3f82578b2 experiments/timestep_strategy/figures/timestep_strategy_comparison.png
|
| 54 |
+
d4ec076286bfd36ba24736dd46ff1eea92b97cd328b70b3e96991d77c92619ae experiments/timestep_strategy/results_json/timestep_strategy_results.json
|
| 55 |
+
6706e8d4edb6db3a0d5c5e7f4cc51a0192ee619cc02bd96042805940c329be3f experiments/timestep_strategy/tables/timestep_strategy_table.tex
|
| 56 |
+
e9d220b0b22d564b4ba6de67723082a5828b96c8bf29d8020a1d3236336713bc missing_checkpoints.md
|
| 57 |
+
791ffac33b2ad634a718320f11a79ddee96ff96b3851ca5233785e053a2f7a57 models/remote_true/main_training/seed123_best_auroc0.9886.ckpt
|
| 58 |
+
305ff58724d0254339a20c7c3ad7e02270b018f2022d7f84afde6ccd73a70ec2 models/remote_true/main_training/seed42_best_auroc0.9873.ckpt
|
| 59 |
+
42ae28da8d69b84440c0362758b0e069954cc278706ad2aec3c892a254889af2 models/remote_true/main_training/seed456_best_auroc0.9887.ckpt
|
| 60 |
+
30200a9a0eec6730bd1b775ad388f8508189278d843343ea53612e33e8606d34 models/remote_true/separation_loss_ablation/sep_loss_0.02_seed456_best_auroc0.9904_ckpt_thesis_auroc0.9903.ckpt
|
| 61 |
+
7e8fc670fa049fe8d74ae0bf4df58c9ab2fc3ea8a22e50e09383136647588539 models/remote_true/separation_loss_ablation/sep_loss_lambda_0p001_2026-02-21_22-03-43_sep_0.001_epoch19_auroc0.9732.ckpt
|
| 62 |
+
5e29012954032dd8c558f67bcf04cfcbd7f2e38398e2737bcbd1c34ea75e16d7 models/remote_true/separation_loss_ablation/sep_loss_lambda_0p01_2026-02-23_18-52-30_sep_0.01_epoch19_auroc0.9869.ckpt
|
| 63 |
+
318a2132b7f934f654ae61d48ee38f71622f750e12118d21c72f4079d99729c6 models/remote_true/separation_loss_ablation/sep_loss_lambda_0p02_2026-02-24_22-57-58_sep_0.02_epoch29_auroc0.9911.ckpt
|
| 64 |
+
64b03548868182d03d44ad675c2648bc39b685a3dbe0a0141f7175c69a6e7239 models/remote_true/separation_loss_ablation/sep_loss_lambda_0p02_seed123_sep_0.02_seed123__2026-02-26_09-43-10_sep_0.02_seed123_epoch29_auroc0.9840.ckpt
|
| 65 |
+
882dbcb4833887158f74db1a650068dee1c8c07c1a584318d6b6080a3f3d9c30 models/remote_true/separation_loss_ablation/sep_loss_lambda_0p02_seed123_sep_0.02_seed123__2026-02-26_22-32-35_sep_0.02_seed123_epoch39_auroc0.9895.ckpt
|
| 66 |
+
6d007ec7a4c0030dcf36c6e6ce828b975c961f87dca05b62f0de83ec148433fc models/remote_true/separation_loss_ablation/sep_loss_lambda_0p05_2026-02-22_14-33-44_sep_0.05_epoch19_auroc0.9851.ckpt
|
| 67 |
+
7bdee5c15900a7a4db13085afb05dce5dd9540cf6e282f692b2824bd6641421d models/remote_true/separation_loss_ablation/sep_loss_lambda_0p05_2026-02-23_02-04-16_sep_0.05_epoch19_auroc0.9851.ckpt
|
| 68 |
+
59230ec1bae56c934d6c3fe03e6e07eb7db56af6a11dca2cb4adc78d435b6085 models/remote_true/separation_loss_ablation/sep_loss_lambda_0p0_2026-02-19_06-56-35_sep_0.0_epoch19_auroc0.9781.ckpt
|
| 69 |
+
f8d92995b708316ceacb5c62f2261bb6bbdc6b0ba13ea9b8c4e4a7c7b9c5c2b9 models/remote_true/separation_loss_ablation/sep_loss_lambda_0p0_2026-02-20_16-33-09_sep_0.0_epoch29_auroc0.9648.ckpt
|
| 70 |
+
ca6cb487d94c1d376d4cf98d74cd5a4491ddefbbbe32c47203cd35f91b93eee6 models/remote_true/separation_loss_ablation/sep_loss_lambda_0p0_2026-02-21_05-04-31_sep_0.0_epoch79_auroc0.8025.ckpt
|
| 71 |
+
e483f3be193ac7a96b0dd2a8888891b6cac7a67ad9dbe7cf6ff7abeafae8d49b models/remote_true/separation_loss_ablation/sep_loss_lambda_0p1_2026-02-22_14-36-51_sep_0.1_epoch149_auroc0.9667.ckpt
|
| 72 |
+
7dcb69acb6fc84cfa54bfe0b501ab42b261d12548fcc064af0eb1888b2c00fef models/remote_true/separation_loss_ablation/sep_loss_lambda_0p1_2026-02-24_06-00-19_sep_0.1_epoch09_auroc0.8397.ckpt
|
| 73 |
+
2e4d6237fbcad74deede88ba0c4d16ad05a7851e1a806020fd0c10fe25804b83 models/remote_true/separation_loss_ablation/separation_loss_ablation_models.csv
|
| 74 |
+
eb04102a85991698e1f62619853557640040f980e285fc1fc19e5e7f76761563 README.md
|
dataset_sources.md
ADDED
|
@@ -0,0 +1,10 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Dataset Sources
|
| 2 |
+
|
| 3 |
+
- CIFAR-10: torchvision dataset, in-distribution class airplane versus non-airplane proxy OOD split.
|
| 4 |
+
- CIFAR-100: torchvision external OOD.
|
| 5 |
+
- SVHN: torchvision SVHN, format 2 cropped.
|
| 6 |
+
- FashionMNIST: torchvision, resized to 32 x 32 and converted to RGB.
|
| 7 |
+
- Places365: external OOD scene dataset.
|
| 8 |
+
- Textures/DTD: Describable Textures Dataset.
|
| 9 |
+
|
| 10 |
+
The GitHub package contains the evaluation scripts and expected preprocessing logic. Public datasets should be downloaded from their canonical sources during reproduction.
|
experiments/external_ood/raw_scores/raw_scores_remote_inventory.csv
ADDED
|
@@ -0,0 +1,26 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
remote_path,local_path,bytes,sha256
|
| 2 |
+
/system/user/studentwork/mohammed/2025/diffusion_classifier_ood/results/raw_scores/seed123_cifar100_scores.pt,D:\side_hustle\thesis\draft02\reproducibility\cifar10_cdm\huggingface\raw_scores\seed123_cifar100_scores.pt,41324,eea96e85415d707344682bc9740402ef7536ad20cdfab4f15d18e4ad7169fbc3
|
| 3 |
+
/system/user/studentwork/mohammed/2025/diffusion_classifier_ood/results/raw_scores/seed123_cifar10_id_scores.pt,D:\side_hustle\thesis\draft02\reproducibility\cifar10_cdm\huggingface\raw_scores\seed123_cifar10_id_scores.pt,5302,fe6e549a6882414c135e31cb587fe0fa96c1ce8d1499929f26e54fb0f574e2ff
|
| 4 |
+
/system/user/studentwork/mohammed/2025/diffusion_classifier_ood/results/raw_scores/seed123_cifar10_ood_scores.pt,D:\side_hustle\thesis\draft02\reproducibility\cifar10_cdm\huggingface\raw_scores\seed123_cifar10_ood_scores.pt,37307,5db6e8d654d19a04903a63a028bf3eee04cbfb2ad11388e38008ed79c779c540
|
| 5 |
+
/system/user/studentwork/mohammed/2025/diffusion_classifier_ood/results/raw_scores/seed123_fashionmnist_scores.pt,D:\side_hustle\thesis\draft02\reproducibility\cifar10_cdm\huggingface\raw_scores\seed123_fashionmnist_scores.pt,41344,c36a3aaa549d85e0d051bffd39aaa41f3becd1c5a77d256440cc6cec85eca94a
|
| 6 |
+
/system/user/studentwork/mohammed/2025/diffusion_classifier_ood/results/raw_scores/seed123_food101_scores.pt,D:\side_hustle\thesis\draft02\reproducibility\cifar10_cdm\huggingface\raw_scores\seed123_food101_scores.pt,21287,efea6c9959a2e1eb8c8f45ec805640e2e9788e3f1335adf2c5f8ffd87456406f
|
| 7 |
+
/system/user/studentwork/mohammed/2025/diffusion_classifier_ood/results/raw_scores/seed123_stl10_scores.pt,D:\side_hustle\thesis\draft02\reproducibility\cifar10_cdm\huggingface\raw_scores\seed123_stl10_scores.pt,21213,99f782f861fd1967d3114512f3609567d462c82a3bf94fa50b06e84b9fe8ba37
|
| 8 |
+
/system/user/studentwork/mohammed/2025/diffusion_classifier_ood/results/raw_scores/seed123_svhn_scores.pt,D:\side_hustle\thesis\draft02\reproducibility\cifar10_cdm\huggingface\raw_scores\seed123_svhn_scores.pt,105368,18467a14e7aa7acb41c6867dac363dc8c01d45aa9f8049e4f7e86f3b0af37c43
|
| 9 |
+
/system/user/studentwork/mohammed/2025/diffusion_classifier_ood/results/raw_scores/seed123_textures_scores.pt,D:\side_hustle\thesis\draft02\reproducibility\cifar10_cdm\huggingface\raw_scores\seed123_textures_scores.pt,8812,3348acbae4bac9d891c40e7f87584ca2003e8185f55a2db31589a11bc7202e6a
|
| 10 |
+
/system/user/studentwork/mohammed/2025/diffusion_classifier_ood/results/raw_scores/seed42_cifar100_scores.pt,D:\side_hustle\thesis\draft02\reproducibility\cifar10_cdm\huggingface\raw_scores\seed42_cifar100_scores.pt,41319,01da976c1ef147ce098120dc72dca4309b039d3deb0582312f19f450a6b9b923
|
| 11 |
+
/system/user/studentwork/mohammed/2025/diffusion_classifier_ood/results/raw_scores/seed42_cifar10_id_scores.pt,D:\side_hustle\thesis\draft02\reproducibility\cifar10_cdm\huggingface\raw_scores\seed42_cifar10_id_scores.pt,5297,f45329e41b35cfb442143379ebdc9d96f488a5f04776ee3d0b4243dec458a757
|
| 12 |
+
/system/user/studentwork/mohammed/2025/diffusion_classifier_ood/results/raw_scores/seed42_cifar10_ood_scores.pt,D:\side_hustle\thesis\draft02\reproducibility\cifar10_cdm\huggingface\raw_scores\seed42_cifar10_ood_scores.pt,37302,64599a919c1dc17d4633ad6024d29d9e6f549fbf491420c9dedae234240e1d39
|
| 13 |
+
/system/user/studentwork/mohammed/2025/diffusion_classifier_ood/results/raw_scores/seed42_fashionmnist_scores.pt,D:\side_hustle\thesis\draft02\reproducibility\cifar10_cdm\huggingface\raw_scores\seed42_fashionmnist_scores.pt,41339,e2595689d4c135e9968f99117b83739f5805eb520e19378caf6800d7ac1cb037
|
| 14 |
+
/system/user/studentwork/mohammed/2025/diffusion_classifier_ood/results/raw_scores/seed42_food101_scores.pt,D:\side_hustle\thesis\draft02\reproducibility\cifar10_cdm\huggingface\raw_scores\seed42_food101_scores.pt,21218,f7c37c628db9b479196923024de79410d3a5bcf15419698657237df36b2beb1b
|
| 15 |
+
/system/user/studentwork/mohammed/2025/diffusion_classifier_ood/results/raw_scores/seed42_places365_scores.pt,D:\side_hustle\thesis\draft02\reproducibility\cifar10_cdm\huggingface\raw_scores\seed42_places365_scores.pt,41324,fa05e2f8e7c80f1dcf3f056aedf5f319e4fb6b87e54ccbd9c6c10326ddab271c
|
| 16 |
+
/system/user/studentwork/mohammed/2025/diffusion_classifier_ood/results/raw_scores/seed42_stl10_scores.pt,D:\side_hustle\thesis\draft02\reproducibility\cifar10_cdm\huggingface\raw_scores\seed42_stl10_scores.pt,21208,63bc986fe2d1750424b3d161056b4deb448580a3665c0265070728173142adad
|
| 17 |
+
/system/user/studentwork/mohammed/2025/diffusion_classifier_ood/results/raw_scores/seed42_svhn_scores.pt,D:\side_hustle\thesis\draft02\reproducibility\cifar10_cdm\huggingface\raw_scores\seed42_svhn_scores.pt,105363,1d4b841177293ab8ba149b22d031c8af7e79938dcbaf798d4546c396fffba50f
|
| 18 |
+
/system/user/studentwork/mohammed/2025/diffusion_classifier_ood/results/raw_scores/seed42_textures_scores.pt,D:\side_hustle\thesis\draft02\reproducibility\cifar10_cdm\huggingface\raw_scores\seed42_textures_scores.pt,8807,8b5a2cf6d56c7c4ee7ee1db6f0a169ec8af01adaa2d65a0fa24430f3dd9f5d38
|
| 19 |
+
/system/user/studentwork/mohammed/2025/diffusion_classifier_ood/results/raw_scores/seed456_cifar100_scores.pt,D:\side_hustle\thesis\draft02\reproducibility\cifar10_cdm\huggingface\raw_scores\seed456_cifar100_scores.pt,41324,6f5eff496e89464f01af6dac0a09e9b9ea4c2333cec255654bc9a72c9acc7ba6
|
| 20 |
+
/system/user/studentwork/mohammed/2025/diffusion_classifier_ood/results/raw_scores/seed456_cifar10_id_scores.pt,D:\side_hustle\thesis\draft02\reproducibility\cifar10_cdm\huggingface\raw_scores\seed456_cifar10_id_scores.pt,5302,eca890ba2edb578cd2a1f6549295f4212e7287c180e02e8477f751845f7cd579
|
| 21 |
+
/system/user/studentwork/mohammed/2025/diffusion_classifier_ood/results/raw_scores/seed456_cifar10_ood_scores.pt,D:\side_hustle\thesis\draft02\reproducibility\cifar10_cdm\huggingface\raw_scores\seed456_cifar10_ood_scores.pt,37307,3d464ff0c432a15cb6c32fce045b7f2088f91ba6a080ff2d4b27a6bb73dea089
|
| 22 |
+
/system/user/studentwork/mohammed/2025/diffusion_classifier_ood/results/raw_scores/seed456_fashionmnist_scores.pt,D:\side_hustle\thesis\draft02\reproducibility\cifar10_cdm\huggingface\raw_scores\seed456_fashionmnist_scores.pt,41344,089afd7bc9661058659d07869e2c1400bbce7366df49d4507390d2852fd6692e
|
| 23 |
+
/system/user/studentwork/mohammed/2025/diffusion_classifier_ood/results/raw_scores/seed456_food101_scores.pt,D:\side_hustle\thesis\draft02\reproducibility\cifar10_cdm\huggingface\raw_scores\seed456_food101_scores.pt,21287,5905ea30ce29afc2b3eea511585a3f5e1cc95d1df3a1150fedada9c17f23e545
|
| 24 |
+
/system/user/studentwork/mohammed/2025/diffusion_classifier_ood/results/raw_scores/seed456_stl10_scores.pt,D:\side_hustle\thesis\draft02\reproducibility\cifar10_cdm\huggingface\raw_scores\seed456_stl10_scores.pt,21213,6ebfbb38187ca20426cbdaa3547f81aa5e4d3830a69c6e623d8a06bfe82fbf8f
|
| 25 |
+
/system/user/studentwork/mohammed/2025/diffusion_classifier_ood/results/raw_scores/seed456_svhn_scores.pt,D:\side_hustle\thesis\draft02\reproducibility\cifar10_cdm\huggingface\raw_scores\seed456_svhn_scores.pt,105368,bbe9b31182ed334606cc8156122ad6f4da2459e90961d7f1c60ae58e271e8107
|
| 26 |
+
/system/user/studentwork/mohammed/2025/diffusion_classifier_ood/results/raw_scores/seed456_textures_scores.pt,D:\side_hustle\thesis\draft02\reproducibility\cifar10_cdm\huggingface\raw_scores\seed456_textures_scores.pt,8812,711b930fb46112f7a5dcfb236947140f0970f65f24524f3bfe80fe25ecdd5adc
|
experiments/external_ood/results_json/external_ood_results.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{}
|
experiments/external_ood/tables/external_ood_table.tex
ADDED
|
@@ -0,0 +1,20 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
\begin{table}[htbp]
|
| 2 |
+
\centering
|
| 3 |
+
\caption{External OOD Detection Results ($\lambda=0.01$, K=100, Seed 42). The binary CDM is trained only on CIFAR-10 Airplane (ID) and evaluated against 7 OOD sources of increasing difficulty.}
|
| 4 |
+
\label{tab:external_ood}
|
| 5 |
+
\begin{tabular}{@{}lcc@{}}
|
| 6 |
+
\toprule
|
| 7 |
+
\textbf{OOD Dataset} & \textbf{AUROC} & \textbf{Relative to Within-CIFAR} \\
|
| 8 |
+
\midrule
|
| 9 |
+
Food-101 & 0.9897 & +0.15\% \\
|
| 10 |
+
Within-CIFAR & 0.9882 & --- \\
|
| 11 |
+
CIFAR-100 & 0.9580 & $-$3.02\% \\
|
| 12 |
+
STL-10 & 0.9426 & $-$4.56\% \\
|
| 13 |
+
FashionMNIST & 0.9392 & $-$4.90\% \\
|
| 14 |
+
SVHN & 0.9275 & $-$6.07\% \\
|
| 15 |
+
Textures & 0.9133 & $-$7.49\% \\
|
| 16 |
+
\midrule
|
| 17 |
+
\textbf{Mean} & \textbf{0.9512} & --- \\
|
| 18 |
+
\bottomrule
|
| 19 |
+
\end{tabular}
|
| 20 |
+
\end{table}
|
experiments/k_ablation/results_json/k_ablation_results.json
ADDED
|
@@ -0,0 +1,47 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"within_cifar": {
|
| 3 |
+
"K_1": {
|
| 4 |
+
"auroc": 0.9099963333333333,
|
| 5 |
+
"fpr95": 0.408,
|
| 6 |
+
"aupr": 0.9877430518385415,
|
| 7 |
+
"time_seconds": 97.9178569316864,
|
| 8 |
+
"time_per_sample": 0.00979178569316864
|
| 9 |
+
},
|
| 10 |
+
"K_5": {
|
| 11 |
+
"auroc": 0.9723531666666667,
|
| 12 |
+
"fpr95": 0.143,
|
| 13 |
+
"aupr": 0.9965687036233508,
|
| 14 |
+
"time_seconds": 486.27918767929077,
|
| 15 |
+
"time_per_sample": 0.04862791876792908
|
| 16 |
+
},
|
| 17 |
+
"K_10": {
|
| 18 |
+
"auroc": 0.9818831111111112,
|
| 19 |
+
"fpr95": 0.094,
|
| 20 |
+
"aupr": 0.9977866960333261,
|
| 21 |
+
"time_seconds": 972.8749701976776,
|
| 22 |
+
"time_per_sample": 0.09728749701976776
|
| 23 |
+
},
|
| 24 |
+
"K_25": {
|
| 25 |
+
"auroc": 0.9852172222222222,
|
| 26 |
+
"fpr95": 0.073,
|
| 27 |
+
"aupr": 0.9982216447717311,
|
| 28 |
+
"time_seconds": 2431.8085684776306,
|
| 29 |
+
"time_per_sample": 0.24318085684776305
|
| 30 |
+
},
|
| 31 |
+
"K_50": {
|
| 32 |
+
"auroc": 0.9863586666666667,
|
| 33 |
+
"fpr95": 0.066,
|
| 34 |
+
"aupr": 0.998352408323816,
|
| 35 |
+
"time_seconds": 4861.0760996341705,
|
| 36 |
+
"time_per_sample": 0.48610760996341706
|
| 37 |
+
},
|
| 38 |
+
"K_100": {
|
| 39 |
+
"auroc": 0.986868,
|
| 40 |
+
"fpr95": 0.066,
|
| 41 |
+
"aupr": 0.9983996289418777,
|
| 42 |
+
"time_seconds": 9723.567284822464,
|
| 43 |
+
"time_per_sample": 0.9723567284822464
|
| 44 |
+
}
|
| 45 |
+
},
|
| 46 |
+
"svhn": {}
|
| 47 |
+
}
|
experiments/k_ablation/tables/k_ablation_table.tex
ADDED
|
@@ -0,0 +1,21 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
% K-Ablation Table (num_trials)
|
| 2 |
+
% Generated by scripts/generate_all_figures_tables.py
|
| 3 |
+
\begin{table}[htbp]
|
| 4 |
+
\centering
|
| 5 |
+
\caption{Effect of number of Monte Carlo trials $K$ on OOD scoring.
|
| 6 |
+
Evaluated on CIFAR-10 binary test set using seed-42 checkpoint.
|
| 7 |
+
Diminishing returns beyond $K=25$; $K=15$ used during training.}
|
| 8 |
+
\label{tab:k-ablation}
|
| 9 |
+
\begin{tabular}{lccc}
|
| 10 |
+
\toprule
|
| 11 |
+
$K$ (trials) & AUROC (\%)$\uparrow$ & FPR@95\%TPR$\downarrow$ & Time (s) \\
|
| 12 |
+
\midrule
|
| 13 |
+
1 & 91.00 & 40.8 & 97.9 \\
|
| 14 |
+
5 & 97.24 & 14.3 & 486.3 \\
|
| 15 |
+
10 & 98.19 & 9.4 & 972.9 \\
|
| 16 |
+
25 & \textbf{98.52} & \textbf{7.3} & 2431.8 \\
|
| 17 |
+
50 & \textbf{98.64} & \textbf{6.6} & 4861.1 \\
|
| 18 |
+
100 & \textbf{98.69} & \textbf{6.6} & 9723.6 \\
|
| 19 |
+
\bottomrule
|
| 20 |
+
\end{tabular}
|
| 21 |
+
\end{table}
|
experiments/main_training/figures/confusion_matrix.png
ADDED
|
experiments/main_training/figures/three_seed_auroc.png
ADDED
|
experiments/main_training/tables/main_results_table.tex
ADDED
|
@@ -0,0 +1,24 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
% Main Results Table — CDM Binary OOD Detection
|
| 2 |
+
% Generated by scripts/generate_all_figures_tables.py
|
| 3 |
+
\begin{table}[htbp]
|
| 4 |
+
\centering
|
| 5 |
+
\caption{Binary CDM OOD detection performance (AUROC, FPR@95\%TPR).
|
| 6 |
+
Within-dataset result is mean $\pm$ std over 3 seeds (42/123/456).
|
| 7 |
+
External OOD is mean $\pm$ std evaluated on the seed-42 checkpoint
|
| 8 |
+
(K=100 MC trials, difference scoring).}
|
| 9 |
+
\label{tab:main-results}
|
| 10 |
+
\begin{tabular}{lccc}
|
| 11 |
+
\toprule
|
| 12 |
+
OOD Dataset & AUROC (\%)$\uparrow$ & FPR95 (\%)$\downarrow$ & AUPR$\uparrow$ \\
|
| 13 |
+
\midrule
|
| 14 |
+
CIFAR-10 (Airplane vs Others) & 98.82 $\pm$ 0.06 & — & — \\
|
| 15 |
+
SVHN & — & — & — \\
|
| 16 |
+
CIFAR-100 & — & — & — \\
|
| 17 |
+
Textures (DTD) & — & — & — \\
|
| 18 |
+
FashionMNIST & — & — & — \\
|
| 19 |
+
STL-10 & — & — & — \\
|
| 20 |
+
Food-101 & — & — & — \\
|
| 21 |
+
Places365 & — & — & — \\
|
| 22 |
+
\bottomrule
|
| 23 |
+
\end{tabular}
|
| 24 |
+
\end{table}
|
experiments/scoring_method/figures/scoring_method_comparison.png
ADDED
|
experiments/scoring_method/figures/scoring_methods_full.png
ADDED
|
experiments/scoring_method/results_json/scoring_method_results.json
ADDED
|
@@ -0,0 +1,36 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"within_cifar": {
|
| 3 |
+
"difference": {
|
| 4 |
+
"auroc": 0.9869498333333332,
|
| 5 |
+
"fpr95": 0.063,
|
| 6 |
+
"aupr": 0.9984283144808994
|
| 7 |
+
},
|
| 8 |
+
"ratio": {
|
| 9 |
+
"auroc": 0.9862080555555556,
|
| 10 |
+
"fpr95": 0.066,
|
| 11 |
+
"aupr": 0.9982978617155271
|
| 12 |
+
},
|
| 13 |
+
"id_error": {
|
| 14 |
+
"auroc": 0.7830467777777776,
|
| 15 |
+
"fpr95": 0.67,
|
| 16 |
+
"aupr": 0.9653815554396192
|
| 17 |
+
}
|
| 18 |
+
},
|
| 19 |
+
"svhn": {
|
| 20 |
+
"difference": {
|
| 21 |
+
"auroc": 0.9413390058389677,
|
| 22 |
+
"fpr95": 0.196,
|
| 23 |
+
"aupr": 0.9966887629225921
|
| 24 |
+
},
|
| 25 |
+
"ratio": {
|
| 26 |
+
"auroc": 0.9606347572218807,
|
| 27 |
+
"fpr95": 0.225,
|
| 28 |
+
"aupr": 0.9983185536493355
|
| 29 |
+
},
|
| 30 |
+
"id_error": {
|
| 31 |
+
"auroc": 0.2023230831284573,
|
| 32 |
+
"fpr95": 0.965,
|
| 33 |
+
"aupr": 0.908071538261028
|
| 34 |
+
}
|
| 35 |
+
}
|
| 36 |
+
}
|
experiments/scoring_method/tables/scoring_method_table.tex
ADDED
|
@@ -0,0 +1,20 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
% Scoring Method Comparison Table
|
| 2 |
+
% Generated by scripts/generate_all_figures_tables.py
|
| 3 |
+
\begin{table}[htbp]
|
| 4 |
+
\centering
|
| 5 |
+
\caption{Comparison of OOD scoring methods (seed-42 checkpoint, K=50 trials).
|
| 6 |
+
\texttt{difference} and \texttt{ratio} perform similarly within CIFAR-10;
|
| 7 |
+
\texttt{ratio} marginally better on external SVHN OOD.
|
| 8 |
+
\texttt{id\_error} (ID-only scoring without class conditioning) is much worse,
|
| 9 |
+
confirming binary conditioning is essential.}
|
| 10 |
+
\label{tab:scoring-methods}
|
| 11 |
+
\begin{tabular}{lccc}
|
| 12 |
+
\toprule
|
| 13 |
+
Scoring Method & CIFAR AUROC (\%)$\uparrow$ & CIFAR FPR95 (\%)$\downarrow$ & SVHN AUROC (\%)$\uparrow$ \\
|
| 14 |
+
\midrule
|
| 15 |
+
\texttt{difference} & \textbf{98.69} & 6.3 & 94.1 \\
|
| 16 |
+
\texttt{ratio} & 98.62 & 6.6 & \textbf{96.1} \\
|
| 17 |
+
\texttt{id\_error} & 78.30 & 67.0 & 20.2 \\
|
| 18 |
+
\bottomrule
|
| 19 |
+
\end{tabular}
|
| 20 |
+
\end{table}
|
experiments/separation_loss_ablation/figures/separation_loss_ablation.png
ADDED
|
experiments/separation_loss_ablation/figures/separation_loss_ablation_final.png
ADDED
|
Git LFS Details
|
experiments/separation_loss_ablation/results_json/separation_loss_results.json
ADDED
|
@@ -0,0 +1,21 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"weights": [
|
| 3 |
+
0.0,
|
| 4 |
+
0.001,
|
| 5 |
+
0.01,
|
| 6 |
+
0.05,
|
| 7 |
+
0.1
|
| 8 |
+
],
|
| 9 |
+
"within_cifar": {
|
| 10 |
+
"0.01": {
|
| 11 |
+
"auroc": 0.9865895000000001,
|
| 12 |
+
"fpr95": 0.064
|
| 13 |
+
}
|
| 14 |
+
},
|
| 15 |
+
"svhn": {
|
| 16 |
+
"0.01": {
|
| 17 |
+
"auroc": 0.8943492240319606,
|
| 18 |
+
"fpr95": 0.285
|
| 19 |
+
}
|
| 20 |
+
}
|
| 21 |
+
}
|
experiments/separation_loss_ablation/tables/separation_loss_table.tex
ADDED
|
@@ -0,0 +1,24 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
% Separation Loss Ablation Table
|
| 2 |
+
% Generated by scripts/generate_all_figures_tables.py
|
| 3 |
+
% Note: SVHN cols only populated for lambda=0.01 (from scoring_method_results.json).
|
| 4 |
+
% Full external OOD evaluation pending completion.
|
| 5 |
+
\begin{table}[htbp]
|
| 6 |
+
\centering
|
| 7 |
+
\caption{Effect of separation loss weight $\lambda$ on CIFAR-10 OOD detection
|
| 8 |
+
(seed=42, K=15 MC trials during training, K=100 for CIFAR final AUROC).
|
| 9 |
+
Best epoch reports early stopping result.
|
| 10 |
+
SVHN column only available for $\lambda=0.01$ (see ablation script).}
|
| 11 |
+
\label{tab:separation-loss}
|
| 12 |
+
\begin{tabular}{lcccc}
|
| 13 |
+
\toprule
|
| 14 |
+
$\lambda$ & CIFAR AUROC (\%) & Best Epoch & SVHN AUROC (\%) & SVHN FPR95 (\%) \\
|
| 15 |
+
\midrule
|
| 16 |
+
0.0 & 80.25 & 79 & — & — \\
|
| 17 |
+
0.001 & 97.32 & 19 & — & — \\
|
| 18 |
+
0.01 & 98.69 & 19 & 94.1 & 28.5 \\
|
| 19 |
+
0.02 & \textbf{99.11} & 29 & — & — \\ % \textbf{Best AUROC}
|
| 20 |
+
0.05 & 98.51 & 19 & — & — \\
|
| 21 |
+
0.1 & 96.67 & 149 & — & — \\
|
| 22 |
+
\bottomrule
|
| 23 |
+
\end{tabular}
|
| 24 |
+
\end{table}
|
experiments/timestep_strategy/figures/error_vs_timestep.png
ADDED
|
Git LFS Details
|
experiments/timestep_strategy/figures/timestep_strategy_comparison.png
ADDED
|
Git LFS Details
|
experiments/timestep_strategy/results_json/timestep_strategy_results.json
ADDED
|
@@ -0,0 +1,367 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"within_cifar": {
|
| 3 |
+
"uniform": {
|
| 4 |
+
"auroc": 0.9886852222222222,
|
| 5 |
+
"fpr95": 0.054,
|
| 6 |
+
"aupr": 0.9986370983243654
|
| 7 |
+
},
|
| 8 |
+
"mid_focus": {
|
| 9 |
+
"auroc": 0.9854892222222222,
|
| 10 |
+
"fpr95": 0.076,
|
| 11 |
+
"aupr": 0.9982258725401427
|
| 12 |
+
},
|
| 13 |
+
"stratified": {
|
| 14 |
+
"auroc": 0.9881399444444445,
|
| 15 |
+
"fpr95": 0.059,
|
| 16 |
+
"aupr": 0.9985863517967093
|
| 17 |
+
}
|
| 18 |
+
},
|
| 19 |
+
"svhn": {
|
| 20 |
+
"uniform": {
|
| 21 |
+
"auroc": 0.9543605562384757,
|
| 22 |
+
"fpr95": 0.146,
|
| 23 |
+
"aupr": 0.9974213022601522
|
| 24 |
+
},
|
| 25 |
+
"mid_focus": {
|
| 26 |
+
"auroc": 0.9380184004302397,
|
| 27 |
+
"fpr95": 0.197,
|
| 28 |
+
"aupr": 0.996371581168088
|
| 29 |
+
},
|
| 30 |
+
"stratified": {
|
| 31 |
+
"auroc": 0.9498002650583898,
|
| 32 |
+
"fpr95": 0.163,
|
| 33 |
+
"aupr": 0.9972195075319602
|
| 34 |
+
}
|
| 35 |
+
},
|
| 36 |
+
"per_timestep": {
|
| 37 |
+
"timesteps": [
|
| 38 |
+
50,
|
| 39 |
+
100,
|
| 40 |
+
150,
|
| 41 |
+
200,
|
| 42 |
+
250,
|
| 43 |
+
300,
|
| 44 |
+
350,
|
| 45 |
+
400,
|
| 46 |
+
450,
|
| 47 |
+
500,
|
| 48 |
+
550,
|
| 49 |
+
600,
|
| 50 |
+
650,
|
| 51 |
+
700,
|
| 52 |
+
750,
|
| 53 |
+
800,
|
| 54 |
+
850,
|
| 55 |
+
900,
|
| 56 |
+
950
|
| 57 |
+
],
|
| 58 |
+
"id": {
|
| 59 |
+
"c0_t50": {
|
| 60 |
+
"mean": 0.16123446822166443,
|
| 61 |
+
"std": 0.05786355584859848
|
| 62 |
+
},
|
| 63 |
+
"c0_t100": {
|
| 64 |
+
"mean": 0.10442730039358139,
|
| 65 |
+
"std": 0.03873381391167641
|
| 66 |
+
},
|
| 67 |
+
"c0_t150": {
|
| 68 |
+
"mean": 0.0775127112865448,
|
| 69 |
+
"std": 0.02978641912341118
|
| 70 |
+
},
|
| 71 |
+
"c0_t200": {
|
| 72 |
+
"mean": 0.06270774453878403,
|
| 73 |
+
"std": 0.024262018501758575
|
| 74 |
+
},
|
| 75 |
+
"c0_t250": {
|
| 76 |
+
"mean": 0.05240098759531975,
|
| 77 |
+
"std": 0.02019326575100422
|
| 78 |
+
},
|
| 79 |
+
"c0_t300": {
|
| 80 |
+
"mean": 0.04459163546562195,
|
| 81 |
+
"std": 0.01662287674844265
|
| 82 |
+
},
|
| 83 |
+
"c0_t350": {
|
| 84 |
+
"mean": 0.03879544511437416,
|
| 85 |
+
"std": 0.014503664337098598
|
| 86 |
+
},
|
| 87 |
+
"c0_t400": {
|
| 88 |
+
"mean": 0.033743977546691895,
|
| 89 |
+
"std": 0.01320528332144022
|
| 90 |
+
},
|
| 91 |
+
"c0_t450": {
|
| 92 |
+
"mean": 0.029082385823130608,
|
| 93 |
+
"std": 0.010959829203784466
|
| 94 |
+
},
|
| 95 |
+
"c0_t500": {
|
| 96 |
+
"mean": 0.026250595226883888,
|
| 97 |
+
"std": 0.009717644192278385
|
| 98 |
+
},
|
| 99 |
+
"c0_t550": {
|
| 100 |
+
"mean": 0.022424820810556412,
|
| 101 |
+
"std": 0.008256726898252964
|
| 102 |
+
},
|
| 103 |
+
"c0_t600": {
|
| 104 |
+
"mean": 0.019210368394851685,
|
| 105 |
+
"std": 0.006838190834969282
|
| 106 |
+
},
|
| 107 |
+
"c0_t650": {
|
| 108 |
+
"mean": 0.01615460403263569,
|
| 109 |
+
"std": 0.006200442556291819
|
| 110 |
+
},
|
| 111 |
+
"c0_t700": {
|
| 112 |
+
"mean": 0.013310677371919155,
|
| 113 |
+
"std": 0.005098859779536724
|
| 114 |
+
},
|
| 115 |
+
"c0_t750": {
|
| 116 |
+
"mean": 0.010465993545949459,
|
| 117 |
+
"std": 0.0037172066513448954
|
| 118 |
+
},
|
| 119 |
+
"c0_t800": {
|
| 120 |
+
"mean": 0.008377683348953724,
|
| 121 |
+
"std": 0.0031924911309033632
|
| 122 |
+
},
|
| 123 |
+
"c0_t850": {
|
| 124 |
+
"mean": 0.005653513129800558,
|
| 125 |
+
"std": 0.002224632538855076
|
| 126 |
+
},
|
| 127 |
+
"c0_t900": {
|
| 128 |
+
"mean": 0.003275742521509528,
|
| 129 |
+
"std": 0.0013118572533130646
|
| 130 |
+
},
|
| 131 |
+
"c0_t950": {
|
| 132 |
+
"mean": 0.0013495800085365772,
|
| 133 |
+
"std": 0.0005494702490977943
|
| 134 |
+
},
|
| 135 |
+
"c1_t50": {
|
| 136 |
+
"mean": 0.1606561243534088,
|
| 137 |
+
"std": 0.05567626282572746
|
| 138 |
+
},
|
| 139 |
+
"c1_t100": {
|
| 140 |
+
"mean": 0.10685943067073822,
|
| 141 |
+
"std": 0.03887505829334259
|
| 142 |
+
},
|
| 143 |
+
"c1_t150": {
|
| 144 |
+
"mean": 0.07943448424339294,
|
| 145 |
+
"std": 0.029171813279390335
|
| 146 |
+
},
|
| 147 |
+
"c1_t200": {
|
| 148 |
+
"mean": 0.06453787535429001,
|
| 149 |
+
"std": 0.023446492850780487
|
| 150 |
+
},
|
| 151 |
+
"c1_t250": {
|
| 152 |
+
"mean": 0.05437518656253815,
|
| 153 |
+
"std": 0.0198157150298357
|
| 154 |
+
},
|
| 155 |
+
"c1_t300": {
|
| 156 |
+
"mean": 0.04662742465734482,
|
| 157 |
+
"std": 0.01747937500476837
|
| 158 |
+
},
|
| 159 |
+
"c1_t350": {
|
| 160 |
+
"mean": 0.040038056671619415,
|
| 161 |
+
"std": 0.014310726895928383
|
| 162 |
+
},
|
| 163 |
+
"c1_t400": {
|
| 164 |
+
"mean": 0.034622400999069214,
|
| 165 |
+
"std": 0.012737436220049858
|
| 166 |
+
},
|
| 167 |
+
"c1_t450": {
|
| 168 |
+
"mean": 0.030930055305361748,
|
| 169 |
+
"std": 0.012175540439784527
|
| 170 |
+
},
|
| 171 |
+
"c1_t500": {
|
| 172 |
+
"mean": 0.02622835338115692,
|
| 173 |
+
"std": 0.00925239734351635
|
| 174 |
+
},
|
| 175 |
+
"c1_t550": {
|
| 176 |
+
"mean": 0.02286655828356743,
|
| 177 |
+
"std": 0.008599987253546715
|
| 178 |
+
},
|
| 179 |
+
"c1_t600": {
|
| 180 |
+
"mean": 0.019960874691605568,
|
| 181 |
+
"std": 0.007759998086839914
|
| 182 |
+
},
|
| 183 |
+
"c1_t650": {
|
| 184 |
+
"mean": 0.017022253945469856,
|
| 185 |
+
"std": 0.006253428291529417
|
| 186 |
+
},
|
| 187 |
+
"c1_t700": {
|
| 188 |
+
"mean": 0.013848936185240746,
|
| 189 |
+
"std": 0.005125450901687145
|
| 190 |
+
},
|
| 191 |
+
"c1_t750": {
|
| 192 |
+
"mean": 0.010915481485426426,
|
| 193 |
+
"std": 0.003997159190475941
|
| 194 |
+
},
|
| 195 |
+
"c1_t800": {
|
| 196 |
+
"mean": 0.008292279206216335,
|
| 197 |
+
"std": 0.0029704829212278128
|
| 198 |
+
},
|
| 199 |
+
"c1_t850": {
|
| 200 |
+
"mean": 0.0059583126567304134,
|
| 201 |
+
"std": 0.002324610250070691
|
| 202 |
+
},
|
| 203 |
+
"c1_t900": {
|
| 204 |
+
"mean": 0.0035888850688934326,
|
| 205 |
+
"std": 0.0013977768830955029
|
| 206 |
+
},
|
| 207 |
+
"c1_t950": {
|
| 208 |
+
"mean": 0.001462708692997694,
|
| 209 |
+
"std": 0.00044951261952519417
|
| 210 |
+
}
|
| 211 |
+
},
|
| 212 |
+
"ood": {
|
| 213 |
+
"c0_t50": {
|
| 214 |
+
"mean": 0.22906392812728882,
|
| 215 |
+
"std": 0.06499648094177246
|
| 216 |
+
},
|
| 217 |
+
"c0_t100": {
|
| 218 |
+
"mean": 0.15222781896591187,
|
| 219 |
+
"std": 0.04274160414934158
|
| 220 |
+
},
|
| 221 |
+
"c0_t150": {
|
| 222 |
+
"mean": 0.11631786823272705,
|
| 223 |
+
"std": 0.03303564339876175
|
| 224 |
+
},
|
| 225 |
+
"c0_t200": {
|
| 226 |
+
"mean": 0.09286506474018097,
|
| 227 |
+
"std": 0.026360269635915756
|
| 228 |
+
},
|
| 229 |
+
"c0_t250": {
|
| 230 |
+
"mean": 0.07722136378288269,
|
| 231 |
+
"std": 0.022630464285612106
|
| 232 |
+
},
|
| 233 |
+
"c0_t300": {
|
| 234 |
+
"mean": 0.06502427160739899,
|
| 235 |
+
"std": 0.0195158738642931
|
| 236 |
+
},
|
| 237 |
+
"c0_t350": {
|
| 238 |
+
"mean": 0.05567947402596474,
|
| 239 |
+
"std": 0.016512945294380188
|
| 240 |
+
},
|
| 241 |
+
"c0_t400": {
|
| 242 |
+
"mean": 0.04731416702270508,
|
| 243 |
+
"std": 0.013769409619271755
|
| 244 |
+
},
|
| 245 |
+
"c0_t450": {
|
| 246 |
+
"mean": 0.04148917272686958,
|
| 247 |
+
"std": 0.012854596599936485
|
| 248 |
+
},
|
| 249 |
+
"c0_t500": {
|
| 250 |
+
"mean": 0.034694258123636246,
|
| 251 |
+
"std": 0.010574056766927242
|
| 252 |
+
},
|
| 253 |
+
"c0_t550": {
|
| 254 |
+
"mean": 0.03002982586622238,
|
| 255 |
+
"std": 0.009448406286537647
|
| 256 |
+
},
|
| 257 |
+
"c0_t600": {
|
| 258 |
+
"mean": 0.025195691734552383,
|
| 259 |
+
"std": 0.007569901645183563
|
| 260 |
+
},
|
| 261 |
+
"c0_t650": {
|
| 262 |
+
"mean": 0.020711131393909454,
|
| 263 |
+
"std": 0.007039411459118128
|
| 264 |
+
},
|
| 265 |
+
"c0_t700": {
|
| 266 |
+
"mean": 0.016733329743146896,
|
| 267 |
+
"std": 0.00529054319486022
|
| 268 |
+
},
|
| 269 |
+
"c0_t750": {
|
| 270 |
+
"mean": 0.013030176982283592,
|
| 271 |
+
"std": 0.004108891822397709
|
| 272 |
+
},
|
| 273 |
+
"c0_t800": {
|
| 274 |
+
"mean": 0.009448970668017864,
|
| 275 |
+
"std": 0.0030608815141022205
|
| 276 |
+
},
|
| 277 |
+
"c0_t850": {
|
| 278 |
+
"mean": 0.00628605717793107,
|
| 279 |
+
"std": 0.002177068032324314
|
| 280 |
+
},
|
| 281 |
+
"c0_t900": {
|
| 282 |
+
"mean": 0.003598423209041357,
|
| 283 |
+
"std": 0.0012530161766335368
|
| 284 |
+
},
|
| 285 |
+
"c0_t950": {
|
| 286 |
+
"mean": 0.0013986843405291438,
|
| 287 |
+
"std": 0.0004934321623295546
|
| 288 |
+
},
|
| 289 |
+
"c1_t50": {
|
| 290 |
+
"mean": 0.22520293295383453,
|
| 291 |
+
"std": 0.06432735174894333
|
| 292 |
+
},
|
| 293 |
+
"c1_t100": {
|
| 294 |
+
"mean": 0.1499990075826645,
|
| 295 |
+
"std": 0.04188496619462967
|
| 296 |
+
},
|
| 297 |
+
"c1_t150": {
|
| 298 |
+
"mean": 0.11321725696325302,
|
| 299 |
+
"std": 0.03249520808458328
|
| 300 |
+
},
|
| 301 |
+
"c1_t200": {
|
| 302 |
+
"mean": 0.08936502039432526,
|
| 303 |
+
"std": 0.025120839476585388
|
| 304 |
+
},
|
| 305 |
+
"c1_t250": {
|
| 306 |
+
"mean": 0.07322543114423752,
|
| 307 |
+
"std": 0.021838413551449776
|
| 308 |
+
},
|
| 309 |
+
"c1_t300": {
|
| 310 |
+
"mean": 0.06204748898744583,
|
| 311 |
+
"std": 0.018268465995788574
|
| 312 |
+
},
|
| 313 |
+
"c1_t350": {
|
| 314 |
+
"mean": 0.05241883546113968,
|
| 315 |
+
"std": 0.01606724224984646
|
| 316 |
+
},
|
| 317 |
+
"c1_t400": {
|
| 318 |
+
"mean": 0.0449826605618,
|
| 319 |
+
"std": 0.01481825951486826
|
| 320 |
+
},
|
| 321 |
+
"c1_t450": {
|
| 322 |
+
"mean": 0.03945695608854294,
|
| 323 |
+
"std": 0.012820725329220295
|
| 324 |
+
},
|
| 325 |
+
"c1_t500": {
|
| 326 |
+
"mean": 0.0332314670085907,
|
| 327 |
+
"std": 0.010059903375804424
|
| 328 |
+
},
|
| 329 |
+
"c1_t550": {
|
| 330 |
+
"mean": 0.02762959897518158,
|
| 331 |
+
"std": 0.009240682236850262
|
| 332 |
+
},
|
| 333 |
+
"c1_t600": {
|
| 334 |
+
"mean": 0.023351749405264854,
|
| 335 |
+
"std": 0.007416155654937029
|
| 336 |
+
},
|
| 337 |
+
"c1_t650": {
|
| 338 |
+
"mean": 0.0198295246809721,
|
| 339 |
+
"std": 0.006654239259660244
|
| 340 |
+
},
|
| 341 |
+
"c1_t700": {
|
| 342 |
+
"mean": 0.015598704107105732,
|
| 343 |
+
"std": 0.00491707818582654
|
| 344 |
+
},
|
| 345 |
+
"c1_t750": {
|
| 346 |
+
"mean": 0.01249911542981863,
|
| 347 |
+
"std": 0.004252676852047443
|
| 348 |
+
},
|
| 349 |
+
"c1_t800": {
|
| 350 |
+
"mean": 0.009655343368649483,
|
| 351 |
+
"std": 0.0032796640880405903
|
| 352 |
+
},
|
| 353 |
+
"c1_t850": {
|
| 354 |
+
"mean": 0.00628657266497612,
|
| 355 |
+
"std": 0.0020485452841967344
|
| 356 |
+
},
|
| 357 |
+
"c1_t900": {
|
| 358 |
+
"mean": 0.003460217034444213,
|
| 359 |
+
"std": 0.0012720918748527765
|
| 360 |
+
},
|
| 361 |
+
"c1_t950": {
|
| 362 |
+
"mean": 0.001465486828237772,
|
| 363 |
+
"std": 0.0005407508579082787
|
| 364 |
+
}
|
| 365 |
+
}
|
| 366 |
+
}
|
| 367 |
+
}
|
experiments/timestep_strategy/tables/timestep_strategy_table.tex
ADDED
|
@@ -0,0 +1,15 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
% Timestep Strategy Table
|
| 2 |
+
\begin{table}[htbp]
|
| 3 |
+
\centering
|
| 4 |
+
\caption{Comparison of timestep sampling strategies.}
|
| 5 |
+
\label{tab:timestep-strategy}
|
| 6 |
+
\begin{tabular}{lccc}
|
| 7 |
+
\toprule
|
| 8 |
+
Strategy & CIFAR AUROC (\%) & SVHN AUROC (\%) \\
|
| 9 |
+
\midrule
|
| 10 |
+
Uniform & 98.9 & 95.4 \\
|
| 11 |
+
Mid Focus & 98.5 & 93.8 \\
|
| 12 |
+
Stratified & 98.8 & 95.0 \\
|
| 13 |
+
\bottomrule
|
| 14 |
+
\end{tabular}
|
| 15 |
+
\end{table}
|
manifest.csv
ADDED
|
@@ -0,0 +1,75 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
path,bytes,sha256
|
| 2 |
+
dataset_sources.md,543,94bd424b0dffdd61783b0593d9fdf677abc7fdaaf4f89babab6303f29315c9c8
|
| 3 |
+
experiments/external_ood/raw_scores/raw_scores_remote_inventory.csv,7274,24edb189e279970cd95ac5e6e02709eaa068fdec7f4a5fd0d95cb5947237559e
|
| 4 |
+
experiments/external_ood/raw_scores/seed123_cifar100_scores.pt,41324,eea96e85415d707344682bc9740402ef7536ad20cdfab4f15d18e4ad7169fbc3
|
| 5 |
+
experiments/external_ood/raw_scores/seed123_cifar10_id_scores.pt,5302,fe6e549a6882414c135e31cb587fe0fa96c1ce8d1499929f26e54fb0f574e2ff
|
| 6 |
+
experiments/external_ood/raw_scores/seed123_cifar10_ood_scores.pt,37307,5db6e8d654d19a04903a63a028bf3eee04cbfb2ad11388e38008ed79c779c540
|
| 7 |
+
experiments/external_ood/raw_scores/seed123_fashionmnist_scores.pt,41344,c36a3aaa549d85e0d051bffd39aaa41f3becd1c5a77d256440cc6cec85eca94a
|
| 8 |
+
experiments/external_ood/raw_scores/seed123_food101_scores.pt,21287,efea6c9959a2e1eb8c8f45ec805640e2e9788e3f1335adf2c5f8ffd87456406f
|
| 9 |
+
experiments/external_ood/raw_scores/seed123_stl10_scores.pt,21213,99f782f861fd1967d3114512f3609567d462c82a3bf94fa50b06e84b9fe8ba37
|
| 10 |
+
experiments/external_ood/raw_scores/seed123_svhn_scores.pt,105368,18467a14e7aa7acb41c6867dac363dc8c01d45aa9f8049e4f7e86f3b0af37c43
|
| 11 |
+
experiments/external_ood/raw_scores/seed123_textures_scores.pt,8812,3348acbae4bac9d891c40e7f87584ca2003e8185f55a2db31589a11bc7202e6a
|
| 12 |
+
experiments/external_ood/raw_scores/seed42_cifar100_scores.pt,41319,01da976c1ef147ce098120dc72dca4309b039d3deb0582312f19f450a6b9b923
|
| 13 |
+
experiments/external_ood/raw_scores/seed42_cifar10_id_scores.pt,5297,f45329e41b35cfb442143379ebdc9d96f488a5f04776ee3d0b4243dec458a757
|
| 14 |
+
experiments/external_ood/raw_scores/seed42_cifar10_ood_scores.pt,37302,64599a919c1dc17d4633ad6024d29d9e6f549fbf491420c9dedae234240e1d39
|
| 15 |
+
experiments/external_ood/raw_scores/seed42_fashionmnist_scores.pt,41339,e2595689d4c135e9968f99117b83739f5805eb520e19378caf6800d7ac1cb037
|
| 16 |
+
experiments/external_ood/raw_scores/seed42_food101_scores.pt,21218,f7c37c628db9b479196923024de79410d3a5bcf15419698657237df36b2beb1b
|
| 17 |
+
experiments/external_ood/raw_scores/seed42_places365_scores.pt,41324,fa05e2f8e7c80f1dcf3f056aedf5f319e4fb6b87e54ccbd9c6c10326ddab271c
|
| 18 |
+
experiments/external_ood/raw_scores/seed42_stl10_scores.pt,21208,63bc986fe2d1750424b3d161056b4deb448580a3665c0265070728173142adad
|
| 19 |
+
experiments/external_ood/raw_scores/seed42_svhn_scores.pt,105363,1d4b841177293ab8ba149b22d031c8af7e79938dcbaf798d4546c396fffba50f
|
| 20 |
+
experiments/external_ood/raw_scores/seed42_textures_scores.pt,8807,8b5a2cf6d56c7c4ee7ee1db6f0a169ec8af01adaa2d65a0fa24430f3dd9f5d38
|
| 21 |
+
experiments/external_ood/raw_scores/seed456_cifar100_scores.pt,41324,6f5eff496e89464f01af6dac0a09e9b9ea4c2333cec255654bc9a72c9acc7ba6
|
| 22 |
+
experiments/external_ood/raw_scores/seed456_cifar10_id_scores.pt,5302,eca890ba2edb578cd2a1f6549295f4212e7287c180e02e8477f751845f7cd579
|
| 23 |
+
experiments/external_ood/raw_scores/seed456_cifar10_ood_scores.pt,37307,3d464ff0c432a15cb6c32fce045b7f2088f91ba6a080ff2d4b27a6bb73dea089
|
| 24 |
+
experiments/external_ood/raw_scores/seed456_fashionmnist_scores.pt,41344,089afd7bc9661058659d07869e2c1400bbce7366df49d4507390d2852fd6692e
|
| 25 |
+
experiments/external_ood/raw_scores/seed456_food101_scores.pt,21287,5905ea30ce29afc2b3eea511585a3f5e1cc95d1df3a1150fedada9c17f23e545
|
| 26 |
+
experiments/external_ood/raw_scores/seed456_stl10_scores.pt,21213,6ebfbb38187ca20426cbdaa3547f81aa5e4d3830a69c6e623d8a06bfe82fbf8f
|
| 27 |
+
experiments/external_ood/raw_scores/seed456_svhn_scores.pt,105368,bbe9b31182ed334606cc8156122ad6f4da2459e90961d7f1c60ae58e271e8107
|
| 28 |
+
experiments/external_ood/raw_scores/seed456_textures_scores.pt,8812,711b930fb46112f7a5dcfb236947140f0970f65f24524f3bfe80fe25ecdd5adc
|
| 29 |
+
experiments/external_ood/results_json/external_ood_results.json,2,44136fa355b3678a1146ad16f7e8649e94fb4fc21fe77e8310c060f61caaff8a
|
| 30 |
+
experiments/external_ood/tables/external_ood_table.tex,742,5ca1db6bdaf482963ef0fe870c0ac658430166ea323f98d5d4396384fb7815b7
|
| 31 |
+
experiments/k_ablation/figures/k_ablation.png,126167,dd6a6d029a7b6e24d12cfb4c01d0b279f8170f6ac1abf2a93d06adb143be037a
|
| 32 |
+
experiments/k_ablation/results_json/k_ablation_results.json,1217,de1233a80f4884990cb8e26199cb9045ce983d445d1412525fcde04ccc09348d
|
| 33 |
+
experiments/k_ablation/tables/k_ablation_table.tex,842,452b9391922d95550512e83359e699d6a1cc4a62c0be75220fdbe347794bd7cd
|
| 34 |
+
experiments/main_training/figures/calibration_curves.png,141264,5b147b2037cd3c01ea0df4a5a207a815eec966ef50cff9b673e61ed56f71b9b6
|
| 35 |
+
experiments/main_training/figures/confusion_matrix.png,78998,c5f6fe6eeed8a320d3920d590de92ba42f9069cec328170678b60d21fbd0ba94
|
| 36 |
+
experiments/main_training/figures/per_class_performance.png,162036,7709d10b29f9bdf00eb996d5e1fc73d628b43dd765cb103d0fc4eb10d98c9465
|
| 37 |
+
experiments/main_training/figures/roc_curves_cifar10.png,181333,319619262a6386632c67e6e55c5f49220c73ba3278b17cc067ed5e03d6aefb1f
|
| 38 |
+
experiments/main_training/figures/score_distributions.png,229117,93a3552bddfe6dcf7e93e4ee7059bd00b791af7579b6fcf5803327677ebe1f99
|
| 39 |
+
experiments/main_training/figures/score_distributions_all.png,468037,c38c43e9308fb7206eda29fbaa41cf1a66bfc4f9c8b3072f84eb5877f241b427
|
| 40 |
+
experiments/main_training/figures/three_seed_auroc.png,64055,50f96dfd443b95060c4aa444d1846e0b6ce1cc3655558442bd9304396cd88099
|
| 41 |
+
experiments/main_training/figures/training_curves.png,214652,5f7834a313dc74778c202922da35aec4a65323baf455c40345389e0c179addf1
|
| 42 |
+
experiments/main_training/tables/main_results_table.tex,995,cff71f40235d7ea6e6f348b8ed7c40404d72fbae3cd6eb1509920fc2b5459cee
|
| 43 |
+
experiments/scoring_method/figures/scoring_method_comparison.png,90004,f0a02d1dde9dd5fdc5bf45cdb17ff7fa0772093ea4cd917dbaa251b4ad276268
|
| 44 |
+
experiments/scoring_method/figures/scoring_methods_full.png,85703,d4a2b5e497467e04e3044fcfd39cf0d4740ca62b65df2a913f4413c1ff902586
|
| 45 |
+
experiments/scoring_method/results_json/scoring_method_results.json,728,23b5d33e0dda98829b7d451bade41ee79f247c7bedf2730406fb46f0ea9a2c17
|
| 46 |
+
experiments/scoring_method/tables/scoring_method_table.tex,936,cb2a2e16208af9fad5847b03cd4cfc757ebf897457196bd72798d7e4ef54fdfc
|
| 47 |
+
experiments/separation_loss_ablation/figures/sep_loss_dual.png,115468,821da978cc9a33c27cc553dfb604d4acdfcd01b48052d4db781350c1e33ad9b2
|
| 48 |
+
experiments/separation_loss_ablation/figures/separation_loss_ablation.png,90207,ac1dd26568bd55e07d36d24851c3b53b5ef25bf3a05c1940d60faee9489a98ff
|
| 49 |
+
experiments/separation_loss_ablation/figures/separation_loss_ablation_final.png,107127,98bf9835ea7128b6d713cec915473e9b1a2e655e365bc6cf9120ceeae49b9b8e
|
| 50 |
+
experiments/separation_loss_ablation/figures/separation_loss_ablation_updated.png,100459,e45576da94da72317429cdfee8f82426ec5f57747def9ecd98840b63d6bc83e8
|
| 51 |
+
experiments/separation_loss_ablation/results_json/separation_loss_results.json,264,38f6d1492b523c65546396366080188c44b2b237f93b6d64d72414cb7c7666b2
|
| 52 |
+
experiments/separation_loss_ablation/tables/separation_loss_table.tex,1080,288027d2aee72c4493909db18aed87172acc5858e72c40c85b5cb2e21a9e230b
|
| 53 |
+
experiments/timestep_strategy/figures/error_vs_timestep.png,284649,dbb86d9641b596aacfd13cb556e4aafcb96acde80d337d93b7d302fc993fb60c
|
| 54 |
+
experiments/timestep_strategy/figures/timestep_strategy_comparison.png,103511,5931e3b4e6bb84ef99dbb15d8a2a42d37c1a716eeff57c06afe950c3f82578b2
|
| 55 |
+
experiments/timestep_strategy/results_json/timestep_strategy_results.json,8722,d4ec076286bfd36ba24736dd46ff1eea92b97cd328b70b3e96991d77c92619ae
|
| 56 |
+
experiments/timestep_strategy/tables/timestep_strategy_table.tex,423,6706e8d4edb6db3a0d5c5e7f4cc51a0192ee619cc02bd96042805940c329be3f
|
| 57 |
+
missing_checkpoints.md,1742,e9d220b0b22d564b4ba6de67723082a5828b96c8bf29d8020a1d3236336713bc
|
| 58 |
+
models/remote_true/main_training/seed123_best_auroc0.9886.ckpt,825944028,791ffac33b2ad634a718320f11a79ddee96ff96b3851ca5233785e053a2f7a57
|
| 59 |
+
models/remote_true/main_training/seed42_best_auroc0.9873.ckpt,825944028,305ff58724d0254339a20c7c3ad7e02270b018f2022d7f84afde6ccd73a70ec2
|
| 60 |
+
models/remote_true/main_training/seed456_best_auroc0.9887.ckpt,825944028,42ae28da8d69b84440c0362758b0e069954cc278706ad2aec3c892a254889af2
|
| 61 |
+
models/remote_true/separation_loss_ablation/sep_loss_0.02_seed456_best_auroc0.9904_ckpt_thesis_auroc0.9903.ckpt,825944156,30200a9a0eec6730bd1b775ad388f8508189278d843343ea53612e33e8606d34
|
| 62 |
+
models/remote_true/separation_loss_ablation/sep_loss_lambda_0p001_2026-02-21_22-03-43_sep_0.001_epoch19_auroc0.9732.ckpt,825944092,7e8fc670fa049fe8d74ae0bf4df58c9ab2fc3ea8a22e50e09383136647588539
|
| 63 |
+
models/remote_true/separation_loss_ablation/sep_loss_lambda_0p01_2026-02-23_18-52-30_sep_0.01_epoch19_auroc0.9869.ckpt,825944028,5e29012954032dd8c558f67bcf04cfcbd7f2e38398e2737bcbd1c34ea75e16d7
|
| 64 |
+
models/remote_true/separation_loss_ablation/sep_loss_lambda_0p02_2026-02-24_22-57-58_sep_0.02_epoch29_auroc0.9911.ckpt,825944028,318a2132b7f934f654ae61d48ee38f71622f750e12118d21c72f4079d99729c6
|
| 65 |
+
models/remote_true/separation_loss_ablation/sep_loss_lambda_0p02_seed123_sep_0.02_seed123__2026-02-26_09-43-10_sep_0.02_seed123_epoch29_auroc0.9840.ckpt,825944156,64b03548868182d03d44ad675c2648bc39b685a3dbe0a0141f7175c69a6e7239
|
| 66 |
+
models/remote_true/separation_loss_ablation/sep_loss_lambda_0p02_seed123_sep_0.02_seed123__2026-02-26_22-32-35_sep_0.02_seed123_epoch39_auroc0.9895.ckpt,825944156,882dbcb4833887158f74db1a650068dee1c8c07c1a584318d6b6080a3f3d9c30
|
| 67 |
+
models/remote_true/separation_loss_ablation/sep_loss_lambda_0p05_2026-02-22_14-33-44_sep_0.05_epoch19_auroc0.9851.ckpt,825944028,6d007ec7a4c0030dcf36c6e6ce828b975c961f87dca05b62f0de83ec148433fc
|
| 68 |
+
models/remote_true/separation_loss_ablation/sep_loss_lambda_0p05_2026-02-23_02-04-16_sep_0.05_epoch19_auroc0.9851.ckpt,825944028,7bdee5c15900a7a4db13085afb05dce5dd9540cf6e282f692b2824bd6641421d
|
| 69 |
+
models/remote_true/separation_loss_ablation/sep_loss_lambda_0p0_2026-02-19_06-56-35_sep_0.0_epoch19_auroc0.9781.ckpt,825944028,59230ec1bae56c934d6c3fe03e6e07eb7db56af6a11dca2cb4adc78d435b6085
|
| 70 |
+
models/remote_true/separation_loss_ablation/sep_loss_lambda_0p0_2026-02-20_16-33-09_sep_0.0_epoch29_auroc0.9648.ckpt,825947740,f8d92995b708316ceacb5c62f2261bb6bbdc6b0ba13ea9b8c4e4a7c7b9c5c2b9
|
| 71 |
+
models/remote_true/separation_loss_ablation/sep_loss_lambda_0p0_2026-02-21_05-04-31_sep_0.0_epoch79_auroc0.8025.ckpt,825947612,ca6cb487d94c1d376d4cf98d74cd5a4491ddefbbbe32c47203cd35f91b93eee6
|
| 72 |
+
models/remote_true/separation_loss_ablation/sep_loss_lambda_0p1_2026-02-22_14-36-51_sep_0.1_epoch149_auroc0.9667.ckpt,825944092,e483f3be193ac7a96b0dd2a8888891b6cac7a67ad9dbe7cf6ff7abeafae8d49b
|
| 73 |
+
models/remote_true/separation_loss_ablation/sep_loss_lambda_0p1_2026-02-24_06-00-19_sep_0.1_epoch09_auroc0.8397.ckpt,825943900,7dcb69acb6fc84cfa54bfe0b501ab42b261d12548fcc064af0eb1888b2c00fef
|
| 74 |
+
models/remote_true/separation_loss_ablation/separation_loss_ablation_models.csv,4393,2e4d6237fbcad74deede88ba0c4d16ad05a7851e1a806020fd0c10fe25804b83
|
| 75 |
+
README.md,1127,eb04102a85991698e1f62619853557640040f980e285fc1fc19e5e7f76761563
|
missing_checkpoints.md
ADDED
|
@@ -0,0 +1,20 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Missing CIFAR-10 Thesis Checkpoints
|
| 2 |
+
|
| 3 |
+
The final thesis documentation references checkpoints on old NFS paths that are not present under `D:\side_hustle\thesis\draft02\ssh00`. They are not substituted with similarly named local files.
|
| 4 |
+
|
| 5 |
+
## Main Training, lambda=0.01
|
| 6 |
+
| Seed | AUROC | Best Epoch | Original Path |
|
| 7 |
+
|---|---:|---:|---|
|
| 8 |
+
| 42 | 0.9873 | 19 | `/system/user/studentwork/mohammed/2025/diffusion_classifier_ood/results/seed42/2026-02-17_18-18-51_seed42/` |
|
| 9 |
+
| 123 | 0.9886 | 19 | `/system/user/studentwork/mohammed/2025/diffusion_classifier_ood/results/seed123/2026-02-19_06-55-43_seed123/` |
|
| 10 |
+
| 456 | 0.9887 | 19 | `/system/user/studentwork/mohammed/2025/diffusion_classifier_ood/results/seed456/2026-02-19_06-56-23_seed456/` |
|
| 11 |
+
|
| 12 |
+
## Separation-Loss Ablation, seed=42
|
| 13 |
+
| Lambda | AUROC | Best Epoch | Original Path |
|
| 14 |
+
|---:|---:|---:|---|
|
| 15 |
+
| 0.0 | 0.8025 | 79 | `/system/user/studentwork/mohammed/2025/diffusion_classifier_ood/results/sep_loss_ablation/2026-02-21_05-04-31_sep_0.0/` |
|
| 16 |
+
| 0.001 | 0.9732 | 19 | `/system/user/studentwork/mohammed/2025/diffusion_classifier_ood/results/sep_loss_ablation/2026-02-21_22-03-43_sep_0.001/` |
|
| 17 |
+
| 0.01 | 0.9869 | 19 | `/system/user/studentwork/mohammed/2025/diffusion_classifier_ood/results/sep_loss_ablation/2026-02-23_18-52-30_sep_0.01/` |
|
| 18 |
+
| 0.02 | 0.9911 | 29 | `/system/user/studentwork/mohammed/2025/diffusion_classifier_ood/results/sep_loss_ablation/2026-02-24_22-57-58_sep_0.02/` |
|
| 19 |
+
| 0.05 | 0.9851 | 19 | `/system/user/studentwork/mohammed/2025/diffusion_classifier_ood/results/sep_loss_ablation/2026-02-23_02-04-16_sep_0.05/` |
|
| 20 |
+
| 0.1 | 0.9667 | 149 | `/system/user/studentwork/mohammed/2025/diffusion_classifier_ood/results/sep_loss_ablation/2026-02-24_06-00-19_sep_0.1/` |
|
models/raw_scores/seed123_cifar100_scores.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:eea96e85415d707344682bc9740402ef7536ad20cdfab4f15d18e4ad7169fbc3
|
| 3 |
+
size 41324
|
models/raw_scores/seed123_cifar10_id_scores.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f7392a8857171beb7d6c4704d21c0234d11403b8e1436b347c81094a03ecc087
|
| 3 |
+
size 5302
|
models/raw_scores/seed123_cifar10_ood_scores.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a9a23641d6365e13b0b97aabb2322ab5d5f22e40970530aa3d90256e16be8f25
|
| 3 |
+
size 37307
|
models/raw_scores/seed123_fashionmnist_scores.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c36a3aaa549d85e0d051bffd39aaa41f3becd1c5a77d256440cc6cec85eca94a
|
| 3 |
+
size 41344
|
models/raw_scores/seed123_food101_scores.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:efea6c9959a2e1eb8c8f45ec805640e2e9788e3f1335adf2c5f8ffd87456406f
|
| 3 |
+
size 21287
|
models/raw_scores/seed123_stl10_scores.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:99f782f861fd1967d3114512f3609567d462c82a3bf94fa50b06e84b9fe8ba37
|
| 3 |
+
size 21213
|
models/raw_scores/seed123_svhn_scores.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:18467a14e7aa7acb41c6867dac363dc8c01d45aa9f8049e4f7e86f3b0af37c43
|
| 3 |
+
size 105368
|
models/raw_scores/seed123_textures_scores.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3348acbae4bac9d891c40e7f87584ca2003e8185f55a2db31589a11bc7202e6a
|
| 3 |
+
size 8812
|
models/raw_scores/seed42_cifar100_scores.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:01da976c1ef147ce098120dc72dca4309b039d3deb0582312f19f450a6b9b923
|
| 3 |
+
size 41319
|
models/raw_scores/seed42_cifar10_id_scores.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f45329e41b35cfb442143379ebdc9d96f488a5f04776ee3d0b4243dec458a757
|
| 3 |
+
size 5297
|
models/raw_scores/seed42_cifar10_ood_scores.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:64599a919c1dc17d4633ad6024d29d9e6f549fbf491420c9dedae234240e1d39
|
| 3 |
+
size 37302
|
models/raw_scores/seed42_fashionmnist_scores.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:69bb05b930eaf55bb5e29c8bbe8d93363398fc480be32a497700919a0a488383
|
| 3 |
+
size 41339
|
models/raw_scores/seed42_food101_scores.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f7c37c628db9b479196923024de79410d3a5bcf15419698657237df36b2beb1b
|
| 3 |
+
size 21218
|
models/raw_scores/seed42_places365_scores.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:fa05e2f8e7c80f1dcf3f056aedf5f319e4fb6b87e54ccbd9c6c10326ddab271c
|
| 3 |
+
size 41324
|
models/raw_scores/seed42_stl10_scores.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:63bc986fe2d1750424b3d161056b4deb448580a3665c0265070728173142adad
|
| 3 |
+
size 21208
|
models/raw_scores/seed42_svhn_scores.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1d4b841177293ab8ba149b22d031c8af7e79938dcbaf798d4546c396fffba50f
|
| 3 |
+
size 105363
|
models/raw_scores/seed42_textures_scores.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8b5a2cf6d56c7c4ee7ee1db6f0a169ec8af01adaa2d65a0fa24430f3dd9f5d38
|
| 3 |
+
size 8807
|
models/raw_scores/seed456_cifar100_scores.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6f5eff496e89464f01af6dac0a09e9b9ea4c2333cec255654bc9a72c9acc7ba6
|
| 3 |
+
size 41324
|
models/raw_scores/seed456_cifar10_id_scores.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:eca890ba2edb578cd2a1f6549295f4212e7287c180e02e8477f751845f7cd579
|
| 3 |
+
size 5302
|
models/raw_scores/seed456_cifar10_ood_scores.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3d464ff0c432a15cb6c32fce045b7f2088f91ba6a080ff2d4b27a6bb73dea089
|
| 3 |
+
size 37307
|
models/raw_scores/seed456_fashionmnist_scores.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:089afd7bc9661058659d07869e2c1400bbce7366df49d4507390d2852fd6692e
|
| 3 |
+
size 41344
|
models/raw_scores/seed456_food101_scores.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5905ea30ce29afc2b3eea511585a3f5e1cc95d1df3a1150fedada9c17f23e545
|
| 3 |
+
size 21287
|
models/raw_scores/seed456_stl10_scores.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6ebfbb38187ca20426cbdaa3547f81aa5e4d3830a69c6e623d8a06bfe82fbf8f
|
| 3 |
+
size 21213
|
models/raw_scores/seed456_svhn_scores.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bbe9b31182ed334606cc8156122ad6f4da2459e90961d7f1c60ae58e271e8107
|
| 3 |
+
size 105368
|