mathpluscode commited on
Commit
e0466ed
Β·
1 Parent(s): b54fd81

Move files

Browse files
This view is limited to 50 files because it contains too many changes. Β  See raw diff
Files changed (50) hide show
  1. README.md +45 -65
  2. finetuned/classification_cvd/{acdc_sax_0.safetensors β†’ acdc_sax/acdc_sax_0.safetensors} +0 -0
  3. finetuned/classification_cvd/{acdc_sax_1.safetensors β†’ acdc_sax/acdc_sax_1.safetensors} +0 -0
  4. finetuned/classification_cvd/{acdc_sax_2.safetensors β†’ acdc_sax/acdc_sax_2.safetensors} +0 -0
  5. finetuned/classification_cvd/{acdc_sax.yaml β†’ acdc_sax/config.yaml} +0 -0
  6. finetuned/classification_cvd/{mnms2_lax_4c.yaml β†’ mnms2_lax_4c/config.yaml} +0 -0
  7. finetuned/classification_cvd/{mnms2_lax_4c_0.safetensors β†’ mnms2_lax_4c/mnms2_lax_4c_0.safetensors} +0 -0
  8. finetuned/classification_cvd/{mnms2_lax_4c_1.safetensors β†’ mnms2_lax_4c/mnms2_lax_4c_1.safetensors} +0 -0
  9. finetuned/classification_cvd/{mnms2_lax_4c_2.safetensors β†’ mnms2_lax_4c/mnms2_lax_4c_2.safetensors} +0 -0
  10. finetuned/classification_cvd/{mnms2_sax.yaml β†’ mnms2_sax/config.yaml} +0 -0
  11. finetuned/classification_cvd/{mnms2_sax_0.safetensors β†’ mnms2_sax/mnms2_sax_0.safetensors} +0 -0
  12. finetuned/classification_cvd/{mnms2_sax_1.safetensors β†’ mnms2_sax/mnms2_sax_1.safetensors} +0 -0
  13. finetuned/classification_cvd/{mnms2_sax_2.safetensors β†’ mnms2_sax/mnms2_sax_2.safetensors} +0 -0
  14. finetuned/classification_cvd/{mnms_sax.yaml β†’ mnms_sax/config.yaml} +0 -0
  15. finetuned/classification_cvd/{mnms_sax_0.safetensors β†’ mnms_sax/mnms_sax_0.safetensors} +0 -0
  16. finetuned/classification_cvd/{mnms_sax_1.safetensors β†’ mnms_sax/mnms_sax_1.safetensors} +0 -0
  17. finetuned/classification_cvd/{mnms_sax_2.safetensors β†’ mnms_sax/mnms_sax_2.safetensors} +0 -0
  18. finetuned/classification_sex/{mnms_sax.yaml β†’ mnms_sax/config.yaml} +0 -0
  19. finetuned/classification_sex/{mnms_sax_0.safetensors β†’ mnms_sax/mnms_sax_0.safetensors} +0 -0
  20. finetuned/classification_sex/{mnms_sax_1.safetensors β†’ mnms_sax/mnms_sax_1.safetensors} +0 -0
  21. finetuned/classification_sex/{mnms_sax_2.safetensors β†’ mnms_sax/mnms_sax_2.safetensors} +0 -0
  22. finetuned/classification_vendor/{mnms2_lax_4c.yaml β†’ mnms2_lax_4c/config.yaml} +0 -0
  23. finetuned/classification_vendor/{mnms2_lax_4c_0.safetensors β†’ mnms2_lax_4c/mnms2_lax_4c_0.safetensors} +0 -0
  24. finetuned/classification_vendor/{mnms2_lax_4c_1.safetensors β†’ mnms2_lax_4c/mnms2_lax_4c_1.safetensors} +0 -0
  25. finetuned/classification_vendor/{mnms2_lax_4c_2.safetensors β†’ mnms2_lax_4c/mnms2_lax_4c_2.safetensors} +0 -0
  26. finetuned/classification_vendor/{mnms2_sax.yaml β†’ mnms2_sax/config.yaml} +0 -0
  27. finetuned/classification_vendor/{mnms2_sax_0.safetensors β†’ mnms2_sax/mnms2_sax_0.safetensors} +0 -0
  28. finetuned/classification_vendor/{mnms2_sax_1.safetensors β†’ mnms2_sax/mnms2_sax_1.safetensors} +0 -0
  29. finetuned/classification_vendor/{mnms2_sax_2.safetensors β†’ mnms2_sax/mnms2_sax_2.safetensors} +0 -0
  30. finetuned/landmark_coordinate/{lax_2c.yaml β†’ lax_2c/config.yaml} +0 -0
  31. finetuned/landmark_coordinate/{lax_2c_0.safetensors β†’ lax_2c/lax_2c_0.safetensors} +0 -0
  32. finetuned/landmark_coordinate/{lax_2c_1.safetensors β†’ lax_2c/lax_2c_1.safetensors} +0 -0
  33. finetuned/landmark_coordinate/{lax_2c_2.safetensors β†’ lax_2c/lax_2c_2.safetensors} +0 -0
  34. finetuned/landmark_coordinate/{lax_4c.yaml β†’ lax_4c/config.yaml} +0 -0
  35. finetuned/landmark_coordinate/{lax_4c_0.safetensors β†’ lax_4c/lax_4c_0.safetensors} +0 -0
  36. finetuned/landmark_coordinate/{lax_4c_1.safetensors β†’ lax_4c/lax_4c_1.safetensors} +0 -0
  37. finetuned/landmark_coordinate/{lax_4c_2.safetensors β†’ lax_4c/lax_4c_2.safetensors} +0 -0
  38. finetuned/landmark_heatmap/{lax_2c.yaml β†’ lax_2c/config.yaml} +0 -0
  39. finetuned/landmark_heatmap/{lax_2c_0.safetensors β†’ lax_2c/lax_2c_0.safetensors} +0 -0
  40. finetuned/landmark_heatmap/{lax_2c_1.safetensors β†’ lax_2c/lax_2c_1.safetensors} +0 -0
  41. finetuned/landmark_heatmap/{lax_2c_2.safetensors β†’ lax_2c/lax_2c_2.safetensors} +0 -0
  42. finetuned/landmark_heatmap/{lax_4c.yaml β†’ lax_4c/config.yaml} +0 -0
  43. finetuned/landmark_heatmap/{lax_4c_0.safetensors β†’ lax_4c/lax_4c_0.safetensors} +0 -0
  44. finetuned/landmark_heatmap/{lax_4c_1.safetensors β†’ lax_4c/lax_4c_1.safetensors} +0 -0
  45. finetuned/landmark_heatmap/{lax_4c_2.safetensors β†’ lax_4c/lax_4c_2.safetensors} +0 -0
  46. finetuned/regression_age/{mnms_sax.yaml β†’ mnms_sax/config.yaml} +0 -0
  47. finetuned/regression_age/{mnms_sax_0.safetensors β†’ mnms_sax/mnms_sax_0.safetensors} +0 -0
  48. finetuned/regression_age/{mnms_sax_1.safetensors β†’ mnms_sax/mnms_sax_1.safetensors} +0 -0
  49. finetuned/regression_age/{mnms_sax_2.safetensors β†’ mnms_sax/mnms_sax_2.safetensors} +0 -0
  50. finetuned/regression_bmi/{acdc_sax_0.safetensors β†’ acdc_sax/acdc_sax_0.safetensors} +0 -0
README.md CHANGED
@@ -1,90 +1,70 @@
1
  ---
2
  license: mit
3
  language:
4
- - en
5
  datasets:
6
- - mathpluscode/ACDC
7
  tags:
8
- - medical
9
- - cardiac
10
- - MRI
11
- - foundation model
12
- - MAE
13
  ---
14
 
15
  # CineMA - A Foundation Model for Cine Cardiac Magnetic Resonance Images πŸŽ₯πŸ«€
16
 
17
- This repository contains the weights for **CineMA**, a foundation model for **Cine** cardiac magnetic resonance (CMR)
18
- imaging based on **M**asked-**A**utoencoder. The model was pre-trained on over 74,000 pairs of short-axis and long-axis
19
- cine CMR images from the UK Biobank.
 
 
 
 
 
 
20
 
21
- CineMA was evaluated across a diverse range of clinically relevant downstream tasks, including
22
-
23
- - Ventricle and myocardium segmentation
24
- - Cardiovascular disease (CVD) detection and classification
25
- - Patient sex classification
26
- - CMR machine vendor classification
27
- - Ejection fraction (EF) regression
28
- - Patient body mass index (BMI) regression
29
- - Patient age regression
30
- - Mid-ventricular and apical landmark localization
31
-
32
- These tasks were studied across multiple datasets:
33
-
34
- - [ACDC](https://www.creatis.insa-lyon.fr/Challenge/acdc/)
35
- - [M&Ms](https://www.ub.edu/mnms/)
36
- - [M&Ms2](https://www.ub.edu/mnms-2/)
37
- - [Kaggle](https://www.kaggle.com/c/second-annual-data-science-bowl/data)
38
- - [Rescan](https://www.ahajournals.org/doi/full/10.1161/CIRCIMAGING.119.009214)
39
- - [Landmark](https://pubs.rsna.org/doi/10.1148/ryai.2021200197)
40
-
41
- Compared to convolutional neural network baselines such as UNet and ResNet, CineMA demonstrated superior or comparable
42
- performance, especially in sample efficiency and generalization to out-of-distribution data not seen during pretraining
43
- or fine-tuning.
44
-
45
- By releasing the model weights and code for pretraining, fine-tuning, and inference, CineMA aims to lower the barrier to
46
- entry for cardiac imaging research, foster reproducibility, and encourage broader adoption across institutions.
47
-
48
- ➑️ **Manuscript:** [TBD](https://arxiv.org/)
49
 
50
  ➑️ **Code:** [mathpluscode/CineMA](https://github.com/mathpluscode/CineMA)
51
 
52
  ## Fine-tuned CineMA Models
53
 
54
- The filenames of fine-tuned model weights follow the convention of `finetuned/<task>/<data>_<view>_<seed>.safetensors`
55
- where number 0, 1, and 2 correspond to the different training seeds.
 
56
 
57
  Check the "Inference Example" column to see example inference scripts using these trained models.
58
 
59
- | Training Task | Training Data | Input View | Input Timeframes | Model Weights and Configurations | Inference Example |
60
- | ----------------------------------------------- | ------------- | ---------- | ---------------- | -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------ |
61
- | Ventricle and myocardium segmentation | ACDC | SAX | 1 | [finetuned/segmentation/acdc_sax_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/segmentation/acdc_sax_0.safetensors)<br>[finetuned/segmentation/acdc_sax_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/segmentation/acdc_sax_1.safetensors)<br>[finetuned/segmentation/acdc_sax_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/segmentation/acdc_sax_2.safetensors)<br>[finetuned/segmentation/sax.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/segmentation/sax.yaml) | [segmentation_sax.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/segmentation_sax.py) |
62
- | Ventricle and myocardium segmentation | M&Ms | SAX | 1 | [finetuned/segmentation/mnms_sax_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/segmentation/mnms_sax_0.safetensors)<br>[finetuned/segmentation/mnms_sax_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/segmentation/mnms_sax_1.safetensors)<br>[finetuned/segmentation/mnms_sax_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/segmentation/mnms_sax_2.safetensors)<br>[finetuned/segmentation/sax.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/segmentation/sax.yaml) | [segmentation_sax.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/segmentation_sax.py) |
63
- | Ventricle and myocardium segmentation | M&Ms2 | SAX | 1 | [finetuned/segmentation/mnms2_sax_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/segmentation/mnms2_sax_0.safetensors)<br>[finetuned/segmentation/mnms2_sax_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/segmentation/mnms2_sax_1.safetensors)<br>[finetuned/segmentation/mnms2_sax_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/segmentation/mnms2_sax_2.safetensors)<br>[finetuned/segmentation/sax.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/segmentation/sax.yaml) | [segmentation_sax.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/segmentation_sax.py) |
64
- | Ventricle and myocardium segmentation | M&Ms2 | LAX 4C | 1 | [finetuned/segmentation/mnms2_lax_4c_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/segmentation/mnms2_lax_4c_0.safetensors)<br>[finetuned/segmentation/mnms2_lax_4c_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/segmentation/mnms2_lax_4c_1.safetensors)<br>[finetuned/segmentation/mnms2_lax_4c_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/segmentation/mnms2_lax_4c_2.safetensors)<br>[finetuned/segmentation/lax_4c.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/segmentation/lax_4c.yaml) | [segmentation_lax_4c.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/segmentation_lax_4c.py) |
65
- | CVD classification | ACDC | SAX | 2 (ED and ES) | [finetuned/classification_cvd/acdc_sax_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_cvd/acdc_sax_0.safetensors)<br>[finetuned/classification_cvd/acdc_sax_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_cvd/acdc_sax_1.safetensors)<br>[finetuned/classification_cvd/acdc_sax_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_cvd/acdc_sax_2.safetensors)<br>[finetuned/classification_cvd/acdc_sax.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_cvd/acdc_sax.yaml) | [classification_cvd.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/classification_cvd.py) |
66
- | CVD classification | M&Ms | SAX | 2 (ED and ES) | [finetuned/classification_cvd/mnms_sax_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_cvd/mnms_sax_0.safetensors)<br>[finetuned/classification_cvd/mnms_sax_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_cvd/mnms_sax_1.safetensors)<br>[finetuned/classification_cvd/mnms_sax_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_cvd/mnms_sax_2.safetensors)<br>[finetuned/classification_cvd/mnms_sax.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_cvd/mnms_sax.yaml) | [classification_cvd.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/classification_cvd.py) |
67
- | CVD classification | M&Ms2 | SAX | 2 (ED and ES) | [finetuned/classification_cvd/mnms2_sax_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_cvd/mnms2_sax_0.safetensors)<br>[finetuned/classification_cvd/mnms2_sax_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_cvd/mnms2_sax_1.safetensors)<br>[finetuned/classification_cvd/mnms2_sax_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_cvd/mnms2_sax_2.safetensors)<br>[finetuned/classification_cvd/mnms2_sax.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_cvd/mnms2_sax.yaml) | [classification_cvd.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/classification_cvd.py) |
68
- | CVD classification | M&Ms2 | LAX 4C | 2 (ED and ES) | [finetuned/classification_cvd/mnms2_lax_4c_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_cvd/mnms2_lax_4c_0.safetensors)<br>[finetuned/classification_cvd/mnms2_lax_4c_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_cvd/mnms2_lax_4c_1.safetensors)<br>[finetuned/classification_cvd/mnms2_lax_4c_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_cvd/mnms2_lax_4c_2.safetensors)<br>[finetuned/classification_cvd/mnms2_lax_4c.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_cvd/mnms2_lax_4c.yaml) | [classification_cvd.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/classification_cvd.py) |
69
- | Patient sex classification | M&Ms | SAX | 2 (ED and ES) | [finetuned/classification_sex/mnms_sax_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_sex/mnms_sax_0.safetensors)<br>[finetuned/classification_sex/mnms_sax_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_sex/mnms_sax_1.safetensors)<br>[finetuned/classification_sex/mnms_sax_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_sex/mnms_sax_2.safetensors)<br>[finetuned/classification_sex/mnms_sax.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_sex/mnms_sax.yaml) | [classification_sex.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/classification_sex.py) |
70
- | CMR machine vendor classification | M&Ms2 | SAX | 2 (ED and ES) | [finetuned/classification_vendor/mnms2_sax_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_vendor/mnms2_sax_0.safetensors)<br>[finetuned/classification_vendor/mnms2_sax_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_vendor/mnms2_sax_1.safetensors)<br>[finetuned/classification_vendor/mnms2_sax_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_vendor/mnms2_sax_2.safetensors)<br>[finetuned/classification_vendor/mnms2_sax.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_vendor/mnms2_sax.yaml) | [classification_vendor.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/classification_vendor.py) |
71
- | CMR machine vendor classification | M&Ms2 | LAX 4C | 2 (ED and ES) | [finetuned/classification_vendor/mnms2_lax_4c_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_vendor/mnms2_lax_4c_0.safetensors)<br>[finetuned/classification_vendor/mnms2_lax_4c_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_vendor/mnms2_lax_4c_1.safetensors)<br>[finetuned/classification_vendor/mnms2_lax_4c_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_vendor/mnms2_lax_4c_2.safetensors)<br>[finetuned/classification_vendor/mnms2_lax_4c.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_vendor/mnms2_lax_4c.yaml) | [classification_vendor.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/classification_vendor.py) |
72
- | EF regression | ACDC | SAX | 2 (ED and ES) | [finetuned/regression_ef/acdc_sax_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_ef/acdc_sax_0.safetensors)<br>[finetuned/regression_ef/acdc_sax_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_ef/acdc_sax_1.safetensors)<br>[finetuned/regression_ef/acdc_sax_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_ef/acdc_sax_2.safetensors)<br>[finetuned/regression_ef/acdc_sax.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_ef/acdc_sax.yaml) | [regression_ef.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/regression_ef.py) |
73
- | EF regression | M&Ms | SAX | 2 (ED and ES) | [finetuned/regression_ef/mnms_sax_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_ef/mnms_sax_0.safetensors)<br>[finetuned/regression_ef/mnms_sax_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_ef/mnms_sax_1.safetensors)<br>[finetuned/regression_ef/mnms_sax_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_ef/mnms_sax_2.safetensors)<br>[finetuned/regression_ef/mnms_sax.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_ef/mnms_sax.yaml) | [regression_ef.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/regression_ef.py) |
74
- | EF regression | M&Ms2 | SAX | 2 (ED and ES) | [finetuned/regression_ef/mnms2_sax_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_ef/mnms2_sax_0.safetensors)<br>[finetuned/regression_ef/mnms2_sax_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_ef/mnms2_sax_1.safetensors)<br>[finetuned/regression_ef/mnms2_sax_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_ef/mnms2_sax_2.safetensors)<br>[finetuned/regression_ef/mnms2_sax.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_ef/mnms2_sax.yaml) | [regression_ef.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/regression_ef.py) |
75
- | EF regression | M&Ms2 | LAX 4C | 2 (ED and ES) | [finetuned/regression_ef/mnms2_lax_4c_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_ef/mnms2_lax_4c_0.safetensors)<br>[finetuned/regression_ef/mnms2_lax_4c_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_ef/mnms2_lax_4c_1.safetensors)<br>[finetuned/regression_ef/mnms2_lax_4c_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_ef/mnms2_lax_4c_2.safetensors)<br>[finetuned/regression_ef/mnms2_lax_4c.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_ef/mnms2_lax_4c.yaml) | [regression_ef.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/regression_ef.py) |
76
- | Patient BMI regression | ACDC | SAX | 2 (ED and ES) | [finetuned/regression_bmi/acdc_sax_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_bmi/acdc_sax_0.safetensors)<br>[finetuned/regression_bmi/acdc_sax_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_bmi/acdc_sax_1.safetensors)<br>[finetuned/regression_bmi/acdc_sax_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_bmi/acdc_sax_2.safetensors)<br>[finetuned/regression_bmi/acdc_sax.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_bmi/acdc_sax.yaml) | [regression_bmi.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/regression_bmi.py) |
77
- | Patient age regression | M&Ms | SAX | 2 (ED and ES) | [finetuned/regression_age/mnms_sax_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_age/mnms_sax_0.safetensors)<br>[finetuned/regression_age/mnms_sax_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_age/mnms_sax_1.safetensors)<br>[finetuned/regression_age/mnms_sax_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_age/mnms_sax_2.safetensors)<br>[finetuned/regression_age/mnms_sax.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_age/mnms_sax.yaml) | [regression_age.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/regression_age.py) |
78
- | Landmark localization by heatmap regression | Landmark | LAX 2C | 1 | [finetuned/landmark_heatmap/lax_2c_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/landmark_heatmap/lax_2c_0.safetensors)<br>[finetuned/landmark_heatmap/lax_2c_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/landmark_heatmap/lax_2c_1.safetensors)<br>[finetuned/landmark_heatmap/lax_2c_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/landmark_heatmap/lax_2c_2.safetensors)<br>[finetuned/landmark_heatmap/lax_2c.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/landmark_heatmap/lax_2c.yaml) | [landmark_heatmap.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/landmark_heatmap.py) |
79
- | Landmark localization by heatmap regression | Landmark | LAX 4C | 1 | [finetuned/landmark_heatmap/lax_4c_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/landmark_heatmap/lax_4c_0.safetensors)<br>[finetuned/landmark_heatmap/lax_4c_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/landmark_heatmap/lax_4c_1.safetensors)<br>[finetuned/landmark_heatmap/lax_4c_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/landmark_heatmap/lax_4c_2.safetensors)<br>[finetuned/landmark_heatmap/lax_4c.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/landmark_heatmap/lax_4c.yaml) | [landmark_heatmap.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/landmark_heatmap.py) |
80
- | Landmark localization by coordinates regression | Landmark | LAX 2C | 1 | [finetuned/landmark_coordinate/lax_2c_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/landmark_coordinate/lax_2c_0.safetensors)<br>[finetuned/landmark_coordinate/lax_2c_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/landmark_coordinate/lax_2c_1.safetensors)<br>[finetuned/landmark_coordinate/lax_2c_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/landmark_coordinate/lax_2c_2.safetensors)<br>[finetuned/landmark_coordinate/lax_2c.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/landmark_coordinate/lax_2c.yaml) | [landmark_coordinate.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/landmark_coordinate.py) |
81
- | Landmark localization by coordinates regression | Landmark | LAX 4C | 1 | [finetuned/landmark_coordinate/lax_4c_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/landmark_coordinate/lax_4c_0.safetensors)<br>[finetuned/landmark_coordinate/lax_4c_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/landmark_coordinate/lax_4c_1.safetensors)<br>[finetuned/landmark_coordinate/lax_4c_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/landmark_coordinate/lax_4c_2.safetensors)<br>[finetuned/landmark_coordinate/lax_4c.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/landmark_coordinate/lax_4c.yaml) | [landmark_coordinate.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/landmark_coordinate.py) |
82
 
83
  ## Pre-trained CineMA Model
84
 
85
  The pre-trained CineMA model backbone is available at
86
  [pretrained/cinema.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/pretrained/cinema.safetensors) with
87
- configuration [pretrained/cinema.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/pretrained/cinema.yaml).
88
 
89
  Following scripts demonstrated how to fine-tune this backbone using
90
  [a preprocessed version of ACDC dataset](https://huggingface.co/datasets/mathpluscode/ACDC):
@@ -97,4 +77,4 @@ Following scripts demonstrated how to fine-tune this backbone using
97
 
98
  ## Contact
99
 
100
- For questions or collaborations, please contact Yunguan Fu ([email protected]).
 
1
  ---
2
  license: mit
3
  language:
4
+ - en
5
  datasets:
6
+ - mathpluscode/ACDC
7
  tags:
8
+ - medical
9
+ - cardiac
10
+ - MRI
11
+ - foundation model
12
+ - MAE
13
  ---
14
 
15
  # CineMA - A Foundation Model for Cine Cardiac Magnetic Resonance Images πŸŽ₯πŸ«€
16
 
17
+ **CineMA** is a foundation model for **Cine** cardiac magnetic resonance (CMR) imaging based on
18
+ **M**asked-**A**utoencoder. CineMA has been pre-trained on UK Biobank data and fine-tuned on multiple clinically
19
+ relevant tasks such as ventricle and myocaridum segmentation, ejection fraction (EF) regression, cardiovascular disease
20
+ (CVD) detection and classification, and mid-valve plane and apical landmark localization. The model has been evaluated
21
+ on multiple datasets, including [ACDC](https://www.creatis.insa-lyon.fr/Challenge/acdc/),
22
+ [M&Ms](https://www.ub.edu/mnms/), [M&Ms2](https://www.ub.edu/mnms-2/),
23
+ [Kaggle](https://www.kaggle.com/c/second-annual-data-science-bowl/data),
24
+ [Rescan](https://www.ahajournals.org/doi/full/10.1161/CIRCIMAGING.119.009214), and
25
+ [Landmark](https://pubs.rsna.org/doi/10.1148/ryai.2021200197), etc.
26
 
27
+ ➑️ **Manuscript:** Coming soon.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
28
 
29
  ➑️ **Code:** [mathpluscode/CineMA](https://github.com/mathpluscode/CineMA)
30
 
31
  ## Fine-tuned CineMA Models
32
 
33
+ The filenames of fine-tuned model weights follow the convention of
34
+ `finetuned/<task>/<data>_<view>/<data>_<view>_<seed>.safetensors` where number 0, 1, and 2 correspond to the different
35
+ training seeds.
36
 
37
  Check the "Inference Example" column to see example inference scripts using these trained models.
38
 
39
+ | Training Task | Training Data | Input View | Input Timeframes | Model Weights and Configurations | Inference Example |
40
+ | ----------------------------------------------- | ------------- | ---------- | ---------------- | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------ |
41
+ | Ventricle and myocardium segmentation | ACDC | SAX | 1 | [finetuned/segmentation/acdc_sax/acdc_sax_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/segmentation/acdc_sax/acdc_sax_0.safetensors)<br>[finetuned/segmentation/acdc_sax/acdc_sax_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/segmentation/acdc_sax/acdc_sax_1.safetensors)<br>[finetuned/segmentation/acdc_sax/acdc_sax_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/segmentation/acdc_sax/acdc_sax_2.safetensors)<br>[finetuned/segmentation/acdc_sax/config.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/segmentation/acdc_sax/config.yaml) | [segmentation_sax.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/segmentation_sax.py) |
42
+ | Ventricle and myocardium segmentation | M&Ms | SAX | 1 | [finetuned/segmentation/mnms_sax/mnms_sax_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/segmentation/mnms_sax/mnms_sax_0.safetensors)<br>[finetuned/segmentation/mnms_sax/mnms_sax_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/segmentation/mnms_sax/mnms_sax_1.safetensors)<br>[finetuned/segmentation/mnms_sax/mnms_sax_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/segmentation/mnms_sax/mnms_sax_2.safetensors)<br>[finetuned/segmentation/mnms_sax/config.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/segmentation/mnms_sax/config.yaml) | [segmentation_sax.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/segmentation_sax.py) |
43
+ | Ventricle and myocardium segmentation | M&Ms2 | SAX | 1 | [finetuned/segmentation/mnms2_sax/mnms2_sax_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/segmentation/mnms2_sax/mnms2_sax_0.safetensors)<br>[finetuned/segmentation/mnms2_sax/mnms2_sax_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/segmentation/mnms2_sax/mnms2_sax_1.safetensors)<br>[finetuned/segmentation/mnms2_sax/mnms2_sax_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/segmentation/mnms2_sax/mnms2_sax_2.safetensors)<br>[finetuned/segmentation/mnms2_sax/config.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/segmentation/mnms2_sax/config.yaml) | [segmentation_sax.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/segmentation_sax.py) |
44
+ | Ventricle and myocardium segmentation | M&Ms2 | LAX 4C | 1 | [finetuned/segmentation/mnms2_lax_4c/mnms2_lax_4c_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/segmentation/mnms2_lax_4c/mnms2_lax_4c_0.safetensors)<br>[finetuned/segmentation/mnms2_lax_4c/mnms2_lax_4c_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/segmentation/mnms2_lax_4c/mnms2_lax_4c_1.safetensors)<br>[finetuned/segmentation/mnms2_lax_4c/mnms2_lax_4c_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/segmentation/mnms2_lax_4c/mnms2_lax_4c_2.safetensors)<br>[finetuned/segmentation/mnms2_lax_4c/config.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/segmentation/mnms2_lax_4c/config.yaml) | [segmentation_lax_4c.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/segmentation_lax_4c.py) |
45
+ | CVD classification | ACDC | SAX | 2 (ED and ES) | [finetuned/classification_cvd/acdc_sax/acdc_sax_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_cvd/acdc_sax/acdc_sax_0.safetensors)<br>[finetuned/classification_cvd/acdc_sax/acdc_sax_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_cvd/acdc_sax/acdc_sax_1.safetensors)<br>[finetuned/classification_cvd/acdc_sax/acdc_sax_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_cvd/acdc_sax/acdc_sax_2.safetensors)<br>[finetuned/classification_cvd/acdc_sax/config.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_cvd/acdc_sax/config.yaml) | [classification_cvd.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/classification_cvd.py) |
46
+ | CVD classification | M&Ms | SAX | 2 (ED and ES) | [finetuned/classification_cvd/mnms_sax/mnms_sax_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_cvd/mnms_sax/mnms_sax_0.safetensors)<br>[finetuned/classification_cvd/mnms_sax/mnms_sax_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_cvd/mnms_sax/mnms_sax_1.safetensors)<br>[finetuned/classification_cvd/mnms_sax/mnms_sax_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_cvd/mnms_sax/mnms_sax_2.safetensors)<br>[finetuned/classification_cvd/mnms_sax/config.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_cvd/mnms_sax/config.yaml) | [classification_cvd.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/classification_cvd.py) |
47
+ | CVD classification | M&Ms2 | SAX | 2 (ED and ES) | [finetuned/classification_cvd/mnms2_sax/mnms2_sax_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_cvd/mnms2_sax/mnms2_sax_0.safetensors)<br>[finetuned/classification_cvd/mnms2_sax/mnms2_sax_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_cvd/mnms2_sax/mnms2_sax_1.safetensors)<br>[finetuned/classification_cvd/mnms2_sax/mnms2_sax_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_cvd/mnms2_sax/mnms2_sax_2.safetensors)<br>[finetuned/classification_cvd/mnms2_sax/config.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_cvd/mnms2_sax/config.yaml) | [classification_cvd.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/classification_cvd.py) |
48
+ | CVD classification | M&Ms2 | LAX 4C | 2 (ED and ES) | [finetuned/classification_cvd/mnms2_lax_4c/mnms2_lax_4c_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_cvd/mnms2_lax_4c/mnms2_lax_4c_0.safetensors)<br>[finetuned/classification_cvd/mnms2_lax_4c/mnms2_lax_4c_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_cvd/mnms2_lax_4c/mnms2_lax_4c_1.safetensors)<br>[finetuned/classification_cvd/mnms2_lax_4c/mnms2_lax_4c_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_cvd/mnms2_lax_4c/mnms2_lax_4c_2.safetensors)<br>[finetuned/classification_cvd/mnms2_lax_4c/config.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_cvd/mnms2_lax_4c/config.yaml) | [classification_cvd.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/classification_cvd.py) |
49
+ | Patient sex classification | M&Ms | SAX | 2 (ED and ES) | [finetuned/classification_sex/mnms_sax/mnms_sax_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_sex/mnms_sax/mnms_sax_0.safetensors)<br>[finetuned/classification_sex/mnms_sax/mnms_sax_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_sex/mnms_sax/mnms_sax_1.safetensors)<br>[finetuned/classification_sex/mnms_sax/mnms_sax_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_sex/mnms_sax/mnms_sax_2.safetensors)<br>[finetuned/classification_sex/mnms_sax/config.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_sex/mnms_sax/config.yaml) | [classification_sex.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/classification_sex.py) |
50
+ | CMR machine vendor classification | M&Ms2 | SAX | 2 (ED and ES) | [finetuned/classification_vendor/mnms2_sax/mnms2_sax_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_vendor/mnms2_sax/mnms2_sax_0.safetensors)<br>[finetuned/classification_vendor/mnms2_sax/mnms2_sax_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_vendor/mnms2_sax/mnms2_sax_1.safetensors)<br>[finetuned/classification_vendor/mnms2_sax/mnms2_sax_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_vendor/mnms2_sax/mnms2_sax_2.safetensors)<br>[finetuned/classification_vendor/mnms2_sax/config.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_vendor/mnms2_sax/config.yaml) | [classification_vendor.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/classification_vendor.py) |
51
+ | CMR machine vendor classification | M&Ms2 | LAX 4C | 2 (ED and ES) | [finetuned/classification_vendor/mnms2_lax_4c/mnms2_lax_4c_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_vendor/mnms2_lax_4c/mnms2_lax_4c_0.safetensors)<br>[finetuned/classification_vendor/mnms2_lax_4c/mnms2_lax_4c_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_vendor/mnms2_lax_4c/mnms2_lax_4c_1.safetensors)<br>[finetuned/classification_vendor/mnms2_lax_4c/mnms2_lax_4c_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_vendor/mnms2_lax_4c/mnms2_lax_4c_2.safetensors)<br>[finetuned/classification_vendor/mnms2_lax_4c/config.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/classification_vendor/mnms2_lax_4c/config.yaml) | [classification_vendor.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/classification_vendor.py) |
52
+ | Direct EF regression | ACDC | SAX | 2 (ED and ES) | [finetuned/regression_ef/acdc_sax/acdc_sax_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_ef/acdc_sax/acdc_sax_0.safetensors)<br>[finetuned/regression_ef/acdc_sax/acdc_sax_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_ef/acdc_sax/acdc_sax_1.safetensors)<br>[finetuned/regression_ef/acdc_sax/acdc_sax_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_ef/acdc_sax/acdc_sax_2.safetensors)<br>[finetuned/regression_ef/acdc_sax/config.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_ef/acdc_sax/config.yaml) | [regression_ef.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/regression_ef.py) |
53
+ | Direct EF regression | M&Ms | SAX | 2 (ED and ES) | [finetuned/regression_ef/mnms_sax/mnms_sax_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_ef/mnms_sax/mnms_sax_0.safetensors)<br>[finetuned/regression_ef/mnms_sax/mnms_sax_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_ef/mnms_sax/mnms_sax_1.safetensors)<br>[finetuned/regression_ef/mnms_sax/mnms_sax_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_ef/mnms_sax/mnms_sax_2.safetensors)<br>[finetuned/regression_ef/mnms_sax/config.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_ef/mnms_sax/config.yaml) | [regression_ef.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/regression_ef.py) |
54
+ | Direct EF regression | M&Ms2 | SAX | 2 (ED and ES) | [finetuned/regression_ef/mnms2_sax/mnms2_sax_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_ef/mnms2_sax/mnms2_sax_0.safetensors)<br>[finetuned/regression_ef/mnms2_sax/mnms2_sax_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_ef/mnms2_sax/mnms2_sax_1.safetensors)<br>[finetuned/regression_ef/mnms2_sax/mnms2_sax_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_ef/mnms2_sax/mnms2_sax_2.safetensors)<br>[finetuned/regression_ef/mnms2_sax/config.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_ef/mnms2_sax/config.yaml) | [regression_ef.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/regression_ef.py) |
55
+ | Direct EF regression | M&Ms2 | LAX 4C | 2 (ED and ES) | [finetuned/regression_ef/mnms2_lax_4c/mnms2_lax_4c_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_ef/mnms2_lax_4c/mnms2_lax_4c_0.safetensors)<br>[finetuned/regression_ef/mnms2_lax_4c/mnms2_lax_4c_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_ef/mnms2_lax_4c/mnms2_lax_4c_1.safetensors)<br>[finetuned/regression_ef/mnms2_lax_4c/mnms2_lax_4c_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_ef/mnms2_lax_4c/mnms2_lax_4c_2.safetensors)<br>[finetuned/regression_ef/mnms2_lax_4c/config.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_ef/mnms2_lax_4c/config.yaml) | [regression_ef.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/regression_ef.py) |
56
+ | Patient BMI regression | ACDC | SAX | 2 (ED and ES) | [finetuned/regression_bmi/acdc_sax/acdc_sax_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_bmi/acdc_sax/acdc_sax_0.safetensors)<br>[finetuned/regression_bmi/acdc_sax/acdc_sax_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_bmi/acdc_sax/acdc_sax_1.safetensors)<br>[finetuned/regression_bmi/acdc_sax/acdc_sax_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_bmi/acdc_sax/acdc_sax_2.safetensors)<br>[finetuned/regression_bmi/acdc_sax/config.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_bmi/acdc_sax/config.yaml) | [regression_bmi.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/regression_bmi.py) |
57
+ | Patient age regression | M&Ms | SAX | 2 (ED and ES) | [finetuned/regression_age/mnms_sax/mnms_sax_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_age/mnms_sax/mnms_sax_0.safetensors)<br>[finetuned/regression_age/mnms_sax/mnms_sax_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_age/mnms_sax/mnms_sax_1.safetensors)<br>[finetuned/regression_age/mnms_sax/mnms_sax_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_age/mnms_sax/mnms_sax_2.safetensors)<br>[finetuned/regression_age/mnms_sax/config.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/regression_age/mnms_sax/config.yaml) | [regression_age.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/regression_age.py) |
58
+ | Landmark localization by heatmap regression | Landmark | LAX 2C | 1 | [finetuned/landmark_heatmap/lax_2c/lax_2c_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/landmark_heatmap/lax_2c/lax_2c_0.safetensors)<br>[finetuned/landmark_heatmap/lax_2c/lax_2c_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/landmark_heatmap/lax_2c/lax_2c_1.safetensors)<br>[finetuned/landmark_heatmap/lax_2c/lax_2c_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/landmark_heatmap/lax_2c/lax_2c_2.safetensors)<br>[finetuned/landmark_heatmap/lax_2c/config.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/landmark_heatmap/lax_2c/config.yaml) | [landmark_heatmap.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/landmark_heatmap.py) |
59
+ | Landmark localization by heatmap regression | Landmark | LAX 4C | 1 | [finetuned/landmark_heatmap/lax_4c/lax_4c_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/landmark_heatmap/lax_4c/lax_4c_0.safetensors)<br>[finetuned/landmark_heatmap/lax_4c/lax_4c_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/landmark_heatmap/lax_4c/lax_4c_1.safetensors)<br>[finetuned/landmark_heatmap/lax_4c/lax_4c_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/landmark_heatmap/lax_4c/lax_4c_2.safetensors)<br>[finetuned/landmark_heatmap/lax_4c/config.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/landmark_heatmap/lax_4c/config.yaml) | [landmark_heatmap.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/landmark_heatmap.py) |
60
+ | Landmark localization by coordinates regression | Landmark | LAX 2C | 1 | [finetuned/landmark_coordinate/lax_2c/lax_2c_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/landmark_coordinate/lax_2c/lax_2c_0.safetensors)<br>[finetuned/landmark_coordinate/lax_2c/lax_2c_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/landmark_coordinate/lax_2c/lax_2c_1.safetensors)<br>[finetuned/landmark_coordinate/lax_2c/lax_2c_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/landmark_coordinate/lax_2c/lax_2c_2.safetensors)<br>[finetuned/landmark_coordinate/lax_2c/config.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/landmark_coordinate/lax_2c/config.yaml) | [landmark_coordinate.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/landmark_coordinate.py) |
61
+ | Landmark localization by coordinates regression | Landmark | LAX 4C | 1 | [finetuned/landmark_coordinate/lax_4c/lax_4c_0.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/landmark_coordinate/lax_4c/lax_4c_0.safetensors)<br>[finetuned/landmark_coordinate/lax_4c/lax_4c_1.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/landmark_coordinate/lax_4c/lax_4c_1.safetensors)<br>[finetuned/landmark_coordinate/lax_4c/lax_4c_2.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/landmark_coordinate/lax_4c/lax_4c_2.safetensors)<br>[finetuned/landmark_coordinate/lax_4c/config.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/finetuned/landmark_coordinate/lax_4c/config.yaml) | [landmark_coordinate.py](https://github.com/mathpluscode/CineMA/blob/main/examples/inference/landmark_coordinate.py) |
62
 
63
  ## Pre-trained CineMA Model
64
 
65
  The pre-trained CineMA model backbone is available at
66
  [pretrained/cinema.safetensors](https://huggingface.co/mathpluscode/CineMA/blob/main/pretrained/cinema.safetensors) with
67
+ configuration [pretrained/config.yaml](https://huggingface.co/mathpluscode/CineMA/blob/main/pretrained/config.yaml).
68
 
69
  Following scripts demonstrated how to fine-tune this backbone using
70
  [a preprocessed version of ACDC dataset](https://huggingface.co/datasets/mathpluscode/ACDC):
 
77
 
78
  ## Contact
79
 
80
+ For questions or collaborations, please contact Yunguan Fu ([email protected]).
finetuned/classification_cvd/{acdc_sax_0.safetensors β†’ acdc_sax/acdc_sax_0.safetensors} RENAMED
File without changes
finetuned/classification_cvd/{acdc_sax_1.safetensors β†’ acdc_sax/acdc_sax_1.safetensors} RENAMED
File without changes
finetuned/classification_cvd/{acdc_sax_2.safetensors β†’ acdc_sax/acdc_sax_2.safetensors} RENAMED
File without changes
finetuned/classification_cvd/{acdc_sax.yaml β†’ acdc_sax/config.yaml} RENAMED
File without changes
finetuned/classification_cvd/{mnms2_lax_4c.yaml β†’ mnms2_lax_4c/config.yaml} RENAMED
File without changes
finetuned/classification_cvd/{mnms2_lax_4c_0.safetensors β†’ mnms2_lax_4c/mnms2_lax_4c_0.safetensors} RENAMED
File without changes
finetuned/classification_cvd/{mnms2_lax_4c_1.safetensors β†’ mnms2_lax_4c/mnms2_lax_4c_1.safetensors} RENAMED
File without changes
finetuned/classification_cvd/{mnms2_lax_4c_2.safetensors β†’ mnms2_lax_4c/mnms2_lax_4c_2.safetensors} RENAMED
File without changes
finetuned/classification_cvd/{mnms2_sax.yaml β†’ mnms2_sax/config.yaml} RENAMED
File without changes
finetuned/classification_cvd/{mnms2_sax_0.safetensors β†’ mnms2_sax/mnms2_sax_0.safetensors} RENAMED
File without changes
finetuned/classification_cvd/{mnms2_sax_1.safetensors β†’ mnms2_sax/mnms2_sax_1.safetensors} RENAMED
File without changes
finetuned/classification_cvd/{mnms2_sax_2.safetensors β†’ mnms2_sax/mnms2_sax_2.safetensors} RENAMED
File without changes
finetuned/classification_cvd/{mnms_sax.yaml β†’ mnms_sax/config.yaml} RENAMED
File without changes
finetuned/classification_cvd/{mnms_sax_0.safetensors β†’ mnms_sax/mnms_sax_0.safetensors} RENAMED
File without changes
finetuned/classification_cvd/{mnms_sax_1.safetensors β†’ mnms_sax/mnms_sax_1.safetensors} RENAMED
File without changes
finetuned/classification_cvd/{mnms_sax_2.safetensors β†’ mnms_sax/mnms_sax_2.safetensors} RENAMED
File without changes
finetuned/classification_sex/{mnms_sax.yaml β†’ mnms_sax/config.yaml} RENAMED
File without changes
finetuned/classification_sex/{mnms_sax_0.safetensors β†’ mnms_sax/mnms_sax_0.safetensors} RENAMED
File without changes
finetuned/classification_sex/{mnms_sax_1.safetensors β†’ mnms_sax/mnms_sax_1.safetensors} RENAMED
File without changes
finetuned/classification_sex/{mnms_sax_2.safetensors β†’ mnms_sax/mnms_sax_2.safetensors} RENAMED
File without changes
finetuned/classification_vendor/{mnms2_lax_4c.yaml β†’ mnms2_lax_4c/config.yaml} RENAMED
File without changes
finetuned/classification_vendor/{mnms2_lax_4c_0.safetensors β†’ mnms2_lax_4c/mnms2_lax_4c_0.safetensors} RENAMED
File without changes
finetuned/classification_vendor/{mnms2_lax_4c_1.safetensors β†’ mnms2_lax_4c/mnms2_lax_4c_1.safetensors} RENAMED
File without changes
finetuned/classification_vendor/{mnms2_lax_4c_2.safetensors β†’ mnms2_lax_4c/mnms2_lax_4c_2.safetensors} RENAMED
File without changes
finetuned/classification_vendor/{mnms2_sax.yaml β†’ mnms2_sax/config.yaml} RENAMED
File without changes
finetuned/classification_vendor/{mnms2_sax_0.safetensors β†’ mnms2_sax/mnms2_sax_0.safetensors} RENAMED
File without changes
finetuned/classification_vendor/{mnms2_sax_1.safetensors β†’ mnms2_sax/mnms2_sax_1.safetensors} RENAMED
File without changes
finetuned/classification_vendor/{mnms2_sax_2.safetensors β†’ mnms2_sax/mnms2_sax_2.safetensors} RENAMED
File without changes
finetuned/landmark_coordinate/{lax_2c.yaml β†’ lax_2c/config.yaml} RENAMED
File without changes
finetuned/landmark_coordinate/{lax_2c_0.safetensors β†’ lax_2c/lax_2c_0.safetensors} RENAMED
File without changes
finetuned/landmark_coordinate/{lax_2c_1.safetensors β†’ lax_2c/lax_2c_1.safetensors} RENAMED
File without changes
finetuned/landmark_coordinate/{lax_2c_2.safetensors β†’ lax_2c/lax_2c_2.safetensors} RENAMED
File without changes
finetuned/landmark_coordinate/{lax_4c.yaml β†’ lax_4c/config.yaml} RENAMED
File without changes
finetuned/landmark_coordinate/{lax_4c_0.safetensors β†’ lax_4c/lax_4c_0.safetensors} RENAMED
File without changes
finetuned/landmark_coordinate/{lax_4c_1.safetensors β†’ lax_4c/lax_4c_1.safetensors} RENAMED
File without changes
finetuned/landmark_coordinate/{lax_4c_2.safetensors β†’ lax_4c/lax_4c_2.safetensors} RENAMED
File without changes
finetuned/landmark_heatmap/{lax_2c.yaml β†’ lax_2c/config.yaml} RENAMED
File without changes
finetuned/landmark_heatmap/{lax_2c_0.safetensors β†’ lax_2c/lax_2c_0.safetensors} RENAMED
File without changes
finetuned/landmark_heatmap/{lax_2c_1.safetensors β†’ lax_2c/lax_2c_1.safetensors} RENAMED
File without changes
finetuned/landmark_heatmap/{lax_2c_2.safetensors β†’ lax_2c/lax_2c_2.safetensors} RENAMED
File without changes
finetuned/landmark_heatmap/{lax_4c.yaml β†’ lax_4c/config.yaml} RENAMED
File without changes
finetuned/landmark_heatmap/{lax_4c_0.safetensors β†’ lax_4c/lax_4c_0.safetensors} RENAMED
File without changes
finetuned/landmark_heatmap/{lax_4c_1.safetensors β†’ lax_4c/lax_4c_1.safetensors} RENAMED
File without changes
finetuned/landmark_heatmap/{lax_4c_2.safetensors β†’ lax_4c/lax_4c_2.safetensors} RENAMED
File without changes
finetuned/regression_age/{mnms_sax.yaml β†’ mnms_sax/config.yaml} RENAMED
File without changes
finetuned/regression_age/{mnms_sax_0.safetensors β†’ mnms_sax/mnms_sax_0.safetensors} RENAMED
File without changes
finetuned/regression_age/{mnms_sax_1.safetensors β†’ mnms_sax/mnms_sax_1.safetensors} RENAMED
File without changes
finetuned/regression_age/{mnms_sax_2.safetensors β†’ mnms_sax/mnms_sax_2.safetensors} RENAMED
File without changes
finetuned/regression_bmi/{acdc_sax_0.safetensors β†’ acdc_sax/acdc_sax_0.safetensors} RENAMED
File without changes