Model Card for Model-Demo-420M
Base model
Task description
test
Label meaning
test
Task type
Protein-level Classification
Model input type
AA Sequence
LoRA config
- r: 8
- lora_dropout: 0.0
- lora_alpha: 16
- target_modules: ['value', 'output.dense', 'key', 'intermediate.dense', 'query']
- modules_to_save: ['classifier']
Training config
- optimizer:
- class: AdamW
- betas: (0.9, 0.98)
- weight_decay: 0.01
- learning rate: 0.0005
- epoch: 5
- batch size: 8
- precision: 16-mixed
- Downloads last month
- -
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for taotl/test
Base model
Rostlab/prot_bert