Spaces:

Do0rMaMu
/

Factory-POC

Sleeping

App Files Files Community

Factory-POC / flash-attention /training /configs /optimizer /adamw-apex.yaml

Do0rMaMu's picture

Upload folder using huggingface_hub

e45d058 verified about 1 year ago

history blame contribute delete

84 Bytes

	# @package train.optimizer
	_target_: apex.optimizers.FusedAdam
	adam_w_mode: True