Update README.md
Browse files
README.md
CHANGED
@@ -6,6 +6,16 @@ tags: []
|
|
6 |
# Model Card for Model ID
|
7 |
|
8 |
<!-- Provide a quick summary of what the model is/does. -->
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
9 |
|
10 |
```python
|
11 |
from functools import partial
|
@@ -77,3 +87,24 @@ for _ in range(10):
|
|
77 |
print("Mean: ", E.mean.real / lattice.n_nodes, "\t time=", time.time()-start)
|
78 |
```
|
79 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
6 |
# Model Card for Model ID
|
7 |
|
8 |
<!-- Provide a quick summary of what the model is/does. -->
|
9 |
+
Pretrained Foundation Neural Quantum State on the Ising in disordered transverse field model on a chain with \\(L=32\\) sites.
|
10 |
+
Several values of the external field are available (check the different revisions).
|
11 |
+
|
12 |
+
The model has been trained on \\(R=2000\\) different disorder realization, using a total batch size of \\(M=10000\\) samples.
|
13 |
+
The computation has been distributed over 4 A100-64GB GPUs for about two hours.
|
14 |
+
|
15 |
+
|
16 |
+
## How to Get Started with the Model
|
17 |
+
|
18 |
+
Use the code below to get started with the model. In particular, we sample the model for a fixed disordered realization using NetKet.
|
19 |
|
20 |
```python
|
21 |
from functools import partial
|
|
|
87 |
print("Mean: ", E.mean.real / lattice.n_nodes, "\t time=", time.time()-start)
|
88 |
```
|
89 |
|
90 |
+
The time per sweep is 0.5s, evaluated on a single A100-40GB GPU.
|
91 |
+
|
92 |
+
### Extract hidden representation
|
93 |
+
|
94 |
+
The hidden representation associated to the input batch of configurations can be extracted as:
|
95 |
+
|
96 |
+
```python
|
97 |
+
wf = FlaxAutoModel.from_pretrained("nqs-models/ising_disorder_fnqs", trust_remote_code=True, return_z=True)
|
98 |
+
|
99 |
+
z = wf(wf.params, samples, h)
|
100 |
+
```
|
101 |
+
|
102 |
+
#### Training Hyperparameters
|
103 |
+
|
104 |
+
Number of layers: 6
|
105 |
+
Embedding dimension: 72
|
106 |
+
Hidden dimension: 288
|
107 |
+
Number of heads: 12
|
108 |
+
Patch size: 4
|
109 |
+
|
110 |
+
Total number of parameters: 326124
|