rrende commited on
Commit
5ca7cf9
·
verified ·
1 Parent(s): 8c72881

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +31 -0
README.md CHANGED
@@ -6,6 +6,16 @@ tags: []
6
  # Model Card for Model ID
7
 
8
  <!-- Provide a quick summary of what the model is/does. -->
 
 
 
 
 
 
 
 
 
 
9
 
10
  ```python
11
  from functools import partial
@@ -77,3 +87,24 @@ for _ in range(10):
77
  print("Mean: ", E.mean.real / lattice.n_nodes, "\t time=", time.time()-start)
78
  ```
79
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
6
  # Model Card for Model ID
7
 
8
  <!-- Provide a quick summary of what the model is/does. -->
9
+ Pretrained Foundation Neural Quantum State on the Ising in disordered transverse field model on a chain with \\(L=32\\) sites.
10
+ Several values of the external field are available (check the different revisions).
11
+
12
+ The model has been trained on \\(R=2000\\) different disorder realization, using a total batch size of \\(M=10000\\) samples.
13
+ The computation has been distributed over 4 A100-64GB GPUs for about two hours.
14
+
15
+
16
+ ## How to Get Started with the Model
17
+
18
+ Use the code below to get started with the model. In particular, we sample the model for a fixed disordered realization using NetKet.
19
 
20
  ```python
21
  from functools import partial
 
87
  print("Mean: ", E.mean.real / lattice.n_nodes, "\t time=", time.time()-start)
88
  ```
89
 
90
+ The time per sweep is 0.5s, evaluated on a single A100-40GB GPU.
91
+
92
+ ### Extract hidden representation
93
+
94
+ The hidden representation associated to the input batch of configurations can be extracted as:
95
+
96
+ ```python
97
+ wf = FlaxAutoModel.from_pretrained("nqs-models/ising_disorder_fnqs", trust_remote_code=True, return_z=True)
98
+
99
+ z = wf(wf.params, samples, h)
100
+ ```
101
+
102
+ #### Training Hyperparameters
103
+
104
+ Number of layers: 6
105
+ Embedding dimension: 72
106
+ Hidden dimension: 288
107
+ Number of heads: 12
108
+ Patch size: 4
109
+
110
+ Total number of parameters: 326124