Update README.md
Browse files
README.md
CHANGED
|
@@ -53,13 +53,10 @@ In each subplot:
|
|
| 53 |
|
| 54 |
4. **Position-specific variations**: In standard RoPE, frequency decreases with dimension index, but F0 adaptation modify this pattern.
|
| 55 |
|
| 56 |
-
|
| 57 |
-
----
|
| 58 |
```python
|
| 59 |
|
| 60 |
freqs = (theta / 220.0) * 700 * (torch.pow(10, torch.linspace(0, 2595 * torch.log10(torch.tensor(1 + 8000/700)), dim // 2, device=device, dtype=dtype) / 2595) - 1) / 1000
|
| 61 |
```
|
| 62 |
-
----
|
| 63 |
|
| 64 |
The patterns below show how positions "see" each other in relation to theta and f0.
|
| 65 |
|
|
|
|
| 53 |
|
| 54 |
4. **Position-specific variations**: In standard RoPE, frequency decreases with dimension index, but F0 adaptation modify this pattern.
|
| 55 |
|
|
|
|
|
|
|
| 56 |
```python
|
| 57 |
|
| 58 |
freqs = (theta / 220.0) * 700 * (torch.pow(10, torch.linspace(0, 2595 * torch.log10(torch.tensor(1 + 8000/700)), dim // 2, device=device, dtype=dtype) / 2595) - 1) / 1000
|
| 59 |
```
|
|
|
|
| 60 |
|
| 61 |
The patterns below show how positions "see" each other in relation to theta and f0.
|
| 62 |
|