Release ViT-L FP16 CUDA weights and document platform deployment choices
Browse files
README.md
CHANGED
|
@@ -25,7 +25,10 @@ DINOv2 ViT-L/14 encoder and a square-query decoder. The model takes
|
|
| 25 |
|
| 26 |
## Files
|
| 27 |
|
| 28 |
-
- `chessqueries-
|
|
|
|
|
|
|
|
|
|
| 29 |
inference weights; SHA-256
|
| 30 |
`6151bdd98fbe25f32080c097eba7ae75808b5615160e4867240931085fc762e5`.
|
| 31 |
- `chessqueries-vitL14-644-joint.ckpt` — original full PyTorch Lightning
|
|
@@ -36,6 +39,39 @@ DINOv2 ViT-L/14 encoder and a square-query decoder. The model takes
|
|
| 36 |
- `chessquerieslite-vits-644-int8.onnx` — the same ViT-S/14 model,
|
| 37 |
INT8 ONNX (36.03 MB).
|
| 38 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 39 |
Setup, inference, evaluation, and reproduction instructions are in the
|
| 40 |
[code repository](https://github.com/JSeytre/chessqueries).
|
| 41 |
|
|
|
|
| 25 |
|
| 26 |
## Files
|
| 27 |
|
| 28 |
+
- `chessqueries-vitl-644-safetensors-fp16-r1.safetensors` — CUDA/web deployment
|
| 29 |
+
weights (743.35 MB), FP16 weights/input/logits; SHA-256
|
| 30 |
+
`45edb69bf156f94299256fc51d1c75805f1de745ecfe34dc0615ef21265ab506`.
|
| 31 |
+
- `chessqueries-vitL14-644-joint.safetensors` — FP32 source/reference, tensor-only
|
| 32 |
inference weights; SHA-256
|
| 33 |
`6151bdd98fbe25f32080c097eba7ae75808b5615160e4867240931085fc762e5`.
|
| 34 |
- `chessqueries-vitL14-644-joint.ckpt` — original full PyTorch Lightning
|
|
|
|
| 39 |
- `chessquerieslite-vits-644-int8.onnx` — the same ViT-S/14 model,
|
| 40 |
INT8 ONNX (36.03 MB).
|
| 41 |
|
| 42 |
+
- `chessquerieslite-vits-644-coreml-fp16-r2.mlpackage.zip` — dedicated iOS
|
| 43 |
+
Lite Core ML package (62.47 MB), applied EXIF orientation and float32 tensor I/O;
|
| 44 |
+
SHA-256 `e01695f8adb0de7216bb1aae3a20ac2bb2f988a6c269a430181440e5d6f3292f`.
|
| 45 |
+
|
| 46 |
+
## FP16 validation
|
| 47 |
+
|
| 48 |
+
The ViT-L FP16 artifact was reloaded and compared with the released FP32 source
|
| 49 |
+
on all 3,196 test boards: ChessReD 2,129, ChessCog 342, SLCC 373 and CVChess 352.
|
| 50 |
+
All 204,544 square predictions matched; exact-board accuracies were unchanged
|
| 51 |
+
(99.624%, 98.538%, 87.668% and 87.216%, respectively). Both models ran at batch
|
| 52 |
+
one on an RTX 4090 with PyTorch 2.8.0, timm 1.0.27 and TF32 disabled. This
|
| 53 |
+
validates this artifact/runtime combination, not every backend or future export.
|
| 54 |
+
|
| 55 |
+
## Deployment selection
|
| 56 |
+
|
| 57 |
+
CUDA/web serving selects ViT-L FP16 weights, targeting roughly 20 ms per warm
|
| 58 |
+
batch-one model inference on an RTX 4090. Use an FP16-aware ChessQueries loader:
|
| 59 |
+
older packages support only FP32. Preserve float32 RGB decode, bilinear
|
| 60 |
+
antialiased resize and ImageNet normalization, then cast to FP16 immediately
|
| 61 |
+
before inference. Safetensors serving ignores EXIF orientation. The dedicated
|
| 62 |
+
iOS Core ML package applies orientation and has its own preprocessing contract.
|
| 63 |
+
|
| 64 |
+
iOS selects the dedicated Core ML export. Device-specific goals are around
|
| 65 |
+
100 ms on a powerful iPhone and 400–500 ms on a less powerful iPhone; validate
|
| 66 |
+
the exact export on the target phone. Android runtime selection is deferred.
|
| 67 |
+
The best existing Pixel 9 Pro result is about 629–633 ms with LiteRT FP16 CPU,
|
| 68 |
+
but a common-workload CPU FP16/INT8 comparison and complete device validation
|
| 69 |
+
remain necessary. These timing scopes differ and are not a cross-platform benchmark.
|
| 70 |
+
|
| 71 |
+
New releases follow these deployment choices. FP32 source/reference checkpoints
|
| 72 |
+
and existing published artifacts remain available; new FP32 companions are not
|
| 73 |
+
required for every deployment release.
|
| 74 |
+
|
| 75 |
Setup, inference, evaluation, and reproduction instructions are in the
|
| 76 |
[code repository](https://github.com/JSeytre/chessqueries).
|
| 77 |
|
chessqueries-vitl-644-safetensors-fp16-r1.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:45edb69bf156f94299256fc51d1c75805f1de745ecfe34dc0615ef21265ab506
|
| 3 |
+
size 743353530
|