EmbeddedLLM
/

all-MiniLM-L6-v2-onnx-o3-cpu

Feature Extraction

sentence-transformers

sentence-similarity

text-embeddings-inference

Model card Files Files and versions

Jia Huei Tan commited on Feb 16, 2024

Commit

ca83acc

·

1 Parent(s): b290091

Update README

Files changed (1) hide show

README.md +7 -1

README.md CHANGED Viewed

@@ -34,7 +34,13 @@ tokenizer = AutoTokenizer.from_pretrained(model_name)
 model = ORTModelForFeatureExtraction.from_pretrained(
     model_name, use_io_binding=True, provider=provider, device_map=device
 )
-inputs = tokenizer(sentences, padding=True, truncation=True, return_tensors="pt")
 inputs = inputs.to(device)
 token_embeddings = model(**inputs).last_hidden_state
 # Pool

 model = ORTModelForFeatureExtraction.from_pretrained(
     model_name, use_io_binding=True, provider=provider, device_map=device
 )
+inputs = tokenizer(
+    sentences,
+    padding=True,
+    truncation=True,
+    return_tensors="pt",
+    max_length=model.config.max_position_embeddings,
+)
 inputs = inputs.to(device)
 token_embeddings = model(**inputs).last_hidden_state
 # Pool