OneSQL-v0.2-Qwen-3B / README.md
onekq's picture
Update README.md
af54044 verified
metadata
base_model: unsloth/Qwen2.5-Coder-3B-Instruct-bnb-4bit
library_name: transformers
model_name: onekq-ai/OneSQL-v0.2-Qwen-3B
tags:
  - generated_from_trainer
  - unsloth
  - trl
  - sft
licence: apache-2.0
pipeline_tag: text-generation

Disclaimer

Your email will be used for anonymous survey. It will NOT be shared with anyone.

Introduction

This model is the full-weight version of the adapter model OneSQL-v0.1-Qwen-3B.

Quick start

To use this model, craft your prompt to start with your database schema in the form of CREATE TABLE, followed by your natural language query preceded by --. Make sure your prompt ends with SELECT in order for the model to finish the query for you.

from transformers import AutoModelForCausalLM, AutoTokenizer, pipeline
from peft import PeftModel

model_name = "onekq-ai/OneSQL-v0.2-Qwen-3B"
model = AutoModelForCausalLM.from_pretrained(model_name, device_map="auto")
tokenizer = AutoTokenizer.from_pretrained(model_name)
tokenizer.padding_side = "left"

generator = pipeline("text-generation", model=model, tokenizer=tokenizer, return_full_text=False)

prompt = """
CREATE TABLE students (
    id INTEGER PRIMARY KEY,
    name TEXT,
    age INTEGER,
    grade TEXT
);

-- Find the three youngest students
SELECT """

result = generator(f"<|im_start|>system\nYou are a SQL expert. Return code only.<|im_end|>\n<|im_start|>user\n{prompt}<|im_end|>\n<|im_start|>assistant\n")[0]
print(result["generated_text"])

The model response is the finished SQL query without SELECT

* FROM students ORDER BY age ASC LIMIT 3