Instructions to use CLMBR/npi-sim-ques-transformer-0 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use CLMBR/npi-sim-ques-transformer-0 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="CLMBR/npi-sim-ques-transformer-0")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("CLMBR/npi-sim-ques-transformer-0") model = AutoModelForCausalLM.from_pretrained("CLMBR/npi-sim-ques-transformer-0", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use CLMBR/npi-sim-ques-transformer-0 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "CLMBR/npi-sim-ques-transformer-0" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "CLMBR/npi-sim-ques-transformer-0", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/CLMBR/npi-sim-ques-transformer-0
- SGLang
How to use CLMBR/npi-sim-ques-transformer-0 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "CLMBR/npi-sim-ques-transformer-0" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "CLMBR/npi-sim-ques-transformer-0", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "CLMBR/npi-sim-ques-transformer-0" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "CLMBR/npi-sim-ques-transformer-0", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use CLMBR/npi-sim-ques-transformer-0 with Docker Model Runner:
docker model run hf.co/CLMBR/npi-sim-ques-transformer-0
Commit History
-
Model save
Verified signature2bb3575 -
Training in progress, epoch 0
Verified signaturee15a56d -
Training in progress, epoch 0
Verified signature4983006
-
Training in progress, epoch 1
Verified signatureea4c808 -
Training in progress, epoch 0
Verified signaturecdb9857 -
Training in progress, epoch 1
Verified signature6abdce8 -
Training in progress, epoch 0
Verified signatureed64ecd -
Training in progress, epoch 1
Verified signature67f418a -
Training in progress, epoch 0
Verified signature62a8b36 -
Training in progress, epoch 1
Verified signature61d93ff -
Training in progress, epoch 0
Verified signature069ef2b
-
Training in progress, epoch 1
Verified signaturec2fde92 -
Training in progress, epoch 0
Verified signature06e1a5f -
Training in progress, epoch 1
Verified signature8ff3817 -
Training in progress, epoch 0
Verified signatured7d8ccc -
Training in progress, epoch 1
Verified signature56e808f -
Training in progress, epoch 0
Verified signatured821e5f -
Training in progress, epoch 1
Verified signatured9ff61b -
Training in progress, epoch 0
Verified signaturee602932 -
Training in progress, epoch 0
Verified signature00718a9
-
Training in progress, epoch 1
Verified signaturea478a77 -
Training in progress, epoch 0
Verified signaturebc81abd -
Training in progress, epoch 1
Verified signature8b43dae -
Training in progress, epoch 0
Verified signature3a8a808 -
Training in progress, epoch 1
Verified signaturea2eacef -
Training in progress, epoch 0
Verified signature213a27a -
Training in progress, epoch 1
Verified signature6805117 -
Training in progress, epoch 0
Verified signatureed03a68
-
Training in progress, epoch 1
Verified signature589e062 -
Training in progress, epoch 0
Verified signatureabd38d7 -
Training in progress, epoch 1
Verified signature81eae1a -
Training in progress, epoch 0
Verified signature6e9d906 -
Training in progress, epoch 1
Verified signatured4a6351 -
Training in progress, epoch 0
Verified signature12384aa -
Training in progress, epoch 1
Verified signature5bc62ca -
Training in progress, epoch 0
Verified signaturee4ef778 -
Training in progress, epoch 0
Verified signaturef3b624f
-
Training in progress, epoch 1
Verified signature32beea2 -
Training in progress, epoch 0
Verified signature375f1dc -
Training in progress, epoch 1
Verified signature381a732 -
Training in progress, epoch 0
Verified signaturea00109d