mradermacher

/

model_requests

like 127

https://huggingface.co/aquif-ai/aquif-3.5-Max-42B-A3B
Sorry typo

trying to use "mradermacher/maya1-GGUF" locally and i am absolute newbie

i see code example for llama-cpp-python in the model card:

# !pip install llama-cpp-python
from llama_cpp import Llama
llm = Llama.from_pretrained(
    repo_id="mradermacher/maya1-GGUF",
    filename="maya1.IQ4_XS.gguf",
)
llm.create_chat_completion(
    messages = "No input example has been defined for this model task."
)

But how to generate wav file and save it? could you please provide some small code snippet?