Quick Start

Chat Completions

1 2 3 4 5 6 7 8 9 10 11 12 13 fetch("https://api.awanllm.com/v1/chat/completions", { method: "POST", headers: { "Authorization": `Bearer ${AWANLLM_API_KEY}`, "Content-Type": "application/json" }, body: JSON.stringify({ "model": "Awanllm-Llama-3-8B-Dolfin", "messages": [ {"role": "user", "content": "What is the meaning of life?"}, ], }) });

Completions

1 2 3 4 5 6 7 8 9 10 11 fetch("https://api.awanllm.com/v1/completions", { method: "POST", headers: { "Authorization": `Bearer ${AWANLLM_API_KEY}`, "Content-Type": "application/json" }, body: JSON.stringify({ "model": "Awanllm-Llama-3-8B-Dolfin", "prompt": "What is the meaning of life?", }) });

Huggingface Chat-UI

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 MONGODB_URL=mongodb://localhost:27017 PUBLIC_APP_NAME=ChatUI PUBLIC_APP_ASSETS=chatui PUBLIC_APP_COLOR=cyan MODELS=`[ { "name": "Awanllm-Llama-3-8B-Dolfin", "displayName": "Awanllm-Llama-3-8B-Dolfin", "id": "Awanllm-Llama-3-8B-Dolfin", "preprompt": "", "parameters": { "temperature": 0.7, "top_p": 0.9, "repetition_penalty": 1.1, "top_k": 40, "truncate": 8192, "max_new_tokens": 1024, "stop": ["<|eot_id|>"] }, "endpoints": [{ "type" : "openai", "baseURL": "https://api.awanllm.com/v1", "apiKey": "${AWANLLM_API_KEY}" }] } ]`

SillyTavern

- Text Completion

SillyTavern Image

- Chat Completion

SillyTavern Image