TaskWeaver Beginners Guide

git clone https://github.com/microsoft/TaskWeaver
cd TaskWeaver
conda create -n taskweaver python=3.11
conda activate taskweaver
pip install -r requirements.txt
cd project

taskweaver_config.json

{
"llm.api_base": "https://api.openai.com/v1",
"llm.api_key": "sk-xxxxxxxxxxxxxxxxxxxx",
"llm.model": "gpt-3.5-turbo-1106"
}

Text Generation Web UI

Models

TheBloke/Orca-2-7B-GGUF
orca-2-7b.Q4_K_M.gguf

Config

{
"llm.api_base": "http://0.0.0.0:5000/v1",
"llm.api_key": "null",
"llm.model": "orca2",
"llm.response" : "text"
}