Install

A step-by-step guide to setting up Evalverse for you

Installation

1. Clone the Evalverse repository

git clone --recursive https://github.com/UpstageAI/evalverse.git

• Notes: --recursive for submodules

2. Install requirement packages

cd evalverse
pip install -e .

Configuration

You have to set an API key or Token in the .env file (rename .env_sample to .env) to use some features.

• Your OpenAI API Key (required for mt_bench)

• Your Slack BOT/APP Token (required for slack reporter)

OPENAI_API_KEY=sk-...

SLACK_BOT_TOKEN=xoxb-...
SLACK_APP_TOKEN=xapp-...