Quick Start

The basic overview of getting familiar with chaiverse and submitting your first model

Google Colabcolab.research.google.com

Submit a model in < 10 minutes with Chaiverse Jupyter Notebook Quickstart

Get your Dev Key

Please check your dm when your join discord.gg/chai-llm to get your key!

Install the library

Now, you will have to install the chaiverse package to submit your first model

Python

# Install via pip
pip install chaiverse
import chaiverse as chai

Good to know: You may need to install pydantic==1.10.8 if importing chaiverse throws an error

Now you must authenticate yourself

chai.developer_login('your_token')

Great You're Ready to Submit your first Model!

Simply submit your model using the chai package

Python

import chaiverse as chai

model_url = "ChaiML/phase2_winner_13b2" # Your model URL

generation_params = {
    'temperature': 0.99,
    'top_p': 0.2,
    "top_k": 40,
    "stopping_words": ['\n'],
    "presence_penalty": 0.5,
    "frequency_penalty": 0.5,
    "max_input_tokens": 1024,
    "best_of": 4
    }
submission_parameters = {'model_repo': model_url, 'generation_params': generation_params, 'model_name': 'my-awesome-llama'}

submitter = chai.ModelSubmitter(verbose=True)
submission_id = submitter.submit(submission_parameters)

Currently, only 2 models are allowed to be deployed at a time.

Deactivating your Model

Great now you're ready to move on!