Skip to main content

dspy.Anyscale

Usage​

lm = dspy.Anyscale(model="mistralai/Mistral-7B-Instruct-v0.1")

Constructor​

The constructor initializes the base class LM and verifies the api_key for using Anyscale API. We expect the following environment variables to be set:

  • ANYSCALE_API_KEY: API key for Together.
  • ANYSCALE_API_BASE: API base URL for Together.
class Anyscale(HFModel):
    def __init__(self, model, **kwargs):

Parameters:

  • model (str): models hosted on Together.

Methods​

Refer to dspy.OpenAI documentation.