Compile Once, Run Anywhere: Supporting Multiple LLM Providers

One of the biggest challenges in AI development isn't writing prompts.

It's maintaining them across multiple providers.

Today you might use:

Tomorrow?

Maybe a completely different model.

The problem isn't the prompt itself.

It's that every provider expects a slightly different format.

---

The Reality Today

Suppose you have a simple assistant.

For OpenAI, your request looks like this.

messages: [

  {
    role: "system",
    content: "You are an expert assistant."
  },

  {
    role: "user",
    content: question
  }

]

Looks straightforward.

Now switch to another provider.

Suddenly you have to rewrite your message format.