AI Chat Providers
AI Chat Providers are the model backends that power AI Chat in ACTIVATE. Each provider connects the platform to a large language model endpoint, allowing users to send messages and receive AI-generated responses.
ACTIVATE supports three types of providers:
- Azure OpenAI — A managed provider provisioned through your organization's Azure infrastructure. ACTIVATE handles deployment and configuration automatically.
- Custom OpenAI-Compatible — Any endpoint that implements the OpenAI chat completions API. Use this to connect services like vLLM, Ollama, or other compatible inference servers.
- Session Tunnels — A secure tunnel from the platform to a model running inside an ACTIVATE compute session. Useful for private or fine-tuned models running on your own hardware.
Permissions Required
Creating and managing AI Chat providers requires appropriate platform permissions. In most organizations, providers are set up by administrators or team leads and then shared with other users.
Provider Permissions
Each provider has its own access controls. The provider owner and organization administrators can share a provider with specific groups or the entire organization using the aiprovider:use permission. Users who have been granted access can select the shared provider in AI Chat.
See Managing Permissions for details on sharing and revoking access.
Next Steps
- Azure OpenAI — Set up a managed Azure OpenAI provider
- Custom OpenAI-Compatible — Connect any OpenAI-compatible endpoint
- Session Tunnels — Route chat through a model in a compute session
- Managing Permissions — Control who can use your providers
Related Documentation
- AI Chat — Using the chat interface
- Adding an ML Resource — Provisioning ML workspaces