Skip to main content
Feedback

Managing and editing model connections

Updated 
note

Bring Your Own Model is an Early Access release. Refer to the Early Access disclaimer for details.

After you connect your LLM provider account to Agentstudio, you can manage model connections by doing the following actions available in the Models list view:

To change other details, such as name, environment, or API key, you must create a new connection and delete the older model connection.

To manage self-hosted runtimes that are connected to models and agents, make changes in Runtime Management in the Boomi Platform. You can navigate to Agentstudio > Agent Garden > Environments to quickly open the Runtime Management screen for a particular environment.

Changing the runtime associated with a model connection

Each model connection is associated with one or more self-hosted runtimes in Runtime Management. After you create this connection, you cannot edit the runtime attachment. To change the associated runtime, you must create a new connection.

To delete a model connection, refer to Deleting a model connection.

To create a new model connection, refer to Connecting models to Agentstudio.

Changing the API key for a model connection

You cannot edit the API key associated with the model connection. Instead, delete a model connection and create a new one.

Changing enabled models

You can edit which models you allow developers to attach to an agent for a specific provider connection.

  1. Navigate to Agentstudio > Agent Garden > Models.
  2. Select the Actions menu (three dots) next to the connection.
  3. Select Edit.
  4. Select and deselect models.
  5. Select Save.

Viewing deployed agents associated with a model

  1. Navigate to Agentstudio > Agent Garden > Models.
  2. Select the model connection.
  3. Select the model.
  4. Select the Deployed Agents hyperlink. A list view opens and displays the Agent Name, package version, and deployment date.

Model card showing the Deployed Agents count as a link

Deleting a model connection

To delete a model connection, you need to first undeploy any agents associated with the model connection.

  1. If the model connection is associated with deployed agents, navigate to Agentstudio > Agent Garden > Packages and Deployments. If not, skip to step 5.
  2. Select the Deployments tab.
  3. Select the Actions menu (three dots).
  4. Select Disable. Repeat for any agents associated with this model connection.
  5. Navigate to Agentstudio > Agent Garden > Models.
  6. Select the Actions menu (three dots).
  7. Select Delete.
On this Page