LLMRails

LLMRails is a platform designed for large language model applications, providing infrastructure and tools to deploy and manage AI models effectively in a scalable environment. It specializes in facilitating advanced search, analysis, and interaction capabilities with large datasets.

How to Connect LLMRails to ZBrain Flow?

To integrate LLMRails with ZBrain Flow, follow these steps to select and utilize the desired capabilities:

1. Search for the Math Helper Component: Search the LLMRails component within the ZBrain interface.

2. Select the Required Capability: Select the required component as per your requirement:

• Datastore search: Search in datastore

• Custom API Call: Send a custom API call to a specific endpoint.

Additional Settings for Datastore Search

• API Key: Enter your LLM Rails API key to authenticate the request.

• Setup a connection: Choose the API connection setup for LLM Rails. Follow these instructions to get your LLMRails API Key:

  • Website Link: Visit the following website: https://console.llmrails.com/api-keys.

  • Create a Key: Once on the website, click on create a key. Once you have created a key, copy it and use it for the Api key field on the site.

  • Connection Name: Enter a custom name for your LLMRails connection.

  • API Key: Provide your LLMRails API key for authentication.

• Datastore ID: Specify the ID of the datastore you wish to search.

• Text: Input the text or query for the datastore search.

• Hybrid Search: Opt to use hybrid search, which combines dense and sparse embeddings.

• Summarize: Choose if the search results should be summarized.

• Continue on Failure: Enable this option to continue execution even if the search fails.

• Retry on Failure: Set to retry the operation up to four times if it fails initially.

Additional Settings for Custom API Calls

• API Key – Select your LLMRails API connection for authentication.

• Setup a connection: Choose the API connection setup for LLM Rails. Follow these instructions to get your LLMRails API Key:

  • Website Link: Visit the following website: https://console.llmrails.com/api-keys.

  • Create a Key: Once on the website, click on create a key. Once you have created a key, copy it and use it for the Api key field on the site.

  • Connection Name: Enter a custom name for your LLMRails connection.

  • API Key: Provide your LLMRails API key for authentication.

• URL – Specify the API endpoint to interact with LLMRails (e.g., /models).

• Method – Choose the HTTP method (GET, POST, etc.) for the API request.

• Headers – Add key-value pairs for additional request headers.

• Query Parameters – Provide optional URL query parameters for the request.

• Body – Enter the request payload in JSON format if required.

• No Error on Failure – Enable to prevent failure from stopping the workflow.

• Timeout (in seconds) – Set the time limit for the API request execution.