ZBrain Documentation
  • ZBrain Documentation
    • ZBrain XPLR
      • ZBrain XPLR modules
      • Get started with ZBrain XPLR
      • Simulation XPLR
        • AI solutions library
      • Taxonomy XPLR
      • Solution XPLR
      • Portfolio XPLR
      • Functional Design XPLR
    • ZBrain Builder
      • Components of ZBrain Builder
      • 📚Knowledge base
        • How to create a knowledge base?
        • Knowledge source
        • Information schema
        • File summary
        • Automated reasoning
        • Retrieval testing
        • Knowledge base settings
      • 📱App
        • How to create a new app?
          • How to leverage knowledge base for app creation
          • How to build advanced applications using Flow
        • How to set up and customize your app?
        • How to access the app reporting dashboard?
      • 🤖ZBrain AI agents
        • Get started with agents on ZBrain Builder
        • Deploying pre-built agents
        • Creating custom AI agents
          • Agent setup
          • Define input sources
          • Define Flow
            • Key elements of a Flow
            • Flow Components
              • AITable
              • Airtable
              • Amazon S3
              • Amazon SNS
              • Amazon SQS
              • Amazon Textract
              • Apify
              • Apollo
              • Approval
              • Asana
              • Azure Communication Services
              • Azure Cosmos DB
              • Azure Document Intelligence
              • Azure OpenAI
              • Azure Translation
              • Bannerbear
              • Baserow
              • Beamer
              • Bedrock Claude
              • Bettermode
              • Binance
              • Bing Search
              • Blackbaud
              • Bonjoro
              • Box
              • Brevo
              • Brilliant Directories
              • Bubble
              • CSV
              • Calendly
              • Certopus
              • Clearout
              • Clockodo
              • Code
              • Confluence
              • Connections
              • Constant Contact
              • Contiguity
              • Contentful
              • Customer.io
              • Crypto
              • Databricks
              • Data Mapper
              • Date Helper
              • DeepL
              • Delay
              • Discord
              • Discourse
              • Drip
              • Dropbox
              • Dust
              • Facebook Pages
              • Figma
              • Files Helper
              • Flowise
              • Flowlu
              • Formbricks
              • Frame
              • Freshdesk
              • Freshsales
              • GCloud Pub/Sub
              • GenerateBanners
              • GhostCMS
              • GitHub
              • GitLab
              • Gmail
              • Google Calendar
              • Google Contacts
              • Google Docs
              • Google Drive
              • Google Forms
              • Google Gemini
              • Google My Business
              • Google Search
              • Google Search Console
              • Google Sheets
              • Google Tasks
              • Groq
              • Hacker News
              • Heartbeat
              • HubSpot
              • HTTP
              • Image Helper
              • Inputs
              • Instagram for Business
              • Intercom
              • Invoice Ninja
              • Jira Cloud
              • Jotform
              • Kimai
              • Kizeo Forms
              • LeadConnector
              • Line Bot
              • Linear
              • LinkedIn
              • LinkedIn Actions
              • LLMRails
              • Lusha
              • MailerLite
              • Mailchimp
              • Mautic
              • Microsoft Dynamics 365 Business Central
              • Microsoft Dynamics CRM
              • Microsoft Excel 365
              • Microsoft OneDrive
              • Microsoft Outlook Calendar
              • Microsoft Teams
              • Mixpanel
              • MongoDB
              • Notion
              • Odoo
              • OpenAI
              • OpenRouter
              • Pastebin
              • PDF
              • Postgres
              • PostHog
              • Pushover
              • Qdrant
              • Queue
              • Razorpay
              • Router
              • Salesforce
              • SendGrid
              • ServiceNow
              • SFTP
              • SharePoint
              • Slack
              • SMTP
              • Snowflake
              • SOAP
              • Spotify
              • Stability AI
              • Stable Diffusion Web UI
              • Storage
              • Stripe
              • SurrealDB
              • SurveyMonkey
              • Taskade
              • Telegram Bot
              • Text Helper
              • Trello
              • Twilio
              • Twitter
              • Utilities
              • WhatsApp Business
              • WordPress
              • XML
              • YouTube
              • ZBrain
              • Zendesk
              • ZeroBounce
              • Zoho Books
              • Zoho CRM
              • Zoho Invoice
              • Zoom
            • How to Define a Flow?
            • How to Test Each Step in the Flow?
          • Configure Additional Settings
          • Test and Deploy Agents
          • How to access, monitor, and manage agent performance and tasks?
      • 💻Prompts
        • How to create a prompt
        • How to manage and monitor prompts
        • How to manage prompt versions and restore previous versions
        • User management: How to assign prompt permissions?
      • 📺Monitor
      • 🔐Security features
      • Settings
      • 📖API tutorials
        • 📚Knowledge base
          • Automated reasoning
        • 📱APP
        • 🤖Agents
Powered by GitBook
On this page
  • Accessing prompts
  • Browsing existing prompts
  • Searching and filtering
  • Monitoring prompt performance
  • Reviewing execution logs
  • Best practices for prompt monitoring
  1. ZBrain Documentation
  2. ZBrain Builder
  3. Prompts

How to manage and monitor prompts

PreviousHow to create a promptNextHow to manage prompt versions and restore previous versions

Last updated 9 hours ago

Once a prompt is created, it will be listed on the main interface. Follow the steps below to manage and monitor your prompts effectively.

Accessing prompts

Navigating to the prompt manager

  • Locate the main navigation bar at the top of the ZBrain interface

  • Click on the ‘Prompts’ tab to access the Prompt Manager

  • The prompt manager displays all your available prompts in a tabular format

Browsing existing prompts

The prompt manager provides a comprehensive view of all your prompts with the following information:

  • ID: Unique identifier for each prompt

  • Prompt name: Descriptive name of the prompt

  • Total runs: Number of times the prompt has been executed

  • Credits used: Number of credits consumed by the prompt

  • Total cost: Accumulated cost from all executions

  • Last updated: Timestamp of the most recent modification

  • Status: Current state of the prompt (Published/ Draft)

  • Actions: Access additional options via the three-dot menu to edit or delete a prompt.

Searching and filtering

  • Search: Use the search bar at the top to find prompts by name

  • Filter: Click the ‘Filter’ button and select show all to view all prompts, or filter by status (Published/Draft) to narrow your results.

Monitoring prompt performance

Accessing detailed analytics

  1. From the prompt manager dashboard, click on a prompt name

  2. This opens the prompt details page

  3. Use the left sidebar navigation to access different pages:

    • Prompt overview: Performance metrics and usage statistics

    • Prompt editor: Modify prompt content and settings

    • User management: Control access permissions

Understanding the analytics dashboard

The prompt overview page provides rich performance data:

Usage metrics

  • Run over time: Graph showing execution frequency by date

  • Total logs: Number of recorded executions

  • Total tokens: Cumulative token usage across all executions

  • Total cost: Aggregate expense from all executions

Performance metrics

  • Average time: Mean processing duration in seconds

  • Median time: Middle value of all processing durations

  • Median cost: Middle value of all execution costs

Version management

  • Current version information is displayed near the prompt name (e.g., "Version: 3 of 3")

  • Use the version dropdown menu to switch between different iterations of the prompt

  • Each version maintains separate analytics, allowing for performance comparison

Reviewing execution logs

Prompt logs table

The detailed logs section provides a comprehensive record of each prompt execution:

Request ID

Unique identifier for each execution instance

Date and Time

When the prompt was executed (e.g., "2 mins ago")

Entity

The context where the prompt was used (e.g., "App", "Playground")

Entity Name

Specific entity identifier (e.g., "HR policy query app")

Evaluations

Any evaluation metrics

Duration

Execution time in seconds

Tokens

Number of tokens consumed in this execution

Cost

The financial cost of this specific execution

You can sort these logs by clicking on any column header to organize entries by that attribute. (e.g., by date, duration, tokens, or cost)

Best practices for prompt monitoring

Regular performance review

  • Monitor total cost and token usage to optimize budget allocation

  • Track execution times to identify performance bottlenecks

  • Compare performance across different versions to validate improvements

Cost optimization

  • Identify high-cost prompts and consider optimization opportunities

  • Analyze token usage patterns to refine prompt efficiency

  • Monitor median costs to establish baseline expectations for similar prompts

Usage pattern analysis

  • Use the ‘Run over time’ graph to identify usage patterns and peaks

  • Track which entities are most frequently using specific prompts

  • Identify underutilized prompts that might need upgrading or removal.

Troubleshooting

  • Investigate abnormal duration times that might indicate performance issues

  • Monitor for sudden increases in token usage that could signal inefficiencies

  • Check entity usage patterns to ensure prompts are being used as intended

By effectively leveraging these monitoring capabilities, teams can ensure their prompts remain performant, cost-effective, and aligned with business objectives.

💻