Splunk AppDynamics Python Agent helps you monitor the AWS Bedrock usage and related metrics. It monitors the converse andconverse_stream requests created using the Boto3 library.
The following metrics are reported at the application, tier, and node levels:
Input Tokens
Completion Tokens
Tokens
Latency
Calls per minute
Prerequisites
Python agent supports the Boto3 for AWS Bedrock in Splunk AppDynamics. For more information, see Boto3 documentation.
Ensure that you meet the following prerequisites to monitor the AWS Bedrock exit calls with Splunk AppDynamics:
The preceding command prompts you to specify the dashboard type (application or tier) that you want to create.
Based on your selected dashboard type, you will be prompted to specify the following dashboard details.
Variable
Description
Default
Possible Values
Required
Dashboard Name
Dashboard Title that is displayed in Dashboard and Reports.
bedrock_app_dashboard
bedrock_app_dashboard
Optional
Application Name
Name of the Application with bedrock backend calls.
bedrock_app
None
Yes
Variable
Description
Default
Possible Values
Required
Dashboard Name
Dashboard Title that is displayed in Dashboard and Reports.
bedrock_app_dashboard
bedrock_app_dashboard
Optional
Application Name
Name of the Application with bedrock backend calls.
bedrock_app
None
Yes
Model Name
Name of the Model which you want to monitor.
amazon-titan-dashbaord
None
Yes
If Model Name has special characters, you must replace them with hyphens ( - ). For example, if the model name is "amazon-titan-lite:1", change the name to "amazon-titan-lite-1".
Navigate to Tiers & Nodes > My Dashboards and create a dashboard for the selected application by copying and pasting widgets from the existing dashboard for easier navigation.