Set Up Log Ingestion with Spectro Cloud Palette

This page describes how to set up Kubernetes® Log Ingestion using the Spectro Cloud® Palette user interface. The Log Collector is installed when you install Kubernetes and App Service Monitoring, but is disabled by default. 

Before You Begin

Ensure that you meet the following requirements:

• You have installed Kubernetes and App Service Monitoring using Spectro Cloud Palette. You should have a Cluster Profile that contains the Splunk AppDynamics add-on packs.
• Filebeat is not installed on your cluster. If Filebeat is running on your cluster, uninstall it. You cannot use an existing Filebeat deployment with the Log Collector.

We recommend starting log-generating applications on your cluster before you begin the steps on this page. You can also start log-generating applications after log ingestion has been set up and deployed.

Supported Data Sources and Log Formats

• Application logs in any of these formats: 
  • log4J
  • logback
  • timestamp -- See supported timestamp formats in Log Collector Settings.
  • json
  • grok

• Infrastructure logs in any of these formats:
  • Native klog 
  • json

Set Up Log Ingestion Using Spectro Cloud Palette

1. Log into the Spectro Cloud Palette console. 
2. In the left-hand navigation panel, click Profiles. 
3. Select the Cluster Profile that contains the Splunk AppDynamics Operator and Collector add-on packs.
4. Expand the drop-down menu next to the profile name. Click Create new version. 
5. Click the Splunk AppDynamics Collectors layer. The values file is now displayed.
6. Locate the appdynamics-cloud-k8s-monitoring > install section. Change the value of logCollector to true.
7. (Optional) Set parameters for logCollectorPod.
8. (Optional) Under appdynamics-cloud-k8s-monitoring, add the logCollectorConfig key. You can copy and paste the key from the sample on Log Collector Settings.
   1. (Optional) Under logCollectorConfig, set optional defaults and parameters. For additional settings, see Log Collector Settings.
9. Click Save Changes.
10. In the left-hand navigation panel, click Clusters.
11. Click the cluster that you want to enable log ingestion on.
12. Click the Profile tab. Under ADDON LAYERS, locate the Cluster Profile with the Splunk AppDynamics packs. 
13. Expand the drop-down menu and select the new version of the Cluster Profile that contains the new settings.
14. Click Save.
15. If you are not already running log-generating applications in your cluster, start the applications to begin log ingestion.

Spectro Cloud® is a registered trademark of Spectro Cloud, Inc. Mention of Spectro Cloud products or services is for informational purposes only and constitutes neither an endorsement nor a recommendation of such products or services.

Kubernetes® is a trademark of The Linux Foundation®.