(v22) Configure Unified Logging Using Fluentd

Configure Unified Logging Using Fluentd

For information and steps on installing Fluentd, refer to Fluentd's installation documentation. If Fluentd is not installed on the same server as the Composer, you will need to obtain the host and port numbers for the Fluentd server.

This section provides describes how

to configure Fluentd to log Composer log data.

Configure Fluentd for logging Composer log data:

1. Run the following command on the server where Composer is installed to install td-agent on that server.

   curl -L https://toolbelt.treasuredata.com/sh/install-redhat-td-agent3.sh

2. Browse to the /etc folder on the Composer server to verify that td-agent is installed in the /etc/td-agent folder.

3. Install the Fluentd plugin for the data store you are using to store your Fluentd logs. Refer to your Fluentd documentation for more information.

   For example, if you are using an Elasticsearch database to store Fluentd logs. run the following command to install the Fluentd Elasticsearch plugin on the Composer server.

   sudo td-agent-gem install fluent-plugin-elasticsearch

4. Modify the td-agent.conf file in the /etc/td-agent folder using the following template.

   The following is an example of td-agent.conf using an Elasticsearch database for Fluentd logs.

   <source>
      @type forward
      port <fluentd_port>
      bind 0.0.0.0
   </source>
   <match *.**>
      @type copy
      <store>
         @type elasticsearch
         host <elasticsearch_host>
         port <elasticsearch_port>
         user <elasticsearch-user>
         password <elasticsearch-password>
         logstash_format true
         logstash_prefix composer-unified-log
         logstash_dateformat %Y%m%d
         include_tag_key true
         index_name composer-unified-log
         type_name composer-unified-log
         tag_key @log_name
         flush_interval 1s
      </store>
      <store>
         @type stdout
      </store>
   </match>

5. Restart td-agent.

   systemctl restart td-agent

6. Complete the steps described inEnable Unified Logging in Composer Using Fluentd to enable Fluentd logging by Composer.