flowcounter doesn't output data

[hbyandy]

I use fluent-plugin-beats + fluent-plugin-flowcounter + fluent-plugin-elasticsearch as a beats process model，and i want a per second bytes data of diskio from metricbeat.
so my td-agent's conf is:

<source>
  @type beats
  bind 0.0.0.0
  port 5044
  max_connections 10
  #metadata_as_tag
  tag beat.to.fluentd
</source>

<match beat.to.fluentd>
  @type copy
  <store>
    @type file
    path /var/log/td-agent/test1
    time_slice_format %Y%m%d
    time_slice_wait 10m
    time_format %Y%m%dT%H%M%S%z
    compress gzip
    utc
    log_level debug
  </store>
  <store>
    @type flowcounter
    unit second
    aggregate all
    tag fluentd.traffic
  </store>
</match>
# Forward all events from beats to each index on elasticsearch
<match fluentd.traffic>
  @type elasticsearch
  host 192.168.199.193
  port 9200
  index_name test_metricbeat
  type_name test_merticbeat
  logstash_format true
  utc_index true
  include_tag_key true
</match>
<match fluentd.traffic>
  @type copy
  <store>
    @type file
    path /var/log/td-agent/test2
    time_slice_format %Y%m%d
    time_slice_wait 10m
    time_format %Y%m%dT%H%M%S%z
    compress gzip
    utc
  </store>
</match>

Here is a list of plugins and versions:

2017-04-20 11:33:51 +0800 [info]: reading config file path="/etc/td-agent/td-agent.conf"
2017-04-20 11:33:51 +0800 [info]: starting fluentd-0.12.31
2017-04-20 11:33:51 +0800 [info]: gem 'fluent-mixin-config-placeholders' version '0.4.0'
2017-04-20 11:33:51 +0800 [info]: gem 'fluent-mixin-plaintextformatter' version '0.2.6'
2017-04-20 11:33:51 +0800 [info]: gem 'fluent-plugin-beats' version '0.1.2'
2017-04-20 11:33:51 +0800 [info]: gem 'fluent-plugin-elasticsearch' version '1.9.3'
2017-04-20 11:33:51 +0800 [info]: gem 'fluent-plugin-flowcounter' version '0.4.2'
2017-04-20 11:33:51 +0800 [info]: gem 'fluent-plugin-kafka' version '0.4.1'
2017-04-20 11:33:51 +0800 [info]: gem 'fluent-plugin-mongo' version '0.7.16'
2017-04-20 11:33:51 +0800 [info]: gem 'fluent-plugin-rewrite-tag-filter' version '1.5.5'
2017-04-20 11:33:51 +0800 [info]: gem 'fluent-plugin-s3' version '0.8.0'
2017-04-20 11:33:51 +0800 [info]: gem 'fluent-plugin-scribe' version '0.10.14'
2017-04-20 11:33:51 +0800 [info]: gem 'fluent-plugin-td' version '0.10.29'
2017-04-20 11:33:51 +0800 [info]: gem 'fluent-plugin-td-monitoring' version '0.2.2'
2017-04-20 11:33:51 +0800 [info]: gem 'fluent-plugin-webhdfs' version '0.4.2'
2017-04-20 11:33:51 +0800 [info]: gem 'fluentd' version '0.12.31'
2017-04-20 11:33:51 +0800 [info]: adding match pattern="beats_data" type="flowcounter"
2017-04-20 11:33:51 +0800 [info]: adding match pattern="flowcounter_beats_data" type="elasticsearch"
2017-04-20 11:33:51 +0800 [info]: adding match pattern="flowcounter_beats_data" type="copy"
2017-04-20 11:33:51 +0800 [info]: adding source type="beats"

my problem :
test1 file can receive output data,but test2 file and elasticsearch can't receive any data,so i think that “beat.to.fluentd” tag can match data sended by metricbeat, but flowcounter doesn't produce any data ,

[tagomoris]

Your log shows different pattern from your configuration:

• configuration uses tags of beat.to.fluentd and fluentd.traffic(twice! - latter one will be ignored)
• log shows match sections for beats_data and flowcounter_beats_data(twice too)

Could you show me the latest log lines?