flume单实例和集群收集的数据是否有序?flume往两个kafka丢数据,怎么flume所在的kafka集群能接收到数据,另一个kafka集群接收不到数据,,,都是内网,网段都一样,,,是不是ssh的原因啊?
flume.conf
a1表示代理名称
a1.sources = s1
a1.channels = c1 c2
a1.sinks = k1 k2
设置sources
a1.sources.s1.type = netcat
a1.sources.s1.bind =172.8.10.143
a1.sources.s1.port = 1555
a1.sources.s1.channels = c1 c2
设置c1
a1.sinks.k1.channel = c1
a1.channels.c1.type = memory
a1.channels.c1.capacity = 10000
a1.channels.c1.transactionCapacity = 100
设置c2
a1.sinks.k2.channel = c2
a1.channels.c2.type = memory
a1.channels.c2.capacity = 10000
a1.channels.c2.transactionCapacity = 100
设置s1
a1.sinks.k1.type= org.apache.flume.sink.kafka.KafkaSink
a1.sinks.k1.brokerList=172.8.10.140:6667
a1.sinks.k1.topic=kafkatest
a1.sinks.k1.serializer.class=kafka.serializer.StringEncoder
设置s2
a1.sinks.k2.type= org.apache.flume.sink.kafka.KafkaSink
a1.sinks.k2.brokerList=172.8.10.143:6667
a1.sinks.k2.topic=kafkatest
a1.sinks.k2.serializer.class=kafka.serializer.StringEncoder