fluent/fluentd — Issue #10: fluentd 0.10.1 cannot parse apache acceess log?
Author: CkReal
Created: 2011-10-18 02:27:29+00:00
State: open

I am testing fluentd 0.10.1.

It cannnot transfer apache access log since 0.10.1 update.
#I looked that fluentd is failed parse apache access log.

transfer server(apache) -- fluentd --> receive server

Following is my environmment and stack trace.

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
[environment]
-transfer server
OS：CentOS5.6
fluentd：0.10.1
apache：2.2.3

-receive server
OS：CentOS6.0
fluentd：0.10.1
fluent-plugin-mongo：0.4.0

[stack trace]
Error log is output at receive server.

2011-10-18 10:30:26 +0900: plugin/in_stream.rb:110:initialize: accepted fluent socket object_id=19531740
2011-10-18 10:30:26 +0900: fluent/engine.rb:103:rescue in emit_stream: emit transaction faild error="undefined method `[]=' for nil:NilClass"
2011-10-18 10:30:26 +0900: fluent/engine.rb:104:rescue in emit_stream: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.1/lib/fluent/mixin.rb:150:in `filter_record'
2011-10-18 10:30:26 +0900: fluent/engine.rb:104:rescue in emit_stream: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.1/lib/fluent/mixin.rb:96:in `block in format_stream'
2011-10-18 10:30:26 +0900: fluent/engine.rb:104:rescue in emit_stream: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.1/lib/fluent/event.rb:127:in `feed_each'
2011-10-18 10:30:26 +0900: fluent/engine.rb:104:rescue in emit_stream: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.1/lib/fluent/event.rb:127:in `each'
2011-10-18 10:30:26 +0900: fluent/engine.rb:104:rescue in emit_stream: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.1/lib/fluent/mixin.rb:95:in `format_stream'
2011-10-18 10:30:26 +0900: fluent/engine.rb:104:rescue in emit_stream: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.1/lib/fluent/output.rb:311:in `emit'
2011-10-18 10:30:26 +0900: fluent/engine.rb:104:rescue in emit_stream: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.1/lib/fluent/match.rb:38:in `emit'
2011-10-18 10:30:26 +0900: fluent/engine.rb:104:rescue in emit_stream: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.1/lib/fluent/engine.rb:101:in `emit_stream'
2011-10-18 10:30:26 +0900: fluent/engine.rb:104:rescue in emit_stream: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.1/lib/fluent/plugin/in_stream.rb:81:in `on_message'
2011-10-18 10:30:26 +0900: fluent/engine.rb:104:rescue in emit_stream: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.1/lib/fluent/plugin/in_stream.rb:139:in `feed_each'
2011-10-18 10:30:26 +0900: fluent/engine.rb:104:rescue in emit_stream: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.1/lib/fluent/plugin/in_stream.rb:139:in `on_read_msgpack'
2011-10-18 10:30:26 +0900: fluent/engine.rb:104:rescue in emit_stream: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.1/lib/fluent/plugin/in_stream.rb:131:in `call'
2011-10-18 10:30:26 +0900: fluent/engine.rb:104:rescue in emit_stream: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.1/lib/fluent/plugin/in_stream.rb:131:in `on_read'
2011-10-18 10:30:26 +0900: fluent/engine.rb:104:rescue in emit_stream: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/cool.io-1.0.0/lib/cool.io/io.rb:108:in `on_readable'
2011-10-18 10:30:26 +0900: fluent/engine.rb:104:rescue in emit_stream: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/cool.io-1.0.0/lib/cool.io/io.rb:170:in `on_readable'
2011-10-18 10:30:26 +0900: fluent/engine.rb:104:rescue in emit_stream: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/cool.io-1.0.0/lib/cool.io/loop.rb:96:in `run_once'
2011-10-18 10:30:26 +0900: fluent/engine.rb:104:rescue in emit_stream: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/cool.io-1.0.0/lib/cool.io/loop.rb:96:in `run'
2011-10-18 10:30:26 +0900: fluent/engine.rb:104:rescue in emit_stream: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.1/lib/fluent/plugin/in_stream.rb:46:in `run'
2011-10-18 10:30:26 +0900: plugin/in_stream.rb:48:rescue in run: unexpected error error="undefined method `[]=' for nil:NilClass"
2011-10-18 10:30:26 +0900: plugin/in_stream.rb:49:rescue in run: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.1/lib/fluent/mixin.rb:150:in `filter_record'
2011-10-18 10:30:26 +0900: plugin/in_stream.rb:49:rescue in run: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.1/lib/fluent/mixin.rb:96:in `block in format_stream'
2011-10-18 10:30:26 +0900: plugin/in_stream.rb:49:rescue in run: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.1/lib/fluent/event.rb:127:in `feed_each'
2011-10-18 10:30:26 +0900: plugin/in_stream.rb:49:rescue in run: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.1/lib/fluent/event.rb:127:in `each'
2011-10-18 10:30:26 +0900: plugin/in_stream.rb:49:rescue in run: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.1/lib/fluent/mixin.rb:95:in `format_stream'
2011-10-18 10:30:26 +0900: plugin/in_stream.rb:49:rescue in run: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.1/lib/fluent/output.rb:311:in `emit'
2011-10-18 10:30:26 +0900: plugin/in_stream.rb:49:rescue in run: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.1/lib/fluent/match.rb:38:in `emit'
2011-10-18 10:30:26 +0900: plugin/in_stream.rb:49:rescue in run: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.1/lib/fluent/engine.rb:101:in `emit_stream'
2011-10-18 10:30:26 +0900: plugin/in_stream.rb:49:rescue in run: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.1/lib/fluent/plugin/in_stream.rb:81:in `on_message'
2011-10-18 10:30:26 +0900: plugin/in_stream.rb:49:rescue in run: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.1/lib/fluent/plugin/in_stream.rb:139:in `feed_each'
2011-10-18 10:30:26 +0900: plugin/in_stream.rb:49:rescue in run: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.1/lib/fluent/plugin/in_stream.rb:139:in `on_read_msgpack'
2011-10-18 10:30:26 +0900: plugin/in_stream.rb:49:rescue in run: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.1/lib/fluent/plugin/in_stream.rb:131:in `call'
2011-10-18 10:30:26 +0900: plugin/in_stream.rb:49:rescue in run: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.1/lib/fluent/plugin/in_stream.rb:131:in `on_read'
2011-10-18 10:30:26 +0900: plugin/in_stream.rb:49:rescue in run: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/cool.io-1.0.0/lib/cool.io/io.rb:108:in `on_readable'
2011-10-18 10:30:26 +0900: plugin/in_stream.rb:49:rescue in run: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/cool.io-1.0.0/lib/cool.io/io.rb:170:in `on_readable'
2011-10-18 10:30:26 +0900: plugin/in_stream.rb:49:rescue in run: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/cool.io-1.0.0/lib/cool.io/loop.rb:96:in `run_once'
2011-10-18 10:30:26 +0900: plugin/in_stream.rb:49:rescue in run: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/cool.io-1.0.0/lib/cool.io/loop.rb:96:in `run'
2011-10-18 10:30:26 +0900: plugin/in_stream.rb:49:rescue in run: /usr/local/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.1/lib/fluent/plugin/in_stream.rb:46:in `run'

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Please help me.