How to debug the logstash file plugin

Question

Is it possible to log actions of the logstash file plugin? (i.e. what files it tries to send, what errors happen, etc)

Answer 1

In new version stdout format changed

stdout { codec => rubydebug }

Answer 2

If you want to debug the process itself you may run it like this

/opt/logstash/bin/logstash -f yourconf.conf -v --debug --verbose

UPDATE: Acording to @neeraj-gupta using --debug and --verbose at the same time may cause a problem when trying to see debug logs of cloudwatch and using only --debug is enough.

Answer 3

Yes, you can see what files it tries to send, what errors happening through the output section by applying

stdout { codec => rubydebug }

Codec is responsible for giving output. So,here it outputs your event data using the ruby "awesome_print" library.

Answer 4

* * * This method of debugging is now deprecated - see Max's answer above! * * *

Try adding a stdout output with debug set to true. You should be able to see the entire event object and errors / warnings in your logstash --log or stdout.

input {
   file {
      ...
   }
}
output {
   stdout {
      debug => true
   }
   ...
}

Hope that helps!