Fluentd Blog

Fluentd v0.12.18 has been released

Hi users!

We have released Fluentd version 0.12.18. Here are the changes:

New features / Enhancement

• in_exec: Stop in_exec immediately at shutdown: 526
• in_exec: Support built-in text parsers: 704
• out_forward: raises ZeroDivisionError when no is available: 707
• Add process_name parameter in system to change fluentd's process name: 708
• test: Add ParserTestDriver: 702
• test: Add FormatterTestDriver: 712
• Add parameter description to built-in plugins

Bug fixes

• fix bug not to protect in-memory-buffer for multi thread emitting / run loop: 710
• in_tail: expand_paths exclude unreadable files: 734

process_name parameter in <system>

You can specify process_name to change fluentd's process title.

<system>
  process_name foo
</system>

ps result is changed like below.

• with process_name

% ps aux | grep foo
repeatedly      45673   0.4  0.2  2523252  38620 s001  S+    7:04AM   0:00.44 worker:foo
repeatedly      45647   0.0  0.1  2481260  23700 s001  S+    7:04AM   0:00.40 supervisor:foo

• without process_name

% ps aux | grep fluentd
repeatedly       3605   0.0  0.1  2503756  21876 s004  S+    7:06AM   0:00.08 ruby /path/to/fluentd -c foo.conf
repeatedly       3579   0.0  0.2  2501648  27492 s004  S+    7:06AM   0:00.39 ruby /path/to/fluentd -c foo.conf

This feature needs Ruby 2.1 or later.

in_exec: Support text parsers

in_exec now supports built-in text parsers excluding multiline in format parameters.

<source>
  @type exec
  format /regex for your script result/
  ...
</source>

No need filter script for converting text to json/tsv/msgpack anymore.

Add parameter description to built-in plugins

We introduced --show-plugin-config option to show plugin parameters at v0.12.16. Since this version, the result contains the description of each parameters. Here is in_tail result:

% fluentd --show-plugin-config=input:tail
2015-12-10 19:24:06 +0900 [info]: Show config for input:tail
2015-12-10 19:24:06 +0900 [info]:
log_level: string: <nil> # Allows the user to set different levels of logging for each plugin.
path: string: <nil> # The paths to read. Multiple paths can be specified, separated by comma.
tag: string: <nil> # The tag of the event.
exclude_path: array: <[]> # The paths to exclude the files from watcher list.
rotate_wait: time: <5> # Specify interval to keep reference to old file when rotate a file.
pos_file: string: <nil> # Fluentd will record the position it last read into this file.
read_from_head: bool: <false> # Start to read the logs from the head of file, not bottom.
refresh_interval: time: <60> # The interval of refreshing the list of watch file.
read_lines_limit: integer: <1000> # The number of reading lines at each IO.

You can easy to check supported parameters.

Lastly, v0.12.18 docker image has also been available on Docker Hub.

Happy logging!