Fluent Bit: http output not sending POST request for each json log line #11311
Description
Bug Report
Describe the bug
I am using fluentbit http output plugin to send vault logs to graylog.
I have GELF HTTP input configured on graylog which allows sending logs via a POST request. The ingested log should be in the GELF format and necessary fields need to be present.
Vault audit logs are of two types request and response.
With HTTP plugin and format json_lines only the request types logs are being send to graylog.
The response type logs are silently skipped. There is only one POST request is shown in the fluentbit log for the http output plugin however there are 2 line separated json entries in the log file.
I am using tail plugin, in the similar setup I have S3 output configured and both the json line logs are getting stored with in the same fluentbit env.
Also, one thing to notice is if I manually add/append response type audit log json to end of the file the http output sends log to graylog. It shows there is nothing misconfigured or configuration issue with graylog or the type os json log. Graylog is able to parse and index it.
It seems when the request response logs are generated the http plugin only picking first line and skipping second.
If I make 10 subsequent request which should generate 20 log lines each request and response in graylog it is only showing all 10 request logs but no response log. However, on S3 getting all 20 log lines.