Syslog and Kafka message size limits (QUX)

  • Log messages that are generated by your Vectra platform are truncated at 16,384 bytes (16KB) before transport.

    • This remains true regardless of the chosen transport mechanism, port, protocol, or format and happens internally in the Vectra platform before being passed on to other components that forward the logs to your receiver.

  • As a result, some messages may be missing expected fields as a result of this when truncation occurs.

    • An example would be when many long domain names are included in a Match log message, not all data may be transmitted.

  • Additionally Syslog messages sent over SSL may be truncated or dropped on the receiver side per RFC.

    • For this reason, TCP is greatly preferred, and TLS/SSL should only be used when required.

    • Receivers who respect the RFC typically truncate syslog messages over SSL at 4 or 8 KB.

  • Using UDP is not recommended as most configurations have a 1KB default message size limit and can cause excessive truncation and message drops.

Last updated

Was this helpful?