This project is not maintained anymore! It has been marked as dormant by Apache Logging Services consensus on 2024-10-10. Users are advised to migrate to alternatives. For other inquiries, see the support policy.
Apache Flume Apache Software Foundation

Version 1.8.0

Status of this release

Apache Flume 1.8.0 is the eleventh release of Flume as an Apache top-level project (TLP). Apache Flume 1.8.0 is production-ready software.

Release Documentation

Changes

Release Notes - Flume - Version v1.8.0

** New Feature
  • [FLUME-2171] - Add Interceptor to remove headers from event
  • [FLUME-2917] - Provide netcat UDP source as alternative to TCP
  • [FLUME-2993] - Support environment variables in configuration files
** Improvement
  • [FLUME-1520] - Timestamp interceptor should support custom headers
  • [FLUME-2945] - Bump java target version to 1.8
  • [FLUME-3020] - Improve HDFSEventSink Escape Ingestion by more then 10x by not getting InetAddress on every record
  • [FLUME-3025] - Expose FileChannel.open on JMX
  • [FLUME-3072] - Add IP address to headers in flume log4j appender
  • [FLUME-3092] - Extend the FileChannel’s monitoring metrics
  • [FLUME-3100] - Support arbitrary header substitution for topic of Kafka
  • [FLUME-3144] - Improve Log4jAppender’s performance by allowing logging collection of messages
** Bug
  • [FLUME-2620] - File channel throws NullPointerException if a header value is null
  • [FLUME-2752] - Flume AvroSource will leak the memory and the OOM will be happened.
  • [FLUME-2812] - Exception in thread “SinkRunner-PollingRunner-DefaultSinkProcessor” java.lang.Error: Maximum permit count exceeded
  • [FLUME-2857] - Kafka Source/Channel/Sink does not restore default values when live update config
  • [FLUME-2905] - NetcatSource - Socket not closed when an exception is encountered during start() leading to file descriptor leaks
  • [FLUME-2991] - ExecSource command execution starts before starting the sourceCounter
  • [FLUME-3027] - Kafka Channel should clear offsets map after commit
  • [FLUME-3031] - sequence source should reset its counter for event body on channel exception
  • [FLUME-3043] - KafkaSink SinkCallback throws NullPointerException when Log4J level is debug
  • [FLUME-3046] - Kafka Sink and Source Configuration Improvements
  • [FLUME-3049] - Wrapping the exception into SecurityException in UGIExecutor.execute hides the original one
  • [FLUME-3057] - Build fails due to unsupported snappy-java version on ppc64le
  • [FLUME-3080] - Close failure in HDFS Sink might cause data loss
  • [FLUME-3083] - Taildir source can miss events if file updated in same second as file close
  • [FLUME-3085] - HDFS Sink can skip flushing some BucketWriters, might lead to data loss
  • [FLUME-3112] - Upgrade jackson-core library dependency
  • [FLUME-3127] - Upgrade libfb303 library dependency
  • [FLUME-3131] - Upgrade spring framework library dependencies
  • [FLUME-3132] - Upgrade tomcat jasper library dependencies
  • [FLUME-3135] - property logger in org.apache.flume.interceptor.RegexFilteringInterceptor confused
  • [FLUME-3141] - Small typo found in RegexHbaseEventSerializer.java
  • [FLUME-3152] - Add Flume Metric for Backup Checkpoint Errors
  • [FLUME-3155] - Use batch mode in mvn to fix Travis CI error
  • [FLUME-3157] - Refactor TestHDFSEventSinkOnMiniCluster to not use LeaseManager private API
  • [FLUME-3173] - Upgrade joda-time
  • [FLUME-3174] - HdfsSink AWS S3A authentication does not work on JDK 8
  • [FLUME-3175] - Javadoc generation fails due to Java8’s strict doclint
** Documentation
  • [FLUME-2175] - Update Developer Guide with notes on how to upgrade Protocol Buffer version
  • [FLUME-2817] - Sink for multi-agent flow example in user guide is set up incorrectly
** Wish
  • [FLUME-2579] - JMS source support durable subscriptions and message listening
** Question
  • [FLUME-2427] - java.lang.NoSuchMethodException and warning on HDFS (S3) sink
** Task
  • [FLUME-3093] - Groundwork for version changes in root pom
  • [FLUME-3154] - Add HBase client version check to AsyncHBaseSink and HBaseSink
** Test
  • [FLUME-2997] - Fix flaky junit test in SpillableMemoryChannel
  • [FLUME-3002] - Some tests in TestBucketWriter are flaky