Samza 1214: Allow users to set a default replication.factor for intermediate topics
authorJacob Maes <jmaes@linkedin.com>
Thu, 27 Apr 2017 22:05:28 +0000 (15:05 -0700)
committerJacob Maes <jmaes@linkedin.com>
Thu, 27 Apr 2017 22:05:28 +0000 (15:05 -0700)
commitf7e1736519915fc284712fd78f2ba7ed5bb55e64
tree1c397ff21a470ffca7afc925feccc48a61431d87
parent05060edfe18a47075dfe80059b0e83102063f587
Samza 1214: Allow users to set a default replication.factor for intermediate topics

* Add a new "systems.sysName.default.stream.*" config structure that allows users to set system-wide defaults for streams.
* More thorough testing of system defaults and stream defaults
* Removed the old migration config from the config table since there's no code to support it.
* Moved 2 kafka-specific config accessors out of JobConfig and into KafkaConfig
* Removed duplicate impl of getChangelogStream()

Author: Jacob Maes <jmaes@linkedin.com>

Reviewers: Jagadish <jvenkatr@linkedin.com>

Closes #141 from jmakes/samza-1214
docs/learn/documentation/versioned/jobs/configuration-table.html
samza-api/src/main/java/org/apache/samza/config/MapConfig.java
samza-core/src/main/java/org/apache/samza/config/JavaStorageConfig.java
samza-core/src/main/java/org/apache/samza/config/JavaSystemConfig.java
samza-core/src/main/scala/org/apache/samza/config/JobConfig.scala
samza-core/src/main/scala/org/apache/samza/config/StorageConfig.scala
samza-core/src/main/scala/org/apache/samza/config/StreamConfig.scala
samza-core/src/test/java/org/apache/samza/config/TestStreamConfig.java
samza-core/src/test/java/org/apache/samza/runtime/TestAbstractApplicationRunner.java
samza-kafka/src/main/scala/org/apache/samza/config/KafkaConfig.scala
samza-kafka/src/test/scala/org/apache/samza/config/TestKafkaConfig.scala