samza.git
2 years agoFix hyphens in url for committer instructions
Jacob Maes [Fri, 17 Feb 2017 23:37:22 +0000 (15:37 -0800)] 
Fix hyphens in url for committer instructions

2 years agoSAMZA-1075: Refactor SystemAdmin Interface to expose a common method to create streams
Jacob Maes [Fri, 17 Feb 2017 20:49:19 +0000 (12:49 -0800)] 
SAMZA-1075: Refactor SystemAdmin Interface to expose a common method to create streams

Author: Jacob Maes <jmaes@linkedin.com>

Reviewers: Yi Pan (Data Infrastructure) <nickpan47@gmail.com>

Closes #53 from jmakes/samza-1075

2 years agoSAMZA-1073: moving all operator classes into samza-core
Yi Pan (Data Infrastructure) [Thu, 16 Feb 2017 23:04:01 +0000 (15:04 -0800)] 
SAMZA-1073: moving all operator classes into samza-core

2 years agoSAMZA-1086; New Grouper for ZK based standalone.
Boris Shkolnik [Thu, 16 Feb 2017 19:40:12 +0000 (11:40 -0800)] 
SAMZA-1086; New Grouper for ZK based standalone.

SAMZA-1086.
Create new grouper with support for arbitrary container ids.
Add support for this list of container IDs in the JobModelManager.

Author: Boris Shkolnik <bshkolni@bshkolni-ld1.linkedin.biz>

Reviewers: Xinyu Liu <xiliu@linkedin.com>, Fred Ji <fredji97@yahoo.com>

Closes #52 from sborya/JobModel

2 years agoSAMZA-1073: top-level fluent API
Yi Pan (Data Infrastructure) [Thu, 16 Feb 2017 18:18:09 +0000 (10:18 -0800)] 
SAMZA-1073: top-level fluent API

`Initial draft of top-level fluent API for operator DAGs

Author: Yi Pan (Data Infrastructure) <nickpan47@gmail.com>

Reviewers: Xinyu Liu <xiliu@linkedin.com>, Jacob Maes <jmaes@linkedin.com>, Prateek Maheshwari <pmaheshw@linkedin.com>

Closes #51 from nickpan47/samza-fluent-api-v1 and squashes the following commits:

001be63 [Yi Pan (Data Infrastructure)] SAMZA-1073: Addressing review feedbacks. Change StreamGraphFactory to StreamGraphBuilder.
373048a [Yi Pan (Data Infrastructure)] SAMZA-1073: top-level fluent API `

2 years agoSAMZA-1087: Schedule after debounce time
Boris Shkolnik [Thu, 16 Feb 2017 01:17:01 +0000 (17:17 -0800)] 
SAMZA-1087: Schedule after debounce time

SAMZA-1087: Allows scheduling an action (a Runnable) after some de-bounce delay.

Author: Boris Shkolnik <bshkolni@bshkolni-ld1.linkedin.biz>
Author: Boris Shkolnik <boryas@apache.org>

Reviewers: Navina Ramesh <navina@apache.org>, Fred Ji <fji@linkedin.com>

Closes #49 from sborya/ScheduleAfterDebounceTime1

2 years agoSAMZA-1082 : Implement Leader Election using ZK
navina [Mon, 13 Feb 2017 21:32:06 +0000 (13:32 -0800)] 
SAMZA-1082 : Implement Leader Election using ZK

Simple implementation of leader election recipe along with unit tests

Author: navina <navina@apache.org>

Reviewers: Xinyu Liu <xinyuliu.us@gmail.com>, Fred Ji <fji@linkedin.com>

Closes #48 from navina/LeaderElector

2 years agoSAMZA-1083 Do not load task stores which are older than delete tombstones during...
Shanthoosh Venkataraman [Thu, 9 Feb 2017 00:07:27 +0000 (16:07 -0800)] 
SAMZA-1083 Do not load task stores which are older than delete tombstones during container startup

2 years agoFix integration test config issue in 0.12 release candidate release-0.12.0-rc2
vjagadish1989 [Mon, 6 Feb 2017 23:39:56 +0000 (15:39 -0800)] 
Fix integration test config issue in 0.12 release candidate

2 years agoFix javadoc issues introduced by Hdfs consumer release-0.12.0-rc1
Xinyu Liu [Thu, 2 Feb 2017 22:31:23 +0000 (14:31 -0800)] 
Fix javadoc issues introduced by Hdfs consumer

2 years agoUpdate Samza version to prepare for 0.12.0 Samza release
vjagadish1989 [Thu, 2 Feb 2017 22:09:40 +0000 (14:09 -0800)] 
Update Samza version to prepare for 0.12.0 Samza release

2 years agoAdd release PGP keys for Jagadish <jagadish@apache.org> release-0.12.0-rc0
vjagadish1989 [Wed, 1 Feb 2017 21:37:23 +0000 (13:37 -0800)] 
Add release PGP keys for Jagadish <jagadish@apache.org>

2 years agoUpdate README.md to point to the most recent hello-samza release
vjagadish1989 [Tue, 31 Jan 2017 23:36:18 +0000 (15:36 -0800)] 
Update README.md to point to the most recent hello-samza release

2 years agoSAMZA-1080 : Initial Standalone JobCoordinator and StreamProcessor API
navina [Tue, 31 Jan 2017 02:30:02 +0000 (18:30 -0800)] 
SAMZA-1080 : Initial Standalone JobCoordinator and StreamProcessor API

This patch contains changes associated with the Standalone StreamProcessor, where there is no coordination. This will work for load-balanced consumers like new Kafka consumer and statically partitioned cases.

Additionally, we have introduced TaskFactory for StreamTask and AsyncStreamTask.

Author: navina <navina@apache.org>

Reviewers: xinyuiscool,fredji97

Closes #44 from navina/Noop-JC

2 years agoSAMZA-1074; Fix builds for hello-samza on various CDH versions
Dongkyu Hwangbo [Mon, 30 Jan 2017 23:56:56 +0000 (15:56 -0800)] 
SAMZA-1074; Fix builds for hello-samza on various CDH versions

This issue is mainly related of hello-samza, but modification of document is needed to help user understand this process well.

Author: Dongkyu Hwangbo <hwangbodk@gmail.com>

Reviewers: jvenkatr

Closes #38 from dkhwangbo/SAMZA-1074

2 years agoSAMZA-1079: Add timeouts for reads from HttpFileSystem. Add tests.
vjagadish1989 [Mon, 30 Jan 2017 23:10:06 +0000 (15:10 -0800)] 
SAMZA-1079: Add timeouts for reads from HttpFileSystem. Add tests.

* Wrote a unit/integration test to simulate a stuck connection when reading binaries for the job.
Other misc. changes:
- Moved some debug log messages to be info for better debugging.

Author: vjagadish1989 <jvenkatr@linkedin.com>

Reviewers: jmakes,nickpan47

Closes #42 from vjagadish/http-fs

2 years agoSAMZA-984; Upgraded RocksDB version to 5.0.1 and added configuration for managing...
Prateek Maheshwari [Mon, 30 Jan 2017 22:58:50 +0000 (14:58 -0800)] 
SAMZA-984; Upgraded RocksDB version to 5.0.1 and added configuration for managing RocksDB logging.

Author: Prateek Maheshwari <pmaheshw@linkedin.com>

Reviewers: Jake Maes <jacob.maes@gmail.com>, Jagadish <jagadish1989@gmail.com>

Closes #46 from prateekm/rocksdb-upgrade

2 years agoSAMZA-1077: SamzaContainer should catch all Throwables instead of only exceptions
vjagadish1989 [Mon, 30 Jan 2017 22:41:57 +0000 (14:41 -0800)] 
SAMZA-1077: SamzaContainer should catch all Throwables instead of only exceptions

Author: vjagadish1989 <jvenkatr@linkedin.com>

Reviewers: Jake Maes <jacob.maes@gmail.com>

Closes #30 from vjagadish1989/samza-1077

2 years agoSpecification of various Window and Trigger APIs in Samza
vjagadish1989 [Mon, 30 Jan 2017 21:50:16 +0000 (13:50 -0800)] 
Specification of various Window and Trigger APIs in Samza

- Defined APIs for specifying different types of windows - sessions, tumbling, global and keyed variants.
- Defined APIs for specifying early and late triggers for a window.
- Standardized all above Window types to be expressed as a combination of default, early and late triggers.
- Defined classes for different types of trigger specifications.
- Hide the WindowState class from programmers and move it from samza-api to samza-operator. We can choose to add it later if need be.
- Removed some implementation classes in Window and Trigger. We can revisit them later when we implement Windows.
- New API for specifying Time durations meaningfully in Samza.
- Unit tests for most of the above changes.
- Misc. Documentation, readability related changes to public APIs.

Author: vjagadish1989 <jvenkatr@linkedin.com>

Reviewers: Yi Pan <nickpan47@gmail.com>, Prateek Maheshwari <pmaheshw@linkedin.com>

Closes #30 from vjagadish/samza-operator-v3

2 years agoSAMZA-1025: Documentation for HdfsSystemConsumer
Hai Lu [Mon, 30 Jan 2017 18:58:15 +0000 (10:58 -0800)] 
SAMZA-1025: Documentation for HdfsSystemConsumer

2 years agoSAMZA-1078: Add my gpg key to KEYS
Xinyu Liu [Wed, 11 Jan 2017 18:42:26 +0000 (10:42 -0800)] 
SAMZA-1078: Add my gpg key to KEYS

Author: Xinyu Liu <xiliu@xiliu-ld.linkedin.biz>

Closes #41 from xinyuiscool/KEYS

2 years agoSAMZA-1076; getKafkaChangelogEnabledStores() should use StorageConfig.getChangelo…
Boris Shkolnik [Fri, 6 Jan 2017 20:22:16 +0000 (12:22 -0800)] 
SAMZA-1076; getKafkaChangelogEnabledStores() should use StorageConfig.getChangelo…

getKafkaChangelogEnabledStores() should use StorageConfig.getChangelogStream to get changelog system.stream

Author: Boris Shkolnik <bshkolni@bshkolni-ld1.linkedin.biz>

Reviewers: xiliu <xiliu@linkedin.com>

Closes #39 from sborya/KafkConfigForChangelogStream

2 years agoFix checkstyle failure
Yi Pan (Data Infrastructure) [Sat, 24 Dec 2016 00:13:00 +0000 (16:13 -0800)] 
Fix checkstyle failure

2 years agoSAMZA-1065: Change the commit order to support at least once processing when using...
Prateek Maheshwari [Fri, 23 Dec 2016 23:08:55 +0000 (15:08 -0800)] 
SAMZA-1065: Change the commit order to support at least once processing when using local state store for deduping.

Author: Prateek Maheshwari <pmaheshw@linkedin.com>

Reviewers: Yi Pan <nickpan47@gmail.com>, Jagadish <jagadish1989@gmail,com>

Closes #35 from prateekm/commit-order

2 years agoSAMZA-1069: Fix Deadlock between KafkaSystemProducer and KafkaProducer
Xinyu Liu [Fri, 23 Dec 2016 22:32:01 +0000 (14:32 -0800)] 
SAMZA-1069: Fix Deadlock between KafkaSystemProducer and KafkaProducer

Moving the producer.close() and sources.flush() outside the lock so it won't have race condition with the kafka network thread callbacks.

Author: Xinyu Liu <xiliu@xiliu-ld.linkedin.biz>

Reviewers: Yi Pan <nickpan47@gmail.com>

Closes #37 from xinyuiscool/SAMZA-1069

2 years agoSAMZA-1066 : JavaStorageConfig handling job.changelog.system
Boris Shkolnik [Fri, 23 Dec 2016 20:29:45 +0000 (12:29 -0800)] 
SAMZA-1066 : JavaStorageConfig handling job.changelog.system

SAMZA-1066

Same as change for StorageConfig.java
Allows user to set changelog system in job.changelog.system and specify stream only in 'stores.<store>.changelog'

Author: Boris Shkolnik <bshkolni@bshkolni-ld1.linkedin.biz>

Reviewers: Navina Ramesh <navina@apache.org>

Closes #36 from sborya/JavaStorageConfig

2 years agoSAMZA-855; Upgrade Samza's Kafka client version to 0.10.0.1.
Shanthoosh Venkataraman [Fri, 23 Dec 2016 20:22:55 +0000 (12:22 -0800)] 
SAMZA-855; Upgrade Samza's Kafka client version to 0.10.0.1.

This is based out of PR 15, with merge conflicts resolved and version number of zkClient set to 0.8(compatible with Kafka 0.0.10.1 version).

Tested and validated this patch with internal Samza build at LinkedIn. This looks good.

Author: Shanthoosh Venkataraman <svenkataraman@linkedin.com>

Reviewers: Yi Pan <nickpan47@gmail.com>

Closes #33 from shanthoosh/kafka_10_upgrade

2 years agoSAMZA-1031: Update to Java 1.8 source compatibility in Samza
Shanthoosh Venkataraman [Thu, 22 Dec 2016 07:06:58 +0000 (23:06 -0800)] 
SAMZA-1031: Update to Java 1.8 source compatibility in Samza

Author: Shanthoosh Venkataraman <santhoshvenkat1988@gmail.com>

Reviewers: Yi Pan <nickpan47@gmail.com>

Closes #34 from shanthoosh/update_check_all_script

2 years agoSAMZA-469: Update Scala version to 2.11
McIntosh, Craig [Thu, 22 Dec 2016 01:25:31 +0000 (17:25 -0800)] 
SAMZA-469: Update Scala version to 2.11

Author: McIntosh, Craig <Craig.McIntosh@ncr.com>

Reviewers: Yi Pan <nickpan47@gmail.com>, Shanthoosh Venkataraman <santhoshvenkat1988@gmail.com>

Closes #28 from craigtmc/master-scala-2.11 and squashes the following commits:

2705376 [McIntosh, Craig] Fix scala version array in check-all.sh
94f1f7c [McIntosh, Craig] SAMZA-469: Update Scala version to 2.11

2 years agoSAMZA-1062: add docs for the new job.changelog.system config
Boris Shkolnik [Fri, 16 Dec 2016 21:56:21 +0000 (13:56 -0800)] 
SAMZA-1062: add docs for the new job.changelog.system config

Author: Boris Shkolnik <bshkolni@bshkolni-ld1.linkedin.biz>

Reviewers: Jagadish <jagadish1989@gmail.com>

Closes #32 from sborya/master

2 years agoSAMZA-1060 add new config job.changelog.system
Boris Shkolnik [Thu, 15 Dec 2016 02:24:10 +0000 (18:24 -0800)] 
SAMZA-1060 add new config job.changelog.system

SAMZA-1060.
Allow to specify a changelog system separately, so user can only specify stream name for each store.
If user specifies both (system and stream) it overwrites the job.changelog.system setting.

Author: Boris Shkolnik <bshkolni@bshkolni-ld1.linkedin.biz>

Reviewers: navina

Closes #31 from sborya/master

2 years agoAdding Build Status to README.md
Navina Ramesh [Mon, 12 Dec 2016 19:51:17 +0000 (11:51 -0800)] 
Adding Build Status to README.md

I setup a Jenkins Build Job to  get triggered every time changes are pushed to samza repository.
https://builds.apache.org/view/S-Z/view/Samza/job/samza-freestyle-build/

In case of build failures, it will send an email to devsamza.apache.org. We can customize this build as need arises.

Author: Navina Ramesh <nramesh@linkedin.com>

Reviewers: nickpan47

Closes #27 from navina/build-icon

2 years agoSAMZA-1054: Refactor Operator APIs
Prateek Maheshwari [Thu, 1 Dec 2016 22:50:52 +0000 (14:50 -0800)] 
SAMZA-1054: Refactor Operator APIs

Some suggestions for an Operator API refactor and misc. cleanup. It does contain some implementation changes, mostly due to deleted, extracted or merged classes. (e.g. OperatorFactory + ChainedOperators == OperatorImpls).

Since git marked several moved classes as (delete + new) instead, it's probably best to apply the diff locally and  browse the code in an IDE.

Some of the changes, in no particular order:
* Extracted XFunction interfaces into a .functions package in -api.
* -api's internal.Operators is now the -operators's spec.* package. Extracted interfaces and classes. Factory methods are now in OperatorSpecs.
* -api's MessageStreams is now -api's MessageStream interface and -operators's MessageStreamImpl.
* -api's internal.Windows classes are now in -api's .window package. Extracted interfaces and classes, but no implementation changes.
* OperatorFactory + ChainedOperators is now OperatorImpls, which is used from StreamOperatorAdaptorTask.
* Added a NoOpOperatorImpl, which acts as the root node for the OperatorImpl DAG returned by OperatorImpls.
* Removed usages of reactivestreams APIs since current code looks simpler without them. We can add them back when we need features like backpressure etc.
* Removed the InputSystemMessage interface.
* Made field names consistent (e.g Fn suffix for functions everywhere etc.).
* Some method/class visibility changes due to moved classes.
* General documentation changes, mostly to make public APIs clearer.

There are additional questions/tasks that we can address in future RBs:
* Updating Window and Trigger APIs.
* Merging samza-operator into samza-core.
* Questions about Message timestamp and Offset comparison semantics.
* Questions about OperatorSpec serialization (e.g. ID generation).
* Questions about StateStoreImpl and StoreFunctions.

Author: Prateek Maheshwari <pmaheshw@linkedin.com>

Reviewers: Yi Pan <nickpan47@gmail.com>, Jagadish <jagadish1989@gmail.com>

Closes #25 from prateekm/master

2 years agoSAMZA-1047: testEndOfStreamWithOutOfOrderProcess is flaky
Branislav Cogic [Wed, 30 Nov 2016 22:34:49 +0000 (14:34 -0800)] 
SAMZA-1047: testEndOfStreamWithOutOfOrderProcess is flaky

Chooser always pools end of stream message until final callback is trigered so process-enelopes metrics didn't match. Changed the test methods to return null envelopes after end of stream message.

Deleted unused boolean variable "completed" in AsyncTaskWorker

Author: banecogic <b.cogic@levi9.com>

Reviewers: Yi Pan <nickpan47@gmail.com>

Closes #24 from banecogic/SAMZA-1047

2 years agoSAMZA-1055: Disable broken tests in SamzaRest
Shanthoosh Venkataraman [Wed, 30 Nov 2016 22:06:54 +0000 (14:06 -0800)] 
SAMZA-1055: Disable broken tests in SamzaRest

Disables a broken test in SamzaRest due to Jetty version upgrade in Samza. This is a temporary solution just to keep the build green on master. Longer term solution is to mock the Jetty objects properly through Mockito.

Author: Shanthoosh Venkataraman <svenkataraman@linkedin.com>

Reviewers: Yi Pan <nickpan47@gmail.com>

Closes #26 from shanthoosh/master

2 years agoSAMZA-1048 : upgrade jetty dependency to Jetty 9 from Jetty 8
Fred Ji [Wed, 30 Nov 2016 00:17:37 +0000 (16:17 -0800)] 
SAMZA-1048 : upgrade jetty dependency to Jetty 9 from Jetty 8

Jetty 8 is a very old jetty version and the current widely used version is Jetty 9. If a user is using standalone Samza in a Jetty container, and he/she is using Jetty 9, he/she may see some incompatibility issue and it makes a lot of sense for a user to upgrade the Jetty version on his/her side instead of downgrading the Jetty version.

Author: Fred Ji <fji@linkedin.com>

Reviewers: Yi Pan <nickpan47@gmail.com>

Closes #20 from fredji97/master

2 years agoSAMZA-1051: merge operator APIs to master
Yi Pan (Data Infrastructure) [Tue, 22 Nov 2016 23:47:48 +0000 (15:47 -0800)] 
SAMZA-1051: merge operator APIs to master

2 years agoSAMZA-1046: Docs for checkpointable consumer
Boris Shkolnik [Tue, 22 Nov 2016 22:36:09 +0000 (14:36 -0800)] 
SAMZA-1046: Docs for checkpointable consumer

2 years agoSAMZA-1049 Enable support for reporting metrics from Monitors in SamzaRest. 21/head
Shanthoosh Venkataraman [Tue, 22 Nov 2016 00:55:35 +0000 (16:55 -0800)] 
SAMZA-1049 Enable support for reporting metrics from Monitors in SamzaRest.

2 years agoSAMZA-1042 - Allow offset notifications for input systems
Boris Shkolnik [Mon, 14 Nov 2016 18:30:07 +0000 (10:30 -0800)] 
SAMZA-1042 - Allow offset notifications for input systems

2 years agoSAMZA-1043: Samza performance improvements
Xinyu Liu [Wed, 9 Nov 2016 19:09:32 +0000 (11:09 -0800)] 
SAMZA-1043: Samza performance improvements

2 years agoFix a minor typo in the web-page
vjagadish1989 [Tue, 1 Nov 2016 00:40:24 +0000 (17:40 -0700)] 
Fix a minor typo in the web-page

2 years agoSAMZA-1033: Remove import-control from checkstyle
Navina Ramesh [Tue, 1 Nov 2016 00:14:25 +0000 (17:14 -0700)] 
SAMZA-1033: Remove import-control from checkstyle

Removing import-control after discussion here - [http://mail-archives.apache.org/mod_mbox/samza-dev/201607.mbox/browser](http://mail-archives.apache.org/mod_mbox/samza-dev/201607.mbox/browser)

Author: Navina Ramesh <nramesh@linkedin.com>

Reviewers: Jagadish Venkataraman <vjagadish1989@gmail.com>

Closes #17 from navina/SAMZA-1033

2 years agoSAMZA-1014: Add property to set YARN AM cpu cores
Maxim Logvinenko [Fri, 21 Oct 2016 01:01:48 +0000 (18:01 -0700)] 
SAMZA-1014: Add property to set YARN AM cpu cores

2 years agoSAMZA-1013: Add node labeling support for Yarn
Maxim Logvinenko [Fri, 21 Oct 2016 00:57:40 +0000 (17:57 -0700)] 
SAMZA-1013: Add node labeling support for Yarn

2 years agoSAMZA-1017 - Added disk quota based throttling to AsyncRunLoop
Prateek Maheshwari [Wed, 19 Oct 2016 19:04:52 +0000 (12:04 -0700)] 
SAMZA-1017 - Added disk quota based throttling to AsyncRunLoop

2 years agoSAMZA-1039 Selective loading of monitors in samza rest
Shanthoosh Venkataraman [Wed, 19 Oct 2016 18:42:36 +0000 (11:42 -0700)] 
SAMZA-1039 Selective loading of monitors in samza rest

2 years agoSAMZA-1040: Revert the ClassLoaderHelper change in SamzaContainer
Xinyu Liu [Wed, 19 Oct 2016 18:27:50 +0000 (11:27 -0700)] 
SAMZA-1040: Revert the ClassLoaderHelper change in SamzaContainer

2 years agoSAMZA-1029: Prepare release candidate for 0.11.0
Xinyu Liu [Mon, 17 Oct 2016 23:27:18 +0000 (16:27 -0700)] 
SAMZA-1029: Prepare release candidate for 0.11.0

2 years agoSAMZA-967: HDFS System Consumer
Hai Lu [Wed, 5 Oct 2016 18:39:17 +0000 (11:39 -0700)] 
SAMZA-967: HDFS System Consumer

2 years agoSAMZA-1012 Generated changelog mappings are not consistent
Tommy Becker [Tue, 4 Oct 2016 15:54:10 +0000 (08:54 -0700)] 
SAMZA-1012 Generated changelog mappings are not consistent

2 years agoSAMZA-974 Support finite data sources that have a notion of end of stream
vjagadish1989 [Sat, 1 Oct 2016 06:07:30 +0000 (23:07 -0700)] 
SAMZA-974 Support finite data sources that have a notion of end of stream

2 years agoSAMZA-1016: Fix support for joint compilation of scala and java sources
vjagadish1989 [Fri, 30 Sep 2016 18:47:53 +0000 (11:47 -0700)] 
SAMZA-1016: Fix support for joint compilation of scala and java sources

2 years agoSAMZA-1015 Add support for streams, Lambdas and other JDK 8 like features in checkstyle
vjagadish1989 [Fri, 30 Sep 2016 18:35:06 +0000 (11:35 -0700)] 
SAMZA-1015 Add support for streams, Lambdas and other JDK 8 like features in checkstyle

2 years agoSAMZA-1030; Add documentation for change in the contribution process
Navina Ramesh [Fri, 30 Sep 2016 01:09:04 +0000 (18:09 -0700)] 
SAMZA-1030; Add documentation for change in the contribution process

I re-organized some of the website files and created a "Contributor's Corner" that collates all info related to new contributors and committers

Also, updated the merge script with constants to match from the website documentation.

Author: Navina Ramesh <nramesh@linkedin.com>

Reviewers: Jagadish <jagadish@apache.org>

Closes #16 from navina/adding-docs

2 years agoUpdate version for 0.11.0 release release-0.11.0-rc0
Xinyu Liu [Thu, 29 Sep 2016 22:45:17 +0000 (15:45 -0700)] 
Update version for 0.11.0 release

2 years agoSAMZA-1028: Fix KafkaSystemProducer logging and use an AtomicReference for tracking...
Xinyu Liu [Thu, 29 Sep 2016 21:51:23 +0000 (14:51 -0700)] 
SAMZA-1028: Fix KafkaSystemProducer logging and use an AtomicReference for tracking producer exceptions

2 years agoSAMZA-995: Remove deprecated property yarn.container.count from config table.
Xinyu Liu [Thu, 29 Sep 2016 18:50:42 +0000 (11:50 -0700)] 
SAMZA-995: Remove deprecated property yarn.container.count from config table.

2 years agoSAMZA-1020: Remove methods in Kafka checkpoint classes that were deprecated in the...
vjagadish1989 [Thu, 29 Sep 2016 18:48:22 +0000 (11:48 -0700)] 
SAMZA-1020: Remove methods in Kafka checkpoint classes that were deprecated in the 0.10 release.

2 years agoSAMZA-1023 ContainerProcessManager spams the job coordinator log with 'TaskManager...
Branislav Cogic [Thu, 29 Sep 2016 13:56:24 +0000 (06:56 -0700)] 
SAMZA-1023 ContainerProcessManager spams the job coordinator log with 'TaskManager state' messages

2 years agoFixed typo in run-in-multi-node-yarn.md
Anatolie Lupacescu [Wed, 28 Sep 2016 05:05:09 +0000 (22:05 -0700)] 
Fixed typo in run-in-multi-node-yarn.md

Author: Anatolie Lupacescu <anatolie.lupacescu@gamesys.com.uk>

Reviewers: Navina Ramesh <navi.trinity@gmail.com>

Closes #11 from anatollupacescu/docs-typo-fix

2 years agoSAMZA-880 - Moving to github/pull-request for code review and check-in
Jagadish [Wed, 28 Sep 2016 02:40:21 +0000 (19:40 -0700)] 
SAMZA-880 - Moving to github/pull-request for code review and check-in

2 years agoSAMZA-1024 Enable support for defining custom configuration for individual monitors
Shanthoosh Venkataraman [Tue, 27 Sep 2016 19:15:56 +0000 (12:15 -0700)] 
SAMZA-1024 Enable support for defining custom configuration for individual monitors

2 years agoSAMZA-927: added docs for split deployment
Boris Shkolnik [Tue, 27 Sep 2016 01:07:10 +0000 (18:07 -0700)] 
SAMZA-927: added docs for split deployment

2 years agoAdd Jagadish and Xinyu to committers
Xinyu Liu [Mon, 26 Sep 2016 23:14:46 +0000 (16:14 -0700)] 
Add Jagadish and Xinyu to committers

2 years agoFix SAMZA-1018.
Tommy Becker [Mon, 19 Sep 2016 12:21:12 +0000 (08:21 -0400)] 
Fix SAMZA-1018.

Check error code from metadata fetch in getSystemStreamPartitionCounts to avoid returning no data for newly created topics.

2 years agoSAMZA-977: User doc for samza multi-threading
Xinyu Liu [Thu, 22 Sep 2016 23:44:30 +0000 (16:44 -0700)] 
SAMZA-977: User doc for samza multi-threading

2 years agoAdd Jake Maes to commiter page
Jacob Maes [Thu, 22 Sep 2016 23:27:06 +0000 (16:27 -0700)] 
Add Jake Maes to commiter page

2 years agoSAMZA-1021 : Remove the redundent poll waiting inside AsyncRunLoop blockIfBusy
Xinyu Liu [Thu, 22 Sep 2016 18:42:13 +0000 (11:42 -0700)] 
SAMZA-1021 : Remove the redundent poll waiting inside AsyncRunLoop blockIfBusy

2 years agoSAMZA-1022 - convert warn() to debug() for 'hostname .. resolves to a loopback address'
Boris Shkolik [Wed, 21 Sep 2016 18:52:54 +0000 (11:52 -0700)] 
SAMZA-1022 - convert warn() to debug() for 'hostname .. resolves to a loopback address'

2 years agoSAMZA 998: Documentation updates for refactored Job Coordinator
Jagadish Venkatraman [Tue, 20 Sep 2016 06:37:10 +0000 (23:37 -0700)] 
SAMZA 998: Documentation updates for refactored Job Coordinator

2 years agoSAMZA-842: Job does not quit when task shutdown is requested using ThreadJobFactory
Tommy Becker [Mon, 12 Sep 2016 22:26:10 +0000 (15:26 -0700)] 
SAMZA-842: Job does not quit when task shutdown is requested using ThreadJobFactory

2 years agoSAMZA-702 - Document the significance of all the different metrics emitted by Samza...
Branislav Cogic [Wed, 14 Sep 2016 01:10:41 +0000 (18:10 -0700)] 
SAMZA-702 - Document the significance of all the different metrics emitted by Samza out of the box

2 years agoSAMZA-1007 - Broadcast streams incompatible with GroupBySystemStreamPartitionFactory
Neil Fordyce [Sun, 11 Sep 2016 00:30:23 +0000 (17:30 -0700)] 
SAMZA-1007 - Broadcast streams incompatible with GroupBySystemStreamPartitionFactory

2 years agoSAMZA-1005 - Refactor class instantiation code to a helper class
Branislav Cogic [Sat, 10 Sep 2016 23:43:30 +0000 (16:43 -0700)] 
SAMZA-1005 - Refactor class instantiation code to a helper class

2 years agoSAMZA-1004: Fix some logging and javadoc issues for AsyncStreamTask
Xinyu Liu [Wed, 7 Sep 2016 22:29:37 +0000 (15:29 -0700)] 
SAMZA-1004: Fix some logging and javadoc issues for AsyncStreamTask

2 years agoSAMZA-976 - Samza REST Documentation
Jacob Maes [Tue, 23 Aug 2016 06:50:10 +0000 (23:50 -0700)] 
SAMZA-976 - Samza REST Documentation

2 years agoSAMZA-975 - Initial Samza REST Implementation
Jacob Maes [Tue, 23 Aug 2016 06:38:13 +0000 (23:38 -0700)] 
SAMZA-975 - Initial Samza REST Implementation

2 years agoSAMZA-1003: Restore lazy init for kafka system producer
Xinyu Liu [Thu, 18 Aug 2016 23:32:13 +0000 (16:32 -0700)] 
SAMZA-1003: Restore lazy init for kafka system producer

2 years agoSAMZA-999 - Checkpoint-tool needs to use the rewriter to rewrite the configs
Boris Shkolik [Tue, 16 Aug 2016 19:03:04 +0000 (12:03 -0700)] 
SAMZA-999 - Checkpoint-tool needs to use the rewriter to rewrite the configs

2 years agoSetting executable permission for all shell scripts
Navina Ramesh [Tue, 16 Aug 2016 17:33:16 +0000 (10:33 -0700)] 
Setting executable permission for all shell scripts

2 years agoUpdating release steps and mirror links
Navina Ramesh [Wed, 10 Aug 2016 01:11:45 +0000 (18:11 -0700)] 
Updating release steps and mirror links

2 years agoSAMZA-963: adding latency metrics for KV storage engine
Fred Ji [Mon, 8 Aug 2016 20:27:54 +0000 (13:27 -0700)] 
SAMZA-963: adding latency metrics for KV storage engine

2 years agoPreparing website for 0.10.1 release
Navina Ramesh [Tue, 9 Aug 2016 07:24:18 +0000 (00:24 -0700)] 
Preparing website for 0.10.1 release

2 years agoSAMZA-994: fix StreamAppender start up issue w/ refactored JobCoordinator
Jagadish Venkatraman [Mon, 8 Aug 2016 16:45:21 +0000 (09:45 -0700)] 
SAMZA-994: fix StreamAppender start up issue w/ refactored JobCoordinator

2 years agoSAMZA-991: Continue to report old AppMaster metrics to maintain backward compatibility
Jagadish Venkatraman [Tue, 2 Aug 2016 23:58:27 +0000 (16:58 -0700)] 
SAMZA-991: Continue to report old AppMaster metrics to maintain backward compatibility

2 years agoSAMZA-992 - Adding PGP Keys for Navina Ramesh
Navina Ramesh [Mon, 1 Aug 2016 23:11:37 +0000 (16:11 -0700)] 
SAMZA-992 - Adding PGP Keys for Navina Ramesh

2 years agoSAMZA-954: Improving startup logging for Samza
Jacob Maes [Mon, 1 Aug 2016 18:48:17 +0000 (11:48 -0700)] 
SAMZA-954: Improving startup logging for Samza

2 years agoSAMZA-978: fix next links in online doc
Fred Ji [Mon, 1 Aug 2016 18:40:09 +0000 (11:40 -0700)] 
SAMZA-978: fix next links in online doc

2 years agoSAMZA-988 - Update failure testing job configs with job coordinator properties
Navina Ramesh [Fri, 29 Jul 2016 23:04:27 +0000 (16:04 -0700)] 
SAMZA-988 - Update failure testing job configs with job coordinator properties

2 years agoSAMZA-981 - Set consistent Kafka clientId for a job instance
Xinyu Liu [Fri, 29 Jul 2016 20:11:36 +0000 (13:11 -0700)] 
SAMZA-981 - Set consistent Kafka clientId for a job instance

2 years agoSAMZA-982 - Add null check for offset update in OffsetManager
Xinyu Liu [Fri, 29 Jul 2016 20:10:00 +0000 (13:10 -0700)] 
SAMZA-982 - Add null check for offset update in OffsetManager

2 years agoSAMZA-979 - Remove KafkaCheckpointMigration
Xinyu Liu [Fri, 29 Jul 2016 19:58:13 +0000 (12:58 -0700)] 
SAMZA-979 - Remove KafkaCheckpointMigration

2 years agoSAMZA-970 : Problems with integration tests
Xinyu Liu [Fri, 29 Jul 2016 19:08:34 +0000 (12:08 -0700)] 
SAMZA-970 : Problems with integration tests

2 years agoSAMZA-972: holistic physical memory monitoring
Jagadish Venkatraman [Wed, 27 Jul 2016 17:16:30 +0000 (10:16 -0700)] 
SAMZA-972: holistic physical memory monitoring

2 years agoSAMZA-973: Disk Quotas: clamp max delay and more accurate processing time measurement
Chris Pettitt [Thu, 21 Jul 2016 00:07:32 +0000 (17:07 -0700)] 
SAMZA-973: Disk Quotas: clamp max delay and more accurate processing time measurement

2 years agoSAMZA-863: Multithreading support in Samza
Xinyu Liu [Tue, 19 Jul 2016 18:53:44 +0000 (11:53 -0700)] 
SAMZA-863: Multithreading support in Samza

2 years agoSAMZA-903: Refactor UI state variables
Jagadish Venkatraman [Tue, 12 Jul 2016 00:10:03 +0000 (17:10 -0700)] 
SAMZA-903: Refactor UI state variables

2 years agoSAMZA-971 : JobCoordinator/JobModelManager does not need to fetch offset for all...
Navina Ramesh [Sat, 25 Jun 2016 00:50:33 +0000 (17:50 -0700)] 
SAMZA-971 : JobCoordinator/JobModelManager does not need to fetch offset for all stream partitions

2 years agoSAMZA-936: add double serde
Jon Bringhurst [Thu, 23 Jun 2016 22:32:22 +0000 (15:32 -0700)] 
SAMZA-936: add double serde