aurora.git
22 months agoUpdating .auroraversion to release version 0.8.0. rel/0.8.0
jfarrell [Tue, 12 May 2015 02:37:21 +0000 (22:37 -0400)] 
Updating .auroraversion to release version 0.8.0.

22 months agoUpdating .auroraversion to 0.8.0-rc1.
jfarrell [Fri, 8 May 2015 04:08:59 +0000 (00:08 -0400)] 
Updating .auroraversion to 0.8.0-rc1.

22 months agoUpdating CHANGELOG for 0.8.0 release.
jfarrell [Fri, 8 May 2015 04:08:59 +0000 (00:08 -0400)] 
Updating CHANGELOG for 0.8.0 release.

22 months agoFix broken style test cases causing PEP302 errors
Jake Farrell [Fri, 8 May 2015 03:38:33 +0000 (23:38 -0400)] 
Fix broken style test cases causing PEP302 errors

Testing Done:
all tests including check style pass with this patch now

Bugs closed: AURORA-1313

Reviewed at https://reviews.apache.org/r/33969/

22 months agoAdds missing license headers in new files created since 0.7.0
Jake Farrell [Fri, 8 May 2015 02:46:33 +0000 (22:46 -0400)] 
Adds missing license headers in new files created since 0.7.0

Bugs closed: AURORA-1312

Reviewed at https://reviews.apache.org/r/33967/

22 months agoFix 0.8.0-RC0 issues raised due to changelog containing wontfix and duplicate ticket...
Jake Farrell [Fri, 8 May 2015 01:56:27 +0000 (21:56 -0400)] 
Fix 0.8.0-RC0 issues raised due to changelog containing wontfix and duplicate ticket references

Patch resets rc version and removes changelog entries, updates changelog script to only pull in relevant issues now

Bugs closed: AURORA-1308

Reviewed at https://reviews.apache.org/r/33950/

22 months agoRemove often-redundant "Error executing command" prefix from client output.
Bill Farner [Fri, 8 May 2015 00:23:11 +0000 (17:23 -0700)] 
Remove often-redundant "Error executing command" prefix from client output.

Bugs closed: AURORA-1310

Reviewed at https://reviews.apache.org/r/33962/

22 months agoInvoke pip as a python module rather than directly.
Bill Farner [Thu, 7 May 2015 21:18:48 +0000 (14:18 -0700)] 
Invoke pip as a python module rather than directly.

Bugs closed: AURORA-1309

Reviewed at https://reviews.apache.org/r/33955/

22 months agoFix and enhance RC verification script.
Bill Farner [Thu, 7 May 2015 21:00:14 +0000 (14:00 -0700)] 
Fix and enhance RC verification script.

Reviewed at https://reviews.apache.org/r/33854/

22 months agoSet verbose=False in the client to squelch noisy ZooKeeper logging.
Bill Farner [Wed, 6 May 2015 23:15:31 +0000 (16:15 -0700)] 
Set verbose=False in the client to squelch noisy ZooKeeper logging.

Reviewed at https://reviews.apache.org/r/33920/

22 months agoUpdgrade to gradle 2.4.
Bill Farner [Wed, 6 May 2015 19:32:00 +0000 (12:32 -0700)] 
Updgrade to gradle 2.4.

Bugs closed: AURORA-1306

Reviewed at https://reviews.apache.org/r/33905/

22 months agoFix inconsistency in MemTaskStore secondary indices.
Bill Farner [Wed, 6 May 2015 17:28:51 +0000 (10:28 -0700)] 
Fix inconsistency in MemTaskStore secondary indices.

Bugs closed: AURORA-1305

Reviewed at https://reviews.apache.org/r/33869/

22 months agoAdded a status update throughput benchmark.
Ben Mahler [Tue, 5 May 2015 22:37:50 +0000 (15:37 -0700)] 
Added a status update throughput benchmark.

Bugs closed: AURORA-1283

Reviewed at https://reviews.apache.org/r/33608/

22 months agoUpdate upstart configurations along with sources.
Bill Farner [Tue, 5 May 2015 19:49:17 +0000 (12:49 -0700)] 
Update upstart configurations along with sources.

Bugs closed: AURORA-1204

Reviewed at https://reviews.apache.org/r/33784/

22 months agoAdd stats for update state transitions.
Bill Farner [Tue, 5 May 2015 18:22:32 +0000 (11:22 -0700)] 
Add stats for update state transitions.

Bugs closed: AURORA-1259

Reviewed at https://reviews.apache.org/r/33783/

22 months agoFix link to contributing page.
Bhuvan Arumugam [Tue, 5 May 2015 18:15:27 +0000 (11:15 -0700)] 
Fix link to contributing page.

Reviewed at https://reviews.apache.org/r/33787/

22 months agoIncrementing snapshot version to 0.9.0-SNAPSHOT.
jfarrell [Tue, 5 May 2015 02:34:36 +0000 (22:34 -0400)] 
Incrementing snapshot version to 0.9.0-SNAPSHOT.

22 months agoUpdating CHANGELOG for 0.8.0 release.
jfarrell [Tue, 5 May 2015 02:34:35 +0000 (22:34 -0400)] 
Updating CHANGELOG for 0.8.0 release.

22 months agoDon't retry API requests that fail with auth errors.
Bill Farner [Mon, 4 May 2015 17:57:28 +0000 (10:57 -0700)] 
Don't retry API requests that fail with auth errors.

Bugs closed: AURORA-1248

Reviewed at https://reviews.apache.org/r/33705/

22 months agoAurora-1106: Release candidate script does not generate correct branch link
Jake Farrell [Mon, 4 May 2015 02:53:12 +0000 (22:53 -0400)] 
Aurora-1106: Release candidate script does not generate correct branch link

Fixes broken links for release branch in release-candidate script.

Bugs closed: AURORA-1106

Reviewed at https://reviews.apache.org/r/33774/

22 months agoAurora-1302: Allow rc script to set an explicit version
Jake Farrell [Mon, 4 May 2015 02:50:56 +0000 (22:50 -0400)] 
Aurora-1302: Allow rc script to set an explicit version

Adds ability to override current .auroraversion when making an release candidate.

Bugs closed: Aurora-1302

Reviewed at https://reviews.apache.org/r/33773/

22 months agoEnable GC executor to gc STARTING tasks which don't exist on the host
Zeke Harris [Sat, 2 May 2015 17:26:24 +0000 (10:26 -0700)] 
Enable GC executor to gc STARTING tasks which don't exist on the host

Reviewed at https://reviews.apache.org/r/33739/

22 months agoAdding logging threadpool executor.
Maxim Khutornenko [Fri, 1 May 2015 22:37:31 +0000 (15:37 -0700)] 
Adding logging threadpool executor.

Reviewed at https://reviews.apache.org/r/33456/

22 months agoHandle UpdateConfigError when starting a job update.
Bill Farner [Fri, 1 May 2015 16:22:32 +0000 (09:22 -0700)] 
Handle UpdateConfigError when starting a job update.

Bugs closed: AURORA-1299

Reviewed at https://reviews.apache.org/r/33740/

22 months agoFix test fixture issue causing failing tests to report as passing.
Bill Farner [Fri, 1 May 2015 00:09:51 +0000 (17:09 -0700)] 
Fix test fixture issue causing failing tests to report as passing.

Bugs closed: AURORA-1301

Reviewed at https://reviews.apache.org/r/33738/

22 months agoFix query for active job updates when serving /updates.
Bill Farner [Thu, 30 Apr 2015 20:00:39 +0000 (13:00 -0700)] 
Fix query for active job updates when serving /updates.

Bugs closed: AURORA-1231

Reviewed at https://reviews.apache.org/r/33728/

23 months agoAlways require slave checkpointing.
Bill Farner [Wed, 29 Apr 2015 23:02:05 +0000 (16:02 -0700)] 
Always require slave checkpointing.

Bugs closed: AURORA-716

Reviewed at https://reviews.apache.org/r/33676/

23 months agoRemove dead code related to Java executor.
Bill Farner [Wed, 29 Apr 2015 22:09:36 +0000 (15:09 -0700)] 
Remove dead code related to Java executor.

Bugs closed: AURORA-195

Reviewed at https://reviews.apache.org/r/33677/

23 months agoAdd support for shorthand names of security realm modules.
Bill Farner [Wed, 29 Apr 2015 22:08:31 +0000 (15:08 -0700)] 
Add support for shorthand names of security realm modules.

Bugs closed: AURORA-1290

Reviewed at https://reviews.apache.org/r/33659/

23 months agoRemove redundant enable_api_security argument.
Bill Farner [Wed, 29 Apr 2015 21:25:29 +0000 (14:25 -0700)] 
Remove redundant enable_api_security argument.

Bugs closed: AURORA-1291

Reviewed at https://reviews.apache.org/r/33658/

23 months agoImplementing PendingTaskProcessor benchmark.
Maxim Khutornenko [Tue, 28 Apr 2015 20:39:29 +0000 (13:39 -0700)] 
Implementing PendingTaskProcessor benchmark.

Reviewed at https://reviews.apache.org/r/33458/

23 months agoDocument Aurora security features.
Kevin Sweeney [Tue, 28 Apr 2015 19:02:11 +0000 (12:02 -0700)] 
Document Aurora security features.

Bugs closed: AURORA-817

Reviewed at https://reviews.apache.org/r/33537/

23 months agoAdd benchmarks for fetching tasks over the API.
Bill Farner [Tue, 28 Apr 2015 18:42:11 +0000 (11:42 -0700)] 
Add benchmarks for fetching tasks over the API.

Reviewed at https://reviews.apache.org/r/33611/

23 months agoUse explicit status update acknowledgements.
Ben Mahler [Mon, 27 Apr 2015 23:49:34 +0000 (16:49 -0700)] 
Use explicit status update acknowledgements.

Bugs closed: AURORA-1228

Reviewed at https://reviews.apache.org/r/33243/

23 months agoExtract an abstract base test for TaskStore implementations.
Bill Farner [Mon, 27 Apr 2015 23:00:34 +0000 (16:00 -0700)] 
Extract an abstract base test for TaskStore implementations.

Reviewed at https://reviews.apache.org/r/33600/

23 months agoAdd SQL tables needed for a datbase-backed task store.
Bill Farner [Fri, 24 Apr 2015 22:27:11 +0000 (15:27 -0700)] 
Add SQL tables needed for a datbase-backed task store.

Bugs closed: AURORA-556

Reviewed at https://reviews.apache.org/r/33279/

23 months agoSimplify storage bindings, remove shims that are now mostly getting in the way.
Bill Farner [Fri, 24 Apr 2015 22:15:48 +0000 (15:15 -0700)] 
Simplify storage bindings, remove shims that are now mostly getting in the way.

Reviewed at https://reviews.apache.org/r/33530/

23 months agoIncreasing the default scheduling rate limit to 40 attempts per second
Maxim Khutornenko [Thu, 23 Apr 2015 18:31:53 +0000 (11:31 -0700)] 
Increasing the default scheduling rate limit to 40 attempts per second

Bugs closed: AURORA-1214

Reviewed at https://reviews.apache.org/r/33487/

23 months agoAdd typed Shiro permissions SPI.
Kevin Sweeney [Wed, 22 Apr 2015 18:20:02 +0000 (11:20 -0700)] 
Add typed Shiro permissions SPI.

Working on an implementation of a Shiro Realm to replace the old
CapabilityValidator I realized we're missing some information with
the new API. This patch allows a Realm implementation to optionally
introspect a permission check for Aurora-specific information about
exactly what's being attempted, while maintaining compatibility
with Shiro realms that don't know anything about Aurora, such as the
included IniRealm.

To do this I've added a new SPI package, and documented
backwards-compatibility considerations with it. The idea is that
a third party can write an Aurora-aware Shiro Realm module against
a stable ABI and gets one release to update it if we want to make
changes to it.

Testing Done:
./gradlew -Pq build

Reviewed at https://reviews.apache.org/r/33411/

23 months agoImproving async preemptor efficiency.
Maxim Khutornenko [Wed, 22 Apr 2015 00:24:45 +0000 (17:24 -0700)] 
Improving async preemptor efficiency.

Bugs closed: AURORA-1219

Reviewed at https://reviews.apache.org/r/32597/

23 months agoUpdated mesos library to 0.22.0.
Ben Mahler [Tue, 21 Apr 2015 22:50:37 +0000 (15:50 -0700)] 
Updated mesos library to 0.22.0.

Bugs closed: AURORA-1276

Reviewed at https://reviews.apache.org/r/33233/

23 months agoAdd a specific storage routine for bulk loading data.
Bill Farner [Tue, 21 Apr 2015 22:45:48 +0000 (15:45 -0700)] 
Add a specific storage routine for bulk loading data.

Reviewed at https://reviews.apache.org/r/33273/

23 months agoResuming blocked updates on restart.
Maxim Khutornenko [Tue, 21 Apr 2015 21:28:27 +0000 (14:28 -0700)] 
Resuming blocked updates on restart.

Bugs closed: AURORA-1285

Reviewed at https://reviews.apache.org/r/33374/

23 months agoFix the path to download stdout/stderr
Bhuvan Arumugam [Tue, 21 Apr 2015 20:25:30 +0000 (13:25 -0700)] 
Fix the path to download stdout/stderr

Bugs closed: AURORA-1135

Reviewed at https://reviews.apache.org/r/33366/

23 months agoRequire non-default primitive values in StorageEntityUtil.
Bill Farner [Tue, 21 Apr 2015 18:51:51 +0000 (11:51 -0700)] 
Require non-default primitive values in StorageEntityUtil.

Reviewed at https://reviews.apache.org/r/33200/

23 months agoUpgrade to virtualenv 12.1.1
Bill Farner [Tue, 21 Apr 2015 18:48:29 +0000 (11:48 -0700)] 
Upgrade to virtualenv 12.1.1

Reviewed at https://reviews.apache.org/r/33403/

23 months agoUpgrade to pystachio 0.8.0
Brian Wickman [Mon, 20 Apr 2015 21:20:23 +0000 (14:20 -0700)] 
Upgrade to pystachio 0.8.0

Testing Done:
./pants test.pytest --no-fast src/test/python::

Reviewed at https://reviews.apache.org/r/33317/

23 months agoFixing e2e kerberos tests.
Maxim Khutornenko [Wed, 15 Apr 2015 22:25:49 +0000 (15:25 -0700)] 
Fixing e2e kerberos tests.

Reviewed at https://reviews.apache.org/r/33235/

23 months agoOnly perform escalation wait when http teardown signal could be dispatched
Stephan Erb [Wed, 15 Apr 2015 19:01:29 +0000 (12:01 -0700)] 
Only perform escalation wait when http teardown signal could be dispatched

Testing Done:
./pants test.pytest --no-fast --options=-v src/test/python/apache/aurora/executor:thermos_task_runner

In addition, manual verification that shutdown of health-checked services without lifecycle methods is 10 seconds faster.

Bugs closed: AURORA-1275

Reviewed at https://reviews.apache.org/r/32889/

23 months agoFixing benchmarks.
Maxim Khutornenko [Wed, 15 Apr 2015 03:28:11 +0000 (20:28 -0700)] 
Fixing benchmarks.

Reviewed at https://reviews.apache.org/r/33202/

23 months agoImplement missing != operator for AuroraJobKey
Stephan Erb [Wed, 15 Apr 2015 00:05:46 +0000 (17:05 -0700)] 
Implement missing != operator for AuroraJobKey

Reviewed at https://reviews.apache.org/r/33184/

23 months agoRemoving taskId from ResourceRequest.
Maxim Khutornenko [Tue, 14 Apr 2015 22:17:34 +0000 (15:17 -0700)] 
Removing taskId from ResourceRequest.

Reviewed at https://reviews.apache.org/r/33191/

23 months agoReturn Iterable from TaskStore.fetchTasks to allow for streaming.
Bill Farner [Tue, 14 Apr 2015 21:44:18 +0000 (14:44 -0700)] 
Return Iterable from TaskStore.fetchTasks to allow for streaming.

Reviewed at https://reviews.apache.org/r/33105/

23 months agoGeneralizing preemption reservation pool.
Maxim Khutornenko [Tue, 14 Apr 2015 20:01:07 +0000 (13:01 -0700)] 
Generalizing preemption reservation pool.

Bugs closed: AURORA-1219

Reviewed at https://reviews.apache.org/r/32907/

23 months agoSimplify AttributeAggregate.
Bill Farner [Tue, 14 Apr 2015 16:53:22 +0000 (09:53 -0700)] 
Simplify AttributeAggregate.

Reviewed at https://reviews.apache.org/r/33106/

23 months agoSkip known flaky tests.
Bill Farner [Mon, 13 Apr 2015 22:08:52 +0000 (15:08 -0700)] 
Skip known flaky tests.

Reviewed at https://reviews.apache.org/r/33103/

23 months agoAdding client Kerberos support.
Maxim Khutornenko [Sat, 11 Apr 2015 01:02:09 +0000 (18:02 -0700)] 
Adding client Kerberos support.

Bugs closed: AURORA-813

Reviewed at https://reviews.apache.org/r/32541/

23 months agoAdd an end-to-end test for HTTP basic auth.
Kevin Sweeney [Fri, 10 Apr 2015 22:29:31 +0000 (15:29 -0700)] 
Add an end-to-end test for HTTP basic auth.

Testing Done:
src/test/sh/org/apache/aurora/e2e/test_end_to_end.sh

Bugs closed: AURORA-810

Reviewed at https://reviews.apache.org/r/33048/

23 months agoImproving JobUpdateDetails fetch performance.
Maxim Khutornenko [Thu, 9 Apr 2015 23:20:17 +0000 (16:20 -0700)] 
Improving JobUpdateDetails fetch performance.

Bugs closed: AURORA-1263

Reviewed at https://reviews.apache.org/r/32990/

23 months agoRemove factory.py
Zameer Manji [Thu, 9 Apr 2015 23:06:33 +0000 (16:06 -0700)] 
Remove factory.py

This patch removes `src/main/python/apache/aurora/client/factory.py` which was a
pile of technical debt. By removing the indirection of creating client object
the code is much easier to understand. As a result of removing this file many
tests had to be touched because they were patching CLUSTERS via factory.py. The
need to patch CLUSTERS at each test site was removed and replaced by modifying
`AuroraClientCommandTest` to patch CLUSTERS before running any test. This
approach is required because `FakeAuroraCommandContext` inherits from
`AuroraCommandContext` which causes the execute on import code in clusters.py to
execute for each test.

Testing Done:
./pants test.pytest src/test/python/apache/aurora/client/cli::

Reviewed at https://reviews.apache.org/r/32905/

23 months agoUse installDist instead of installApp.
Kevin Sweeney [Thu, 9 Apr 2015 19:41:34 +0000 (12:41 -0700)] 
Use installDist instead of installApp.

This removes a deprecation warning:

==> devcluster: The installApp task has been deprecated and is
scheduled to be removed in Gradle 3.0. Please use the installDist
task instead.

Testing Done:
aurorabuild scheduler

Reviewed at https://reviews.apache.org/r/33029/

23 months agoRevert "Make health check configurable"
Bill Farner [Thu, 9 Apr 2015 19:22:09 +0000 (12:22 -0700)] 
Revert "Make health check configurable"

This reverts commit 27a602d2c9efdd1cd2591c9c754f086c04ad0eb9.

Bugs closed: AURORA-1266

Reviewed at https://reviews.apache.org/r/33026/

23 months agoAdd Kerberos support to the scheduler
Kevin Sweeney [Thu, 9 Apr 2015 18:44:27 +0000 (11:44 -0700)] 
Add Kerberos support to the scheduler

Support authenticating to the scheduler API with Kerberos.

Testing Done:
./gradlew -Pq build
./src/test/sh/org/apache/aurora/test_kerberos_end_to_end.sh

Bugs closed: AURORA-812

Reviewed at https://reviews.apache.org/r/32559/

23 months agoFix header levels in monitoring.md
Stephan Erb [Thu, 9 Apr 2015 04:51:58 +0000 (21:51 -0700)] 
Fix header levels in monitoring.md

Reviewed at https://reviews.apache.org/r/32830/

23 months agoRemove use of LocalServiceRegistry, simplify plumbing of HTTP address.
Bill Farner [Thu, 9 Apr 2015 04:47:29 +0000 (21:47 -0700)] 
Remove use of LocalServiceRegistry, simplify plumbing of HTTP address.

Testing Done:
Test suite + end-to-end tests.

Reviewed at https://reviews.apache.org/r/32806/

23 months agoIncrease executor resource epsilon to match the minimum required by Mesos.
Stephan Erb [Thu, 9 Apr 2015 04:46:11 +0000 (21:46 -0700)] 
Increase executor resource epsilon to match the minimum required by Mesos.

Bugs closed: AURORA-1246

Reviewed at https://reviews.apache.org/r/32861/

23 months agoRevert "Bump pants version to 0.0.32."
Zameer Manji [Wed, 8 Apr 2015 23:04:38 +0000 (16:04 -0700)] 
Revert "Bump pants version to 0.0.32."

qhis reverts commit 35f3e8daea815facccd1f5e577fe5a682bd02516. This reverts pants
to 0.0.28. After some extensive testing I have found some flakyness in how pants
0.0.32 handles pants.ini options and it is best to revert it here before
debugging.

Testing Done:
./pants --print-exception-stacktrace test.pytest --no-fast src/test/python/::

Reviewed at https://reviews.apache.org/r/32993/

23 months agoBump pants version to 0.0.32.
Zameer Manji [Wed, 8 Apr 2015 18:39:05 +0000 (11:39 -0700)] 
Bump pants version to 0.0.32.

From the [release notes](http://pantsbuild.github.io/changelog.html) we get PEX
improvements and a bunch of python related bug fixes.

Testing Done:
build-support/jenkins/build.sh
src/test/sh/org/apache/aurora/e2e/test_end_to_end.sh

Reviewed at https://reviews.apache.org/r/32912/

23 months agoRemove url related methods out of AuroraCommandContext
Zameer Manji [Tue, 7 Apr 2015 19:49:40 +0000 (12:49 -0700)] 
Remove url related methods out of AuroraCommandContext

This is a refactor of AuroraCommandContext which removes all url related methods
out of it. The objective of this refactor is to remove functionality from
AuroraCommandContext to allow for easier testing of commands. This commit also
adds two tests for commands which were using the url related functionality but
lacked test coverage.

Testing Done:
./pants test.pytest --no-fast src/test/python/apache/aurora/client/cli::

Reviewed at https://reviews.apache.org/r/32900/

23 months agoAdd a test utility to check that all fields are set on a storage entity.
Bill Farner [Tue, 7 Apr 2015 00:38:55 +0000 (17:38 -0700)] 
Add a test utility to check that all fields are set on a storage entity.

Reviewed at https://reviews.apache.org/r/32909/

23 months agoRemove scheduler warning when maxWaitToInstanceRunningMs is set.
Bill Farner [Mon, 6 Apr 2015 23:19:51 +0000 (16:19 -0700)] 
Remove scheduler warning when maxWaitToInstanceRunningMs is set.

Bugs closed: AURORA-1240

Reviewed at https://reviews.apache.org/r/32896/

23 months agoIgnore maxWaitToInstanceRunningMs in the scheduler updater.
Bill Farner [Mon, 6 Apr 2015 18:31:03 +0000 (11:31 -0700)] 
Ignore maxWaitToInstanceRunningMs in the scheduler updater.

Bugs closed: AURORA-1240

Reviewed at https://reviews.apache.org/r/32840/

23 months agoMake health check configurable
Brian Brazil [Fri, 3 Apr 2015 22:33:05 +0000 (15:33 -0700)] 
Make health check configurable

This allows the endpoint, expected response
and expected response code to be configured by the user.

Testing Done:
Unittests added and manurally verified in vagrant enviroment.

Bugs closed: AURORA-316

Reviewed at https://reviews.apache.org/r/32295/

23 months agoExtract job key from RPC parameters
Kevin Sweeney [Fri, 3 Apr 2015 21:19:55 +0000 (17:19 -0400)] 
Extract job key from RPC parameters

Testing Done:
./gradlew -Pq build

Bugs closed: AURORA-1187

Reviewed at https://reviews.apache.org/r/32329/

23 months agoFix checkstyle violations in benchmarks.
Bill Farner [Fri, 3 Apr 2015 18:33:49 +0000 (11:33 -0700)] 
Fix checkstyle violations in benchmarks.

Reviewed at https://reviews.apache.org/r/32825/

23 months agoAdd a benchmark for getRoleSummary.
Bill Farner [Fri, 3 Apr 2015 18:26:22 +0000 (11:26 -0700)] 
Add a benchmark for getRoleSummary.

Reviewed at https://reviews.apache.org/r/32802/

23 months agoMaking preemptor asynchronous. Part 3(final) - background service.
Maxim Khutornenko [Thu, 2 Apr 2015 21:29:39 +0000 (14:29 -0700)] 
Making preemptor asynchronous. Part 3(final) - background service.

Bugs closed: AURORA-1158

Reviewed at https://reviews.apache.org/r/32352/

23 months agoRefine types used in QuotaManager, share more functions/predicates.
Bill Farner [Wed, 1 Apr 2015 17:22:18 +0000 (10:22 -0700)] 
Refine types used in QuotaManager, share more functions/predicates.

Reviewed at https://reviews.apache.org/r/32371/

23 months agoDropping "incubator" from Aurora.
Maxim Khutornenko [Tue, 31 Mar 2015 19:11:13 +0000 (12:11 -0700)] 
Dropping "incubator" from Aurora.

Reviewed at https://reviews.apache.org/r/32641/

2 years agoKill inotify disk collector.
Brian Wickman [Sat, 28 Mar 2015 00:12:50 +0000 (17:12 -0700)] 
Kill inotify disk collector.

This is currently unwired and its only test is marked flaky.

Reviewed at https://reviews.apache.org/r/32515/

2 years agoEnable gradle daemon in Vagrant.
Kevin Sweeney [Fri, 27 Mar 2015 21:07:46 +0000 (14:07 -0700)] 
Enable gradle daemon in Vagrant.

Testing Done:
Sped up Kerberos integration testing.

Reviewed at https://reviews.apache.org/r/32554/

2 years agoFix missing hooked api dependencies.
Brian Wickman [Thu, 26 Mar 2015 22:30:46 +0000 (15:30 -0700)] 
Fix missing hooked api dependencies.

Testing Done:
mba=aurora=; ./pants test src/test/python/apache/aurora/client/hooks::

Reviewed at https://reviews.apache.org/r/32553/

2 years agoClean up bindings in DbModule.
Bill Farner [Tue, 24 Mar 2015 00:33:32 +0000 (17:33 -0700)] 
Clean up bindings in DbModule.

Reviewed at https://reviews.apache.org/r/32372/

2 years agoAdd a mechanism to lazily instantiate module classes.
Bill Farner [Tue, 24 Mar 2015 00:31:54 +0000 (17:31 -0700)] 
Add a mechanism to lazily instantiate module classes.

Bugs closed: AURORA-1217

Reviewed at https://reviews.apache.org/r/32377/

2 years agoAdd a test to ensure annotations exist for AuroraSchedulerManager
Kevin Sweeney [Mon, 23 Mar 2015 18:56:43 +0000 (11:56 -0700)] 
Add a test to ensure annotations exist for AuroraSchedulerManager

This addresses review feedback from https://reviews.apache.org/r/32141/
and prevents divergence when api.thrift changes.

Testing Done:
./gradlew build

Bugs closed: AURORA-1187

Reviewed at https://reviews.apache.org/r/32175/

2 years agoSimplify port name association.
Bill Farner [Mon, 23 Mar 2015 18:52:14 +0000 (11:52 -0700)] 
Simplify port name association.

Reviewed at https://reviews.apache.org/r/32369/

2 years agoAdd a deprecation warning when using the client-side updater.
Bill Farner [Sat, 21 Mar 2015 00:11:27 +0000 (17:11 -0700)] 
Add a deprecation warning when using the client-side updater.

Bugs closed: AURORA-1190

Reviewed at https://reviews.apache.org/r/32319/

2 years agoRename 'update status' to 'update info' and support fetching arbitrary updates.
Bill Farner [Fri, 20 Mar 2015 23:54:44 +0000 (16:54 -0700)] 
Rename 'update status' to 'update info' and support fetching arbitrary updates.

Bugs closed: AURORA-1206

Reviewed at https://reviews.apache.org/r/32313/

2 years agoDRY up PMD configuration.
Kevin Sweeney [Fri, 20 Mar 2015 19:54:49 +0000 (12:54 -0700)] 
DRY up PMD configuration.

Testing Done:
./gradlew -Pq pmdMain -d

diffed the "Using rule" log lines from before and after:

```
% diff -u <(sort -u old-rules.txt) <(sort -u new-rules.txt)
%
```

Reviewed at https://reviews.apache.org/r/32323/

2 years agoAdding preemptor jmh benchmark
Maxim Khutornenko [Fri, 20 Mar 2015 17:12:22 +0000 (10:12 -0700)] 
Adding preemptor jmh benchmark

Bugs closed: AURORA-1158

Reviewed at https://reviews.apache.org/r/32225/

2 years agoAdding check to see if java version is below 1.8
Florian Pfeiffer [Fri, 20 Mar 2015 16:59:32 +0000 (09:59 -0700)] 
Adding check to see if java version is below 1.8

Bugs closed: AURORA-1189

Reviewed at https://reviews.apache.org/r/32231/

2 years agoClarify docs for multi-master native log init.
Brian Brazil [Fri, 20 Mar 2015 15:00:00 +0000 (08:00 -0700)] 
Clarify docs for multi-master native log init.

Bugs closed: AURORA-991

Reviewed at https://reviews.apache.org/r/32303/

2 years agoFix error listing active updates.
Bill Farner [Fri, 20 Mar 2015 02:22:12 +0000 (19:22 -0700)] 
Fix error listing active updates.

Reviewed at https://reviews.apache.org/r/32276/

2 years agoChange "update list" subcommand to accept a hierarchy.
Bill Farner [Fri, 20 Mar 2015 00:44:34 +0000 (17:44 -0700)] 
Change "update list" subcommand to accept a hierarchy.

Bugs closed: AURORA-1168

Reviewed at https://reviews.apache.org/r/32171/

2 years agoMaking preemptor asynchronous. Part 2 - async handling.
Maxim Khutornenko [Fri, 20 Mar 2015 00:01:38 +0000 (17:01 -0700)] 
Making preemptor asynchronous. Part 2 - async handling.

Bugs closed: AURORA-1158

Reviewed at https://reviews.apache.org/r/32220/

2 years agoMoving pending task search into PreemptorImpl
Maxim Khutornenko [Wed, 18 Mar 2015 22:12:01 +0000 (15:12 -0700)] 
Moving pending task search into PreemptorImpl

Testing Done:
./gradlew -Pq build

Reviewed at https://reviews.apache.org/r/32164/

2 years agoReduce loglevel for insufficient GC resources to fine
Stephan Erb [Wed, 18 Mar 2015 21:11:10 +0000 (14:11 -0700)] 
Reduce loglevel for insufficient GC resources to fine

Testing Done:
./gradlew -Pq build

Reviewed at https://reviews.apache.org/r/32208/

2 years agoCache TaskDetectors for reuse.
Brian Wickman [Tue, 17 Mar 2015 21:37:53 +0000 (14:37 -0700)] 
Cache TaskDetectors for reuse.

Testing Done:
./pants test src/test/python/apache/thermos/observer:: + manual observation

Reviewed at https://reviews.apache.org/r/32013/

2 years agoIntroduce AnnotatedAuroraAdmin superclass for annotations.
Kevin Sweeney [Tue, 17 Mar 2015 20:26:33 +0000 (13:26 -0700)] 
Introduce AnnotatedAuroraAdmin superclass for annotations.

Add an AnnotatedAuroraAdmin subclass for AuroraAdmin.Iface and change
code to inherit from it. This gives us a place to put annotations like
the AuthorizingParam one introduced in this review without needing to
copy-paste them when we override a new method. A future diff will use
these annotations to determine which permission a method call needs by
inspecting the annotated parameter. I created a new interface to enable
DRY - otherwise I'd need to annotate both ForwardingThrift and
SchedulerThriftInterface and keep them in sync.

Testing Done:
./gradlew build

Bugs closed: AURORA-1187

Reviewed at https://reviews.apache.org/r/32141/

2 years agoImprove TaskDetector performance by memoizing regular expressions
Brian Wickman [Tue, 17 Mar 2015 20:13:46 +0000 (13:13 -0700)] 
Improve TaskDetector performance by memoizing regular expressions

We found that the new observer burns 10x the cpu in production.  Most of the
time is spent in compiling new regular expressions, so memoize them.
Follow-up review adds TaskDetector caching in observer.

Testing Done:
Added generic TaskDetector test and made sure it passes before/after.

Reviewed at https://reviews.apache.org/r/32012/