aurora.git
13 months agoUpdating .auroraversion to release version 0.15.0. rel/0.15.0
Maxim Khutornenko [Tue, 5 Jul 2016 18:40:45 +0000 (11:40 -0700)] 
Updating .auroraversion to release version 0.15.0.

13 months agoUpdating .auroraversion to 0.15.0-rc1. rel/0.15.0-rc1
Maxim Khutornenko [Fri, 1 Jul 2016 01:54:54 +0000 (18:54 -0700)] 
Updating .auroraversion to 0.15.0-rc1.

13 months agoIncrementing snapshot version to 0.16.0-SNAPSHOT.
Maxim Khutornenko [Fri, 1 Jul 2016 01:54:54 +0000 (18:54 -0700)] 
Incrementing snapshot version to 0.16.0-SNAPSHOT.

13 months agoUpdating CHANGELOG for 0.15.0 release.
Maxim Khutornenko [Fri, 1 Jul 2016 01:54:54 +0000 (18:54 -0700)] 
Updating CHANGELOG for 0.15.0 release.

13 months agoFixing e2e tests failing due to mesos-slave state.
Maxim Khutornenko [Fri, 1 Jul 2016 01:37:46 +0000 (18:37 -0700)] 
Fixing e2e tests failing due to mesos-slave state.

Reviewed at https://reviews.apache.org/r/49478/

13 months agoRevert "Updating CHANGELOG for 0.15.0 release."
Maxim Khutornenko [Thu, 30 Jun 2016 23:07:26 +0000 (16:07 -0700)] 
Revert "Updating CHANGELOG for 0.15.0 release."

This reverts commit 5de1803a247964bd7c4227562c33c4b9108c3c21.

13 months agoRevert "Incrementing snapshot version to 0.16.0-SNAPSHOT."
Maxim Khutornenko [Thu, 30 Jun 2016 23:06:57 +0000 (16:06 -0700)] 
Revert "Incrementing snapshot version to 0.16.0-SNAPSHOT."

This reverts commit 94e2eea541c3c6d408ac9f22492457060009c8d4.

13 months agoIncrementing snapshot version to 0.16.0-SNAPSHOT.
Maxim Khutornenko [Thu, 30 Jun 2016 18:28:14 +0000 (11:28 -0700)] 
Incrementing snapshot version to 0.16.0-SNAPSHOT.

13 months agoUpdating CHANGELOG for 0.15.0 release.
Maxim Khutornenko [Thu, 30 Jun 2016 18:28:14 +0000 (11:28 -0700)] 
Updating CHANGELOG for 0.15.0 release.

13 months agoFixup install docs to match 0.13.0+ packaging.
John Sirois [Thu, 30 Jun 2016 16:27:09 +0000 (10:27 -0600)] 
Fixup install docs to match 0.13.0+ packaging.

Reviewed at https://reviews.apache.org/r/49413/

13 months agoUpgrade to Mesos 0.28.2.
Joshua Cohen [Wed, 29 Jun 2016 17:45:50 +0000 (12:45 -0500)] 
Upgrade to Mesos 0.28.2.

Release notes:
  http://mesos.apache.org/blog/mesos-0-28-0-released/
  http://mesos.apache.org/blog/mesos-0-28-2-released/

Reviewed at https://reviews.apache.org/r/49384/

13 months agoAdd support for Mesos Fetcher
Renan DelValle [Wed, 29 Jun 2016 15:59:19 +0000 (08:59 -0700)] 
Add support for Mesos Fetcher

Reviewed at https://reviews.apache.org/r/49218/

13 months agoAURORA-1725 Expose tier configurations as a debug page
Mehrdad Nurolahzade [Tue, 28 Jun 2016 22:56:38 +0000 (15:56 -0700)] 
AURORA-1725 Expose tier configurations as a debug page

Reviewed at https://reviews.apache.org/r/49334/

13 months agoAdd announce and enable_hooks to Job Schema table
Benjamin Staffin [Tue, 28 Jun 2016 19:51:17 +0000 (21:51 +0200)] 
Add announce and enable_hooks to Job Schema table

Reviewed at https://reviews.apache.org/r/49330/

13 months agoAURORA-1458 Add tier into the UI "show config" summary
Mehrdad Nurolahzade [Tue, 21 Jun 2016 16:40:15 +0000 (09:40 -0700)] 
AURORA-1458 Add tier into the UI "show config" summary

Reviewed at https://reviews.apache.org/r/48796/

13 months agoEnsure we can verify release candidates in the Vagrant box
Stephan Erb [Mon, 20 Jun 2016 17:49:44 +0000 (19:49 +0200)] 
Ensure we can verify release candidates in the Vagrant box

* bump the virtualbox memory to make the tests pass
  (otherwise failing with 'Cannot allocate memory')
* remove unnecessary destroy step that seems to be copy
  pasted from the egg-building scripts.

Reviewed at https://reviews.apache.org/r/48591/

13 months agoAURORA-1710 Make 'tier' required and remove support for 'production'
Mehrdad Nurolahzade [Mon, 20 Jun 2016 16:58:51 +0000 (09:58 -0700)] 
AURORA-1710 Make 'tier' required and remove support for 'production'
flag in Job configuration - Backfill portion

Reviewed at https://reviews.apache.org/r/48559/

14 months agoRemove link to non-existing Locks page
Martin Hrabovcin [Thu, 16 Jun 2016 17:14:26 +0000 (10:14 -0700)] 
Remove link to non-existing Locks page

Reviewed at https://reviews.apache.org/r/48786/

14 months agoIncrementing snapshot version to 0.15.0-SNAPSHOT.
Stephan Erb [Fri, 10 Jun 2016 14:07:34 +0000 (16:07 +0200)] 
Incrementing snapshot version to 0.15.0-SNAPSHOT.

14 months agoUpdating CHANGELOG for 0.14.0 release.
Stephan Erb [Fri, 10 Jun 2016 14:07:34 +0000 (16:07 +0200)] 
Updating CHANGELOG for 0.14.0 release.

14 months agoPrepare RELEASE-NOTES.md for release
Stephan Erb [Fri, 10 Jun 2016 13:27:27 +0000 (15:27 +0200)] 
Prepare RELEASE-NOTES.md for release

14 months agoDon't require user when initializing a Docker sandbox.
Joshua Cohen [Thu, 9 Jun 2016 17:25:42 +0000 (12:25 -0500)] 
Don't require user when initializing a Docker sandbox.

Bugs closed: AURORA-1709

Reviewed at https://reviews.apache.org/r/48492/

14 months agoUpdated documentation to include custom executor explaination
Renan DelValle [Wed, 8 Jun 2016 17:35:51 +0000 (12:35 -0500)] 
Updated documentation to include custom executor explaination

Reviewed at https://reviews.apache.org/r/48360/

14 months agoAdding gpg key for serb
Stephan Erb [Tue, 7 Jun 2016 21:32:21 +0000 (23:32 +0200)] 
Adding gpg key for serb

Reviewed at https://reviews.apache.org/r/48359/

14 months agoConverting resource counters to use new resource fields
Maxim Khutornenko [Tue, 7 Jun 2016 21:04:31 +0000 (14:04 -0700)] 
Converting resource counters to use new resource fields

Reviewed at https://reviews.apache.org/r/47998/

14 months agoAURORA-1624 New thrift API for retrieving tier configuration
Mehrdad Nurolahzade [Tue, 7 Jun 2016 20:41:48 +0000 (13:41 -0700)] 
AURORA-1624 New thrift API for retrieving tier configuration

Bugs closed: AURORA-1624

Reviewed at https://reviews.apache.org/r/48082/

14 months agoDocument the logfile locations used in the vagrant box
Stephan Erb [Tue, 7 Jun 2016 18:42:43 +0000 (20:42 +0200)] 
Document the logfile locations used in the vagrant box

Reviewed at https://reviews.apache.org/r/48218/

14 months agoMark webhooks as experimental
Stephan Erb [Mon, 6 Jun 2016 22:49:43 +0000 (00:49 +0200)] 
Mark webhooks as experimental

14 months agoAdd webhook code that can POST events to an endpoint
Dmitriy Shirchenko [Mon, 6 Jun 2016 22:41:47 +0000 (00:41 +0200)] 
Add webhook code that can POST events to an endpoint

Bugs closed: AURORA-1683

Reviewed at https://reviews.apache.org/r/47440/

14 months agoChange the UI to refer to Mesos Agents instead of Mesos Slaves.
Stephan Erb [Sat, 4 Jun 2016 17:25:40 +0000 (19:25 +0200)] 
Change the UI to refer to Mesos Agents instead of Mesos Slaves.

This change also moves the /slaves endpoint to /agents and adds a compatibility redirect.

Bugs closed: AURORA-1449, AURORA-1450

Reviewed at https://reviews.apache.org/r/48216/

14 months agoFix containers doc example.
Raymond Khalife [Fri, 3 Jun 2016 16:12:08 +0000 (18:12 +0200)] 
Fix containers doc example.

Reviewed at https://reviews.apache.org/r/48211/

14 months agoAdding support for GPU resource
Maxim Khutornenko [Tue, 31 May 2016 01:43:47 +0000 (18:43 -0700)] 
Adding support for GPU resource

Reviewed at https://reviews.apache.org/r/47869/

14 months agoAdd -ip option to bind scheduler to a single IP
Chris Bannister [Thu, 26 May 2016 18:33:29 +0000 (13:33 -0500)] 
Add -ip option to bind scheduler to a single IP

Add an -ip command line option which sets the IP that the Jetty server
will listen on.

Bugs closed: AURORA-572

Reviewed at https://reviews.apache.org/r/47697/

14 months agoAURORA-1492 Improve "aurora update start" command output
Mehrdad Nurolahzade [Wed, 25 May 2016 22:39:49 +0000 (17:39 -0500)] 
AURORA-1492 Improve "aurora update start" command output

Reviewed at https://reviews.apache.org/r/47550/

14 months agoGeneralizing resource management on the client
Maxim Khutornenko [Wed, 25 May 2016 20:21:23 +0000 (13:21 -0700)] 
Generalizing resource management on the client

Reviewed at https://reviews.apache.org/r/47809/

14 months agoRemoving requestedPorts usage from the UI
Maxim Khutornenko [Wed, 25 May 2016 20:19:18 +0000 (13:19 -0700)] 
Removing requestedPorts usage from the UI

Reviewed at https://reviews.apache.org/r/47846/

14 months agoUpdating scheduler UI to use new resource objects
Maxim Khutornenko [Wed, 25 May 2016 17:09:31 +0000 (10:09 -0700)] 
Updating scheduler UI to use new resource objects

Reviewed at https://reviews.apache.org/r/47741/

14 months agoUse 'Mesos agent' instead of 'Mesos slave' in docs
Stephan Erb [Sun, 22 May 2016 10:09:14 +0000 (12:09 +0200)] 
Use 'Mesos agent' instead of 'Mesos slave' in docs

There are a few referencess left: those that refer to the `mesos-slave` command
line and those that document `clusters.json` attributes that use the term `slave`.

I am picking up this work from kts as the whole renaming has gained momentum in
Mesos https://github.com/apache/mesos/commit/24e1e098035ce918e0b73c9b3c751418d5c06064.

Bugs closed: AURORA-1451

Reviewed at https://reviews.apache.org/r/47495/

14 months agoImproving scheduling loop performance.
Maxim Khutornenko [Thu, 19 May 2016 21:34:14 +0000 (14:34 -0700)] 
Improving scheduling loop performance.

Reviewed at https://reviews.apache.org/r/47614/

14 months agoFixing resource slot counting.
Maxim Khutornenko [Thu, 19 May 2016 15:27:00 +0000 (08:27 -0700)] 
Fixing resource slot counting.

Reviewed at https://reviews.apache.org/r/47561/

15 months agoBatching explicit task reconciliation calls
Maxim Khutornenko [Mon, 16 May 2016 19:22:59 +0000 (12:22 -0700)] 
Batching explicit task reconciliation calls

Reviewed at https://reviews.apache.org/r/47373/

15 months agoRemoving Resources and ResourceSlot classes.
Maxim Khutornenko [Mon, 16 May 2016 19:21:40 +0000 (12:21 -0700)] 
Removing Resources and ResourceSlot classes.

Reviewed at https://reviews.apache.org/r/47325/

15 months agoGeneralizing AcceptedOffer resource management.
Maxim Khutornenko [Mon, 16 May 2016 17:27:13 +0000 (10:27 -0700)] 
Generalizing AcceptedOffer resource management.

Reviewed at https://reviews.apache.org/r/47261/

15 months agoMigrating preemptor and scheduling filter to ResourceBag.
Maxim Khutornenko [Tue, 10 May 2016 21:26:33 +0000 (14:26 -0700)] 
Migrating preemptor and scheduling filter to ResourceBag.

Reviewed at https://reviews.apache.org/r/47050/

15 months agoFix dead link in documentation
Stephan Erb [Sun, 8 May 2016 21:54:53 +0000 (23:54 +0200)] 
Fix dead link in documentation

Reviewed at https://reviews.apache.org/r/47099/

15 months agoAdd client and scheduler support for launching tasks using the Mesos unified containe...
Joshua Cohen [Fri, 6 May 2016 20:13:56 +0000 (15:13 -0500)] 
Add client and scheduler support for launching tasks using the Mesos unified containerizer

A few notes:

1. It's not possible to configure Mesos 0.27.x to launch docker tasks due to a bug in parsing the
docker_store_dir flag. Fixed here: https://reviews.apache.org/r/43451/ but has not been backported
to Mesos 0.27. This means we can only launch tasks that use AppC images until we upgrade our Mesos
dependency to 0.28.x. The good news is I've confirmed that launching tasks with Docker images *does*
work by using Aurora linked against 0.27.x but running Mesos 0.28.x in Vagrant.

2. The Mesos unified containerizer does not automatically create mount points in the filesystem from
the image. It expects the full path to the mount to exist in the image. For /etc/passwd and
/etc/groups this is not a problem, but for the announcer acls file it was. I ended up moving the
announcer acl file into its own directory and mount that instead. In conjunction with this I also
had to modify our http_example Dockerfile to explicitly create that mount point. A case could be
made for sticking with the current path and just creating an empty file in the image, I felt that
creating an empty directory was slightly less gross. This is tracked by
https://issues.apache.org/jira/browse/MESOS-5229.

Reviewed at https://reviews.apache.org/r/46835/

15 months agoReplacing IResourceAggregate in resource calculations.
Maxim Khutornenko [Fri, 6 May 2016 19:13:53 +0000 (12:13 -0700)] 
Replacing IResourceAggregate in resource calculations.

Reviewed at https://reviews.apache.org/r/46997/

15 months agoChanging ResourceMapper interface arg type
Maxim Khutornenko [Fri, 6 May 2016 18:22:05 +0000 (11:22 -0700)] 
Changing ResourceMapper interface arg type

Reviewed at https://reviews.apache.org/r/47076/

15 months agoAdding mesos resource converter
Maxim Khutornenko [Wed, 4 May 2016 20:14:15 +0000 (13:14 -0700)] 
Adding mesos resource converter

Reviewed at https://reviews.apache.org/r/46948/

15 months agoCommand line flag to change FrameworkInfo.name
Stephan Erb [Tue, 3 May 2016 22:25:59 +0000 (00:25 +0200)] 
Command line flag to change FrameworkInfo.name

This commit introduces a new command line flag `-framework_name` and changes the value from the hardcoded 'TwitterScheduler' to 'aurora'.
This change is non-intrusive as https://issues.apache.org/jira/browse/MESOS-2614 has been fixed. The new value will be shown on the UI and used for Mesos DNS.

Bugs closed: AURORA-945

Reviewed at https://reviews.apache.org/r/46596/

15 months agoGeneralizing port resource management.
Maxim Khutornenko [Mon, 2 May 2016 16:04:54 +0000 (09:04 -0700)] 
Generalizing port resource management.

Reviewed at https://reviews.apache.org/r/46810/

15 months agoAdd missing Mesos dependency to packer build script.
Joshua Cohen [Thu, 28 Apr 2016 19:47:20 +0000 (14:47 -0500)] 
Add missing Mesos dependency to packer build script.

See http://markmail.org/message/rofuiaclgkesfx3o for full details.

Reviewed at https://reviews.apache.org/r/46786/

15 months agoFixing e2e tests.
Maxim Khutornenko [Thu, 28 Apr 2016 18:49:22 +0000 (11:49 -0700)] 
Fixing e2e tests.

Reviewed at https://reviews.apache.org/r/46795/

15 months agoIntroduce command line option to control the offer filter duration
Stephan Erb [Wed, 27 Apr 2016 22:23:20 +0000 (00:23 +0200)] 
Introduce command line option to control the offer filter duration

Aurora is declining Mesos offers implicitly when launching a task and explicitly when compacting multiple offers of a slave into a single one.
The filter duration instructs Mesos to return the declined resources to us only after a timeout of X seconds, even if there is no other framework that wants them. If no filter is supplied, the hardcoded default of 5 seconds would be used.

By making this value configurable, Aurora can be tuned for either single or multi-framework deployment.

Bugs closed: AURORA-1658

Reviewed at https://reviews.apache.org/r/46603/

15 months agoResourceAggregate schema changes for resource refactoring.
Maxim Khutornenko [Wed, 27 Apr 2016 19:05:11 +0000 (12:05 -0700)] 
ResourceAggregate schema changes for resource refactoring.

Reviewed at https://reviews.apache.org/r/46716/

15 months agoAdd Kakao to companies using Aurora.
se choi [Wed, 27 Apr 2016 15:14:53 +0000 (10:14 -0500)] 
Add Kakao to companies using Aurora.

Reviewed at https://reviews.apache.org/r/46739/

15 months agoDeprecating --restart-threshold option in 'aurora job restart'
Maxim Khutornenko [Mon, 25 Apr 2016 23:22:16 +0000 (16:22 -0700)] 
Deprecating --restart-threshold option in 'aurora job restart'

Bugs closed: AURORA-1631

Reviewed at https://reviews.apache.org/r/46587/

15 months agoSchema changes for resource management refactoring
Maxim Khutornenko [Mon, 25 Apr 2016 23:19:29 +0000 (16:19 -0700)] 
Schema changes for resource management refactoring

Reviewed at https://reviews.apache.org/r/46459/

15 months agoAdd GPU design document
Stephan Erb [Fri, 22 Apr 2016 22:43:37 +0000 (00:43 +0200)] 
Add GPU design document

Reviewed at https://reviews.apache.org/r/46591/

15 months agoRevert "Moving db migration into LogStorage"
Maxim Khutornenko [Thu, 21 Apr 2016 21:10:41 +0000 (14:10 -0700)] 
Revert "Moving db migration into LogStorage"

This reverts commit ae051f3b92797d5c9f328c6c6d42d03ee4077938.

Reviewed at https://reviews.apache.org/r/46499/

15 months agoFix bug when fetching a task with multiple assigned ports.
Joshua Cohen [Thu, 21 Apr 2016 19:23:45 +0000 (14:23 -0500)] 
Fix bug when fetching a task with multiple assigned ports.

Because we did not include the ids for task ports and task events in the query when mybatis tried
to map the results, there was no way to identify the task events returned in each additional row
for ports as distinct. This resulted in each subsequent task fetch tacking on extra task events.

Bugs closed: AURORA-1672

Reviewed at https://reviews.apache.org/r/46506/

15 months agoRevert "Revert "Upgrade to Mesos 0.27.2""
Joshua Cohen [Wed, 20 Apr 2016 15:27:23 +0000 (10:27 -0500)] 
Revert "Revert "Upgrade to Mesos 0.27.2""

This reverts commit 81f52e4ae6a8368cc7667d5cc758fc91fb3718f1.

Also bump box version to 0.0.5 to pick up mesos 27.

Reviewed at https://reviews.apache.org/r/46336/

15 months agoDeleting --setuid-health-checks and switching to --nosetuid-health-checks flag
Dmitriy Shirchenko [Tue, 19 Apr 2016 19:40:32 +0000 (12:40 -0700)] 
Deleting --setuid-health-checks and switching to --nosetuid-health-checks flag
to to control whether the executor runs health checks as the job role's user.

Bugs closed: AURORA-1666

Reviewed at https://reviews.apache.org/r/46361/

16 months agoAdd @Timed annotations to cron stores.
Zameer Manji [Mon, 18 Apr 2016 21:52:30 +0000 (14:52 -0700)] 
Add @Timed annotations to cron stores.

Both cron stores don't have @Timed annoations. This adds them so operators can
look at the throughput of storage.

Bugs closed: AURORA-1665

Reviewed at https://reviews.apache.org/r/46346/

16 months agoAdding a flag to control whether the executor runs health checks as the job role...
Dmitriy Shirchenko [Mon, 18 Apr 2016 19:23:11 +0000 (12:23 -0700)] 
Adding a flag to control whether the executor runs health checks as the job role's user

Bugs closed: AURORA-1666

Reviewed at https://reviews.apache.org/r/46290/

16 months agoPlumb Curator discovery as an option.
John Sirois [Mon, 18 Apr 2016 18:26:39 +0000 (12:26 -0600)] 
Plumb Curator discovery as an option.

This Adds a Guice module for the Curator discovery implementations and
re-works the `ServiceDiscoveryModule` to optionally bind it when the new
`-zk_use_curator` flag is set.

Bugs closed: AURORA-1468, AURORA-1669

Reviewed at https://reviews.apache.org/r/46286/

16 months agoMoving db migration into LogStorage
Maxim Khutornenko [Mon, 18 Apr 2016 18:24:54 +0000 (11:24 -0700)] 
Moving db migration into LogStorage

Reviewed at https://reviews.apache.org/r/46291/

16 months agoMake MyBatis connection pool size configurable.
Zameer Manji [Mon, 18 Apr 2016 18:04:03 +0000 (11:04 -0700)] 
Make MyBatis connection pool size configurable.

This adds two arguments which enables operators to configure the internal
MyBatis connection pool size. Increasing the size will allow for greater
concurrency in larger clusters.

Reviewed at https://reviews.apache.org/r/46289/

16 months agoAdd an explicit box version to Vagrantfile.
Joshua Cohen [Mon, 18 Apr 2016 15:41:02 +0000 (10:41 -0500)] 
Add an explicit box version to Vagrantfile.

Bugs closed: AURORA-1667

Reviewed at https://reviews.apache.org/r/46335/

16 months agoRevert "Upgrade to Mesos 0.27.2"
Joshua Cohen [Fri, 15 Apr 2016 22:20:24 +0000 (17:20 -0500)] 
Revert "Upgrade to Mesos 0.27.2"

This reverts commit 0d12515c0e30a13a4d18ba5fa80f804322a9bd6d.

16 months agoUpgrade to Mesos 0.27.2
Joshua Cohen [Fri, 15 Apr 2016 21:52:39 +0000 (16:52 -0500)] 
Upgrade to Mesos 0.27.2

Release notes here: http://mesos.apache.org/blog/mesos-0-27-0-released/
Upgrade notes here: http://mesos.apache.org/documentation/latest/upgrades/#0-27-x-implicit-roles

Reviewed at https://reviews.apache.org/r/46241/

16 months agoReplace org.apache.aurora.common.base.Closure with java.util.function.Consumer
Zameer Manji [Fri, 15 Apr 2016 21:02:57 +0000 (14:02 -0700)] 
Replace org.apache.aurora.common.base.Closure with java.util.function.Consumer

Commons came with a `Closure` type which is identical to the Java 8 type
`Consumer`. This replaces the former with the latter in the interests of
reducing the commons code and fork.

Reviewed at https://reviews.apache.org/r/46167/

16 months agoCentralize ZooKeeper configuration in discovery.
John Sirois [Fri, 15 Apr 2016 18:37:12 +0000 (12:37 -0600)] 
Centralize ZooKeeper configuration in discovery.

This moves `ZooKeeperClient` configuration to the discovery package and
factors `ZooKeeperConfig` up out of the `ZooKeeperClientModule`
for re-use as ZooKeeper config data by Curator.

Bugs closed: AURORA-1468

Reviewed at https://reviews.apache.org/r/46171/

16 months agoIntroduce a Curator-based `SingletonService`.
John Sirois [Thu, 14 Apr 2016 01:27:17 +0000 (19:27 -0600)] 
Introduce a Curator-based `SingletonService`.

Bugs closed: AURORA-1468

Reviewed at https://reviews.apache.org/r/46111/

16 months agoSimplify `Credentials`; kill `ZooKeeperClient` dep.
John Sirois [Wed, 13 Apr 2016 22:11:38 +0000 (16:11 -0600)] 
Simplify `Credentials`; kill `ZooKeeperClient` dep.

The Curator discovery code will need to be configured from the same
command line flags and code as the commons discovery code.  This
simplifies Credentials to be a simple struct and adapts from the
`Credentials.NONE` null-object to use of `Optional` in consumers.

Bugs closed: AURORA-1468

Reviewed at https://reviews.apache.org/r/46133/

16 months agoDiscuss guest-additions version mismatch.
John Sirois [Wed, 13 Apr 2016 20:43:13 +0000 (14:43 -0600)] 
Discuss guest-additions version mismatch.

This adds a paragraph to the "Start the local cluster" section that
explains the guest-additions mismatch warning and suggests an optional
fix.

Bugs closed: AURORA-1663

Reviewed at https://reviews.apache.org/r/46150/

16 months agoRemoving ResourceVector enum in favor of ResourceType
Maxim Khutornenko [Tue, 12 Apr 2016 18:27:57 +0000 (11:27 -0700)] 
Removing ResourceVector enum in favor of ResourceType

Reviewed at https://reviews.apache.org/r/46064/

16 months agoRevert "Revert "Add support for storing and fetching images as properties of task...
Joshua Cohen [Tue, 12 Apr 2016 17:42:09 +0000 (12:42 -0500)] 
Revert "Revert "Add support for storing and fetching images as properties of task configs.""

This reverts commit b5c9e1bc46a623b5d898ec4dacbe132b79903dd7 and layers the changes needed to
support DB migrations on top as well.

Reviewed at https://reviews.apache.org/r/46103/

16 months agoAdd a test for invalid member nodes.
John Sirois [Tue, 12 Apr 2016 17:20:06 +0000 (11:20 -0600)] 
Add a test for invalid member nodes.

Bugs closed: AURORA-1468

Reviewed at https://reviews.apache.org/r/46069/

16 months agoAURORA-1584: Aurora 0.13.0 release candidate missing CHANGELOG
Jake Farrell [Tue, 12 Apr 2016 15:58:28 +0000 (11:58 -0400)] 
AURORA-1584: Aurora 0.13.0 release candidate missing CHANGELOG

Updates CHANGELOG missed when creating the 0.13.0-rc0 release candidate.

Bugs closed: AURORA-1584

Reviewed at https://reviews.apache.org/r/46098/

16 months agoFix stale NEWS RC email link.
John Sirois [Tue, 12 Apr 2016 05:05:37 +0000 (23:05 -0600)] 
Fix stale NEWS RC email link.

The NEWS file was moved to RELEASE-NOTES.md in cbb206c5.

Bugs closed: AURORA-1584

Reviewed at https://reviews.apache.org/r/46070/

16 months agoMake `ServerSet.JSON_CODEC` robust to errors.
John Sirois [Tue, 12 Apr 2016 04:31:49 +0000 (22:31 -0600)] 
Make `ServerSet.JSON_CODEC` robust to errors.

Previously bad or partial input (deserialize), and errors writing output
(serialize) could throw exceptions not matching the `Codec` contract.
Factor the codec into its own top-level class to allow testing the
serialization failure case and expand coverage to include bad inputs.

Bugs closed: AURORA-1468

Reviewed at https://reviews.apache.org/r/45992/

16 months agoIntroduce a Curator-based `ServiceGroupMonitor`.
John Sirois [Tue, 12 Apr 2016 04:31:27 +0000 (22:31 -0600)] 
Introduce a Curator-based `ServiceGroupMonitor`.

Bugs closed: AURORA-1468

Reviewed at https://reviews.apache.org/r/45902/

16 months agoIncrementing snapshot version to 0.13.1-SNAPSHOT.
jfarrell [Tue, 12 Apr 2016 03:23:04 +0000 (23:23 -0400)] 
Incrementing snapshot version to 0.13.1-SNAPSHOT.

16 months agoUpdating CHANGELOG for 0.13.0 release.
jfarrell [Tue, 12 Apr 2016 03:23:04 +0000 (23:23 -0400)] 
Updating CHANGELOG for 0.13.0 release.

16 months agoRenaming ResourceType.getName()
Maxim Khutornenko [Mon, 11 Apr 2016 23:02:20 +0000 (16:02 -0700)] 
Renaming ResourceType.getName()

Reviewed at https://reviews.apache.org/r/46057/

16 months agoMoving resource-related classes into a new package
Maxim Khutornenko [Mon, 11 Apr 2016 21:45:39 +0000 (14:45 -0700)] 
Moving resource-related classes into a new package

Reviewed at https://reviews.apache.org/r/46051/

16 months agoRemoving unused quota_check.py
Maxim Khutornenko [Mon, 11 Apr 2016 21:43:47 +0000 (14:43 -0700)] 
Removing unused quota_check.py

Reviewed at https://reviews.apache.org/r/46045/

16 months agoRemove support for positional command line arguments,
Bill Farner [Fri, 8 Apr 2016 19:28:43 +0000 (12:28 -0700)] 
Remove support for positional command line arguments,

Reviewed at https://reviews.apache.org/r/45939/

16 months agoRemove support for reading command line argument values from files.
Bill Farner [Fri, 8 Apr 2016 19:20:54 +0000 (12:20 -0700)] 
Remove support for reading command line argument values from files.

Reviewed at https://reviews.apache.org/r/45936/

16 months agoRemove support for canonical command line arg names.
Bill Farner [Fri, 8 Apr 2016 19:03:59 +0000 (12:03 -0700)] 
Remove support for canonical command line arg names.

Reviewed at https://reviews.apache.org/r/45935/

16 months agoFix bug when checking to ensure that all db migrations on the classpath have been...
Joshua Cohen [Fri, 8 Apr 2016 18:48:05 +0000 (13:48 -0500)] 
Fix bug when checking to ensure that all db migrations on the classpath have been applied.

While testing applying the multiple migrations for storing images, I noticed that we were rolling
one back on startup when no migration should be performed.

It turned out I misunderstood the semantics of the Java8 stream API filter/findFirst combination.

Reviewed at https://reviews.apache.org/r/45933/

16 months agoAdd support for automated DB migrations and rollbacks when restoring from dbScript...
Joshua Cohen [Fri, 8 Apr 2016 00:33:24 +0000 (19:33 -0500)] 
Add support for automated DB migrations and rollbacks when restoring from dbScript stored in a
snapshot.

Bugs closed: AURORA-1648

Reviewed at https://reviews.apache.org/r/45816/

16 months agoGeneralize ZooKeeper Test Utils.
John Sirois [Thu, 7 Apr 2016 21:03:08 +0000 (15:03 -0600)] 
Generalize ZooKeeper Test Utils.

This makes way for Curator client based in-process integration tests.

Bugs closed: AURORA-1468

Reviewed at https://reviews.apache.org/r/45886/

16 months agoSet DiscoveryInfo in mesos tasks.
Zhitao Li [Thu, 7 Apr 2016 04:31:48 +0000 (21:31 -0700)] 
Set DiscoveryInfo in mesos tasks.

This allows alternative service discovery methodologies
to find tasks from Aurora (e.g. mesos-dns), especially
the dynamic port mapping.

Bugs closed: AURORA-1629

Reviewed at https://reviews.apache.org/r/45177/

16 months agoFix packer builder to not prompt for input.
Bill Farner [Thu, 7 Apr 2016 02:55:49 +0000 (19:55 -0700)] 
Fix packer builder to not prompt for input.

Reviewed at https://reviews.apache.org/r/45858/

16 months agoFactor out a discovery package.
John Sirois [Thu, 7 Apr 2016 02:46:04 +0000 (20:46 -0600)] 
Factor out a discovery package.

This will be the home for the Curator implementations.

In the process, lift the `ServerSetMonitor` to a top-level class and add
a test. Also tighten up the `ServiceDiscoveryModule` and make
requirements and exports clear.

Bugs closed: AURORA-1468

Reviewed at https://reviews.apache.org/r/45850/

16 months agoSkip flaky test test_health_checker_metrics.
Bill Farner [Thu, 7 Apr 2016 01:06:05 +0000 (18:06 -0700)] 
Skip flaky test test_health_checker_metrics.

Reviewed at https://reviews.apache.org/r/45372/

16 months agoRemove AddInstancesConfig parameter from addInstances RPC.
Bill Farner [Thu, 7 Apr 2016 00:20:29 +0000 (17:20 -0700)] 
Remove AddInstancesConfig parameter from addInstances RPC.

Bugs closed: AURORA-1595

Reviewed at https://reviews.apache.org/r/45725/

16 months agoImplement custom MyBatis cache to record cache statistics.
Zameer Manji [Wed, 6 Apr 2016 23:10:17 +0000 (16:10 -0700)] 
Implement custom MyBatis cache to record cache statistics.

This swaps out our use of the MyBatis default cache with a custom one backed by
Guava. The benefit of this is that we can now plumb cache statistics out which
is helpful in debugging performance problems with MyBatis.

Reviewed at https://reviews.apache.org/r/45821/