aurora.git
23 months agoUpdating .auroraversion to release version 0.9.0. rel/0.9.0
jfarrell [Thu, 23 Jul 2015 20:47:15 +0000 (16:47 -0400)] 
Updating .auroraversion to release version 0.9.0.

23 months agoUpdating .auroraversion to 0.9.0-rc0.
jfarrell [Mon, 20 Jul 2015 17:12:31 +0000 (13:12 -0400)] 
Updating .auroraversion to 0.9.0-rc0.

23 months agoUpdating CHANGELOG for 0.9.0 release.
jfarrell [Mon, 20 Jul 2015 17:12:31 +0000 (13:12 -0400)] 
Updating CHANGELOG for 0.9.0 release.

23 months agoRevert 0.9.0-rc0 changes to master due to bad changelog
jfarrell [Mon, 20 Jul 2015 16:50:21 +0000 (12:50 -0400)] 
Revert 0.9.0-rc0 changes to master due to bad changelog

23 months agoIncrementing snapshot version to 0.10.0-SNAPSHOT.
jfarrell [Mon, 20 Jul 2015 16:29:32 +0000 (12:29 -0400)] 
Incrementing snapshot version to 0.10.0-SNAPSHOT.

23 months agoUpdating CHANGELOG for 0.9.0 release.
jfarrell [Mon, 20 Jul 2015 16:29:32 +0000 (12:29 -0400)] 
Updating CHANGELOG for 0.9.0 release.

23 months agoImprove diff output of aurora cli.
Brian Brazil [Fri, 17 Jul 2015 22:14:26 +0000 (15:14 -0700)] 
Improve diff output of aurora cli.

Use json.dumps to pretty print the executor config,
and munge it to look right and not get messed with by
the general pretty printer.
Show newlines directly so that multi-line cmdlines look right.

Make DIFF_VIEWER work for things like "diff -u10"

Testing Done:
Tested in vargant environment.

Reviewed at https://reviews.apache.org/r/36392/

23 months agoUse the application-level storage lock to prevent DB-level deadlock when GCing rows.
Bill Farner [Fri, 17 Jul 2015 01:01:08 +0000 (18:01 -0700)] 
Use the application-level storage lock to prevent DB-level deadlock when GCing rows.

Bugs closed: AURORA-1401

Reviewed at https://reviews.apache.org/r/36561/

23 months agoUse HTTPS for Twitter Maven repository.
Kevin Sweeney [Thu, 16 Jul 2015 00:04:05 +0000 (17:04 -0700)] 
Use HTTPS for Twitter Maven repository.

Testing Done:
rm -fr ~/.gradle/caches
./gradlew assemble

Reviewed at https://reviews.apache.org/r/36526/

23 months agoPrevent job updates from allowing unbounded instance events
Joe Smith [Wed, 15 Jul 2015 22:02:24 +0000 (15:02 -0700)] 
Prevent job updates from allowing unbounded instance events

Bugs closed: AURORA-1096

Reviewed at https://reviews.apache.org/r/36436/

23 months agoUse Provider<Optional<Subject>> instead of optional injection for Shiro audit logging.
Kevin Sweeney [Wed, 15 Jul 2015 18:55:28 +0000 (11:55 -0700)] 
Use Provider<Optional<Subject>> instead of optional injection for Shiro audit logging.

Use injection of an optional value instead of optional injection.

Testing Done:
./gradlew build

Bugs closed: AURORA-1352

Reviewed at https://reviews.apache.org/r/36490/

23 months agoRemoves version on virtual pacakge in debian control
Andrew Jorgensen [Wed, 15 Jul 2015 18:35:01 +0000 (11:35 -0700)] 
Removes version on virtual pacakge in debian control

java-runtime-headless is a virtual package and cannot have a version
specified. The consequence of this is that the built packages require openjdk-8
be installed which prevented the packages from working with oracle-java8.
java8-runtime-headless is a virtual package provided by both openjdk-8
and oracle-java8 so the resulting debian packages can be installed on a
machine with either versions of java8 installed.

Testing Done:
Started two docker containers, one with oracle-java8 and the other with
openjdk-8. I was able to install the aurora-scheduler package in both containers
with this change.

Bugs closed: AURORA-1400

Reviewed at https://reviews.apache.org/r/36511/

23 months agoClient: when waiting for a job update, use helpful exit codes.
Bill Farner [Tue, 14 Jul 2015 20:58:17 +0000 (13:58 -0700)] 
Client: when waiting for a job update, use helpful exit codes.

Bugs closed: AURORA-1399

Reviewed at https://reviews.apache.org/r/36478/

23 months agoMake e2e test fail when a command fails.
Kevin Sweeney [Tue, 14 Jul 2015 19:03:48 +0000 (12:03 -0700)] 
Make e2e test fail when a command fails.

Make e2e test fail correctly.

This doesn't fix the test (still investigating the root cause there),
but causes it to be properly broken.

Testing Done:
```
+ + grep -q 'shiro_audit_logging_enabled 1'
+ curl -s localhost:8081/vars
+ tear_down 1
+ local retcode=1
+ sudo cp /vagrant/examples/vagrant/clusters.json /etc/aurora/clusters.json
+ sudo stop aurora-scheduler-kerberos
aurora-scheduler-kerberos stop/waiting
+ sudo rm -f /etc/init/aurora-scheduler-kerberos.conf
+ sudo start aurora-scheduler
aurora-scheduler start/running, process 13559
+ [[ 1 -ne 0 ]]
+ echo

+ echo '!!! FAILED'
!!! FAILED
+ echo
```

Bugs closed: AURORA-1378

Reviewed at https://reviews.apache.org/r/36063/

23 months agoUpgrade isort version, which is less verbose by default.
Bill Farner [Tue, 14 Jul 2015 17:57:46 +0000 (10:57 -0700)] 
Upgrade isort version, which is less verbose by default.

Bugs closed: AURORA-1397

Reviewed at https://reviews.apache.org/r/36456/

23 months agoTidying RPM packaging README and specfile
Steve Salevan [Tue, 14 Jul 2015 17:50:34 +0000 (10:50 -0700)] 
Tidying RPM packaging README and specfile

Bugs closed: AURORA-1391

Reviewed at https://reviews.apache.org/r/36370/

23 months agoIntroduce DB entity objects and avoid ugly hacks around mybatis/thrift issues.
Bill Farner [Mon, 13 Jul 2015 23:40:34 +0000 (16:40 -0700)] 
Introduce DB entity objects and avoid ugly hacks around mybatis/thrift issues.

Reviewed at https://reviews.apache.org/r/36407/

23 months agoFix AuroraConfigLoader schema filtering when loading from string.
Brian Wickman [Mon, 13 Jul 2015 23:11:57 +0000 (16:11 -0700)] 
Fix AuroraConfigLoader schema filtering when loading from string.

We have an internal tool that needs to serialize configs into a string and
retrieve them from stable storage.  We had deployed a client containing
shutdown_endpoint then reverted it in https://reviews.apache.org/r/35847/
but unfortunately deserialization broke the internal tool since it was not
filtering out the unknown attributes.

Testing Done:
Added test, it broke.  Fixed code, tests passed.

Also updated tests to not create files when not necessary.

Reviewed at https://reviews.apache.org/r/36459/

23 months agoFix JDBC URL.
Bill Farner [Mon, 13 Jul 2015 22:22:15 +0000 (15:22 -0700)] 
Fix JDBC URL.

Reviewed at https://reviews.apache.org/r/36387/

23 months agoRemove restriction that -hostname must resolve.
Brian Brazil [Fri, 10 Jul 2015 02:07:20 +0000 (19:07 -0700)] 
Remove restriction that -hostname must resolve.

Reviewed at https://reviews.apache.org/r/36305/

23 months agoTaskConfigManager: de-dupe task configs when inserting.
Bill Farner [Thu, 9 Jul 2015 21:56:42 +0000 (14:56 -0700)] 
TaskConfigManager: de-dupe task configs when inserting.

Bugs closed: AURORA-1392

Reviewed at https://reviews.apache.org/r/36372/

23 months agoUpgrade gradle version dependencies in rpm/deb specs.
Bill Farner [Thu, 9 Jul 2015 21:28:20 +0000 (14:28 -0700)] 
Upgrade gradle version dependencies in rpm/deb specs.

Reviewed at https://reviews.apache.org/r/36365/

23 months agoDB cron job store: allow upsert.
Bill Farner [Thu, 9 Jul 2015 20:53:23 +0000 (13:53 -0700)] 
DB cron job store: allow upsert.

Bugs closed: AURORA-1390

Reviewed at https://reviews.apache.org/r/36367/

23 months agoUpgrade to checkstyle 6.7.
Bill Farner [Thu, 9 Jul 2015 19:52:44 +0000 (12:52 -0700)] 
Upgrade to checkstyle 6.7.

Reviewed at https://reviews.apache.org/r/36364/

23 months agoRelax the transaction isolation in H2 to match MemStorage behavior.
Bill Farner [Thu, 9 Jul 2015 19:29:53 +0000 (12:29 -0700)] 
Relax the transaction isolation in H2 to match MemStorage behavior.

Bugs closed: AURORA-1386

Reviewed at https://reviews.apache.org/r/36357/

23 months agoDon't reject update requests scoped to already-updated instances.
Bill Farner [Thu, 9 Jul 2015 19:15:32 +0000 (12:15 -0700)] 
Don't reject update requests scoped to already-updated instances.

Bugs closed: AURORA-1332

Reviewed at https://reviews.apache.org/r/36338/

23 months agoUpgrade to gradle 2.5.
Bill Farner [Thu, 9 Jul 2015 19:07:47 +0000 (12:07 -0700)] 
Upgrade to gradle 2.5.

Reviewed at https://reviews.apache.org/r/36362/

23 months agoAdd a stat that tracks uncaught exceptions in pubsub event handlers.
Bill Farner [Thu, 9 Jul 2015 18:22:39 +0000 (11:22 -0700)] 
Add a stat that tracks uncaught exceptions in pubsub event handlers.

Reviewed at https://reviews.apache.org/r/36329/

23 months agoPerform leader redirect using HTTP status code 307.
Stephan Erb [Wed, 8 Jul 2015 21:56:03 +0000 (14:56 -0700)] 
Perform leader redirect using HTTP status code 307.

Reviewed at https://reviews.apache.org/r/36064/

23 months agoEnable debugging tools on the scheduler in vagrant.
Bill Farner [Wed, 8 Jul 2015 21:52:44 +0000 (14:52 -0700)] 
Enable debugging tools on the scheduler in vagrant.

Reviewed at https://reviews.apache.org/r/36320/

23 months agoDB task store: Remove invalid constraint on task_config_metadata.
Bill Farner [Wed, 8 Jul 2015 20:57:26 +0000 (13:57 -0700)] 
DB task store: Remove invalid constraint on task_config_metadata.

Bugs closed: AURORA-1383

Reviewed at https://reviews.apache.org/r/36319/

23 months agoAdds RPM specfile and support scripting
Steve Salevan [Mon, 6 Jul 2015 21:57:34 +0000 (14:57 -0700)] 
Adds RPM specfile and support scripting

Bugs closed: AURORA-1116

Reviewed at https://reviews.apache.org/r/33778/

23 months agoChange docs to use a working git repo URL.
Bill Farner [Mon, 6 Jul 2015 21:41:09 +0000 (14:41 -0700)] 
Change docs to use a working git repo URL.

Bugs closed: AURORA-1382

Reviewed at https://reviews.apache.org/r/36220/

23 months agoFix DB constraint violation when updating host attributes.
Bill Farner [Mon, 6 Jul 2015 21:21:18 +0000 (14:21 -0700)] 
Fix DB constraint violation when updating host attributes.

Bugs closed: AURORA-1379

Reviewed at https://reviews.apache.org/r/36096/

23 months agoCompute SLA stats for non-prod jobs
Stephan Erb [Mon, 6 Jul 2015 18:11:48 +0000 (11:11 -0700)] 
Compute SLA stats for non-prod jobs

Testing Done:
`./gradlew -Pq build` and a manual verification in Vagrant.

Bugs closed: AURORA-1350

Reviewed at https://reviews.apache.org/r/35498/

23 months agoUpgrade to rbt 0.7.4.
Bill Farner [Wed, 1 Jul 2015 19:30:21 +0000 (12:30 -0700)] 
Upgrade to rbt 0.7.4.

Reviewed at https://reviews.apache.org/r/36100/

23 months agoRemove unnecessary uses of type witness.
Bill Farner [Wed, 1 Jul 2015 19:29:27 +0000 (12:29 -0700)] 
Remove unnecessary uses of type witness.

Reviewed at https://reviews.apache.org/r/35932/

23 months agoPrevent quota from being set below current production reservation.
Zameer Manji [Wed, 1 Jul 2015 18:15:59 +0000 (11:15 -0700)] 
Prevent quota from being set below current production reservation.

Having quota below current production reservation is illogical and the scheduler
should reject requests that would result in this.

Bugs closed: AURORA-1375

Reviewed at https://reviews.apache.org/r/35954/

23 months agoAvoid unintentional use of TaskStatus.Reason default value.
Bill Farner [Wed, 1 Jul 2015 17:53:12 +0000 (10:53 -0700)] 
Avoid unintentional use of TaskStatus.Reason default value.

Bugs closed: AURORA-1327

Reviewed at https://reviews.apache.org/r/35928/

23 months agoAdd a DbCronJobStore implementation.
Bill Farner [Wed, 1 Jul 2015 17:40:44 +0000 (10:40 -0700)] 
Add a DbCronJobStore implementation.

Bugs closed: AURORA-415

Reviewed at https://reviews.apache.org/r/35901/

23 months agoSplit http lifecycle into a composition layer.
Brian Wickman [Wed, 1 Jul 2015 17:38:21 +0000 (10:38 -0700)] 
Split http lifecycle into a composition layer.

Move shutdown endpoints to the Job config since the lifecycle is controlled
by Aurora and not Thermos.  Split the lifecycle management into a
composition layer that can more readily be tested.

Bugs closed: AURORA-1368

Reviewed at https://reviews.apache.org/r/35847/

23 months agoDisabling h2 console by default.
Maxim Khutornenko [Tue, 30 Jun 2015 19:32:17 +0000 (12:32 -0700)] 
Disabling h2 console by default.

Reviewed at https://reviews.apache.org/r/36060/

23 months agoFix terminology in cron docs.
Kevin Sweeney [Mon, 29 Jun 2015 20:12:22 +0000 (13:12 -0700)] 
Fix terminology in cron docs.

Reviewed at https://reviews.apache.org/r/36015/

23 months agoRemove "enable_legacy_constraints" flag.
Zameer Manji [Fri, 26 Jun 2015 18:09:06 +0000 (11:09 -0700)] 
Remove "enable_legacy_constraints" flag.

Remove the "enable_legacy_constraints" flag and associated behaviour.

Testing Done:
./gradlew build -Pq

Bugs closed: AURORA-1074

Reviewed at https://reviews.apache.org/r/35812/

23 months agoDon't warn about unoptimized Operations
Stephan Erb [Fri, 26 Jun 2015 18:00:06 +0000 (11:00 -0700)] 
Don't warn about unoptimized Operations

Bugs closed: AURORA-1369

Reviewed at https://reviews.apache.org/r/35840/

2 years agoRemoving GC executor code.
Maxim Khutornenko [Thu, 25 Jun 2015 20:49:15 +0000 (13:49 -0700)] 
Removing GC executor code.

Bugs closed: AURORA-1333

Reviewed at https://reviews.apache.org/r/35813/

2 years agoRemove static modifier from test case.
Kevin Sweeney [Thu, 25 Jun 2015 20:45:54 +0000 (13:45 -0700)] 
Remove static modifier from test case.

Remove static modifier from test case, which was introduced in the
last revision to https://reviews.apache.org/r/35842/

This fixes

[ant:checkstyle]
/home/ksweeney/workspace/aurora/src/test/java/org/apache/aurora/GuavaUtilsTest.java:23:1:
Utility classes should not have a public or default constructor.

Testing Done:
./gradlew -Pq build

Reviewed at https://reviews.apache.org/r/35886/

2 years agoDbTaskStore: delete unreferenced job keys and task configs.
Bill Farner [Thu, 25 Jun 2015 19:17:35 +0000 (12:17 -0700)] 
DbTaskStore: delete unreferenced job keys and task configs.

Bugs closed: AURORA-1298

Reviewed at https://reviews.apache.org/r/35793/

2 years agoUse java.util.Optional and streams in LockManager
Kevin Sweeney [Thu, 25 Jun 2015 18:42:26 +0000 (11:42 -0700)] 
Use java.util.Optional and streams in LockManager

Use java.util.Optional and streams in Lock*.

Taking advantage of some Java 8 features along the way, and introduced
GuavaCollectors.toImmutableSet for compatibility with the streams API

Testing Done:
./gradlew -Pq build

Reviewed at https://reviews.apache.org/r/35842/

2 years agoAdd exact times to update UI.
David McLaughlin [Wed, 24 Jun 2015 19:51:41 +0000 (12:51 -0700)] 
Add exact times to update UI.

Bugs closed: AURORA-1371

Reviewed at https://reviews.apache.org/r/35839/

2 years agoRefactoring TaskLauncher.
Maxim Khutornenko [Tue, 23 Jun 2015 20:42:54 +0000 (13:42 -0700)] 
Refactoring TaskLauncher.

Bugs closed: AURORA-1334

Reviewed at https://reviews.apache.org/r/35761/

2 years agoRemoving GcExecutorLauncher code.
Maxim Khutornenko [Tue, 23 Jun 2015 18:08:55 +0000 (11:08 -0700)] 
Removing GcExecutorLauncher code.

Bugs closed: AURORA-1334

Reviewed at https://reviews.apache.org/r/35760/

2 years agoAllow equals in bound variables passed via cmdline
Michael Leinartas [Mon, 22 Jun 2015 23:48:50 +0000 (16:48 -0700)] 
Allow equals in bound variables passed via cmdline

The parsing for the --bind parameter splits the parameter value on equals and
enforces only two elements. This prevents parameters whose value contains an
equals to be passed.

Example case:
    HELLO_WORLD = Job(
         name = 'hello',
         role = 'bozo',
         cluster = 'west',
         environment = 'test',
         instances = 1,
         update_config = UpdateConfig(
           batch_size = 1,
           restart_threshold = 60,
           watch_secs = 45,
           max_per_shard_failures = 2,
         ),
         task = Task(
           name = 'test',
           processes = [Process(name = 'hello_world', cmdline = 'echo {{flags}}')],
           resources = Resources(cpu = 0.1, ram = 64 * MB, disk = 64 * MB),
         )
       )
       jobs = [HELLO_WORLD]

aurora job create --bind flags=-myflag=value west/bozo/test/hello ./hello_world.aurora

Instead, the split() should use the maxsplit parameter to limit to 1 match and
leave additional equals signs in the parameter

Testing Done:
Added a new binding to UNBOUND_CONFIG and a matching --bind parameter with an
equals sign in it to test_simple_successful_create_job_with_bindings
(test_create.py)

    $ ./pants test --test-pytest-options='-k _bindings' src/test/python/apache/aurora:all
passes

Reviewed at https://reviews.apache.org/r/35745/

2 years agoSuppress task reconciliation status update logging.
Maxim Khutornenko [Mon, 22 Jun 2015 19:52:06 +0000 (12:52 -0700)] 
Suppress task reconciliation status update logging.

Reviewed at https://reviews.apache.org/r/35587/

2 years agoDo better sanitation on the client side when encountering unbound pystachio refs
Brian Wickman [Mon, 22 Jun 2015 18:50:33 +0000 (11:50 -0700)] 
Do better sanitation on the client side when encountering unbound pystachio refs

It's possible to define nested refs that can cause the executor to stack trace, e.g.
{{derp[{{thermos.ports[http]}}]}} is perfectly valid but crashes the executor.

Testing Done:
Added some regression tests.

Bugs closed: AURORA-739

Reviewed at https://reviews.apache.org/r/34300/

2 years agoDbTaskStore perf: optimize queries scoped to a task ID.
Bill Farner [Mon, 22 Jun 2015 16:51:36 +0000 (09:51 -0700)] 
DbTaskStore perf: optimize queries scoped to a task ID.

Bugs closed: AURORA-1298

Reviewed at https://reviews.apache.org/r/35672/

2 years agoFixing broken gradle dependency scanner.
Maxim Khutornenko [Fri, 19 Jun 2015 19:11:00 +0000 (12:11 -0700)] 
Fixing broken gradle dependency scanner.

Reviewed at https://reviews.apache.org/r/35613/

2 years agoFiltering explicit reconciliation tasks by SLAVE_ASSIGNED_STATES.
Maxim Khutornenko [Fri, 19 Jun 2015 01:32:01 +0000 (18:32 -0700)] 
Filtering explicit reconciliation tasks by SLAVE_ASSIGNED_STATES.

Bugs closed: AURORA-1361

Reviewed at https://reviews.apache.org/r/35639/

2 years agoDbTaskStore perf: add a task store API to list task job keys.
Bill Farner [Thu, 18 Jun 2015 23:37:55 +0000 (16:37 -0700)] 
DbTaskStore perf: add a task store API to list task job keys.

Bugs closed: AURORA-1298

Reviewed at https://reviews.apache.org/r/35630/

2 years agoFixing stylecheck errors.
Maxim Khutornenko [Thu, 18 Jun 2015 23:18:43 +0000 (16:18 -0700)] 
Fixing stylecheck errors.

Reviewed at https://reviews.apache.org/r/35633/

2 years agoExplicitly bind SessionContext.
Kevin Sweeney [Thu, 18 Jun 2015 22:01:45 +0000 (15:01 -0700)] 
Explicitly bind SessionContext.

Discussion on bugs like this and a potential solution
(enabling `requireExplicitBindings`) are here:
https://github.com/google/guice/issues/740

Testing Done:
Ran kerberos e2e test.

Bugs closed: AURORA-1352

Reviewed at https://reviews.apache.org/r/35627/

2 years agoFixing option type in observer.
Maxim Khutornenko [Thu, 18 Jun 2015 20:54:37 +0000 (13:54 -0700)] 
Fixing option type in observer.

Bugs closed: AURORA-1356

Reviewed at https://reviews.apache.org/r/35621/

2 years agoFix symlink duplicates from MesosPathDetector.
Brian Wickman [Wed, 17 Jun 2015 21:30:34 +0000 (14:30 -0700)] 
Fix symlink duplicates from MesosPathDetector.

Also adds thread ids to TaskResourceMonitor for better /threads debugging.

Testing Done:
Verified we realpath the paths prior to returning from path detector.

Bugs closed: AURORA-1353

Reviewed at https://reviews.apache.org/r/35580/

2 years agoMaking observer polling interval configurable.
Maxim Khutornenko [Tue, 16 Jun 2015 23:09:10 +0000 (16:09 -0700)] 
Making observer polling interval configurable.

Bugs closed: AURORA-1351

Reviewed at https://reviews.apache.org/r/35527/

2 years agoAllow config of the /quitquitquit and /abortabortabort endpoints.
Brian Brazil [Tue, 16 Jun 2015 22:25:17 +0000 (15:25 -0700)] 
Allow config of the /quitquitquit and /abortabortabort endpoints.

Fix name of test for sigterm being ignored.

Based on https://github.com/tellapart/incubator-aurora/commit/c90532d69d69045c545004451e3660f5282e6e34

Testing Done:
Unittests and manually in vagrant cluster. Also verified that the flaky tests pass.

Bugs closed: AURORA-1257

Reviewed at https://reviews.apache.org/r/32973/

2 years agoUse Shiro identity if available in audit logs.
Kevin Sweeney [Tue, 16 Jun 2015 22:07:11 +0000 (15:07 -0700)] 
Use Shiro identity if available in audit logs.

Testing Done:
./gradlew -Pq build

Bugs closed: AURORA-1352

Reviewed at https://reviews.apache.org/r/35535/

2 years agoRemoving deprecated JobUpdateSummary fields.
Maxim Khutornenko [Tue, 16 Jun 2015 00:57:47 +0000 (17:57 -0700)] 
Removing deprecated JobUpdateSummary fields.

Bugs closed: AURORA-1139

Reviewed at https://reviews.apache.org/r/35483/

2 years agoNative Debian packaging for Aurora
Benjamin Staffin [Mon, 15 Jun 2015 14:31:22 +0000 (10:31 -0400)] 
Native Debian packaging for Aurora

This uses Debian package dependencies to install gradle and thrift-compiler.  Gradle 2.x isn't in Debian or Ubuntu yet, but you can build your own package easily enough using https://github.com/benley/gradle-packaging

Testing Done:
Built debs in a clean Ubuntu 14.04 environment using git-buildpackage and pbuilder. Have been using debs built from this branch on a testing cluster for a few months now.

Bugs closed: AURORA-951

Reviewed at https://reviews.apache.org/r/31101/

2 years agoUpgrade to requests-kerberos 0.7.0.
Kevin Sweeney [Wed, 10 Jun 2015 18:00:08 +0000 (11:00 -0700)] 
Upgrade to requests-kerberos 0.7.0.

Upstream changelog:
0.7.0: 2015-05-04

* Added Windows native authentication support by adding kerberos-sspi as an alternative backend.
* Prevent infinite recursion when a server returns 401 to an authorization attempt.
* Reduce the logging during successful responses.

Testing Done:
e2e test run pending

Bugs closed: AURORA-1346

Reviewed at https://reviews.apache.org/r/35274/

2 years agoRevert "Revert "Make health check configurable""
Brian Brazil [Wed, 10 Jun 2015 15:41:04 +0000 (08:41 -0700)] 
Revert "Revert "Make health check configurable""

Bugs closed: AURORA-316

Reviewed at https://reviews.apache.org/r/33433/

2 years agoAdds new documentation page listing Apache Aurora presentations (both videos and...
Dave Lester [Tue, 9 Jun 2015 20:19:22 +0000 (13:19 -0700)] 
Adds new documentation page listing Apache Aurora presentations (both videos and slides).

Testing Done:
Markdown originally verified using Mou markdown editor/browser.

Also viewable on github: https://github.com/davelester/incubator-aurora/blob/aurora-presentations-documentation/docs/presentations.md

Reviewed at https://reviews.apache.org/r/34661/

2 years agoRelax requirement for .ini file sections.
Kevin Sweeney [Mon, 8 Jun 2015 21:49:16 +0000 (14:49 -0700)] 
Relax requirement for .ini file sections.

Testing Done:
./gradlew -Pq build

Bugs closed: AURORA-1342

Reviewed at https://reviews.apache.org/r/35219/

2 years agoFix a markdown syntax error in the deployment docs
Jeffrey Schroeder [Sun, 7 Jun 2015 01:11:05 +0000 (18:11 -0700)] 
Fix a markdown syntax error in the deployment docs

Testing Done:
Rendered document before and then after.

Reviewed at https://reviews.apache.org/r/30248/

2 years agoAdding H2 management console.
Maxim Khutornenko [Thu, 4 Jun 2015 21:40:47 +0000 (14:40 -0700)] 
Adding H2 management console.

Bugs closed: AURORA-1287

Reviewed at https://reviews.apache.org/r/34566/

2 years agoUse TaskStatus Reason to set memory limit message.
Zameer Manji [Wed, 3 Jun 2015 18:15:06 +0000 (11:15 -0700)] 
Use TaskStatus Reason to set memory limit message.

Use TaskStatus Reason to set memory limit message instead of checking the
contents of the message field. Future versions of Mesos can change the
diagnostic information in the message field causing Aurora to display no
information when a task fails.

Testing Done:
./gradlew test -Pq

Bugs closed: AURORA-1341

Reviewed at https://reviews.apache.org/r/34967/

2 years agoMoving checkpoint root into the executor sandbox.
Maxim Khutornenko [Tue, 2 Jun 2015 17:47:34 +0000 (10:47 -0700)] 
Moving checkpoint root into the executor sandbox.

Bugs closed: AURORA-1337

Reviewed at https://reviews.apache.org/r/34827/

2 years agoDaemonize all deadline calls in aurora executor.
Brian Wickman [Mon, 1 Jun 2015 22:20:25 +0000 (15:20 -0700)] 
Daemonize all deadline calls in aurora executor.

If we do not daemonize, it's possible for the aurora executor to send
TASK_KILLED and then block indefinitely on shutdown.  This way the aurora
executor process will at least exit, allow the cgroup to tear down all
active processes.

Testing Done:
./pants test src/test/python/apache/aurora/executor::

Bugs closed: AURORA-698

Reviewed at https://reviews.apache.org/r/34484/

2 years agoAdding ChainedPathDetector into the GC executor.
Maxim Khutornenko [Thu, 28 May 2015 17:49:08 +0000 (10:49 -0700)] 
Adding ChainedPathDetector into the GC executor.

Bugs closed: AURORA-1025

Reviewed at https://reviews.apache.org/r/34739/

2 years agoFixing default TaskReconciler initial delay.
Maxim Khutornenko [Thu, 28 May 2015 16:17:45 +0000 (09:17 -0700)] 
Fixing default TaskReconciler initial delay.

Bugs closed: AURORA-1339

Reviewed at https://reviews.apache.org/r/34733/

2 years agoEnabling TemporaryStorage to use flagged task store.
Maxim Khutornenko [Thu, 28 May 2015 16:13:20 +0000 (09:13 -0700)] 
Enabling TemporaryStorage to use flagged task store.

Bugs closed: AURORA-1322

Reviewed at https://reviews.apache.org/r/34501/

2 years agoCorrecting typo in developing-aurora-client.md for readability.
Will Swank [Tue, 26 May 2015 21:06:06 +0000 (14:06 -0700)] 
Correcting typo in developing-aurora-client.md for readability.

Reviewed at https://reviews.apache.org/r/34679/

2 years agoImplementing task reconciler.
Maxim Khutornenko [Fri, 22 May 2015 21:25:19 +0000 (14:25 -0700)] 
Implementing task reconciler.

Bugs closed: AURORA-1047

Reviewed at https://reviews.apache.org/r/34440/

2 years agoValidating INSTANCES_SPEC_ARGUMENT option range
Maxim Khutornenko [Wed, 20 May 2015 17:52:47 +0000 (10:52 -0700)] 
Validating INSTANCES_SPEC_ARGUMENT option range

Bugs closed: AURORA-1296

Reviewed at https://reviews.apache.org/r/34449/

2 years agoExposing task reconciliation stats.
Maxim Khutornenko [Wed, 20 May 2015 17:48:35 +0000 (10:48 -0700)] 
Exposing task reconciliation stats.

Bugs closed: AURORA-1047

Reviewed at https://reviews.apache.org/r/34373/

2 years agoPlace api_util.py inside a `pants_library` target.
Zameer Manji [Mon, 18 May 2015 21:10:25 +0000 (14:10 -0700)] 
Place api_util.py inside a `pants_library` target.

This places `api_util.py` inside a `pants_library` target and has the two
consumer targets depend on that file explicitly.

Testing Done:
./pants test.pytest --no-fast --options='-v' src/test/python::

Bugs closed: AURORA-1325

Reviewed at https://reviews.apache.org/r/34372/

2 years agoUpgrade pants to 0.0.32
Kevin Sweeney [Mon, 18 May 2015 20:34:20 +0000 (13:34 -0700)] 
Upgrade pants to 0.0.32

Testing Done:
./pants test.pytest --no-fast src/test/python:all
./src/test/sh/org/apache/aurora/e2e/test_end_to_end.sh

Bugs closed: AURORA-1267

Reviewed at https://reviews.apache.org/r/34307/

2 years agoImplementing benchmark for snapshot restore.
Maxim Khutornenko [Mon, 18 May 2015 19:35:19 +0000 (12:35 -0700)] 
Implementing benchmark for snapshot restore.

Bugs closed: AURORA-1318, AURORA-1321

Reviewed at https://reviews.apache.org/r/34301/

2 years agoAdd Sabre Labs to Aurora Adopters list.
Dave Lester [Thu, 14 May 2015 05:09:16 +0000 (22:09 -0700)] 
Add Sabre Labs to Aurora Adopters list.

2 years agoUpdated scheduler to process status updates asynchronously in batches.
Ben Mahler [Thu, 14 May 2015 00:57:18 +0000 (17:57 -0700)] 
Updated scheduler to process status updates asynchronously in batches.

Bugs closed: AURORA-1228

Reviewed at https://reviews.apache.org/r/33689/

2 years agoEnhancing the StateManager.changeState result.
Maxim Khutornenko [Wed, 13 May 2015 18:08:42 +0000 (11:08 -0700)] 
Enhancing the StateManager.changeState result.

Reviewed at https://reviews.apache.org/r/34148/

2 years agoAdd a type witness to satisfy JDK 8U11 compiler in jenkins.
Bill Farner [Wed, 13 May 2015 16:24:20 +0000 (09:24 -0700)] 
Add a type witness to satisfy JDK 8U11 compiler in jenkins.

Reviewed at https://reviews.apache.org/r/34169/

2 years agoAdd a task store implementation that uses a relational database.
Bill Farner [Tue, 12 May 2015 23:51:07 +0000 (16:51 -0700)] 
Add a task store implementation that uses a relational database.

Bugs closed: AURORA-556

Reviewed at https://reviews.apache.org/r/33612/

2 years agoUse JDK 8 language features.
Bill Farner [Tue, 12 May 2015 23:42:59 +0000 (16:42 -0700)] 
Use JDK 8 language features.

Bugs closed: AURORA-274

Reviewed at https://reviews.apache.org/r/34126/

2 years agoRemoving dead code from StateManagerImpl.
Maxim Khutornenko [Tue, 12 May 2015 22:09:39 +0000 (15:09 -0700)] 
Removing dead code from StateManagerImpl.

Reviewed at https://reviews.apache.org/r/34124/

2 years agoImprove GPG key validation for release verification script.
Joe Smith [Tue, 12 May 2015 00:42:57 +0000 (17:42 -0700)] 
Improve GPG key validation for release verification script.

Reviewed at https://reviews.apache.org/r/33997/

2 years agoImprove client update json output to consistently use last_modified.
Joe Smith [Tue, 12 May 2015 00:41:25 +0000 (17:41 -0700)] 
Improve client update json output to consistently use last_modified.

Bugs closed: AURORA-1316

Reviewed at https://reviews.apache.org/r/34015/

2 years agoUpgade h2 to 1.4.187.
Bill Farner [Mon, 11 May 2015 18:47:50 +0000 (11:47 -0700)] 
Upgade h2 to 1.4.187.

Bugs closed: AURORA-1311

Reviewed at https://reviews.apache.org/r/34046/

2 years agoMake aurora-scheduler-kerberos.conf startup manual.
Kevin Sweeney [Mon, 11 May 2015 17:59:45 +0000 (10:59 -0700)] 
Make aurora-scheduler-kerberos.conf startup manual.

Testing Done:
vagrant up

Waiting on results of e2e test.

Bugs closed: AURORA-1304

Reviewed at https://reviews.apache.org/r/33819/

2 years agoAdd missing binding to ThriftApiBenchmarks.
Bill Farner [Fri, 8 May 2015 22:02:38 +0000 (15:02 -0700)] 
Add missing binding to ThriftApiBenchmarks.

Reviewed at https://reviews.apache.org/r/33999/

2 years agoAdding missing API hook support in kill commands.
Maxim Khutornenko [Fri, 8 May 2015 21:41:38 +0000 (14:41 -0700)] 
Adding missing API hook support in kill commands.

Bugs closed: AURORA-1307

Reviewed at https://reviews.apache.org/r/33924/