tez.git
2 years agoUpdate version to 0.8.4 rel/release-0.8.4 release-0.8.4-rc1
Siddharth Seth [Tue, 5 Jul 2016 21:36:15 +0000 (14:36 -0700)] 
Update version to 0.8.4

2 years agoUpdate date for 0.8.4 release to In progress.
Siddharth Seth [Tue, 5 Jul 2016 21:25:23 +0000 (14:25 -0700)] 
Update date for 0.8.4 release to In progress.

2 years agoTEZ-3323. Update licese and notice for xml-apis jar. Also update year in
Siddharth Seth [Tue, 5 Jul 2016 21:21:24 +0000 (14:21 -0700)] 
TEZ-3323. Update licese and notice for xml-apis jar. Also update year in
notice to 2016. (sseth)

(cherry picked from commit f3f607ad63b69a308101cc9c4b2ed1a391a3e239)

2 years agoUpdate CHANGES.txt for TEZ-3223. (hitesh)
Hitesh Shah [Tue, 5 Jul 2016 21:00:11 +0000 (14:00 -0700)] 
Update CHANGES.txt for TEZ-3223. (hitesh)

2 years agoTEZ-3223. Support a NullHistoryLogger to disable history logging if needed. (hitesh)
Hitesh Shah [Tue, 5 Jul 2016 20:53:34 +0000 (13:53 -0700)] 
TEZ-3223. Support a NullHistoryLogger to disable history logging if needed. (hitesh)

(cherry picked from commit 36ab0c043113bdd99f3121c9fb4348dbd39f18ab)

Conflicts:
CHANGES.txt

2 years agoTEZ-3318. Tez UI: Polling is not restarted after RM recovery (sree)
Sreenath Somarajapuram [Tue, 5 Jul 2016 20:10:08 +0000 (01:40 +0530)] 
TEZ-3318. Tez UI: Polling is not restarted after RM recovery (sree)

2 years agoTEZ-3231. 0.8.4 release. Add version 0.8.5 to CHANGES.txt. Update
Siddharth Seth [Thu, 30 Jun 2016 23:44:51 +0000 (16:44 -0700)] 
TEZ-3231. 0.8.4 release. Add version 0.8.5 to CHANGES.txt. Update
version to 0.8.5-SNAPSHOT.

2 years agoTEZ-3286. Allow clients to set processor reserved memory per vertex (instead of per...
Siddharth Seth [Thu, 30 Jun 2016 23:30:01 +0000 (16:30 -0700)] 
TEZ-3286. Allow clients to set processor reserved memory per vertex (instead of per container). Contributed by Hitesh Shah.

(cherry picked from commit 3b08cbf907784de463c9e3c05147b5c6d681251d)

2 years agoTEZ-3293. Fetch failures can cause a shuffle hang waiting for memory
Siddharth Seth [Thu, 30 Jun 2016 23:13:23 +0000 (16:13 -0700)] 
TEZ-3293. Fetch failures can cause a shuffle hang waiting for memory
merge that never starts. Contributed by Jason Lowe.

(cherry picked from commit 71bb2defe97e55e3bf7dbb299fe33ab8a667e7a1)

2 years agoTEZ-3314. Double counting input bytes in MultiMRInput (Contributed by Harish JP via...
Rajesh Balamohan [Wed, 29 Jun 2016 23:49:14 +0000 (16:49 -0700)] 
TEZ-3314. Double counting input bytes in MultiMRInput (Contributed by Harish JP via rbalamohan)

(cherry picked from commit 540eab0183787b434cbe95154bf2d1884dfaf46d)

2 years agoTEZ-3308. Add counters to capture input split length. Contributed by Harish Jaiprakash.
Siddharth Seth [Tue, 28 Jun 2016 01:29:39 +0000 (18:29 -0700)] 
TEZ-3308. Add counters to capture input split length. Contributed by Harish Jaiprakash.

(cherry picked from commit c6a7d76eab86643cdb7d7537c3d5a4df4eb7387c)

2 years agoTEZ-3302. Add a version of processorContext.waitForAllInputsReady and
Siddharth Seth [Mon, 27 Jun 2016 19:57:47 +0000 (12:57 -0700)] 
TEZ-3302. Add a version of processorContext.waitForAllInputsReady and
waitForAnyInputReady with a timeout. Contributed by Tsuyoshi Ozawa.

(cherry picked from commit d2b9222fb589ce85124b1e381ba199621e91b263)

2 years agoTEZ-3291. Optimize splits grouping when locality information is not available (rbalam...
Rajesh Balamohan [Wed, 22 Jun 2016 01:01:46 +0000 (18:01 -0700)] 
TEZ-3291. Optimize splits grouping when locality information is not available (rbalamohan)

(cherry picked from commit 1264d5d019c86ae5e26240693bfb8c0a81d44dcd)

2 years agoTEZ-3305. TestAnalyzer fails on Hadoop 2.7. (Jonathan Eagles via hitesh)
Hitesh Shah [Thu, 16 Jun 2016 23:07:47 +0000 (16:07 -0700)] 
TEZ-3305. TestAnalyzer fails on Hadoop 2.7. (Jonathan Eagles via hitesh)

(cherry picked from commit 993a7b5f58223f811d82f2a1dec5ed7349922b2e)

Conflicts:
CHANGES.txt

2 years agoTEZ-3304. TestHistoryParser fails with Hadoop 2.7. (Jonathan Eagles via hitesh)
Hitesh Shah [Thu, 16 Jun 2016 23:05:54 +0000 (16:05 -0700)] 
TEZ-3304. TestHistoryParser fails with Hadoop 2.7. (Jonathan Eagles via hitesh)

(cherry picked from commit 61d5d5e735e38c917a170fa4cc7846d6c38dcdea)

Conflicts:
CHANGES.txt

2 years agoTEZ-3296. Tez job can hang if two vertices at the same root distance have different...
Jason Lowe [Thu, 16 Jun 2016 19:59:24 +0000 (19:59 +0000)] 
TEZ-3296. Tez job can hang if two vertices at the same root distance have different task requirements (jlowe)
(cherry picked from commit cc33410d8c9992fb70e489fc1f61748143fb08c2)

Conflicts:

CHANGES.txt

2 years agoTEZ-3294. DAG.createDag() does not clear local state on repeat calls. (Harish Jaiprak...
Hitesh Shah [Tue, 14 Jun 2016 02:27:49 +0000 (19:27 -0700)] 
TEZ-3294. DAG.createDag() does not clear local state on repeat calls. (Harish Jaiprakash via hitesh)

(cherry picked from commit 7f699f18ff94ca2b44a0eda650f31e1054c79ade)

Conflicts:
CHANGES.txt

2 years agoTEZ-3297. Deadlock scenario in AM during ShuffleVertexManager auto reduce (rbalamohan)
Rajesh Balamohan [Sun, 12 Jun 2016 23:45:51 +0000 (05:15 +0530)] 
TEZ-3297. Deadlock scenario in AM during ShuffleVertexManager auto reduce (rbalamohan)

(cherry picked from commit 51fb3e4cf0213a39e52476127f390639247e089b)

2 years agoTEZ-3296. Tez fails to compile against hadoop 2.8 after MAPREDUCE-5870 (jeagles)
Jonathan Eagles [Sun, 12 Jun 2016 13:35:30 +0000 (08:35 -0500)] 
TEZ-3296. Tez fails to compile against hadoop 2.8 after MAPREDUCE-5870 (jeagles)

(cherry picked from commit 1d11ad275548031c68b2b360f2b8b7111ecd91fd)

2 years agoTEZ-3290. Set full task attempt id string in MRInput configuration
Siddharth Seth [Wed, 8 Jun 2016 22:02:50 +0000 (15:02 -0700)] 
TEZ-3290. Set full task attempt id string in MRInput configuration
object. Contributed by Prasanth Jayachandran.
(cherry picked from commit 2c212858ab91fb49ca8e6ab36bf51328adcccb43)

Conflicts:
CHANGES.txt

2 years agoTEZ-3281. Tez UI: Swimlane improvements (sree)
Sreenath Somarajapuram [Wed, 1 Jun 2016 05:53:05 +0000 (11:23 +0530)] 
TEZ-3281. Tez UI: Swimlane improvements (sree)

2 years agoTEZ-3278. Hide Swimlane from Tez UI (jeagles)
Jonathan Eagles [Tue, 31 May 2016 19:39:51 +0000 (14:39 -0500)] 
TEZ-3278. Hide Swimlane from Tez UI (jeagles)

2 years agoTEZ-3280. LOG MRInputHelpers split generation message as INFO (jeagles)
Jonathan Eagles [Tue, 31 May 2016 18:16:29 +0000 (13:16 -0500)] 
TEZ-3280. LOG MRInputHelpers split generation message as INFO (jeagles)

(cherry picked from commit 18da4939839fb19bf3339f0e9cd3ec118355062f)

2 years agoTEZ-909. Provide support for application tags (ebadger via rohini)
Rohini Palaniswamy [Fri, 27 May 2016 19:32:21 +0000 (12:32 -0700)] 
TEZ-909. Provide support for application tags (ebadger via rohini)

Conflicts:
CHANGES.txt

2 years agoTEZ-2769. TEZ-UI Hive SQL is only displayed to line 11
Jonathan Eagles [Fri, 27 May 2016 16:01:13 +0000 (11:01 -0500)] 
TEZ-2769. TEZ-UI Hive SQL is only displayed to line 11

2 years agoTEZ-3257. Fix flaky test TestUnorderedPartitionedKVWriter. Contributed by Ming Ma.
Siddharth Seth [Thu, 26 May 2016 18:01:35 +0000 (11:01 -0700)] 
TEZ-3257. Fix flaky test TestUnorderedPartitionedKVWriter. Contributed by Ming Ma.
(cherry picked from commit 89802b1c599e34027eedda5d826035cd66b99f85)

Conflicts:
CHANGES.txt

2 years agoTEZ-3262. Tez UI : zip.js is not having a bower friendly versioning system (sree)
Sreenath Somarajapuram [Mon, 23 May 2016 07:32:38 +0000 (13:02 +0530)] 
TEZ-3262. Tez UI : zip.js is not having a bower friendly versioning system (sree)

2 years agoTEZ-3240. Improvements to tez.lib.uris to allow for multiple tarballs and mixing...
Jason Lowe [Fri, 20 May 2016 20:39:40 +0000 (20:39 +0000)] 
TEZ-3240. Improvements to tez.lib.uris to allow for multiple tarballs and mixing tarballs and jars. (Eric Badger via hitesh)
(cherry picked from commit b3712f863c630cea263a499183f57f9564be6a0f)

Conflicts:

CHANGES.txt

2 years agoTEZ-3237. Corrupted shuffle transfers to disk are not detected during transfer (jlowe)
Jason Lowe [Fri, 20 May 2016 17:53:10 +0000 (17:53 +0000)] 
TEZ-3237. Corrupted shuffle transfers to disk are not detected during transfer (jlowe)
(cherry picked from commit 5dd47c6858028ac0187c4fab76b66217bf0d6c56)

Conflicts:

CHANGES.txt

2 years agoTEZ-3246. Improve diagnostics when DAG killed by user (Eric Badger via jlowe)
Jason Lowe [Tue, 17 May 2016 20:00:17 +0000 (20:00 +0000)] 
TEZ-3246. Improve diagnostics when DAG killed by user (Eric Badger via jlowe)
(cherry picked from commit b63d7faf5f9ef892b582f62d000fafd80e8a3b5b)

2 years agoTEZ-3258. Jvm Checker does not ignore DisableExplicitGC when checking JVM GC options...
Hitesh Shah [Tue, 17 May 2016 14:51:19 +0000 (07:51 -0700)] 
TEZ-3258. Jvm Checker does not ignore DisableExplicitGC when checking JVM GC options. (Fengdong Yu via hitesh)

(cherry picked from commit d22389cc23175379edd5858d2654282973a2f5dc)

Conflicts:
CHANGES.txt

2 years agoTEZ-3259. Tez UI: Build issue - File saver package is not working well with bower...
Sreenath Somarajapuram [Tue, 17 May 2016 12:27:34 +0000 (17:57 +0530)] 
TEZ-3259. Tez UI: Build issue - File saver package is not working well with bower (sree)

2 years agoTEZ-3256. [Backport HADOOP-11032] Remove Guava Stopwatch dependency (jeagles)
Jonathan Eagles [Thu, 12 May 2016 18:27:12 +0000 (13:27 -0500)] 
TEZ-3256. [Backport HADOOP-11032] Remove Guava Stopwatch dependency (jeagles)

(cherry picked from commit f70aa172e0cfcf7272bda04e4da20e5fc5e96e82)

2 years agoTEZ-2342. Reduce bytearray copy with TezEvent Serialization and deserialization
Jonathan Eagles [Wed, 11 May 2016 21:32:01 +0000 (16:32 -0500)] 
TEZ-2342. Reduce bytearray copy with TezEvent Serialization and deserialization

(cherry picked from commit 88bd5b9dc3f08b3c3b361e5167c219ad3e59c53f)

2 years agoTEZ-3251. Allow ability to add custom counters to TaskRunner2Callable (Contributed...
Rajesh Balamohan [Wed, 11 May 2016 08:05:03 +0000 (13:35 +0530)] 
TEZ-3251. Allow ability to add custom counters to TaskRunner2Callable (Contributed by Prasanth Jayachandran)

2 years agoTezTaskRunner2 should accept ExecutorService (Contributed by Prasanth Jayachandran)
Rajesh Balamohan [Wed, 11 May 2016 02:02:49 +0000 (07:32 +0530)] 
TezTaskRunner2 should accept ExecutorService (Contributed by Prasanth Jayachandran)

2 years agoTEZ-3193. Deadlock in AM during task commit request. (Jason Lowe via hitesh)
Hitesh Shah [Mon, 2 May 2016 18:00:48 +0000 (11:00 -0700)] 
TEZ-3193. Deadlock in AM during task commit request. (Jason Lowe via hitesh)

(cherry picked from commit c3b8b852331c41f9a9b41c7c74995f52f4578d99)

Conflicts:
CHANGES.txt

2 years agoTEZ-3203. DAG hangs when one of the upstream vertices has zero tasks (jlowe)
Jason Lowe [Thu, 28 Apr 2016 13:57:58 +0000 (13:57 +0000)] 
TEZ-3203. DAG hangs when one of the upstream vertices has zero tasks (jlowe)
(cherry picked from commit 7221d386a4fbc1f32aae1854bd25defb4c6d557a)

Conflicts:

CHANGES.txt

2 years agoTEZ-3219. Allow service plugins to define log locations link for remotely run task...
Hitesh Shah [Mon, 25 Apr 2016 18:04:41 +0000 (11:04 -0700)] 
TEZ-3219. Allow service plugins to define log locations link for remotely run task attempts. (hitesh)

(cherry picked from commit 7e9ed83184e1fefb4ecf8b560a60d2521c0f30e0)

Conflicts:
CHANGES.txt

2 years agoUpdate CHANGES.txt for TEZ-3224
Hitesh Shah [Fri, 22 Apr 2016 22:47:17 +0000 (15:47 -0700)] 
Update CHANGES.txt for TEZ-3224

2 years agoTEZ-3224. User payload is not initialized before creating vertex manager plugin....
Hitesh Shah [Fri, 22 Apr 2016 22:32:06 +0000 (15:32 -0700)] 
TEZ-3224. User payload is not initialized before creating vertex manager plugin. (Zhiyuan Yang via hitesh)

2 years agoTEZ-3226. Tez UI 2: All DAGs UX improvements. (Sreenath Somarajapuram via hitesh)
Hitesh Shah [Fri, 22 Apr 2016 22:30:16 +0000 (15:30 -0700)] 
TEZ-3226. Tez UI 2: All DAGs UX improvements. (Sreenath Somarajapuram via hitesh)

2 years agoTEZ-3146. Tez UI 2: CSS & JS assets in the UI must be minified (sree)
Sreenath Somarajapuram [Wed, 20 Apr 2016 05:30:03 +0000 (11:00 +0530)] 
TEZ-3146. Tez UI 2: CSS & JS assets in the UI must be minified (sree)

2 years agoTEZ-3087. Tez UI 2: Add log links in task & attempt details page (sree)
Sreenath Somarajapuram [Wed, 20 Apr 2016 05:04:08 +0000 (10:34 +0530)] 
TEZ-3087. Tez UI 2: Add log links in task & attempt details page (sree)

2 years agoTEZ-3077. TezClient.waitTillReady should support timeout. Contributed by Kuhu Shukla.
Siddharth Seth [Mon, 18 Apr 2016 21:52:08 +0000 (14:52 -0700)] 
TEZ-3077. TezClient.waitTillReady should support timeout. Contributed by Kuhu Shukla.

2 years agoTEZ-3210. Tez UI 2: license should account for numeral, more-js, loader.js , etc...
Sreenath Somarajapuram [Mon, 18 Apr 2016 03:12:45 +0000 (08:42 +0530)] 
TEZ-3210. Tez UI 2: license should account for numeral, more-js, loader.js , etc (sree)

2 years agoTEZ-3208 part2. Update documentation for 0.8.3 release.
Siddharth Seth [Sat, 16 Apr 2016 02:58:24 +0000 (19:58 -0700)] 
TEZ-3208 part2. Update documentation for 0.8.3 release.

2 years agoTEZ-3214. Tez UI 2: Pagination in All DAGs (sree)
Sreenath Somarajapuram [Fri, 15 Apr 2016 06:27:27 +0000 (11:57 +0530)] 
TEZ-3214. Tez UI 2: Pagination in All DAGs (sree)

2 years ago TEZ-3165. Allow Inputs/Outputs to be initialized serially, control processor initia...
Jonathan Eagles [Thu, 14 Apr 2016 20:43:53 +0000 (15:43 -0500)] 
  TEZ-3165. Allow Inputs/Outputs to be initialized serially, control processor initialization relative to Inputs/Outputs (jeagles)

2 years agoTEZ-3202. Reduce the memory need for jobs with high number of segments (jeagles)
Jonathan Eagles [Thu, 14 Apr 2016 20:27:39 +0000 (15:27 -0500)] 
TEZ-3202. Reduce the memory need for jobs with high number of segments (jeagles)

2 years agoTEZ-3208. Update version to 0.8.4-SNAPSHOT, and add section to
Siddharth Seth [Fri, 8 Apr 2016 23:43:43 +0000 (16:43 -0700)] 
TEZ-3208. Update version to 0.8.4-SNAPSHOT, and add section to
CHANGES.txt in prepartion for 0.8.3 release.

2 years agoTEZ-3180. Update master docs to declare hadoop-2.6.x as a minimum
Siddharth Seth [Fri, 8 Apr 2016 17:15:46 +0000 (10:15 -0700)] 
TEZ-3180. Update master docs to declare hadoop-2.6.x as a minimum
requirement. Contributed by Hitesh Shah.

2 years agoTEZ-3188. Move tez.submit.hosts out of TezConfiguration to
Siddharth Seth [Fri, 8 Apr 2016 17:14:17 +0000 (10:14 -0700)] 
TEZ-3188. Move tez.submit.hosts out of TezConfiguration to
TezConfigurationConstants. (sseth)

2 years agoTEZ-3194. Tez UI: Swimlane improve in-progress experience. (Sreenath Somarajapuram...
Hitesh Shah [Fri, 8 Apr 2016 14:57:49 +0000 (07:57 -0700)] 
TEZ-3194. Tez UI: Swimlane improve in-progress experience. (Sreenath Somarajapuram via hitesh)

2 years agoTEZ-3196. java.lang.InternalError from decompression codec is fatal to a task during...
Jason Lowe [Fri, 8 Apr 2016 13:48:44 +0000 (13:48 +0000)] 
TEZ-3196. java.lang.InternalError from decompression codec is fatal to a task during shuffle (jlowe)

2 years agoTEZ-3199. Rename getCredentials in TaskCommunicatorContext to be less
Siddharth Seth [Thu, 7 Apr 2016 17:45:54 +0000 (10:45 -0700)] 
TEZ-3199. Rename getCredentials in TaskCommunicatorContext to be less
confusing. (sseth)

2 years agoTEZ-3183. Change the taskFailed method on plugin contexts to specify the
Siddharth Seth [Thu, 7 Apr 2016 17:45:04 +0000 (10:45 -0700)] 
TEZ-3183. Change the taskFailed method on plugin contexts to specify the
type of failure. (sseth)

2 years agoTEZ-3120. Remove TaskCommContext.getCurrentDagName, Identifier. Contributed by Tsuyos...
Siddharth Seth [Thu, 7 Apr 2016 17:44:11 +0000 (10:44 -0700)] 
TEZ-3120. Remove TaskCommContext.getCurrentDagName, Identifier. Contributed by Tsuyoshi Ozawa.

2 years agoTEZ-3201. Tez-UI build broken (sree)
Sreenath Somarajapuram [Thu, 7 Apr 2016 08:24:05 +0000 (13:54 +0530)] 
TEZ-3201. Tez-UI build broken (sree)

2 years agoTEZ-3161. Allow task to report different kinds of errors - fatal / kill (sseth)
Siddharth Seth [Wed, 6 Apr 2016 03:41:26 +0000 (20:41 -0700)] 
TEZ-3161. Allow task to report different kinds of errors - fatal / kill (sseth)

2 years agoTEZ-3177. Non-DAG events should use the session domain or no domain if the data does...
Hitesh Shah [Tue, 5 Apr 2016 14:56:32 +0000 (07:56 -0700)] 
TEZ-3177. Non-DAG events should use the session domain or no domain if the data does not need protection.

2 years agoTEZ-3172. Tez UI: Swimlane - In progress & Shadow (sree)
Sreenath Somarajapuram [Tue, 5 Apr 2016 08:51:54 +0000 (14:21 +0530)] 
TEZ-3172. Tez UI: Swimlane - In progress & Shadow (sree)

2 years agoTEZ-3192. IFile#checkState creating unnecessary objects though auto-boxing (jeagles)
Jonathan Eagles [Fri, 1 Apr 2016 00:15:58 +0000 (19:15 -0500)] 
TEZ-3192. IFile#checkState creating unnecessary objects though auto-boxing (jeagles)

2 years agoTEZ-3173. Update Tez AM REST APIs for more information for each vertex. (Zhiyuan...
Hitesh Shah [Wed, 30 Mar 2016 23:50:45 +0000 (16:50 -0700)] 
TEZ-3173. Update Tez AM REST APIs for more information for each vertex. (Zhiyuan Yang via hitesh)

2 years agoTEZ-3108. Add support for external services to local mode. (sseth)
Siddharth Seth [Wed, 30 Mar 2016 17:21:31 +0000 (10:21 -0700)] 
TEZ-3108. Add support for external services to local mode. (sseth)

2 years agoTEZ-3189. Pre-warm dags should not be counted in submitted dags count by DAGAppMaster...
Hitesh Shah [Tue, 29 Mar 2016 17:54:49 +0000 (10:54 -0700)] 
TEZ-3189. Pre-warm dags should not be counted in submitted dags count by DAGAppMaster. (Zhiyuan Yang via hitesh)

2 years agoTEZ-3171. Tez UI 2: Swimlane - Tooltip, zoom & redirection (sree)
Sreenath Somarajapuram [Fri, 25 Mar 2016 18:50:14 +0000 (00:20 +0530)] 
TEZ-3171. Tez UI 2: Swimlane - Tooltip, zoom & redirection (sree)

2 years agoTEZ-3152. Tez UI 2: Build fails when run by multiple users or when node_modules is...
Sreenath Somarajapuram [Fri, 25 Mar 2016 18:43:24 +0000 (00:13 +0530)] 
TEZ-3152. Tez UI 2: Build fails when run by multiple users or when node_modules is old (sree)

2 years agoTEZ-2967. Vertex start time should be that of first task start time in UI (jeagles)
Jonathan Eagles [Mon, 21 Mar 2016 15:39:09 +0000 (10:39 -0500)] 
TEZ-2967. Vertex start time should be that of first task start time in UI (jeagles)

2 years agoTEZ-3175. Add tez client submit host (jeagles)
Jonathan Eagles [Fri, 18 Mar 2016 19:45:40 +0000 (14:45 -0500)] 
TEZ-3175. Add tez client submit host (jeagles)

2 years agoTEZ-3170. Tez UI 2: Swimlane - Display computed events, event bars & dependencies...
Sreenath Somarajapuram [Fri, 18 Mar 2016 10:04:33 +0000 (15:34 +0530)] 
TEZ-3170. Tez UI 2: Swimlane - Display computed events, event bars & dependencies (sree)

2 years agoTEZ-3166. Fix a few cases where counters aren't fully updated and sent
Siddharth Seth [Fri, 18 Mar 2016 00:38:41 +0000 (17:38 -0700)] 
TEZ-3166. Fix a few cases where counters aren't fully updated and sent
for failed tasks. Contributed by Zhiyuan Yang.

2 years agoTEZ-2958. Recovered TA, whose commit cannot be recovered, should move to killed state...
Jason Lowe [Thu, 17 Mar 2016 19:00:46 +0000 (19:00 +0000)] 
TEZ-2958. Recovered TA, whose commit cannot be recovered, should move to killed state (jlowe)

2 years agoTEZ-3160. Tez UI 2: Swimlane - Create swimlane page & component (sree)
Sreenath Somarajapuram [Thu, 17 Mar 2016 15:18:20 +0000 (20:48 +0530)] 
TEZ-3160. Tez UI 2: Swimlane - Create swimlane page & component (sree)

2 years agoTEZ-2936. Create ATS implementation that enables support for YARN-4265 (ATSv1.5)...
Hitesh Shah [Mon, 14 Mar 2016 23:36:43 +0000 (16:36 -0700)] 
TEZ-2936. Create ATS implementation that enables support for YARN-4265 (ATSv1.5) (hitesh)

2 years agoTEZ-3148. Invalid event TA_TEZ_EVENT_UPDATE on TaskAttempt. (Tsuyoshi Ozawa via hitesh)
Hitesh Shah [Mon, 14 Mar 2016 18:45:56 +0000 (11:45 -0700)] 
TEZ-3148. Invalid event TA_TEZ_EVENT_UPDATE on TaskAttempt. (Tsuyoshi Ozawa via hitesh)

2 years agoUpdate CHANGES.txt
Hitesh Shah [Mon, 14 Mar 2016 18:21:14 +0000 (11:21 -0700)] 
Update CHANGES.txt

2 years agoTEZ-3155. Addendum patch for logging. Support a way to submit DAGs to a session where...
Hitesh Shah [Mon, 14 Mar 2016 18:18:22 +0000 (11:18 -0700)] 
TEZ-3155. Addendum patch for logging. Support a way to submit DAGs to a session where the DAG plan exceeds hadoop ipc limits. (Zhiyuan Yang via hitesh)

2 years agoTEZ-3105. TezMxBeanResourceCalculator does not work on IBM JDK 7 or 8 causing Tez...
Hitesh Shah [Mon, 14 Mar 2016 18:17:51 +0000 (11:17 -0700)] 
TEZ-3105. TezMxBeanResourceCalculator does not work on IBM JDK 7 or 8 causing Tez failures. (Greg Senia via hitesh)

2 years agoTEZ-3155. Support a way to submit DAGs to a session where the DAG plan exceeds hadoop...
Hitesh Shah [Thu, 10 Mar 2016 01:41:18 +0000 (17:41 -0800)] 
TEZ-3155. Support a way to submit DAGs to a session where the DAG plan exceeds hadoop ipc limits. (Zhiyuan Yang via hitesh)

2 years agoTEZ-2863. Container, node, and logs not available in UI for tasks that fail to launch...
Jonathan Eagles [Tue, 8 Mar 2016 23:26:23 +0000 (17:26 -0600)] 
TEZ-2863. Container, node, and logs not available in UI for tasks that fail to launch (jeagles)

2 years agoTEZ-3140. Reduce AM memory usage during serialization
Rohini Palaniswamy [Mon, 7 Mar 2016 15:51:37 +0000 (07:51 -0800)] 
TEZ-3140. Reduce AM memory usage during serialization

2 years agoTEZ-2756. MergeManager close should not try merging files on close if invoked after...
Rajesh Balamohan [Fri, 4 Mar 2016 05:58:15 +0000 (11:28 +0530)] 
TEZ-2756. MergeManager close should not try merging files on close if invoked after a shuffle exception (Tsuyoshi Ozawa via rbalamohan)

2 years agoTEZ-3156. Tez client keeps trying to talk to RM even if RM does not know about the...
Hitesh Shah [Thu, 3 Mar 2016 20:19:12 +0000 (12:19 -0800)] 
TEZ-3156. Tez client keeps trying to talk to RM even if RM does not know about the application. (hitesh)

2 years agoTEZ-3115. Shuffle string handling adds significant memory overhead (jeagles)
Jonathan Eagles [Wed, 2 Mar 2016 20:02:04 +0000 (14:02 -0600)] 
TEZ-3115. Shuffle string handling adds significant memory overhead (jeagles)

2 years agoTEZ-3151. Expose DAG credentials to plugins. Contributed by Sergey Shelukhin.
Siddharth Seth [Tue, 1 Mar 2016 00:34:00 +0000 (16:34 -0800)] 
TEZ-3151. Expose DAG credentials to plugins. Contributed by Sergey Shelukhin.

2 years agoTEZ-3149. Tez-tools: Add username in DagInfo (rbalamohan)
Rajesh Balamohan [Mon, 29 Feb 2016 22:10:28 +0000 (03:40 +0530)] 
TEZ-3149. Tez-tools: Add username in DagInfo (rbalamohan)

2 years agoTEZ-2988. DAGAppMaster::shutdownTezAM should return with a no-op if it has been invok...
Hitesh Shah [Mon, 29 Feb 2016 18:52:27 +0000 (10:52 -0800)] 
TEZ-2988. DAGAppMaster::shutdownTezAM should return with a no-op if it has been invoked earlier. (Tsuyoshi Ozawa via hitesh)

2 years agoTEZ-3143. Tez UI 2: Make the build faster (sree)
Sreenath Somarajapuram [Sun, 28 Feb 2016 02:39:45 +0000 (08:09 +0530)] 
TEZ-3143. Tez UI 2: Make the build faster (sree)

2 years agoTEZ-3147. Intermediate mem-to-mem: Fix early exit when only one segment can fit into...
Rajesh Balamohan [Sat, 27 Feb 2016 05:27:09 +0000 (10:57 +0530)] 
TEZ-3147. Intermediate mem-to-mem: Fix early exit when only one segment can fit into memory (rbalamohan)

2 years agoTEZ-1911. addendum patch. MergeManager's unconditionalReserve() should check for...
Rajesh Balamohan [Sat, 27 Feb 2016 01:33:18 +0000 (07:03 +0530)] 
TEZ-1911. addendum patch. MergeManager's unconditionalReserve() should check for memory limits before allocating memory to IntermediateMemoryToMemoryMerger (rbalamohan)

2 years agoTEZ-3141. mapreduce.task.timeout is not translated to container heartbeat timeout...
Jason Lowe [Fri, 26 Feb 2016 21:56:17 +0000 (21:56 +0000)] 
TEZ-3141. mapreduce.task.timeout is not translated to container heartbeat timeout (jlowe)

2 years agoTEZ-3128. Avoid stopping containers on the AM shutdown thread. Contributed by Tsuyosh...
Siddharth Seth [Fri, 26 Feb 2016 18:11:01 +0000 (10:11 -0800)] 
TEZ-3128. Avoid stopping containers on the AM shutdown thread. Contributed by Tsuyoshi Ozawa.

2 years agoTEZ-3129. Tez task and task attempt UI needs application fails with NotFoundException...
Jonathan Eagles [Fri, 26 Feb 2016 16:38:58 +0000 (10:38 -0600)] 
TEZ-3129. Tez task and task attempt UI needs application fails with NotFoundException (jeagles)

2 years agoTEZ-3114. Shuffle OOM due to EventMetaData flood (jlowe)
Jason Lowe [Fri, 26 Feb 2016 15:41:50 +0000 (15:41 +0000)] 
TEZ-3114. Shuffle OOM due to EventMetaData flood (jlowe)

2 years agoTEZ-1911. MergeManager's unconditionalReserve() should check for memory limits before...
Rajesh Balamohan [Fri, 26 Feb 2016 06:26:48 +0000 (11:56 +0530)] 
TEZ-1911. MergeManager's unconditionalReserve() should check for memory limits before allocating memory to IntermediateMemoryToMemoryMerger (rbalamohan)

2 years agoTEZ-3102. Fetch failure of a speculated task causes job hang (jlowe)
Jason Lowe [Thu, 25 Feb 2016 20:18:17 +0000 (20:18 +0000)] 
TEZ-3102. Fetch failure of a speculated task causes job hang (jlowe)

2 years agoTEZ-3136. Tez UI 2: Pre-merge: Update CHANGES.txt and remove from excluded list ... TEZ-2980
Sreenath Somarajapuram [Wed, 24 Feb 2016 20:38:58 +0000 (02:08 +0530)] 
TEZ-3136. Tez UI 2: Pre-merge: Update CHANGES.txt and remove from excluded list (sree)

2 years agoTEZ-3127. Tez UI 2: Release audit is failing (sree)
Sreenath Somarajapuram [Thu, 18 Feb 2016 19:06:04 +0000 (00:36 +0530)] 
TEZ-3127. Tez UI 2: Release audit is failing (sree)

2 years agoTEZ-3125. Tez UI 2: All auto-refresh pages refresh multiple times shortly after appli...
Sreenath Somarajapuram [Thu, 18 Feb 2016 09:12:09 +0000 (14:42 +0530)] 
TEZ-3125. Tez UI 2: All auto-refresh pages refresh multiple times shortly after application complete (sree)