308 Commits

Author SHA1 Message Date
Wangda Tan
d838c6443d YARN-1942. Deprecate toString/fromString methods from ConverterUtils and move them to records classes like ContainerId/ApplicationId, etc. (wangda) 2016-06-14 15:21:41 -07:00
Wangda Tan
9436548152 YARN-3426. Add jdiff support to YARN. (vinodkv via wangda) 2016-06-10 09:56:18 -07:00
Vinod Kumar Vavilapalli
593d2c66c4 YARN-5080. Addendum fix to the original patch to fix YARN logs CLI. Contributed by Xuan Gong
(cherry picked from commit 5a43583c0bbb9650ea6a9f48d9544ec3ec24b580)
2016-06-08 09:52:37 -07:00
Wangda Tan
19e578870d YARN-4844. Add getMemorySize/getVirtualCoresSize to o.a.h.y.api.records.Resource. (wangda) 2016-06-07 12:41:50 -07:00
Ming Ma
ec4f9a14f9 MAPREDUCE-5044. Have AM trigger jstack on task attempts that timeout before killing them. (Eric Payne and Gera Shegalov via mingma)
(cherry picked from commit 4a1cedc010d3fa1d8ef3f2773ca12acadfee5ba5)
(cherry picked from commit 74e2b5efa26f27027fed212b4b2108f0e95587fb)
2016-06-06 14:49:43 -07:00
Wangda Tan
2f3e1d965d Revert "YARn-4844. Add getMemoryLong/getVirtualCoreLong to o.a.h.y.api.records.Resource. Contributed by Wangda Tan."
This reverts commit 457884737f75c796413ce860b1859a31cc5292ca.
2016-05-31 22:16:53 -07:00
Varun Vasudev
457884737f YARn-4844. Add getMemoryLong/getVirtualCoreLong to o.a.h.y.api.records.Resource. Contributed by Wangda Tan. 2016-05-29 20:57:56 +05:30
Akira Ajisaka
01e7c2bbe4 YARN-5166. javadoc:javadoc goal fails on hadoop-yarn-client. Contributed by Andras Bokor.
(cherry picked from commit e4022debf717083ab9192164af9978500035d1be)
(cherry picked from commit ec811909e41cdea84a0d9c9254ed7c756cbae37b)
2016-05-27 23:16:00 +09:00
Carlo Curino
7982933c09 YARN-4957. Add getNewReservation in ApplicationClientProtocol (Sean Po via curino)
(cherry picked from commit 013532a95e63d7c53e601be530021d6d5a15ab7f)
(cherry picked from commit c656977961e2ba0f9dfd349ed59bf1d0d41c57f5)
2016-05-25 17:02:22 -07:00
Naganarasimha
0fb6a05577 YARN-4925. ContainerRequest in AMRMClient, application should be able to specify nodes/racks together with nodeLabelExpression. Contributed by Bibin A Chundatt
(cherry picked from commit f04c81c9ce93512bc714531a7731debbe6b794ce)
2016-05-19 01:40:06 +08:00
Xuan
4eeec4e35b YARN-5080. Cannot obtain logs using YARN CLI -am for either KILLED or
RUNNING AM. Contributed by Xuan Gong

(cherry picked from commit 7be53b65f95dae89c760cde354b42f15f5ee3b5f)
(cherry picked from commit 3fe4107909393dea91adac9fda16c45814e01648)
2016-05-14 12:22:33 -07:00
Rohith Sharma K S
9d4dedd65f YARN-4794. Deadlock in NMClientImpl. Contributed by Jian He.
(cherry picked from commit ff722bbbdfaf9715643507628e94ece26d904b9d)
2016-04-12 10:05:35 +05:30
Akira Ajisaka
13be7a849d YARN-4630. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta.
(cherry picked from commit 1ff27f9d12e8124c1b9a722708264c5b07fd0fde)
(cherry picked from commit 8cf6630fc6cedbd86eff9da6f35ce1da4ed7ed2f)
2016-04-11 14:55:54 +09:00
Jian He
7c81e374da YARN-4117. End to end unit test with mini YARN cluster for AMRMProxy Service. Contributed by Giovanni Matteo Fumarola 2016-03-28 13:23:53 -07:00
Junping Du
782db43d18 YARN-4820. ResourceManager web redirects in HA mode drops query parameters. Contributed by Varun Vasudev.
(cherry picked from commit 19b645c93801a53d4486f9a7639186525e51f723)
(cherry picked from commit c722262c759d5cddf97de4249c563c8d165b7c9f)
2016-03-23 19:39:09 -07:00
Eric Payne
878e1cfc77 YARN-4686. MiniYARNCluster.start() returns before cluster is completely started. Contributed by Eric Badger.
(cherry picked from commit 92b7e0d41302b6b110927f99de5c2b4a4a93c5fd)
2016-03-18 17:19:06 +00:00
Rohith Sharma K S
f18d092bda YARN-4654. Yarn node label CLI should parse "=" correctly when trying to remove all labels on a node. (Naganarasimha G R via rohithsharmaks)
(cherry picked from commit c1afac3a98a4889d30a6ec7574a364fcbb6bb5b0)
2016-02-18 14:21:55 +05:30
Steve Loughran
706351afb8 YARN-4682. AMRM client to log when AMRM token updated. (Prabhu Joseph via stevel) 2016-02-12 10:58:09 +00:00
Wangda Tan
c487453b91 YARN-4340. Add list API to reservation system. (Sean Po via wangda)
(cherry picked from commit 9875325d5c63f343809907d06bf48a298035a611)
2016-02-02 10:23:25 +08:00
Jason Lowe
e2762f035f YARN-4371. "yarn application -kill" should take multiple application ids. Contributed by Sunil G
(cherry picked from commit e91e8b711c68273460b36557fc37fdfc86be097b)
2016-01-22 21:37:41 +00:00
Akira Ajisaka
ecba5f2ed3 YARN-4605. Spelling mistake in the help message of "yarn applicationattempt" command. Contributed by Weiwei Yang.
(cherry picked from commit 8f58f742aea87b2b46b9741ffeaebfa36af3573f)
(cherry picked from commit ddc22bbcb1c2e90f64092e94d295515ff8c7fe48)
2016-01-22 19:47:57 +09:00
Akira Ajisaka
4417c3b6d2 YARN-4534. Remove the redundant symbol in yarn rmadmin help msg. Contributed by Lin Yiqun.
(cherry picked from commit 62b0d6151362a9860d4d750e6e0d032882af68aa)
(cherry picked from commit ffca0ebfff7fa6d0e6878801da01dfdbe1ed770a)
2016-01-14 14:00:18 +09:00
Wangda Tan
e507ed1f90 YARN-4290. Add -showDetails option to YARN Nodes CLI to print all nodes reports information. (Sunil G via wangda)
(cherry picked from commit a0de7028515eebe1c526cc42808cdbc8ed6b4e2a)
2015-12-21 11:38:15 -08:00
Wangda Tan
c4b1386b4e YARN-4225. Add preemption status to yarn queue -status for capacity scheduler. (Eric Payne via wangda)
(cherry picked from commit 7faa406f27f687844c941346f59a27a375af3233)
(cherry picked from commit 2f5435acbda53470724d833cfa1c58dc3c3c9bb1)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2015-12-18 16:34:45 -08:00
Wangda Tan
9ed9eb265f YARN-4293. ResourceUtilization should be a part of yarn node CLI. (Sunil G via wangda)
(cherry picked from commit 79c41b1d83e981ae74cb8b58ffcf7907b7612ad4)
(cherry picked from commit 9f4a6ec6630f3776859f8d677532370095a58d0c)
2015-12-18 16:34:45 -08:00
Wangda Tan
7b9f7eaf5c YARN-4384. updateNodeResource CLI should not accept negative values for resource. (Junping Du via wangda)
(cherry picked from commit 23c625ec571b01c0a2811728608890da38f86890)
2015-11-24 16:36:30 -08:00
Wangda Tan
875aec3177 YARN-1509. Make AMRMClient support send increase container request and get increased/decreased containers. (Meng Ding via wangda)
(cherry picked from commit 7ff280fca9af45b98cee2336e78803da46b0f8a5)
2015-11-12 11:50:41 -08:00
Jason Lowe
9050078005 YARN-4345. yarn rmadmin -updateNodeResource doesn't work. Contributed by Junping Du
(cherry picked from commit 06a70311b90a7bc676af86e778ec7bcd8dd6ea82)
2015-11-12 14:49:55 +00:00
Wangda Tan
8a8ac50a5b YARN-1510. Make NMClient support change container resources. (Meng Ding via wangda)
(cherry picked from commit c99925d6dd0235f0d27536f0bebd129e435688fb)
2015-11-10 13:17:23 -08:00
Tsuyoshi Ozawa
d29bff86c4 YARN-4251. TestAMRMClientOnRMRestart#testAMRMClientOnAMRMTokenRollOverOnRMRestart is failing. Contributed by Brahma Reddy Battula.
(cherry picked from commit 9f4dfdf4eb60cc6b13da586dabcd95bd77fc783c)
2015-10-28 17:39:26 +09:00
Wangda Tan
baa2998e93 YARN-4285. Display resource usage as percentage of queue and cluster in the RM UI (Varun Vasudev via wangda)
(cherry picked from commit 3cc73773eb26f7469c99b25a76814d6fad0be28e)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2015-10-26 13:12:56 -07:00
Rohith Sharma K S
e75799d5fd YARN-4246. NPE while listing app attempt. (Nijel S F via rohithsharmaks)
(cherry picked from commit b57f08c0d2dae57b545a3baa213e18464060ae3b)
2015-10-26 12:07:48 +05:30
Jason Lowe
0139517811 YARN-261. Ability to fail AM attempts. Contributed by Andrey Klochkov and Rohith Sharma K S
(cherry picked from commit a0bca2b5ad2344fda5411d910a3730c85f12a0df)
2015-10-09 14:19:41 +00:00
Xuan
53bddc410f YARN-1897. CLI and core support for signal container functionality. Contributed by Ming Ma
(cherry picked from commit 8f08532bde153811368e1b8336446fba4743f9d2)
2015-10-02 18:53:04 -07:00
Jian He
d458805690 YARN-1651. CapacityScheduler side changes to support container resize. Contributed by Wangda Tan
(cherry picked from commit 89cab1ba5f0671f8ef30dbe7432079c18362b434)

Conflicts:
	hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/scheduler/SLSCapacityScheduler.java
2015-09-24 10:30:04 -07:00
Jian He
b6c594c6ea YARN-1644. RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing. Contributed by Meng Ding
(cherry picked from commit c3dc1af072574f5890a8d43e4d60526951b4b8bc)
2015-09-24 10:24:04 -07:00
Jason Lowe
b7111449a1 YARN-3975. WebAppProxyServlet should not redirect to RM page if AHS is enabled. Contributed by Mit Desai
(cherry picked from commit 692d51c09d3668cde47cc297296d095ddfa933a3)
2015-09-23 16:39:50 +00:00
Tsuyoshi Ozawa
52cc2ca488 HADOOP-12428. Fix inconsistency between log-level guards and statements. Contributed by Jagadesh Kiran N and Jackie Chang.
(cherry picked from commit dfd807afab0fae3839c9cc5d552aa0304444f956)
2015-09-22 12:54:44 +09:00
Xuan
f3c0a210b6 YARN-4149. yarn logs -am should provide an option to fetch all the log
files. Contributed by Varun Vasudev

(cherry picked from commit 34ef1a092bcab369bb845481efffb8c47adef53a)
2015-09-15 14:37:59 -07:00
Wangda Tan
c31fe79979 YARN-3717. Expose app/am/queue's node-label-expression to RM web UI / CLI / REST-API. (Naganarasimha G R via wangda)
(cherry picked from commit ae5308fe1d08479da0f3929cc6a57816411e9121)
2015-09-15 11:41:57 -07:00
Junping Du
df714e25aa YARN-313. Add Admin API for supporting node resource configuration in command line. (Contributed by Inigo Goiri, Kenji Kikushima and Junping Du)
(cherry picked from commit 73e3a49eb0d58f08549dc6b7054eb5c1f62819dc)
2015-09-15 07:58:47 -07:00
Robert Kanter
d07eef8c87 YARN-4115. Reduce loglevel of ContainerManagementProtocolProxy to Debug (adhoot via rkanter)
(cherry picked from commit b84fb41bb6ca2d69153cf5bd61f88492538ee713)
2015-09-11 11:46:35 -07:00
Robert Kanter
ea64a9b277 YARN-4086. Allow Aggregated Log readers to handle HAR files (rkanter)
(cherry picked from commit 6dd6ca442aba8612c3780399a42bb473e4483021)
2015-09-09 18:03:47 -07:00
Varun Vasudev
a53054c853 YARN-3970. Add REST api support for Application Priority. Contributed by Naganarasimha G R.
(cherry picked from commit 223a306da925ad031bc398f2ea5e56f0e6521edf)
2015-09-03 16:40:42 +05:30
Jian He
48f5161cd5 YARN-4092. Fixed UI redirection to print useful messages when both RMs are in standby mode. Contributed by Xuan Gong
(cherry picked from commit a3fd2ccc869dfc1f04d1cf0a8678d4d90a43a80f)
2015-08-31 17:34:49 -07:00
Jian He
306c535395 YARN-3250. Support admin cli interface in for Application Priority. Contributed by Rohith Sharma K S
(cherry picked from commit a9c8ea71aa427ff5f25caec98be15bc880e578a7)
2015-08-27 13:27:34 -07:00
Jian He
387076894f YARN-4014. Support user cli interface in for Application Priority. Contributed by Rohith Sharma K S
(cherry picked from commit 57c7ae1affb2e1821fbdc3f47738d7e6fd83c7c1)
2015-08-24 20:37:18 -07:00
Karthik Kambatla
b567aa2b4f YARN-4055. Report node resource utilization in heartbeat. (Inigo Goiri via kasha)
(cherry picked from commit 13604bd5f119fc81b9942190dfa366afad61bc92)
2015-08-20 16:52:33 -07:00
rohithsharmaks
c5b20e0db6 YARN-4023. Publish Application Priority to TimelineServer. (Sunil G via rohithsharmaks)
(cherry picked from commit 1c12adb71f32f24ec525313ff8dfcd2b738fc8e2)
2015-08-12 14:47:23 +05:30
Rohith Sharma K S
a0da1ec010 YARN-3948. Display Application Priority in RM Web UI.(Sunil G via rohithsharmaks)
(cherry picked from commit b6265d39c5d0fda21dfe55273f193d8a6a20c6a8)
2015-08-07 10:47:08 +05:30