318 Commits

Author SHA1 Message Date
Akira Ajisaka
ec811909e4 YARN-5166. javadoc:javadoc goal fails on hadoop-yarn-client. Contributed by Andras Bokor.
(cherry picked from commit e4022debf717083ab9192164af9978500035d1be)
2016-05-27 23:15:48 +09:00
Xuan
38ae5954df YARN-5089. Improve "yarn log" command-line "logFiles" option to support
regex. Contributed by Xuan Gong

(cherry picked from commit bde819abbbcea940cfa6426a9e4920e6c8dc9cf1)
2016-05-26 23:50:14 -07:00
Carlo Curino
c656977961 YARN-4957. Add getNewReservation in ApplicationClientProtocol (Sean Po via curino)
(cherry picked from commit 013532a95e63d7c53e601be530021d6d5a15ab7f)
2016-05-25 16:58:19 -07:00
Arun Suresh
ce886ff2b1 YARN-4991. Fix ContainerRequest Constructor to set nodelabelExpression correctly. (Bibin A Chundatt via asuresh)
(cherry picked from commit a5fed8bbfeed9b58c59584afa5931eae635afa2f)
2016-05-24 05:12:03 -07:00
Arun Suresh
a555a320e8 YARN-5090. Add End-to-End test-cases for DistributedScheduling using MiniYarnCluster. (asuresh)
(cherry picked from commit 8a9ecb7584b529be1de3a6e8850041e211c88ebc)
2016-05-18 23:20:36 -07:00
Arun Suresh
68964bbaa2 YARN-4335. Allow ResourceRequests to specify ExecutionType of a request ask (kkaranasos via asuresh)
(cherry picked from commit 8ffabfdf4fec104cdaa68133385cfe9cf88b95a8)
(cherry picked from commit b2a654c5ee6524f81c971ea0b70e58ea0a455f1d)
2016-05-18 22:02:43 -07:00
Naganarasimha
a166286b9e YARN-4925. ContainerRequest in AMRMClient, application should be able to specify nodes/racks together with nodeLabelExpression. Contributed by Bibin A Chundatt
(cherry picked from commit f04c81c9ce93512bc714531a7731debbe6b794ce)
2016-05-19 01:35:47 +08:00
Varun Vasudev
3c9392a31d YARN-4913. Yarn logs should take a -out option to write to a directory. Contributed by Xuan Gong.
(cherry picked from commit ef1757790d89cc72f88f5330761b1c8901c59e94)
2016-05-18 22:45:06 +05:30
Xuan
3fe4107909 YARN-5080. Cannot obtain logs using YARN CLI -am for either KILLED or
RUNNING AM. Contributed by Xuan Gong

(cherry picked from commit 7be53b65f95dae89c760cde354b42f15f5ee3b5f)
2016-05-14 12:22:06 -07:00
Vinod Kumar Vavilapalli
e0d6a9632d YARN-4842. Fixed "yarn logs" command to guess (and thus not require) the appOwner argument when viewing another user's logs. Contributed by Ram Venkatesh and Xuan Gong.
(cherry picked from commit 87f5e351337a905af5215af76c72b9312616cd4f)
2016-05-09 22:47:58 -07:00
Vinod Kumar Vavilapalli
8262ef8318 YARN-4905. Improved "yarn logs" command-line to optionally show log metadata also. Contributed by Xuan Gong.
(cherry picked from commit 9e37fe3b7a3b5f0a193d228bb5e065f41acd2835)
2016-05-04 14:17:09 -07:00
Varun Vasudev
cf3e93ee73 YARN-4966. Improve yarn logs to fetch container logs without specifying nodeId. Contributed by Xuan Gong.
(cherry picked from commit 66b07d83740a2ec3e6bfb2bfd064863bae37a1b5)
2016-04-27 15:57:17 +05:30
Karthik Kambatla
cd74cf9525 YARN-4935. TestYarnClient#testSubmitIncorrectQueue fails when FairScheduler is the default. (Yufei Gu via kasha)
(cherry picked from commit 6e297836d64498d90d0cd343789db2f2d490378a)
2016-04-20 23:41:03 -07:00
Rohith Sharma K S
e9d1d8afd7 YARN-4794. Deadlock in NMClientImpl. Contributed by Jian He.
(cherry picked from commit ff722bbbdfaf9715643507628e94ece26d904b9d)
2016-04-12 10:03:29 +05:30
Akira Ajisaka
8cf6630fc6 YARN-4630. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta.
(cherry picked from commit 1ff27f9d12e8124c1b9a722708264c5b07fd0fde)
2016-04-11 14:55:37 +09:00
Jian He
d2f9adca88 Missing file for YARN-4117. 2016-03-28 09:23:06 -07:00
Junping Du
c722262c75 YARN-4820. ResourceManager web redirects in HA mode drops query parameters. Contributed by Varun Vasudev.
(cherry picked from commit 19b645c93801a53d4486f9a7639186525e51f723)
2016-03-23 19:35:14 -07:00
Eric Payne
dd1e4107e5 YARN-4686. MiniYARNCluster.start() returns before cluster is completely started. Contributed by Eric Badger.
(cherry picked from commit 92b7e0d41302b6b110927f99de5c2b4a4a93c5fd)
2016-03-18 17:05:53 +00:00
Rohith Sharma K S
d4203c9aa2 YARN-4654. Yarn node label CLI should parse "=" correctly when trying to remove all labels on a node. (Naganarasimha G R via rohithsharmaks)
(cherry picked from commit c1afac3a98a4889d30a6ec7574a364fcbb6bb5b0)
2016-02-18 14:17:04 +05:30
Steve Loughran
2ea1913cad YARN-4682. AMRM client to log when AMRM token updated. (Prabhu Joseph via stevel) 2016-02-12 10:58:46 +00:00
Varun Vasudev
dcead143fe YARN-4684. TestYarnCLI#testGetContainers failing in CN locale. Contributed by Bibin A Chundatt.
(cherry picked from commit 74e9d17a813baeb4e610eb5fdd8e289660346782)
2016-02-12 12:08:57 +05:30
Varun Vasudev
05b57c87f9 YARN-4628. Display application priority in yarn top. Contributed by Bibin A Chundatt.
(cherry picked from commit 663a80031cf6f17151622fff327171dedd976df3)
2016-02-11 12:00:32 +05:30
Steve Loughran
179b36efb5 YARN-4629. Distributed shell breaks under strong security. (Daniel Templeton via stevel) 2016-02-10 13:00:48 +00:00
Wangda Tan
9591363ad8 YARN-4340. Add list API to reservation system. (Sean Po via wangda)
(cherry picked from commit 9875325d5c63f343809907d06bf48a298035a611)
2016-02-02 10:19:19 +08:00
Xuan
1d19557dda YARN-4496. Improve HA ResourceManager Failover detection on the client.
Contributed by Jian He

(cherry picked from commit 618bfd6ac2a5b62d39e9bed80f75362bafc0ef28)
2016-01-22 18:21:50 -08:00
Jason Lowe
ad84f90e88 YARN-4371. "yarn application -kill" should take multiple application ids. Contributed by Sunil G
(cherry picked from commit e91e8b711c68273460b36557fc37fdfc86be097b)
2016-01-22 21:37:08 +00:00
rohithsharmaks
1cec12d95a YARN-4574. Fix random failure in TestAMRMClientOnRMRestart. (Takashi Ohnishi via rohithsharmaks)
(cherry picked from commit 34a3900773df6d9075dcf5476e8fe5208cd8f806)
2016-01-22 21:18:42 +05:30
Akira Ajisaka
ddc22bbcb1 YARN-4605. Spelling mistake in the help message of "yarn applicationattempt" command. Contributed by Weiwei Yang.
(cherry picked from commit 8f58f742aea87b2b46b9741ffeaebfa36af3573f)
2016-01-22 19:43:37 +09:00
Akira Ajisaka
ffca0ebfff YARN-4534. Remove the redundant symbol in yarn rmadmin help msg. Contributed by Lin Yiqun.
(cherry picked from commit 62b0d6151362a9860d4d750e6e0d032882af68aa)
2016-01-14 13:59:58 +09:00
Wangda Tan
9a7d5f69ec YARN-4522. Queue acl can be checked at app submission. (Jian He via wangda)
(cherry picked from commit 8310b2e9ff3d6804bad703c4c15458b0dfeeb4af)
2015-12-30 15:31:11 -08:00
Wangda Tan
daf5fae369 YARN-4290. Add -showDetails option to YARN Nodes CLI to print all nodes reports information. (Sunil G via wangda)
(cherry picked from commit a0de7028515eebe1c526cc42808cdbc8ed6b4e2a)
2015-12-21 11:36:49 -08:00
Jian He
1147b086d9 YARN-4164. Changed updateApplicationPriority API to return the updated application priority. Contributed by Rohith Sharma K S 2015-12-18 14:14:31 -08:00
Wangda Tan
2f5435acbd YARN-4225. Add preemption status to yarn queue -status for capacity scheduler. (Eric Payne via wangda)
(cherry picked from commit 7faa406f27f687844c941346f59a27a375af3233)
2015-12-16 13:29:02 -08:00
Wangda Tan
9f4a6ec663 YARN-4293. ResourceUtilization should be a part of yarn node CLI. (Sunil G via wangda)
(cherry picked from commit 79c41b1d83e981ae74cb8b58ffcf7907b7612ad4)
2015-12-16 13:28:56 -08:00
Vinod Kumar Vavilapalli
b20e77eba3 Preparing for 2.9.0 development: mvn versions:set -DnewVersion=2.9.0 2015-11-25 17:47:22 -08:00
Wangda Tan
7b9f7eaf5c YARN-4384. updateNodeResource CLI should not accept negative values for resource. (Junping Du via wangda)
(cherry picked from commit 23c625ec571b01c0a2811728608890da38f86890)
2015-11-24 16:36:30 -08:00
Wangda Tan
875aec3177 YARN-1509. Make AMRMClient support send increase container request and get increased/decreased containers. (Meng Ding via wangda)
(cherry picked from commit 7ff280fca9af45b98cee2336e78803da46b0f8a5)
2015-11-12 11:50:41 -08:00
Jason Lowe
9050078005 YARN-4345. yarn rmadmin -updateNodeResource doesn't work. Contributed by Junping Du
(cherry picked from commit 06a70311b90a7bc676af86e778ec7bcd8dd6ea82)
2015-11-12 14:49:55 +00:00
Wangda Tan
8a8ac50a5b YARN-1510. Make NMClient support change container resources. (Meng Ding via wangda)
(cherry picked from commit c99925d6dd0235f0d27536f0bebd129e435688fb)
2015-11-10 13:17:23 -08:00
Tsuyoshi Ozawa
d29bff86c4 YARN-4251. TestAMRMClientOnRMRestart#testAMRMClientOnAMRMTokenRollOverOnRMRestart is failing. Contributed by Brahma Reddy Battula.
(cherry picked from commit 9f4dfdf4eb60cc6b13da586dabcd95bd77fc783c)
2015-10-28 17:39:26 +09:00
Wangda Tan
baa2998e93 YARN-4285. Display resource usage as percentage of queue and cluster in the RM UI (Varun Vasudev via wangda)
(cherry picked from commit 3cc73773eb26f7469c99b25a76814d6fad0be28e)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2015-10-26 13:12:56 -07:00
Rohith Sharma K S
e75799d5fd YARN-4246. NPE while listing app attempt. (Nijel S F via rohithsharmaks)
(cherry picked from commit b57f08c0d2dae57b545a3baa213e18464060ae3b)
2015-10-26 12:07:48 +05:30
Jason Lowe
0139517811 YARN-261. Ability to fail AM attempts. Contributed by Andrey Klochkov and Rohith Sharma K S
(cherry picked from commit a0bca2b5ad2344fda5411d910a3730c85f12a0df)
2015-10-09 14:19:41 +00:00
Xuan
53bddc410f YARN-1897. CLI and core support for signal container functionality. Contributed by Ming Ma
(cherry picked from commit 8f08532bde153811368e1b8336446fba4743f9d2)
2015-10-02 18:53:04 -07:00
Jian He
d458805690 YARN-1651. CapacityScheduler side changes to support container resize. Contributed by Wangda Tan
(cherry picked from commit 89cab1ba5f0671f8ef30dbe7432079c18362b434)

Conflicts:
	hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/scheduler/SLSCapacityScheduler.java
2015-09-24 10:30:04 -07:00
Jian He
b6c594c6ea YARN-1644. RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing. Contributed by Meng Ding
(cherry picked from commit c3dc1af072574f5890a8d43e4d60526951b4b8bc)
2015-09-24 10:24:04 -07:00
Jason Lowe
b7111449a1 YARN-3975. WebAppProxyServlet should not redirect to RM page if AHS is enabled. Contributed by Mit Desai
(cherry picked from commit 692d51c09d3668cde47cc297296d095ddfa933a3)
2015-09-23 16:39:50 +00:00
Tsuyoshi Ozawa
52cc2ca488 HADOOP-12428. Fix inconsistency between log-level guards and statements. Contributed by Jagadesh Kiran N and Jackie Chang.
(cherry picked from commit dfd807afab0fae3839c9cc5d552aa0304444f956)
2015-09-22 12:54:44 +09:00
Xuan
f3c0a210b6 YARN-4149. yarn logs -am should provide an option to fetch all the log
files. Contributed by Varun Vasudev

(cherry picked from commit 34ef1a092bcab369bb845481efffb8c47adef53a)
2015-09-15 14:37:59 -07:00
Wangda Tan
c31fe79979 YARN-3717. Expose app/am/queue's node-label-expression to RM web UI / CLI / REST-API. (Naganarasimha G R via wangda)
(cherry picked from commit ae5308fe1d08479da0f3929cc6a57816411e9121)
2015-09-15 11:41:57 -07:00