333 Commits

Author SHA1 Message Date
Junping Du
6afa044dda YARN-5251. Yarn CLI to obtain App logs for last 'n' bytes fails. Contributed by Xuan Gong.
(cherry picked from commit c35fa4a0e57b99415e284c7c2f3b1a0bebc610c2)
2016-06-17 08:25:33 -07:00
Junping Du
eec703f36f YARN-5083. YARN CLI for AM logs does not give any error message if entered invalid am value. Contributed by Jian He.
(cherry picked from commit e14ee0d3b55816bed1d27a8caf78001985119e3c)
2016-06-16 08:56:46 -07:00
Varun Vasudev
75235149af YARN-5223. Container line in yarn logs output for a live application should include the hostname for the container. Contributed by Xuan Gong.
(cherry picked from commit 25064fb2fb79751cedbb8019900d811e07549ecf)
2016-06-15 12:43:26 +05:30
Varun Vasudev
5bd39d2f3c YARN-5122. "yarn logs" for running containers should print an explicit footer saying that the log may be incomplete. Contributed by Jian He.
(cherry picked from commit d6284428e8bd09a06cf18ff81a7064d744ef47d0)
2016-06-15 12:37:51 +05:30
Wangda Tan
863bfa4d6a YARN-1942. Deprecate toString/fromString methods from ConverterUtils and move them to records classes like ContainerId/ApplicationId, etc. (wangda) 2016-06-14 15:12:00 -07:00
Karthik Kambatla
a92be02c2e YARN-5124. Modify AMRMClient to set the ExecutionType in the ResourceRequest. Addendum to fix compilation. (Arun Suresh via kasha) 2016-06-12 14:28:14 -07:00
Arun Suresh
fccb641942 YARN-5124. Modify AMRMClient to set the ExecutionType in the ResourceRequest. (asuresh)
(cherry picked from commit 51432779588fdd741b4840601f5db637ec783d92)
2016-06-12 09:43:19 -07:00
Wangda Tan
e91e9e596d YARN-3426. Add jdiff support to YARN. (vinodkv via wangda)
(cherry picked from commit 03fc6b1bb0f5c0844cd5477ffba43de8a14d4d60)
2016-06-10 09:53:40 -07:00
Wangda Tan
a4094ddb5a YARN-5208. Run TestAMRMClient TestNMClient TestYarnClient TestClientRMTokens TestAMAuthorization tests with hadoop.security.token.service.use_ip enabled. (Rohith Sharma K S via wangda)
(cherry picked from commit 244506f9c8953029283aa8e0eb2006ae2f30025e)
2016-06-10 09:37:35 -07:00
Vinod Kumar Vavilapalli
67dbd4c466 YARN-5080. Addendum fix to the original patch to fix YARN logs CLI. Contributed by Xuan Gong
(cherry picked from commit 5a43583c0bbb9650ea6a9f48d9544ec3ec24b580)
2016-06-08 09:51:36 -07:00
Ming Ma
74e2b5efa2 MAPREDUCE-5044. Have AM trigger jstack on task attempts that timeout before killing them. (Eric Payne and Gera Shegalov via mingma)
(cherry picked from commit 4a1cedc010d3fa1d8ef3f2773ca12acadfee5ba5)
2016-06-06 14:34:47 -07:00
Arun Suresh
384a84828f YARN-5180. Allow ResourceRequest to specify an enforceExecutionType flag. (asuresh)
(cherry picked from commit dc26601d8fe27a4223a50601bf7522cc42e8e2f3)
2016-06-02 09:14:30 -07:00
Xuan
04062593b4 YARN-5088. Improve "yarn log" command-line to read the last K bytes for the log files. Contributed by Xuan Gong
(cherry picked from commit 0bc05e40fa7e183efe8463ada459c621da3ce3bf)
2016-06-01 13:45:24 -07:00
Varun Vasudev
bd01153ddf YARN-5141. Get Container logs for the Running application from Yarn Logs CommandLine. Contributed by Xuan Gong.
(cherry picked from commit 4e1f56e111a88c2bc600aaa601010295075676c9)
2016-05-29 21:54:29 +05:30
Varun Vasudev
4f36c3d214 YARN-4844. Add getMemoryLong/getVirtualCoreLong to o.a.h.y.api.records.Resource. Contributed by Wangda Tan. 2016-05-29 20:55:39 +05:30
Akira Ajisaka
ec811909e4 YARN-5166. javadoc:javadoc goal fails on hadoop-yarn-client. Contributed by Andras Bokor.
(cherry picked from commit e4022debf717083ab9192164af9978500035d1be)
2016-05-27 23:15:48 +09:00
Xuan
38ae5954df YARN-5089. Improve "yarn log" command-line "logFiles" option to support
regex. Contributed by Xuan Gong

(cherry picked from commit bde819abbbcea940cfa6426a9e4920e6c8dc9cf1)
2016-05-26 23:50:14 -07:00
Carlo Curino
c656977961 YARN-4957. Add getNewReservation in ApplicationClientProtocol (Sean Po via curino)
(cherry picked from commit 013532a95e63d7c53e601be530021d6d5a15ab7f)
2016-05-25 16:58:19 -07:00
Arun Suresh
ce886ff2b1 YARN-4991. Fix ContainerRequest Constructor to set nodelabelExpression correctly. (Bibin A Chundatt via asuresh)
(cherry picked from commit a5fed8bbfeed9b58c59584afa5931eae635afa2f)
2016-05-24 05:12:03 -07:00
Arun Suresh
a555a320e8 YARN-5090. Add End-to-End test-cases for DistributedScheduling using MiniYarnCluster. (asuresh)
(cherry picked from commit 8a9ecb7584b529be1de3a6e8850041e211c88ebc)
2016-05-18 23:20:36 -07:00
Arun Suresh
68964bbaa2 YARN-4335. Allow ResourceRequests to specify ExecutionType of a request ask (kkaranasos via asuresh)
(cherry picked from commit 8ffabfdf4fec104cdaa68133385cfe9cf88b95a8)
(cherry picked from commit b2a654c5ee6524f81c971ea0b70e58ea0a455f1d)
2016-05-18 22:02:43 -07:00
Naganarasimha
a166286b9e YARN-4925. ContainerRequest in AMRMClient, application should be able to specify nodes/racks together with nodeLabelExpression. Contributed by Bibin A Chundatt
(cherry picked from commit f04c81c9ce93512bc714531a7731debbe6b794ce)
2016-05-19 01:35:47 +08:00
Varun Vasudev
3c9392a31d YARN-4913. Yarn logs should take a -out option to write to a directory. Contributed by Xuan Gong.
(cherry picked from commit ef1757790d89cc72f88f5330761b1c8901c59e94)
2016-05-18 22:45:06 +05:30
Xuan
3fe4107909 YARN-5080. Cannot obtain logs using YARN CLI -am for either KILLED or
RUNNING AM. Contributed by Xuan Gong

(cherry picked from commit 7be53b65f95dae89c760cde354b42f15f5ee3b5f)
2016-05-14 12:22:06 -07:00
Vinod Kumar Vavilapalli
e0d6a9632d YARN-4842. Fixed "yarn logs" command to guess (and thus not require) the appOwner argument when viewing another user's logs. Contributed by Ram Venkatesh and Xuan Gong.
(cherry picked from commit 87f5e351337a905af5215af76c72b9312616cd4f)
2016-05-09 22:47:58 -07:00
Vinod Kumar Vavilapalli
8262ef8318 YARN-4905. Improved "yarn logs" command-line to optionally show log metadata also. Contributed by Xuan Gong.
(cherry picked from commit 9e37fe3b7a3b5f0a193d228bb5e065f41acd2835)
2016-05-04 14:17:09 -07:00
Varun Vasudev
cf3e93ee73 YARN-4966. Improve yarn logs to fetch container logs without specifying nodeId. Contributed by Xuan Gong.
(cherry picked from commit 66b07d83740a2ec3e6bfb2bfd064863bae37a1b5)
2016-04-27 15:57:17 +05:30
Karthik Kambatla
cd74cf9525 YARN-4935. TestYarnClient#testSubmitIncorrectQueue fails when FairScheduler is the default. (Yufei Gu via kasha)
(cherry picked from commit 6e297836d64498d90d0cd343789db2f2d490378a)
2016-04-20 23:41:03 -07:00
Rohith Sharma K S
e9d1d8afd7 YARN-4794. Deadlock in NMClientImpl. Contributed by Jian He.
(cherry picked from commit ff722bbbdfaf9715643507628e94ece26d904b9d)
2016-04-12 10:03:29 +05:30
Akira Ajisaka
8cf6630fc6 YARN-4630. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta.
(cherry picked from commit 1ff27f9d12e8124c1b9a722708264c5b07fd0fde)
2016-04-11 14:55:37 +09:00
Jian He
d2f9adca88 Missing file for YARN-4117. 2016-03-28 09:23:06 -07:00
Junping Du
c722262c75 YARN-4820. ResourceManager web redirects in HA mode drops query parameters. Contributed by Varun Vasudev.
(cherry picked from commit 19b645c93801a53d4486f9a7639186525e51f723)
2016-03-23 19:35:14 -07:00
Eric Payne
dd1e4107e5 YARN-4686. MiniYARNCluster.start() returns before cluster is completely started. Contributed by Eric Badger.
(cherry picked from commit 92b7e0d41302b6b110927f99de5c2b4a4a93c5fd)
2016-03-18 17:05:53 +00:00
Rohith Sharma K S
d4203c9aa2 YARN-4654. Yarn node label CLI should parse "=" correctly when trying to remove all labels on a node. (Naganarasimha G R via rohithsharmaks)
(cherry picked from commit c1afac3a98a4889d30a6ec7574a364fcbb6bb5b0)
2016-02-18 14:17:04 +05:30
Steve Loughran
2ea1913cad YARN-4682. AMRM client to log when AMRM token updated. (Prabhu Joseph via stevel) 2016-02-12 10:58:46 +00:00
Varun Vasudev
dcead143fe YARN-4684. TestYarnCLI#testGetContainers failing in CN locale. Contributed by Bibin A Chundatt.
(cherry picked from commit 74e9d17a813baeb4e610eb5fdd8e289660346782)
2016-02-12 12:08:57 +05:30
Varun Vasudev
05b57c87f9 YARN-4628. Display application priority in yarn top. Contributed by Bibin A Chundatt.
(cherry picked from commit 663a80031cf6f17151622fff327171dedd976df3)
2016-02-11 12:00:32 +05:30
Steve Loughran
179b36efb5 YARN-4629. Distributed shell breaks under strong security. (Daniel Templeton via stevel) 2016-02-10 13:00:48 +00:00
Wangda Tan
9591363ad8 YARN-4340. Add list API to reservation system. (Sean Po via wangda)
(cherry picked from commit 9875325d5c63f343809907d06bf48a298035a611)
2016-02-02 10:19:19 +08:00
Xuan
1d19557dda YARN-4496. Improve HA ResourceManager Failover detection on the client.
Contributed by Jian He

(cherry picked from commit 618bfd6ac2a5b62d39e9bed80f75362bafc0ef28)
2016-01-22 18:21:50 -08:00
Jason Lowe
ad84f90e88 YARN-4371. "yarn application -kill" should take multiple application ids. Contributed by Sunil G
(cherry picked from commit e91e8b711c68273460b36557fc37fdfc86be097b)
2016-01-22 21:37:08 +00:00
rohithsharmaks
1cec12d95a YARN-4574. Fix random failure in TestAMRMClientOnRMRestart. (Takashi Ohnishi via rohithsharmaks)
(cherry picked from commit 34a3900773df6d9075dcf5476e8fe5208cd8f806)
2016-01-22 21:18:42 +05:30
Akira Ajisaka
ddc22bbcb1 YARN-4605. Spelling mistake in the help message of "yarn applicationattempt" command. Contributed by Weiwei Yang.
(cherry picked from commit 8f58f742aea87b2b46b9741ffeaebfa36af3573f)
2016-01-22 19:43:37 +09:00
Akira Ajisaka
ffca0ebfff YARN-4534. Remove the redundant symbol in yarn rmadmin help msg. Contributed by Lin Yiqun.
(cherry picked from commit 62b0d6151362a9860d4d750e6e0d032882af68aa)
2016-01-14 13:59:58 +09:00
Wangda Tan
9a7d5f69ec YARN-4522. Queue acl can be checked at app submission. (Jian He via wangda)
(cherry picked from commit 8310b2e9ff3d6804bad703c4c15458b0dfeeb4af)
2015-12-30 15:31:11 -08:00
Wangda Tan
daf5fae369 YARN-4290. Add -showDetails option to YARN Nodes CLI to print all nodes reports information. (Sunil G via wangda)
(cherry picked from commit a0de7028515eebe1c526cc42808cdbc8ed6b4e2a)
2015-12-21 11:36:49 -08:00
Jian He
1147b086d9 YARN-4164. Changed updateApplicationPriority API to return the updated application priority. Contributed by Rohith Sharma K S 2015-12-18 14:14:31 -08:00
Wangda Tan
2f5435acbd YARN-4225. Add preemption status to yarn queue -status for capacity scheduler. (Eric Payne via wangda)
(cherry picked from commit 7faa406f27f687844c941346f59a27a375af3233)
2015-12-16 13:29:02 -08:00
Wangda Tan
9f4a6ec663 YARN-4293. ResourceUtilization should be a part of yarn node CLI. (Sunil G via wangda)
(cherry picked from commit 79c41b1d83e981ae74cb8b58ffcf7907b7612ad4)
2015-12-16 13:28:56 -08:00
Vinod Kumar Vavilapalli
b20e77eba3 Preparing for 2.9.0 development: mvn versions:set -DnewVersion=2.9.0 2015-11-25 17:47:22 -08:00