474 Commits

Author SHA1 Message Date
Haibo Chen
1134060678 YARN-7310. TestAMRMProxy#testAMRMProxyE2E fails with FairScheduler. (Robert Kanter via Haibo Chen)
(cherry picked from commit 3fb47188867124bf18fb798b460928b3557ab9a1)
2017-10-13 15:52:09 -07:00
Jonathan Hung
168a3df8e6 YARN-7251. Misc changes to YARN-5734 2017-10-09 14:54:57 -07:00
Xuan
e09f0d64ac YARN-5953:Create CLI for changing YARN configurations. (Jonathan Hung via xgong) 2017-10-09 14:54:54 -07:00
Haibo Chen
c021c8a19f YARN-7009. TestNMClient.testNMClientNoCleanupOnStop is flaky by design. (Miklos Szegedi via Haibo Chen)
(cherry picked from commit c071aad5da6f6601978e73d38ce5813958848bc4)
2017-10-05 15:51:08 -07:00
Arun Suresh
b61d12e300 YARN-7258. Add Node and Rack Hints to Opportunistic Scheduler. (Kartheek Muthyala via asuresh).
(cherry picked from commit b733348dde18a242e6c9074c512116a8baf1d281)
2017-10-05 10:06:30 -07:00
Akira Ajisaka
b658ae002f
YARN-6943. Update Yarn to YARN in documentation. Contributed by Chetna Chaudhari.
(cherry picked from commit c9b525bd943fe7e098e72fb9be5623862c7ab5ff)
2017-10-04 07:02:31 +09:00
Wangda Tan
d58d75ca50 YARN-6509. Add a size threshold beyond which yarn logs will require a force option. (Xuan Gong via wangda)
Change-Id: I755fe903337d4ff9ec35dae5b9cce638794e1d0f
(cherry picked from commit ec2ae3060a807c8754826af2135a68c08b2e4f13)
2017-09-29 16:49:59 -07:00
Junping Du
c3eade44d0 YARN-7072. Add a new log aggregation file format controller. Contributed by Xuan Gong.
(cherry picked from commit 3fddabc2fe4fbdb8ef3f9ce7558955c4f0794dcc)
2017-09-29 16:49:44 -07:00
Chris Trezzo
3d23522110 YARN-7250. Update Shared cache client api to use URLs.
(cherry picked from commit c114da5e64d14b1d9e614081c4171ea0391cb1aa)
2017-09-28 15:31:23 -07:00
Andrew Wang
5a4f37019a Preparing for 3.0.0 GA development 2017-09-28 11:32:01 -07:00
Akira Ajisaka
149d3ad6ba
YARN-7153. Remove duplicated code in AMRMClientAsyncImpl.java. Contributed by Sen Zhao.
(cherry picked from commit e928ee583c5a1367e24eab34057f8d8496891452)
2017-09-26 02:04:23 +09:00
Arun Suresh
2ccfe92a4e YARN-7203. Add container ExecutionType into ContainerReport. (Botong Huang via asuresh)
(cherry picked from commit 56ef5279c1db93d03b2f1e04badbfe804f548918)
2017-09-18 15:50:39 -07:00
Junping Du
21f6aa77ab YARN-7174. Add retry logic in LogsCLI when fetch running application logs. Contributed by Xuan Gong.
(cherry picked from commit 1a84c24b0cf6674fa755403971fa57d8e412b320)
2017-09-15 15:34:30 -07:00
Robert Kanter
aa21b01fcb YARN-7146. Many RM unit tests failing with FairScheduler (rkanter)
(cherry picked from commit bb34ae955496c1aa595dc1186153d605a41f5378)
2017-09-13 15:45:28 -07:00
Haibo Chen
8ff2523687 HADOOP-14847. Remove Guava Supplier and change to java Supplier in AMRMClient and AMRMClientAysnc. (Bharat Viswanadham via Haibo Chen)
(cherry picked from commit 8edc60531fec4f4070955b3e82a78ba70ba40ec0)
2017-09-08 14:35:03 -07:00
Sunil G
dfc174b747 YARN-6600. Introduce default and max lifetime of application at LeafQueue level. Contributed by Rohith Sharma K S.
(cherry picked from commit 56d93d2e39ead89bb79c4f4096554820dc77e84b)
2017-09-08 20:06:06 +05:30
Arun Suresh
05b4abf537 YARN-6978. Add updateContainer API to NMClient. (Kartheek Muthyala via asuresh)
(cherry picked from commit c41118a7f826dcbb269b4bd3d5877b35fbbee2b1)
2017-09-07 10:28:18 -07:00
Junping Du
00594eb686 YARN-7148. TestLogsCLI fails in trunk and branch-2 and javadoc error. Contributed by Xuan Gong.
(cherry picked from commit 63231a2a3008794c5ebcbc9d3855638fc5f28216)
2017-09-06 15:01:35 -07:00
Jason Lowe
6ec611d8c1 YARN-7164. TestAMRMClientOnRMRestart fails sporadically with bind address in use. Contributed by Jason Lowe
(cherry picked from commit 704267cb4909bf9968dd30067617f74543e07ffb)
2017-09-06 15:28:45 -05:00
Varun Saxena
5323335fca YARN-7152. [ATSv2] Registering timeline client before AMRMClient service init throw exception (Rohith Sharma K S via Varun Saxena)
(cherry picked from commit ef87d34a0e96f6b6390b7086c4ea2d5b7a4c2754)
2017-09-04 20:21:08 +05:30
Junping Du
91cc070d67 YARN-6877. Create an abstract log reader for extendability. Contributed by Xuan Gong. 2017-08-31 16:41:43 -07:00
Robert Kanter
ce79f7be29 YARN-7094. Document the current known issue with server-side NM graceful decom (rkanter) 2017-08-30 18:04:55 -07:00
Jian He
08f40bcc7f MAPREDUCE-6838. [ATSv2 Security] Add timeline delegation token received in allocate response to UGI. Contributed by Varun Saxena 2017-08-30 11:29:54 +05:30
Rohith Sharma K S
7594d1de7b YARN-6130. [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM. Contributed by Varun Saxena. 2017-08-30 11:29:53 +05:30
Jian He
8201ed8009 YARN-6756. ContainerRequest#executionTypeRequest causes NPE. Contributed by Jian He 2017-08-29 20:35:53 -07:00
Wangda Tan
51881a863c YARN-7112. TestAMRMProxy is failing with invalid request. (Jason Lowe via wangda)
Change-Id: I432f4523921666ac218fcf9936f826a0d8d635e0
2017-08-28 11:37:35 -07:00
Junping Du
c2cb7ea1ef YARN-6876. Create an abstract log writer for extendability. Contributed by Xuan Gong. 2017-08-24 13:36:49 -07:00
Jason Lowe
14553061be YARN-7020. TestAMRMProxy#testAMRMProxyTokenRenewal is flakey. Contributed by Robert Kanter 2017-08-16 13:04:36 -05:00
Arun Suresh
4d7be1d857 YARN-5978. ContainerScheduler and ContainerManager changes to support ExecType update. (Kartheek Muthyala via asuresh) 2017-08-14 19:46:17 -07:00
Arun Suresh
8d3fd81980 YARN-6920. Fix resource leak that happens during container re-initialization. (asuresh) 2017-08-07 18:59:25 -07:00
Arun Suresh
35dc782923 YARN-5977. ContainerManagementProtocol changes to support change of container ExecutionType. (Kartheek Muthyala via asuresh) 2017-08-03 21:15:40 -07:00
Yufei Gu
c617fe02b3 YARN-6832. Tests use assertTrue(....equals(...)) instead of assertEquals()). (Daniel Templeton via Yufei Gu) 2017-08-03 11:33:37 -07:00
Subru Krishnan
98b45b0ed3 YARN-6093. Minor bugs with AMRMtoken renewal and state store availability when using FederationRMFailoverProxyProvider during RM failover. (Botong Huang via Subru).
(cherry picked from commit 66500f4fa6155d29435d7c92fd6d68079c4cab86)
2017-08-01 17:28:22 -07:00
Jian He
bdfad4523f YARN-3673. Create a FailoverProxy for Federation services. Contributed by Subru Krishnan
(cherry picked from commit 3307564a5f8c8abc5fe84efcd05ee0f7dfdd921c)
2017-08-01 17:28:20 -07:00
Daniel Templeton
4c40cd451c YARN-6844. AMRMClientImpl.checkNodeLabelExpression() has wrong error message
(Contributed by Manikandan R via Daniel Templeton)
2017-07-24 12:03:02 -07:00
Andrew Wang
af2773f609 Updating version for 3.0.0-beta1 development 2017-06-29 17:57:40 -07:00
Daniel Templeton
036a24bab3 MAPREDUCE-6896. Document wrong spelling in usage of MapredTestDriver tools.
(Contributed by LiXin Ge via Daniel Templeton)
2017-06-13 13:21:23 -07:00
Brahma Reddy Battula
19ef3a81f8 HADOOP-14485. Redundant 'final' modifier in try-with-resources statement. Contributed by wenxin he. 2017-06-06 23:11:47 +08:00
Andrew Wang
16ad896d5c Update maven version for 3.0.0-alpha4 development 2017-05-26 14:09:44 -07:00
Daniel Templeton
d81372dfad YARN-6646. Modifier 'static' is redundant for inner enums
(Contributed by ZhangBing Lin via Daniel Templeton)
2017-05-26 12:05:48 -07:00
Jian He
8236130b2c YARN-6306. NMClient API change for container upgrade. Contributed by Arun Suresh 2017-05-16 10:48:46 -07:00
Jason Lowe
6099deebcb YARN-6552. Increase YARN test timeouts from 1 second to 10 seconds. Contributed by Eric Badger 2017-05-10 08:47:48 -05:00
Karthik Kambatla
166be0ee95 YARN-3742. YARN RM will shut down if ZKClient creation times out. (Daniel Templeton via kasha) 2017-05-09 14:44:16 -07:00
Naganarasimha
64f68cb0b8 YARN-6520. Fix warnings from Spotbugs in hadoop-yarn-client. Contributed by Weiwei Yang. 2017-05-01 18:38:22 +05:30
Eric Payne
fdf5192bbb YARN-6536. TestAMRMClient.testAMRMClientWithSaslEncryption fails intermittently. Contributed by Jason Lowe. 2017-04-28 15:20:35 -05:00
Akira Ajisaka
8a99eba96d
Revert "YARN-5007. Remove deprecated constructors of MiniYARNCluster and MiniMRYarnCluster. Contributed by Andras Bokor."
This reverts commit 34ab8e73d48ea3c21c9e9571419b43b605de15c3.
2017-04-26 15:34:23 +09:00
Sunil G
9ff25408bc YARN-6164. Expose Queue Configurations per Node Label through YARN client api. Contributed by Benson Qiu. 2017-04-19 20:39:09 +05:30
Jason Lowe
90d97372ed YARN-6461. TestRMAdminCLI has very low test timeouts. Contributed by Eric Badger 2017-04-11 09:16:11 -05:00
Jason Lowe
1b081ca27e YARN-6288. Exceptions during aggregated log writes are mishandled. Contributed by Akira Ajisaka 2017-04-06 16:24:36 -05:00
Akira Ajisaka
34ab8e73d4
YARN-5007. Remove deprecated constructors of MiniYARNCluster and MiniMRYarnCluster. Contributed by Andras Bokor. 2017-04-05 17:33:07 +09:00