2719 Commits

Author SHA1 Message Date
Akira Ajisaka
ac0ddc4fec YARN-4298. Fix findbugs warnings in hadoop-yarn-common. Contributed by Sunil G.
(cherry picked from commit 8c0133f3d4c85733c1e0389d1ee39f1eab58c0b9)
2015-11-24 18:40:56 +09:00
Karthik Kambatla
49ed955c91 YARN-3980. Plumb resource-utilization info in node heartbeat through to the scheduler. (Inigo Goiri via kasha)
(cherry picked from commit 52948bb20bd1446164df1d3920c46c96dad750ae)
2015-11-24 13:52:29 +05:30
Jian He
b339a4b8d6 YARN-4349. Support CallerContext in YARN. Contributed by Wangda Tan
(cherry picked from commit 8676a118a12165ae5a8b80a2a4596c133471ebc1)
2015-11-23 17:20:24 -08:00
Jason Lowe
d13b646c61 Update CHANGES.txt for recent commits to branch-2.6.
(cherry picked from commit aa2009c37bc3c47035a5aea4a7449d3fe48569d4)
2015-11-23 21:58:57 +00:00
Jason Lowe
9d303edbfb YARN-4344. NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations. Contributed by Varun Vasudev
(cherry picked from commit d36b6e045f317c94e97cb41a163aa974d161a404)
2015-11-23 20:31:50 +00:00
Arun Suresh
cbbdbe3cdd YARN-3454. Add efficient merge operation to RLESparseResourceAllocation (Carlo Curino via asuresh)
(cherry picked from commit da1016365aba1cee9c06771ab142d077379f27af)
2015-11-21 10:01:10 -08:00
Wangda Tan
08727287de move YARN-4326/YARN-3849 from 2.8.0 to 2.7.3 2015-11-20 16:42:11 -08:00
Wangda Tan
cdca460ad4 YARN-3769. Consider user limit when calculating total pending resource for preemption policy in Capacity Scheduler. (Eric Payne via wangda)
(cherry picked from commit 2346fa3141bf28f25a90b6a426a1d3a3982e464f)
2015-11-20 15:56:17 -08:00
Jason Lowe
f3bca8bc1a YARN-4374. RM capacity scheduler UI rounds user limit factor. Contributed by Chang Li
(cherry picked from commit 060cdcbe5db56383e74e282ac61eedff8248c11b)
2015-11-20 23:13:27 +00:00
Xuan
8347b1048d YARN-2859 addendum: move the entry from 2.6.2 to 2.6.3 in hadoop-yarn/CHANGES.txt.
(cherry picked from commit 866dce4e8e105d0e2c7e041b5d30213536a61702)
2015-11-19 10:17:20 -08:00
Xuan
be65d319fa YARN-2859.addendum: fix the remaining issue from the previous patch
(cherry picked from commit f114e728da6e19f3d35ff0cfef9fceea26aa5d46)
2015-11-19 10:09:48 -08:00
Wangda Tan
3504d0e795 move fix version of YARN-4287 from 2.8.0 to 2.7.3 2015-11-18 14:01:02 -08:00
Karthik Kambatla
d3f9508096 YARN-4367. SLS webapp doesn't load. (kasha) 2015-11-18 13:45:00 -08:00
Steve Loughran
a0b3e43a6d YARN-4279. Mark ApplicationId and ApplicationAttemptId static methods as @Public, @Unstable. (stevel) 2015-11-18 21:41:24 +00:00
Arun Suresh
d8e60080e9 YARN-4184. Remove update reservation state api from state store as its not used by ReservationSystem (Sean Po via asuresh)
(cherry picked from commit 6a61928fb790d553c942641761ea963b5e996ef6)
2015-11-17 15:51:59 -08:00
Jian He
2cf084ac76 Revert "YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan"
This reverts commit a4ff03b200cf02a49ab81fa3c71cb707f6d2fee1.

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2015-11-16 20:19:31 -08:00
Junping Du
1d107d8058 YARN-4354. Public resource localization fails with NPE. Contributed by Jason Lowe.
(cherry picked from commit 855d52927b6115e2cfbd97a94d6c1a3ddf0e94bb)
2015-11-15 04:44:59 -08:00
Wangda Tan
875aec3177 YARN-1509. Make AMRMClient support send increase container request and get increased/decreased containers. (Meng Ding via wangda)
(cherry picked from commit 7ff280fca9af45b98cee2336e78803da46b0f8a5)
2015-11-12 11:50:41 -08:00
Wangda Tan
13f8c7093b YARN-4347. Resource manager fails with Null pointer exception. (Jian He via wangda)
(cherry picked from commit 7f55a18071ebe1c5591ff8a410b227c855c3f428)
2015-11-12 11:24:04 -08:00
Wangda Tan
0c1fb15b29 YARN-4287. Capacity Scheduler: Rack Locality improvement (Nathan Roberts via wangda)
(cherry picked from commit 796638d9bc86235b9f3e5d1a3a9a25bbf5c04d1c)
2015-11-12 11:12:11 -08:00
Jason Lowe
9050078005 YARN-4345. yarn rmadmin -updateNodeResource doesn't work. Contributed by Junping Du
(cherry picked from commit 06a70311b90a7bc676af86e778ec7bcd8dd6ea82)
2015-11-12 14:49:55 +00:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
bb5dd7f772 YARN-4183. Reverting the patch to fix behaviour change.
Revert "YARN-4183. Enabling generic application history forces every job to get a timeline service delegation token (jeagles)"

This reverts commit 42bc525acb78088ed952e92aa49408413937de86.
2015-11-11 10:42:52 -08:00
Akira Ajisaka
f6f128c867 YARN-4241. Fix typo of property name in yarn-default.xml. Contributed by Anthony Rojas.
(cherry picked from commit 23d0db551cc63def9acbab2473e58fb1c52f85e0)
2015-11-11 16:13:50 +09:00
Wangda Tan
8a8ac50a5b YARN-1510. Make NMClient support change container resources. (Meng Ding via wangda)
(cherry picked from commit c99925d6dd0235f0d27536f0bebd129e435688fb)
2015-11-10 13:17:23 -08:00
Vinod Kumar Vavilapalli
b742ea7fe6 HADOOP-12451. Setting HADOOP_HOME explicitly should be allowed. Fixing bugs in
the first patch committed. (Karthik Kambatla via vinodkv)
2015-11-10 12:16:52 -08:00
Jian He
a4ff03b200 YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan
(cherry picked from commit 8fbea531d7f7b665f6f55af54c8ebf330118ff37)
2015-11-09 11:05:12 -08:00
Jason Lowe
8334d86472 Add 2.7.3 release to CHANGES.txt
(cherry picked from commit 0383a3973b3b734fb23c331a2256dc92cff05365)
2015-11-04 16:27:28 +00:00
Wangda Tan
3190446df9 YARN-4326. Fix TestDistributedShell timeout as AHS in MiniYarnCluster no longer binds to default port 8188. (Meng Ding via wangda)
(cherry picked from commit 0783184f4b3f669f7211e42b395b62d63144100d)
2015-11-03 11:36:11 -08:00
Sangjin Lee
b2d6ea5e18 Updated the 2.6.2 final release date.
(cherry picked from commit a4a6b5b4b470b1e7a3c5e2d38433429c455bc709)
2015-10-30 18:49:21 -07:00
Jason Lowe
8dce482f61 Creating 2.6.3 entries in CHANGES.txt files.
(cherry picked from commit eadf7b3096cb010eb7f0afd9afd4ae0d67b2645f)
2015-10-30 14:52:06 +00:00
Tsuyoshi Ozawa
1c80473a41 YARN-4320. TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no longer binds to default port 8188. Contributed by Varun Saxena.
(cherry picked from commit ce31b22739512804da38cf87e0ce1059e3128da3)
2015-10-30 18:00:35 +09:00
Tsuyoshi Ozawa
dd144035a0 Add an entry of YARN-4312 to CHANGES.txt
(cherry picked from commit d21214ce33cb176926aa3ae5a9f4efe00f66480b)
2015-10-30 17:57:29 +09:00
Tsuyoshi Ozawa
c522a9ffc2 Move YARN-3580 in CHANGES.txt from 2.8 to 2.7.2.
(cherry picked from commit d2e01f4ed87c3c41156ec9a68855f923f8c0adf9)
2015-10-30 15:51:04 +09:00
Xuan
b505bf9e58 YARN-4313. Race condition in MiniMRYarnCluster when getting history
server address. Contributed by Jian He

(cherry picked from commit 7412ff48eeb967c972c19c1370c77a41c5b3b81f)
2015-10-29 17:37:24 -07:00
Jian He
2b197bbffd YARN-4127. RM fail with noAuth error if switched from failover to non-failover. Contributed by Varun Saxena
(cherry picked from commit e5b1733e049dc0f1859b93618354e049a0efdc4a)
2015-10-29 15:43:26 -07:00
Jonathan Eagles
42bc525acb YARN-4183. Enabling generic application history forces every job to get a timeline service delegation token (jeagles)
(cherry picked from commit c293c58954cdab25c8c69418b0e839883b563fa4)
2015-10-29 16:42:49 -05:00
Arun Suresh
8943abfb08 YARN-4310. FairScheduler: Log skipping reservation messages at DEBUG level (asuresh)
(cherry picked from commit 58d1df585c2b8a4d2f78ae30726f07b4c6a94731)
2015-10-29 13:43:43 -07:00
Jason Lowe
c75d8b164f YARN-2902. Killing a container that is localizing can orphan resources in the DOWNLOADING state. Contributed by Varun Saxena
(cherry picked from commit e2267de2076245bd9857f6a30e3c731df017fef8)
2015-10-29 16:39:55 +00:00
Jian He
7d109ef5b5 YARN-4288. Fixed RMProxy to retry on IOException from local host. Contributed by Junping Du
(cherry picked from commit c41699965e78ce5e87669d17923ab84e494c4188)
2015-10-29 00:01:20 -07:00
Rohith Sharma K S
e3fcb711d6 YARN-4130. Duplicate declaration of ApplicationId in RMAppManager#submitApplication method. (Kai Sasaki via rohithsharmaks)
(cherry picked from commit 656c8f952738f469766ede729dc0f25a3ce4214e)
2015-10-29 12:25:08 +05:30
Sangjin Lee
16db203a83 Set the release date for 2.6.2 2015-10-28 20:48:49 -07:00
Xuan
9ce5069d16 YARN-2859. ApplicationHistoryServer binds to default port 8188 in
MiniYARNCluster. Contributed by Vinod Kumar Vavilapalli

(cherry picked from commit 27414dac66f278b61fc23762204b01a1c508178a)
2015-10-28 10:33:56 -07:00
Tsuyoshi Ozawa
d29bff86c4 YARN-4251. TestAMRMClientOnRMRestart#testAMRMClientOnAMRMTokenRollOverOnRMRestart is failing. Contributed by Brahma Reddy Battula.
(cherry picked from commit 9f4dfdf4eb60cc6b13da586dabcd95bd77fc783c)
2015-10-28 17:39:26 +09:00
Varun Vasudev
c5bf1cb7af YARN-4302. SLS not able start due to NPE in SchedulerApplicationAttempt. Contributed by Bibin A Chundatt.
(cherry picked from commit c28e16b40caf1e22f72cf2214ebc2fe2eaca4d03)
2015-10-27 20:56:45 +05:30
Tsuyoshi Ozawa
3138b43f16 YARN-3573. MiniMRYarnCluster constructor that starts the timeline server using a boolean should be marked deprecated. Contributed by Brahma Reddy Battula.
(cherry picked from commit 96677bef00b03057038157efeb3c2ad4702914da)
2015-10-27 12:35:20 +09:00
Akira Ajisaka
d9156c1245 YARN-4300. [JDK8] Fix javadoc errors caused by wrong tags. (aajisaka)
(cherry picked from commit 8a68630dd126348b859e0fbe2d14079965016772)
2015-10-27 10:28:30 +09:00
Wangda Tan
1499af38eb YARN-3216. Max-AM-Resource-Percentage should respect node labels. (Sunil G via wangda)
(cherry picked from commit 56e4f6237ae8b1852e82b186e08db3934f79a9db)
2015-10-26 16:45:20 -07:00
Wangda Tan
9bf1e74171 YARN-4169. Fix racing condition of TestNodeStatusUpdaterForLabels. (Naganarasimha G R via wangda)
(cherry picked from commit 6f606214e734d9600bc0f25a63142714f0fea633)
2015-10-26 16:38:39 -07:00
Wangda Tan
baa2998e93 YARN-4285. Display resource usage as percentage of queue and cluster in the RM UI (Varun Vasudev via wangda)
(cherry picked from commit 3cc73773eb26f7469c99b25a76814d6fad0be28e)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2015-10-26 13:12:56 -07:00
Jason Lowe
7d66e2e666 YARN-4284. condition for AM blacklisting is too narrow. Contributed by Sangjin Lee
(cherry picked from commit 33a03af3c396097929b9cd9c790d7f52eddc13e0)
2015-10-26 19:54:16 +00:00