Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,489 Commits 326 Branches 371 Tags
Commit Graph

1664 Commits

Author SHA1 Message Date
Jian He
16f7ac48d4 YARN-4403. (AM/NM/Container)LivelinessMonitor should use monotonic time when calculating period. Contributed by Junping Du 2015-12-14 13:52:33 -08:00
Arun Suresh
c2e788a7b5 YARN-4358 addendum patch to fix javadoc error 
(cherry picked from commit 7fb212e5e672b3f285493f6c7b2598ef7e61406b)
 2015-12-12 22:26:35 -08:00
rohithsharmaks
5bc33c5ae4 YARN-4421. Remove dead code in RmAppImpl.RMAppRecoveredTransition. (Daniel Templeton via rohithsharmaks) 
(cherry picked from commit a5e2e1ecb06a3942903cb79f61f0f4bb02480f19)
 2015-12-09 11:35:02 +05:30
rohithsharmaks
6a6bbc51c4 YARN-4431. Not necessary to do unRegisterNM() if NM get stop due to failed to connect to RM. (Junpin Du via rohithsharmaks) 2015-12-09 11:06:31 +05:30
Chris Douglas
3d100163de YARN-4248. Followup patch adding asf-licence exclusions for json test files 
(cherry picked from commit 9f50e13d5dc329c3a6df7f9bcaf2f29b35adc52b)
(cherry picked from commit bfe4796802c8f706fdc4c393324ddb9f24194677)
 2015-12-08 12:08:53 -08:00
=
3205fe3da8 YARN-4248. REST API for submit/update/delete Reservations. (curino) 
(cherry picked from commit c25a6354598ec855bec7f695a7c3eed8794cd381)
(cherry picked from commit 4ac1564418597e2ebbaa80600eb5f002b1431281)
 2015-12-07 13:46:37 -08:00
rohithsharmaks
03e615ba55 YARN-3456. Improve handling of incomplete TimelineEntities. (Varun Saxena via rohithsharmaks) 
(cherry picked from commit 01a641bc447c464b2830d58addd482f47dbd92ae)
 2015-12-07 15:20:50 +05:30
Arun Suresh
db69c5f744 YARN-4358. Reservation System: Improve relationship between SharingPolicy and ReservationAgent. (Carlo Curino via asuresh) 
(cherry picked from commit 742632e346604fd2b263bd42367165638fcf2416)
 2015-12-05 21:35:32 -08:00
Junping Du
6af5255b02 YARN-4408. Fix issue that NodeManager still reports negative running containers. Contributed by Robert Kanter. 
(cherry picked from commit 62e9348bc10bb97a5fcb4281f7996a09d8e69c60)
(cherry picked from commit e76ba91fa58dae6750f608c0f8b86e9a43e80005)
 2015-12-03 06:39:07 -08:00
Tsuyoshi Ozawa
d76b523b02 YARN-4380. TestResourceLocalizationService.testDownloadingResourcesOnContainerKill fails intermittently. Contributed by Varun Saxena. 
(cherry picked from commit 0656d2dc83af6a48a8d8d0e37cdf1f813124f366)
 2015-11-26 01:10:41 +09:00
Jason Lowe
9e54433c6c YARN-4132. Separate configs for nodemanager to resourcemanager connection timeout and retries. Contributed by Chang Li 
(cherry picked from commit 4ac6799d4a8b071e0d367c2d709e84d8ea06942d)
 2015-11-24 22:36:19 +00:00
Tsuyoshi Ozawa
9e458c3e9e YARN-4387. Fix typo in FairScheduler log message. Contributed by Xin Wang. 
(cherry picked from commit 28dfe721b86ccbaf2ddcfb7e709b226ac766803a)
 2015-11-24 22:10:31 +09:00
Karthik Kambatla
49ed955c91 YARN-3980. Plumb resource-utilization info in node heartbeat through to the scheduler. (Inigo Goiri via kasha) 
(cherry picked from commit 52948bb20bd1446164df1d3920c46c96dad750ae)
 2015-11-24 13:52:29 +05:30
Jian He
b339a4b8d6 YARN-4349. Support CallerContext in YARN. Contributed by Wangda Tan 
(cherry picked from commit 8676a118a12165ae5a8b80a2a4596c133471ebc1)
 2015-11-23 17:20:24 -08:00
Jason Lowe
9d303edbfb YARN-4344. NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations. Contributed by Varun Vasudev 
(cherry picked from commit d36b6e045f317c94e97cb41a163aa974d161a404)
 2015-11-23 20:31:50 +00:00
Arun Suresh
cbbdbe3cdd YARN-3454. Add efficient merge operation to RLESparseResourceAllocation (Carlo Curino via asuresh) 
(cherry picked from commit da1016365aba1cee9c06771ab142d077379f27af)
 2015-11-21 10:01:10 -08:00
Wangda Tan
cdca460ad4 YARN-3769. Consider user limit when calculating total pending resource for preemption policy in Capacity Scheduler. (Eric Payne via wangda) 
(cherry picked from commit 2346fa3141bf28f25a90b6a426a1d3a3982e464f)
 2015-11-20 15:56:17 -08:00
Jason Lowe
f3bca8bc1a YARN-4374. RM capacity scheduler UI rounds user limit factor. Contributed by Chang Li 
(cherry picked from commit 060cdcbe5db56383e74e282ac61eedff8248c11b)
 2015-11-20 23:13:27 +00:00
Xuan
be65d319fa YARN-2859.addendum: fix the remaining issue from the previous patch 
(cherry picked from commit f114e728da6e19f3d35ff0cfef9fceea26aa5d46)
 2015-11-19 10:09:48 -08:00
Arun Suresh
d8e60080e9 YARN-4184. Remove update reservation state api from state store as its not used by ReservationSystem (Sean Po via asuresh) 
(cherry picked from commit 6a61928fb790d553c942641761ea963b5e996ef6)
 2015-11-17 15:51:59 -08:00
Jian He
2cf084ac76 Revert "YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan" 
This reverts commit a4ff03b200cf02a49ab81fa3c71cb707f6d2fee1.

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-11-16 20:19:31 -08:00
Junping Du
1d107d8058 YARN-4354. Public resource localization fails with NPE. Contributed by Jason Lowe. 
(cherry picked from commit 855d52927b6115e2cfbd97a94d6c1a3ddf0e94bb)
 2015-11-15 04:44:59 -08:00
Wangda Tan
13f8c7093b YARN-4347. Resource manager fails with Null pointer exception. (Jian He via wangda) 
(cherry picked from commit 7f55a18071ebe1c5591ff8a410b227c855c3f428)
 2015-11-12 11:24:04 -08:00
Wangda Tan
0c1fb15b29 YARN-4287. Capacity Scheduler: Rack Locality improvement (Nathan Roberts via wangda) 
(cherry picked from commit 796638d9bc86235b9f3e5d1a3a9a25bbf5c04d1c)
 2015-11-12 11:12:11 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
bb5dd7f772 YARN-4183. Reverting the patch to fix behaviour change. 
Revert "YARN-4183. Enabling generic application history forces every job to get a timeline service delegation token (jeagles)"

This reverts commit 42bc525acb78088ed952e92aa49408413937de86.
 2015-11-11 10:42:52 -08:00
Jian He
a4ff03b200 YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan 
(cherry picked from commit 8fbea531d7f7b665f6f55af54c8ebf330118ff37)
 2015-11-09 11:05:12 -08:00
Tsuyoshi Ozawa
1c80473a41 YARN-4320. TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no longer binds to default port 8188. Contributed by Varun Saxena. 
(cherry picked from commit ce31b22739512804da38cf87e0ce1059e3128da3)
 2015-10-30 18:00:35 +09:00
Jian He
2b197bbffd YARN-4127. RM fail with noAuth error if switched from failover to non-failover. Contributed by Varun Saxena 
(cherry picked from commit e5b1733e049dc0f1859b93618354e049a0efdc4a)
 2015-10-29 15:43:26 -07:00
Jonathan Eagles
42bc525acb YARN-4183. Enabling generic application history forces every job to get a timeline service delegation token (jeagles) 
(cherry picked from commit c293c58954cdab25c8c69418b0e839883b563fa4)
 2015-10-29 16:42:49 -05:00
Arun Suresh
8943abfb08 YARN-4310. FairScheduler: Log skipping reservation messages at DEBUG level (asuresh) 
(cherry picked from commit 58d1df585c2b8a4d2f78ae30726f07b4c6a94731)
 2015-10-29 13:43:43 -07:00
Jason Lowe
c75d8b164f YARN-2902. Killing a container that is localizing can orphan resources in the DOWNLOADING state. Contributed by Varun Saxena 
(cherry picked from commit e2267de2076245bd9857f6a30e3c731df017fef8)
 2015-10-29 16:39:55 +00:00
Rohith Sharma K S
e3fcb711d6 YARN-4130. Duplicate declaration of ApplicationId in RMAppManager#submitApplication method. (Kai Sasaki via rohithsharmaks) 
(cherry picked from commit 656c8f952738f469766ede729dc0f25a3ce4214e)
 2015-10-29 12:25:08 +05:30
Xuan
9ce5069d16 YARN-2859. ApplicationHistoryServer binds to default port 8188 in 
MiniYARNCluster. Contributed by Vinod Kumar Vavilapalli

(cherry picked from commit 27414dac66f278b61fc23762204b01a1c508178a)
 2015-10-28 10:33:56 -07:00
Tsuyoshi Ozawa
3138b43f16 YARN-3573. MiniMRYarnCluster constructor that starts the timeline server using a boolean should be marked deprecated. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 96677bef00b03057038157efeb3c2ad4702914da)
 2015-10-27 12:35:20 +09:00
Akira Ajisaka
d9156c1245 YARN-4300. [JDK8] Fix javadoc errors caused by wrong tags. (aajisaka) 
(cherry picked from commit 8a68630dd126348b859e0fbe2d14079965016772)
 2015-10-27 10:28:30 +09:00
Wangda Tan
1499af38eb YARN-3216. Max-AM-Resource-Percentage should respect node labels. (Sunil G via wangda) 
(cherry picked from commit 56e4f6237ae8b1852e82b186e08db3934f79a9db)
 2015-10-26 16:45:20 -07:00
Wangda Tan
9bf1e74171 YARN-4169. Fix racing condition of TestNodeStatusUpdaterForLabels. (Naganarasimha G R via wangda) 
(cherry picked from commit 6f606214e734d9600bc0f25a63142714f0fea633)
 2015-10-26 16:38:39 -07:00
Wangda Tan
baa2998e93 YARN-4285. Display resource usage as percentage of queue and cluster in the RM UI (Varun Vasudev via wangda) 
(cherry picked from commit 3cc73773eb26f7469c99b25a76814d6fad0be28e)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-10-26 13:12:56 -07:00
Jason Lowe
7d66e2e666 YARN-4284. condition for AM blacklisting is too narrow. Contributed by Sangjin Lee 
(cherry picked from commit 33a03af3c396097929b9cd9c790d7f52eddc13e0)
 2015-10-26 19:54:16 +00:00
Rohith Sharma K S
33455fa415 YARN-2729. Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup. (Naganarasimha G R via rohithsharmaks) 
(cherry picked from commit 5acdde4744c131e05db7b4b5f7d684fed7608b99)
 2015-10-26 15:45:22 +05:30
Tsuyoshi Ozawa
e85ebf0825 YARN-3528. Tests with 12345 as hard-coded port break jenkins. Contributed by Brahma Reddy Battula. 
Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestNodeManagerShutdown.java
 2015-10-26 17:06:46 +09:00
Allen Wittenauer
599653ad92 YARN-3724. Use POSIX nftw(3) instead of fts(3) (Alan Burlison via aw) 2015-10-25 21:43:51 -07:00
Arun Suresh
f0580dcac0 YARN-3738. Add support for recovery of reserved apps running under dynamic queues (subru via asuresh) 
(cherry picked from commit ab8eb8770c8b8bff41dacb1a399d75906abb1ac4)
 2015-10-24 22:54:45 -07:00
Akira Ajisaka
356e922632 YARN-4294. [JDK8] Fix javadoc errors caused by wrong reference and illegal tag. (aajisaka) 
(cherry picked from commit 7781fe1b9e89488b37217f81c246c1398407e47a)
 2015-10-24 11:56:37 +09:00
Jason Lowe
235e84bf3d YARN-4041. Slow delegation token renewal can severely prolong RM recovery. Contributed by Sunil G 
(cherry picked from commit d3a34a4f388155f6a7ef040e244ce7be788cd28b)
 2015-10-23 20:57:53 +00:00
Jonathan Eagles
6db7bfbcfd YARN-4009. CORS support for ResourceManager REST API. ( Varun Vasudev via jeagles) 
(cherry picked from commit f8adeb712dc834c27cec15c04a986f2f635aba83)
 2015-10-23 10:43:59 -05:00
Ming Ma
4bb7e68eb6 YARN-2913. Fair scheduler should have ability to set MaxResourceDefault for each queue. (Siqi Li via mingma) 
(cherry picked from commit 934d96a334598fcf0e5aba2043ff539469025f69)
 2015-10-23 08:37:46 -07:00
Junping Du
d5145b58f6 YARN-4243. Add retry on establishing Zookeeper conenction in EmbeddedElectorService#serviceInit. Contributed by Xuan Gong. 
(cherry picked from commit 0fce5f9a496925f0d53ea6c14318c9b513de9882)
 2015-10-22 13:42:12 -07:00
Zhihai Xu
9fe7ccc61c YARN-4256. YARN fair scheduler vcores with decimal values. Contributed by Jun Gong 
(cherry picked from commit 960201b79b9f2ca40f8eadb21a2f9fe37dde2b5d)
 2015-10-22 12:31:28 -07:00
Anubhav Dhoot
c44401f362 YARN-3739. Add reservation system recovery to RM recovery process. Contributed by Subru Krishnan. 
(cherry picked from commit 2798723a5443d04455b9d79c48d61f435ab52267)
 2015-10-22 06:52:41 -07:00