Junping Du
86800b30a9
Add COMMON/MAPREDUCE/YARN jdiff of 2.8.0 release.
...
(cherry picked from commit 6df029db36
)
(cherry picked from commit 3ad4d37363
)
2017-03-25 14:34:55 -07:00
Xuan
e0401e0781
YARN-4559. Make leader elector and zk store share the same curator
...
client. Contributed by Jian He
(cherry picked from commit 890a2ebd1a
)
(cherry picked from commit be3322792f
)
2016-12-20 16:15:59 -08:00
Wangda Tan
69f91d8c48
HADOOP-13544. JDiff reports unncessarily show unannotated APIs and cause confusion while our javadocs only show annotated and public APIs. (vinodkv via wangda)
...
(cherry picked from commit 875062b5bc
)
(cherry picked from commit 269401dc83
)
2016-09-27 11:46:49 -07:00
Wangda Tan
9436548152
YARN-3426. Add jdiff support to YARN. (vinodkv via wangda)
2016-06-10 09:56:18 -07:00
Jian He
e45799a61b
YARN-4617. LeafQueue#pendingOrderingPolicy should always use fixed ordering policy instead of using same as active applications ordering policy. Contributed by Rohith Sharma K S
...
(cherry picked from commit f4a57d4a53
)
2016-01-29 12:23:02 -08:00
Jian He
e73bf71e10
YARN-4537. Pull out priority comparison from fifocomparator and use compound comparator for FifoOrdering policy. Contributed by Rohith Sharma K S
...
(cherry picked from commit b8942be888
)
2016-01-11 16:45:48 -08:00
Jian He
17d29b515f
YARN-4479. Change CS LeafQueue pendingOrderingPolicy to hornor recovered apps. Contributed by Rohith Sharma K S
...
(cherry picked from commit 109e528ef5
)
2016-01-08 15:52:03 -08:00
Wangda Tan
c4b1386b4e
YARN-4225. Add preemption status to yarn queue -status for capacity scheduler. (Eric Payne via wangda)
...
(cherry picked from commit 7faa406f27
)
(cherry picked from commit 2f5435acbd
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2015-12-18 16:34:45 -08:00
Rohith Sharma K S
06ecc37e82
YARN-4223. Fixed findbugs warnings in hadoop-yarn-server-nodemanager project. (varun saxena via rohithsharmaks)
...
(cherry picked from commit 092883b34a
)
2015-10-26 15:26:08 +05:30
Wangda Tan
9692bcc2c8
YARN-3319. Implement a FairOrderingPolicy. (Craig Welch via wangda)
...
(cherry picked from commit 395205444e
)
2015-04-23 10:48:00 -07:00
Jian He
6f70f1b1af
YARN-3136. Fixed a synchronization problem of AbstractYarnScheduler#getTransferredContainers. Contributed by Sunil G
...
(cherry picked from commit 497c86b485
)
2015-04-18 12:47:30 -07:00
Jian He
57eb07d34b
YARN-2696. Queue sorting in CapacityScheduler should consider node label. Contributed by Wangda Tan
...
(cherry picked from commit d573f09fb9
)
2015-04-17 13:37:34 -07:00
Wangda Tan
89a7c98436
YARN-3318. Create Initial OrderingPolicy Framework and FifoOrderingPolicy. (Craig Welch via wangda)
...
(cherry picked from commit 5004e75332
)
2015-04-15 09:57:52 -07:00
Wangda Tan
5f59e621ba
YARN-2901 addendum: Fixed findbugs warning caused by previously patch
...
(cherry picked from commit ba9ee22ca4
)
2015-04-08 11:02:54 -07:00
Karthik Kambatla
1e77d92d62
Revert "YARN-3181. FairScheduler: Fix up outdated findbugs issues. (kasha)"
...
This reverts commit c2b185def8
.
(cherry picked from commit 32b4330456
)
2015-03-17 12:31:44 -07:00
Jian He
a5f3fb4dc1
YARN-1809. Synchronize RM and TimeLineServer Web-UIs. Contributed by Zhijie Shen and Xuan Gong
...
(cherry picked from commit 95bfd087dc
)
2015-03-05 21:27:03 -08:00
Wangda Tan
0a502c665b
YARN-3272. Surface container locality info in RM web UI (Jian He via wangda)
...
(cherry picked from commit e17e5ba9d7
)
2015-03-03 11:49:45 -08:00
Karthik Kambatla
fcfbdf6440
YARN-3181. FairScheduler: Fix up outdated findbugs issues. (kasha)
...
(cherry picked from commit c2b185def8
)
2015-02-12 15:39:50 -08:00
Jian He
1be2d64ddd
YARN-3124. Fixed CS LeafQueue/ParentQueue to use QueueCapacities to track capacities-by-label. Contributed by Wangda Tan
...
(cherry picked from commit 18a594257e
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2015-02-12 15:01:14 -08:00
Jian He
4931600030
YARN-2637. Fixed max-am-resource-percent calculation in CapacityScheduler when activating applications. Contributed by Craig Welch
...
(cherry picked from commit c53420f583
)
2015-01-13 17:32:36 -08:00
Zhijie Shen
e5cb52ec1f
YARN-2938. Fixed new findbugs warnings in hadoop-yarn-resourcemanager and hadoop-yarn-applicationhistoryservice. Contributed by Varun Saxena.
...
(cherry picked from commit 241d3b3a50
)
2014-12-29 10:07:54 -08:00
Zhijie Shen
f02bd6683a
YARN-2937. Fixed new findbugs warnings in hadoop-yarn-nodemanager. Contributed by Varun Saxena.
...
(cherry picked from commit 41a548a916
)
2014-12-23 20:35:32 -08:00
Jian He
e3a54b1b8b
YARN-2837. Support TimeLine server to recover delegation token when restarting. Contributed by Zhijie Shen
...
(cherry picked from commit 149512a837
)
2014-12-23 18:26:37 -08:00
Junping Du
6f252f7f36
YARN-2939. Fix new findbugs warnings in hadoop-yarn-common. (Li Lu via junping_du)
...
(cherry picked from commit a696fbb001
)
2014-12-22 03:08:25 -08:00
Vinod Kumar Vavilapalli
d5d2905262
YARN-2824. Fixed Capacity Scheduler to not crash when some node-labels are not mapped to queues by making default capacities per label to be zero. Contributed by Wangda Tan.
...
(cherry picked from commit 2ac1be7dec
)
2014-11-07 10:44:25 -08:00
Vinod Kumar Vavilapalli
e8e3a36213
YARN-2496. Enhanced Capacity Scheduler to have basic support for allocating resources based on node-labels. Contributed by Wangda Tan.
...
YARN-2500. Ehnaced ResourceManager to support schedulers allocating resources based on node-labels. Contributed by Wangda Tan.
(cherry picked from commit f2ea555ac6
)
2014-10-15 18:34:19 -07:00
Steve Loughran
d218ab58fc
YARN-913 service registry: YARN-2652 add hadoop-yarn-registry package under hadoop-yarn
2014-10-08 12:55:47 -07:00
Jason Lowe
4f6a367166
YARN-1769. CapacityScheduler: Improve reservations. Contributed by Thomas Graves
...
(cherry picked from commit 9c22065109
)
2014-09-29 14:13:21 +00:00
Jason Darrell Lowe
23b4c0b6c1
HADOOP-10893. isolated classloader on the client side. Contributed by Sangjin Lee
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1619605 13f79535-47bb-0310-9956-ffa450edef68
2014-08-21 21:41:24 +00:00
Karthik Kambatla
a0bf22947d
YARN-2352. FairScheduler: Collect metrics on duration of critical methods that affect performance. (kasha)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1616785 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 14:40:46 +00:00
Sanford Ryza
aeb12ce4bf
YARN-2313. Livelock can occur in FairScheduler when there are lots of running apps (Tsuyoshi Ozawa via Sandy Ryza)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1612770 13f79535-47bb-0310-9956-ffa450edef68
2014-07-23 05:01:35 +00:00
Karthik Kambatla
233ca3e2a5
YARN-2122. In AllocationFileLoaderService, the reloadThread should be created in init() and started in start(). (Robert Kanter via kasha)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1601046 13f79535-47bb-0310-9956-ffa450edef68
2014-06-07 00:51:50 +00:00
Vinod Kumar Vavilapalli
38b14291e9
YARN-2017. Merged some of the common scheduler code. Contributed by Jian He.
...
svn merge --ignore-ancestry -c 1596753 ../../trunk/
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1596754 13f79535-47bb-0310-9956-ffa450edef68
2014-05-22 05:33:00 +00:00
Vinod Kumar Vavilapalli
0c6db6af6e
YARN-1512. Enhanced CapacityScheduler to be able to decouple scheduling from node-heartbeats. Contributed by Arun C Murthy.
...
svn merge --ignore-ancestry -c 1578722 ../../trunk/
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1578724 13f79535-47bb-0310-9956-ffa450edef68
2014-03-18 02:53:50 +00:00
Vinod Kumar Vavilapalli
3cd8219519
YARN-1459. Changed ResourceManager to depend its service initialization on the configuration-provider mechanism during startup too. Contributed by Xuan Gong.
...
svn merge --ignore-ancestry -c 1566791 ../../trunk/
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1566793 13f79535-47bb-0310-9956-ffa450edef68
2014-02-10 22:51:30 +00:00
Karthik Kambatla
db2afa8bae
YARN-1559. Race between ServerRMProxy and ClientRMProxy setting RMProxy#INSTANCE. (kasha and vinodkv via kasha)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1555971 13f79535-47bb-0310-9956-ffa450edef68
2014-01-06 18:43:09 +00:00
Vinod Kumar Vavilapalli
237310d89a
YARN-1028. Added FailoverProxyProvider capability to ResourceManager to help with RM failover. Contributed by Karthik Kambatla.
...
svn merge --ignore-ancestry -c 1551739 ../../trunk/
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1551740 13f79535-47bb-0310-9956-ffa450edef68
2013-12-17 22:33:16 +00:00
Vinod Kumar Vavilapalli
45bfbbbabe
YARN-895. Changed RM state-store to not crash immediately if RM restarts while the state-store is down. Contributed by Jian He.
...
svn merge --ignore-ancestry -c 1547538 ../../trunk/
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1547539 13f79535-47bb-0310-9956-ffa450edef68
2013-12-03 19:28:42 +00:00
Bikas Saha
63115de6fd
Merging r1541995 from trunk to branch-2 for YARN-1222. Make improvements in ZKRMStateStore for fencing (Karthik Kambatla via bikas)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1542026 13f79535-47bb-0310-9956-ffa450edef68
2013-11-14 19:09:40 +00:00
Vinod Kumar Vavilapalli
f487f4eb19
YARN-926. Modified ContainerManagerProtcol APIs to take in requests for multiple containers. Contributed by Jian He.
...
MAPREDUCE-5412. Update MR app to use multiple containers API of ContainerManager after YARN-926. Contributed by Jian He.
svn merge --ignore-ancestry -c 1506391 ../../trunk/
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1506392 13f79535-47bb-0310-9956-ffa450edef68
2013-07-24 03:42:52 +00:00
Vinod Kumar Vavilapalli
10e4f3b4bd
YARN-853. Fixed CapacityScheduler's maximum-am-resource-percent to properly work beyond refreshing queues. Contributed by Devaraj K.
...
svn merge --ignore-ancestry -c 1505855 ../../trunk/
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1505856 13f79535-47bb-0310-9956-ffa450edef68
2013-07-22 23:50:54 +00:00
Vinod Kumar Vavilapalli
903f0fea8e
YARN-530. Defined Service model strictly, implemented AbstractService for robust subclassing and migrated yarn-common services. Contributed by Steve Loughran.
...
YARN-117. Migrated rest of YARN to the new service model. Contributed by Steve Louhran.
MAPREDUCE-5298. Moved MapReduce services to YARN-530 stricter lifecycle. Contributed by Steve Loughran.
svn merge --ignore-ancestry -c 1492718 ../../trunk/
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1492720 13f79535-47bb-0310-9956-ffa450edef68
2013-06-13 15:56:44 +00:00
Vinod Kumar Vavilapalli
2594db460f
YARN-634. Modified YarnRemoteException to be not backed by PB and introduced a separate SerializedException record. Contributed by Siddharth Seth.
...
MAPREDUCE-5239. Updated MR App to reflect YarnRemoteException changes after YARN-634. Contributed by Siddharth Seth.
svn merge --ignore-ancestry -c 1481205 ../../trunk/
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1481209 13f79535-47bb-0310-9956-ffa450edef68
2013-05-10 21:51:32 +00:00
Vinod Kumar Vavilapalli
d6f8a7f7ee
YARN-539. Addressed memory leak of LocalResource objects NM when a resource localization fails. Contributed by Omkar Vinit Joshi.
...
svn merge --ignore-ancestry -c 1466756 ../../trunk/
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1466757 13f79535-47bb-0310-9956-ffa450edef68
2013-04-11 02:08:49 +00:00
Vinod Kumar Vavilapalli
8565f5f81d
YARN-467. Modify public distributed cache to localize files such that no local directory hits unix file count limits and thus prevent job failures. Contributed by Omkar Vinit Joshi.
...
svn merge --ignore-ancestry -c 1463823 ../../trunk/
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1463824 13f79535-47bb-0310-9956-ffa450edef68
2013-04-03 05:01:35 +00:00
Siddharth Seth
035d367933
merge YARN-383 from trunk. AMRMClientImpl should handle null rmClient in stop(). Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1443700 13f79535-47bb-0310-9956-ffa450edef68
2013-02-07 20:22:34 +00:00
Arun Murthy
0c2206db70
Merge -c 1423706 from trunk to branch-2 to fix YARN-3. Add support for CPU isolation/monitoring of containers. Contributed by Andrew Ferguson.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1443010 13f79535-47bb-0310-9956-ffa450edef68
2013-02-06 15:17:57 +00:00
Siddharth Seth
992ba4c79c
merge YARN-360 from trunk. Allow apps to concurrently register tokens for renewal. Contributed by Daryn Sharp.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1442442 13f79535-47bb-0310-9956-ffa450edef68
2013-02-05 00:27:36 +00:00
Alejandro Abdelnur
94c43d250e
YARN-184. Remove unnecessary locking in fair scheduler, and address findbugs excludes. (sandyr via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1410830 13f79535-47bb-0310-9956-ffa450edef68
2012-11-18 05:46:29 +00:00
Arun Murthy
92a99de731
Merge -c 1370666 from trunk to branch-2 to fix YARN-1. Promote YARN to be a sub-project of Apache Hadoop.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1370667 13f79535-47bb-0310-9956-ffa450edef68
2012-08-08 05:33:56 +00:00