Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,110 Commits 326 Branches 371 Tags
Commit Graph

17110 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Haibo Chen
175c4472d5 YARN-6546. SLS is slow while loading 10k queues. (Yufei Gu via Haibo Chen) 
(cherry picked from commit 46eb1033a86ca53e7b94202567aef8af2417bdf8)
 2017-10-17 16:04:49 -07:00
Lei Xu
6959db9c20 HDFS-12612. DFSStripedOutputStream.close will throw if called a second time with a failed streamer. (Lei (Eddy) Xu) 2017-10-17 15:53:07 -07:00
Subru Krishnan
81a86860bf YARN-7311. Fix TestRMWebServicesReservation parametrization for fair scheduler. (Yufei Gu via Subru). 
(cherry picked from commit 75323394fbc4211596a2c8fbb5e584f3183f742f)
 2017-10-17 12:39:40 -07:00
Haibo Chen
5334deb089 YARN-7341. TestRouterWebServiceUtil#testMergeMetrics is flakey. (Robert Kanter via Haibo Chen) 
(cherry picked from commit acabc657ff5433f36ce1b238cecd3a3b5bbe87ae)
 2017-10-17 10:26:02 -07:00
Lei Xu
cdfcd384b2 HDFS-12613. Native EC coder should implement release() as idempotent function. (Lei (Eddy) Xu) 
(cherry picked from commit 31ebccc96238136560f4210bdf6766fe18e0650c)
 2017-10-16 19:46:26 -07:00
Robert Kanter
a9cbfb0398 HADOOP-14938. Configuration.updatingResource map should be initialized lazily (misha@cloudera.com via rkanter) 2017-10-16 16:39:25 -07:00
Robert Kanter
6971699099 YARN-7308. TestApplicationACLs fails with FairScheduler (rkanter) 
(cherry picked from commit 8a615259281511de639c1f9aa719a842e34a523f)
 2017-10-16 15:34:50 -07:00
Nathan Roberts
a809ce8f50 YARN-7333. container-executor fails to remove entries from a directory that is not writable or executable. Contributed by Jason Lowe. 
(cherry picked from commit 8620140a6a3ec0117675ede06d92d830da3da551)
 2017-10-16 16:41:42 -05:00
Xiao Chen
23ec4a788a HADOOP-14949. TestKMS#testACLs fails intermittently. 
(cherry picked from commit 152317d40ece8abfa76fb5bd29f04878c1b0d3d8)
 2017-10-16 14:19:44 -07:00
Junping Du
26da4045aa YARN-7124. LogAggregationTFileController deletes/renames while file is open. Contributed by Jason Lowe. 
(cherry picked from commit 1fcbe7cf5f2f7c609cd4158912f151848268ca9e)
 2017-10-16 13:57:41 -07:00
Arun Suresh
2fdffbd8c7 YARN-7275. NM Statestore cleanup for Container updates. (Kartheek Muthyala via asuresh) 
(cherry picked from commit a50be1b8f432f50c940b66d12c7de87b95ea47c0)
 2017-10-16 13:23:58 -07:00
Xiao Chen
7c00d66118 HDFS-12642. Log block and datanode details in BlockRecoveryWorker. 
(cherry picked from commit 971b3ca1acc15d9a1f8e774291813dafd16ef704)
 2017-10-16 10:34:15 -07:00
Xiao Chen
ca1271e218 HDFS-12637. Extend TestDistributedFileSystemWithECFile with a random EC policy. Contributed by Takanobu Asanuma. 
(cherry picked from commit f57e5aae77a004ac9a8d548cf7fa2669e3642f30)
 2017-10-16 09:55:31 -07:00
Xiao Chen
77ef810552 HDFS-12603. Enable async edit logging by default. Contributed by Andrew Wang. 
(cherry picked from commit d0311dfc5fe92a0e0f3fb8ae92e412edce609740)
 2017-10-16 09:51:19 -07:00
Xiao Chen
66847c27db HDFS-12659. Update TestDeadDatanode#testNonDFSUsedONDeadNodeReReg to increase heartbeat recheck interval. Contributed by Ajay Kumar. 
(cherry picked from commit 11a7729c1474aa379a62c0440c8c1a11be261a75)
 2017-10-15 19:28:30 -07:00
Wangda Tan
41e8ed7e98 Addendum fix for: YARN-7269. Tracking URL in the app state does not get redirected to ApplicationMaster for Running applications. (Wangda Tan) 
Change-Id: If1fe4a62e07b25e6f1b8ba803495da87e2cb2df6
(cherry picked from commit 87ea1dff9c431fb88e064e497b35fc17c65f1d53)
 2017-10-14 10:45:12 -07:00
Haibo Chen
1134060678 YARN-7310. TestAMRMProxy#testAMRMProxyE2E fails with FairScheduler. (Robert Kanter via Haibo Chen) 
(cherry picked from commit 3fb47188867124bf18fb798b460928b3557ab9a1)
 2017-10-13 15:52:09 -07:00
Arpit Agarwal
4d19e39fd7 HDFS-12553. Add nameServiceId to QJournalProtocol. Contributed by Bharat Viswanadham 2017-10-13 14:53:45 -07:00
Robert Kanter
b7cef4e934 YARN-7309. TestClientRMService#testUpdateApplicationPriorityRequest and TestClientRMService#testUpdatePriorityAndKillAppWithZeroClusterResource test functionality not supported by FairScheduler (rkanter) 
(cherry picked from commit ec8bf9e48ac4dc675516a57c06a29890b5138548)
 2017-10-13 13:57:40 -07:00
Yufei Gu
dbf6c48af9 YARN-7270. Fix unsafe casting from long to int for class Resource and its sub-classes. (Yufei) 
(cherry picked from commit 7a27c2c367518e1bf6ee393391a2f9b412113819)
 2017-10-13 13:06:16 -07:00
Akira Ajisaka
24ac7c6e79
Revert "HADOOP-13514. Upgrade maven surefire plugin to 2.19.1." 
This reverts commit 372997f3954e97200220ebb3117eed4a175f101c.
 2017-10-13 18:01:50 +09:00
Chris Trezzo
24b03eb79f MAPREDUCE-5951. Add support for the YARN Shared Cache. 
(cherry picked from commit e46d5bb962b0c942f993afc505b165b1cd96e51b)
 2017-10-12 11:15:46 -07:00
Carlo Curino
97b7d39a5f YARN-7317. Fix overallocation resulted from ceiling in LocalityMulticastAMRMProxyPolicy. (contributed by Botong Huang via curino) 
(cherry picked from commit 13fcfb3d46ee7a0d606b4bb221d1cd66ef2a5a7c)
 2017-10-12 10:40:44 -07:00
Anu Engineer
beb54e5279 HADOOP-13102. Update GroupsMapping documentation to reflect the new changes. Contributed by Esther Kundin. 
(cherry picked from commit 075358eb6fff5ae4a40ac4dfde292e2a9a4ceddf)
 2017-10-11 16:24:08 -07:00
Arun Suresh
52844ec0a1 HADOOP-13556. Change Configuration.getPropsWithPrefix to use getProps instead of iterator. (Larry McCay via asuresh) 
(cherry picked from commit b6c2c9058e83116dcca46cd6934db3428f931347)
 2017-10-11 15:22:18 -07:00
Arpit Agarwal
0a673f1539 HDFS-12599. Remove Mockito dependency from DataNodeTestUtils. Contributed by Ted Yu. 
(cherry picked from commit 09ad848b6484c4d36b2d59903f9ec370fdb18d3e)
 2017-10-11 15:31:39 -05:00
Jason Lowe
44f8b2a630 YARN-7082. TestContainerManagerSecurity failing in trunk. Contributed by Akira Ajisaka 
(cherry picked from commit ebb34c7053ee93296412591f83a776846765fda5)
 2017-10-11 10:32:23 -05:00
Kai Zheng
8947c0b881 HDFS-12635. Unnecessary exception declaration of the CellBuffers constructor. Contributed by Huafeng Wang 2017-10-11 15:47:00 +08:00
Akira Ajisaka
372997f395
HADOOP-13514. Upgrade maven surefire plugin to 2.19.1. 
(cherry picked from commit 3d04c00aed63ca49420210f5f34efe39897aae63)
 2017-10-11 10:44:29 +09:00
Andrew Wang
a26da9dcf2 HDFS-12547. Extend TestQuotaWithStripedBlocks with a random EC policy. Contributed by Takanobu Asanuma. 
(cherry picked from commit a297fb08866305860dc17813c3db5701e9515101)
 2017-10-10 17:35:56 -07:00
Jason Lowe
c0d56cad5c HADOOP-14912. FairCallQueue may defer servicing calls. Contributed by Daryn Sharp 
(cherry picked from commit 1123f8f0b62292197f5433cd40e66d8620044608)
 2017-10-10 14:49:15 -05:00
Andrew Wang
61ac7c82f2 HADOOP-14939. Update project release notes with HDFS-10467 for 3.0.0. Contributed by Inigo Goiri. 
(cherry picked from commit 132cdac0ddb5c38205a96579a23b55689ea5a8e3)
 2017-10-10 10:16:39 -07:00
Andrew Wang
f1cfb2a8dc Revert "HDFS-12603. Enable async edit logging by default." 
This reverts commit e9f3f49b6dabca540ce48a633c1767fbdb49b6da.
 2017-10-09 17:54:19 -07:00
Xuan
fa676ba06b Merge branch 'YARN-5734-branch-3.0' into branch-3.0. (xgong) 2017-10-09 15:00:48 -07:00
Jonathan Hung
043a217017 YARN-7252. Removing queue then failing over results in exception 2017-10-09 14:54:57 -07:00
Jonathan Hung
168a3df8e6 YARN-7251. Misc changes to YARN-5734 2017-10-09 14:54:57 -07:00
Jonathan Hung
d35f544020 YARN-7238. Documentation for API based scheduler configuration management 2017-10-09 14:54:56 -07:00
Jonathan Hung
5105bc4721 YARN-7046. Add closing logic to configuration store 2017-10-09 14:54:56 -07:00
Wangda Tan
e6827a9121 YARN-6840. Implement zookeeper based store for scheduler configuration updates. (Jonathan Hung via wangda) 
Change-Id: I9debea674fe8c7e4109d4ca136965a1ea4c48bcc
 2017-10-09 14:54:56 -07:00
Xuan
4bf38062a5 YARN-7024: Fix issues on recovery in LevelDB store. Contributed by Jonathan Hung 2017-10-09 14:54:56 -07:00
Xuan
0b546420da YARN-6322: Disable queue refresh when configuration mutation is enabled. Contributed by Jonathan Hung 2017-10-09 14:54:55 -07:00
Xuan
793476e4b7 YARN-5947: Create LeveldbConfigurationStore class using Leveldb as backing store. Contributed by Jonathan Hung 2017-10-09 14:54:55 -07:00
Xuan
09b7c8766e YARN-5953 addendum: Move QueueConfigInfo and SchedConfUpdateInfo to package org.apache.hadoop.yarn.webapp.dao 2017-10-09 14:54:54 -07:00
Xuan
e09f0d64ac YARN-5953:Create CLI for changing YARN configurations. (Jonathan Hung via xgong) 2017-10-09 14:54:54 -07:00
Xuan
3f29c1585b YARN-6575. Support global configuration mutation in MutableConfProvider. (Jonathan Hung via Xuan Gong) 2017-10-09 14:54:54 -07:00
Wangda Tan
5fd1668a27 YARN-5949. Add pluggable configuration ACL policy interface and implementation. (Jonathan Hung via wangda) 
Change-Id: Ib98e82ff753bede21fcab2e6ca9ec1e7a5a2008f
 2017-10-09 14:54:53 -07:00
Wangda Tan
d1514bacd1 YARN-5952. Create REST API for changing YARN scheduler configurations. (Jonathan Hung via wangda) 2017-10-09 14:54:53 -07:00
Jonathan Hung
28754646e5 YARN-5948. Implement MutableConfigurationManager for handling storage into configuration store 2017-10-09 14:54:53 -07:00
Xuan
c4c2feeccf YARN-5946: Create YarnConfigurationStore interface and 
InMemoryConfigurationStore class. Contributed by Jonathan Hung
 2017-10-09 14:54:52 -07:00
Jonathan Hung
72169a0281 YARN-5951. Changes to allow CapacityScheduler to use configuration store 2017-10-09 14:54:52 -07:00