Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,065 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

17065 Commits

Author SHA1 Message Date
Junping Du 9433f9eb09 HADOOP-14958. Fix source-level compatibility after HADOOP-11252. Contributed by Junping Du. 
(cherry picked from commit b016f08f67)
 2017-10-18 15:07:20 -07:00
Anu Engineer 0160a708ae HADOOP-14752. TestCopyFromLocal#testCopyFromLocalWithThreads is fleaky. Contributed by Andras Bokor. 
(cherry picked from commit 442ea85545)
 2017-10-18 11:26:23 -07:00
Akira Ajisaka a887016e1d
MAPREDUCE-6972. Enable try-with-resources for RecordReader. Contributed by Zoltan Haindrich. 
(cherry picked from commit 2523e1cce5)
 2017-10-18 11:19:00 +09:00
Xiao Chen 12d19d3978 HADOOP-14944. Add JvmMetrics to KMS. 
(cherry picked from commit 86ee0c5e4e)
 2017-10-17 19:07:19 -07:00
Arpit Agarwal 5897095d53 HDFS-12420. Add an option to disallow 'namenode format -force'. Contributed by Ajay Kumar. 
(cherry picked from commit b6942cbe9b)
 2017-10-17 16:45:21 -07:00
Haibo Chen 175c4472d5 YARN-6546. SLS is slow while loading 10k queues. (Yufei Gu via Haibo Chen) 
(cherry picked from commit 46eb1033a8)
 2017-10-17 16:04:49 -07:00
Lei Xu 6959db9c20 HDFS-12612. DFSStripedOutputStream.close will throw if called a second time with a failed streamer. (Lei (Eddy) Xu) 2017-10-17 15:53:07 -07:00
Subru Krishnan 81a86860bf YARN-7311. Fix TestRMWebServicesReservation parametrization for fair scheduler. (Yufei Gu via Subru). 
(cherry picked from commit 75323394fb)
 2017-10-17 12:39:40 -07:00
Haibo Chen 5334deb089 YARN-7341. TestRouterWebServiceUtil#testMergeMetrics is flakey. (Robert Kanter via Haibo Chen) 
(cherry picked from commit acabc657ff)
 2017-10-17 10:26:02 -07:00
Lei Xu cdfcd384b2 HDFS-12613. Native EC coder should implement release() as idempotent function. (Lei (Eddy) Xu) 
(cherry picked from commit 31ebccc962)
 2017-10-16 19:46:26 -07:00
Robert Kanter a9cbfb0398 HADOOP-14938. Configuration.updatingResource map should be initialized lazily (misha@cloudera.com via rkanter) 2017-10-16 16:39:25 -07:00
Robert Kanter 6971699099 YARN-7308. TestApplicationACLs fails with FairScheduler (rkanter) 
(cherry picked from commit 8a61525928)
 2017-10-16 15:34:50 -07:00
Nathan Roberts a809ce8f50 YARN-7333. container-executor fails to remove entries from a directory that is not writable or executable. Contributed by Jason Lowe. 
(cherry picked from commit 8620140a6a3ec0117675ede06d92d830da3da551)
 2017-10-16 16:41:42 -05:00
Xiao Chen 23ec4a788a HADOOP-14949. TestKMS#testACLs fails intermittently. 
(cherry picked from commit 152317d40ece8abfa76fb5bd29f04878c1b0d3d8)
 2017-10-16 14:19:44 -07:00
Junping Du 26da4045aa YARN-7124. LogAggregationTFileController deletes/renames while file is open. Contributed by Jason Lowe. 
(cherry picked from commit 1fcbe7cf5f)
 2017-10-16 13:57:41 -07:00
Arun Suresh 2fdffbd8c7 YARN-7275. NM Statestore cleanup for Container updates. (Kartheek Muthyala via asuresh) 
(cherry picked from commit a50be1b8f4)
 2017-10-16 13:23:58 -07:00
Xiao Chen 7c00d66118 HDFS-12642. Log block and datanode details in BlockRecoveryWorker. 
(cherry picked from commit 971b3ca1acc15d9a1f8e774291813dafd16ef704)
 2017-10-16 10:34:15 -07:00
Xiao Chen ca1271e218 HDFS-12637. Extend TestDistributedFileSystemWithECFile with a random EC policy. Contributed by Takanobu Asanuma. 
(cherry picked from commit f57e5aae77a004ac9a8d548cf7fa2669e3642f30)
 2017-10-16 09:55:31 -07:00
Xiao Chen 77ef810552 HDFS-12603. Enable async edit logging by default. Contributed by Andrew Wang. 
(cherry picked from commit d0311dfc5fe92a0e0f3fb8ae92e412edce609740)
 2017-10-16 09:51:19 -07:00
Xiao Chen 66847c27db HDFS-12659. Update TestDeadDatanode#testNonDFSUsedONDeadNodeReReg to increase heartbeat recheck interval. Contributed by Ajay Kumar. 
(cherry picked from commit 11a7729c1474aa379a62c0440c8c1a11be261a75)
 2017-10-15 19:28:30 -07:00
Wangda Tan 41e8ed7e98 Addendum fix for: YARN-7269. Tracking URL in the app state does not get redirected to ApplicationMaster for Running applications. (Wangda Tan) 
Change-Id: If1fe4a62e07b25e6f1b8ba803495da87e2cb2df6
(cherry picked from commit 87ea1dff9c)
 2017-10-14 10:45:12 -07:00
Haibo Chen 1134060678 YARN-7310. TestAMRMProxy#testAMRMProxyE2E fails with FairScheduler. (Robert Kanter via Haibo Chen) 
(cherry picked from commit 3fb4718886)
 2017-10-13 15:52:09 -07:00
Arpit Agarwal 4d19e39fd7 HDFS-12553. Add nameServiceId to QJournalProtocol. Contributed by Bharat Viswanadham 2017-10-13 14:53:45 -07:00
Robert Kanter b7cef4e934 YARN-7309. TestClientRMService#testUpdateApplicationPriorityRequest and TestClientRMService#testUpdatePriorityAndKillAppWithZeroClusterResource test functionality not supported by FairScheduler (rkanter) 
(cherry picked from commit ec8bf9e48a)
 2017-10-13 13:57:40 -07:00
Yufei Gu dbf6c48af9 YARN-7270. Fix unsafe casting from long to int for class Resource and its sub-classes. (Yufei) 
(cherry picked from commit 7a27c2c367)
 2017-10-13 13:06:16 -07:00
Akira Ajisaka 24ac7c6e79
Revert "HADOOP-13514. Upgrade maven surefire plugin to 2.19.1." 
This reverts commit 372997f395.
 2017-10-13 18:01:50 +09:00
Chris Trezzo 24b03eb79f MAPREDUCE-5951. Add support for the YARN Shared Cache. 
(cherry picked from commit e46d5bb962)
 2017-10-12 11:15:46 -07:00
Carlo Curino 97b7d39a5f YARN-7317. Fix overallocation resulted from ceiling in LocalityMulticastAMRMProxyPolicy. (contributed by Botong Huang via curino) 
(cherry picked from commit 13fcfb3d46)
 2017-10-12 10:40:44 -07:00
Anu Engineer beb54e5279 HADOOP-13102. Update GroupsMapping documentation to reflect the new changes. Contributed by Esther Kundin. 
(cherry picked from commit 075358eb6f)
 2017-10-11 16:24:08 -07:00
Arun Suresh 52844ec0a1 HADOOP-13556. Change Configuration.getPropsWithPrefix to use getProps instead of iterator. (Larry McCay via asuresh) 
(cherry picked from commit b6c2c9058e)
 2017-10-11 15:22:18 -07:00
Arpit Agarwal 0a673f1539 HDFS-12599. Remove Mockito dependency from DataNodeTestUtils. Contributed by Ted Yu. 
(cherry picked from commit 09ad848b64)
 2017-10-11 15:31:39 -05:00
Jason Lowe 44f8b2a630 YARN-7082. TestContainerManagerSecurity failing in trunk. Contributed by Akira Ajisaka 
(cherry picked from commit ebb34c7053)
 2017-10-11 10:32:23 -05:00
Kai Zheng 8947c0b881 HDFS-12635. Unnecessary exception declaration of the CellBuffers constructor. Contributed by Huafeng Wang 2017-10-11 15:47:00 +08:00
Akira Ajisaka 372997f395
HADOOP-13514. Upgrade maven surefire plugin to 2.19.1. 
(cherry picked from commit 3d04c00aed)
 2017-10-11 10:44:29 +09:00
Andrew Wang a26da9dcf2 HDFS-12547. Extend TestQuotaWithStripedBlocks with a random EC policy. Contributed by Takanobu Asanuma. 
(cherry picked from commit a297fb0886)
 2017-10-10 17:35:56 -07:00
Jason Lowe c0d56cad5c HADOOP-14912. FairCallQueue may defer servicing calls. Contributed by Daryn Sharp 
(cherry picked from commit 1123f8f0b6)
 2017-10-10 14:49:15 -05:00
Andrew Wang 61ac7c82f2 HADOOP-14939. Update project release notes with HDFS-10467 for 3.0.0. Contributed by Inigo Goiri. 
(cherry picked from commit 132cdac0dd)
 2017-10-10 10:16:39 -07:00
Andrew Wang f1cfb2a8dc Revert "HDFS-12603. Enable async edit logging by default." 
This reverts commit e9f3f49b6d.
 2017-10-09 17:54:19 -07:00
Xuan fa676ba06b Merge branch 'YARN-5734-branch-3.0' into branch-3.0. (xgong) 2017-10-09 15:00:48 -07:00
Jonathan Hung 043a217017 YARN-7252. Removing queue then failing over results in exception 2017-10-09 14:54:57 -07:00
Jonathan Hung 168a3df8e6 YARN-7251. Misc changes to YARN-5734 2017-10-09 14:54:57 -07:00
Jonathan Hung d35f544020 YARN-7238. Documentation for API based scheduler configuration management 2017-10-09 14:54:56 -07:00
Jonathan Hung 5105bc4721 YARN-7046. Add closing logic to configuration store 2017-10-09 14:54:56 -07:00
Wangda Tan e6827a9121 YARN-6840. Implement zookeeper based store for scheduler configuration updates. (Jonathan Hung via wangda) 
Change-Id: I9debea674fe8c7e4109d4ca136965a1ea4c48bcc
 2017-10-09 14:54:56 -07:00
Xuan 4bf38062a5 YARN-7024: Fix issues on recovery in LevelDB store. Contributed by Jonathan Hung 2017-10-09 14:54:56 -07:00
Xuan 0b546420da YARN-6322: Disable queue refresh when configuration mutation is enabled. Contributed by Jonathan Hung 2017-10-09 14:54:55 -07:00
Xuan 793476e4b7 YARN-5947: Create LeveldbConfigurationStore class using Leveldb as backing store. Contributed by Jonathan Hung 2017-10-09 14:54:55 -07:00
Xuan 09b7c8766e YARN-5953 addendum: Move QueueConfigInfo and SchedConfUpdateInfo to package org.apache.hadoop.yarn.webapp.dao 2017-10-09 14:54:54 -07:00
Xuan e09f0d64ac YARN-5953:Create CLI for changing YARN configurations. (Jonathan Hung via xgong) 2017-10-09 14:54:54 -07:00
Xuan 3f29c1585b YARN-6575. Support global configuration mutation in MutableConfProvider. (Jonathan Hung via Xuan Gong) 2017-10-09 14:54:54 -07:00