Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
16,953 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

16953 Commits

Author SHA1 Message Date
Nathan Roberts a809ce8f50 YARN-7333. container-executor fails to remove entries from a directory that is not writable or executable. Contributed by Jason Lowe. 
(cherry picked from commit 8620140a6a3ec0117675ede06d92d830da3da551)
 2017-10-16 16:41:42 -05:00
Xiao Chen 23ec4a788a HADOOP-14949. TestKMS#testACLs fails intermittently. 
(cherry picked from commit 152317d40ece8abfa76fb5bd29f04878c1b0d3d8)
 2017-10-16 14:19:44 -07:00
Junping Du 26da4045aa YARN-7124. LogAggregationTFileController deletes/renames while file is open. Contributed by Jason Lowe. 
(cherry picked from commit 1fcbe7cf5f)
 2017-10-16 13:57:41 -07:00
Arun Suresh 2fdffbd8c7 YARN-7275. NM Statestore cleanup for Container updates. (Kartheek Muthyala via asuresh) 
(cherry picked from commit a50be1b8f4)
 2017-10-16 13:23:58 -07:00
Xiao Chen 7c00d66118 HDFS-12642. Log block and datanode details in BlockRecoveryWorker. 
(cherry picked from commit 971b3ca1acc15d9a1f8e774291813dafd16ef704)
 2017-10-16 10:34:15 -07:00
Xiao Chen ca1271e218 HDFS-12637. Extend TestDistributedFileSystemWithECFile with a random EC policy. Contributed by Takanobu Asanuma. 
(cherry picked from commit f57e5aae77a004ac9a8d548cf7fa2669e3642f30)
 2017-10-16 09:55:31 -07:00
Xiao Chen 77ef810552 HDFS-12603. Enable async edit logging by default. Contributed by Andrew Wang. 
(cherry picked from commit d0311dfc5fe92a0e0f3fb8ae92e412edce609740)
 2017-10-16 09:51:19 -07:00
Xiao Chen 66847c27db HDFS-12659. Update TestDeadDatanode#testNonDFSUsedONDeadNodeReReg to increase heartbeat recheck interval. Contributed by Ajay Kumar. 
(cherry picked from commit 11a7729c1474aa379a62c0440c8c1a11be261a75)
 2017-10-15 19:28:30 -07:00
Wangda Tan 41e8ed7e98 Addendum fix for: YARN-7269. Tracking URL in the app state does not get redirected to ApplicationMaster for Running applications. (Wangda Tan) 
Change-Id: If1fe4a62e07b25e6f1b8ba803495da87e2cb2df6
(cherry picked from commit 87ea1dff9c)
 2017-10-14 10:45:12 -07:00
Haibo Chen 1134060678 YARN-7310. TestAMRMProxy#testAMRMProxyE2E fails with FairScheduler. (Robert Kanter via Haibo Chen) 
(cherry picked from commit 3fb4718886)
 2017-10-13 15:52:09 -07:00
Arpit Agarwal 4d19e39fd7 HDFS-12553. Add nameServiceId to QJournalProtocol. Contributed by Bharat Viswanadham 2017-10-13 14:53:45 -07:00
Robert Kanter b7cef4e934 YARN-7309. TestClientRMService#testUpdateApplicationPriorityRequest and TestClientRMService#testUpdatePriorityAndKillAppWithZeroClusterResource test functionality not supported by FairScheduler (rkanter) 
(cherry picked from commit ec8bf9e48a)
 2017-10-13 13:57:40 -07:00
Yufei Gu dbf6c48af9 YARN-7270. Fix unsafe casting from long to int for class Resource and its sub-classes. (Yufei) 
(cherry picked from commit 7a27c2c367)
 2017-10-13 13:06:16 -07:00
Akira Ajisaka 24ac7c6e79
Revert "HADOOP-13514. Upgrade maven surefire plugin to 2.19.1." 
This reverts commit 372997f395.
 2017-10-13 18:01:50 +09:00
Chris Trezzo 24b03eb79f MAPREDUCE-5951. Add support for the YARN Shared Cache. 
(cherry picked from commit e46d5bb962)
 2017-10-12 11:15:46 -07:00
Carlo Curino 97b7d39a5f YARN-7317. Fix overallocation resulted from ceiling in LocalityMulticastAMRMProxyPolicy. (contributed by Botong Huang via curino) 
(cherry picked from commit 13fcfb3d46)
 2017-10-12 10:40:44 -07:00
Anu Engineer beb54e5279 HADOOP-13102. Update GroupsMapping documentation to reflect the new changes. Contributed by Esther Kundin. 
(cherry picked from commit 075358eb6f)
 2017-10-11 16:24:08 -07:00
Arun Suresh 52844ec0a1 HADOOP-13556. Change Configuration.getPropsWithPrefix to use getProps instead of iterator. (Larry McCay via asuresh) 
(cherry picked from commit b6c2c9058e)
 2017-10-11 15:22:18 -07:00
Arpit Agarwal 0a673f1539 HDFS-12599. Remove Mockito dependency from DataNodeTestUtils. Contributed by Ted Yu. 
(cherry picked from commit 09ad848b64)
 2017-10-11 15:31:39 -05:00
Jason Lowe 44f8b2a630 YARN-7082. TestContainerManagerSecurity failing in trunk. Contributed by Akira Ajisaka 
(cherry picked from commit ebb34c7053)
 2017-10-11 10:32:23 -05:00
Kai Zheng 8947c0b881 HDFS-12635. Unnecessary exception declaration of the CellBuffers constructor. Contributed by Huafeng Wang 2017-10-11 15:47:00 +08:00
Akira Ajisaka 372997f395
HADOOP-13514. Upgrade maven surefire plugin to 2.19.1. 
(cherry picked from commit 3d04c00aed)
 2017-10-11 10:44:29 +09:00
Andrew Wang a26da9dcf2 HDFS-12547. Extend TestQuotaWithStripedBlocks with a random EC policy. Contributed by Takanobu Asanuma. 
(cherry picked from commit a297fb0886)
 2017-10-10 17:35:56 -07:00
Jason Lowe c0d56cad5c HADOOP-14912. FairCallQueue may defer servicing calls. Contributed by Daryn Sharp 
(cherry picked from commit 1123f8f0b6)
 2017-10-10 14:49:15 -05:00
Andrew Wang 61ac7c82f2 HADOOP-14939. Update project release notes with HDFS-10467 for 3.0.0. Contributed by Inigo Goiri. 
(cherry picked from commit 132cdac0dd)
 2017-10-10 10:16:39 -07:00
Andrew Wang f1cfb2a8dc Revert "HDFS-12603. Enable async edit logging by default." 
This reverts commit e9f3f49b6d.
 2017-10-09 17:54:19 -07:00
Xuan fa676ba06b Merge branch 'YARN-5734-branch-3.0' into branch-3.0. (xgong) 2017-10-09 15:00:48 -07:00
Jonathan Hung 043a217017 YARN-7252. Removing queue then failing over results in exception 2017-10-09 14:54:57 -07:00
Jonathan Hung 168a3df8e6 YARN-7251. Misc changes to YARN-5734 2017-10-09 14:54:57 -07:00
Jonathan Hung d35f544020 YARN-7238. Documentation for API based scheduler configuration management 2017-10-09 14:54:56 -07:00
Jonathan Hung 5105bc4721 YARN-7046. Add closing logic to configuration store 2017-10-09 14:54:56 -07:00
Wangda Tan e6827a9121 YARN-6840. Implement zookeeper based store for scheduler configuration updates. (Jonathan Hung via wangda) 
Change-Id: I9debea674fe8c7e4109d4ca136965a1ea4c48bcc
 2017-10-09 14:54:56 -07:00
Xuan 4bf38062a5 YARN-7024: Fix issues on recovery in LevelDB store. Contributed by Jonathan Hung 2017-10-09 14:54:56 -07:00
Xuan 0b546420da YARN-6322: Disable queue refresh when configuration mutation is enabled. Contributed by Jonathan Hung 2017-10-09 14:54:55 -07:00
Xuan 793476e4b7 YARN-5947: Create LeveldbConfigurationStore class using Leveldb as backing store. Contributed by Jonathan Hung 2017-10-09 14:54:55 -07:00
Xuan 09b7c8766e YARN-5953 addendum: Move QueueConfigInfo and SchedConfUpdateInfo to package org.apache.hadoop.yarn.webapp.dao 2017-10-09 14:54:54 -07:00
Xuan e09f0d64ac YARN-5953:Create CLI for changing YARN configurations. (Jonathan Hung via xgong) 2017-10-09 14:54:54 -07:00
Xuan 3f29c1585b YARN-6575. Support global configuration mutation in MutableConfProvider. (Jonathan Hung via Xuan Gong) 2017-10-09 14:54:54 -07:00
Wangda Tan 5fd1668a27 YARN-5949. Add pluggable configuration ACL policy interface and implementation. (Jonathan Hung via wangda) 
Change-Id: Ib98e82ff753bede21fcab2e6ca9ec1e7a5a2008f
 2017-10-09 14:54:53 -07:00
Wangda Tan d1514bacd1 YARN-5952. Create REST API for changing YARN scheduler configurations. (Jonathan Hung via wangda) 2017-10-09 14:54:53 -07:00
Jonathan Hung 28754646e5 YARN-5948. Implement MutableConfigurationManager for handling storage into configuration store 2017-10-09 14:54:53 -07:00
Xuan c4c2feeccf YARN-5946: Create YarnConfigurationStore interface and 
InMemoryConfigurationStore class. Contributed by Jonathan Hung
 2017-10-09 14:54:52 -07:00
Jonathan Hung 72169a0281 YARN-5951. Changes to allow CapacityScheduler to use configuration store 2017-10-09 14:54:52 -07:00
Andrew Wang 1d11701e55 HDFS-12541. Extend TestSafeModeWithStripedFile with a random EC policy. Contributed by Takanobu Asanuma. 
(cherry picked from commit 7938208233)
 2017-10-09 13:03:39 -07:00
Andrew Wang e9f3f49b6d HDFS-12603. Enable async edit logging by default. 
(cherry picked from commit afb42aeabf)
 2017-10-09 11:20:04 -07:00
Lei Xu 015eb628b8 HDFS-12606. When using native decoder, DFSStripedStream.close crashes JVM after being called multiple times. (Lei (Eddy) Xu) 
(cherry picked from commit 46644319e1)
 2017-10-09 10:09:49 -07:00
Daniel Templeton bec03f7060 YARN-2612 addendum: fixed javadoc error. 
(cherry picked from commit 6d6ca4c923)
 2017-10-09 14:15:52 +02:00
Sunil G 84e2e2a6f6 YARN-7245. Max AM Resource column in Active Users Info section of Capacity Scheduler UI page should be updated per-user. Contributed by Eric Payne. 
(cherry picked from commit 8137254a1f)
 2017-10-09 14:40:44 +05:30
John Zhuge 7dfe97d84f HDFS-12494. libhdfs SIGSEGV in setTLSExceptionStrings. Contributed by John Zhuge. 
(cherry picked from commit 2856eb207b)
 2017-10-07 00:09:36 -07:00
Inigo Goiri ae9f82c603 HDFS-12577. Rename Router tooling. Contributed by Inigo Goiri. 
(cherry picked from commit 53e8d0d030)
 2017-10-06 19:04:47 -07:00