Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,131 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

12131 Commits

Author SHA1 Message Date
Mingliang Liu a868cf4046 Revert "HDFS-10893. Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test. Contributed by Mingliang Liu" 
This reverts commit 14bacd2b99.
 2016-10-05 23:10:28 -07:00
Mingliang Liu 14bacd2b99 HDFS-10893. Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test. Contributed by Mingliang Liu 2016-10-05 22:54:27 -07:00
Wei-Chiu Chuang 434403a2a0 HDFS-10683. Make class Token$PrivateToken private. Contributed by John Zhuge. 
(cherry picked from commit c5ca216915)
 2016-10-05 17:46:46 -07:00
Andrew Wang 6b2a853dd7 HDFS-10962. TestRequestHedgingProxyProvider is flaky. 
(cherry picked from commit e68c7b96c7)
 2016-10-05 15:09:11 -07:00
Chris Douglas 539c3e4dc0 YARN-5702. Refactor TestPBImplRecords for reuse in other YARN modules. Contributed by Subru Krishnan 
(cherry picked from commit d65b957776)
 2016-10-05 12:19:21 -07:00
Steve Loughran 6ed335a018 HADOOP-12667 s3a to support createNonRecursive API. Contributed by Sean Mackrory 2016-10-05 15:01:15 +01:00
Akira Ajisaka bdbb75e083 HADOOP-13685. Document -safely option of rm command. Contributed by Xiaoyu Yao. 
(cherry picked from commit 9a61b52fbe)
 2016-10-05 20:41:29 +09:00
Varun Vasudev 3ce02387ea YARN-5704. Provide config knobs to control enabling/disabling new/work in progress features in container-executor. Contributed by Sidharta Seethana. 
(cherry picked from commit 0992708d79)
 2016-10-05 15:32:50 +05:30
Kihwal Lee b565fa8e05 HDFS-10956. Remove rename/delete performance penalty when not using snapshots. Contributed by Daryn Sharp. 
(cherry picked from commit 44f48ee96e)
 2016-10-04 15:26:42 -05:00
Chris Nauroth 213f0ad7f0 HADOOP-13674. S3A can provide a more detailed error message when accessing a bucket through an incorrect S3 endpoint. Contributed by Chris Nauroth. 
(cherry picked from commit 88b9444a81)
 2016-10-04 10:37:04 -07:00
Kihwal Lee a9a2f64e56 HDFS-10878. TestDFSClientRetries#testIdempotentAllocateBlockAndClose throws ConcurrentModificationException. Contributed by Rushabh S Shah. 
(cherry picked from commit 382307cbdd)
 2016-10-04 11:10:29 -05:00
Brahma Reddy Battula 560e524f93 HDFS-10947. Correct the API name for truncate in webhdfs document. Contributed by Surendra Singh Lilhore 
(cherry picked from commit ef7f06f7d1)
 2016-10-04 18:51:40 +05:30
Brahma Reddy Battula c9df3c5f21 HDFS-10944. Correct the javadoc of dfsadmin#disallowSnapshot. Contributed by Jagadesh Kiran N 
(cherry picked from commit 5ea0210c7f)
 2016-10-04 18:37:43 +05:30
Mingliang Liu 612aa0cc0b HDFS-10934. TestDFSShell#testStat fails intermittently. Contributed by Eric Badger 
(cherry picked from commit f61e3d13e9)
 2016-10-03 22:47:09 -04:00
Mingliang Liu d963ecb918 HDFS-10810. setreplication removing block from underconstrcution temporarily. Contributed by Brahma Reddy Battula 2016-10-03 21:59:31 -04:00
Xiao Chen d9b686a2bd HDFS-10918. Add a tool to get FileEncryptionInfo from CLI. Contributed by Xiao Chen. 
(cherry picked from commit 853d65a157)
 2016-10-03 16:02:07 -07:00
Karthik Kambatla 1578781fe9 YARN-4767. Network issues can cause persistent RM UI outage. (Daniel Templeton via kasha) 
(cherry picked from commit 736d33cddd)
 2016-10-03 14:36:14 -07:00
Xiaoyu Yao 6f3744195d HDFS-10690. Optimize insertion/removal of replica in ShortCircuitCache. Contributed by Fenghua Hu. 
(cherry picked from commit 607705c488)
 2016-10-03 11:00:15 -07:00
Karthik Kambatla 876fc2e61a MAPREDUCE-6638. Do not attempt to recover progress from previous job attempts if spill encryption is enabled. (Haibo Chen via kasha) 
(cherry picked from commit de7a0a92ca)
 2016-10-03 10:30:44 -07:00
Kihwal Lee 03b797a6ac HDFS-10940. Reduce performance penalty of block caching when not used. Contributed by Daryn Sharp. 
(cherry picked from commit 744208431f)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirStatAndListingOp.java
 2016-10-03 11:41:19 -05:00
Kihwal Lee ebfbce3b5f HDFS-10945. Fix the Findbugwaring FSNamesystem#renameTo() in branch-2. Contributed by Brahma Reddy Battula. 2016-10-03 10:48:14 -05:00
Kihwal Lee 2ee47f02cf HDFS-10619. Cache path in InodesInPath. Contributed by Daryn Sharp. 
(cherry picked from commit 90020624b0)
 2016-10-03 09:20:08 -05:00
Karthik Kambatla f8c2c7b2c0 YARN-5672. FairScheduler: Wrong queue name in log when adding application. (Wilfred Spiegelenburg via kasha) 
(cherry picked from commit 0da54e8848)
 2016-10-03 06:04:09 -07:00
Naganarasimha 04f594dbea YARN-4855. Should check if node exists when replace nodelabels. Contributeed by Tao Jie 
(cherry picked from commit 6e130c308c)
 2016-10-03 02:13:46 -04:00
Karthik Kambatla 57726eed83 YARN-5678. Log demand as demand in FSLeafQueue and FSParentQueue. (Yufei Gu via kasha) 
(cherry picked from commit 82857037b6)
 2016-10-02 22:10:07 -07:00
Arpit Agarwal 6dd747b6bc Revert "HDFS-10923. Make InstrumentedLock require ReentrantLock." 
This reverts commit 9873ed32c6.
 2016-09-30 23:12:07 -07:00
Arpit Agarwal 9873ed32c6 HDFS-10923. Make InstrumentedLock require ReentrantLock. 2016-09-30 23:04:22 -07:00
Subru Krishnan 9f43f89899 YARN-5384. Expose priority in ReservationSystem submission APIs. (Sean Po via Subru). 
(cherry picked from commit 3a3697deab)
 2016-09-30 19:43:29 -07:00
Xiao Chen 1ed23a134c HADOOP-13317. Add logs to KMS server-side to improve supportability. Contributed by Suraj Acharya. 
(cherry picked from commit 89bd6d29a6)
 2016-09-30 17:52:13 -07:00
Kihwal Lee 2551ff80b7 HDFS-10851. FSDirStatAndListingOp: stop passing path as string. Contributed by Daryn Sharp. 2016-09-30 15:59:40 -05:00
Robert Kanter 56ec975ea9 YARN-5693. Reduce loglevel to Debug in ContainerManagementProtocolProxy and AMRMClientImpl (yufeigu via rkanter) 
(cherry picked from commit 2549ee9d4c)
 2016-09-30 13:35:58 -07:00
Zhe Zhang dfca0f4abb HDFS-10896. Move lock logging logic from FSNamesystem into FSNamesystemLock. Contributed by Erik Krogen. 
(cherry-picked from commit 434c5ea75d)
 2016-09-30 13:30:31 -07:00
Wei-Chiu Chuang a6863e5334 HADOOP-12974. Create a CachingGetSpaceUsed implementation that uses df. Contributed by Elliott Clark. 
(cherry picked from commit 57aec2b46b)
 2016-09-30 13:00:04 -07:00
Kihwal Lee 10222cd54e HDFS-10850. getEZForPath should NOT throw FNF. Contributed by Andrew Wang. 
(cherry picked from commit 0670149c88)
 2016-09-30 08:58:38 -05:00
Akira Ajisaka 25df276c6b HADOOP-13640. Fix findbugs warning in VersionInfoMojo.java. Contributed by Yuanbo Liu. 
(cherry picked from commit 82c55dcbc8)
 2016-09-30 18:18:26 +09:00
Li Lu 919c0802fa YARN-4205. Addendum patch to fix branch-2. 2016-09-29 15:41:31 -07:00
Chris Nauroth cf954d7a48 Revert "HADOOP-13081. add the ability to create multiple UGIs/subjects from one kerberos login. Contributed by Sergey Shelukhin." 
This reverts commit ec522a1907.
 2016-09-29 13:58:55 -07:00
Kihwal Lee 92336ea37e HADOOP-13537. Support external calls in the RPC call queue. Contributed by Daryn Sharp. 
(cherry picked from commit 236ac773c9)
 2016-09-29 13:54:30 -05:00
Steve Loughran 896df3f55a HADOOP-13164 Optimize S3AFileSystem::deleteUnnecessaryFakeDirectories. Contributed by Rajesh Balamohan. 2016-09-29 17:00:34 +01:00
Jason Lowe c52ad9ee86 MAPREDUCE-6771. RMContainerAllocator sends container diagnostics event after corresponding completion event. Contributed by Haibo Chen 2016-09-29 15:50:50 +00:00
Jian He 39f896e1a1 YARN-4205. Add a service for monitoring application life time out. Contributed by Rohith Sharma K S 
(cherry picked from commit 2ae5a3a5bf)
 2016-09-29 22:06:36 +08:00
Steve Loughran 2b6b4fd779 HADOOP-13663 Index out of range in SysInfoWindows. Contributed by Inigo Goiri 2016-09-29 11:35:37 +01:00
Chris Nauroth 1f1e47e411 HADOOP-13599. s3a close() to be non-synchronized, so avoid risk of deadlock on shutdown. Contributed by Steve Loughran. 
(cherry picked from commit 47f80922dc)
 2016-09-28 16:21:00 -07:00
Mingliang Liu a7c1636296 HDFS-10892. Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'. Contributed by Mingliang Liu 
(cherry picked from commit 84c6264079)
 2016-09-28 16:09:09 -07:00
Robert Kanter 85724268c2 MAPREDUCE-6718. add progress log to JHS during startup (haibochen via rkanter) 
(cherry picked from commit 0d6778d800)
 2016-09-28 16:04:48 -07:00
Andrew Wang b12f004474 HDFS-10914. Move remnants of oah.hdfs.client to hadoop-hdfs-client. 
(cherry picked from commit 92e5e91598)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/HdfsAdmin.java
 2016-09-28 16:03:16 -07:00
Robert Kanter 4f8c7f819c YARN-5400. addendum patch to fix JDK 7 issue 2016-09-28 16:01:18 -07:00
Kihwal Lee 087c61192d HDFS-10779. Rename does not need to re-solve destination. Contributed by Daryn Sharp. 
(cherry picked from commit 5f34402ada)
 2016-09-28 17:58:53 -05:00
Arpit Agarwal 50888471d9 HDFS-10824. MiniDFSCluster#storageCapacities has no effects on real capacity. Contributed by Xiaobing Zhou. 2016-09-28 15:56:08 -07:00
Robert Kanter bc91e33d5e YARN-5400. Light cleanup in ZKRMStateStore (templedf via rkanter) 
(cherry picked from commit bcb2528a51)
 2016-09-28 14:57:14 -07:00