Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,312 Commits 326 Branches 371 Tags
Commit Graph

3122 Commits

Author SHA1 Message Date
Arpit Agarwal
c35c1e6703 HDFS-10623. Remove unused import of httpclient.HttpConnection from TestWebHdfsTokens. (Contributed by Hanisha Koneru) 2016-07-14 13:01:15 -07:00
Zhe Zhang
c7e1e92c1a HDFS-10544. Balancer doesn't work with IPFailoverProxyProvider. 
(cherry picked from commit 087290e6b1cb1082646d966b65494082712ebe3e)
(cherry picked from commit 5b4e916b3cae2540267d48716fd9240dfc055288)
(cherry picked from commit af94dfaa53532d7c650478050621d216360e04b5)
 2016-07-13 14:36:26 -07:00
Arpit Agarwal
771033babd HADOOP-12570. HDFS Secure Mode Documentation updates. (Arpit Agarwal) 2016-07-13 13:02:01 -07:00
Vinod Kumar Vavilapalli
c454639abf HADOOP-13312. Updated CHANGES.txt to reflect all the changes in branch-2.7. Contributed by Akira Ajisaka. 2016-07-12 15:41:22 -07:00
Andrew Wang
5ebebc6524 HDFS-10488. Update WebHDFS documentation regarding CREATE and MKDIR default permissions. Contributed by Wellington Chevreuil. 
(cherry picked from commit 728623242f47c6bffb46cfcc8f3425b58c1fde3a)
 2016-07-07 10:38:33 -07:00
Brahma Reddy Battula
6a1fc34595 HDFS-9530. ReservedSpace is not cleared for abandoned Blocks (Contributed by Brahma Reddy Battula) 2016-06-21 16:12:46 +05:30
Rohith Sharma K S
0bc531aa8f Adding-release-2.7.4-to-CHANGES.txt 2016-06-21 11:27:13 +05:30
Brahma Reddy Battula
be94ed6ceb HDFS-10474. hftp copy fails when file name with Chinese+special char in branch-2 (Contributed by Brahma Reddy Battula) 2016-06-20 12:43:18 +05:30
Arpit Agarwal
aca4310f32 HDFS-9906. Remove spammy log spew when a datanode is restarted. (Contributed by Brahma Reddy Battula) 
(cherry picked from commit 02949b2151f1eecce3e1bcdbbec1afac164a6065)
 2016-06-14 23:13:48 -07:00
Vinod Kumar Vavilapalli
f4b58eae94 Preparing for 2.7.4 development: Updating snapshot version to 2.7.4 on branch-2.7. 2016-06-14 19:14:02 -07:00
Kihwal Lee
8854cdd9ee HDFS-8581. ContentSummary on / skips further counts on yielding lock (contributed by J.Andreina) 
(cherry picked from commit 4014ce5990bff9b0ecb3d38a633d40eaf6cf07a7)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestQuota.java
 2016-06-14 08:25:09 -05:00
Masatake Iwasaki
5a3fed0602 HDFS-9905. WebHdfsFileSystem#runWithRetry should display original stack trace on error. (Wei-Chiu Chuang via iwasakims) 
cherry-picked from 6fcde2e38da04cae3aad6b13cf442af211f71506
 2016-06-09 20:48:58 +00:00
Zhe Zhang
9b68eda274 HDFS-10458. getFileEncryptionInfo should return quickly for non-encrypted cluster. 
(cherry picked from commit 6de9213df111a9a4ed875db995d67af72d08a798)
(cherry picked from commit 06e38c835d0ad9619d4bea662f2dd7d0f62007a9)
(cherry picked from commit 0274636529cfac4d64582a7c21631aebbf4deb1b)
 2016-06-06 16:09:14 -07:00
Xiaoyu Yao
97e79662b6 HDFS-8548. Minicluster throws NPE on shutdown. Contributed by surendra singh lilhore. 
(cherry picked from commit 6a76250b39f33466bdc8dabab33070c90aa1a389)
 2016-06-03 12:55:31 -07:00
Akira Ajisaka
fe08ba439e HDFS-9476. TestDFSUpgradeFromImage#testUpgradeFromRel1BBWImage occasionally fail. Contributed by Masatake Iwasaki. 
(cherry picked from commit 69555fca066815053dd9168ebe15868a5c02cdcd)
(cherry picked from commit 3dd557e4b6b852ee99f6acc29cca1088dc3a39ff)
 2016-06-02 18:55:36 +09:00
Tsz-Wo Nicholas Sze
d3bdea7f7f HDFS-9365. Balaner does not work with the HDFS-6376 HA setup. 2016-05-24 13:52:05 -07:00
Kihwal Lee
6e62b6fd83 HDFS-8772. Fix TestStandbyIsHot#testDatanodeRestarts which occasionally fails. Contributed by Walter Su. 
(cherry picked from commit 0c4c7b3b62fd9e58dc8adef42b81b8b96e1f4ab1)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/MiniDFSCluster.java
 2016-05-12 11:26:27 -05:00
Colin Patrick Mccabe
a61e04171f HDFS-10377. CacheReplicationMonitor shutdown log message should use INFO level (Yiqun Lin via cmccabe) 
(cherry picked from commit f0252ad2525c90b2b89ae2ff1de12482da2c8ddd)
(cherry picked from commit 43f32d3f4a86d8f2a302530831003496c78fd561)
(cherry picked from commit 154332bb5463998d5e8f2251c8010d624f5e85a9)
 2016-05-10 11:22:13 -07:00
Kihwal Lee
0467efcc09 HDFS-10372. Fix for failing TestFsDatasetImpl#testCleanShutdownOfVolume. Contributed by Rushabh Shah. 
(cherry picked from commit b9e5a32fa14b727b44118ec7f43fb95de05a7c2c)
Added a CHANGES.txt entry.
 2016-05-09 15:56:51 -05:00
Masatake Iwasaki
dd8aba3fad HDFS-2043. TestHFlush failing intermittently. Contributed by Lin Yiqun. 2016-05-06 15:57:06 +09:00
Harsh J
d490cfc42c HDFS-2580. NameNode#main(...) can make use of GenericOptionsParser. Contributed by harsh. (harsh) 
(cherry picked from commit 54e612bfb9f877e58f7f153c43cb4147876826d3)
 2016-05-02 17:52:14 -07:00
Kihwal Lee
6347f8f4d4 HDFS-10347. Namenode report bad block method doesn't log the bad block or datanode. Contributed by Rushabh Shah. 
(cherry picked from commit 7da540d03eccc2f97950bf47e8b35ce8c889d1e0)
Updated CHANGES.txt
 2016-04-29 16:07:20 -05:00
Tsz-Wo Nicholas Sze
c927f938fe HDFS-10335 Mover$Processor#chooseTarget() always chooses the first matching target storage group. Contributed by Mingliang Liu 2016-04-29 11:28:23 -07:00
Kihwal Lee
a3ece8b5b4 HDFS-9958. BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages. Contributed by Kuhu Shukla. 2016-04-28 16:47:04 -05:00
Akira Ajisaka
076215024b HDFS-10245. Fix the findbugs warnings in branch-2.7. Contributed by Brahma Reddy Battula. 2016-04-25 22:03:48 +09:00
Kihwal Lee
9e3b91b141 HDFS-9555. LazyPersistFileScrubber should still sleep if there are errors in the clear progress. Contributed by Phil Yang. 
(cherry picked from commit 5d4255a80156d2cacfea8184b41805070223d3a9)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
 2016-04-22 11:47:18 -05:00
Tsz-Wo Nicholas Sze
e7f1b8fcb3 HDFS-10319. Balancer should not try to pair storages with different types. 2016-04-21 15:36:28 -07:00
Arpit Agarwal
12c6c2c9a6 HDFS-10264. Logging improvements in FSImageFormatProtobuf.Saver. (Contributed by Xiaobing Zhou) 2016-04-19 11:28:01 -07:00
Walter Su
91ca90fdd1 HDFS-10275. TestDataNodeMetrics failing intermittently due to TotalWriteTime counted incorrectly. Contributed by Lin Yiqun. 
(cherry picked from commit ab903029a9d353677184ff5602966b11ffb408b9)
 2016-04-18 20:30:48 +08:00
Walter Su
2ee244ac28 HDFS-9772. TestBlockReplacement#testThrottler doesn't work as expected. Contributed by Lin Yiqun. 
(cherry picked from commit 903428bf946827b4d58c7c577ed0c574a7cff029)
 2016-04-13 17:51:01 +08:00
Vinayakumar B
b52ac3cb4d Addendum: HDFS-10271. 
Added CHANGES.txt entry
 2016-04-12 11:57:00 +05:30
Vinayakumar B
37e4e45390 HDFS-10271. Extra bytes are getting released from reservedSpace for append (Contributed by Brahma Reddy Battula) 2016-04-12 11:32:28 +05:30
Tsz-Wo Nicholas Sze
262d769b4d HDFS-10186. DirectoryScanner: Improve logs by adding full path of both actual and expected block directories. Contributed by Rakesh R 2016-04-07 12:43:09 +08:00
Kihwal Lee
8e784afb15 Revert "HDFS-8791. block ID-based DN storage layout can be very slow for datanode on ext4. Contributed by Chris Trezzo." 
This reverts commit 9bc9e13a979c775354b2394d926f466a0d5be514.

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2016-04-06 17:35:54 -05:00
Kihwal Lee
dd701c9800 HDFS-10261. TestBookKeeperHACheckpoints doesn't handle ephemeral HTTP ports. Contributed by Eric Badger. 
(cherry picked from commit 9ba1e5af06070ba01dcf46e1a4c66713a1d43352)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal/src/test/java/org/apache/hadoop/contrib/bkjournal/TestBookKeeperHACheckpoints.java

(cherry picked from commit 6e37c5fe80ee9ce46afc26838391cc27ca6b1e6f)
 2016-04-05 17:00:42 -05:00
Kihwal Lee
9608601330 HDFS-10239. Fsshell mv fails if port usage doesn't match in src and destination paths. Contributed by Kuhu Shukla. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSShell.java

(cherry picked from commit ef3da823573cbf16fd1d84479330dd457f95e0ff)
 2016-04-05 09:20:38 -05:00
Vinayakumar B
fc0ffc48d4 HDFS-9917. IBR accumulate more objects when SNN was down for sometime. (Contributed by Brahma Reddy Battula) 2016-04-05 09:59:37 +08:00
Kihwal Lee
69d4fa0deb HDFS-10178. Permanent write failures can happen if pipeline recoveries occur for the first packet. Contributed by Kihwal Lee. 
(cherry picked from commit a7d1fb0cd2fdbf830602eb4dbbd9bbe62f4d5584)
TestClientProtocolForPipelineRecovery modified to use DFSConfigKeys instead of HdfsClientConfigKeys.
 2016-04-04 16:54:04 -05:00
Kihwal Lee
efb210cc30 Fix CHANGES.txt 2016-03-28 11:31:07 -05:00
Walter Su
ec459e3966 HDFS-10182. Hedged read might overwrite user's buf. Contributed by zhouyingchao. 
(cherry picked from commit d8383c687c95dbb37effa307ab2d41497da1cfc2)
 2016-03-28 15:46:15 +08:00
Aaron T. Myers
17dbf82f54 HDFS-8101. DFSClient use of non-constant DFSConfigKeys pulls in WebHDFS classes at runtime. Contributed by Sean Busbey. 
(cherry picked from commit 3fe61e0bb0d025a6acbb754027f73f3084b2f4d1)
 2016-03-26 17:54:09 -07:00
Kihwal Lee
a66d2a2a85 HDFS-9874. Long living DataXceiver threads cause volume shutdown to block. Contributed by Rushabh Shah. 
(cherry picked from commit 63c966a3fbeb675959fc4101e65de9f57aecd17d)
(cherry picked from commit 242c7f1fee664b4d609a6c72e899f10816430f65)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/TestFsDatasetImpl.java
 2016-03-18 10:38:33 -05:00
Akira Ajisaka
6902789a92 HDFS-9860. Backport HDFS-9638 to branch-2.7. Contributed by Wei-Chiu Chuang. 2016-03-17 02:59:51 +09:00
Kihwal Lee
b8e73cff8f HDFS-9904. testCheckpointCancellationDuringUpload occasionally fails. Contributed by Lin Yiqun. 
(cherry picked from commit d4574017845cfa7521e703f80efd404afd09b8c4)
 2016-03-15 10:56:46 -05:00
Akira Ajisaka
7f43eb9547 HDFS-9812. Streamer threads leak if failure happens when closing DFSOutputStream. Contributed by Lin Yiqun. 
(cherry picked from commit 352d299cf8ebe330d24117df98d1e6a64ae38c26)
(cherry picked from commit fe0009a2bd17e26f9e9364ec3f772e9a3f138de8)
 2016-03-08 11:15:27 +09:00
Masatake Iwasaki
e768f8b771 HDFS-9865. TestBlockReplacement fails intermittently in trunk (Lin Yiqun via iwasakims) 2016-03-08 02:13:50 +09:00
Masatake Iwasaki
08fc048018 HDFS-9048. DistCp documentation is out-of-dated (Daisuke Kobayashi via iwasakims) 
(cherry picked from commit 33a412e8a4ab729d588a9576fb7eb90239c6e383)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

(cherry picked from commit 55f7ceb0db13a6ef7a29b54f63075ce05dc1b019)
 2016-03-03 19:00:50 +09:00
Akira Ajisaka
8f2d0d4cea HDFS-9851. NameNode throws NPE when setPermission is called on a path that does not exist. Contributed by Brahma Reddy Battula. 2016-03-02 14:45:33 +09:00
Akira Ajisaka
2f3ceb8c65 HDFS-9766. TestDataNodeMetrics#testDataNodeTimeSpend fails intermittently. Contributed by Xiao Chen. 
(cherry picked from commit 81fbc40f084eab85750cc7d4cc967d43d70d8333)
(cherry picked from commit e8401417269bc3515918566bb2860e3b70d1d3ed)
 2016-03-02 14:16:58 +09:00
Kihwal Lee
006ed54a16 HDFS-9880. TestDatanodeRegistration fails occasionally. Contributed by Kihwal Lee. 
(cherry picked from commit e76b13c415459e4062c4c9660a16759a11ffb34a)
 2016-03-01 17:02:43 -06:00