Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,364 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

3157 Commits

Author SHA1 Message Date
Yongjun Zhang 4fd2adbc5f HDFS-10625. VolumeScanner to report why a block is found bad. Contributed by Rushabh S Shah and Yiqun Lin. 
(cherry picked from commit 5d1609ddf2)
 2016-08-29 14:25:49 -07:00
Mingliang Liu 3112a2447f HDFS-10807. Doc about upgrading to a version of HDFS with snapshots may be confusing. (Contributed by Mingliang Liu) 2016-08-29 10:22:55 -07:00
Zhe Zhang 1d01704060 HADOOP-12765. HttpServer2 should switch to using the non-blocking SslSelectChannelConnector to prevent performance degradation when handling SSL connections. Contributed by Min Shen. Branch-2 patch contributed by Wei-Chiu Chuang. 
(cherry picked from commit dfcbc12026)
(cherry picked from commit 8bc33bf343)
 2016-08-29 10:10:47 -07:00
Zhe Zhang 4f43607311 HDFS-10798. Make the threshold of reporting FSNamesystem lock contention configurable. Contributed by Erik Krogen. 
(cherry picked from commit 407b519fb1)
(cherry picked from commit f3a4cbcc60)
(cherry picked from commit 96cf681b5d)
 2016-08-26 14:34:28 -07:00
Kihwal Lee 8593225e85 HDFS-8915. TestFSNamesystem.testFSLockGetWaiterCount fails intermittently. Contributed by Masatake Iwasaki. 
(cherry picked from commit 13fb1b50e6)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSNamesystem.java
Updated CHANGES.txt
 2016-08-26 10:09:57 -05:00
Jing Zhao 8aa18534d9 HDFS-9467. Fix data race accessing writeLockHeldTimeStamp in FSNamesystem. Contributed by Mingliang Liu. 
(cherry picked from commit e556c35b05)
(cherry picked from commit 288cf8437b)
 2016-08-25 10:34:43 -07:00
Haohui Mai 0d8a1636ef HDFS-9145. Tracking methods that hold FSNamesytemLock for too long. Contributed by Mingliang Liu. 
(cherry picked from commit 5c5362980c)
 2016-08-25 10:18:50 -07:00
Xiaoyu Yao e5cb9d9e18 HDFS-8883. NameNode Metrics : Add FSNameSystem lock Queue Length. Contributed by Anu Engineer. 
(cherry picked from commit a7862d5fe4)
(cherry picked from commit 27ccbd51f6)
 2016-08-25 10:10:18 -07:00
cnauroth a1d8e421f6 HDFS-8721. Add a metric for number of encryption zones. Contributed by Rakesh R. 
(cherry picked from commit cb03768b1b)
(cherry picked from commit 57d55d40dd)
 2016-08-25 09:39:27 -07:00
Zhe Zhang 5fe29062eb HADOOP-12668. Support excluding weak Ciphers in HttpServer2 through ssl-server.conf. Contributed by Vijay Singh. 
Change-Id: Ie46a5427d29188935427f67e55203c19fcd83335
(cherry picked from commit 6d4a4e785b)
 2016-08-23 15:09:05 -07:00
Jason Lowe cec6083055 HDFS-9745. TestSecureNNWithQJM#testSecureMode sometimes fails with timeouts. Contributed by Xiao Chen 
(cherry picked from commit 126d165efd)
 2016-08-23 14:51:29 +00:00
Wei-Chiu Chuang cdc48c5d5e HDFS-8224. Schedule a block for scanning if its metadata file is 
corrupt. Contributed by Rushabh S Shah.
 2016-08-23 07:28:21 -07:00
Kihwal Lee d04fd76956 Revert "HDFS-9395. Make HDFS audit logging consistant. Contributed by Kuhu Shukla." 
This reverts commit 25b3531eb4.
Reverting HDFS-9395 from branch-2.7 as it is an incompatible change.
 2016-08-18 17:20:20 -05:00
Kihwal Lee e3b55237b0 Fix misplaced entry in CHANGES.txt 2016-08-18 16:49:53 -05:00
Kihwal Lee 61e1348fe4 HDFS-10763. Open files can leak permanently due to inconsistent lease update. Contributed by Kihwal Lee. 2016-08-18 16:39:35 -05:00
Kihwal Lee 6593851fa6 Revert "HDFS-10763. Open files can leak permanently due to inconsistent lease update. Contributed by Kihwal Lee." 
This reverts commit 71d0e4fca7.
 2016-08-18 13:04:20 -05:00
Zhe Zhang 040a1b7b90 HDFS-7933. fsck should also report decommissioning replicas. Contributed by Xiaoyu Yao. 
(cherry picked from commit 293c763e82)
 2016-08-16 10:35:52 -07:00
Kihwal Lee 9f5a22ff22 HDFS-10270. TestJMXGet:testNameNode() fails. Contributed by Gergely Novák 
(cherry picked from commit d2f3bbc290)
(cherry picked from commit ccaf746eea)
 2016-08-16 10:26:33 -07:00
Mingliang Liu de96efec25 HDFS-10747. o.a.h.hdfs.tools.DebugAdmin usage message is misleading. (Contributed by Mingliang Liu) 2016-08-15 21:10:32 -07:00
Kihwal Lee 71d0e4fca7 HDFS-10763. Open files can leak permanently due to inconsistent lease update. Contributed by Kihwal Lee. 2016-08-15 17:40:07 -05:00
Kihwal Lee 7519956c30 HDFS-9696. Garbage snapshot records linger forever. Adding an entry to CHANGES.txt. 2016-08-15 15:50:54 -05:00
Kihwal Lee e3b809a284 HDFS-9696. Garbage snapshot records linger forever. Contributed by Kihwal Lee 
(cherry picked from commit 83e57e083f)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestSaveNamespace.java

(cherry picked from commit 4766a3153d)
 2016-08-15 13:17:02 -05:00
Zhe Zhang 13414be1a1 HDFS-9888. Allow reseting KerberosName in unit tests. Contributed by Xiao Chen. 
(cherry picked from commit 3e8099a45a)
(cherry picked from commit 00ff3d737c)
(cherry picked from commit 9c1c48c0d4)
 2016-08-11 16:40:02 -07:00
Akira Ajisaka 1038e6b476 HDFS-10336. TestBalancer failing intermittently because of not reseting UserGroupInformation completely. Contributed by Yiqun Lin. 
(cherry picked from commit 932aed64d7)
(cherry picked from commit 0529da7239)
(cherry picked from commit f29d0739d7)
 2016-08-11 16:21:35 -07:00
Zhe Zhang 7f78740885 HDFS-9804. Allow long-running Balancer to login with keytab. Contributed by Xiao Chen. 
(cherry picked from commit ccff6035f5)
(cherry picked from commit 7d402692b4)
(cherry picked from commit b8b4ea67d8)
 2016-08-11 16:18:40 -07:00
Yuanbo Liu e88546596d HDFS-10694. processReport() should print blockReportId in each log message. Contributed by Yuanbo Liu. 
(cherry picked from commit 6dfa4fb16e449a248f2f3cf43a6be59dd8e1ac78)
 2016-08-10 11:14:33 -07:00
Konstantin V Shvachko bfc261f2a0 HDFS-10693. metaSave should print blocks, not LightWeightHashSet. Contributed by Yuanbo Liu. 
(cherry picked from commit 4d3af47f27)
 2016-08-07 15:02:51 -07:00
Konstantin V Shvachko a8886dcc20 HDFS-8780. Follow up commit to add missing lines from porting to branch-2.7. 2016-08-02 13:26:36 -07:00
Konstantin V Shvachko 0c3282b35c Revert "HDFS-10301. Interleaving processing of storages from repeated block reports causes false zombie storage detection, removes valid blocks. Contributed by Vinitha Gankidi." 
This reverts commit a76eb7fa34.
 2016-08-02 10:53:06 -07:00
Vinitha Reddy Gankidi a76eb7fa34 HDFS-10301. Interleaving processing of storages from repeated block reports causes false zombie storage detection, removes valid blocks. Contributed by Vinitha Gankidi. 2016-07-30 17:01:49 -07:00
Akira Ajisaka 379d587d23 HDFS-10691. FileDistribution fails in hdfs oiv command due to ArrayIndexOutOfBoundsException. Contributed by Yiqun Lin. 2016-07-30 08:29:55 +09:00
Vinayakumar B 2371ed0551 HDFS-8682. Should not remove decommissioned node,while calculating the number of live/dead decommissioned node. (Contributed by J. Andreina) 
(cherry picked from commit fdb56f74f3)
 2016-07-29 16:07:33 -07:00
Konstantin V Shvachko fb00663aaa HDFS-8780. Fetching live/dead datanode list with arg true for removeDecommissionNode,returns list with decom node. (Contributed by J.Andreina) 
(cherry picked from commit 2893da4f53)
 2016-07-29 15:56:12 -07:00
Masatake Iwasaki b904a7fd00 HDFS-9601. NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding block. (iwasakims) 2016-07-28 00:45:13 +09:00
Jing Zhao 2a5b8e5b3a HDFS-10653. Optimize conversion from path string to components. Contributed by Daryn Sharp. 
(cherry picked from commit bd3dcf46e2)
(cherry picked from commit 6a7fe835f1)
 2016-07-21 11:30:06 -07:00
Arpit Agarwal c35c1e6703 HDFS-10623. Remove unused import of httpclient.HttpConnection from TestWebHdfsTokens. (Contributed by Hanisha Koneru) 2016-07-14 13:01:15 -07:00
Zhe Zhang c7e1e92c1a HDFS-10544. Balancer doesn't work with IPFailoverProxyProvider. 
(cherry picked from commit 087290e6b1)
(cherry picked from commit 5b4e916b3c)
(cherry picked from commit af94dfaa53)
 2016-07-13 14:36:26 -07:00
Arpit Agarwal 771033babd HADOOP-12570. HDFS Secure Mode Documentation updates. (Arpit Agarwal) 2016-07-13 13:02:01 -07:00
Vinod Kumar Vavilapalli c454639abf HADOOP-13312. Updated CHANGES.txt to reflect all the changes in branch-2.7. Contributed by Akira Ajisaka. 2016-07-12 15:41:22 -07:00
Andrew Wang 5ebebc6524 HDFS-10488. Update WebHDFS documentation regarding CREATE and MKDIR default permissions. Contributed by Wellington Chevreuil. 
(cherry picked from commit 728623242f)
 2016-07-07 10:38:33 -07:00
Brahma Reddy Battula 6a1fc34595 HDFS-9530. ReservedSpace is not cleared for abandoned Blocks (Contributed by Brahma Reddy Battula) 2016-06-21 16:12:46 +05:30
Rohith Sharma K S 0bc531aa8f Adding-release-2.7.4-to-CHANGES.txt 2016-06-21 11:27:13 +05:30
Brahma Reddy Battula be94ed6ceb HDFS-10474. hftp copy fails when file name with Chinese+special char in branch-2 (Contributed by Brahma Reddy Battula) 2016-06-20 12:43:18 +05:30
Arpit Agarwal aca4310f32 HDFS-9906. Remove spammy log spew when a datanode is restarted. (Contributed by Brahma Reddy Battula) 
(cherry picked from commit 02949b2151)
 2016-06-14 23:13:48 -07:00
Vinod Kumar Vavilapalli f4b58eae94 Preparing for 2.7.4 development: Updating snapshot version to 2.7.4 on branch-2.7. 2016-06-14 19:14:02 -07:00
Kihwal Lee 8854cdd9ee HDFS-8581. ContentSummary on / skips further counts on yielding lock (contributed by J.Andreina) 
(cherry picked from commit 4014ce5990)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestQuota.java
 2016-06-14 08:25:09 -05:00
Masatake Iwasaki 5a3fed0602 HDFS-9905. WebHdfsFileSystem#runWithRetry should display original stack trace on error. (Wei-Chiu Chuang via iwasakims) 
cherry-picked from 6fcde2e38d
 2016-06-09 20:48:58 +00:00
Zhe Zhang 9b68eda274 HDFS-10458. getFileEncryptionInfo should return quickly for non-encrypted cluster. 
(cherry picked from commit 6de9213df1)
(cherry picked from commit 06e38c835d)
(cherry picked from commit 0274636529)
 2016-06-06 16:09:14 -07:00
Xiaoyu Yao 97e79662b6 HDFS-8548. Minicluster throws NPE on shutdown. Contributed by surendra singh lilhore. 
(cherry picked from commit 6a76250b39)
 2016-06-03 12:55:31 -07:00
Akira Ajisaka fe08ba439e HDFS-9476. TestDFSUpgradeFromImage#testUpgradeFromRel1BBWImage occasionally fail. Contributed by Masatake Iwasaki. 
(cherry picked from commit 69555fca06)
(cherry picked from commit 3dd557e4b6)
 2016-06-02 18:55:36 +09:00