Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,418 Commits 326 Branches 371 Tags
Commit Graph

2789 Commits

Author SHA1 Message Date
Kihwal Lee
6ae7b9f800 HDFS-10627. Volume Scanner marks a block as "suspect" even if the exception is network-related. Contributed by Rushabh S Shah. 
Updated CHANGES.txt
(cherry picked from commit 5c0bffddc0cb824a8a2751bcd0dc3e15ce081727)
 2016-10-20 11:09:20 -05:00
Brahma Reddy Battula
1e5c40b5b4 HDFS-9444. Add utility to find set of available ephemeral ports to ServerSocketUtil. Contributed by Masatake Iwasaki 
(cherry picked from commit e9a34ae29c7390f3ffcbeee02dc5faa26fca482a)
(cherry picked from commit 5f754e8638d5a35ab12765edec6561228312f71c)
 2016-10-18 10:50:19 -07:00
Konstantin V Shvachko
4aea760676 Update CHANGES.txt for HDFS-10712 and HDFS-10301. (shv) 2016-10-18 10:37:01 -07:00
Masatake Iwasaki
fd3df4bb04 HDFS-9333. Some tests using MiniDFSCluster errored complaining port in use. (iwasakims) 
(cherry picked from commit 964e546ab1dba5f5d53b209ec6c9a70a85654765)

 Conflicts:
  hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlockTokenWithDFSStriped.java

(cherry picked from commit 1b91ebb7145860ecda394d764da5fc7063406fee)
(cherry picked from commit 1524e6320659df7d066ac96fd2c190d7a7c5b932)
 2016-10-18 10:32:16 -07:00
Xiao Chen
d053d1c3ff HDFS-10879. TestEncryptionZonesWithKMS#testReadWrite fails intermittently. Contributed by Xiao Chen. 
(cherry picked from commit d31bef575478fe78c0600fb602e117e4b81c9887)
(cherry picked from commit 11ed4f5d40effcdb26461a393379c6bddaa29bed)
 2016-10-18 10:16:30 -07:00
Yongjun Zhang
b2dfab4326 HDFS-10512. VolumeScanner may terminate due to NPE in DataNode.reportBadBlocks. Contributed by Wei-Chiu Chuang and Yiqun Lin. 
(cherry picked from commit da6f1b88dd47e22b24d44f6fc8bbee73e85746f7)
(cherry picked from commit 96e68e722f0fe99d1609b38377014c04ef5b6640)
 2016-10-18 09:09:06 -07:00
Akira Ajisaka
8eb0b6f39c HDFS-11002. Fix broken attr/getfattr/setfattr links in ExtendedAttributes.md. Contributed by Mingliang Liu. 
(cherry picked from commit 901eca004d0e7e413b109a93128892176c808d61)
(cherry picked from commit 43cf0b29732ebafb8b5b23b06d6015fe4c7777b4)
 2016-10-13 14:32:47 +09:00
Andrew Wang
165febbc84 HDFS-10991. Export hdfsTruncateFile symbol in libhdfs. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit dacd3ec66b111be24131957c986f0c748cf9ea26)
(cherry picked from commit 67f0319db667ed724a3c19cc2ab745ef661fc5f8)
 2016-10-11 15:08:53 -07:00
Tsz-Wo Nicholas Sze
b23b60e7b4 HDFS-8824. Do not use small blocks for balancing the cluster. 
(cherry-picked from commit 61b9e5f7ff15daa0efd09e98efd70351f474c8cb)
 2016-10-07 11:01:29 -07:00
Zhe Zhang
47fcae7da8 HDFS-10745. Directly resolve paths into INodesInPath. Contributed by Daryn Sharp.. 2016-10-06 09:39:59 -07:00
Brahma Reddy Battula
7e241cfcba HADOOP-13670. Update CHANGES.txt to reflect all the changes in branch-2.7. Contributed by Brahma Reddy Battula 2016-10-06 17:56:45 +05:30
Kihwal Lee
3eff0873f6 HDFS-10878. TestDFSClientRetries#testIdempotentAllocateBlockAndClose throws ConcurrentModificationException. Contributed by Rushabh S Shah. 
Modified CHANGES.txt
(cherry picked from commit 382307cbdd94107350fe6fad1acf87d63c9be9d6)
 2016-10-04 11:17:59 -05:00
Brahma Reddy Battula
5c3294d00f HDFS-10889. Remove outdated Fault Injection Framework documentaion. Contributed by Brahma Reddy Battula 
(cherry picked from commit df1d0f5d56f375e82b0219a19675a7b6052aaf30)
 2016-09-27 19:48:32 +05:30
Brahma Reddy Battula
1190f837c8 adding the entry in CHANGE.txt for HDFS-9885 2016-09-27 10:58:31 +05:30
Xiaoyu Yao
d7da70332f HDFS-9019. Adding informative message to sticky bit permission denied exception. Contributed by Xiaoyu Yao. 
(cherry picked from commit 970daaa5e44d3c09afd46d1c8e923a5096708c44)
(cherry picked from commit b2465690a15ee4257b381a8d186ffa6981ddc537)
 2016-09-12 13:16:31 -07:00
Yongjun Zhang
97e4b13038 HDFS-5802. NameNode does not check for inode type before traversing down a path. (Xiao Chen via Yongjun Zhang) 
(cherry picked from commit 9859fd006b638d94c9842a719f12c51159746fc8)
 2016-09-12 12:58:00 -07:00
Kihwal Lee
8593225e85 HDFS-8915. TestFSNamesystem.testFSLockGetWaiterCount fails intermittently. Contributed by Masatake Iwasaki. 
(cherry picked from commit 13fb1b50e608558b2970184908ee5b9fcd7eb7b6)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSNamesystem.java
Updated CHANGES.txt
 2016-08-26 10:09:57 -05:00
Jason Lowe
cec6083055 HDFS-9745. TestSecureNNWithQJM#testSecureMode sometimes fails with timeouts. Contributed by Xiao Chen 
(cherry picked from commit 126d165efd80e266a8309241f3cf059e358f5019)
 2016-08-23 14:51:29 +00:00
Kihwal Lee
d04fd76956 Revert "HDFS-9395. Make HDFS audit logging consistant. Contributed by Kuhu Shukla." 
This reverts commit 25b3531eb40a32a602574e5cfc1ffe028044bcc9.
Reverting HDFS-9395 from branch-2.7 as it is an incompatible change.
 2016-08-18 17:20:20 -05:00
Kihwal Lee
e3b55237b0 Fix misplaced entry in CHANGES.txt 2016-08-18 16:49:53 -05:00
Kihwal Lee
61e1348fe4 HDFS-10763. Open files can leak permanently due to inconsistent lease update. Contributed by Kihwal Lee. 2016-08-18 16:39:35 -05:00
Kihwal Lee
6593851fa6 Revert "HDFS-10763. Open files can leak permanently due to inconsistent lease update. Contributed by Kihwal Lee." 
This reverts commit 71d0e4fca79d4305fe35e44b614703d3b9883017.
 2016-08-18 13:04:20 -05:00
Kihwal Lee
71d0e4fca7 HDFS-10763. Open files can leak permanently due to inconsistent lease update. Contributed by Kihwal Lee. 2016-08-15 17:40:07 -05:00
Kihwal Lee
7519956c30 HDFS-9696. Garbage snapshot records linger forever. Adding an entry to CHANGES.txt. 2016-08-15 15:50:54 -05:00
Akira Ajisaka
379d587d23 HDFS-10691. FileDistribution fails in hdfs oiv command due to ArrayIndexOutOfBoundsException. Contributed by Yiqun Lin. 2016-07-30 08:29:55 +09:00
Masatake Iwasaki
b904a7fd00 HDFS-9601. NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding block. (iwasakims) 2016-07-28 00:45:13 +09:00
Arpit Agarwal
c35c1e6703 HDFS-10623. Remove unused import of httpclient.HttpConnection from TestWebHdfsTokens. (Contributed by Hanisha Koneru) 2016-07-14 13:01:15 -07:00
Vinod Kumar Vavilapalli
c454639abf HADOOP-13312. Updated CHANGES.txt to reflect all the changes in branch-2.7. Contributed by Akira Ajisaka. 2016-07-12 15:41:22 -07:00
Brahma Reddy Battula
6a1fc34595 HDFS-9530. ReservedSpace is not cleared for abandoned Blocks (Contributed by Brahma Reddy Battula) 2016-06-21 16:12:46 +05:30
Rohith Sharma K S
0bc531aa8f Adding-release-2.7.4-to-CHANGES.txt 2016-06-21 11:27:13 +05:30
Brahma Reddy Battula
be94ed6ceb HDFS-10474. hftp copy fails when file name with Chinese+special char in branch-2 (Contributed by Brahma Reddy Battula) 2016-06-20 12:43:18 +05:30
Kihwal Lee
8854cdd9ee HDFS-8581. ContentSummary on / skips further counts on yielding lock (contributed by J.Andreina) 
(cherry picked from commit 4014ce5990bff9b0ecb3d38a633d40eaf6cf07a7)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestQuota.java
 2016-06-14 08:25:09 -05:00
Xiaoyu Yao
97e79662b6 HDFS-8548. Minicluster throws NPE on shutdown. Contributed by surendra singh lilhore. 
(cherry picked from commit 6a76250b39f33466bdc8dabab33070c90aa1a389)
 2016-06-03 12:55:31 -07:00
Akira Ajisaka
fe08ba439e HDFS-9476. TestDFSUpgradeFromImage#testUpgradeFromRel1BBWImage occasionally fail. Contributed by Masatake Iwasaki. 
(cherry picked from commit 69555fca066815053dd9168ebe15868a5c02cdcd)
(cherry picked from commit 3dd557e4b6b852ee99f6acc29cca1088dc3a39ff)
 2016-06-02 18:55:36 +09:00
Kihwal Lee
6e62b6fd83 HDFS-8772. Fix TestStandbyIsHot#testDatanodeRestarts which occasionally fails. Contributed by Walter Su. 
(cherry picked from commit 0c4c7b3b62fd9e58dc8adef42b81b8b96e1f4ab1)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/MiniDFSCluster.java
 2016-05-12 11:26:27 -05:00
Kihwal Lee
0467efcc09 HDFS-10372. Fix for failing TestFsDatasetImpl#testCleanShutdownOfVolume. Contributed by Rushabh Shah. 
(cherry picked from commit b9e5a32fa14b727b44118ec7f43fb95de05a7c2c)
Added a CHANGES.txt entry.
 2016-05-09 15:56:51 -05:00
Masatake Iwasaki
dd8aba3fad HDFS-2043. TestHFlush failing intermittently. Contributed by Lin Yiqun. 2016-05-06 15:57:06 +09:00
Kihwal Lee
6347f8f4d4 HDFS-10347. Namenode report bad block method doesn't log the bad block or datanode. Contributed by Rushabh Shah. 
(cherry picked from commit 7da540d03eccc2f97950bf47e8b35ce8c889d1e0)
Updated CHANGES.txt
 2016-04-29 16:07:20 -05:00
Kihwal Lee
a3ece8b5b4 HDFS-9958. BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages. Contributed by Kuhu Shukla. 2016-04-28 16:47:04 -05:00
Akira Ajisaka
076215024b HDFS-10245. Fix the findbugs warnings in branch-2.7. Contributed by Brahma Reddy Battula. 2016-04-25 22:03:48 +09:00
Kihwal Lee
9e3b91b141 HDFS-9555. LazyPersistFileScrubber should still sleep if there are errors in the clear progress. Contributed by Phil Yang. 
(cherry picked from commit 5d4255a80156d2cacfea8184b41805070223d3a9)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
 2016-04-22 11:47:18 -05:00
Vinayakumar B
b52ac3cb4d Addendum: HDFS-10271. 
Added CHANGES.txt entry
 2016-04-12 11:57:00 +05:30
Kihwal Lee
8e784afb15 Revert "HDFS-8791. block ID-based DN storage layout can be very slow for datanode on ext4. Contributed by Chris Trezzo." 
This reverts commit 9bc9e13a979c775354b2394d926f466a0d5be514.

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2016-04-06 17:35:54 -05:00
Kihwal Lee
9608601330 HDFS-10239. Fsshell mv fails if port usage doesn't match in src and destination paths. Contributed by Kuhu Shukla. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSShell.java

(cherry picked from commit ef3da823573cbf16fd1d84479330dd457f95e0ff)
 2016-04-05 09:20:38 -05:00
Vinayakumar B
fc0ffc48d4 HDFS-9917. IBR accumulate more objects when SNN was down for sometime. (Contributed by Brahma Reddy Battula) 2016-04-05 09:59:37 +08:00
Kihwal Lee
69d4fa0deb HDFS-10178. Permanent write failures can happen if pipeline recoveries occur for the first packet. Contributed by Kihwal Lee. 
(cherry picked from commit a7d1fb0cd2fdbf830602eb4dbbd9bbe62f4d5584)
TestClientProtocolForPipelineRecovery modified to use DFSConfigKeys instead of HdfsClientConfigKeys.
 2016-04-04 16:54:04 -05:00
Kihwal Lee
efb210cc30 Fix CHANGES.txt 2016-03-28 11:31:07 -05:00
Aaron T. Myers
17dbf82f54 HDFS-8101. DFSClient use of non-constant DFSConfigKeys pulls in WebHDFS classes at runtime. Contributed by Sean Busbey. 
(cherry picked from commit 3fe61e0bb0d025a6acbb754027f73f3084b2f4d1)
 2016-03-26 17:54:09 -07:00
Kihwal Lee
a66d2a2a85 HDFS-9874. Long living DataXceiver threads cause volume shutdown to block. Contributed by Rushabh Shah. 
(cherry picked from commit 63c966a3fbeb675959fc4101e65de9f57aecd17d)
(cherry picked from commit 242c7f1fee664b4d609a6c72e899f10816430f65)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/TestFsDatasetImpl.java
 2016-03-18 10:38:33 -05:00
Akira Ajisaka
6902789a92 HDFS-9860. Backport HDFS-9638 to branch-2.7. Contributed by Wei-Chiu Chuang. 2016-03-17 02:59:51 +09:00