Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,507 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

2817 Commits

Author SHA1 Message Date
Zhe Zhang bec23593b5 HDFS-11709. StandbyCheckpointer should handle an non-existing legacyOivImageDir gracefully. Contributed by Erik Krogen. 
(cherry picked from commit d8a3309830)
(cherry picked from commit fc46f398d9)
(cherry picked from commit 70f18911c7)
 2017-04-27 09:56:14 -07:00
Brahma Reddy Battula ac12063eeb HDFS-10455. Logging the username when deny the setOwner operation. Contributed by Rakesh R. 
(cherry picked from commit 1c5708f6de)
(cherry picked from commit c895f08936)
 2017-04-26 15:59:21 -07:00
Konstantin V Shvachko 54bbdb4c02 Update CHANGES.txt for HDFS-11634. 2017-04-18 13:20:21 -07:00
Zhe Zhang ccd24f0917 HDFS-11615. FSNamesystemLock metrics can be inaccurate due to millisecond precision. Contributed by Erik Krogen. 
(cherry picked from commit ad49098eb3)
(cherry picked from commit 051ab77806)
(cherry picked from commit 07047335a3)
 2017-04-17 16:55:24 -07:00
Masatake Iwasaki 0ece3c8dd9 HDFS-11486. Client close() should not fail fast if the last block is being decommissioned. Contributed by Wei-Chiu Chuang and Yiqun Lin. 
(cherry picked from commit ca3ede5fda)
 2017-03-28 18:17:45 +09:00
Wei-Chiu Chuang 830a602375 HDFS-11499. Decommissioning stuck because of failing recovery. Contributed by Lukas Majercak and Manoj Govindassamy. 
(cherry picked from commit 385d2cb777)

 Conflicts:
    hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java

(cherry picked from commit 60be2e5d8a)

 Conflicts:
    hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
 2017-03-13 13:45:12 -07:00
Zhe Zhang 33f4263345 HDFS-11466. Change dfs.namenode.write-lock-reporting-threshold-ms default from 1000ms to 5000ms. Contributed by Andrew Wang. 
(cherry picked from commit d269b488a7)
(cherry picked from commit 5fb785e154)
(cherry picked from commit 265ddb20c3)
 2017-02-28 09:07:23 -08:00
Xiao Chen c2a4ce7717 HDFS-11379. DFSInputStream may infinite loop requesting block locations. Contributed by Daryn Sharp. 2017-02-17 15:38:55 -08:00
Wei-Chiu Chuang f133e0161c HDFS-11333. Print a user friendly error message when plugins are not found. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 859bd159ae)
(cherry picked from commit a8531d5d52)
(cherry picked from commit 4c47cb68e8)
 2017-02-15 03:05:01 -08:00
Zhe Zhang 03a67e1e62 HDFS-10534. NameNode WebUI should display DataNode usage histogram. Contributed by Kai Sasaki. 2017-01-26 10:34:00 -08:00
Akira Ajisaka ab62484240 HDFS-11352. Add missing entry in CHANGES.txt. 2017-01-24 14:57:21 +09:00
Akira Ajisaka b0b3966851 HDFS-11290. TestFSNameSystemMBean should wait until JMX cache is cleared. Contributed by Erik Krogen. 
(cherry picked from commit b1a9ec856b)
(cherry picked from commit db47bd15dd)
 2017-01-24 14:19:21 +09:00
Brahma Reddy Battula 3e0bd9951f HDFS-11263. ClassCastException when we use Bzipcodec for Fsimage compression. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 1b401f6a73)
 2016-12-20 21:30:18 +05:30
Wei-Chiu Chuang bbf380a493 HDFS-11160. VolumeScanner reports write-in-progress replicas as corrupt incorrectly. Contributed by Wei-Chiu Chuang and Yongjun Zhang. 
(cherry picked from commit 0cb99db9d9)

Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockScanner.java

(cherry picked from commit 18be0447cde622dfaaad27f7c2b9cccb30469fef)

Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/FsVolumeSpi.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsVolumeImpl.java
 2016-12-16 13:40:20 -08:00
Wei-Chiu Chuang 2123b664ca HDFS-11229. HDFS-11056 failed to close meta file. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 292bd78b44)
(cherry picked from commit fa3b2bee61)
 2016-12-10 09:34:05 -08:00
Akira Ajisaka 6d8df4e81e HDFS-11180. Intermittent deadlock in NameNode when failover happens. 2016-12-03 11:11:50 +09:00
Akira Ajisaka c594904eca HDFS-11174. Wrong HttpFS test command in doc. Contributed by John Zhuge. 
(cherry picked from commit bb1b5e083b)
(cherry picked from commit 6fe5ffd05d)
 2016-11-25 21:31:11 +09:00
Kihwal Lee 01ad9dee08 HDFS-10966. Enhance Dispatcher logic on deciding when to give up a source DataNode. Contributed by Mark Wagner and Zhe Zhang. 2016-11-21 16:58:12 -06:00
Konstantin V Shvachko f6e517c6cc Updated CHANGES.txt for HDFS-11087. 2016-11-15 11:10:44 -08:00
Zhe Zhang ec0f854ba0 Add CHANGES.txt entry for HDFS-10872. 2016-11-14 23:14:35 -08:00
Wei-Chiu Chuang 81bf6f2834 HDFS-11056. Concurrent append and read operations lead to checksum error. Contributed by Wei-Chiu Chuang. 2016-11-14 11:57:51 -08:00
Anu Engineer 95edf265b3 HDFS-8307. Spurious DNS Queries from hdfs shell. Contributed by Andres Perez 2016-11-10 14:38:53 -08:00
Zhe Zhang 49f059125a Addendum of HDFS-8709: update CHANGES.TXT. 2016-10-31 15:17:21 -07:00
Andrew Wang 85708329c8 HDFS-8709. Clarify automatic sync in FSEditLog#logEdit. 
(cherry picked from commit 5fddc5177d)
(cherry picked from commit efe9ae9fc6)
(cherry picked from commit 3b8cc7c21615d07e62251fd1b9c80f696f590a8f)
 2016-10-31 15:08:52 -07:00
Erik Krogen d002e4d10b HDFS-9500. Fix software version counts for DataNodes during rolling upgrade. Contributed by Erik Krogen. 
(cherry picked from commit f3ac1f41b8)
 2016-10-27 16:10:26 -07:00
Kihwal Lee a49510f697 HDFS-11069. Tighten the authorization of datanode RPC. Contributed by Kihwal Lee 
Updated CHANGES.txt
(cherry picked from commit ae48c496dc)
 2016-10-27 14:23:20 -05:00
Kihwal Lee fdd645be6b HDFS-11053. Unnecessary superuser check in versionRequest(). Contributed by Kihwal Lee. 
Updated CHANGES.txt
(cherry picked from commit e90af4a89b)
 2016-10-26 09:19:45 -05:00
Zhe Zhang c05d701161 HDFS-11015. Enforce timeout in balancer. Contributed by Kihwal Lee. 
(cherry picked from commit f6367c5f44)
(cherry picked from commit ff806cbfc7)
(cherry picked from commit 262518fa5b)
 2016-10-25 11:50:51 -07:00
Kihwal Lee 6ae7b9f800 HDFS-10627. Volume Scanner marks a block as "suspect" even if the exception is network-related. Contributed by Rushabh S Shah. 
Updated CHANGES.txt
(cherry picked from commit 5c0bffddc0)
 2016-10-20 11:09:20 -05:00
Brahma Reddy Battula 1e5c40b5b4 HDFS-9444. Add utility to find set of available ephemeral ports to ServerSocketUtil. Contributed by Masatake Iwasaki 
(cherry picked from commit e9a34ae29c)
(cherry picked from commit 5f754e8638)
 2016-10-18 10:50:19 -07:00
Konstantin V Shvachko 4aea760676 Update CHANGES.txt for HDFS-10712 and HDFS-10301. (shv) 2016-10-18 10:37:01 -07:00
Masatake Iwasaki fd3df4bb04 HDFS-9333. Some tests using MiniDFSCluster errored complaining port in use. (iwasakims) 
(cherry picked from commit 964e546ab1)

 Conflicts:
  hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlockTokenWithDFSStriped.java

(cherry picked from commit 1b91ebb714)
(cherry picked from commit 1524e63206)
 2016-10-18 10:32:16 -07:00
Xiao Chen d053d1c3ff HDFS-10879. TestEncryptionZonesWithKMS#testReadWrite fails intermittently. Contributed by Xiao Chen. 
(cherry picked from commit d31bef575478fe78c0600fb602e117e4b81c9887)
(cherry picked from commit 11ed4f5d40)
 2016-10-18 10:16:30 -07:00
Yongjun Zhang b2dfab4326 HDFS-10512. VolumeScanner may terminate due to NPE in DataNode.reportBadBlocks. Contributed by Wei-Chiu Chuang and Yiqun Lin. 
(cherry picked from commit da6f1b88dd)
(cherry picked from commit 96e68e722f)
 2016-10-18 09:09:06 -07:00
Akira Ajisaka 8eb0b6f39c HDFS-11002. Fix broken attr/getfattr/setfattr links in ExtendedAttributes.md. Contributed by Mingliang Liu. 
(cherry picked from commit 901eca004d)
(cherry picked from commit 43cf0b2973)
 2016-10-13 14:32:47 +09:00
Andrew Wang 165febbc84 HDFS-10991. Export hdfsTruncateFile symbol in libhdfs. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit dacd3ec66b)
(cherry picked from commit 67f0319db6)
 2016-10-11 15:08:53 -07:00
Tsz-Wo Nicholas Sze b23b60e7b4 HDFS-8824. Do not use small blocks for balancing the cluster. 
(cherry-picked from commit 61b9e5f7ff)
 2016-10-07 11:01:29 -07:00
Zhe Zhang 47fcae7da8 HDFS-10745. Directly resolve paths into INodesInPath. Contributed by Daryn Sharp.. 2016-10-06 09:39:59 -07:00
Brahma Reddy Battula 7e241cfcba HADOOP-13670. Update CHANGES.txt to reflect all the changes in branch-2.7. Contributed by Brahma Reddy Battula 2016-10-06 17:56:45 +05:30
Kihwal Lee 3eff0873f6 HDFS-10878. TestDFSClientRetries#testIdempotentAllocateBlockAndClose throws ConcurrentModificationException. Contributed by Rushabh S Shah. 
Modified CHANGES.txt
(cherry picked from commit 382307cbdd)
 2016-10-04 11:17:59 -05:00
Brahma Reddy Battula 5c3294d00f HDFS-10889. Remove outdated Fault Injection Framework documentaion. Contributed by Brahma Reddy Battula 
(cherry picked from commit df1d0f5d56)
 2016-09-27 19:48:32 +05:30
Brahma Reddy Battula 1190f837c8 adding the entry in CHANGE.txt for HDFS-9885 2016-09-27 10:58:31 +05:30
Xiaoyu Yao d7da70332f HDFS-9019. Adding informative message to sticky bit permission denied exception. Contributed by Xiaoyu Yao. 
(cherry picked from commit 970daaa5e4)
(cherry picked from commit b2465690a1)
 2016-09-12 13:16:31 -07:00
Yongjun Zhang 97e4b13038 HDFS-5802. NameNode does not check for inode type before traversing down a path. (Xiao Chen via Yongjun Zhang) 
(cherry picked from commit 9859fd006b)
 2016-09-12 12:58:00 -07:00
Kihwal Lee 8593225e85 HDFS-8915. TestFSNamesystem.testFSLockGetWaiterCount fails intermittently. Contributed by Masatake Iwasaki. 
(cherry picked from commit 13fb1b50e6)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSNamesystem.java
Updated CHANGES.txt
 2016-08-26 10:09:57 -05:00
Jason Lowe cec6083055 HDFS-9745. TestSecureNNWithQJM#testSecureMode sometimes fails with timeouts. Contributed by Xiao Chen 
(cherry picked from commit 126d165efd)
 2016-08-23 14:51:29 +00:00
Kihwal Lee d04fd76956 Revert "HDFS-9395. Make HDFS audit logging consistant. Contributed by Kuhu Shukla." 
This reverts commit 25b3531eb4.
Reverting HDFS-9395 from branch-2.7 as it is an incompatible change.
 2016-08-18 17:20:20 -05:00
Kihwal Lee e3b55237b0 Fix misplaced entry in CHANGES.txt 2016-08-18 16:49:53 -05:00
Kihwal Lee 61e1348fe4 HDFS-10763. Open files can leak permanently due to inconsistent lease update. Contributed by Kihwal Lee. 2016-08-18 16:39:35 -05:00
Kihwal Lee 6593851fa6 Revert "HDFS-10763. Open files can leak permanently due to inconsistent lease update. Contributed by Kihwal Lee." 
This reverts commit 71d0e4fca7.
 2016-08-18 13:04:20 -05:00