Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,616 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

4095 Commits

Author SHA1 Message Date
Arpit Agarwal 3f5482bb69 HDFS-10828. Fix usage of FsDatasetImpl object lock in ReplicaMap. (Arpit Agarwal) 2016-09-27 10:02:27 -07:00
Masatake Iwasaki 756dbc505e HDFS-10426. TestPendingInvalidateBlock failed in trunk. Contributed by Yiqun Lin. 
(cherry picked from commit f55eb981dd)
 2016-09-28 01:47:31 +09:00
Arpit Agarwal a349c54603 HDFS-10713. Throttle FsNameSystem lock warnings. Contributed by Hanisha Koneru. 2016-09-27 09:05:53 -07:00
Brahma Reddy Battula 5bc297c58f HDFS-10889. Remove outdated Fault Injection Framework documentaion. Contributed by Brahma Reddy Battula 
(cherry picked from commit df1d0f5d56)
 2016-09-27 19:35:57 +05:30
Wei-Chiu Chuang f0f3b6a66a HDFS-10609. Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 3ae652f821)
(cherry picked from commit bde787db23)
 2016-09-26 14:46:02 -07:00
Brahma Reddy Battula 17b66c894b HDFS-10869. Remove the unused method InodeId#checkId(). Contributed by Jagadesh Kiran N 
(cherry picked from commit 3e37e243ee)
 2016-09-25 11:07:21 +05:30
Wei-Chiu Chuang 367d5b2a7e HDFS-10876. Dispatcher#dispatch should log IOException stacktrace. Contributed by Manoj Govindassamy. 
(cherry picked from commit 74b3dd514c)
(cherry picked from commit 6c98455728)
 2016-09-23 13:28:59 -07:00
Konstantin V Shvachko 20540df80d HDFS-10843. Update space quota when a UC block is completed rather than committed. Contributed by Erik Krogen. 
(cherry picked from commit a5bb88c8e0)
 2016-09-23 10:49:26 -07:00
Brahma Reddy Battula aa967869a5 HDFS-10886. Replace fs.default.name with fs.defaultFS in viewfs document. 
(cherry picked from commit bbdf350ff9)
 2016-09-23 19:35:34 +05:30
Masatake Iwasaki 1524e63206 HDFS-9333. Some tests using MiniDFSCluster errored complaining port in use. (iwasakims) 
(cherry picked from commit 964e546ab1)

 Conflicts:
  hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlockTokenWithDFSStriped.java

(cherry picked from commit 1b91ebb714)
 2016-09-21 10:52:00 +09:00
Xiao Chen 11ed4f5d40 HDFS-10879. TestEncryptionZonesWithKMS#testReadWrite fails intermittently. Contributed by Xiao Chen. 
(cherry picked from commit d31bef575478fe78c0600fb602e117e4b81c9887)
 2016-09-20 16:57:44 -07:00
Xiao Chen e7daeea711 HDFS-10875. Optimize du -x to cache intermediate result. Contributed by Xiao Chen. 
(cherry picked from commit e52d6e7a46)
 2016-09-19 21:45:09 -07:00
Xiao Chen 900dc70a01 HDFS-10489. Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones. Contributed by Xiao Chen. 
(cherry picked from commit ea839bd48e)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/HdfsConfiguration.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml

(cherry picked from commit 20585ade1d9d7fbd8b9df8b1e3db5a74fd4441a6)
 2016-09-19 16:38:00 -07:00
Andrew Wang 8c24388af0 HDFS-10832. Propagate ACL bit and isEncrypted bit in HttpFS FileStatus permissions. 
(cherry picked from commit cba973f036)
(cherry picked from commit f448ce2a89)
 2016-09-19 16:38:00 -07:00
Akira Ajisaka ab57c869e2 HDFS-10862. Typos in 4 log messages. Contributed by Mehran Hassani. 
(cherry picked from commit b09a03cd7d)
(cherry picked from commit 214b6d16d5)
 2016-09-16 16:13:00 +09:00
Arpit Agarwal bdc71bd608 HDFS-10805. Reduce runtime for append test. Contributed by Gergely Novak. 2016-09-14 09:31:35 -07:00
Akira Ajisaka c06cf0f89c HDFS-10856. Update the comment of BPServiceActor$Scheduler#scheduleNextBlockReport. Contributed by Yiqun Lin. 
(cherry picked from commit f0876b8b60)
(cherry picked from commit 764cf431ca)
 2016-09-13 14:51:29 +09:00
Yongjun Zhang b96e2cbd20 HDFS-10657. testAclCLI.xml setfacl test should expect mask r-x. (John Zhuge via Yongjun Zhang) 
(cherry picked from commit d2466ec3e0)
 2016-09-12 22:13:17 -07:00
Xiao Chen 76a18915bf HDFS-9781. FsDatasetImpl#getBlockReports can occasionally throw NullPointerException. Contributed by Manoj Govindassamy. 
(cherry picked from commit bb6d866207)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
 2016-09-10 23:14:22 -07:00
Arpit Agarwal ed35f99045 HDFS-10830. FsDatasetImpl#removeVolumes crashes with IllegalMonitorStateException when vol being removed is in use. (Arpit Agarwal and Manoj Govindassamy) 2016-09-10 18:34:28 -07:00
Arpit Agarwal 04f620c4d0 HDFS-10742. Measure lock time in FsDatasetImpl. Contributed by Chen Liang. 2016-09-10 18:01:37 -07:00
Andrew Wang 912631a226 HDFS-10831. Add log when URLConnectionFactory.openConnection failed. Contributed by yunjiong zhao. 
(cherry picked from commit b07c266dca)
(cherry picked from commit 72ea641468)
 2016-09-08 18:30:36 -07:00
Arpit Agarwal 162ee0f0a4 HDFS-9038. DFS reserved space is erroneously counted towards non-DFS used. (Brahma Reddy Battula) 2016-09-06 13:52:05 -07:00
Xiao Chen e84b5c5e3e HDFS-10841. Remove duplicate or unused variable in appendFile(). Contributed by Kihwal Lee. 
(cherry picked from commit f6c0b7543f)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirAppendOp.java

(cherry picked from commit 3025992bd3)
 2016-09-06 11:54:02 -07:00
Andrew Wang 9b7e079d4b HDFS-10833. Fix JSON errors in WebHDFS.md examples. 
(cherry picked from commit cbd909ce2a)
(cherry picked from commit 40eab77562)
 2016-09-02 14:51:12 -07:00
Kihwal Lee 16c166249c HDFS-10772. Reduce byte/string conversions for get listing. Contributed by Daryn Sharp. 
(cherry picked from commit a1f3293762)
 2016-09-02 12:32:34 -05:00
Kihwal Lee 1c946a2665 HDFS-10768. Optimize mkdir ops. Contributed by Daryn Sharp. 
(cherry picked from commit 442dfd1bbe)
 2016-09-02 12:28:11 -05:00
Kihwal Lee bf350e4480 HDFS-10762. Pass IIP for file status related methods 
(cherry picked from commit a30f6a68fa)
 2016-09-02 12:23:21 -05:00
Kihwal Lee c2708bc5fb HDFS-9621. Consolidate FSDirStatAndListingOp#createFileStatus to let its INodesInPath parameter always include the target INode. Contributed by Jing Zhao. 
(cherry picked from commit 313f03bfda)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
 2016-09-02 12:16:08 -05:00
Kihwal Lee 69bdcd9b1e HDFS-10745. Directly resolve paths into INodesInPath. Contributed by Daryn Sharp. 
(cherry picked from commit 922d045e11)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirWriteFileOp.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFsck.java
 2016-09-02 11:44:01 -05:00
Kihwal Lee 3dac73080a HDFS-10744. Internally optimize path component resolution. Contributed by Daryn Sharp. 
(cherry picked from commit 1ef8d7a638)
 2016-09-02 11:31:48 -05:00
Kihwal Lee 5a779cce8e HDFS-10711. Optimize FSPermissionChecker group membership check. Contributed by Daryn Sharp. 
(cherry picked from commit 43d1279df0)
 2016-09-02 11:24:20 -05:00
Kihwal Lee f09b04b3f5 HDFS-10673. Optimize FSPermissionChecker's internal path usage. Contributed by Daryn Sharp. 
(cherry picked from commit 438a9f047e)
(cherry picked from commit 09b06a6e9e)
 2016-09-01 17:03:48 -07:00
Zhe Zhang 08b6808489 Addendum fix for HDFS-10817 to fix failure of the added testFSReadLockLongHoldingReport in branch-2. 
(cherry picked from commit 6c600360ca)
(cherry picked from commit 776eccd873)
 2016-08-31 23:45:45 -07:00
Zhe Zhang 7adbd569a6 HDFS-10817. Add Logging for Long-held NN Read Locks. Contributed by Erik Krogen. 
(cherry picked from commit 6f4b0d33ca)
(cherry picked from commit f87e2f5d05)
 2016-08-31 15:54:46 -07:00
Kihwal Lee e53f6fde46 HDFS-10674. Optimize creating a full path from an inode. Contributed by Daryn Sharp. 
(cherry picked from commit 22ef5286bc)
(cherry picked from commit a5d12d9c1f)
 2016-08-31 15:16:07 -07:00
Kihwal Lee 7b5e12229d HDFS-10656. Optimize conversion of byte arrays back to path string. Contributed by Daryn Sharp. 
(cherry picked from commit bebf10d245)
(cherry picked from commit ab7072838f)
 2016-08-31 15:11:27 -07:00
Kihwal Lee ce902fc80a HDFS-10729. Improve log message for edit loading failures caused by FS limit checks. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 01721dd88e)
 2016-08-31 14:12:02 -05:00
Wei-Chiu Chuang 80bb9ffb67 HDFS-10760. DataXceiver#run() should not log InvalidToken exception as an error. Contributed by Pan Yuxuan. 
(cherry picked from commit c4ee6915a1)
 2016-08-30 10:44:48 -07:00
Zhe Zhang ee28034a8a HDFS-10814. Add assertion for getNumEncryptionZones when no EZ is created. Contributed by Vinitha Reddy Gankidi. 
(cherry picked from commit 4bd45f54ee)
 2016-08-29 23:43:04 -07:00
Xiao Chen a291306510 HDFS-4210. Throw helpful exception when DNS entry for JournalNode cannot be resolved. Contributed by Charles Lamb and John Zhuge. 
(cherry picked from commit 046f6bf0f944311fc70de3a96fc6ab8211cbbbd8)
 2016-08-29 17:42:30 -07:00
Yongjun Zhang 18f7628664 HDFS-10625. VolumeScanner to report why a block is found bad. Contributed by Rushabh S Shah and Yiqun Lin. 
(cherry picked from commit 5d1609ddf2)
 2016-08-29 14:15:23 -07:00
Mingliang Liu f84ae6f091 HDFS-10807. Doc about upgrading to a version of HDFS with snapshots may be confusing. (Contributed by Mingliang Liu) 
(cherry picked from commit 6742fb6e68)
 2016-08-29 10:19:53 -07:00
Yongjun Zhang 6f10a0a87b HDFS-10652. Add a unit test for HDFS-4660. Contributed by Vinayakumar B., Wei-Chiu Chuang, Yongjun Zhang. 
(cherry picked from commit c25817159a)
 2016-08-27 23:11:57 -07:00
Andrew Wang 42e03d7bfe HDFS-10793. Fix HdfsAuditLogger binary incompatibility introduced by HDFS-9184. Contributed by Manoj Govindassamy. 
(cherry picked from commit a445b82baa)
(cherry picked from commit 1c47a356d8)
 2016-08-26 15:40:13 -07:00
Zhe Zhang 96cf681b5d HDFS-10798. Make the threshold of reporting FSNamesystem lock contention configurable. Contributed by Erik Krogen. 
(cherry picked from commit 407b519fb1)
(cherry picked from commit f3a4cbcc60)
 2016-08-26 14:23:51 -07:00
Kihwal Lee 1c5ecb6cc4 HDFS-8915. TestFSNamesystem.testFSLockGetWaiterCount fails intermittently. Contributed by Masatake Iwasaki. 
(cherry picked from commit 13fb1b50e6)
 2016-08-26 10:01:19 -05:00
Xiaoyu Yao db415ea166 HDFS-10748. TestFileTruncate#testTruncateWithDataNodesRestart runs sometimes timeout. Contributed by Yiqun Lin. 
(cherry picked from commit 4da5000dd3)
 2016-08-25 09:22:16 -07:00
Wei-Chiu Chuang bd729af8a8 HDFS-8986. Add option to -du to calculate directory space usage excluding snapshots. Contributed by Xiao Chen. 2016-08-24 08:53:43 -07:00
Zhe Zhang 8bc33bf343 HADOOP-12765. HttpServer2 should switch to using the non-blocking SslSelectChannelConnector to prevent performance degradation when handling SSL connections. Contributed by Min Shen. Branch-2 patch contributed by Wei-Chiu Chuang. 
(cherry picked from commit dfcbc12026)
 2016-08-23 14:46:47 -07:00