Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,083 Commits 326 Branches 371 Tags
Commit Graph

4197 Commits

Author SHA1 Message Date
Arpit Agarwal
50888471d9 HDFS-10824. MiniDFSCluster#storageCapacities has no effects on real capacity. Contributed by Xiaobing Zhou. 2016-09-28 15:56:08 -07:00
Brahma Reddy Battula
e9a34ae29c HDFS-9444. Add utility to find set of available ephemeral ports to ServerSocketUtil. Contributed by Masatake Iwasaki 2016-09-28 10:50:50 +05:30
Mingliang Liu
54ca505c41 HDFS-10915. Fix time measurement bug in TestDatanodeRestart. Contributed by Xiaobing Zhou 
(cherry picked from commit 6437ba18c5c26bc271a63aff5ea03756f43dd9a3)
 2016-09-27 20:42:47 -07:00
Wangda Tan
269401dc83 HADOOP-13544. JDiff reports unncessarily show unannotated APIs and cause confusion while our javadocs only show annotated and public APIs. (vinodkv via wangda) 
(cherry picked from commit 875062b5bc789158290bf93dadc71b5328ca4fee)
 2016-09-27 11:27:25 -07:00
Arpit Agarwal
80628ee2c3 HDFS-10828. Fix usage of FsDatasetImpl object lock in ReplicaMap. (Arpit Agarwal) 2016-09-27 10:02:22 -07:00
Masatake Iwasaki
d17f03b625 HDFS-10426. TestPendingInvalidateBlock failed in trunk. Contributed by Yiqun Lin. 
(cherry picked from commit f55eb981dd408ca61d49488f83c99c1fc1f83134)
 2016-09-28 01:40:55 +09:00
Arpit Agarwal
b3c0656e90 HDFS-10713. Throttle FsNameSystem lock warnings. Contributed by Hanisha Koneru. 2016-09-27 09:00:39 -07:00
Brahma Reddy Battula
61368c8039 HDFS-10889. Remove outdated Fault Injection Framework documentaion. Contributed by Brahma Reddy Battula 
(cherry picked from commit df1d0f5d56f375e82b0219a19675a7b6052aaf30)
 2016-09-27 19:34:38 +05:30
Arpit Agarwal
809a45a60c HDFS-9895. Remove unnecessary conf cache from DataNode. Contributed by Xiaobing Zhou. 2016-09-26 19:24:16 -07:00
Wei-Chiu Chuang
bde787db23 HDFS-10609. Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 3ae652f82110a52bf239f3c1849b48981558eb19)
 2016-09-26 14:44:48 -07:00
Brahma Reddy Battula
74962e3451 HDFS-10869. Remove the unused method InodeId#checkId(). Contributed by Jagadesh Kiran N 
(cherry picked from commit 3e37e243ee041e843e060b17c622ab50c8f9ff11)
 2016-09-25 11:04:30 +05:30
Wei-Chiu Chuang
6c98455728 HDFS-10876. Dispatcher#dispatch should log IOException stacktrace. Contributed by Manoj Govindassamy. 
(cherry picked from commit 74b3dd514c86b46197e2e19d9824a423715cab30)
 2016-09-23 13:28:18 -07:00
Konstantin V Shvachko
c872ecaab4 HDFS-10843. Update space quota when a UC block is completed rather than committed. Contributed by Erik Krogen. 
(cherry picked from commit a5bb88c8e0fd4bd19b6d377fecbe1d2d441514f6)
 2016-09-23 10:40:09 -07:00
Brahma Reddy Battula
347131fe8d HDFS-10886. Replace fs.default.name with fs.defaultFS in viewfs document. 
(cherry picked from commit bbdf350ff9fb624fe736c1eb9271c5dcb4e14b06)
 2016-09-23 19:32:37 +05:30
Masatake Iwasaki
1b91ebb714 HDFS-9333. Some tests using MiniDFSCluster errored complaining port in use. (iwasakims) 
(cherry picked from commit 964e546ab1dba5f5d53b209ec6c9a70a85654765)

 Conflicts:
  hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlockTokenWithDFSStriped.java
 2016-09-21 10:40:56 +09:00
Xiao Chen
81df2be017 HDFS-10879. TestEncryptionZonesWithKMS#testReadWrite fails intermittently. Contributed by Xiao Chen. 
(cherry picked from commit d31bef575478fe78c0600fb602e117e4b81c9887)
 2016-09-20 16:57:34 -07:00
Xiao Chen
4e376f162f HDFS-10875. Optimize du -x to cache intermediate result. Contributed by Xiao Chen. 
(cherry picked from commit e52d6e7a46ceef74dd8d8a3d49c49420e3271365)
 2016-09-19 21:45:05 -07:00
Xiao Chen
b6a60d715d HDFS-10489. Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones. Contributed by Xiao Chen. 
(cherry picked from commit ea839bd48e4478fc7b6d0a69e0eaeae2de5e0f0d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/HdfsConfiguration.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
 2016-09-19 16:38:18 -07:00
Andrew Wang
b03a0be7a3 HDFS-10823. Implement HttpFSFileSystem#listStatusIterator. 
(cherry picked from commit 8a40953058d50d421d62b71067a13b626b3cba1f)
 2016-09-16 15:37:49 -07:00
Akira Ajisaka
214b6d16d5 HDFS-10862. Typos in 4 log messages. Contributed by Mehran Hassani. 
(cherry picked from commit b09a03cd7d26cf96ec26a81ba11f00778241eb3e)
 2016-09-16 16:12:19 +09:00
Arpit Agarwal
853e1e6946 HDFS-10805. Reduce runtime for append test. Contributed by Gergely Novak. 2016-09-14 09:31:24 -07:00
Andrew Wang
abaad976cd HDFS-10837. Standardize serializiation of WebHDFS DirectoryListing. 
(cherry picked from commit db6d243cf89d25fefbffd4c8721e14d9246b5a16)
 2016-09-13 11:02:43 -07:00
Akira Ajisaka
764cf431ca HDFS-10856. Update the comment of BPServiceActor$Scheduler#scheduleNextBlockReport. Contributed by Yiqun Lin. 
(cherry picked from commit f0876b8b60c19aa25e0417ac0f419a3a82bf210b)
 2016-09-13 14:51:04 +09:00
Yongjun Zhang
223ce108a1 HDFS-10657. testAclCLI.xml setfacl test should expect mask r-x. (John Zhuge via Yongjun Zhang) 
(cherry picked from commit d2466ec3e01b5ef2a0bde738232c5ad6d2d956eb)
 2016-09-12 21:46:09 -07:00
Arpit Agarwal
6948691ad1 HDFS-10830. FsDatasetImpl#removeVolumes crashes with IllegalMonitorStateException when vol being removed is in use. (Arpit Agarwal and Manoj Govindassamy) 2016-09-10 18:22:15 -07:00
Arpit Agarwal
012b266e5e HDFS-10742. Measure lock time in FsDatasetImpl. Contributed by Chen Liang. 2016-09-10 18:04:00 -07:00
Arpit Agarwal
ad0ac6cced HDFS-10682. Replace FsDatasetImpl object lock with a separate lock object. (Contributed by Chen Liang) 2016-09-10 17:48:27 -07:00
Xiao Chen
bb6d866207 HDFS-9781. FsDatasetImpl#getBlockReports can occasionally throw NullPointerException. Contributed by Manoj Govindassamy. 2016-09-09 18:25:35 -07:00
Andrew Wang
f448ce2a89 HDFS-10832. Propagate ACL bit and isEncrypted bit in HttpFS FileStatus permissions. 
(cherry picked from commit cba973f036a2c8fcc21a5826b8306247ec154c7b)
 2016-09-09 12:16:08 -07:00
Andrew Wang
72ea641468 HDFS-10831. Add log when URLConnectionFactory.openConnection failed. Contributed by yunjiong zhao. 
(cherry picked from commit b07c266dca7f303c793b432a0738d593728cf2b3)
 2016-09-08 18:30:26 -07:00
Akira Ajisaka
c0756dfef6 HDFS-10847. Complete the document for FileDistribution processor in OfflineImageViewer. Contributed by Yiqun Lin. 
(cherry picked from commit 20a20c2f6e1b3b8aa6a58a824ad3aadc349dc761)
 2016-09-09 01:35:36 +09:00
Akira Ajisaka
fe6dd66174 HDFS-10778. Add -format option to make the output of FileDistribution processor human-readable in OfflineImageViewer. 
(cherry picked from commit 63f594892ecd4687e37a99790288e36eb278849f)
 2016-09-08 15:18:25 +09:00
Arpit Agarwal
f9415b7a7e HDFS-9038. DFS reserved space is erroneously counted towards non-DFS used. (Brahma Reddy Battula) 2016-09-06 13:44:22 -07:00
Xiao Chen
3025992bd3 HDFS-10841. Remove duplicate or unused variable in appendFile(). Contributed by Kihwal Lee. 
(cherry picked from commit f6c0b7543f612de756ff0c03e9a2c6e33b496a36)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirAppendOp.java
 2016-09-06 11:52:30 -07:00
Andrew Wang
40eab77562 HDFS-10833. Fix JSON errors in WebHDFS.md examples. 
(cherry picked from commit cbd909ce2a5ac1da258f756fa1f93e84dd20b926)
 2016-09-02 14:50:41 -07:00
Lei Xu
d6bfb2176c HDFS-10822. Log DataNodes in the write pipeline. John Zhuge via Lei Xu 
(cherry picked from commit 5a8c5064d1a1d596b1f5c385299a86ec6ab9ad1e)
 2016-09-02 11:02:38 -07:00
Allen Wittenauer
b1466b8124 HDFS-9877. HDFS Namenode UI: Fix browsing directories that need to be encoded (Ravi Prakash via aw) 
(cherry picked from commit 15f018434c5b715729488fd0b03a11f1bc943470)
 2016-09-01 14:24:13 -07:00
Allen Wittenauer
b9eedc24a6 HDFS-7987. Allow files / directories to be moved (Ravi Prakash via aw) 
(cherry picked from commit d44f4745b4a186dd06dd6837a85ad90a237d7d97)
 2016-09-01 14:23:42 -07:00
Allen Wittenauer
743c0ebd67 HDFS-7767. Use the noredirect flag in WebHDFS to allow web browsers to upload files via the NN UI (Ravi Prakash via aw) 
(cherry picked from commit 99a771cd7a3f792a76ac89c406b82a983c059d28)
 2016-09-01 14:22:23 -07:00
Zhe Zhang
776eccd873 Addendum fix for HDFS-10817 to fix failure of the added testFSReadLockLongHoldingReport in branch-2. 
(cherry picked from commit 6c600360ca469d5fe0f017d681585db06c80c9cc)
 2016-08-31 23:44:54 -07:00
Zhe Zhang
f87e2f5d05 HDFS-10817. Add Logging for Long-held NN Read Locks. Contributed by Erik Krogen. 
(cherry picked from commit 6f4b0d33ca339e3724623a1d23c101f8cfd3cdd5)
 2016-08-31 15:54:03 -07:00
Andrew Wang
72d90cbe32 HDFS-10784. Implement WebHdfsFileSystem#listStatusIterator. 
(cherry picked from commit 85bab5fb572194fda38854f1f21c670925058009)
 2016-08-31 14:33:14 -07:00
Allen Wittenauer
72334a4be3 HDFS-7766. Add a flag to WebHDFS op=CREATE to not respond with a 307 redirect (Ravi Prakash via aw) 
(cherry picked from commit 4b0f55b6ea1665e2118fd573f72a6fcd1fce20d6)
 2016-08-31 14:33:10 -07:00
Kihwal Lee
34042ccbb9 HDFS-10729. Improve log message for edit loading failures caused by FS limit checks. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 01721dd88ee532d20eda841254437da4dfd69db5)
 2016-08-31 14:09:23 -05:00
Ming Ma
56c9a96a76 HDFS-9392. Admins support for maintenance state. Contributed by Ming Ma. 
(cherry picked from commit 9dcbdbdb5a34d85910707f81ebc1bb1f81c99978)
 2016-08-30 14:09:18 -07:00
Wei-Chiu Chuang
abbd95b790 HDFS-10760. DataXceiver#run() should not log InvalidToken exception as an error. Contributed by Pan Yuxuan. 
(cherry picked from commit c4ee6915a14e00342755d7cdcbf2d61518f306aa)
 2016-08-30 10:44:27 -07:00
Zhe Zhang
320be1b3c6 HDFS-10814. Add assertion for getNumEncryptionZones when no EZ is created. Contributed by Vinitha Reddy Gankidi. 
(cherry picked from commit 4bd45f54eedd449a98a90540698c6ceb47454fec)
 2016-08-29 23:42:46 -07:00
Xiao Chen
72863f0049 HDFS-4210. Throw helpful exception when DNS entry for JournalNode cannot be resolved. Contributed by Charles Lamb and John Zhuge. 
(cherry picked from commit 046f6bf0f944311fc70de3a96fc6ab8211cbbbd8)
 2016-08-29 17:48:49 -07:00
Yongjun Zhang
4bed2a4b9c HDFS-10625. VolumeScanner to report why a block is found bad. Contributed by Rushabh S Shah and Yiqun Lin. 
(cherry picked from commit 5d1609ddf275e4907bd224bf618e2aad4b262888)
 2016-08-29 14:08:36 -07:00
Mingliang Liu
875c14004d HDFS-10807. Doc about upgrading to a version of HDFS with snapshots may be confusing. (Contributed by Mingliang Liu) 
(cherry picked from commit 6742fb6e68d349055f985eb640d845e689d75384)
 2016-08-29 10:19:33 -07:00