Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,854 Commits 326 Branches 371 Tags
Commit Graph

3792 Commits

Author SHA1 Message Date
cnauroth
a40ff6d4fb Revert "HDFS-9569. Log the name of the fsimage being loaded for better supportability. Contributed by Yongjun Zhang." 
This reverts commit 03e10f1fb3fade650cb054ddf5f3a152871b8c0f.
 2015-12-17 13:53:25 -08:00
Allen Wittenauer
a5c74cd921 HDFS-9570. Minor typos, grammar, and case sensitivity cleanup in HdfsPermissionsGuide.md's (Travis Campbell via aw) 
(cherry picked from commit 8d278d8d2e5a8a53308608a8fbc6ba96228e53ef)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-12-17 11:40:58 -08:00
cnauroth
940026fc6b HDFS-9552. Document types of permission checks performed for HDFS operations. Contributed by Chris Nauroth. 
(cherry picked from commit 724e71f63b35695482642ed7aedacd70d08e6cb1)
 2015-12-17 10:43:54 -08:00
Arpit Agarwal
0c1d1e311c HDFS-9565. TestDistributedFileSystem.testLocatedFileStatusStorageIdsTypes is flaky due to race condition. (Contributed by Wei-Chiu Chuang) 2015-12-17 10:37:58 -08:00
Kihwal Lee
03e10f1fb3 HDFS-9569. Log the name of the fsimage being loaded for better supportability. Contributed by Yongjun Zhang. 
(cherry picked from commit eb6939cea0343840c62b930d4adb377f5eaf879f)
 2015-12-17 10:30:58 -06:00
Konstantin V Shvachko
3d0222eafd Update CHANGES.txt to move HDFS-9516 to 2.7.3 section. 2015-12-16 23:24:34 -08:00
Uma Mahesh
3be39d0229 HDFS-9198. Coalesce IBR processing in the NN. (Daryn Sharp via umamahesh) 
(cherry picked from commit f741476146574550a1a208d58ef8be76639e5ddc)
 2015-12-16 22:04:19 -08:00
Uma Mahesh
e82135df87 Revert this commit as there is compilation issue with this patch in branch-2 "HDFS-9198. Coalesce IBR processing in the NN. (Daryn Sharp via umamahesh)" 
This reverts commit 991ce3d6300fe742862f07397f5474b1ed8eb9a4.
 2015-12-16 19:18:30 -08:00
Uma Mahesh
991ce3d630 HDFS-9198. Coalesce IBR processing in the NN. (Daryn Sharp via umamahesh) 
(cherry picked from commit f741476146574550a1a208d58ef8be76639e5ddc)
 2015-12-16 18:25:29 -08:00
Andrew Wang
c7cb29defe HDFS-9300. TestDirectoryScanner.testThrottle() is still a little flakey. Contributed by Daniel Templeton. 
(cherry picked from commit 3c0adac88c3cddb821a732aea02bc068cafd7ea8)
 2015-12-16 16:21:16 -08:00
cnauroth
e8e3737ce8 HDFS-9557. Reduce object allocation in PB conversion. Contributed by Daryn Sharp. 
(cherry picked from commit c470c8953d4927043b6383fad8e792289c634c09)
 2015-12-16 11:11:27 -08:00
Andrew Wang
2796c1099f HDFS-8894. Set SO_KEEPALIVE on DN server sockets. Contributed by Kanaka Kumar Avvaru. 
(cherry picked from commit 49949a4bb03aa81cbb9115e91ab1c61cc6dc8a62)
 2015-12-15 14:39:04 -08:00
Jing Zhao
e0abb0a4e7 HDFS-9371. Code cleanup for DatanodeManager. Contributed by Jing Zhao. 
(cherry picked from commit 8602692338d6f493647205e0241e4116211fab75)
 2015-12-15 11:02:04 -08:00
Plamen Jeliazkov
15124c86d8 HDFS-9516. Truncate file fails with data dirs on multiple disks. Contributed by Plamen Jeliazkov. 2015-12-15 00:39:42 -08:00
Lei Xu
6df45118e5 Revert "Revert "HDFS-8860. Remove unused Replica copyOnWrite code (Lei (Eddy) Xu via Colin P. McCabe)"" 
This reverts commit fb909554a8dfdc8b6244842d3b5ecb8eabc7f99a.
 2015-12-14 11:26:32 -08:00
Jing Zhao
e02ad5a618 HDFS-9535. Newly completed blocks in IBR should not be considered under-replicated too quickly. Contributed by Mingliang Liu. 
(cherry picked from commit e53456981474d6e16e3c134e3777b3588dc6fedf)
 2015-12-14 11:18:28 -08:00
Lei Xu
0852d3562a HDFS-9281. Change TestDeleteBlockPool to not explicitly use File to check block pool existence. (lei) 
(cherry picked from commit db975af5fae506eb3d586bd9201f76adb3fd1281)
 2015-12-14 11:01:48 -08:00
Yongjun Zhang
be167d0154 HDFS-9514. TestDistributedFileSystem.testDFSClientPeerWriteTimeout failing; exception being swallowed. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit bf5295b118a24e762f21bb2b9054e5e0c1d1d14a)
 2015-12-11 20:56:58 -08:00
Yongjun Zhang
3fc9593318 HDFS-9519. Some coding improvement in SecondaryNameNode#main. (Xiao Chen via Yongjun Zhang) 
(cherry picked from commit 2a4c7d4facabb8b99d6dcbf4ccfe2afedf4fd445)
 2015-12-11 20:56:46 -08:00
Xiaoyu Yao
08616b3654 HDFS-8785. TestDistributedFileSystem is failing in trunk. Contributed by Xiaoyu Yao. 
(cherry picked from commit 2196e39e142b0f8d1944805db2bfacd4e3244625)
 2015-12-11 20:56:12 -08:00
Uma Mahesh
5b1e1dfb3f HDFS-9528. Cleanup namenode audit/log/exception messages. (szetszwo via umamahesh) 
(cherry picked from commit 796a676d18bd7cd3ed4113d002e0e69cf261d6d1)
 2015-12-11 19:18:25 -08:00
Yongjun Zhang
e00888d5cb HDFS-9532. Detailed exception info is lost in reportTo methods of ErrorReportAction and ReportBadBlockAction. (Yongjun Zhang) 
(cherry picked from commit f5a911452f8f6bc8a37617d1fc155e5ec23f3a78)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-12-11 18:24:50 -08:00
Xiaoyu Yao
5595b912e4 HDFS-8326. Documentation about when checkpoints are run is out of date. (Misty Stanley-Jones via xyao) 
(cherry picked from commit d0e75e60fb16ffd6c95648a06ff3958722f71e4d)
 2015-12-11 08:41:30 -08:00
Kihwal Lee
a72ef921f0 HDFS-9445. Datanode may deadlock while handling a bad volume. Contributed by Walter Su. 
(cherry picked from commit a48301791e9564363bc2abad4e89e344b0d7a5ff)
 2015-12-11 08:46:03 -06:00
Uma Mahesh
7dc558b6a7 HDFS-9472. concat() API does not give proper exception messages on ./reserved relative path (Rakesh R via umamahesh) 
(cherry picked from commit e363417e7b7abdd5d149f303f729ecf3e95ef8f3)
 2015-12-11 00:01:02 -08:00
Lei Xu
fb909554a8 Revert "HDFS-8860. Remove unused Replica copyOnWrite code (Lei (Eddy) Xu via Colin P. McCabe)" 
This reverts commit b9bf1a9391f0619d75604a5601763c2fab1ae1c5.

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/DataNodeTestUtils.java
 2015-12-10 11:23:02 -10:00
Tsz-Wo Nicholas Sze
c65a796f88 HDFS-9527. The return type of FSNamesystem.getBlockCollection should be changed to INodeFile. 2015-12-09 18:10:34 -08:00
Vinod Kumar Vavilapalli
e81cb68508 HDFS-9273. Moving to 2.6.3 CHANGES section to reflect the backport. 2015-12-08 11:34:05 -08:00
cnauroth
1072be12b9 HDFS-9414. Refactor reconfiguration of ClientDatanodeProtocol for reusability. Contributed by Xiaobing Zhou. 
(cherry picked from commit 303f80e6567023985f00e5f33ff41a7bbb4d6072)
 2015-12-08 10:50:13 -08:00
Jing Zhao
c993327483 HDFS-9129. Move the safemode block count into BlockManager. Contributed by Mingliang Liu. 2015-12-07 13:46:12 -08:00
Steve Loughran
af14458de7 HADOOP-12321. Make JvmPauseMonitor an AbstractService. (Sunil G via Stevel) [includes HDFS-8947 MAPREDUCE-6462 and YARN-4072] 2015-12-06 17:42:56 +00:00
Arpit Agarwal
6999e764cb HDFS-9414. Add missing license header 2015-12-05 09:24:44 -08:00
Arpit Agarwal
71be31201a HDFS-9414. Refactor reconfiguration of ClientDatanodeProtocol for reusability. (Contributed by Xiaobing Zhou) 2015-12-04 20:53:43 -08:00
Lei Xu
ce49ba39d2 HDFS-9491. Tests should get the number of pending async deletes via FsDatasetTestUtils. (Tony Wu via lei) 
(cherry picked from commit c92713dac56da0f836382005d84b577cfeb36a05)
 2015-12-04 18:05:51 -08:00
Xiaoyu Yao
eb7f9901b4 HDFS-8831. Trash Support for deletion in HDFS encryption zone. Contributed by Xiaoyu Yao. 
(cherry picked from commit cbc7b6bf97a80c39d4bbb3005e42dacae6726baf)
 2015-12-04 16:57:58 -08:00
Arpit Agarwal
496c8969d4 HDFS-9214. Add missing license header 2015-12-04 15:33:24 -08:00
Arpit Agarwal
9ddd7a95b9 HDFS-9214. Support reconfiguring dfs.datanode.balance.max.concurrent.moves without DN restart. (Contributed by Xiaobing Zhou) 2015-12-04 14:46:54 -08:00
Yongjun Zhang
78a21e773d HDFS-9474. TestPipelinesFailover should not fail when printing debug message. (John Zhuge via Yongjun Zhang) 
(cherry picked from commit 59dbe8b3e96d13c2322cabd87c7f893c5a3812ba)
 2015-12-04 13:50:03 -08:00
Colin P. McCabe
3beedc177d HDFS-9267. TestDiskError should get stored replicas through FsDatasetTestUtils. (Lei (Eddy) Xu via Colin P. McCabe) 
(cherry picked from commit e02bbeb8862ee5bca572a0252e8ff3a3699eff5a)
 2015-12-04 12:51:55 -08:00
Lei Xu
58714f3b73 HDFS-9490. MiniDFSCluster should change block generation stamp via FsDatasetTestUtils. (Tony Wu via lei) 
(cherry picked from commit 0ac8fb4b336dd03a037092c9712b962e7ed8f852)
 2015-12-04 10:26:06 -08:00
Ming Ma
a68faf1a02 HDFS-9430 Remove waitForLoadingFSImage since checkNNStartup has ensured image loaded and namenode started. (Brahma Reddy Battula via mingma) 
(cherry picked from commit 3fa33b5c2c289ceaced30c6c5451f3569110459d)
 2015-12-04 09:55:02 -08:00
Konstantin V Shvachko
33d4588a7c HDFS-9484. NNThroughputBenchmark$BlockReportStats should not send empty block reports. Contributed by Mingliang Liu. 2015-12-03 14:56:00 -08:00
Konstantin V Shvachko
3aa73a867a HDFS-9436. Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default. Contributed by Mingliang. 2015-12-03 14:54:06 -08:00
Tsz-Wo Nicholas Sze
bac127a4e2 HDFS-9294. DFSClient deadlock when close file and failed to renew lease. Contributed by Brahma Reddy Battula 2015-12-02 17:49:16 -08:00
Colin Patrick Mccabe
9b516a2a05 HDFS-9429. Tests in TestDFSAdminWithHA intermittently fail with EOFException (Xiao Chen via Colin P. McCabe) 
(cherry picked from commit 53e3bf7e704c332fb119f55cb92520a51b644bfc)
 2015-12-01 23:58:09 -08:00
Arpit Agarwal
0a1ef49b33 HDFS-6533. TestBPOfferService#testBasicFunctionalitytest fails intermittently. (Contributed by Wei-Chiu Chuang) 2015-12-01 13:32:37 -08:00
Jing Zhao
7e416aa70d HDFS-9485. Make BlockManager#removeFromExcessReplicateMap accept BlockInfo instead of Block. Contributed by Mingliang Liu. 
(cherry picked from commit 830eb252aaa4fec7ef2ec38cb66f669e8e1ecaa5)
 2015-12-01 13:07:19 -08:00
Zhe Zhang
9db4b77ea5 HDFS-9269. Update the documentation and wrapper for fuse-dfs. Contributed by Wei-Chiu Chuang. 
Change-Id: Ia9ec512de2464bf94725cc7c15c378c59d0f04c4
 2015-12-01 10:25:32 -08:00
Allen Wittenauer
45bb467918 HADOOP-12366. expose calculated paths (aw) 2015-12-01 08:16:20 -08:00
Junping Du
092c469059 Creating 2.6.4 entries in CHANGES.txt files. 
(cherry picked from commit 028894281bccd4e2f37eebff2e46409404ef64b7)
 2015-12-01 08:18:57 -08:00