Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,855 Commits 326 Branches 371 Tags
Commit Graph

3807 Commits

Author SHA1 Message Date
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
7eb63d4e7c HADOOP-5323. Trash documentation should describe its directory structure and configurations. (Weiwei Yang via ozawa) 
Moved entry from HDFS CHANGES.txt to that of common.

(cherry picked from commit cb73c753dab836105247945392ad4e43695a50bc)
 2016-01-13 14:56:35 -08:00
Yongjun Zhang
6650387bfb HDFS-9569. Log the name of the fsimage being loaded for better supportability. (Yongjun Zhang) 
(cherry picked from commit 25051c3bd08efc12333a6acb51782cc7800403a4)
 2016-01-12 09:23:40 -08:00
Xiaoyu Yao
74c05e5359 Correct commit message for HDFS-9584 
(cherry picked from commit 103d3cfc4ee1ac21970fd6bbca54bb085ab771ba)
 2016-01-11 19:01:11 -08:00
Xiaoyu Yao
a9cbfd717c HDFS-8584. NPE in distcp when ssl configuration file does not exist in class path. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit c2e2e134555010ec28da296bcfef4ba2613a5c6c)
 2016-01-11 17:16:43 -08:00
Arpit Agarwal
319c71b89b HDFS-9639. Fix up CHANGES.txt 2016-01-11 15:11:30 -08:00
Arpit Agarwal
476f7d0be3 HDFS-9639. Inconsistent Logging in BootstrapStandby. (Contributed by Xiaobing Zhou) 2016-01-11 15:10:21 -08:00
Zhe Zhang
87d614c70b HDFS-9630. DistCp minor refactoring and clean up. Contributed by Kai Zheng. 
Change-Id: I363c4ffcac32116ddcdc0a22fac3db92f14a0db0
 2016-01-11 09:57:01 -08:00
Zhe Zhang
eef26388ca HDFS-9626. TestBlockReplacement#testBlockReplacement fails occasionally. Contributed by Xiao Chen. 
Change-Id: I5cee398dfc361121d8b666ffd1203cc14a4ace24
 2016-01-08 13:20:02 -08:00
Kihwal Lee
d1cbc8442c HDFS-9574. Reduce client failures during datanode restart. Contributed by Kihwal Lee. 
(cherry picked from commit 38c4c14472996562eb3d610649246770c2888c6b)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
 2016-01-08 11:16:40 -06:00
Vinayakumar B
3303326dd9 HDFS-9619. SimulatedFSDataset sometimes can not find blockpool for the correct namenode (Contributed by Wei-Chiu Chuang) 
(cherry picked from commit 6702e7d66a4949a40bcdbd9f51ca1e746c8991e1)
(cherry picked from commit 08f39bd5d1b86db9a0efa84901408a615309bf48)
 2016-01-07 14:21:18 +05:30
Vinayakumar B
a14baa05b0 HDFS-9600. do not check replication if the block is under construction (Contributed by Phil Yang) 
(cherry picked from commit 34cd7cd76505d01ec251e30837c94ab03319a0c1)
(cherry picked from commit aa710bd461b593b0f3d7d7ac41ca68e1aa3fa9d6)
 2016-01-07 12:11:55 +05:30
Haohui Mai
bb6f03d597 HDFS-9047. Retire libwebhdfs. Contributed by Haohui Mai. 2016-01-06 16:39:51 -08:00
Haohui Mai
6dcf3cb6a1 HDFS-9605. Add links to failed volumes to explorer.html in HDFS Web UI. Contributed by Archana T. 2016-01-05 13:56:18 -08:00
Haohui Mai
2aa99e6df0 HDFS-7779. Support changing ownership, group and replication in HDFS Web UI. Contributed by Ravi Prakash. 2016-01-05 13:45:10 -08:00
Uma Mahesh
68ee13e4f5 HADOOP-12658. Clear javadoc and check style issues around DomainSocket. Contributed by Kai Zheng 
(cherry picked from commit 778146eaae5b1e17928a1f26fb1e46536a6ee510)
 2016-01-04 15:14:14 -08:00
Akira Ajisaka
22ac1a1ac0 Set release date for 2.6.3 
(cherry picked from commit db99e30f670cb5d73d5ec79671026eeeaf337d3d)
(cherry picked from commit 247ab92464beb55bad58b6e63eeac1a41767f432)
 2016-01-04 16:13:06 +09:00
Akira Ajisaka
13a48f6256 HADOOP-11252. RPC client does not time out by default. Contributed by Wilfred Spiegelenburg and Masatake Iwasaki. 
(cherry picked from commit 64ae85fd2ea91f46ab3b21f007befbeef8c3c947)
(cherry picked from commit d98cfe611f7cedc58cdecfb5a83829adb2521138)
 2016-01-04 14:32:21 +09:00
cnauroth
6d9f210c4d HDFS-7553. fix the TestDFSUpgradeWithHA due to BindException. Contributed by Xiao Chen. 
(cherry picked from commit 1f8162b74eddd849c7949ac64acf729c208b8af9)
 2015-12-29 10:57:30 -08:00
Kihwal Lee
263c544021 HDFS-7163. WebHdfsFileSystem should retry reads according to the configured retry policy. Contributed by Eric Payne. 
(cherry picked from commit 867048c3e4b20ece0039a876def129fa5eb9234f)
(cherry picked from commit 131260f0a7e8480e03b20d6e6327d8b468a9313d)
 2015-12-22 14:20:10 -06:00
cnauroth
8fad4c780a HDFS-9458. TestBackupNode always binds to port 50070, which can cause bind failures. Contributed by Xiao Chen. 
(cherry picked from commit 5c0ff69618fa303078c0f9afef4c93a864ab6cb7)
(cherry picked from commit 9b039a5004685d61375a7c0d40de95e4c15ae1d6)
 2015-12-22 10:29:47 -08:00
Colin Patrick Mccabe
9218890c7f HDFS-9589. Block files which have been hardlinked should be duplicated before the DataNode appends to the them (cmccabe) 
(cherry picked from commit bb540ba85aa37d9fe31e640665158afe8a936230)
(cherry picked from commit a56c5ef636413052fec62cee1a38b7e1455e389d)
 2015-12-22 09:39:04 -08:00
Akira Ajisaka
4254ca9898 Move HDFS-8914 from 2.8.0 to 2.7.3 in CHANGES.txt. 
(cherry picked from commit 2cb5afffc4c546e3d0d0f68a921905967047b0e0)
(cherry picked from commit 12caea3274f42d6218149d17cd68c687905cc669)
 2015-12-21 21:53:53 +09:00
Akira Ajisaka
1cd85efd71 HDFS-9505. HDFS Architecture documentation needs to be refreshed. Contributed by Masatake Iwasaki. 
(cherry picked from commit fa544020f6f71ee993f047c9b986c047a25ed84c)
(cherry picked from commit 7526a2a005621e2d1d5eed6561fcd1b05ad20037)
 2015-12-21 21:23:40 +09:00
Uma Mahesh
6f30919336 YARN-4480. Clean up some inappropriate imports. (Kai Zheng via umamahesh) 
(cherry picked from commit 0f82b5d878a76b1626c9e07b2fbb55ce2a79232a)
 2015-12-19 23:28:51 -08:00
cnauroth
d6f1d3b6ca HADOOP-12570. HDFS Secure Mode Documentation updates. Contributed by Arpit Agarwal. 
(cherry picked from commit 932956458dddabd9583b911c693386a56d723c0d)
(cherry picked from commit dd91cf9fa51df11c80f52e6845555bb9f2b8acef)
 2015-12-18 16:54:36 -08:00
Xiaoyu Yao
4f21f9408e HDFS-8326. Documentation about when checkpoints are run is out of date. (Misty Stanley-Jones via xyao) 
(cherry picked from commit d0e75e60fb16ffd6c95648a06ff3958722f71e4d)
(cherry picked from commit 5595b912e417286594ec0703d3e6062b00985fcc)
 2015-12-18 16:34:44 -08:00
Xiaoyu Yao
f3ee0e7857 HDFS-8831. Trash Support for deletion in HDFS encryption zone. Contributed by Xiaoyu Yao. 
(cherry picked from commit cbc7b6bf97a80c39d4bbb3005e42dacae6726baf)
(cherry picked from commit eb7f9901b4355c5488172dc93f734ee496b3e4dc)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-12-18 16:34:43 -08:00
Lei Xu
134195df55 HDFS-9490. MiniDFSCluster should change block generation stamp via FsDatasetTestUtils. (Tony Wu via lei) 
(cherry picked from commit 0ac8fb4b336dd03a037092c9712b962e7ed8f852)
(cherry picked from commit 58714f3b7357d05604987e1db8f6734a7d2827d9)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-12-18 16:34:42 -08:00
Konstantin V Shvachko
0b88a7f259 HDFS-9484. NNThroughputBenchmark$BlockReportStats should not send empty block reports. Contributed by Mingliang Liu. 
(cherry picked from commit 33d4588a7c57a0945f82fb14d8127d49c9ec68d2)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-12-18 16:34:42 -08:00
Konstantin V Shvachko
69d3a71f14 HDFS-9436. Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default. Contributed by Mingliang. 
(cherry picked from commit 3aa73a867a3a5048de72e08d73ffaabe84f8ddee)
 2015-12-18 16:33:53 -08:00
Zhe Zhang
65effb76d9 HDFS-9347. Invariant assumption in TestQuorumJournalManager.shutdown() is wrong. Contributed by Wei-Chiu Chuang. 
Change-Id: Idde8522e11c77f82b376e0c90a9bf33d163d5cb9
 2015-12-18 16:06:42 -08:00
Vinayakumar B
384628a2d6 HDFS-9393. After choosing favored nodes, choosing nodes for remaining replicas should go through BlockPlacementPolicy (Contributed by J.Andreina) 
(cherry picked from commit bfadf11b36e9d97e03d6ed1e71829907c2301412)
(cherry picked from commit c887bcd1f03244300a45ff70df9a9c9f2ad5a431)
 2015-12-18 11:41:27 +05:30
cnauroth
9a6814f37c HDFS-9571. Fix ASF Licence warnings in Jenkins reports. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 6da9deec204a4fa69dfc2d891ce934979d59b0ab)
(cherry picked from commit 7e5306e7952c1020b4cf9b4f71057ebb40db4ad7)
 2015-12-17 16:26:16 -08:00
Kihwal Lee
e5e5ba495f HDFS-9533. seen_txid in the shared edits directory is modified during bootstrapping. Contributed by Kihwal Lee. 
(cherry picked from commit 5cb1e0118b173a95c1f7bdfae1e58d7833d61c26)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ha/BootstrapStandby.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestBootstrapStandby.java
(cherry picked from commit 3c0ae5914ca673b055a9673b4c17c8aaa570c258)
 2015-12-17 17:23:55 -06:00
cnauroth
12e6f38f52 HDFS-9572. Prevent DataNode log spam if a client connects on the data transfer port but sends no data. Contributed by Chris Nauroth 
(cherry picked from commit 03bab8dea163a9ee45d09d2a0483d45cf6fe57c9)
(cherry picked from commit 294d0f6f6a90926f23cbcf8006cbc893bdb488e6)
 2015-12-17 14:05:19 -08:00
Arpit Agarwal
c8e5d2eba4 HDFS-9515. NPE when MiniDFSCluster#shutdown is invoked on uninitialized reference. (Contributed by Wei-Chiu Chuang) 2015-12-17 13:57:03 -08:00
cnauroth
1e81e1f891 Revert "HDFS-9569. Log the name of the fsimage being loaded for better supportability. Contributed by Yongjun Zhang." 
This reverts commit a8dc35dfdf9f3ab82d88a7ef2d03e172d594499b.
 2015-12-17 13:50:02 -08:00
Allen Wittenauer
b11362fd2a HDFS-9570. Minor typos, grammar, and case sensitivity cleanup in HdfsPermissionsGuide.md's (Travis Campbell via aw) 
(cherry picked from commit 8d278d8d2e5a8a53308608a8fbc6ba96228e53ef)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

(cherry picked from commit a5c74cd921d0305f3baa23d7dc53064cb3d09968)
 2015-12-17 11:41:11 -08:00
cnauroth
7cc11b22dd HDFS-9552. Document types of permission checks performed for HDFS operations. Contributed by Chris Nauroth. 
(cherry picked from commit 724e71f63b35695482642ed7aedacd70d08e6cb1)
(cherry picked from commit 940026fc6b2682a3b62d3e33ba977f5ae6375fbf)
 2015-12-17 10:44:00 -08:00
Arpit Agarwal
12df736673 HDFS-9565. TestDistributedFileSystem.testLocatedFileStatusStorageIdsTypes is flaky due to race condition. (Contributed by Wei-Chiu Chuang) 2015-12-17 10:38:58 -08:00
Kihwal Lee
a8dc35dfdf HDFS-9569. Log the name of the fsimage being loaded for better supportability. Contributed by Yongjun Zhang. 
(cherry picked from commit eb6939cea0343840c62b930d4adb377f5eaf879f)
 2015-12-17 10:31:37 -06:00
Plamen Jeliazkov
cffa262f11 HDFS-9516. Truncate file fails with data dirs on multiple disks. Contributed by Plamen Jeliazkov. 2015-12-17 00:03:51 -08:00
Uma Mahesh
e6dc6f24a2 HDFS-9198. Coalesce IBR processing in the NN. (Daryn Sharp via umamahesh) 
(cherry picked from commit f741476146574550a1a208d58ef8be76639e5ddc)
 2015-12-16 22:50:12 -08:00
cnauroth
d3e1161b8d HDFS-9557. Reduce object allocation in PB conversion. Contributed by Daryn Sharp. 
(cherry picked from commit c470c8953d4927043b6383fad8e792289c634c09)
(cherry picked from commit e8e3737ce8224df41f57b5d03ed097e8ab413bda)
 2015-12-16 11:11:34 -08:00
Andrew Wang
8e5de6cc42 HDFS-8894. Set SO_KEEPALIVE on DN server sockets. Contributed by Kanaka Kumar Avvaru. 
(cherry picked from commit 49949a4bb03aa81cbb9115e91ab1c61cc6dc8a62)
(cherry picked from commit 2796c1099f5c770d534f4bf10c1d80886d0bc194)
 2015-12-15 14:40:23 -08:00
Yongjun Zhang
4bc1aab49d HDFS-9514. TestDistributedFileSystem.testDFSClientPeerWriteTimeout failing; exception being swallowed. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit bf5295b118a24e762f21bb2b9054e5e0c1d1d14a)
 2015-12-14 15:40:55 -08:00
Yongjun Zhang
6c0e36b91c HDFS-9519. Some coding improvement in SecondaryNameNode#main. (Xiao Chen via Yongjun Zhang) 
(cherry picked from commit 2a4c7d4facabb8b99d6dcbf4ccfe2afedf4fd445)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-12-14 15:40:13 -08:00
Xiaoyu Yao
cdf43bb438 HDFS-8785. TestDistributedFileSystem is failing in trunk. Contributed by Xiaoyu Yao. 
(cherry picked from commit 2196e39e142b0f8d1944805db2bfacd4e3244625)
 2015-12-14 15:31:37 -08:00
Jing Zhao
73a055bb9f HDFS-9535. Newly completed blocks in IBR should not be considered under-replicated too quickly. Contributed by Mingliang Liu. 
(cherry picked from commit e53456981474d6e16e3c134e3777b3588dc6fedf)
(cherry picked from commit e02ad5a6187d4560c8ee58b4a5582042592fa817)
 2015-12-14 11:20:10 -08:00
Uma Mahesh
4c0b9c9062 HDFS-9528. Cleanup namenode audit/log/exception messages. (szetszwo via umamahesh) 
(cherry picked from commit 796a676d18bd7cd3ed4113d002e0e69cf261d6d1)
 2015-12-11 19:32:40 -08:00