Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,685 Commits 326 Branches 371 Tags
Commit Graph

3727 Commits

Author SHA1 Message Date
Tsz-Wo Nicholas Sze
f09b0fe5c4 HDFS-9654. Code refactoring for HDFS-8578. 2016-01-28 11:01:47 +08:00
Tsz-Wo Nicholas Sze
0271fb1f18 HDFS-9690. ClientProtocol.addBlock is not idempotent after HDFS-8071. 2016-01-26 14:58:44 +08:00
Jitendra Pandey
f1f61eac15 HDFS-9672. o.a.h.hdfs.TestLeaseRecovery2 fails intermittently. Contributed by Mingliang Liu. 2016-01-25 17:06:23 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
3efc72ccd5 Release process for 2.7.2: Set the release date for 2.7.2 
(cherry picked from commit ec4d2d9f40c1cb52ca4561b3d010ffc046a73495)
 2016-01-25 15:47:39 -08:00
Eric Yang
6ba6f993f8 HDFS-9653. Added blocks pending deletion report to dfsadmin. 
(Weiwei Yang via eyang)
 2016-01-24 14:27:17 -08:00
Kihwal Lee
330876689b HDFS-8898. Create API and command-line argument to get quota and quota usage without detailed content summary. Contributed by Ming Ma. 
(cherry picked from commit b5db1d44104a8ac4c3643cc3ac841f75f31c8345)
 2016-01-22 09:20:39 -06:00
Akira Ajisaka
4b121be77e HDFS-9682. Fix a typo "aplication" in HttpFS document. Contributed by Weiwei yang. 
(cherry picked from commit 683163468219107afb57a002f2cf2a369442171d)
(cherry picked from commit 4fe28a644e77a59968a1bed6fdae175cd43ae14d)
 2016-01-22 20:12:55 +09:00
Kihwal Lee
67ba20e364 HDFS-9634. webhdfs client side exceptions don't provide enough details. Contributed by Eric Payne. 
(cherry picked from commit 7b70500484574a565dd8cd5c7d8b5bc7c6d91154)
 2016-01-21 09:34:06 -06:00
Vinayakumar B
4449677049 HDFS-9625. set replication for empty file failed when set storage policy (Contributed by DENG FEI) 
(cherry picked from commit b7372b7166a13111b98794602ca4c166dfd78d29)
(cherry picked from commit 845acfd96c8461ebb412cd1daec51e89ce9f1c18)
 2016-01-21 19:19:43 +05:30
Lei Xu
b4b5468152 HDFS-9655. NN should start JVM pause monitor before loading fsimage. (John Zhuge via Lei (Eddy) Xu) 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNode.java
 2016-01-20 14:35:59 -08:00
Vinayakumar B
3d38c1ef3a HDFS-9661. Deadlock in DN.FsDatasetImpl between moveBlockAcrossStorage and createRbw (Contributed by ade) 
(cherry picked from commit 14255786908f991fd2022480fe5575533a3dc7ce)
 2016-01-20 21:09:08 +05:30
Yongjun Zhang
15713f947c HDFS-6054. MiniQJMHACluster should not use static port to avoid binding failure in unit test. (Yongjun Zhang) 
(cherry picked from commit 57d0a94305b22a469062c7ce85b3159fee17a28b)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/qjournal/MiniQJMHACluster.java

(cherry picked from commit a5ee4c09de849b1fdb1ee69b2e40a071a7050456)
 2016-01-19 23:14:56 -08:00
Akira Ajisaka
ca22066582 HDFS-9623. Update example configuration of block state change log in log4j.properties. Contributed by Masatake Iwasaki. 
(cherry picked from commit 92c5f565fd5466eab4496c2413de2e8b2897a91f)
(cherry picked from commit 3a8d372518aefe3d25fc9107ae0220d6de8fa736)
 2016-01-19 13:32:54 +09:00
Tsz-Wo Nicholas Sze
e75ca52138 In CHANGES.txt, move HDFS-9294 to Release 2.6.4. 2016-01-16 23:47:20 +08:00
Yongjun Zhang
4c8131b1bf HDFS-9612. DistCp worker threads are not terminated after jobs are done. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit a9c69ebeb707801071db3cc22bfcd14f87be443a)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2016-01-15 10:12:15 -08:00
Benoy Antony
6ceee07357 HDFS-9597. BaseReplicationPolicyTest should update data node stats after adding a data node. Contributed by Wei-Chiu Chuang. 2016-01-14 14:42:04 -08:00
Benoy Antony
5a50651e5b HDFS-9034. StorageTypeStats Metric should not count failed storage. Contributed by Surendra Singh Lilhore. 2016-01-14 14:42:04 -08:00
Arpit Agarwal
3266709b5d HDFS-9415. Document dfs.cluster.administrators and dfs.permissions.superusergroup. (Contributed by Xiaobing Zhou) 2016-01-14 14:18:21 -08:00
Yongjun Zhang
f2eea3a1b4 HDFS-9648. TestStartup.testImageChecksum is broken by HDFS-9569's message change. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit 817cc1f02a60ef4e372171415058fdc76c0d2e39)
 2016-01-14 13:06:23 -08:00
Lei Xu
894345e2f0 HDFS-9493. Test o.a.h.hdfs.server.namenode.TestMetaSave fails in trunk. (Tony Wu via lei) 
(cherry picked from commit fd8065a763ff68db265ef23a7d4f97558e213ef9)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestMetaSave.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManagerTestUtil.java
 2016-01-13 16:34:13 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
7eb63d4e7c HADOOP-5323. Trash documentation should describe its directory structure and configurations. (Weiwei Yang via ozawa) 
Moved entry from HDFS CHANGES.txt to that of common.

(cherry picked from commit cb73c753dab836105247945392ad4e43695a50bc)
 2016-01-13 14:56:35 -08:00
Yongjun Zhang
6650387bfb HDFS-9569. Log the name of the fsimage being loaded for better supportability. (Yongjun Zhang) 
(cherry picked from commit 25051c3bd08efc12333a6acb51782cc7800403a4)
 2016-01-12 09:23:40 -08:00
Xiaoyu Yao
74c05e5359 Correct commit message for HDFS-9584 
(cherry picked from commit 103d3cfc4ee1ac21970fd6bbca54bb085ab771ba)
 2016-01-11 19:01:11 -08:00
Xiaoyu Yao
a9cbfd717c HDFS-8584. NPE in distcp when ssl configuration file does not exist in class path. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit c2e2e134555010ec28da296bcfef4ba2613a5c6c)
 2016-01-11 17:16:43 -08:00
Arpit Agarwal
319c71b89b HDFS-9639. Fix up CHANGES.txt 2016-01-11 15:11:30 -08:00
Arpit Agarwal
476f7d0be3 HDFS-9639. Inconsistent Logging in BootstrapStandby. (Contributed by Xiaobing Zhou) 2016-01-11 15:10:21 -08:00
Zhe Zhang
87d614c70b HDFS-9630. DistCp minor refactoring and clean up. Contributed by Kai Zheng. 
Change-Id: I363c4ffcac32116ddcdc0a22fac3db92f14a0db0
 2016-01-11 09:57:01 -08:00
Zhe Zhang
eef26388ca HDFS-9626. TestBlockReplacement#testBlockReplacement fails occasionally. Contributed by Xiao Chen. 
Change-Id: I5cee398dfc361121d8b666ffd1203cc14a4ace24
 2016-01-08 13:20:02 -08:00
Kihwal Lee
d1cbc8442c HDFS-9574. Reduce client failures during datanode restart. Contributed by Kihwal Lee. 
(cherry picked from commit 38c4c14472996562eb3d610649246770c2888c6b)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
 2016-01-08 11:16:40 -06:00
Vinayakumar B
3303326dd9 HDFS-9619. SimulatedFSDataset sometimes can not find blockpool for the correct namenode (Contributed by Wei-Chiu Chuang) 
(cherry picked from commit 6702e7d66a4949a40bcdbd9f51ca1e746c8991e1)
(cherry picked from commit 08f39bd5d1b86db9a0efa84901408a615309bf48)
 2016-01-07 14:21:18 +05:30
Vinayakumar B
a14baa05b0 HDFS-9600. do not check replication if the block is under construction (Contributed by Phil Yang) 
(cherry picked from commit 34cd7cd76505d01ec251e30837c94ab03319a0c1)
(cherry picked from commit aa710bd461b593b0f3d7d7ac41ca68e1aa3fa9d6)
 2016-01-07 12:11:55 +05:30
Haohui Mai
bb6f03d597 HDFS-9047. Retire libwebhdfs. Contributed by Haohui Mai. 2016-01-06 16:39:51 -08:00
Haohui Mai
6dcf3cb6a1 HDFS-9605. Add links to failed volumes to explorer.html in HDFS Web UI. Contributed by Archana T. 2016-01-05 13:56:18 -08:00
Haohui Mai
2aa99e6df0 HDFS-7779. Support changing ownership, group and replication in HDFS Web UI. Contributed by Ravi Prakash. 2016-01-05 13:45:10 -08:00
Uma Mahesh
68ee13e4f5 HADOOP-12658. Clear javadoc and check style issues around DomainSocket. Contributed by Kai Zheng 
(cherry picked from commit 778146eaae5b1e17928a1f26fb1e46536a6ee510)
 2016-01-04 15:14:14 -08:00
Akira Ajisaka
22ac1a1ac0 Set release date for 2.6.3 
(cherry picked from commit db99e30f670cb5d73d5ec79671026eeeaf337d3d)
(cherry picked from commit 247ab92464beb55bad58b6e63eeac1a41767f432)
 2016-01-04 16:13:06 +09:00
Akira Ajisaka
13a48f6256 HADOOP-11252. RPC client does not time out by default. Contributed by Wilfred Spiegelenburg and Masatake Iwasaki. 
(cherry picked from commit 64ae85fd2ea91f46ab3b21f007befbeef8c3c947)
(cherry picked from commit d98cfe611f7cedc58cdecfb5a83829adb2521138)
 2016-01-04 14:32:21 +09:00
cnauroth
6d9f210c4d HDFS-7553. fix the TestDFSUpgradeWithHA due to BindException. Contributed by Xiao Chen. 
(cherry picked from commit 1f8162b74eddd849c7949ac64acf729c208b8af9)
 2015-12-29 10:57:30 -08:00
Kihwal Lee
263c544021 HDFS-7163. WebHdfsFileSystem should retry reads according to the configured retry policy. Contributed by Eric Payne. 
(cherry picked from commit 867048c3e4b20ece0039a876def129fa5eb9234f)
(cherry picked from commit 131260f0a7e8480e03b20d6e6327d8b468a9313d)
 2015-12-22 14:20:10 -06:00
cnauroth
8fad4c780a HDFS-9458. TestBackupNode always binds to port 50070, which can cause bind failures. Contributed by Xiao Chen. 
(cherry picked from commit 5c0ff69618fa303078c0f9afef4c93a864ab6cb7)
(cherry picked from commit 9b039a5004685d61375a7c0d40de95e4c15ae1d6)
 2015-12-22 10:29:47 -08:00
Colin Patrick Mccabe
9218890c7f HDFS-9589. Block files which have been hardlinked should be duplicated before the DataNode appends to the them (cmccabe) 
(cherry picked from commit bb540ba85aa37d9fe31e640665158afe8a936230)
(cherry picked from commit a56c5ef636413052fec62cee1a38b7e1455e389d)
 2015-12-22 09:39:04 -08:00
Akira Ajisaka
4254ca9898 Move HDFS-8914 from 2.8.0 to 2.7.3 in CHANGES.txt. 
(cherry picked from commit 2cb5afffc4c546e3d0d0f68a921905967047b0e0)
(cherry picked from commit 12caea3274f42d6218149d17cd68c687905cc669)
 2015-12-21 21:53:53 +09:00
Akira Ajisaka
1cd85efd71 HDFS-9505. HDFS Architecture documentation needs to be refreshed. Contributed by Masatake Iwasaki. 
(cherry picked from commit fa544020f6f71ee993f047c9b986c047a25ed84c)
(cherry picked from commit 7526a2a005621e2d1d5eed6561fcd1b05ad20037)
 2015-12-21 21:23:40 +09:00
Uma Mahesh
6f30919336 YARN-4480. Clean up some inappropriate imports. (Kai Zheng via umamahesh) 
(cherry picked from commit 0f82b5d878a76b1626c9e07b2fbb55ce2a79232a)
 2015-12-19 23:28:51 -08:00
cnauroth
d6f1d3b6ca HADOOP-12570. HDFS Secure Mode Documentation updates. Contributed by Arpit Agarwal. 
(cherry picked from commit 932956458dddabd9583b911c693386a56d723c0d)
(cherry picked from commit dd91cf9fa51df11c80f52e6845555bb9f2b8acef)
 2015-12-18 16:54:36 -08:00
Xiaoyu Yao
4f21f9408e HDFS-8326. Documentation about when checkpoints are run is out of date. (Misty Stanley-Jones via xyao) 
(cherry picked from commit d0e75e60fb16ffd6c95648a06ff3958722f71e4d)
(cherry picked from commit 5595b912e417286594ec0703d3e6062b00985fcc)
 2015-12-18 16:34:44 -08:00
Xiaoyu Yao
f3ee0e7857 HDFS-8831. Trash Support for deletion in HDFS encryption zone. Contributed by Xiaoyu Yao. 
(cherry picked from commit cbc7b6bf97a80c39d4bbb3005e42dacae6726baf)
(cherry picked from commit eb7f9901b4355c5488172dc93f734ee496b3e4dc)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-12-18 16:34:43 -08:00
Lei Xu
134195df55 HDFS-9490. MiniDFSCluster should change block generation stamp via FsDatasetTestUtils. (Tony Wu via lei) 
(cherry picked from commit 0ac8fb4b336dd03a037092c9712b962e7ed8f852)
(cherry picked from commit 58714f3b7357d05604987e1db8f6734a7d2827d9)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-12-18 16:34:42 -08:00
Konstantin V Shvachko
0b88a7f259 HDFS-9484. NNThroughputBenchmark$BlockReportStats should not send empty block reports. Contributed by Mingliang Liu. 
(cherry picked from commit 33d4588a7c57a0945f82fb14d8127d49c9ec68d2)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-12-18 16:34:42 -08:00
Konstantin V Shvachko
69d3a71f14 HDFS-9436. Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default. Contributed by Mingliang. 
(cherry picked from commit 3aa73a867a3a5048de72e08d73ffaabe84f8ddee)
 2015-12-18 16:33:53 -08:00