3894 Commits

Author	SHA1	Message	Date
Xiaoyu Yao	88e67a9583	Revert "HDFS-9210. Fix some misuse of %n in VolumeScanner#printStats. Contributed by Xiaoyu Yao." ... This reverts commit c1f68b3cd9.	2015-10-14 14:42:02 -07:00
Xiaoyu Yao	c1f68b3cd9	HDFS-9210. Fix some misuse of %n in VolumeScanner#printStats. Contributed by Xiaoyu Yao. ... (cherry picked from commit 3d50855952)	2015-10-14 14:08:02 -07:00
Lei Xu	8651677446	HDFS-9238. Update TestFileCreation.testLeaseExpireHardLimit() to avoid using DataNodeTestUtils.getFile(). (Tony Wu via lei)	2015-10-14 13:11:09 -07:00
Jing Zhao	d6fbd4124c	HDFS-1172. Blocks in newly completed files are considered under-replicated too quickly. Contributed by Masatake Iwasaki. ... (cherry picked from commit 2a98724342)	2015-10-13 23:07:08 -07:00
Colin Patrick Mccabe	fea7e472c8	Add CHANGES.txt entry for HDFS-9187	2015-10-13 16:22:23 -07:00
Haohui Mai	ee04add696	HDFS-9167. Update pom.xml in other modules to depend on hdfs-client instead of hdfs. Contributed by Mingliang Liu.	2015-10-13 15:24:29 -07:00
Haohui Mai	65d41fd896	HDFS-8779. WebUI fails to display block IDs that are larger than 2^53 - 1. Contributed by Haohui Mai.	2015-10-13 13:51:32 -07:00
Haohui Mai	016d9fa9b9	HDFS-9235. hdfs-native-client build getting errors when built with cmake 2.6. Contributed by Eric Payne.	2015-10-13 13:42:50 -07:00
Haohui Mai	5c5362980c	HDFS-9145. Tracking methods that hold FSNamesytemLock for too long. Contributed by Mingliang Liu.	2015-10-13 13:20:17 -07:00
Jitendra Pandey	e7203b6954	HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou.	2015-10-13 09:14:01 -07:00
Kihwal Lee	f203b84cf4	HDFS-8676. Delayed rolling upgrade finalization can cause heartbeat expiration. Contributed by Walter Su. ... (cherry picked from commit 5b43db47a3)	2015-10-13 10:07:47 -05:00
Vinayakumar B	b0b97dfbef	HDFS-9139. Enable parallel JUnit tests for HDFS Pre-commit (Contributed by Chris Nauroth and Vinayakumar B) ... (cherry picked from commit 39581e3be2) Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestEditLogTailer.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestSeveralNameNodes.java	2015-10-13 19:29:51 +05:30
Vinayakumar B	b01eaa3b46	HDFS-9160. [OIV-Doc] : Missing details of 'delimited' for processor options (Contributed by nijel) ... (cherry picked from commit caa711b660)	2015-10-13 18:14:04 +05:30
Vinayakumar B	50253c43f0	HDFS-9224. TestFileTruncate fails intermittently with BindException (Contributed by Brahma Reddy Battula) ... (cherry picked from commit 69b025dbba)	2015-10-13 11:43:32 +05:30
Lei Xu	218aa7bba1	HDFS-9006. Provide BlockPlacementPolicy that supports upgrade domain. (Ming Ma via lei) ... (cherry picked from commit 0f5f9846ed)	2015-10-12 16:24:46 -07:00
Haohui Mai	eed61a5eda	Addendum patch for HDFS-9215.	2015-10-12 15:52:15 -07:00
yliu	85b5481d87	HDFS-8988. Use LightWeightHashSet instead of LightWeightLinkedSet in BlockManager#excessReplicateMap. (yliu)	2015-10-12 14:55:58 +08:00
yliu	5e2a44a7fe	HDFS-9221. HdfsServerConstants#ReplicaState#getState should avoid calling values() since it creates a temporary array. (Staffan Friberg via yliu)	2015-10-12 14:30:01 +08:00
Haohui Mai	d578165b99	HDFS-9222. Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client. Contributed by Mingliang Liu.	2015-10-09 22:31:23 -07:00
Haohui Mai	ce0bb73c10	HDFS-9215. Suppress the RAT warnings in hdfs-native-client module. Contributed by Haohui Mai.	2015-10-09 22:20:55 -07:00
Andrew Wang	12d3b69217	HDFS-8941. DistributedFileSystem listCorruptFileBlocks API should resolve relative path. Contributed by Rakesh R. ... (cherry picked from commit c32614f410)	2015-10-09 11:57:07 -07:00
Andrew Wang	673f301408	HDFS-9110. Use Files.walkFileTree in NNUpgradeUtil#doPreUpgrade for better efficiency. Contributed by Charlie Helin. ... (cherry picked from commit 357b1fd082)	2015-10-09 11:49:27 -07:00
Ming Ma	02380e0156	HDFS-9142. Separating Configuration object for namenode(s) in MiniDFSCluster. (Siqi Li via mingma) ... (cherry picked from commit de8efc65a4)	2015-10-09 11:41:54 -07:00
Yongjun Zhang	61988f8016	HDFS-9181. Better handling of exceptions thrown during upgrade shutdown. Contributed by Wei-Chiu Chuang. ... (cherry picked from commit c11fc8a1be)	2015-10-09 09:24:37 -07:00
Yongjun Zhang	aaf7b73fe4	HDFS-8164. cTime is 0 in VERSION file for newly formatted NameNode. Contributed by Xiao Chen. ... (cherry picked from commit 1107bd399c)	2015-10-07 23:23:36 -07:00
yliu	22ed1471bd	HDFS-9137. DeadLock between DataNode#refreshVolumes and BPOfferService#registrationSucceeded. (Uma Maheswara Rao G via yliu)	2015-10-08 10:26:30 +08:00
Andrew Wang	2f4bcdef8c	HDFS-9211. Fix incorrect version in hadoop-hdfs-native-client/pom.xml from HDFS-9170 branch-2 backport. Contributed by Eric Payne.	2015-10-07 18:04:19 -07:00
Lei Xu	ad1f0f307b	HDFS-9176. Fix TestDirectoryScanner#testThrottling often fails. (Daniel Templeton via lei) ... (cherry picked from commit 6dd47d754c)	2015-10-07 14:34:18 -07:00
Kihwal Lee	c43181d8a7	HDFS-9178. Slow datanode I/O can cause a wrong node to be marked bad. Contributed by Kihwal Lee. ... (cherry picked from commit 99e5204ff5)	2015-10-07 10:18:35 -05:00
Vinayakumar B	2b6fe90764	HDFS-9159. [OIV] : return value of the command is not correct if invalid value specified in '-p (processor)' option (Contributed by nijel) ... (cherry picked from commit 61b3547c46)	2015-10-07 14:30:07 +05:30
Haohui Mai	960b19edf6	HDFS-9170. Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client. Contributed by Haohui Mai.	2015-10-07 00:15:52 -07:00
Jing Zhao	a4b8dc48f1	HDFS-9196. Fix TestWebHdfsContentLength. Contributed by Masatake Iwasaki. ... (cherry picked from commit 239d119c67)	2015-10-06 23:55:33 -07:00
Vinayakumar B	96fbe42bd7	HDFS-7899. Improve EOF error message (Contributed by Jagadesh Kiran N) ... (cherry picked from commit 874c8ed239)	2015-10-06 15:55:12 +05:30
Colin Patrick Mccabe	05b88080b6	HDFS-9155. OEV should treat .XML files as XML even when the file name extension is uppercase (nijel via cmccabe) ... (cherry picked from commit 2fc2b50534)	2015-10-05 13:02:55 -07:00
Vinayakumar B	d843c50d58	HDFS-9158. [OEV-Doc] : Document does not mention about '-f' and '-r' options (Contributed by nijel) ... (cherry picked from commit b925cf1006)	2015-10-05 18:23:37 +05:30
Vinayakumar B	dc72ed7218	HDFS-9151. Mover should print the exit status/reason on console like balancer tool. (Contributed by Surendra singh lilhore) ... (cherry picked from commit 0faa4efa3d)	2015-10-05 13:23:30 +05:30
Tsuyoshi Ozawa	e6514c6a3b	HADOOP-11098. [JDK8] Max Non Heap Memory default changed between JDK7 and 8. ... (cherry picked from commit 30e2f836a2)	2015-10-05 08:15:40 +09:00
Haohui Mai	460b5db9ff	HDFS-9193. Fix incorrect references the usages of the DN in dfshealth.js. Contributed by Chang Li.	2015-10-03 11:44:40 -07:00
Haohui Mai	1257483ebf	HDFS-8979. Clean up checkstyle warnings in hadoop-hdfs-client module. Contributed by Mingliang Liu.	2015-10-03 11:37:19 -07:00
Jakob Homan	caa970974c	HDFS-9191. Typo in Hdfs.java. NoSuchElementException is misspelled. Contributed by Catherine Palmer. ... (cherry picked from commit 3929ac9340)	2015-10-03 10:50:03 +02:00
Kihwal Lee	b5d08e29e1	fix CHANGES.txt	2015-10-02 15:02:23 -05:00
Yongjun Zhang	7964b13405	HDFS-9100. HDFS Balancer does not respect dfs.client.use.datanode.hostname. Contributed by Casey Brotherton. ... (cherry picked from commit 1037ee580f)	2015-10-02 12:08:55 -07:00
Lei Xu	4d01dbda50	HDFS-9015. Refactor TestReplicationPolicy to test different block placement policies. (Ming Ma via lei) ... (cherry picked from commit 260b9d9410e45dbcb89d97d58450c79220c9e7bc)	2015-10-02 11:41:45 -07:00
cnauroth	7273ef0590	HDFS-9175. Change scope of 'AccessTokenProvider.getAccessToken()' and 'CredentialBasedAccessTokenProvider.getCredential()' abstract methods to public. Contributed by Santhosh Nayak. ... (cherry picked from commit c7e03c3a6c)	2015-09-30 16:06:45 -07:00
Aaron T. Myers	cb89ee931d	HDFS-9001. DFSUtil.getNsServiceRpcUris() can return too many entries in a non-HA, non-federated cluster. Contributed by Daniel Templeton. ... (cherry picked from commit 071733dc69)	2015-09-29 18:20:00 -07:00
Haohui Mai	37d42fcec1	HDFS-8971. Remove guards when calling LOG.debug() and LOG.trace() in client package. Contributed by Mingliang Liu.	2015-09-29 17:52:42 -07:00
Haohui Mai	58bdc9c672	Revert "HDFS-9170. Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client. Contributed by Haohui Mai." ... This reverts commit cf873fff9f.	2015-09-29 17:51:31 -07:00
Haohui Mai	cf873fff9f	HDFS-9170. Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client. Contributed by Haohui Mai.	2015-09-29 17:48:35 -07:00
Haohui Mai	bc0487c29c	HDFS-8696. Make the lower and higher watermark in the DN Netty server configurable. Contributed by Xiaobing Zhou.	2015-09-29 14:59:35 -07:00
Haohui Mai	baa6ef0207	HDFS-9174. Fix findbugs warnings in FSOutputSummer.tracer and DirectoryScanner$ReportCompiler.currentThread. Contributed by Yi Liu.	2015-09-29 14:56:13 -07:00
Haohui Mai	cf6fb09162	HDFS-9166. Move hftp / hsftp filesystem to hfds-client. Contributed by Mingliang Liu.	2015-09-29 10:07:19 -07:00
Haohui Mai	c705eab221	HDFS-9165. Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client. Contributed by Mingliang Liu.	2015-09-29 09:51:30 -07:00
Colin Patrick Mccabe	171bd1cb2b	HADOOP-12447. Clean up some htrace integration issues (cmccabe) ... (cherry picked from commit 850d679acb)	2015-09-29 09:38:10 -07:00
yliu	28805cb8d7	HDFS-9141. Thread leak in Datanode#refreshVolumes. (Uma Maheswara Rao G via yliu)	2015-09-29 22:06:20 +08:00
yliu	9c47ab32b1	HDFS-8859. Improve DataNode ReplicaMap memory footprint to save about 45%. (yliu)	2015-09-29 16:23:50 +08:00
Yongjun Zhang	1a5f3e93c3	HDFS-9092. Nfs silently drops overlapping write requests and causes data copying to fail. Contributed by Yongjun Zhang. ... (cherry picked from commit 151fca5032)	2015-09-28 18:47:47 -07:00
Kihwal Lee	95b8f1f3a6	HADOOP-12446. Undeprecate createNonRecursive(). Contributed by Ted Yu. ... (cherry picked from commit 3abbdc929b)	2015-09-28 17:33:20 -05:00
Lei Xu	213ff984ee	HDFS-9147. Fix the setting of visibleLength in ExternalBlockReader. (Colin P. McCabe via Lei (Eddy) Xu) ... (cherry picked from commit e5992ef4df)	2015-09-28 13:43:52 -07:00
Lei Xu	74092f2144	HDFS-9148. Incorrect assert message in TestWriteToReplica#testWriteToTemporary (Tony Wu via Lei (Eddy) Xu) ... (cherry picked from commit 50741cb568)	2015-09-28 13:28:08 -07:00
Kihwal Lee	468b330feb	HDFS-9106. Transfer failure during pipeline recovery causes permanent write failures. Contributed by Kihwal Lee. ... (cherry picked from commit 4c9497cbf0)	2015-09-28 14:30:06 -05:00
Colin Patrick Mccabe	3b9d32627f	HDFS-9080. Update htrace version to 4.0.1 (cmccabe) ... (cherry picked from commit 892ade689f) Conflicts: hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSClient.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/BlockStorageLocationUtil.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java	2015-09-28 08:15:00 -07:00
Haohui Mai	504d6fd950	HDFS-8740. Move DistributedFileSystem to hadoop-hdfs-client. Contributed by Mingliang Liu.	2015-09-27 10:54:53 -07:00
Colin Patrick Mccabe	2dca55be00	HDFS-9087. Add some jitter to DataNode.checkDiskErrorThread (Elliott Clark via Colin P. McCabe) ... (cherry picked from commit 0b31c237f2)	2015-09-26 20:37:54 -07:00
Haohui Mai	94cbb6d164	HDFS-8053. Move DFSIn/OutputStream and related classes to hadoop-hdfs-client. Contributed by Mingliang Liu.	2015-09-26 11:16:50 -07:00
Colin Patrick Mccabe	e5dc723d48	HDFS-8873. Allow the directoryScanner to be rate-limited (Daniel Templeton via Colin P. McCabe) ... (cherry picked from commit 7a3c381b39)	2015-09-26 04:21:23 -07:00
Lei Xu	82d4c05b2d	HDFS-9133. ExternalBlockReader and ReplicaAccessor need to return -1 on read when at EOF. (Colin Patrick McCabe via Lei (Eddy) Xu) ... (cherry picked from commit 67b0e967f0)	2015-09-25 16:02:27 -07:00
Lei Xu	1a2870f6ff	HDFS-9132. Pass genstamp to ReplicaAccessorBuilder. (Colin Patrick McCabe via Lei (Eddy) Xu)	2015-09-25 15:51:29 -07:00
Colin Patrick Mccabe	a6166aa552	HDFS-9107. Prevent NN's unrecoverable death spiral after full GC (Daryn Sharp via Colin P. McCabe) ... (cherry-picked from 4e7c6a653f)	2015-09-25 15:33:02 -07:00
Jing Zhao	aca014ea67	HDFS-9112. Improve error message for Haadmin when multiple name service IDs are configured. Contributed by Anu Engineer. ... (cherry picked from commit 83e99d06d0)	2015-09-25 14:21:52 -07:00
Yongjun Zhang	bc5ee80794	HDFS-5795. RemoteBlockReader2#checkSuccess() shoud print error status. (Xiao Chen via Yongjun Zhang) ... (cherry picked from commit 83e65c5fe8)	2015-09-24 22:15:28 -07:00
Yongjun Zhang	16ae3f5d46	HDFS-9123. Copying from the root to a subdirectory should be forbidden. (Wei-Chiu Chuang via Yongjun Zhang) ... (cherry picked from commit 3187dbd7a8)	2015-09-24 21:41:48 -07:00
Haohui Mai	85c73d159e	HDFS-9134. Move LEASE_{SOFTLIMIT,HARDLIMIT}_PERIOD constants from HdfsServerConstants to HdfsConstants. Contributed by Mingliang Liu.	2015-09-24 20:29:52 -07:00
Arpit Agarwal	3c06162259	HADOOP-12437. Allow SecurityUtil to lookup alternate hostnames. (Contributed by Arpit Agarwal)	2015-09-24 11:41:58 -07:00
Haohui Mai	13bdc20d2b	HDFS-7529. Consolidate encryption zone related implementation into a single class. Contributed by Rakesh R.	2015-09-24 08:46:44 -07:00
Vinayakumar B	a0ff9af827	HDFS-9076. Log full path instead of inodeId in DFSClient#closeAllFilesBeingWritten() (Contributed by Surendra Singh Lilhore) ... (cherry picked from commit e52bc697f8)	2015-09-24 17:44:18 +05:30
Haohui Mai	d148b6a234	HDFS-9131. Move config keys used by hdfs-client to HdfsClientConfigKeys. Contributed by Mingliang Liu.	2015-09-24 00:30:17 -07:00
Haohui Mai	7e4bd11b5b	HDFS-9130. Use GenericTestUtils#setLogLevel to the logging level. Contributed by Mingliang Liu.	2015-09-24 00:12:29 -07:00
Haohui Mai	3d8f6b9d48	HDFS-9128. TestWebHdfsFileContextMainOperations and TestSWebHdfsFileContextMainOperations fail due to invalid HDFS path on Windows. Contributed by Chris Nauroth.	2015-09-23 19:38:21 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)	f48af332a7	Release process for 2.6.1: Set the release date for 2.6.1 ... (cherry picked from commit 1f707ecffd)	2015-09-23 15:12:30 -07:00
Vinayakumar B	017dff9877	HDFS-9013. Deprecate NameNodeMXBean#getNNStarted in branch2 and remove from trunk (Contributed by Surendra Singh Lilhore) ... (cherry picked from commit a2c76e5f26)	2015-09-23 15:45:21 +05:30
Haohui Mai	090b1f6398	HDFS-8733. Keep server related definition in hdfs.proto on server side. Contributed by Mingliang Liu.	2015-09-22 20:57:11 -07:00
Haohui Mai	ed7211563c	HDFS-9039. Separate client and server side methods of o.a.h.hdfs.NameNodeProxies. Contributed by Mingliang Liu.	2015-09-22 20:52:46 -07:00
Vinayakumar B	96e3fbf401	HDFS-9043. Doc updation for commands in HDFS Federation (Contributed by J.Andreina) ... (cherry picked from commit 57003fa971)	2015-09-22 16:33:41 +05:30
Vinayakumar B	2893da4f53	HDFS-8780. Fetching live/dead datanode list with arg true for removeDecommissionNode,returns list with decom node. (Contributed by J.Andreina) ... (cherry picked from commit 10ab7d595e)	2015-09-22 12:31:02 +05:30
Tsuyoshi Ozawa	52cc2ca488	HADOOP-12428. Fix inconsistency between log-level guards and statements. Contributed by Jagadesh Kiran N and Jackie Chang. ... (cherry picked from commit dfd807afab)	2015-09-22 12:54:44 +09:00
Haohui Mai	4e752a37e7	HDFS-9111. Move hdfs-client protobuf convert methods from PBHelper to PBHelperClient. Contributed by Mingliang Liu.	2015-09-21 19:43:14 -07:00
Lei Xu	0095936a6a	HDFS-9004. Add upgrade domain to DatanodeInfo. Contributed by Ming Ma (via Lei (Eddy) Xu). ... Change-Id: I887c66578eebd61acc34b94f18da6e6851c609f4 (cherry picked from commit 3a9c7076e8)	2015-09-19 18:09:56 -07:00
Haohui Mai	41f1f1aabf	HDFS-9101. Remove deprecated NameNode.getUri() static helper method. Contributed by Mingliang Liu.	2015-09-18 18:24:09 -07:00
Jing Zhao	b4e1279217	HDFS-9063. Correctly handle snapshot path for getContentSummary. Contributed by Jing Zhao. ... (cherry picked from commit 3f42753102)	2015-09-18 09:27:10 -07:00
Yongjun Zhang	9859fd006b	HDFS-5802. NameNode does not check for inode type before traversing down a path. (Xiao Chen via Yongjun Zhang)	2015-09-18 07:29:51 -07:00
Vinayakumar B	f40b4f4542	HDFS-6955. DN should reserve disk space for a full block when creating tmp files (Contributed by Kanaka Kumar Avvaru)	2015-09-18 16:42:22 +05:30
Haohui Mai	cadde8c1e5	HDFS-9022. Move NameNode.getAddress() and NameNode.getUri() to hadoop-hdfs-client. Contributed by Mingliang Liu.	2015-09-17 14:17:30 -07:00
Aaron T. Myers	e533555b57	Fix-up for HDFS-9072 - adding missing import of DFSTestUtil.	2015-09-16 12:30:31 -07:00
Haohui Mai	a343aa928a	HDFS-7995. Implement chmod in the HDFS Web UI. Contributed by Ravi Prakash and Haohui Mai.	2015-09-16 11:50:45 -07:00
Steve Loughran	9a8d09dada	HDFS-9073. Fix failures in TestLazyPersistLockedMemory testReleaseOnEviction(). (J.Andreina via stevel)	2015-09-16 10:11:59 +01:00
Steve Loughran	1f28703d93	HDFS-9072. Fix random failures in TestJMXGet. (J.Andreina via stevel)	2015-09-16 10:08:18 +01:00
Haohui Mai	08c2c402cf	HDFS-7986. Allow files / directories to be deleted from the NameNode UI. Contributed by Ravi Prakash.	2015-09-15 16:48:33 -07:00
cnauroth	b297a9c95c	HDFS-9082. Change the log level in WebHdfsFileSystem.initialize() from INFO to DEBUG. Contributed by Santhosh Nayak. ... (cherry picked from commit 559c09dc0e)	2015-09-15 15:13:56 -07:00
Vinayakumar B	2b78714c68	HDFS-8953. DataNode Metrics logging (Contributed by Kanaka Kumar Avvaru) ... (cherry picked from commit ce69c9b54c)	2015-09-16 00:18:59 +05:30
Ming Ma	3531823fcc	HDFS-9008. Balancer#Parameters class could use a builder pattern. (Chris Trezzo via mingma) ... (cherry picked from commit 083b44c136)	2015-09-15 10:18:44 -07:00
Vinayakumar B	aa963ab441	HDFS-9067. o.a.h.hdfs.server.datanode.fsdataset.impl.TestLazyWriter is failing in trunk (Contributed by Surendra Singh Lilhore) ... (cherry picked from commit a440567491)	2015-09-15 17:33:15 +05:30
Haohui Mai	df9bb7449c	HDFS-9065. Include commas on # of files, blocks, total filesystem objects in NN Web UI. Contributed by Daniel Templeton.	2015-09-14 20:27:24 -07:00
Haohui Mai	5546df0020	HDFS-9010. Replace NameNode.DEFAULT_PORT with HdfsClientConfigKeys.DFS_NAMENODE_RPC_PORT_DEFAULT config key. Contributed by Mingliang Liu.	2015-09-14 18:23:10 -07:00
Colin Patrick Mccabe	149d731559	HDFS-8829. Make SO_RCVBUF and SO_SNDBUF size configurable for DataTransferProtocol sockets and allow configuring auto-tuning (He Tianyi via Colin P. McCabe) ... Change-Id: I77dc71aaf9e14ef743f2a2cbebeec04a4f628c78 (cherry picked from commit 7b5cf5352e)	2015-09-14 16:02:26 -07:00
Colin Patrick Mccabe	2596695654	HDFS-8996. Consolidate validateLog and scanLog in FJM#EditLogFile (Zhe Zhang via Colin P. McCabe) ... (cherry picked from commit 53bad4eb00)	2015-09-14 15:52:39 -07:00
Steve Loughran	c951d56556	HDFS-9069. TestNameNodeMetricsLogger failing -port in use. (stevel)	2015-09-14 10:36:34 +01:00
Haohui Mai	323821b174	HDFS-9041. Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client. Contributed by Mingliang Liu.	2015-09-12 11:02:27 -07:00
Vinayakumar B	7545488b12	HDFS-9036. In BlockPlacementPolicyWithNodeGroup#chooseLocalStorage , random node is selected eventhough fallbackToLocalRack is true. (Contributed by J.Andreina) ... (cherry picked from commit c715650385)	2015-09-12 17:40:41 +05:30
Vinayakumar B	1857621671	HDFS-9042. Update document for the Storage policy name (Contributed by J.Andreina) ... (cherry picked from commit d8455479b8)	2015-09-12 12:36:37 +05:30
Kihwal Lee	50a367da20	Fix up CHANGES.txt	2015-09-11 16:02:05 -05:00
Arpit Agarwal	d732c7b9de	HDFS-9027. Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method. (Contributed by Mingliang Liu)	2015-09-11 10:12:02 -07:00
Vinod Kumar Vavilapalli	d5823452b9	HDFS-7314. Moving to 2.6.1 CHANGES.txt section. ... (cherry picked from commit f103a70af5)	2015-09-10 16:47:00 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)	cbf90f93f9	Updating all CHANGES.txt files to move entires from future releases into 2.6.1 ... section given the large number of backports to 2.6.1. (cherry picked from commit fbbb7ff1ed)	2015-09-10 14:01:15 -07:00
Kihwal Lee	633344aa57	HDFS-6763. Initialize file system-wide quota once on transitioning to active. Contributed by Kihwal Lee ... (cherry picked from commit a40342b0da)	2015-09-10 09:18:10 -05:00
Akira Ajisaka	c260a8aa93	HDFS-8974. Convert docs in xdoc format to markdown. Contributed by Masatake Iwasaki.	2015-09-10 16:50:57 +09:00
Vinayakumar B	cd256c1fda	HDFS-8581. ContentSummary on / skips further counts on yielding lock (contributed by J.Andreina) ... (cherry picked from commit 4014ce5990)	2015-09-10 00:09:27 +05:30
Vinayakumar B	03f50de48d	HDFS-7116. Add a command to get the balancer bandwidth (Contributed by Rakesh R) ... (cherry picked from commit 0f0e897bf1)	2015-09-09 22:59:55 +05:30
Kihwal Lee	d003797098	HDFS-8716. Introduce a new config specifically for safe mode block count. Contributed by Chang Li. ... (cherry picked from commit 4d13335fc9)	2015-09-09 11:10:02 -05:00
Akira Ajisaka	eb9e06f8e3	HDFS-9033. dfsadmin -metasave prints "NaN" for cache used%. Contributed by Brahma Reddy Battula. ... (cherry picked from commit 0113e4528d)	2015-09-09 17:21:22 +09:00
Vinayakumar B	ddecd86818	HDFS-8929. Add a metric to expose the timestamp of the last journal (Contributed by surendra singh lilhore) ... (cherry picked from commit 94cf7ab9d2)	2015-09-09 11:06:06 +05:30
Colin Patrick Mccabe	b9bf1a9391	HDFS-8860. Remove unused Replica copyOnWrite code (Lei (Eddy) Xu via Colin P. McCabe) ... (cherry picked from commit a153b9601a)	2015-09-08 18:37:42 -07:00
Xiaoyu Yao	b2465690a1	HDFS-9019. Adding informative message to sticky bit permission denied exception. Contributed by Xiaoyu Yao. ... (cherry picked from commit 970daaa5e4)	2015-09-08 09:58:29 -07:00
Andrew Wang	355398e441	HADOOP-12358. Add -safely flag to rm to prompt when deleting many files. Contributed by Xiaoyu Yao. ... (cherry picked from commit e1feaf6db0)	2015-09-04 13:48:42 -07:00
Haohui Mai	67bce1e827	HDFS-8984. Move replication queues related methods in FSNamesystem to BlockManager. Contributed by Haohui Mai.	2015-09-04 11:45:01 -07:00
Jing Zhao	21178f0b1b	HDFS-8384. Allow NN to startup if there are files having a lease but are not under construction. Contributed by Jing Zhao. ... (cherry picked from commit 8928729c80)	2015-09-04 11:42:53 -07:00
Haohui Mai	8f712dd2f0	HDFS-9012. Move o.a.h.hdfs.protocol.datatransfer.PipelineAck class to hadoop-hdfs-client module. Contributed by Mingliang Liu.	2015-09-04 10:41:28 -07:00
Andrew Wang	267bb22aaa	HDFS-9021. Use a yellow elephant rather than a blue one in diagram. ... (cherry picked from commit c83d13c649)	2015-09-03 16:27:23 -07:00
Haohui Mai	d99018d6bc	HDFS-9002. Move o.a.h.hdfs.net/*Peer classes to hdfs-client. Contributed by Mingliang Liu.	2015-09-03 15:33:22 -07:00
Jakob Homan	9871f57d41	HDFS-8939. Test(S)WebHdfsFileContextMainOperations failing on branch-2. Contributed by Chris Nauroth.	2015-09-03 13:25:53 -07:00
Colin Patrick Mccabe	9310745d22	HDFS-8964. When validating the edit log, do not read at or beyond the file offset that is being written (Zhe Zhang via Colin P. McCabe) ... (cherry picked from commit 53c38cc89a)	2015-09-03 11:25:33 -07:00
Arpit Agarwal	e1842ce678	HDFS-9009. Send metrics logs to NullAppender by default. (Arpit Agarwal)	2015-09-03 11:14:53 -07:00
Tsuyoshi Ozawa	f4ee0bf19f	HADOOP-5323. Trash documentation should describe its directory structure and configurations. Contributed by Weiwei Yang. ... (cherry picked from commit 9a87f81ce6)	2015-09-03 22:34:40 +09:00
Akira Ajisaka	772fe0f478	HDFS-8885. ByteRangeInputStream used in webhdfs does not override available(). Contributed by Shradha Revankar. ... (cherry picked from commit c92e31bd65)	2015-09-03 19:41:36 +09:00
Ming Ma	f81d12668f	HDFS-8890. Allow admin to specify which blockpools the balancer should run on. (Chris Trezzo via mingma) ... (cherry picked from commit d31a41c359)	2015-09-02 15:57:55 -07:00
Jing Zhao	1d56325a80	HDFS-9003. ForkJoin thread pool leaks. Contributed by Kihwal Lee. ... (cherry picked from commit de928d566a)	2015-09-02 15:19:29 -07:00
Andrew Wang	e1943e4471	HDFS-328. Improve fs -setrep error message for invalid replication factors. Contributed by Daniel Templeton. ... (cherry picked from commit afc88b396f)	2015-09-02 13:49:23 -07:00
Colin Patrick Mccabe	5e4bc2640d	HDFS-2070. Add more unit tests for FsShell getmerge (Daniel Templeton via Colin P. McCabe) ... (cherry picked from commit c006c3a1e6)	2015-09-02 12:47:00 -07:00
Akira Ajisaka	25efccba01	HDFS-8388. Time and Date format need to be in sync in NameNode UI page. Contributed by Surendra Singh Lilhore. ... (cherry picked from commit 65ccf2b125)	2015-09-02 14:30:23 +09:00
yliu	0fb6b68101	HDFS-8995. Flaw in registration bookeeping can make DN die on reconnect. (Kihwal Lee via yliu)	2015-09-02 09:01:31 +08:00
Colin Patrick Mccabe	b52ae6140b	HDFS-8965. Harden edit log reading code against out of memory errors (cmccabe) ... (cherry picked from commit 24f6a7c956)	2015-08-31 18:06:48 -07:00
yliu	d852ec1f77	HDFS-8946. Improve choosing datanode storage for block placement. (yliu)	2015-09-01 08:51:32 +08:00
Haohui Mai	94ab3b9e8f	HDFS-8990. Move RemoteBlockReader to hdfs-client module. Contributed by Mingliang Liu.	2015-08-31 13:54:42 -07:00
Jing Zhao	f39c749f2a	HDFS-8980. Remove unnecessary block replacement in INodeFile. Contributed by Jing Zhao. ... (cherry picked from commit caa04de149)	2015-08-31 11:48:32 -07:00
Jakob Homan	94944ba4f6	HDFS-8155. Support OAuth2 in WebHDFS. ... (cherry picked from commit 837fb75e8e)	2015-08-29 18:38:21 -07:00
Arpit Agarwal	f1d5f1417e	HDFS-8983. NameNode support for protected directories. (Contributed by Arpit Agarwal)	2015-08-29 09:57:53 -07:00
Haohui Mai	a3d0534558	HDFS-8925. Move BlockReaderLocal to hdfs-client. Contributed by Mingliang Liu.	2015-08-28 14:38:23 -07:00
Colin Patrick Mccabe	159969f658	HDFS-8950. NameNode refresh doesn't remove DataNodes that are no longer in the allowed list (Daniel Templeton) ... (cherry picked from commit b94b56806d)	2015-08-28 14:22:05 -07:00
Haohui Mai	dea531a3d5	HDFS-8938. Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager. Contributed by Mingliang Liu.	2015-08-28 14:13:59 -07:00
Kihwal Lee	5184779418	HDFS-8865. Improve quota initialization performance. Contributed by Kihwal Lee. ... (cherry picked from commit b6ceee9bf4)	2015-08-28 13:19:28 -05:00
yliu	5f9b323eb0	HDFS-8963. Fix incorrect sign extension of xattr length in HDFS-8900. (Colin Patrick McCabe via yliu)	2015-08-28 10:53:53 +08:00
Haohui Mai	07a19325c4	Revert "HDFS-8938. Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager. Contributed by Mingliang Liu." ... This reverts commit 0ae19f76f4.	2015-08-27 16:09:51 -07:00
Haohui Mai	0ae19f76f4	HDFS-8938. Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager. Contributed by Mingliang Liu.	2015-08-27 15:49:26 -07:00
Haohui Mai	1b01d163a2	HDFS-8969. Clean up findbugs warnings for HDFS-8823 and HDFS-8932. Contributed by Anu Engineer.	2015-08-27 13:03:29 -07:00
Haohui Mai	f4b2348503	HDFS-8961. Investigate lock issue in o.a.h.hdfs.shortcircuit.DfsClientShmManager.EndpointShmManager. Contributed by Mingliang Liu.	2015-08-27 09:13:37 -07:00
Haohui Mai	af1e2993c7	HDFS-8962. Clean up checkstyle warnings in o.a.h.hdfs.DfsClientConf. Contributed by Mingliang Liu.	2015-08-27 09:05:28 -07:00
Harsh J	574f3a98ce	HDFS-2390. dfsadmin -setBalancerBandwidth does not validate -ve value. Contributed by Gautam Gopalakrishnan. ... (cherry picked from commit 0bf285413f)	2015-08-27 16:23:22 +05:30
Vinayakumar B	d63122979f	HDFS-8682. Should not remove decommissioned node,while calculating the number of live/dead decommissioned node. (Contributed by J. Andreina) ... (cherry picked from commit fdb56f74f3)	2015-08-27 13:07:35 +05:30
Haohui Mai	2f3faf39ef	HDFS-8248. Store INodeId instead of the INodeFile object in BlockInfoContiguous. Contributed by Haohui Mai.	2015-08-26 18:14:49 -07:00
Jing Zhao	10c4d6df61	HDFS-8896. DataNode object isn't GCed when shutdown, because it has GC root in ShutdownHookManager. Contributed by Walter Su. ... (cherry picked from commit f44b599003)	2015-08-26 16:28:38 -07:00
Haohui Mai	f0f6f1c7e9	HDFS-8951. Move the shortcircuit package to hdfs-client. Contributed by Mingliang Liu.	2015-08-26 14:22:33 -07:00
Colin Patrick Mccabe	9264b7e119	HDFS-8846. Add a unit test for INotify functionality across a layout version upgrade (Zhe Zhang via Colin P. McCabe) ... (cherry picked from commit a4d9acc51d)	2015-08-25 14:30:15 -07:00
yliu	df5dbf317d	HDFS-8900. Compact XAttrs to optimize memory footprint. (yliu)	2015-08-25 16:14:11 +08:00
Xiaoyu Yao	137bde0755	HDFS-8932. NPE thrown in NameNode when try to get TotalSyncCount metric before editLogStream initialization. Contributed by Surendra Singh Lilhore ... (cherry picked from commit 3b00eaea25)	2015-08-24 16:57:02 -07:00
Haohui Mai	ef8437a382	HDFS-8948. Use GenericTestUtils to set log levels in TestPread and TestReplaceDatanodeOnFailure. Contributed by Mingliang Liu.	2015-08-24 16:16:33 -07:00
Jing Zhao	eefc1c174b	HDFS-8928. Improvements for BlockUnderConstructionFeature: ReplicaUnderConstruction as a separate class and replicas as an array. Contributed by Jing Zhao. ... (cherry picked from commit bdd79388f3)	2015-08-24 15:55:58 -07:00
Haohui Mai	95f8e93691	HDFS-8934. Move ShortCircuitShm to hdfs-client. Contributed by Mingliang Liu.	2015-08-24 13:40:30 -07:00
Andrew Wang	a727c6db05	Revert "HDFS-8934. Move ShortCircuitShm to hdfs-client. Contributed by Mingliang Liu." ... This reverts commit 8e4afa3a67.	2015-08-24 11:51:46 -07:00
Colin Patrick Mccabe	87d0133703	HDFS-8930. Block report lease may leak if the 2nd full block report comes when NN is still in safemode (Colin P. McCabe via Jing Zhao) ... (cherry picked from commit b5ce87f84d)	2015-08-24 11:33:21 -07:00
Akira Ajisaka	f7ee225052	HDFS-8942. Update hyperlink to rack awareness page in HDFS Architecture documentation. Contributed by Masatake Iwasaki. ... (cherry picked from commit bcaf83902a)	2015-08-24 13:53:22 +09:00
Haohui Mai	8e4afa3a67	HDFS-8934. Move ShortCircuitShm to hdfs-client. Contributed by Mingliang Liu.	2015-08-22 13:30:48 -07:00
Haohui Mai	8c205267c8	HDFS-8823. Move replication factor into individual blocks. Contributed by Haohui Mai.	2015-08-22 00:09:59 -07:00
Lei Xu	3a4d614f68	HDFS-8924. Add pluggable interface for reading replicas in DFSClient. (Colin Patrick McCabe via Lei Xu) ... (cherry picked from 7087e700e0) Conflicts: hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/impl/DfsClientConf.java	2015-08-21 17:17:19 -07:00
Chris Douglas	c8f1097989	HDFS-8891. HDFS concat should keep srcs order. Contributed by Yong Zhang. ... Moved CHANGES.txt entry to 2.7.2 (cherry picked from commit b0564c9f3c)	2015-08-20 20:39:59 -07:00
Vinod Kumar Vavilapalli	45be1240d9	Creating 2.6.2 entries in CHANGES.txt files. ... (cherry picked from commit 33474939a0)	2015-08-20 17:23:54 -07:00
Jing Zhao	cd0c6b5789	HDFS-8809. HDFS fsck reports under construction blocks as CORRUPT. Contributed by Jing Zhao. ... (cherry picked from commit c8bca62718)	2015-08-20 16:32:04 -07:00
Colin Patrick Mccabe	a0450b96a2	HDFS-8922. Link the native_mini_dfs test library with libdl, since IBM Java requires it (Ayappan via Colin P. McCabe) ... (cherry picked from commit 7642f64c24)	2015-08-20 14:40:37 -07:00
Yongjun Zhang	b085c5ef6f	HDFS-8828. Utilize Snapshot diff report to build diff copy list in distcp. (Yufei Gu via Yongjun Zhang) ... (cherry picked from commit 0bc15cb6e6)	2015-08-20 08:10:34 -07:00
yliu	146db49f7f	HDFS-8863. The remaining space check in BlockPlacementPolicyDefault is flawed. (Kihwal Lee via yliu)	2015-08-20 20:46:45 +08:00
yliu	63bdbb7793	HDFS-8884. Fail-fast check in BlockPlacementPolicyDefault#chooseTarget. (yliu)	2015-08-20 20:08:20 +08:00
Jing Zhao	62dfe1b7e4	HDFS-8917. Cleanup BlockInfoUnderConstruction from comments and tests. Contributed by Zhe Zhang. ... (cherry picked from commit 4e14f7982a)	2015-08-19 15:16:35 -07:00
Haohui Mai	535b6db74c	HDFS-8803. Move DfsClientConf to hdfs-client. Contributed by Mingliang Liu.	2015-08-19 11:43:32 -07:00
Jing Zhao	c0a4cd978a	HDFS-8867. Enable optimized block reports. Contributed by Daryn Sharp. ... (cherry picked from commit f61120d964)	2015-08-19 10:39:18 -07:00
Arpit Agarwal	10a0ddbac3	HDFS-8911. NameNode Metric : Add Editlog counters as a JMX metric. (Contributed by Anu Engineer)	2015-08-19 09:42:48 -07:00
yliu	0824fa1c4f	HDFS-8908. TestAppendSnapshotTruncate may fail with IOException: Failed to replace a bad datanode. (Tsz Wo Nicholas Sze via yliu)	2015-08-19 21:56:56 +08:00
Tsz-Wo Nicholas Sze	7245f7fad2	HDFS-8826. In Balancer, add an option to specify the source node list so that balancer only selects blocks to move from those nodes.	2015-08-18 19:26:58 -07:00
Chris Douglas	79af15fd37	HDFS-8435. Support CreateFlag in WebHDFS. Contributed by Jakob Homan	2015-08-18 17:33:21 -07:00
Akira Ajisaka	38b344adfa	HDFS-8852. HDFS architecture documentation of version 2.x is outdated about append write support. Contributed by Ajith S. ... (cherry picked from commit fc509f66d8)	2015-08-18 23:32:57 +09:00
Tsz-Wo Nicholas Sze	9ab89a9266	HDFS-8278. When computing max-size-to-move in Balancer, count only the storage with remaining >= default block size.	2015-08-17 18:42:41 -07:00
yliu	076c688780	HDFS-8862. BlockManager#excessReplicateMap should use a HashMap. (yliu)	2015-08-18 09:25:03 +08:00
Arpit Agarwal	85cb596e2e	HDFS-8880. NameNode metrics logging. (Arpit Agarwal)	2015-08-17 16:55:24 -07:00
Colin Patrick Mccabe	39326ba71c	HDFS-8845. DiskChecker should not traverse the entire tree (Chang Li via Colin P. McCabe)	2015-08-17 15:24:56 -07:00
Colin Patrick Mccabe	08508ca1c8	HDFS-8792. BlockManager#postponedMisreplicatedBlocks should use a LightWeightHashSet to save memory (Yi Liu via Colin P. McCabe) ... (cherry picked from commit c77bd6af16)	2015-08-17 12:07:16 -07:00
Haohui Mai	55f7097900	HDFS-8801. Convert BlockInfoUnderConstruction as a feature. Contributed by Jing Zhao.	2015-08-17 11:28:51 -07:00
Haohui Mai	4e712faac2	HDFS-6407. Add sorting and pagination in the datanode tab of the NN Web UI. Contributed by Haohui Mai.	2015-08-17 11:04:17 -07:00
Xiaoyu Yao	27ccbd51f6	HDFS-8883. NameNode Metrics : Add FSNameSystem lock Queue Length. Contributed by Anu Engineer. ... (cherry picked from commit a7862d5fe4)	2015-08-17 10:23:56 -07:00
Andrew Wang	9dcb426819	HDFS-8713. Convert DatanodeDescriptor to use SLF4J logging. ... (cherry picked from commit 3fe758436041d55da1ccde4d5109da38d1f5110f)	2015-08-17 10:16:37 -07:00
Jing Zhao	2edfc3ce71	HDFS-8891. HDFS concat should keep srcs order. Contributed by Yong Zhang. ... (cherry picked from commit dc7a061668)	2015-08-14 14:43:33 -07:00
Tsz-Wo Nicholas Sze	61b9e5f7ff	HDFS-8824. Do not use small blocks for balancing the cluster.	2015-08-14 13:08:57 -07:00
Arpit Agarwal	b094f8b589	HDFS-7649. Multihoming docs should emphasize using hostnames in configurations. (Contributed by Brahma Reddy Battula)	2015-08-14 13:08:19 -07:00
Xiaoyu Yao	17256e2ae8	HDFS-8565. Typo in dfshealth.html - Decomissioning. (nijel via xyao) ... (cherry picked from commit 1569228ec9)	2015-08-14 12:35:17 -07:00
Vinayakumar B	0b6574380c	HDFS-8270. create() always retried with hardcoded timeout when file already exists with open lease (Contributed by J.Andreina) ... Moved to 2.6.1 (cherry picked from commit 84bf71295a)	2015-08-14 16:13:47 +05:30
Vinayakumar B	15760a148b	HDFS-7225. Remove stale block invalidation work when DN re-registers with different UUID. (Zhe Zhang and Andrew Wang) ... Moved to 2.6.1 (cherry picked from commit 08bd4edf40)	2015-08-14 12:38:23 +05:30
Vinayakumar B	9839abe1a8	HDFS-7263. Snapshot read can reveal future bytes for appended files. Contributed by Tao Luo. ... Moved CHANGES.txt entry to 2.6.1 (cherry picked from commit fa2641143c)	2015-08-14 11:46:30 +05:30
Vinayakumar B	c2a9c3929e	HDFS-7235. DataNode#transferBlock should report blocks that don't exist using reportBadBlock (yzhang via cmccabe) ... Moved CHANGES.txt entry to 2.6.1 (cherry picked from commit f2b4bc9b6a)	2015-08-14 11:38:03 +05:30
Vinayakumar B	2c0063d420	HDFS-7213. processIncrementalBlockReport performance degradation. Contributed by Eric Payne. ... Moved CHANGES.TXT entry to 2.6.1 (cherry picked from commit d25cb8fe12)	2015-08-14 11:24:12 +05:30
yliu	073cb16d81	HADOOP-12295. Improve NetworkTopology#InnerNode#remove logic. (yliu)	2015-08-13 16:42:40 +08:00
Akira Ajisaka	200fadedc0	HDFS-8622. Implement GETCONTENTSUMMARY operation for WebImageViewer. Contributed by Jagadesh Kiran N. ... (cherry picked from commit 40f815131e)	2015-08-13 12:23:03 +09:00
cnauroth	bf8b09d4b8	HADOOP-12258. Need translate java.nio.file.NoSuchFileException to FileNotFoundException to avoid regression. Contributed by Zhihai Xu. ... (cherry picked from commit 6cc8e38db5)	2015-08-12 16:45:05 -07:00
Xiaoyu Yao	458b684941	HDFS-8879. Quota by storage type usage incorrectly initialized upon namenode restart. Contributed by Xiaoyu Yao. ... (cherry picked from commit 3e715a4f4c)	2015-08-12 15:25:20 -07:00
Andrew Wang	d53296281a	HDFS-8887. Expose storage type and storage ID in BlockLocation. ... (cherry picked from commit 1ea1a8334e)	2015-08-11 23:33:06 -07:00
Jing Zhao	f0e13c5499	HDFS-8805. Archival Storage: getStoragePolicy should not need superuser privilege. Contributed by Brahma Reddy Battula. ... (cherry picked from commit 1fc3c779a4)	2015-08-11 10:28:48 -07:00
Tsz-Wo Nicholas Sze	ac8d153046	HDFS-8818. Changes the global moveExecutor to per datanode executors and changes MAX_SIZE_TO_MOVE to be configurable.	2015-08-10 16:53:15 -07:00
Jakob Homan	e771dbefe9	HDFS-8866. Typo in docs: Rumtime -> Runtime. Contributed by Gabor Liptak. ... (cherry picked from commit 8f73bdd06b)	2015-08-07 11:39:54 -07:00
Andrew Wang	0c4c7b3b62	HDFS-8772. Fix TestStandbyIsHot#testDatanodeRestarts which occasionally fails. Contributed by Walter Su.	2015-08-07 09:53:04 -07:00
Arpit Agarwal	42a05d29ee	HDFS-8856. Make LeaseManager#countPath O(1). (Contributed by Arpit Agarwal)	2015-08-06 18:52:07 -07:00
Jing Zhao	d7d804623e	Revert "HDFS-8499. Refactor BlockInfo class hierarchy with static helper class. Contributed by Zhe Zhang." ... This reverts commit c17439c2dd. (cherry picked from commit f4c523b69b)	2015-08-06 10:26:09 -07:00
Jing Zhao	2c694286b4	Revert "HDFS-8623. Refactor NameNode handling of invalid, corrupt, and under-recovery blocks. Contributed by Zhe Zhang." ... This reverts commit de480d6c89. (cherry picked from commit 663eba0ab1)	2015-08-06 10:25:54 -07:00
Vinayakumar B	f8932d478f	HDFS-8815. DFS getStoragePolicy implementation using single RPC call (Contributed by Surendra Singh Lilhore) ... (cherry picked from commit cc71ad80e1)	2015-08-06 11:11:59 +05:30
Lei Xu	f7b0f292e7	HADOOP-12269. Update aws-sdk dependency to 1.10.6 (Thomas Demoor via Lei (Eddy) Xu) ... (cherry picked from commit d5403747b5)	2015-08-04 18:56:07 -07:00
Colin Patrick Mccabe	b64d2ac478	HDFS-8844. TestHDFSCLI does not cleanup the test directory (Masatake Iwasaki via Colin P. McCabe) ... (cherry picked from commit c95993cbaf)	2015-08-04 12:22:40 -07:00
yliu	d2b941f94a	HDFS-8850. VolumeScanner thread exits with exception if there is no block pool to be scanned but there are suspicious blocks. (Colin Patrick McCabe via yliu)	2015-08-04 15:51:37 +08:00
Zhihai Xu	c6e79178d4	HDFS-8847. change TestHDFSContractAppend to not override testRenameFileBeingAppended method. Contributed by Zhihai Xu ... (cherry picked from commit 90b510405a)	2015-07-31 21:48:03 -07:00
Xiaoyu Yao	52ee3ecdf6	HDFS-6860. BlockStateChange logs are too noisy. Contributed by Chang Li and Xiaoyu Yao. ... (cherry picked from commit d311a38a6b)	2015-07-31 16:19:11 -07:00
Colin Patrick Mccabe	07a042aa3c	HADOOP-7824. NativeIO.java flags and identifiers must be set correctly for each platform, not hardcoded to their Linux values (Martin Walsh via Colin P. McCabe) ... (cherry picked from commit 21d10ccc6e)	2015-07-31 15:02:01 -07:00
Harsh J	212b8b919d	HDFS-8821. Explain message "Operation category X is not supported in state standby". Contributed by Gautam Gopalakrishnan. ... (cherry picked from commit c5caa25b8f)	2015-07-31 08:59:22 +05:30
Arpit Agarwal	95e71772cf	HDFS-7192. DN should ignore lazyPersist hint if the writer is not local. (Contributed by Arpit Agarwal)	2015-07-30 13:16:52 -07:00
Haohui Mai	3faf7bc3fe	HDFS-8816. Improve visualization for the Datanode tab in the NN UI. Contributed by Haohui Mai.	2015-07-29 17:14:20 -07:00
Jason Lowe	e6b4714d0b	HADOOP-10945. 4-digit octal umask permissions throws a parse error. Contributed by Chang Li ... (cherry picked from commit 6f0a35724f)	2015-07-29 15:25:59 +00:00
Vinayakumar B	a0238d85f6	HDFS-8670. Better to exclude decommissioned nodes for namenode NodeUsage JMX (Contributed by J.Andreina) ... (cherry picked from commit 6374ee0db4) Conflicts: hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt	2015-07-29 14:49:16 +05:30
Akira Ajisaka	dff49aee08	Revert "HDFS-6682. Add a metric to expose the timestamp of the oldest under-replicated block. (aajisaka)" ... This reverts commit 17319c4a65.	2015-07-29 16:52:54 +09:00
Lei Xu	9d81916040	HDFS-8834. TestReplication is not valid after HDFS-6482. (Contributed by Lei Xu) ... (cherry picked from commit f4f1b8b267)	2015-07-28 23:41:44 -07:00
Vinayakumar B	dcf1f1fdf8	HDFS-8822. Add SSD storagepolicy tests in TestBlockStoragePolicy#testDefaultPolicies (Contributed by Vinayakumar B) ... (cherry picked from commit 975e138df3)	2015-07-29 11:51:18 +05:30
Vinayakumar B	0c09597942	HDFS-8811. Move BlockStoragePolicy name's constants from HdfsServerConstants.java to HdfsConstants.java (Contributed by Vinayakumar B) ... (cherry picked from commit 50887e5b07)	2015-07-29 11:46:19 +05:30
Jakob Homan	71a5aa267d	HDFS-8180. AbstractFileSystem Implementation for WebHdfs. Contributed by Sathosh G Nayak. ... (cherry picked from commit 0712a8103f)	2015-07-28 21:11:02 -07:00
Arun Suresh	ffe6a34d5b	HDFS-7858. Improve HA Namenode Failover detection on the client. (asuresh) ... (cherry picked from commit 030fcfa99c)	2015-07-27 23:03:34 -07:00
Akira Ajisaka	1cf5e40838	HDFS-8810. Correct assertions in TestDFSInotifyEventInputStream class. Contributed by Surendra Singh Lilhore. ... (cherry picked from commit 1df78688c6)	2015-07-27 13:18:02 +09:00
Akira Ajisaka	7bdd32ce3c	HDFS-8735. Inotify: All events classes should implement toString() API. Contributed by Surendra Singh Lilhore. ... (cherry picked from commit f8f6091823)	2015-07-25 02:57:33 +09:00
Akira Ajisaka	b2a532f61c	HDFS-8806. Inconsistent metrics: number of missing blocks with replication factor 1 not properly cleared. Contributed by Zhe Zhang. ... (cherry picked from commit 206d4933a5)	2015-07-24 18:29:24 +09:00
Akira Ajisaka	17319c4a65	HDFS-6682. Add a metric to expose the timestamp of the oldest under-replicated block. (aajisaka) ... (cherry picked from commit 02c01815ec)	2015-07-24 11:39:16 +09:00
Haohui Mai	d3e6b40b44	HDFS-8730. Clean up the import statements in ClientProtocol. Contributed by Takanobu Asanuma.	2015-07-23 10:30:43 -07:00
Arpit Agarwal	601b503895	HADOOP-12161. Add getStoragePolicy API to the FileSystem interface. (Contributed by Brahma Reddy Battula)	2015-07-23 10:14:01 -07:00
Jing Zhao	71764a92c6	HDFS-8797. WebHdfsFileSystem creates too many connections for pread. Contributed by Jing Zhao. ... (cherry picked from commit e91ccfad07)	2015-07-22 18:03:45 -07:00
yliu	930e344d78	HDFS-8795. Improve InvalidateBlocks#node2blocks. (yliu)	2015-07-22 15:15:08 +08:00
Haohui Mai	53ed25c3d1	HDFS-8495. Consolidate append() related implementation into a single class. Contributed by Rakesh R.	2015-07-21 17:28:28 -07:00
cnauroth	aab1c14df6	HDFS-8773. Few FSNamesystem metrics are not documented in the Metrics page. Contributed by Rakesh R. ... (cherry picked from commit a26cc66f38) Conflicts: hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt	2015-07-21 14:13:15 -07:00
cnauroth	57d55d40dd	HDFS-8721. Add a metric for number of encryption zones. Contributed by Rakesh R. ... (cherry picked from commit cb03768b1b)	2015-07-21 13:56:07 -07:00
Ravi Prakash	b728edce0f	Revert "HDFS-8344. NameNode doesn't recover lease for files with missing blocks (raviprak)" ... This reverts commit 3d58c7a700. Conflicts: hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt	2015-07-21 11:30:41 -07:00
Vinayakumar B	cd3692fe4b	HDFS-7582. Enforce maximum number of ACL entries separately per access and default. (Contributed by Vinayakumar B) ... (cherry picked from commit 29cf887b22)	2015-07-21 15:17:26 +05:30
Haohui Mai	4283831348	HDFS-7483. Display information per tier on the Namenode UI. Contributed by Benoy Antony and Haohui Mai.	2015-07-20 20:13:16 -07:00
Akira Ajisaka	e78ee18642	Move HDFS-6945 to 2.7.2 section in CHANGES.txt. ... (cherry picked from commit a628f67590)	2015-07-21 11:45:53 +09:00
yliu	cadd02ad1d	HDFS-8794. Improve CorruptReplicasMap#corruptReplicasMap. (yliu)	2015-07-21 09:18:43 +08:00
Ravi Prakash	3d58c7a700	HDFS-8344. NameNode doesn't recover lease for files with missing blocks (raviprak) ... (cherry picked from commit e4f756260f)	2015-07-20 14:04:28 -07:00
Ming Ma	516bbf1c20	HDFS-7314. When the DFSClient lease cannot be renewed, abort open-for-write files rather than the entire DFSClient. (mingma) ... (cherry picked from commit fbd88f1062)	2015-07-16 12:55:29 -07:00
Arpit Agarwal	dc211ca658	HDFS-8778. TestBlockReportRateLimiting#testLeaseExpiration can deadlock. (Contributed by Arpit Agarwal)	2015-07-15 14:09:06 -07:00
Akira Ajisaka	bad5d288ac	HDFS-8742. Inotify: Support event for OP_TRUNCATE. Contributed by Surendra Singh Lilhore. ... (cherry picked from commit 979c9ca2ca)	2015-07-15 04:43:03 +09:00
Kihwal Lee	b0a2dc9c84	HDFS-8722. Optimize datanode writes for small writes and flushes. Contributed by Kihwal Lee ... (cherry picked from commit 59388a8015)	2015-07-14 14:07:38 -05:00
Colin Patrick Mccabe	471037883f	HDFS-7608: hdfs dfsclient newConnectedPeer has no write timeout (Xiaoyu Yao via Colin P. McCabe) ... (cherry picked from commit 1d74ccecec)	2015-07-14 11:00:45 -07:00
Tsz-Wo Nicholas Sze	d8d6d69b09	HDFS-8541. Mover should exit with NO_MOVE_PROGRESS if there is no move progress. Contributed by Surendra Singh Lilhore	2015-07-13 15:13:14 -07:00
Tsz-Wo Nicholas Sze	2e455d4d8b	Add HDFS-8143 to CHANGES.txt.	2015-07-13 15:07:28 -07:00
Jing Zhao	0e8c335e7c	HDFS-8751. Remove setBlocks API from INodeFile and misc code cleanup. Contributed by Zhe Zhang ... (cherry picked from commit 47f4c54106)	2015-07-10 14:18:09 -07:00
Vinayakumar B	c1447e654d	HDFS-2956. calling fetchdt without a --renewer argument throws NPE (Contributed by Vinayakumar B)HDFS-2956. calling fetchdt without a --renewer argument throws NPE (Contributed by Vinayakumar B) ... (cherry picked from commit b48908033f) Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/tools/TestDelegationTokenFetcher.java	2015-07-10 15:52:35 +05:30
Akira Ajisaka	3a0318ea93	HDFS-8749. Fix findbugs warnings in BlockManager.java. Contributed by Brahma Reddy Battula. ... (cherry picked from commit d66302ed9b)	2015-07-10 15:04:44 +09:00
Jing Zhao	ae0d5d6917	HDFS-8729. Fix TestFileTruncate#testTruncateWithDataNodesRestartImmediately which occasionally failed. Contributed by Walter Su. ... (cherry picked from commit f4ca530c1c)	2015-07-09 13:18:35 -07:00
Haohui Mai	981fe4cfaa	HDFS-8726. Move protobuf files that define the client-sever protocols to hdfs-client. Contributed by Haohui Mai.	2015-07-08 10:37:31 -07:00
Arpit Agarwal	e519df47b2	HDFS-8642. Make TestFileTruncate more reliable. (Contributed by Rakesh R)	2015-07-08 09:31:17 -07:00
Vinayakumar B	6fe2e7c3f3	HDFS-8712. Remove 'public' and 'abstract' modifiers in FsVolumeSpi and FsDatasetSpi (Contributed by Lei (Eddy) Xu) ... (cherry picked from commit bd4e10900c) Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/FsDatasetSpi.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/FsVolumeSpi.java	2015-07-08 17:03:18 +05:30
Vinayakumar B	01e12b7d69	Revert "HDFS-8712. Remove 'public' and 'abstract' modifiers in FsVolumeSpi and FsDatasetSpi (Contributed by Lei (Eddy) Xu)" ... This reverts commit 38ee9247cd.	2015-07-08 16:59:22 +05:30
Vinayakumar B	38ee9247cd	HDFS-8712. Remove 'public' and 'abstract' modifiers in FsVolumeSpi and FsDatasetSpi (Contributed by Lei (Eddy) Xu) ... (cherry picked from commit bd4e10900c) Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/FsDatasetSpi.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/FsVolumeSpi.java	2015-07-08 16:36:12 +05:30
Xiaoyu Yao	907abdca73	HDFS-8711. setSpaceQuota command should print the available storage type when input storage type is wrong. Contributed by Brahma Reddy Battula. ... (cherry picked from commit b68701b7b2) Conflicts: hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestQuota.java	2015-07-08 16:25:47 +05:30
Haohui Mai	b181c13cbf	HDFS-8620. Clean up the checkstyle warinings about ClientProtocol. Contributed by Takanobu Asanuma.	2015-07-07 14:04:12 -07:00
Jing Zhao	bed74b620a	Revert "HDFS-8652. Track BlockInfo instead of Block in CorruptReplicasMap. Contributed by Jing Zhao." ... This reverts commit d62b63d297. (cherry picked from commit bc99aaffe7)	2015-07-07 10:14:17 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)	a8bf34cad8	Release process for 2.7.1: Set the release date for 2.7.1. ... (cherry picked from commit bf89ddb9b8)	2015-07-06 16:41:00 -07:00
Jing Zhao	3d73d2027f	HDFS-8652. Track BlockInfo instead of Block in CorruptReplicasMap. Contributed by Jing Zhao. ... (cherry picked from commit d62b63d297)	2015-07-06 15:55:03 -07:00
Vinayakumar B	9a774dfae5	HDFS-8686. WebHdfsFileSystem#getXAttr(Path p, final String name) doesn't work if namespace is in capitals (Contributed by kanaka kumar avvaru) ... (cherry picked from commit fc92d3e651)	2015-07-06 16:09:42 +05:30
Vinayakumar B	b963ca84bc	HDFS-8577. Avoid retrying to recover lease on a file which does not exist (Contributed by J.Andreina) ... (cherry picked from commit 2eae130ab9)	2015-07-03 13:36:07 +05:30
Andrew Wang	efe9ae9fc6	HDFS-8709. Clarify automatic sync in FSEditLog#logEdit. ... (cherry picked from commit 5fddc5177d)	2015-07-02 10:26:43 -07:00
Vinayakumar B	55bf014a07	HDFS-8703. Merge refactor of DFSInputStream from ErasureCoding branch (Contributed by Vinayakumar B) ... (cherry picked from commit bff5999d07)	2015-07-02 16:12:13 +05:30
Colin Patrick Mccabe	490bef0856	HADOOP-12171. Shorten overly-long htrace span names for server (cmccabe) ... (cherry picked from commit a78d5074fb)	2015-07-01 17:57:33 -07:00
Jing Zhao	ff7562cc99	HDFS-8666. Speedup the TestMover test. Contributed by Walter Su. ... (cherry picked from commit 152e5df3b6)	2015-07-01 15:00:16 -07:00
Arpit Agarwal	d38f377cd3	HDFS-8706. Fix typo in datanode startup options in HDFSCommands.html. (Controibuted by Brahma Reddy Battula)	2015-07-01 10:36:10 -07:00
cnauroth	f7ba3c0045	HADOOP-12116. Fix unrecommended syntax usages in hadoop/hdfs/yarn script for cygwin in branch-2. Contributed by Li Lu.	2015-06-30 16:55:10 -07:00
Colin Patrick Mccabe	7c698bc350	HADOOP-10798. globStatus() should always return a sorted list of files (cmccabe) ... (cherry picked from commit 68e588cbee)	2015-06-30 16:42:36 -07:00
Colin Patrick Mccabe	604d1bbdb7	HDFS-8635. Migrate HDFS native build to new CMake framework (Alan Burlison via Colin P. McCabe) ... (cherry picked from commit 29df73dc05)	2015-06-30 16:01:48 -07:00
Vinayakumar B	bc06d5b041	HADOOP-12154. FileSystem#getUsed() returns the file length only from root '/' (Contributed by J.Andreina) ... (cherry picked from commit 6d99017f38)	2015-06-30 15:25:58 +05:30
Vinayakumar B	3c632c80a2	HDFS-8579. Update HDFS usage with missing options (Contributed by J.Andreina) ... (cherry picked from commit 77588e1d32) Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs	2015-06-30 15:02:46 +05:30
Haohui Mai	eccd4f273e	HDFS-8493. Consolidate truncate() related implementation in a single class. Contributed by Rakesh R.	2015-06-29 16:44:58 -07:00
Arpit Agarwal	ff78e611c0	HDFS-8687. Remove the duplicate usage message from Dfsck.java. (Contributed by Brahma Reddy Battula)	2015-06-29 14:56:49 -07:00
Yongjun Zhang	11bdcb754a	HDFS-8659. Block scanner INFO message is spamming logs. Contributed by Yongjun Zhang. ... (cherry picked from commit 43a1288fff)	2015-06-29 14:48:17 -07:00
Andrew Wang	ada7f66e12	HDFS-8653. Code cleanup for DatanodeManager, DatanodeDescriptor and DatanodeStorageInfo. Contributed by Zhe Zhang. ... (cherry picked from commit 2ffd84273a)	2015-06-29 12:12:54 -07:00
Benoy Antony	e40e9fc7f4	HDFS-7390. Provide JMX metrics per storage type. (Benoy Antony) ... (cherry picked from commit d3fed8e653)	2015-06-29 11:02:43 -07:00
Vinayakumar B	438bb25d43	HDFS-8628. Update missing command option for fetchdt (Contributed by J.Andreina) ... (cherry picked from commit fde20ffcef)	2015-06-29 16:51:15 +05:30
Vinayakumar B	beab746177	HDFS-8586. Dead Datanode is allocated for write when client is from deadnode (Contributed by Brahma Reddy Battula) ... (cherry picked from commit 88ceb382ef)	2015-06-29 15:25:54 +05:30
Vinod Kumar Vavilapalli	4155bb565e	Adding release 2.7.2 to CHANGES.txt. ... (cherry picked from commit aad6a7d5db)	2015-06-28 16:30:27 -07:00
Arpit Agarwal	0fd47fa809	HDFS-8681. BlockScanner is incorrectly disabled by default. (Contributed by Arpit Agarwal)	2015-06-28 14:51:30 -07:00
Andrew Wang	dd7776b2fe	HDFS-8656. Preserve compatibility of ClientProtocol#rollingUpgrade after finalization. ... (cherry picked from commit 60b858bfa6)	2015-06-26 11:33:40 -07:00
Jing Zhao	83d76151e2	HDFS-8623. Refactor NameNode handling of invalid, corrupt, and under-recovery blocks. Contributed by Zhe Zhang. ... (cherry picked from commit de480d6c89)	2015-06-26 11:04:05 -07:00
Colin Patrick Mccabe	8552af91f4	HDFS-8651. Make hadoop-hdfs-project Native code -Wall-clean (Alan Burlison via Colin P. McCabe) ... (cherry picked from commit 1b764a01fd)	2015-06-26 10:28:14 -07:00
Andrew Wang	84fdd4a3a0	HDFS-8546. Use try with resources in DataStorage and Storage. ... (cherry picked from commit 1403b84b12)	2015-06-25 17:50:39 -07:00
Andrew Wang	ba406b723d	HDFS-8665. Fix replication check in DFSTestUtils#waitForReplication. ... (cherry picked from commit ff0e5e572f)	2015-06-25 17:29:30 -07:00
Arpit Agarwal	05e9ffdd62	HDFS-8640. Make reserved RBW space visible through JMX. (Contributed by kanaka kumar avvaru)	2015-06-25 10:13:31 -07:00
Akira Ajisaka	44dbddb022	HDFS-8462. Implement GETXATTRS and LISTXATTRS operations for WebImageViewer. Contributed by Jagadesh Kiran N. ... (cherry picked from commit bc433908d3)	2015-06-26 00:22:30 +09:00
Andrew Wang	4b8593caf8	HDFS-8645. Resolve inconsistent code in TestReplicationPolicy between trunk and branch-2. Contributed by Zhe Zhang.	2015-06-24 18:26:14 -07:00
Andrew Wang	431f685300	HDFS-8646. Prune cached replicas from DatanodeDescriptor state on replica invalidation. ... (cherry picked from commit afe9ea3c12)	2015-06-24 14:46:13 -07:00
Haohui Mai	0cd7603bd6	Addendum patch for HDFS-6564.	2015-06-23 22:30:27 -07:00
Jing Zhao	77609e6465	HDFS-8639. Add Option for NameNode HTTP port in MiniDFSClusterManager. Contributed by Kai Sasaki. ... (cherry picked from commit 2ba6465721)	2015-06-23 22:21:01 -07:00
Haohui Mai	3fb192bfb7	HDFS-6564. Use slf4j instead of common-logging in hdfs-client. Contributed by Rakesh R.	2015-06-23 11:41:32 -07:00
Jakob Homan	f6157a4a08	HDFS-8542. WebHDFS getHomeDirectory behavior does not match specification. Contributed by Kanaka Kumar Avvaru. ... (cherry picked from commit fac4e04dd3)	2015-06-22 16:38:07 -07:00
Colin Patrick Mccabe	cbd11681ce	HDFS-8480. Fix performance and timeout issues in HDFS-7929 by using hard-links to preserve old edit logs, instead of copying them. (Zhe Zhang via Colin P. McCabe) ... (cherry picked from commit 7b424f938c)	2015-06-22 14:37:35 -07:00
Andrew Wang	c71f57b2a0	HDFS-8608. Merge HDFS-7912 to trunk and branch-2 (track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks). Contributed by Zhe Zhang. ... (cherry picked from commit 6e3fcffe29) Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/UnderReplicatedBlocks.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestReplicationPolicy.java	2015-06-22 14:22:48 -07:00
Andrew Wang	cd1e0930dc	HDFS-4366. Block Replication Policy Implementation May Skip Higher-Priority Blocks for Lower-Priority Blocks. (Derek Dagit and Zhe Zhang via wang)	2015-06-22 14:18:33 -07:00
Arpit Agarwal	175c5829f0	HDFS-8192. Eviction should key off used locked memory instead of ram disk free space. (Contributed by Arpit Agarwal)	2015-06-20 13:27:58 -07:00
Arpit Agarwal	5dcda16859	HDFS-7164. Update CHANGES.txt	2015-06-20 13:09:21 -07:00
Yongjun Zhang	5774b1ff02	Move HDFS-7546 to release 2.7.1 in CHANGES.txt. ... (cherry picked from commit bcb3c40bed) Conflicts: hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt	2015-06-20 00:49:17 -07:00
Allen Wittenauer	92cff5663e	HDFS-7546. Document, and set an accepting default for dfs.namenode.kerberos.principal.pattern (Harsh J via aw) ... (cherry picked from commit 63613c79c1)	2015-06-20 00:40:44 -07:00
Yongjun Zhang	87c3d3739f	Move HDFS-8337 to branch 2.8 in CHANGES.txt. ... (cherry picked from commit 20c03c9606)	2015-06-20 00:28:48 -07:00
Yongjun Zhang	d657e378ad	HDFS-8337. Accessing httpfs via webhdfs doesn't work from a jar with kerberos. Contributed by Yongjun Zhang. ... (cherry picked from commit 971dc838ec)	2015-06-19 23:44:48 -07:00
Colin Patrick Mccabe	c94579f845	HDFS-8582. Support getting a list of reconfigurable config properties and do not generate spurious reconfig warnings (Lei (Eddy) Xu via Colin P. McCabe) ... (cherry picked from commit d112d18324)	2015-06-19 19:14:38 -07:00
Arpit Agarwal	fcd1824b61	HDFS-8626. Reserved RBW space is not released if creation of RBW File fails. (Contributed by kanaka kumar avvaru)	2015-06-19 18:23:44 -07:00
Yongjun Zhang	2e13e5b253	HDFS-8633. Fix setting of dfs.datanode.readahead.bytes in hdfs-default.xml to match DFSConfigKeys. Contributed by Ray Chiang. ... (cherry picked from commit b42f1ec13d)	2015-06-19 09:50:14 -07:00
Andrew Wang	7f62e41b2e	HDFS-8605. Merge Refactor of DFSOutputStream from HDFS-7285 branch. (vinayakumarb) ... (cherry picked from commit 1c13519e1e)	2015-06-18 08:48:23 -07:00
Akira Ajisaka	998027652f	HDFS-6249. Output AclEntry in PBImageXmlWriter. Contributed by surendra singh lilhore. ... (cherry picked from commit cc432885ad)	2015-06-17 17:41:55 -07:00
Akira Ajisaka	9f9315008e	HDFS-8615. Correct HTTP method in WebHDFS document. Contributed by Brahma Reddy Battula. ... (cherry picked from commit 1a169a26bc)	2015-06-17 17:13:32 -07:00
Colin Patrick Mccabe	8939e3cc2d	HDFS-8589. Fix unused imports in BPServiceActor and BlockReportLeaseManager (cmccabe) ... (cherry picked from commit 45ced38f10)	2015-06-17 17:02:08 -07:00
Haohui Mai	38a16e1a45	HDFS-8446. Separate safemode related operations in GetBlockLocations(). Contributed by Haohui Mai.	2015-06-17 16:38:19 -07:00
Haohui Mai	1270cb47e1	Update CHANGES.txt for HDFS-8238.	2015-06-17 16:20:40 -07:00
Haohui Mai	09941e6f8d	HDFS-8238. Move ClientProtocol to the hdfs-client. Contributed by Takanobu Asanuma.	2015-06-17 16:16:55 -07:00
Arpit Agarwal	acc90ca175	HDFS-7164. Feature documentation for HDFS-6581. (Contributed by Arpit Agarwal)	2015-06-16 19:06:39 -07:00
Tsz-Wo Nicholas Sze	64389f727c	HDFS-8606. Cleanup DFSOutputStream by removing unwanted changes from HDFS-8386. Contributed by Rakesh R	2015-06-16 18:09:30 -07:00
Xiaoyu Yao	4bfbc6b1d4	HDFS-8551. Fix hdfs datanode CLI usage message. Contributed by Brahma Reddy Battula. ... (cherry picked from commit 9cd5ad9d84)	2015-06-16 14:17:51 -07:00
Xiaoyu Yao	8ab23d9ec1	HDFS-8548. Minicluster throws NPE on shutdown. Contributed by surendra singh lilhore. ... (cherry picked from commit 6a76250b39)	2015-06-16 14:00:33 -07:00
Kihwal Lee	d2d038b0a0	HDFS-4660. Block corruption can happen during pipeline recovery. Contributed by Kihwal Lee. ... (cherry picked from commit c74517c46b)	2015-06-16 15:42:00 -05:00
Xiaoyu Yao	d7c8a6feaa	HDFS-8597. Fix TestFSImage#testZeroBlockSize on Windows. Contributed by Xiaoyu Yao. ... (cherry picked from commit 4e88ff5b27) Conflicts: hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt	2015-06-16 12:47:05 -07:00
Haohui Mai	be8e4ed1e1	HDFS-8592. SafeModeException never get unwrapped. Contributed by Haohui Mai.	2015-06-15 22:07:42 -07:00
Yongjun Zhang	b1d3ed02c1	HDFS-8544. Incorrect port specified in HFTP Guide document in branch-2. (Contributed by Brahma Reddy Battula)	2015-06-15 21:45:30 -07:00
Tsz-Wo Nicholas Sze	10b97f6655	HDFS-8361. Choose SSD over DISK in block placement.	2015-06-15 17:18:09 -07:00
Tsz-Wo Nicholas Sze	95483513ed	Move HDFS-8540 to 2.8 in CHANGES.txt.	2015-06-15 17:02:45 -07:00
Tsz-Wo Nicholas Sze	9ba29f081b	HDFS-8540. Mover should exit with NO_MOVE_BLOCK if no block can be moved. Contributed by surendra singh lilhore	2015-06-15 16:28:37 -07:00
Tsz-Wo Nicholas Sze	5c111a5192	HDFS-8576. Lease recovery should return true if the lease can be released and the file can be closed. Contributed by J.Andreina	2015-06-15 16:09:32 -07:00
Arpit Agarwal	ea9a9b3d7e	HDFS-8607. TestFileCorruption doesn't work as expected. (Contributed by Walter Su)	2015-06-15 10:12:07 -07:00
Arpit Agarwal	d07f3804b0	HDFS-8595. TestCommitBlockSynchronization fails in branch-2.7. (Patch applies to all branches). (Contributed by Arpit Agarwal)	2015-06-14 16:24:36 -07:00
Yongjun Zhang	cd578fa289	HDFS-8596. TestDistributedFileSystem et al tests are broken in branch-2 due to incorrect setting of "datanode" attribute. Contributed by Yongjun Zhang. ... (cherry picked from commit b0dc291961) Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/DatanodeHttpServer.java	2015-06-14 12:01:28 -07:00
cnauroth	92144ca75c	HDFS-8593. Calculation of effective layout version mishandles comparison to current layout version in storage. Contributed by Chris Nauroth. ... (cherry picked from commit b8341f1cd8)	2015-06-13 10:38:03 -07:00
Andrew Wang	2776255ed6	HDFS-8499. Refactor BlockInfo class hierarchy with static helper class. Contributed by Zhe Zhang. ... (cherry picked from commit 355e98ab7c7dd997378a8624f642199713467fb8) Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestReplicationPolicy.java	2015-06-12 11:39:02 -07:00
Colin Patrick Mccabe	378bb484bb	HDFS-7923. The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages (cmccabe) ... (cherry picked from commit 12b5b06c06)	2015-06-12 11:29:05 -07:00
Akira Ajisaka	e397cca456	HADOOP-11971. Move test utilities for tracing from hadoop-hdfs to hadoop-common. Contributed by Masatake Iwasaki. ... (cherry picked from commit e4489d97e5)	2015-06-12 07:26:05 -07:00
Haohui Mai	f1ee2eaf86	HDFS-8572. DN always uses HTTP/localhost@REALM principals in SPNEGO. Contributed by Haohui Mai.	2015-06-11 18:59:53 -07:00
Arpit Agarwal	a560e654d9	HDFS-8583. Document that NFS gateway does not work with rpcbind on SLES 11. (Arpit Agarwal)	2015-06-11 15:08:50 -07:00
Colin Patrick Mccabe	754dd3496c	HDFS-8566. HDFS documentation about debug commands wrongly identifies them as "hdfs dfs" commands (Surendra Singh Lilhore via Colin P. McCabe) ... (cherry picked from commit 587309bbba)	2015-06-11 14:28:41 -07:00
Andrew Wang	086eb49424	HDFS-8573. Move creation of restartMeta file logic from BlockReceiver to ReplicaInPipeline. Contributed by Eddy Xu. ... (cherry picked from commit b258b344bb)	2015-06-11 10:12:40 -07:00
Andrew Wang	9523e2c098	HDFS-8549. Abort the balancer if an upgrade is in progress. ... (cherry picked from commit a7a7768341)	2015-06-10 13:43:00 -07:00
Arpit Agarwal	2d67dff15f	HADOOP-12078. The default retry policy does not handle RetriableException correctly. (Contributed by Arpit Agarwal)	2015-06-09 20:58:46 -07:00
Xiaoyu Yao	d8d9041187	HDFS-8568. TestClusterId#testFormatWithEmptyClusterIdOption is failing. Contributed by Rakesh R. ... (cherry picked from commit 3c2397cb04)	2015-06-09 12:21:53 -07:00
Xiaoyu Yao	116a72096d	HDFS-8552. Fix hdfs CLI usage message for namenode and zkfc. Contributed by Brahma Reddy Battula ... (cherry picked from commit 927577c87c)	2015-06-08 22:03:07 -07:00
cnauroth	cc960734e4	HDFS-8553. Document hdfs class path options. Contributed by Brahma Reddy Battula. ... (cherry picked from commit d2832b3d42)	2015-06-08 16:15:53 -07:00
cnauroth	8ee50d8ca7	HDFS-8554. TestDatanodeLayoutUpgrade fails on Windows. Contributed by Chris Nauroth. ... (cherry picked from commit 0e80d51983)	2015-06-08 08:39:14 -07:00
cnauroth	953c4a049a	HDFS-8539. Hdfs doesnt have class debug in windows. Contributed by Anu Engineer. ... (cherry picked from commit a6cb4894b4)	2015-06-07 13:02:01 -07:00
Xiaoyu Yao	c8dc113943	HDFS-8116. Cleanup uncessary if LOG.isDebugEnabled() from RollingWindowManager. Contributed by Brahma Reddy Battula. ... (cherry picked from commit b61b489995)	2015-06-06 18:48:52 -07:00
cnauroth	f99744b7a0	HDFS-8432. Introduce a minimum compatible layout version to allow downgrade in more rolling upgrade use cases. Contributed by Chris Nauroth. ... (cherry picked from commit 71de367c5e) Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/BackupImage.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLog.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java	2015-06-06 09:45:46 -07:00
cnauroth	1d1841d40f	HADOOP-12055. Deprecate usage of NativeIO#link. Contributed by Andrew Wang. ... (cherry picked from commit e46cb80002)	2015-06-06 09:17:11 -07:00
Xiaoyu Yao	1a6cdf97bb	HDFS-8522. Change heavily recorded NN logs from INFO to DEBUG level. Contributed by xyao.	2015-06-05 17:33:06 -07:00
Andrew Wang	320e4cc0e7	HDFS-8535. Clarify that dfs usage in dfsadmin -report output includes all block replicas. Contributed by Eddy Xu. ... (cherry picked from commit b2540f486e)	2015-06-04 15:35:12 -07:00
Andrew Wang	ccc834395b	HDFS-8532. Make the visibility of DFSOutputStream#streamer member variable to private. Contributed by Rakesh R. ... (cherry picked from commit 5149dc7b97)	2015-06-04 11:09:28 -07:00
Kihwal Lee	f0f277ddd0	HDFS-8463. Calling DFSInputStream.seekToNewSource just after stream creation causes NullPointerException. Contributed by Masatake Iwasaki. ... (cherry picked from commit ade6d9a61e)	2015-06-04 12:52:49 -05:00
Vinayakumar B	539ff92c2a	HDFS-3716. Purger should remove stale fsimage ckpt files (Contributed by J.Andreina) ... (cherry picked from commit c59e745630)	2015-06-03 15:31:01 +05:30
Vinayakumar B	0ed9c2d8fe	HDFS-8523. Remove usage information on unsupported operation 'fsck -showprogress' from branch-2 (Contributed by J.Andreina)	2015-06-03 15:15:44 +05:30
Vinayakumar B	4bb725b4dd	HDFS-8470. fsimage loading progress should update inode, delegation token and cache pool count. (Contributed by surendra singh lilhore) ... (cherry picked from commit e965dcec37)	2015-06-03 14:25:12 +05:30
Vinayakumar B	066e45bcb6	HDFS-8270. create() always retried with hardcoded timeout when file already exists with open lease (Contributed by J.Andreina) ... (cherry picked from commit 54f83d9bd9)	2015-06-03 12:12:22 +05:30
Colin Patrick Mccabe	12497b0543	HDFS-8521. Add VisibleForTesting annotation to BlockPoolSlice#selectReplicaToDelete. (cmccabe) ... (cherry picked from commit 806e407ac8)	2015-06-02 20:06:53 -07:00
Andrew Wang	a80a68c298	HDFS-8513. Rename BlockPlacementPolicyRackFaultTolarent to BlockPlacementPolicyRackFaultTolerant. (wang) ... (cherry picked from commit c1d50a91f7)	2015-06-02 15:48:31 -07:00
Andrew Wang	379ece15fe	HDFS-8386. Improve synchronization of 'streamer' reference in DFSOutputStream. Contributed by Rakesh R. ... (cherry picked from commit efc510a570) Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java	2015-06-02 15:42:27 -07:00
Colin Patrick Mccabe	17e369511d	HDFS-8486. DN startup may cause severe data loss (Daryn Sharp via Colin P. McCabe) ... (cherry picked from commit 03fb5c6425)	2015-06-02 11:42:08 -07:00
Vinayakumar B	d1da842f86	HDFS-8256. '-storagepolicies , -blockId ,-replicaDetails ' options are missed out in usage and from documentation (Contributed by J.Andreina) ... (cherry picked from commit a2bd6217eb) Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/DFSck.java	2015-06-02 16:25:53 +05:30
Jing Zhao	640ea994ed	HDFS-8489. Subclass BlockInfo to represent contiguous blocks. Contributed by Zhe Zhang. ... (cherry picked from commit cdc13efb1a)	2015-06-01 11:45:04 -07:00
Tsuyoshi Ozawa	b91cadcafd	HDFS-8490. Typo in trace enabled log in ExceptionHandler of WebHDFS. Contributed by Archana T. ... (cherry picked from commit c2356cb0bc)	2015-06-01 00:42:11 +09:00
Andrew Wang	bdaa0fed13	HADOOP-11885. hadoop-dist dist-layout-stitching.sh does not work with dash. (wang) ... (cherry picked from commit 7673d4f205) Conflicts: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-nativetask/pom.xml hadoop-mapreduce-project/pom.xml	2015-05-29 14:55:52 -07:00
Jing Zhao	17fb442a4c	HDFS-7609. Avoid retry cache collision when Standby NameNode loading edits. Contributed by Ming Ma. ... (cherry picked from commit 7817674a3a)	2015-05-29 11:11:01 -07:00
Vinayakumar B	983c1d3969	HDFS-7401. Add block info to DFSInputStream' WARN message when it adds node to deadNodes (Contributed by Arshad Mohammad) ... (cherry picked from commit b75df697e0)	2015-05-29 16:36:39 +05:30
Akira Ajisaka	e7b81710dd	HDFS-8443. Document dfs.namenode.service.handler.count in hdfs-site.xml. Contributed by J.Andreina. ... (cherry picked from commit d725dd8af6)	2015-05-29 11:36:59 +09:00
Colin Patrick Mccabe	4b108a441d	HADOOP-11894. Bump the version of Apache HTrace to 3.2.0-incubating (Masatake Iwasaki via Colin P. McCabe) ... (cherry picked from commit a1140959da)	2015-05-28 12:03:07 -07:00
Colin Patrick Mccabe	b9752f24a6	HDFS-8407. libhdfs hdfsListDirectory must set errno to 0 on success (Masatake Iwasaki via Colin P. McCabe) ... (cherry picked from commit d2d95bfe88)	2015-05-28 11:38:44 -07:00
cnauroth	25db341278	HDFS-8431. hdfs crypto class not found in Windows. Contributed by Anu Engineer. ... (cherry picked from commit 50eeea1300) Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs.cmd	2015-05-27 22:56:04 -07:00
Andrew Wang	a634809895	HDFS-8482. Rename BlockInfoContiguous to BlockInfo. Contributed by Zhe Zhang. ... (cherry picked from commit ff83459f192f7cc4ce864f0b1f01e1e08243be83) Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockInfo.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogLoader.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestReplicationPolicy.java	2015-05-27 15:42:12 -07:00
Haohui Mai	3f321be24d	Addendum of HDFS-8135.	2015-05-27 13:14:51 -07:00
Haohui Mai	cc348fead7	Revert HDFS-8135 in branch-2.	2015-05-27 11:06:17 -07:00
Akira Ajisaka	9670762a82	HADOOP-11242. Record the time of calling in tracing span of IPC server. Contributed by Mastake Iwasaki. ... (cherry picked from commit bb1816328a)	2015-05-27 18:05:08 +09:00
Colin Patrick Mccabe	3dec58dd78	HADOOP-11969. ThreadLocal initialization in several classes is not thread safe (Sean Busbey via Colin P. McCabe) ... (cherry picked from commit 7dba7005b7)	2015-05-26 12:40:41 -07:00
Haohui Mai	f70b9d9241	HDFS-8377. Support HTTP/2 in datanode. Contributed by Duo Zhang.	2015-05-24 22:30:50 -07:00
Vinayakumar B	19895a41ad	HADOOP-11743. maven doesn't clean all the site files (Contributed by ramtin) ... (cherry picked from commit 55ed6558ba) Conflicts: hadoop-common-project/hadoop-common/pom.xml	2015-05-22 16:46:50 +05:30
Vinayakumar B	658f5cf985	HDFS-8268. Port conflict log for data node server is not sufficient (Contributed by Mohammad Shahid Khan) ... (cherry picked from commit 0c6638c2ea)	2015-05-22 16:15:39 +05:30
Arpit Agarwal	a073e5bd31	HDFS-8454. Remove unnecessary throttling in TestDatanodeDeath. (Arpit Agarwal)	2015-05-21 20:44:07 -07:00
Xiaoyu Yao	61d7ccb27e	HDFS-8451. DFSClient probe for encryption testing interprets empty URI property for enabled. Contributed by Steve Loughran. ... (cherry picked from commit 05e04f34f2)	2015-05-21 11:59:11 -07:00
Haohui Mai	0b909d028f	HDFS-8421. Move startFile() and related functions into FSDirWriteFileOp. Contributed by Haohui Mai.	2015-05-21 08:06:13 -07:00
Akira Ajisaka	b578f76bed	HADOOP-10366. Add whitespaces between classes for values in core-default.xml to fit better in browser. Contributed by kanaka kumar avvaru. ... (cherry picked from commit 0e4f1081c7)	2015-05-21 17:53:18 +09:00
Akira Ajisaka	185cddfd6a	HDFS-4383. Document the lease limits. Contributed by Arshad Mohammad. ... (cherry picked from commit dc8434ab2b)	2015-05-21 17:31:47 +09:00
Colin Patrick Mccabe	9534e533dc	HADOOP-11970. Replace uses of ThreadLocal<Random> with JDK7 ThreadLocalRandom (Sean Busbey via Colin P. McCabe) ... (cherry picked from commit 470c87dbc6) Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestReplicationPolicy.java hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/common/JspHelper.java	2015-05-19 11:15:04 -07:00
Kihwal Lee	536b9ee6d6	HDFS-8404. Pending block replication can get stuck using older genstamp. Contributed by Nathan Roberts. ... (cherry picked from commit 8860e352c3)	2015-05-19 13:06:48 -05:00
Kihwal Lee	9e656bfa94	HDFS-8131. Implement a space balanced block placement policy. Contributed by Liu Shaohui. ... (cherry picked from commit de30d66b26)	2015-05-19 08:06:07 -05:00
Vinayakumar B	5bbf157cb2	HADOOP-11103. Clean up RemoteException (Contributed by Sean Busbey) ... (cherry picked from commit d4a2830b63)	2015-05-19 14:41:34 +05:30
Allen Wittenauer	3d0e2e54a1	HADOOP-8934. Shell command ls should include sort options (Jonathan Allen via aw) ... (cherry picked from commit 30b797ee9d) Conflicts: hadoop-common-project/hadoop-common/src/site/apt/FileSystemShell.apt.vm	2015-05-19 17:38:22 +09:00
Vinayakumar B	6dee42f6db	HDFS-6348. SecondaryNameNode not terminating properly on runtime exceptions (Contributed by Rakesh R) ... (cherry picked from commit 93972a332a)	2015-05-19 12:25:00 +05:30
Ravi Prakash	e5b805d361	HDFS-4185. Add a metric for number of active leases (Rakesh R via raviprak) ... (cherry picked from commit cdfae446ad)	2015-05-18 12:38:32 -07:00
Tsz-Wo Nicholas Sze	7bd4db968d	HDFS-8405. Fix a typo in NamenodeFsck. Contributed by Takanobu Asanuma	2015-05-19 03:01:07 +08:00
Arpit Agarwal	9bcb740049	HDFS-8345. Storage policy APIs must be exposed via the FileSystem interface. (Arpit Agarwal)	2015-05-18 11:49:01 -07:00
Uma Maheswara Rao G	ea875939f1	Revert from branch-2: HDFS-8332. DFS client API calls should check filesystem closed. Contributed by Rakesh R.	2015-05-18 14:38:30 +05:30
Arpit Agarwal	151f6d6dcc	HDFS-8157. Writes to RAM DISK reserve locked memory for block files. (Arpit Agarwal)	2015-05-16 09:05:50 -07:00
Haohui Mai	46d62e7016	HDFS-8403. Eliminate retries in TestFileCreation#testOverwriteOpenForWrite. Contributed by Arpit Agarwal.	2015-05-15 19:12:46 -07:00
Haohui Mai	1796d94d62	HDFS-8394. Move getAdditionalBlock() and related functionalities into a separate class. Contributed by Haohui Mai.	2015-05-15 19:10:05 -07:00
Jing Zhao	d6aa65d037	HDFS-8397. Refactor the error handling code in DataStreamer. Contributed by Tsz Wo Nicholas Sze. ... (cherry picked from commit 8f37873342)	2015-05-15 16:32:25 -07:00
Vinayakumar B	d9455c790f	HDFS-6888. Allow selectively audit logging ops (Contributed by Chen He) ... (cherry picked from commit 7f2e89fa7082840bfa3e8e593c93db050a80d04f)	2015-05-15 11:05:26 +05:30
Akira Ajisaka	7fb3486eb3	HDFS-8350. Remove old webhdfs.xml and other outdated documentation stuff. Contributed by Brahma Reddy Battula.	2015-05-15 13:57:58 +09:00
Akira Ajisaka	2e5b7f24ab	HDFS-8371. Fix test failure in TestHdfsConfigFields for spanreceiver properties. Contributed by Ray Chiang. ... (cherry picked from commit cbc01ed08e)	2015-05-15 12:15:26 +09:00
Vinayakumar B	4bbcffa510	HDFS-8150. Make getFileChecksum fail for blocks under construction (Contributed by J.Andreina) ... (cherry picked from commit def9136e02)	2015-05-14 15:55:20 +05:30
Haohui Mai	4b5915be9f	HDFS-7728. Avoid updating quota usage while loading edits. Contributed by Jing Zhao.	2015-05-13 21:50:41 -07:00
Arpit Agarwal	33f6136ee3	HDFS-8243. Files written by TestHostsFiles and TestNameNodeMXBean are causing Release Audit Warnings. (Contributed by Ruth Wisniewski)	2015-05-13 19:46:34 -07:00
Colin Patrick Mccabe	52da75180a	HDFS-8380. Always call addStoredBlock on blocks which have been shifted from one storage to another (cmccabe) ... (cherry picked from commit 281d47a969)	2015-05-13 14:45:37 -07:00
cnauroth	ddc4afeff2	HADOOP-11966. Variable cygwin is undefined in hadoop-config.sh when executed through hadoop-daemon.sh. Contributed by Chris Nauroth.	2015-05-13 12:25:49 -07:00
Kihwal Lee	2e9392c157	HDFS-8358. TestTraceAdmin fails. Contributed by Masatake Iwasaki. ... (cherry picked from commit f9a46a00d2)	2015-05-13 14:16:37 -05:00
Tsz-Wo Nicholas Sze	bdf8f64be8	HDFS-8143. Mover should exit after some retry when failed to move blocks. Contributed by surendra singh lilhore	2015-05-13 11:58:35 -07:00
Vinayakumar B	2adb1257b1	HDFS-6300. Prevent multiple balancers from running simultaneously (Contributed by Rakesh R) ... (cherry picked from commit 065d8f2a34)	2015-05-13 17:30:40 +05:30
Akira Ajisaka	7596c6e731	HDFS-6184. Capture NN's thread dump when it fails over. Contributed by Ming Ma. ... (cherry picked from commit 2463666ecb)	2015-05-13 11:37:59 +09:00
yliu	c31c6fbda7	HDFS-8255. Rename getBlockReplication to getPreferredBlockReplication. (Contributed by Zhe Zhang)	2015-05-12 21:26:57 +08:00
Vinayakumar B	e1b8bb9d84	HDFS-8362. Java Compilation Error in TestHdfsConfigFields.java (Contributed by Arshad Mohammad) ... (cherry picked from commit 987abc99b0)	2015-05-12 12:10:14 +05:30
Kihwal Lee	50778f9d45	HDFS-7916. 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop. Contributed by Rushabh Shah. ... (cherry picked from commit ea11590aad)	2015-05-11 14:33:45 -05:00
Junping Du	a1a7deebf8	YARN-3587. Fix the javadoc of DelegationTokenSecretManager in yarn, etc. projects. Contributed by Gabor Liptak. ... (cherry picked from commit 7e543c27fa)	2015-05-11 05:28:25 -07:00
Akira Ajisaka	703f1e9d16	HDFS-8351. Remove namenode -finalize option from document. (aajisaka) ... (cherry picked from commit 3fa2efc09f)	2015-05-11 15:37:12 +09:00
Haohui Mai	1f499a61dc	HDFS-8357. Consolidate parameters of INode.CleanSubtree() into a parameter objects. Contributed by Li Lu.	2015-05-09 22:52:07 -07:00
Haohui Mai	300d36cee7	HDFS-8327. Compute storage type quotas in INodeFile.computeQuotaDeltaForTruncate(). Contributed by Haohui Mai.	2015-05-08 23:09:57 -07:00
Haohui Mai	51bfb66ec8	Add missing entry in CHANGES.txt for HDFS-6757.	2015-05-08 23:09:55 -07:00
Haohui Mai	73d61f7ae7	HDFS-6757. Simplify lease manager with INodeID. Contributed by Haohui Mai.	2015-05-08 23:04:57 -07:00
Arpit Agarwal	969a8f6c96	HDFS-8097. TestFileTruncate is failing intermittently. (Contributed by Rakesh R)	2015-05-08 16:29:01 -07:00
Kihwal Lee	f264a5aeed	HDFS-8245. Standby namenode doesn't process DELETED_BLOCK if the addblock request is in edit log. Contributed by Rushabh S Shah. ... (cherry picked from commit 2d4ae3d18b)	2015-05-08 16:37:26 -05:00
Colin Patrick Mccabe	ab80a572be	HDFS-8113. Add check for null BlockCollection pointers in BlockInfoContiguous structures (Chengbing Liu via Colin P. McCabe) ... (cherry picked from commit f523e963e4)	2015-05-08 14:00:13 -07:00
Yongjun Zhang	fbb2cf54bc	HDFS-8311. DataStreamer.transfer() should timeout the socket InputStream. (Esteban Gutierrez via Yongjun Zhang) ... (cherry picked from commit 730f9930a4)	2015-05-08 01:38:01 -07:00
Kihwal Lee	30cb540b4d	HDFS-7433. Optimize performance of DatanodeManager's node map. Contributed by Daryn Sharp. ... (cherry picked from commit 7a7960be41)	2015-05-08 15:20:14 -05:00
Colin Patrick Mccabe	d83ae68bb0	HDFS-8284. Update documentation about how to use HTrace with HDFS (Masatake Iwasaki via Colin P. McCabe) ... (cherry picked from commit 8f7c2364d7)	2015-05-08 12:30:34 -07:00
cnauroth	5c188908fe	HDFS-5640. Add snapshot methods to FileContext. Contributed by Rakesh R. ... (cherry picked from commit 26f61d41df)	2015-05-08 11:21:02 -07:00
Arun Suresh	2124742e07	HDFS-7559. Create unit test to automatically compare HDFS related classes and hdfs-default.xml. (Ray Chiang via asuresh) ... (cherry picked from commit 3cefc02af7)	2015-05-08 10:31:23 -07:00
Arpit Agarwal	68d85e92bf	HDFS-8340. Fix NFS documentation of nfs.wtmax. (Contributed by Ajith S)	2015-05-08 10:15:35 -07:00
Arpit Agarwal	a0905ae57a	HDFS-8274. NFS configuration nfs.dump.dir not working (Contributed by Ajith S)	2015-05-08 10:04:11 -07:00
Haohui Mai	d4d7d7bf22	HDFS-8346. libwebhdfs build fails during link due to unresolved external symbols. Contributed by Chris Nauroth.	2015-05-08 09:58:00 -07:00
Kihwal Lee	802a5775f3	HDFS-7894. Rolling upgrade readiness is not updated in jmx until query command is issued. Contributed by Brahma Reddy Battula. ... (cherry picked from commit 6f622672b6)	2015-05-08 09:32:07 -05:00
Uma Maheswara Rao G	faf26f081c	HDFS-6285. tidy an error log inside BlockReceiver. Contributed by Liang Xie. ... (cherry picked from commit 7b1ea9c481)	2015-05-08 17:25:07 +05:30
Vinayakumar B	d129bbbb37	HDFS-3384. DataStreamer thread should be closed immediatly when failed to setup a PipelineForAppendOrRecovery (Contributed by Uma Maheswara Rao G) ... (cherry picked from commit c648317a68)	2015-05-08 17:18:59 +05:30
Vinayakumar B	a87ab77fec	HDFS-6576. Datanode log is generating at root directory in security mode (Contributed by surendra singh lilhore)	2015-05-08 16:37:36 +05:30
Vinayakumar B	3ee1b50dad	HDFS-8226. Non-HA rollback compatibility broken (Contributed by J.Andreina) ... Added one missed change, missed while resolving conflict	2015-05-08 15:39:47 +05:30
Vinayakumar B	3a894b4563	HDFS-8226. Non-HA rollback compatibility broken (Contributed by J.Andreina) ... (cherry picked from commit e01c1a979c) Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-dfs.sh hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HdfsUserGuide.md	2015-05-08 15:34:17 +05:30
Vinayakumar B	eaa5f3e448	HDFS-8209. Support different number of datanode directories in MiniDFSCluster. (Contributed by surendra singh lilhore) ... (cherry picked from commit 4c6816faf8)	2015-05-08 15:04:58 +05:30
Tsuyoshi Ozawa	8109f29ee2	HDFS-8207. Improper log message when blockreport interval compared with initial delay. Contributed by Brahma Reddy Battula and Ashish Singhi. ... (cherry picked from commit 888e630990) Conflicts: hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt	2015-05-08 18:14:08 +09:00
Vinayakumar B	595b92e2c2	HDFS-8175. Provide information on snapshotDiff for supporting the comparison between snapshot and current status (Contributed by J.Andreina) ... (cherry picked from commit 6232235df3)	2015-05-08 14:38:53 +05:30
Vinayakumar B	10999ffd7a	HDFS-8187. Remove usage of '-setStoragePolicy' and '-getStoragePolicy' using dfsadmin cmd (as it is not been supported) (Contributed by J.Andreina) ... (cherry picked from commit e642eff0e0)	2015-05-08 14:26:58 +05:30