Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,688 Commits 326 Branches 371 Tags
Commit Graph

3248 Commits

Author SHA1 Message Date
Jitendra Pandey
04962efe43 HDFS-8153. Error Message points to wrong parent directory in case of path component name length error. Contributed by Anu Engineer. 
cherry picked from 369ddc67bdaf61cca3f2f766ab504e2932f6fb72
 2015-04-16 22:15:57 -07:00
Tsz-Wo Nicholas Sze
fa7b18e387 HDFS-7891. A block placement policy with best rack failure tolerance. Contributed by Walter Su 2015-04-16 18:26:46 -07:00
Akira Ajisaka
d363f853ab Revert "Merge r1588258 from trunk, HDFS-6153. Document "fileId" and "childrenNum" fields in the FileStatus Json schema" 
This reverts commit 641cbc0febe546e350a5fd4f37e717f2b8e52d6f.
 2015-04-16 16:50:04 -05:00
Tsz-Wo Nicholas Sze
bad547d969 HDFS-8082. Move dfs.client.read.*, dfs.client.short.circuit.*, dfs.client.mmap.* and dfs.client.hedged.read.* conf from DFSConfigKeys to HdfsClientConfigKeys. 2015-04-16 13:27:15 -07:00
Haohui Mai
e1ebad8203 HDFS-8135. Remove the deprecated FSConstants class. Contributed by Li Lu. 2015-04-16 11:26:13 -07:00
Andrew Wang
9123f26c73 HDFS-8142. DistributedFileSystem encryption zone commands should resolve relative paths. Contributed by Rakesh R. 
(cherry picked from commit 2e8ea780a45c0eccb8f106b2bf072b59446a1cc4)
 2015-04-16 07:14:53 -07:00
Akira Ajisaka
6d183561ff HDFS-8149. The footer of the Web UI "Hadoop, 2014" is old. Contributed by Brahma Reddy Battula. 
(cherry picked from commit de0f1700c150a819b38028c44ef1926507086e6c)
 2015-04-15 15:32:08 -05:00
Jing Zhao
725621d95a HDFS-7934. Update RollingUpgrade rollback documentation: should use bootstrapstandby for standby NN. Contributed by J. Andreina. 
(cherry picked from commit b172d03595d1591e7f542791224607d8c5fce3e2)
 2015-04-15 13:11:15 -07:00
Jing Zhao
d4dd97eabd HDFS-8151. Always use snapshot path as source when invalid snapshot names are used for diff based distcp. Contributed by Jing Zhao. 
(cherry picked from commit 4c097e473bb1f18d1510deb61bae2bcb8c156f18)
 2015-04-15 12:39:09 -07:00
Arpit Agarwal
96e12fa46a HDFS-8144. Split TestLazyPersistFiles into multiple tests. (Arpit Agarwal) 2015-04-15 10:25:16 -07:00
Andrew Wang
871bf6a765 HDFS-8117. More accurate verification in SimulatedFSDataset: replace DEFAULT_DATABYTE with patterned data. Contributed by Zhe Zhang. 2015-04-15 08:43:42 -07:00
Jing Zhao
38b031d6ba HDFS-8127. NameNode Failover during HA upgrade can cause DataNode to finalize upgrade. Contributed by Jing Zhao. 
(cherry picked from commit fddd55279d0bdd08b3b40aba6fe2ded1d2e0d846)
 2015-04-14 15:12:37 -07:00
cnauroth
c7ebecfff5 HDFS-8055. NullPointerException when topology script is missing. Contributed by Anu Engineer. 
(cherry picked from commit fef596df038112cbbc86c4dc49314e274fca0190)
 2015-04-14 10:19:45 -07:00
cnauroth
9779b79ed8 HDFS-6666. Abort NameNode and DataNode startup if security is enabled but block access token is not enabled. Contributed by Vijay Bhat. 
(cherry picked from commit d45aa7647b1fecf81860ec7b563085be2af99a0b)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestSecureNameNode.java
 2015-04-14 10:03:53 -07:00
Arpit Agarwal
d77705c980 HDFS-7701. Support reporting per storage type quota and usage with hadoop/hdfs shell. (Contributed by Peter Shi) 2015-04-13 21:20:30 -07:00
Allen Wittenauer
b7a052c84a HADOOP-7713. dfs -count -q should label output column (Jonathan Allen via aw) 2015-04-13 21:18:59 -07:00
Tsz-Wo Nicholas Sze
e4fe5fa2ee HDFS-8083. Move dfs.client.write.* conf from DFSConfigKeys to HdfsClientConfigKeys.Write. 2015-04-13 11:45:03 -07:00
Vinayakumar B
1071a57b20 HDFS-8111. NPE thrown when invalid FSImage filename given for 'hdfs oiv_legacy' cmd ( Contributed by surendra singh lilhore ) 
(cherry picked from commit 14384f5b5142a98a10ce4bffadeb13e89bda9365)
 2015-04-13 17:19:18 +05:30
cnauroth
293c763e82 HDFS-7933. fsck should also report decommissioning replicas. Contributed by Xiaoyu Yao. 
(cherry picked from commit f8f5887209a7d8e53c0a77abef275cbcaf1f7a5b)
 2015-04-11 13:24:06 -07:00
Tsz-Wo Nicholas Sze
ef2bd4bd11 HDFS-8084. Move dfs.client.failover.* confs from DFSConfigKeys to HdfsClientConfigKeys.Failover and fix typos in the dfs.http.client.* configuration keys. 2015-04-10 19:58:42 -07:00
Haohui Mai
6f97b780df HDFS-8103. Move BlockTokenSecretManager.AccessMode into BlockTokenIdentifier. Contributed by Haohui Mai. 2015-04-10 16:36:57 -07:00
Tsz-Wo Nicholas Sze
1113aca7f8 HDFS-8100. Refactor DFSClient.Conf to a standalone class and separates short-circuit related conf to ShortCircuitConf. 2015-04-10 14:49:32 -07:00
Arun Suresh
3d17c50176 HDFS-7931. DistributedFileSystem should not look for keyProvider in cache if Encryption is disabled (asuresh) 
(cherry picked from commit 7660da95cb67cbfe034aa8fa2a5bf0f8c9fdf41a)
 2015-04-10 11:42:18 -07:00
Vinayakumar B
4aba069b37 HDFS-7939. Two fsimage_rollback_* files are created which are not deleted after rollback. (Contributed by J.Andreina) 
(cherry picked from commit 987c9e12e184b35a5abab49f4188e22509ad63a5)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-04-10 11:27:20 +05:30
Konstantin V Shvachko
0e99da620d HDFS-8081. Split getAdditionalBlock() into two methods. Contributed by Konstantin Shvachko 2015-04-09 22:02:14 -07:00
Haohui Mai
e34afb48d4 HDFS-8102. Separate webhdfs retry configuration keys from DFSConfigKeys. Contributed by Haohui Mai. 2015-04-09 14:36:35 -07:00
Vinod Kumar Vavilapalli
aec1c5ec7d Adding release 2.7.1 to CHANGES.txt 
(cherry picked from commit 623fd46c1eac057ea9bc4b503a47ad1a831cdacf)
 2015-04-09 13:56:14 -07:00
Arun Suresh
c846e84d55 HDFS-8091: ACLStatus and XAttributes should be presented to INodeAttributesProvider before returning to client (asuresh) 
(cherry picked from commit 922b7ed21d1f1460263ca42f709bb9f415d189c5)
 2015-04-09 13:13:23 -07:00
Colin Patrick Mccabe
8dac245920 HDFS-8063: Fix intermittent test failures in TestTracing (Masatake Iwasaki via Colin P. McCabe) 
(cherry picked from commit 61dc2ea3fee4085b19cd2d01de9eacdc4c42e21f)
 2015-04-09 11:42:00 -07:00
Colin Patrick Mccabe
ca12088253 HDFS-8099. Change "DFSInputStream has been closed already" message to debug log level (Charles Lamb via Colin P. McCabe) 
(cherry picked from commit 30acb7372ab97adf9bc86ead529c96cfe36e2396)
 2015-04-09 11:23:01 -07:00
Aaron T. Myers
edf2f52d6d HDFS-8101. DFSClient use of non-constant DFSConfigKeys pulls in WebHDFS classes at runtime. Contributed by Sean Busbey. 
(cherry picked from commit 3fe61e0bb0d025a6acbb754027f73f3084b2f4d1)
 2015-04-09 09:45:02 -07:00
Kihwal Lee
6d1cb34221 Fix CHANGES.txt for branch-2 2015-04-09 10:05:43 -05:00
Vinayakumar B
4e099c113b HDFS-8096. DatanodeMetrics#blocksReplicated will get incremented early and even for failed transfers (Contributed by Vinayakumar B) 
(cherry picked from commit 9d8952f97f638ede27e4336b9601507d7bb1de7b)
 2015-04-09 11:59:05 +05:30
Andrew Wang
351fac25a9 HDFS-7979. Initialize block report IDs with a random number. 
(cherry picked from commit b1e059089d6a5b2b7006d7d384c6df81ed268bd9)
 2015-04-08 21:43:57 -07:00
Haohui Mai
88ef75f167 HDFS-8089. Move o.a.h.hdfs.web.resources.* to the client jars. Contributed by Haohui Mai. 2015-04-08 16:30:57 -07:00
Andrew Wang
069366e1be HDFS-8025. Addendum fix for HDFS-3087 Decomissioning on NN restart can complete without blocks being replicated. Contributed by Ming Ma. 2015-04-08 16:09:28 -07:00
Haohui Mai
6d2eca081d Revert HDFS-7813. 2015-04-08 16:03:20 -07:00
Haohui Mai
35816c438d Revert HDFS-7808. 2015-04-08 16:00:10 -07:00
Andrew Wang
8104d52269 HDFS-7725. Incorrect 'nodes in service' metrics caused all writes to fail. Contributed by Ming Ma. 2015-04-08 15:52:15 -07:00
Andrew Wang
9792500c54 HDFS-8076. Code cleanup for DFSInputStream: use offset instead of LocatedBlock when possible. Contributed by Zhe Zhang. 
(cherry picked from commit a42bb1cd915abe5dc33eda3c01e8c74c64f35748)
 2015-04-08 15:41:54 -07:00
Kihwal Lee
7e622076d4 HDFS-8046. Allow better control of getContentSummary. Contributed by Kihwal Lee. 
(cherry picked from commit 285b31e75e51ec8e3a796c2cb0208739368ca9b8)
 2015-04-08 15:39:25 -05:00
Tsz-Wo Nicholas Sze
de7f9a8bcc HDFS-8079. Move CorruptFileBlockIterator to a new hdfs.client.impl package. 2015-04-08 11:51:43 -07:00
Arpit Agarwal
f0324738c9 HDFS-8072. Reserved RBW space is not released if client terminates while writing block. (Arpit Agarwal) 2015-04-08 11:38:30 -07:00
Haohui Mai
f9fbde3074 HDFS-8080. Separate JSON related routines used by WebHdfsFileSystem to a package local class. Contributed by Haohui Mai. 2015-04-07 21:30:23 -07:00
Vinayakumar B
3cf7ac181b HDFS-8073. Split BlockPlacementPolicyDefault.chooseTarget(..) so it can be easily overrided. (Contributed by Walter Su) 
(cherry picked from commit d505c8acd30d6f40d0632fe9c93c886a4499a9fc)
 2015-04-08 09:57:49 +05:30
Tsz-Wo Nicholas Sze
eb3ca514fb HDFS-8079. Move dfs.client.retry.* confs from DFSConfigKeys to HdfsClientConfigKeys.Retry. 2015-04-07 19:53:30 -07:00
Yongjun Zhang
b76c321e94 HDFS-5215. dfs.datanode.du.reserved is not considered while computing 
available space ( Brahma Reddy Battula via Yongjun Zhang)

(cherry picked from commit 66763bb06f107f0e072c773a5feb25903c688ddc)
 2015-04-07 19:36:02 -07:00
cnauroth
8921526440 HDFS-8038. PBImageDelimitedTextWriter#getEntry output HDFS path in platform-specific format. Contributed by Xiaoyu Yao. 
(cherry picked from commit 672ed462965ea7da10ce3df48c02e2a3bd13f0ae)
 2015-04-07 14:23:29 -07:00
Tsz-Wo Nicholas Sze
a4f0eea261 HDFS-8049. Add @InterfaceAudience.Private annotation to hdfs client implementation. Contributed by Takuya Fukudome 2015-04-07 14:01:55 -07:00
Konstantin V Shvachko
81b522790b HDFS-8071. Redundant checkFileProgress() in PART II of getAdditionalBlock(). Contributed by Konstantin Shvachko. 2015-04-06 22:23:33 -07:00