Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,152 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

3894 Commits

Author SHA1 Message Date
Kihwal Lee 9e91433295 HDFS-10178. Permanent write failures can happen if pipeline recoveries occur for the first packet. Contributed by Kihwal Lee. 
(cherry picked from commit a7d1fb0cd2)
 2016-04-04 16:40:44 -05:00
Masatake Iwasaki c981efb0f6 HDFS-9599. TestDecommissioningStatus.testDecommissionStatus occasionally fails (Lin Yiqun via iwasakims) 
(cherry picked from commit 154d2532cf)
 2016-04-05 03:39:10 +09:00
Vinayakumar B aa38748997 HDFS-10253. Fix TestRefreshCallQueue failure (Contributed by Xiaoyu Yao) 
(cherry picked from commit 54b2e78fd2)
 2016-04-03 13:28:22 +05:30
Akira Ajisaka 0795ee687b HDFS-10221. Add .json to the rat exclusions. Contributed by Ming Ma. 
(cherry picked from commit 32c0c3ecdf)
 2016-03-31 09:06:34 +09:00
Colin Patrick Mccabe be5894c12d HDFS-10223. peerFromSocketAndKey performs SASL exchange before setting connection timeouts (cmccabe) 
(cherry picked from commit 37e23ce45c)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/erasurecode/ErasureCodingWorker.java
 2016-03-30 13:42:24 -07:00
Vinayakumar B 0852e44110 HDFS-5177. blocksScheduled count should be decremented for abandoned blocks (Contributed by Vinayakumar B) 
(cherry picked from commit 09d63d5a19)
 2016-03-30 14:23:11 +08:00
Arpit Agarwal ed15cb9a30 HDFS-9439. Support reconfiguring fs.protected.directories without NN restart. (Contributed by Xiaobing Zhou) 2016-03-29 13:56:02 -07:00
Arpit Agarwal 8ee2140706 HDFS-10228. TestHDFSCLI fails. (Contributed by Akira AJISAKA) 2016-03-29 13:56:00 -07:00
Andrew Wang 1d79b57c14 HDFS-10197. TestFsDatasetCache failing intermittently due to timeout. Contributed by Lin Yiqun. 
(cherry picked from commit f2aec4eb82)
 2016-03-29 11:54:52 -07:00
Vinayakumar B f74364e8b9 HDFS-9871. "Bytes Being Moved" -ve(-1 B) when cluster was already balanced. (Contributed by Brahma Reddy Battulla) 
(cherry picked from commit 1f004b3367)
 2016-03-29 11:28:10 +08:00
Walter Su 07b0abe0b3 HDFS-10182. Hedged read might overwrite user's buf. Contributed by zhouyingchao. 
(cherry picked from commit d8383c687c)
 2016-03-28 15:46:01 +08:00
Lei Xu ae98314980 Add missing files from HDFS-9005. (lei) 2016-03-25 18:13:01 -07:00
Lei Xu 493648611d HDFS-9005. Provide support for upgrade domain script. (Ming Ma via Lei Xu) 2016-03-25 17:12:44 -07:00
Andrew Wang c658deabb6 HDFS-10200. Docs for WebHDFS still describe GETDELEGATIONTOKENS operation. Contributed by Wellington Chevreuil. 
(cherry picked from commit 8f85e5d212)
 2016-03-23 12:55:23 -07:00
Colin Patrick Mccabe 7ad3162df4 HDFS-10193. fuse_dfs segfaults if uid cannot be resolved to a username (John Thiltges via cmccabe) 
(cherry picked from commit 0d19a0ce98)
 2016-03-23 11:19:55 -07:00
Colin Patrick Mccabe a68a9eb2b1 HDFS-10189. PacketResponder#toString should include the downstreams for PacketResponderType.HAS_DOWNSTREAM_IN_PIPELINE (Joe Pallas via cmccabe) 
(cherry picked from commit a7d8f2b396)
 2016-03-22 17:21:54 -07:00
Colin Patrick Mccabe 2ce24bf218 HDFS-9951. Use string constants for XML tags in OfflineImageReconstructor (Lin Yiqun via cmccabe) 
(cherry picked from commit 680716f31e)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/offlineImageViewer/OfflineImageReconstructor.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/offlineImageViewer/PBImageXmlWriter.java
 2016-03-21 11:46:09 -07:00
Andrew Wang e826d860a7 HDFS-9405. Warmup NameNode EDEK caches in background thread. Contributed by Xiao Chen. 
(cherry picked from commit e3bb38d625)
 2016-03-21 11:39:19 -07:00
Sangjin Lee d956e0a0bb HDFS-9579. Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level (Ming Ma via sjlee) 2016-03-21 10:56:32 -07:00
Haohui Mai 6236782151 HDFS-7166. SbNN Web UI shows #Under replicated blocks and #pending deletion blocks. Contributed by Wei-Chiu Chuang. 2016-03-20 17:21:53 -07:00
Akira Ajisaka 41621a994d HDFS-3677. dfs.namenode.edits.dir.required is missing from hdfs-default.xml. Contributed by Mark Yang. 
(cherry picked from commit 414f33126ac178a44146666cc7c00059cfc9cabf)
 2016-03-19 01:10:44 +09:00
Kihwal Lee ead63bc297 HDFS-9874. Long living DataXceiver threads cause volume shutdown to block. Contributed by Rushabh Shah. 
(cherry picked from commit 63c966a3fb)
 2016-03-18 10:26:57 -05:00
Colin Patrick Mccabe f69a6c3632 HDFS-9949. Add a test case to ensure that the DataNode does not regenerate its UUID when a storage directory is cleared (Harsh J via cmccabe) 
(cherry picked from commit dc951e606f)
 2016-03-17 10:42:37 -07:00
Andrew Wang d4370f224b HDFS-10173. Typo in DataXceiverServer. Contributed by Michael Han. 
(cherry picked from commit 02a250db9f)
 2016-03-16 18:50:00 -07:00
Kihwal Lee 8b00d9de25 HDFS-9904. testCheckpointCancellationDuringUpload occasionally fails. Contributed by Lin Yiqun. 
(cherry picked from commit d457401784)
 2016-03-15 10:54:37 -05:00
Masatake Iwasaki d595429538 HDFS-9928. Make HDFS commands guide up to date (Wei-Chiu Chuang via iwasakims) 2016-03-15 21:04:14 +09:00
Colin Patrick Mccabe 8ac3fc7540 HDFS-9947. Block#toString should not output information from derived classes (cmccabe) 
(cherry picked from commit 9a43094e12)
 2016-03-14 14:59:46 -07:00
Ravi Prakash 51b7d8935a HDFS-9953. Download File from UI broken after pagination. Contributed by Brahma Reddy Battula 2016-03-14 14:32:42 -07:00
Chris Nauroth dd462bc32f HDFS-9941. Do not log StandbyException on NN, other minor logging fixes. Contributed by Arpit Agarwal. 
(cherry picked from commit 5644137ada)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockUnderConstructionFeature.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirWriteFileOp.java
 2016-03-14 09:55:27 -07:00
Arpit Agarwal b0ea50bb29 HDFS-1477. Support reconfiguring dfs.heartbeat.interval and dfs.namenode.heartbeat.recheck-interval without NN restart. (Contributed by Xiaobing Zhou) 2016-03-10 19:05:22 -08:00
Colin Patrick Mccabe 710811652c HDFS-9933. ReverseXML should be capitalized in oiv usage message (cmccabe) 
(cherry picked from commit 79961ecea8)
 2016-03-10 13:45:02 -08:00
Colin Patrick Mccabe c82d1e1187 HDFS-9934. ReverseXML oiv processor should bail out if the XML file's layoutVersion doesn't match oiv's (cmccabe) 
(cherry picked from commit bd49354c6d)
 2016-03-10 13:41:32 -08:00
Colin Patrick Mccabe b8b580e6b8 HDFS-9927. Document the new OIV ReverseXML processor (Wei-Chiu Chuang via cmccabe) 
(cherry picked from commit 500875dfcc)
 2016-03-10 13:39:20 -08:00
Allen Wittenauer 9f4b3eaac0 Revert "HADOOP-12366. expose calculated paths (aw)" 
This reverts commit 45bb467918.
 2016-03-09 09:59:19 -08:00
Chris Nauroth 38a031ce68 HADOOP-12905. Clean up CHANGES.txt RAT exclusions from pom.xml files. Contributed by Chris Nauroth. 
(cherry picked from commit 89b16d27e2)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/pom.xml
	hadoop-mapreduce-project/pom.xml
 2016-03-08 21:22:57 -08:00
Arpit Agarwal 9d67f98e05 HDFS-9882. Add heartbeatsTotal in Datanode metrics. (Contributed by Hua Liu) 2016-03-07 21:10:34 -08:00
Akira Ajisaka fe0009a2bd HDFS-9812. Streamer threads leak if failure happens when closing DFSOutputStream. Contributed by Lin Yiqun. 
(cherry picked from commit 352d299cf8)
 2016-03-08 10:55:59 +09:00
Arpit Agarwal 3e987446e3 HDFS-9906. Remove spammy log spew when a datanode is restarted. (Contributed by Brahma Reddy Battula) 2016-03-07 12:20:07 -08:00
Masatake Iwasaki 135ceb6c7b HDFS-9865. TestBlockReplacement fails intermittently in trunk (Lin Yiqun via iwasakims) 
(cherry picked from commit d718fc1ee5)
 2016-03-08 02:11:07 +09:00
Harsh J ed421cb128 HDFS-9521. TransferFsImage.receiveFile should account and log separate times for image download and fsync to disk. Contributed by Wellington Chevreuil 
(cherry picked from commit fd1c09be3e)
 2016-03-07 17:23:11 +05:30
Chris Nauroth 592f161e13 HDFS-9239. DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness. Contributed by Chris Nauroth. 
(cherry picked from commit 2759689d7d)
 2016-03-04 15:30:28 -08:00
Yongjun Zhang 1d6c9486a4 HDFS-9889. Update balancer/mover document about HDFS-6133 feature. Contributed by Yongjun Zhang. 
(cherry picked from commit 8e08861a14)
 2016-03-04 13:28:10 -08:00
Masatake Iwasaki 722182fdfb HADOOP-12470. In-page TOC of documentation should be automatically generated by doxia macro (iwasakims) 
(cherry picked from commit cbd31328a6)

 Conflicts:
	hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md
	hadoop-common-project/hadoop-common/src/site/markdown/UnixShellGuide.md
 2016-03-04 14:12:44 +09:00
Andrew Wang 670944810c HADOOP-11792. Remove all of the CHANGES.txt files. 2016-03-03 21:02:58 -08:00
Masatake Iwasaki 8095c612a3 HDFS-9048. DistCp documentation is out-of-dated (Daisuke Kobayashi via iwasakims) 
(cherry picked from commit 33a412e8a4)
 2016-03-03 18:57:41 +09:00
Masatake Iwasaki 69e024f8fa HADOOP-12793. Write a new group mapping service guide (Wei-Chiu Chuang via iwasakims) 
(cherry picked from commit f70e317ccc)
 2016-03-03 17:14:53 +09:00
Arpit Agarwal 7b4a1001ea HDFS-9534. Add CLI command to clear storage policy from a path. (Contributed by Xiaobing Zhou) 2016-03-02 18:35:38 -08:00
Colin Patrick Mccabe 5998b20d63 HDFS-9835. OIV: add ReverseXML processor which reconstructs an fsimage from an XML file (cmccabe) 
(cherry picked from commit 700b0e4019)
 2016-03-02 18:18:45 -08:00
Zhe Zhang b97ac02c4b HDFS-9886. Configuration properties for hedged read is broken. Contributed by Akira AJISAKA. 2016-03-02 10:27:09 -08:00
Xiaoyu Yao 6bffe1a908 HDFS-9887. WebHdfs socket timeouts should be configurable. Contributed by Austin Donnelly and Chris Douglas. 
(cherry picked from commit 5abf051249)
 2016-03-02 09:24:46 -08:00