Commit Graph

3164 Commits

Author SHA1 Message Date
Colin Patrick Mccabe 518a7f4af3 HDFS-7282. Fix intermittent TestShortCircuitCache and TestBlockReaderFactory failures resulting from TemporarySocketDirectory GC (Jinghui Wang via Colin P. McCabe) 2014-10-27 17:44:07 -07:00
Haohui Mai 00b4e44a2e HDFS-5928. Show namespace and namenode ID on NN dfshealth page. Contributed by Siqi Li. 2014-10-27 16:22:19 -07:00
Colin Patrick Mccabe baf794dc40 HDFS-7278. Add a command that allows sysadmins to manually trigger full block reports from a DN (cmccabe) 2014-10-27 09:53:16 -07:00
cnauroth 463aec1171 HDFS-6934. Move checksum computation off the hot path when writing to RAM disk. Contributed by Chris Nauroth. 2014-10-27 09:38:30 -07:00
Harsh J 0058eadbd3 HDFS-6538. Comment format error in ShortCircuitRegistry javadoc. Contributed by David Luo. (harsh) 2014-10-27 19:24:50 +05:30
Byron Wong 28051e4155 HADOOP-6857. FsShell should report raw disk usage including replication factor. Contributed by Byron Wong. 2014-10-25 12:31:41 -07:00
Colin Patrick Mccabe a52eb4bc5f HDFS-6988. Improve HDFS-6581 eviction configuration (Xiaoyu Yao via Colin P. McCabe) 2014-10-24 13:08:59 -07:00
Jitendra Pandey 86ac0d40b8 HDFS-6904. Added files missing in previous commit. 2014-10-24 12:01:09 -07:00
Jitendra Pandey e2be333744 HDFS-6904. YARN unable to renew delegation token fetched via webhdfs due to incorrect service port. 2014-10-24 11:35:19 -07:00
Haohui Mai b3d8a642a9 HDFS-7283. Bump DataNode OOM log from WARN to ERROR. Contributed by Stephen Chu. 2014-10-24 10:50:16 -07:00
Haohui Mai 0942c99eba HDFS-7258. CacheReplicationMonitor rescan schedule log should use DEBUG level instead of INFO level. Contributed by Xiaoyu Yao. 2014-10-23 23:58:32 -07:00
yliu 57dec28807 HDFS-7243. HDFS concat operation should not be allowed in Encryption Zone. (clamb via yliu) 2014-10-24 11:12:18 +08:00
Colin Patrick Mccabe 5b56ac4c72 HDFS-7223. Tracing span description of IPC client is too long (iwasakims via cmccabe) 2014-10-23 19:14:00 -07:00
Haohui Mai 670879ef41 HDFS-7257. Add the time of last HA state transition to NN's /jmx page. Contributed by Charles Lamb. 2014-10-23 16:52:58 -07:00
Andrew Wang 86cad007d7 HDFS-7222. Expose DataNode network errors as a metric. (Charles Lamb via wang) 2014-10-23 12:53:01 -07:00
Andrew Wang 8c5b23b547 HDFS-7165. Separate block metrics for files with replication count 1. (Zhe Zhang via wang) 2014-10-23 12:28:02 -07:00
Haohui Mai f729ecf9d2 HDFS-7277. Remove explicit dependency on netty 3.2 in BKJournal. Contributed by Haohui Mai. 2014-10-22 17:31:57 -07:00
Andrew Wang a36399e09c HDFS-6824. Additional user documentation for HDFS encryption. 2014-10-22 14:38:47 -07:00
Colin Patrick Mccabe 7b0f9bb258 HDFS-6877. Avoid calling checkDisk when an HDFS volume is removed during a write. (Lei Xu via Colin P. McCabe) 2014-10-22 13:38:26 -07:00
Colin Patrick Mccabe 66e8187ea1 HDFS-7254. Add documentation for hot swaping DataNode drives (Lei Xu via Colin P. McCabe) 2014-10-22 13:27:51 -07:00
Jing Zhao 1c8d191117 HDFS-7228. Fix TestDNFencing.testQueueingWithAppend. Contributed by Yongjun Zhang. 2014-10-22 10:48:15 -07:00
Allen Wittenauer 4baca311ff HDFS-7204. balancer doesn't run as a daemon (aw) 2014-10-21 14:26:08 -07:00
Andrew Wang ac56b0637e HDFS-7221. TestDNFencingWithReplication fails consistently. Contributed by Charles Lamb. 2014-10-21 12:55:18 -07:00
Brandon Li 4e134a02a4 HDFS-7215.Add JvmPauseMonitor to NFS gateway. Contributed by Brandon Li 2014-10-21 11:49:10 -07:00
Colin Patrick Mccabe 7aab5fa1bd HDFS-7154. Fix returning value of starting reconfiguration task (Lei Xu via Colin P. McCabe) 2014-10-20 18:33:11 -07:00
Colin Patrick Mccabe 4799570dfd HDFS-7266. HDFS Peercache enabled check should not lock on object (awang via cmccabe) 2014-10-20 18:24:53 -07:00
Benoy Antony e4d6a87854 HDFS-7184. Allow data migration tool to run as a daemon. (Benoy Antony) 2014-10-20 12:15:58 -07:00
Tsz-Wo Nicholas Sze 2e140523d3 HDFS-7260. Change DFSOutputStream.MAX_PACKETS to be configurable. 2014-10-17 18:30:09 -07:00
Vinayakumar B 368743140d HDFS-7252. small refinement to the use of isInAnEZ in FSNamesystem. (Yi Liu via vinayakumarb) 2014-10-17 18:03:44 +05:30
Vinayakumar B 1c3ff0b7c8 HDFS-7242. Code improvement for FSN#checkUnreadableBySuperuser. (Contributed by Yi Liu) 2014-10-17 17:48:20 +05:30
Vinayakumar B cba1f9e389 HDFS-6995. Block should be placed in the client's 'rack-local' node if 'client-local' node is not available (vinayakumarb)
Adding missed test file
2014-10-17 17:31:01 +05:30
Tsz-Wo Nicholas Sze 2894433332 HDFS-5089. When a LayoutVersion support SNAPSHOT, it must support FSIMAGE_NAME_OPTIMIZATION. 2014-10-15 20:56:59 -07:00
Tsz-Wo Nicholas Sze 41980c56d3 HDFS-7208. NN doesn't schedule replication when a DN storage fails. Contributed by Ming Ma 2014-10-15 20:44:24 -07:00
Jing Zhao 18620649f9 HDFS-7185. The active NameNode will not accept an fsimage sent from the standby during rolling upgrade. Contributed by Jing Zhao. 2014-10-15 10:27:30 -07:00
Haohui Mai 128ace10cd HDFS-7190. Bad use of Preconditions in startFileInternal(). Contributed by Dawson Choong. 2014-10-14 23:42:19 -07:00
Haohui Mai 0260231667 HDFS-7201. Fix typos in hdfs-default.xml. Contributed by Dawson Choong. 2014-10-14 17:36:07 -07:00
Jing Zhao 7dcad84143 HDFS-7228. Add an SSD policy into the default BlockStoragePolicySuite. Contributed by Jing Zhao. 2014-10-14 10:22:34 -07:00
Tsz-Wo Nicholas Sze f6d0b8892a HDFS-7237. The command "hdfs namenode -rollingUpgrade" throws ArrayIndexOutOfBoundsException. 2014-10-13 18:28:34 -07:00
cnauroth 1770bb942f HDFS-7090. Use unbuffered writes when persisting in-memory replicas. Contributed by Xiaoyu Yao. 2014-10-13 10:56:32 -07:00
Haohui Mai 53100318ea HDFS-6544. Broken Link for GFS in package.html. Contributed by Suraj Nayak M. 2014-10-13 10:33:19 -07:00
Jing Zhao 98ac9f26c5 HDFS-7236. Fix TestOpenFilesWithSnapshot#testOpenFilesWithMultipleSnapshots. Contributed by Yongjun Zhang. 2014-10-13 10:27:36 -07:00
Andrew Wang d3d3d47202 HDFS-7209. Populate EDEK cache when creating encryption zone. (Yi Liu via wang) 2014-10-10 13:40:37 -07:00
Colin Patrick Mccabe 1ceb326933 HDFS-7198. Fix "unchecked conversion" warning in DFSClient#getPathTraceScope (cmccabe) 2014-10-10 13:03:29 -07:00
Aaron T. Myers cbd21fd13b HDFS-7026. Introduce a string constant for "Failed to obtain user group info...". Contributed by Yongjun Zhang. 2014-10-09 18:52:48 -07:00
Andrew Wang 8d94114495 HADOOP-11174. Delegation token for KMS should only be got once if it already exists. (Yi Liu via wang) 2014-10-09 13:21:19 -07:00
Kihwal Lee db71bb54bc HDFS-7217. Better batching of IBRs. Contributed by Kihwal Lee. 2014-10-09 12:07:51 -05:00
Aaron T. Myers 2a51494ce1 HADOOP-11161. Expose close method in KeyProvider to give clients of Provider implementations a hook to release resources. Contribued by Arun Suresh. 2014-10-08 18:01:51 -07:00
Colin Patrick Mccabe d996235285 HDFS-7202. Should be able to omit package name of SpanReceiver on "hadoop trace -add" (iwasakims via cmccabe) 2014-10-08 17:55:46 -07:00
Kihwal Lee 853cb704ed HDFS-7203. Concurrent appending to the same file can cause data
corruption. Contributed by Kihwal Lee.
2014-10-08 15:05:34 -05:00
cnauroth 1efd9c9825 HDFS-7112. LazyWriter should use either async IO or one thread per physical disk. Contributed by Xiaoyu Yao. 2014-10-07 20:25:19 -07:00