Commit Graph

3141 Commits

Author SHA1 Message Date
Thomas Graves 0e7214933d HADOOP-8495. Update Netty to avoid leaking file descriptors during shuffle (Jason Lowe via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351363 13f79535-47bb-0310-9956-ffa450edef68
2012-06-18 14:42:25 +00:00
Tsz-wo Sze 19ac5c4e8b HADOOP-8468. Add NetworkTopologyWithNodeGroup, a 4-layer implementation of NetworkTopology. Contributed by Junping Du
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351163 13f79535-47bb-0310-9956-ffa450edef68
2012-06-17 21:12:25 +00:00
Tsz-wo Sze 5572f73d45 HDFS-3518. Add a utility method HdfsUtils.isHealthy(uri) for checking if the given HDFS is healthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1350825 13f79535-47bb-0310-9956-ffa450edef68
2012-06-15 23:00:36 +00:00
Uma Maheswara Rao G 7a5c2e8790 Updated CHANGES.txt for HDFS-3408(BKJM : Namenode format fails, if there is no BK root) And HDFS-3389(Document the BKJM usage in Namenode HA)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1350733 13f79535-47bb-0310-9956-ffa450edef68
2012-06-15 18:35:58 +00:00
Tsz-wo Sze 9d2b1b2ee8 HDFS-3524. Update TestFileLengthOnClusterRestart for HDFS-3522. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1350384 13f79535-47bb-0310-9956-ffa450edef68
2012-06-14 20:17:54 +00:00
Alejandro Abdelnur a30456941d HADOOP-8509. JarFinder duplicate entry: META-INF/MANIFEST.MF exception (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1350008 13f79535-47bb-0310-9956-ffa450edef68
2012-06-13 20:47:51 +00:00
Eli Collins 29d39bcc7b HDFS-3480. Multiple SLF4J binding warning. Contributed by Vinay
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349643 13f79535-47bb-0310-9956-ffa450edef68
2012-06-13 05:53:24 +00:00
Eli Collins cd72aad125 HADOOP-8433. Don't set HADOOP_LOG_DIR in hadoop-env.sh. Contributed by Brahma Reddy Battula
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349641 13f79535-47bb-0310-9956-ffa450edef68
2012-06-13 05:37:27 +00:00
Aaron Myers 9cabf93e7a HDFS-766. Error message not clear for set space quota out of boundary values. Contributed by Jon Zuanich.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349639 13f79535-47bb-0310-9956-ffa450edef68
2012-06-13 05:29:57 +00:00
Eli Collins fda95a6a3d HDFS-3478. Test quotas with Long.Max_Value. Contributed by Sujay Rau
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349634 13f79535-47bb-0310-9956-ffa450edef68
2012-06-13 05:04:20 +00:00
Eli Collins 6702d5dbd4 HDFS-3372. offlineEditsViewer should be able to read a binary edits file with recovery mode. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349628 13f79535-47bb-0310-9956-ffa450edef68
2012-06-13 03:31:47 +00:00
Eli Collins 07b8584431 HDFS-3531. EditLogFileOutputStream#preallocate should check for incomplete writes. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349616 13f79535-47bb-0310-9956-ffa450edef68
2012-06-13 02:42:52 +00:00
Alejandro Abdelnur 5a2e0ee4d2 HADOOP-8465. hadoop-auth should support ephemeral authentication (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349613 13f79535-47bb-0310-9956-ffa450edef68
2012-06-13 02:22:06 +00:00
Eli Collins 0297662ffe Fix bug in CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349565 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 22:13:35 +00:00
Eli Collins 0199fe9763 HADOOP-8507. Avoid OOM while deserializing DelegationTokenIdentifer. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349561 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 22:10:12 +00:00
Alejandro Abdelnur c83ccc5002 Amendment to my previous commit, fixing JIRA in CHANGES.txt from HDFS-3228 to HDFS-3428
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349556 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 22:02:56 +00:00
Alejandro Abdelnur 4d4661802e HDFS-3228. Move DelegationTokenRenewer to common (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349555 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 21:52:46 +00:00
Alejandro Abdelnur 22c6588623 HADOOP-8458. Add management hook to AuthenticationHandler to enable delegation token operations support (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349514 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 20:45:57 +00:00
Uma Maheswara Rao G f9c938666b HDFS-3389. Document the BKJM usage in Namenode HA. Contributed by Uma Maheswara Rao G and Ivan Kelly.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349466 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 18:19:46 +00:00
Uma Maheswara Rao G 048c2f28fe HDFS-3408. BKJM : Namenode format fails, if there is no BK root. Contributed by Rakesh R.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349459 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 17:58:49 +00:00
Uma Maheswara Rao G eb0537b18f HDFS-3408. BKJM : Namenode format fails, if there is no BK root. Contributed by Rakesh R.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349456 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 17:48:16 +00:00
Eli Collins 797c8548d0 Revert HADOOP-8491
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349133 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 06:22:06 +00:00
Tsz-wo Sze 45fafc2b8f HDFS-3504. Support configurable retry policy in DFSClient for RPC connections and RPC calls, and add MultipleLinearRandomRetry, a new retry policy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349124 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 05:27:15 +00:00
Eli Collins 8879653ab4 HDFS-3520. Add transfer rate logging to TransferFsImage. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349117 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 05:00:07 +00:00
Todd Lipcon 9947d8054c HDFS-3049. During the normal NN startup process, fall back on a different edit log if we see one that is corrupt. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349114 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 04:15:18 +00:00
Tsz-wo Sze 543f86631b HDFS-3522. If a namenode is in safemode, it should throw SafeModeException when getBlockLocations has zero locations. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349088 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 01:55:51 +00:00
Siddharth Seth eff9fa1aad MAPREDUCE-3921. MR AM should act on node health status changes. Contributed by Bikas Saha.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349065 13f79535-47bb-0310-9956-ffa450edef68
2012-06-11 23:14:06 +00:00
Eli Collins 6e3ebf4d73 HADOOP-8491. Check for short writes when using FileChannel#write and related methods. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349019 13f79535-47bb-0310-9956-ffa450edef68
2012-06-11 21:20:28 +00:00
Eli Collins 9e7334a8fe HDFS-3517. TestStartup should bind ephemeral ports. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349004 13f79535-47bb-0310-9956-ffa450edef68
2012-06-11 20:52:45 +00:00
Tsz-wo Sze ca39e780c4 HDFS-3052. Change INodeFile and INodeFileUnderConstruction to package private.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348998 13f79535-47bb-0310-9956-ffa450edef68
2012-06-11 20:38:46 +00:00
Thomas White 13ad756796 MAPREDUCE-3871. Allow symlinking in LocalJobRunner DistributedCache.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348997 13f79535-47bb-0310-9956-ffa450edef68
2012-06-11 20:37:03 +00:00
Alejandro Abdelnur 56f386b98d HADOOP-8368. Amendment to add entry in CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348960 13f79535-47bb-0310-9956-ffa450edef68
2012-06-11 18:47:18 +00:00
Alejandro Abdelnur 8a9e63e468 HADOOP-8368. Use CMake rather than autotools to build native code (ccccabe via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348957 13f79535-47bb-0310-9956-ffa450edef68
2012-06-11 18:34:40 +00:00
Eli Collins 56d2ef6f5e HDFS-2797. Fix misuses of InputStream#skip in the edit log code. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348945 13f79535-47bb-0310-9956-ffa450edef68
2012-06-11 18:01:38 +00:00
Thomas Graves 27d1c74a0c MAPREDUCE-3927. Shuffle hang when set map.failures.percent (Bhallamudi Venkata Siva Kamesh via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348846 13f79535-47bb-0310-9956-ffa450edef68
2012-06-11 13:54:46 +00:00
Tsz-wo Sze 5991ed9cbd HDFS-3490. DatanodeWebHdfsMethods throws NullPointerException if NamenodeRpcAddressParam is not set.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348287 13f79535-47bb-0310-9956-ffa450edef68
2012-06-09 00:54:10 +00:00
Todd Lipcon 51d889e369 Move several JIRAs from trunk to branch-2 section of CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348258 13f79535-47bb-0310-9956-ffa450edef68
2012-06-08 21:48:16 +00:00
Aaron Myers bc367be4ef HDFS-3514. Add missing TestParallelLocalRead. Contributed by Henry Robinson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348207 13f79535-47bb-0310-9956-ffa450edef68
2012-06-08 19:50:24 +00:00
Thomas Graves 9368be0e73 MAPREDUCE-3842. Stop webpages from automatic refreshing (tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348123 13f79535-47bb-0310-9956-ffa450edef68
2012-06-08 15:47:50 +00:00
Aaron Myers b98e26af58 HDFS-2914. HA: Standby should not enter safemode when resources are low. Contributed by Vinay.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347895 13f79535-47bb-0310-9956-ffa450edef68
2012-06-08 06:57:52 +00:00
Aaron Myers 072ae08a00 HDFS-3040. TestMulitipleNNDataBlockScanner is misspelled. Contributed by Madhukara Phatak.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347891 13f79535-47bb-0310-9956-ffa450edef68
2012-06-08 06:38:14 +00:00
Tsz-wo Sze 415ce38b82 HADOOP-8469. Make NetworkTopology class pluggable. Contributed by Junping Du
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347867 13f79535-47bb-0310-9956-ffa450edef68
2012-06-08 02:29:40 +00:00
Eli Collins bce811c18b HADOOP-8488. test-patch.sh gives +1 even if the native build fails. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347846 13f79535-47bb-0310-9956-ffa450edef68
2012-06-08 00:44:39 +00:00
Todd Lipcon 0b3af2a66b Move HDFS-3042 (automatic failover) to branch-2 section of CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347809 13f79535-47bb-0310-9956-ffa450edef68
2012-06-07 21:35:30 +00:00
Todd Lipcon 05a73a3a1e Revert HDFS-3492 from r1347192: patch broke TestShortCircuitLocalRead
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347796 13f79535-47bb-0310-9956-ffa450edef68
2012-06-07 21:06:13 +00:00
Todd Lipcon 6d8efb7378 HDFS-3485. DataTransferThrottler will over-throttle when currentTimeMillis jumps. Contributed by Andy Isaacson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347751 13f79535-47bb-0310-9956-ffa450edef68
2012-06-07 18:41:24 +00:00
Tsz-wo Sze 743cbf6ef3 svn merge -c -1347092 for reverting HADOOP-8368 again.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347738 13f79535-47bb-0310-9956-ffa450edef68
2012-06-07 17:56:04 +00:00
Todd Lipcon bef65d0601 HDFS-3492. Fix some misuses of InputStream#skip. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347192 13f79535-47bb-0310-9956-ffa450edef68
2012-06-06 22:48:48 +00:00
Vinod Kumar Vavilapalli 9ae7639405 Fixing CHANGES.txt to refer to branch-2 instead of (an unreleased, not-yet-decided) release.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347136 13f79535-47bb-0310-9956-ffa450edef68
2012-06-06 21:19:33 +00:00
Eli Collins df57680b5f HADOOP-8485. Don't hardcode "Apache Hadoop 0.23" in the docs. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347133 13f79535-47bb-0310-9956-ffa450edef68
2012-06-06 21:14:15 +00:00