Commit Graph

2903 Commits

Author SHA1 Message Date
Thomas Graves 5568bf8260 merge -r 1363453:1363454 from trunk. FIXES: MAPREDUCE-4423
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1363455 13f79535-47bb-0310-9956-ffa450edef68
2012-07-19 18:22:03 +00:00
Robert Joseph Evans 48a86fbe8f svn merge -c 1363435 FIXES: HADOOP-8551. fs -mkdir creates parent directories without the -p option (Daryn Sharp and John George via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1363437 13f79535-47bb-0310-9956-ffa450edef68
2012-07-19 17:48:33 +00:00
Todd Lipcon fb87050e00 HDFS-3605. Block mistakenly marked corrupt during edit log catchup phase of failover. Contributed by Todd Lipcon and Brahma Reddy Battula.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1363176 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 23:42:20 +00:00
Daryn Sharp 22022a8760 svn merge -c 1363170 FIXES: HDFS-3646. LeaseRenewer can hold reference to inactive DFSClient instances forever.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1363172 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 23:27:21 +00:00
Alejandro Abdelnur 52fa40b8ba Merge -r 1363161:1363162 from trunk to branch. FIXES: MAPREDUCE-4407
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1363163 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 22:43:52 +00:00
Robert Joseph Evans e69e5c9cd3 svn merge -c 1363067 FIXES: MAPREDUCE-4157. ResourceManager should not kill apps that are well behaved (Jason Lowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1363070 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 19:44:22 +00:00
Eli Collins e8b0614072 HDFS-2966. TestNameNodeMetrics tests can fail under load. Contributed by Steve Loughran
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362985 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 15:42:19 +00:00
Tsz-wo Sze 7221b08042 svn merge -c 1362976 from trunk for HDFS-3577. In DatanodeWebHdfsMethods, use MessageBodyWriter instead of StreamingOutput, otherwise, it will fail to transfer large files.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362977 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 15:14:38 +00:00
Eli Collins ab129035bf Revert HDFS-3639. JspHelper#getUGI should always verify the token if security is enabled.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362765 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 05:16:50 +00:00
Eli Collins 3f4826881d Revert HDFS-3654. TestJspHelper#testGetUgi fails with NPE.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362764 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 05:16:09 +00:00
Alejandro Abdelnur bd359a1a8e Merge -r 1362750:1362751 from trunk to branch. FIXES: MAPREDUCE-4406
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362752 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 03:37:38 +00:00
Todd Lipcon 1aa9249c61 HADOOP-8537. Fix TFile tests to pass even when native zlib support is not compiled. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362730 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 00:51:36 +00:00
Alejandro Abdelnur c22cddbad1 Merge -r 1362721:1362722 from trunk to branch. FIXES: MAPREDUCE-4422
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362723 13f79535-47bb-0310-9956-ffa450edef68
2012-07-17 23:34:38 +00:00
Daryn Sharp 70f330d14c svn merge -c 1362618 FIXES: MAPREDUCE-4448. Fix NM crash during app cleanup if aggregation didn't
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362621 13f79535-47bb-0310-9956-ffa450edef68
2012-07-17 19:46:44 +00:00
Robert Joseph Evans f8bd54b16a svn merge -c 1362612 FIXES: MAPREDUCE-4380. Empty Userlogs directory is getting created under logs directory (Devaraj K via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362613 13f79535-47bb-0310-9956-ffa450edef68
2012-07-17 19:15:30 +00:00
Robert Joseph Evans 71b35e827c svn merge -c 1362608 FIXES: MAPREDUCE-4283. Display tail of aggregated logs by default (Jason Lowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362609 13f79535-47bb-0310-9956-ffa450edef68
2012-07-17 19:08:26 +00:00
Robert Joseph Evans 796272a502 svn merge -c 1362495 FIXES: MAPREDUCE-4449. Incorrect MR_HISTORY_STORAGE property name in JHAdminConfig (Ahmed Radwan via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362496 13f79535-47bb-0310-9956-ffa450edef68
2012-07-17 13:51:52 +00:00
Arun Murthy 1f299865c0 Merge -c 1362332 from trunk to branch-2 to fix MAPREDUCE-4440. Changed SchedulerApp and SchedulerNode to be a minimal interface to allow schedulers to maintain their own.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362333 13f79535-47bb-0310-9956-ffa450edef68
2012-07-17 01:49:30 +00:00
Todd Lipcon 2b81fe68b7 HADOOP-8599. Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file. Contributed by Andrey Klochkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362296 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 22:41:59 +00:00
Eli Collins 551ed65482 Amend HDFS-3666, applied earlier version of the patch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362279 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 21:50:58 +00:00
Eli Collins 9404bc7cad HDFS-3666. Plumb more exception messages to terminate. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362274 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 21:30:42 +00:00
Robert Joseph Evans 0d1867fa9d svn merge -c 1362209 FIXES: MAPREDUCE-4437. Race in MR ApplicationMaster can cause reducers to never be scheduled (Jason Lowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362213 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 19:13:10 +00:00
Eli Collins d3b1109de8 MAPREDUCE-4447. Remove aop from cruft from the ant build. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362207 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 19:10:26 +00:00
Eli Collins c56bbc7a00 HDFS-3665. Add a test for renaming across file systems via a symlink. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362179 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 18:34:09 +00:00
Alejandro Abdelnur 5b64da5b53 Merge -r 1362150:1362151 from trunk to branch. FIXES: HADOOP-8552
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362152 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 17:29:54 +00:00
Eli Collins fa26901c01 HDFS-3537. Move libhdfs and fuse-dfs source to native subdirectories. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362127 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 16:54:49 +00:00
Robert Joseph Evans c35da29454 svn merge -c 1362052. FIXES: MAPREDUCE-4395. Possible NPE at ClientDistributedCacheManager#determineTimestamps (Bhallamudi via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362054 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 14:20:47 +00:00
Harsh J 769194d5b3 Backport of HADOOP-8531 from trunk. SequenceFile Writer can throw out a better error if a serializer or deserializer isn't available. Contributed by Madhukara Phatak. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361943 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 09:03:24 +00:00
Harsh J 2c418eecf6 Backport of HDFS-3659 from trunk. Add missing @Override to methods across the hadoop-hdfs project. Contributed by Brandon Li. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361895 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 03:07:49 +00:00
Arun Murthy 4902c6bdc9 Merge -c 1361813 from trunk to branch-2 to fix MAPREDUCE-4427. Added an 'unmanaged' mode for AMs so as to ease development of new applications. Contributed by Bikas Saha.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361815 13f79535-47bb-0310-9956-ffa450edef68
2012-07-15 21:47:53 +00:00
Eli Collins 5685eb30bb HDFS-3663. MiniDFSCluster should capture the code path that led to the first ExitException. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361777 13f79535-47bb-0310-9956-ffa450edef68
2012-07-15 19:48:15 +00:00
Harsh J a016d8e9a9 Backport of HADOOP-7818 from trunk. DiskChecker#checkDir should fail if the directory is not executable. Contributed by Madhukara Phatak. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361718 13f79535-47bb-0310-9956-ffa450edef68
2012-07-15 15:34:35 +00:00
Harsh J f868d9fc98 Backport of HADOOP-8362 from trunk. svn merge -c 1361712 ../../trunk. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361714 13f79535-47bb-0310-9956-ffa450edef68
2012-07-15 15:17:30 +00:00
Eli Collins 30d0104c0e HDFS-3610. fuse_dfs: Provide a way to use the default (configured) NN URI. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361566 13f79535-47bb-0310-9956-ffa450edef68
2012-07-14 17:19:26 +00:00
Eli Collins d03fb9c0d2 Amend HDFS-799. Remove unnecessary tls check. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361563 13f79535-47bb-0310-9956-ffa450edef68
2012-07-14 17:03:24 +00:00
Eli Collins a9629c6fe7 HDFS-3654. TestJspHelper#testGetUgi fails with NPE. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361465 13f79535-47bb-0310-9956-ffa450edef68
2012-07-14 01:10:19 +00:00
Eli Collins 2e63754888 HDFS-3539. libhdfs code cleanups. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361461 13f79535-47bb-0310-9956-ffa450edef68
2012-07-14 00:53:07 +00:00
Eli Collins e8cc5cb4aa HDFS-3609. libhdfs: don't force the URI to look like hdfs://hostname:port. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361455 13f79535-47bb-0310-9956-ffa450edef68
2012-07-14 00:36:32 +00:00
Eli Collins 03e8648d17 HDFS-3492. fix some misuses of InputStream#skip. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361450 13f79535-47bb-0310-9956-ffa450edef68
2012-07-14 00:22:55 +00:00
Eli Collins bb00c0ce20 HDFS-470. libhdfs should handle 0-length reads from FSInputStream correctly. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361447 13f79535-47bb-0310-9956-ffa450edef68
2012-07-14 00:04:36 +00:00
Eli Collins 849dc6da07 HDFS-3606. libhdfs: create self-contained unit test. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361442 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 23:28:23 +00:00
Eli Collins 67c853f068 HADOOP-8499. Lower min.user.id to 500 for the tests. Contributed Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361439 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 23:05:35 +00:00
Alejandro Abdelnur 8155269a0a Merge -r 1361435:1361436 from trunk to branch. MAPREDUCE-3451 Amendment, exclduing findbugs warnings
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361437 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 22:57:21 +00:00
Robert Joseph Evans 24bb52b137 svn merge -c 1361397 FIXES: MAPREDUCE-4299. Terasort hangs with MR2 FifoScheduler (Tom White via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361398 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 20:55:05 +00:00
Robert Joseph Evans 3260960be3 svn merge -c 1361389 FIXES: MAPREDUCE-4419. ./mapred queue -info <queuename> -showJobs displays all the jobs irrespective of <queuename> (Devaraj K via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361391 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 20:45:05 +00:00
Alejandro Abdelnur e4f54acd26 Merge -r 1361386:1361387 from trunk to branch. FIXES: MAPREDUCE-4441
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361390 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 20:42:51 +00:00
Harsh J f457ffb05b Backport of MAPREDUCE-4432 from trunk. Confusing warning message when GenericOptionsParser is not used. Contributed by Gabriel Reid. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361275 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 15:23:09 +00:00
Harsh J 7d09bc1880 Revert MAPREDUCE-4422 from branch-2 until further comments are addressed.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361100 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 08:45:53 +00:00
Harsh J eb22b9d183 MAPREDUCE-4422. YARN_APPLICATION_CLASSPATH needs a documented default value in YarnConfiguration. Contributed by Ahmed Radwan. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361062 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 07:27:31 +00:00
Harsh J 0565cb3c03 HDFS-3612. Single namenode image directory config warning can be improved. Contributed by Andy Isaacson. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361060 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 07:21:18 +00:00