Commit Graph

1582 Commits

Author SHA1 Message Date
Thomas White 7edfff5795 HADOOP-7787. Make source tarball use conventional name. Contributed by Bruno Mahé
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203437 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 00:19:53 +00:00
Alejandro Abdelnur ed45ad0fcc MAPREDUCE-3415. improve MiniMRYarnCluster & DistributedShell JAR resolution (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203411 13f79535-47bb-0310-9956-ffa450edef68
2011-11-17 22:58:44 +00:00
Alejandro Abdelnur 302e3dfe2c MAPREDUCE-3169. Create a new MiniMRCluster equivalent which only provides client APIs cross MR1 and MR2. (Ahmed via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203371 13f79535-47bb-0310-9956-ffa450edef68
2011-11-17 21:13:29 +00:00
Vinod Kumar Vavilapalli 9d7402e0af MAPREDUCE-3407. Fixed pom files to refer to the correct MR app-jar needed by the integration tests. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1202766 13f79535-47bb-0310-9956-ffa450edef68
2011-11-16 16:30:05 +00:00
Vinod Kumar Vavilapalli 00b50a5c94 MAPREDUCE-3355. Fixed MR AM's ContainerLauncher to handle node-command timeouts correctly. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1202744 13f79535-47bb-0310-9956-ffa450edef68
2011-11-16 15:37:27 +00:00
Mahadev Konar 649080131c HADOOP-7811. TestUserGroupInformation#testGetServerSideGroups test fails in chroot. (Jonathan Eagles via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1202540 13f79535-47bb-0310-9956-ffa450edef68
2011-11-16 06:29:09 +00:00
Vinod Kumar Vavilapalli c56e051961 MAPREDUCE-3102. Changed NodeManager to fail fast when LinuxContainerExecutor has wrong configuration or permissions. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1202117 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 10:30:26 +00:00
Mahadev Konar 3491205b0a MAPREDUCE-3331. Improvement to single node cluster setup documentation for 0.23 (Anupam Seth via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1202002 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 02:05:25 +00:00
Amar Kamat 116b91cdfb MAPREDUCE-3375. [Gridmix] Memory Emulation system tests. (Vinay Thota via amarrk)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201997 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 01:48:42 +00:00
Todd Lipcon 9a3f147fdd HDFS-2476. More CPU efficient data structure for under-replicated, over-replicated, and invalidated blocks. Contributed by Tomasz Nykiel.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201991 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 01:13:58 +00:00
Todd Lipcon 51ce383112 HDFS-2532. Add timeout to TestDfsOverAvroRpc
This test is timing out on trunk, causing tests below it to
fail spuriously. This patch doesn't fix the issue -- just adds
a JUnit timeout so that the failure is properly attributed
to this test.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201963 13f79535-47bb-0310-9956-ffa450edef68
2011-11-14 23:34:21 +00:00
Mahadev Konar 4cdcf7b867 MAPREDUCE-3243. Invalid tracking URL for streaming jobs (Jonathan Eagles via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201951 13f79535-47bb-0310-9956-ffa450edef68
2011-11-14 22:44:44 +00:00
Mahadev Konar 58bfa24ae4 MAPREDUCE-3341. Enhance logging of initalized queue limit values. (Anupam Seth via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201947 13f79535-47bb-0310-9956-ffa450edef68
2011-11-14 22:38:56 +00:00
Mahadev Konar 503593af1e MAPREDUCE-3325. Improvements to CapacityScheduler doc. (Thomas Graves via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201925 13f79535-47bb-0310-9956-ffa450edef68
2011-11-14 21:59:56 +00:00
Mahadev Konar ac320f5046 MAPREDUCE-3324. Not All HttpServer tools links (stacks,logs,config,metrics) are accessible through all UI servers (Jonathan Eagles via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201914 13f79535-47bb-0310-9956-ffa450edef68
2011-11-14 21:30:10 +00:00
Todd Lipcon 3cedc5f83f HADOOP-7813. Fix test-patch to use proper numerical comparison when checking javadoc and findbugs warning counts. Contributed by Jonathan Eagles.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201056 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 21:16:27 +00:00
Vinod Kumar Vavilapalli 27c9b8833b MAPREDUCE-3370. More changes accidentally missed from the previous commit.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1200775 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 08:51:21 +00:00
Vinod Kumar Vavilapalli 9c17410c50 MAPREDUCE-3370. Fixed MiniMRYarnCluster and related tests to not use a hard-coded path for the mr-app jar. Contributed by Ahmed Radwan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1200768 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 08:44:52 +00:00
Vinod Kumar Vavilapalli dbc82dbdfb MAPREDUCE-3379. Fixed LocalResourceTracker in NodeManager to remove deleted cache entries correctly. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1200747 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 06:30:27 +00:00
Tsz-wo Sze 09a156fcce HDFS-2539. Support doAs and GETHOMEDIRECTORY in webhdfs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1200731 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 04:19:45 +00:00
Vinod Kumar Vavilapalli 200bb27557 MAPREDUCE-3392. Fixed Cluster's getDelegationToken's API to return null when there isn't a supported token. Contributed by John George.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1200484 13f79535-47bb-0310-9956-ffa450edef68
2011-11-10 19:19:25 +00:00
Vinod Kumar Vavilapalli 15150cd997 MAPREDUCE-3280. Removed the unnecessary job user-name configuration in mapred-site.xml. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1200441 13f79535-47bb-0310-9956-ffa450edef68
2011-11-10 17:28:16 +00:00
Vinod Kumar Vavilapalli 2df83e5b4d MAPREDUCE-3333. Fixed bugs in ContainerLauncher of MR AppMaster due to which per-container connections to NodeManager were lingering long enough to hit the ulimits on number of processes. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199751 13f79535-47bb-0310-9956-ffa450edef68
2011-11-09 13:41:19 +00:00
Vinod Kumar Vavilapalli 3853d112ea MAPREDUCE-3336. Replaced guice internal.Preconditions api usage with the public Preconditions API. Contributed by Thomas Graves.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199714 13f79535-47bb-0310-9956-ffa450edef68
2011-11-09 12:40:41 +00:00
Amar Kamat cec9f82344 MAPREDUCE-2733. [Gridmix] Gridmix3 cpu emulation system tests. (Vinay Thota via amarrk)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199678 13f79535-47bb-0310-9956-ffa450edef68
2011-11-09 09:47:50 +00:00
Tsz-wo Sze 94c631af1f HDFS-2540. Webhdfs: change "Expect: 100-continue" to two-step write; change "HdfsFileStatus" and "localName" respectively to "FileStatus" and "pathSuffix" in JSON response.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199396 13f79535-47bb-0310-9956-ffa450edef68
2011-11-08 19:25:57 +00:00
Vinod Kumar Vavilapalli 80cc8e9486 MAPREDUCE-3345. Fixed a race condition in ResourceManager that was causing TestContainerManagerSecurity to fail sometimes. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199144 13f79535-47bb-0310-9956-ffa450edef68
2011-11-08 07:55:51 +00:00
Vinod Kumar Vavilapalli 9fe9f42c8f MAPREDUCE-3342. Fixed JobHistoryServer to also show the job's queue name. Contributed by Jonathan Eagles.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199133 13f79535-47bb-0310-9956-ffa450edef68
2011-11-08 07:28:56 +00:00
Amar Kamat 6749d1395f [Rumen] LoggedTaskAttempt#getHostName() returns null. (amarrk)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199105 13f79535-47bb-0310-9956-ffa450edef68
2011-11-08 04:44:25 +00:00
Thomas White cb7f819b91 HADOOP-7801. HADOOP_PREFIX cannot be overriden. Contributed by Bruno Mahé.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199025 13f79535-47bb-0310-9956-ffa450edef68
2011-11-08 00:16:27 +00:00
Hairong Kuang 6dff9329d5 HDFS-2495. Increase granularity of write operations in ReplicationMonitor thus reducing contention for write lock. Contributed by Tomasz Nykiel.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199024 13f79535-47bb-0310-9956-ffa450edef68
2011-11-08 00:16:23 +00:00
Tsz-wo Sze a83753b735 HADOOP-7688. Add servlet handler check in HttpServer.start(). Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1198924 13f79535-47bb-0310-9956-ffa450edef68
2011-11-07 20:51:15 +00:00
Thomas White 00b5aa76f9 Update CHANGES.txt for commit 1198910.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1198912 13f79535-47bb-0310-9956-ffa450edef68
2011-11-07 20:14:33 +00:00
Thomas White 9a6da7979e MAPREDUCE-3344. o.a.h.mapreduce.Reducer since 0.21 blindly casts to ReduceContext.ValueIterator. Contributed by Brock Noland.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1198910 13f79535-47bb-0310-9956-ffa450edef68
2011-11-07 20:13:00 +00:00
Tsz-wo Sze a590b498ac HDFS-2528. Webhdfs: set delegation kind to WEBHDFS and add a HDFS token when http requests are redirected to datanode.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1198903 13f79535-47bb-0310-9956-ffa450edef68
2011-11-07 20:05:16 +00:00
Mahadev Konar 6733a1ca5e MAPREDUCE-3291. App fail to launch due to delegation token not found in cache (Robert Evans via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1198583 13f79535-47bb-0310-9956-ffa450edef68
2011-11-06 22:58:47 +00:00
Sanjay Radia 072bdd85d1 HADOOP-7776 Make the Ipc-Header in a RPC-Payload an explicit header (sanjay)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1197885 13f79535-47bb-0310-9956-ffa450edef68
2011-11-05 05:06:44 +00:00
Hairong Kuang db13c99940 Add the missing test file to HDFS-2477.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1197801 13f79535-47bb-0310-9956-ffa450edef68
2011-11-04 21:49:15 +00:00
Vinod Kumar Vavilapalli 0b5a4823a9 MAPREDUCE-3217. Reenabled and fixed bugs in the failing ant test TestAuditLogger. Contributed by Devaraj K.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1197438 13f79535-47bb-0310-9956-ffa450edef68
2011-11-04 09:01:51 +00:00
Vinod Kumar Vavilapalli 08cb4cf334 MAPREDUCE-3219. Reenabled and fixed bugs in the failing test TestDelegationToken. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1197415 13f79535-47bb-0310-9956-ffa450edef68
2011-11-04 07:48:26 +00:00
Tsz-wo Sze 6afe3e0d22 HDFS-2527. WebHdfs: remove the use of "Range" header in Open; use ugi username if renewer parameter is null in GetDelegationToken; response OK when setting replication for non-files; rename GETFILEBLOCKLOCATIONS to GET_BLOCK_LOCATIONS and state that it is a private unstable API; replace isDirectory and isSymlink with enum {FILE, DIRECTORY, SYMLINK} in HdfsFileStatus JSON object.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1197329 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 22:34:47 +00:00
Vinod Kumar Vavilapalli dae055bb70 MAPREDUCE-3215. Reneabled and fixed bugs in the failing test TestNoJobSetupCleanup. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1197101 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 13:19:29 +00:00
Vinod Kumar Vavilapalli aa297b188e MAPREDUCE-3221. Reneabled the previously ignored test in TestSubmitJob and fixed bugs in it. Contributed by Devaraj K.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1197080 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 12:25:18 +00:00
Vinod Kumar Vavilapalli c27601fefe MAPREDUCE-3297. Moved log related components into yarn-common so that HistoryServer and clients can use them without depending on the yarn-server-nodemanager module. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196986 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 08:02:19 +00:00
Arun Murthy 0df4878033 MAPREDUCE-3337. Added missing license headers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196977 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 07:06:53 +00:00
Todd Lipcon 40fe96546f HDFS-2129. Simplify BlockReader to not inherit from FSInputChecker. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196976 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 06:54:59 +00:00
Arun Murthy 5d5e2df9d3 HADOOP-7797. Fix top-level pom.xml to refer to correct staging maven repository. Contributed by Owen O'Malley.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196971 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 06:34:32 +00:00
Arun Murthy c7b1d6f392 HADOOP-7798. Fixed jira number in CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196966 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 06:31:18 +00:00
Arun Murthy 59c0b31d78 HADOOP-7789. Add support gpg signatures for maven release artifacts. Contributed by Doug Cutting.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196957 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 06:20:46 +00:00
Todd Lipcon fd8c757b9f Add new section to HDFS CHANGES.txt for 0.23.1. Moved two things that were recently committed post-0.23.0 to this new section.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196904 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 01:02:28 +00:00