Commit Graph

2985 Commits

Author SHA1 Message Date
Uma Maheswara Rao G d28b982428 HDFS-3222. DFSInputStream#openInfo should not silently get the length as 0 when locations length is zero for last partial block. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331061 13f79535-47bb-0310-9956-ffa450edef68
2012-04-26 20:18:01 +00:00
Robert Joseph Evans 1c0231cc74 MAPREDUCE-4189. TestContainerManagerSecurity is failing (Devaraj K via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331046 13f79535-47bb-0310-9956-ffa450edef68
2012-04-26 19:40:48 +00:00
Thomas White 1a118d6a32 MAPREDUCE-4138. Reduce memory usage of counters due to non-static nested classes.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331023 13f79535-47bb-0310-9956-ffa450edef68
2012-04-26 18:39:22 +00:00
Robert Joseph Evans cda16311a9 MAPREDUCE-4169. Container Logs appear in unsorted order (Jonathan Eagles via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331012 13f79535-47bb-0310-9956-ffa450edef68
2012-04-26 18:27:05 +00:00
Aaron Myers 4b62c68292 HADOOP-8310. FileContext#checkPath should handle URIs with no port. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331007 13f79535-47bb-0310-9956-ffa450edef68
2012-04-26 18:19:01 +00:00
Eli Collins 2b254dad2e HDFS-3258. Test for HADOOP-8144 (pseudoSortByDistance in NetworkTopology for first rack local node). Contributed by Junping Du
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330613 13f79535-47bb-0310-9956-ffa450edef68
2012-04-26 00:47:16 +00:00
Thomas Graves e7583d816a MAPREDUCE-3613. web service calls header contains 2 content types (tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330560 13f79535-47bb-0310-9956-ffa450edef68
2012-04-25 21:13:06 +00:00
Robert Joseph Evans 719b719e3d MAPREDUCE-4194. ConcurrentModificationError in DirectoryCollection (Jonathan Eagles via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330552 13f79535-47bb-0310-9956-ffa450edef68
2012-04-25 20:49:41 +00:00
Tsz-wo Sze 3b773da036 HDFS-3319. Change DFSOutputStream to not to start a thread in constructors.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330535 13f79535-47bb-0310-9956-ffa450edef68
2012-04-25 20:17:20 +00:00
Tsz-wo Sze 2584779166 HDFS-3321. Fix safe mode turn off tip message. Contributed by Ravi Prakash
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330506 13f79535-47bb-0310-9956-ffa450edef68
2012-04-25 19:34:36 +00:00
Tsz-wo Sze f86352c2df HDFS-3318. Use BoundedInputStream in ByteRangeInputStream, otherwise, it hangs on transfers >2 GB. Contributed by Daryn Sharp
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330500 13f79535-47bb-0310-9956-ffa450edef68
2012-04-25 19:24:00 +00:00
Thomas Graves e84b552713 HADOOP-8296. hadoop/yarn daemonlog usage wrong (Devaraj K via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330445 13f79535-47bb-0310-9956-ffa450edef68
2012-04-25 17:59:08 +00:00
Tsz-wo Sze 8e99d9a764 Move HDFS-3282 and HDFS-3298 to 2.0.0 in CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330443 13f79535-47bb-0310-9956-ffa450edef68
2012-04-25 17:57:28 +00:00
Thomas White bcfb66ebb2 MAPREDUCE-4193. broken doc link for yarn-default.xml in site.xml. Contributed by Patrick Hunt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330427 13f79535-47bb-0310-9956-ffa450edef68
2012-04-25 17:20:00 +00:00
Alejandro Abdelnur e29ede3f72 HADOOP-8314. HttpServer#hasAdminAccess should return false if authorization is enabled but user is not authenticated. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330086 13f79535-47bb-0310-9956-ffa450edef68
2012-04-25 03:20:53 +00:00
Tsz-wo Sze ea32198db4 HDFS-3298. Add HdfsDataOutputStream as a public API.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330064 13f79535-47bb-0310-9956-ffa450edef68
2012-04-24 23:39:43 +00:00
Alejandro Abdelnur 706e861a85 HADOOP-7549. Use JDK ServiceLoader mechanism to find FileSystem implementations. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329994 13f79535-47bb-0310-9956-ffa450edef68
2012-04-24 20:33:05 +00:00
Alejandro Abdelnur f4711ef3ab HDFS-3314. HttpFS operation for getHomeDirectory is incorrect. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329715 13f79535-47bb-0310-9956-ffa450edef68
2012-04-24 13:46:25 +00:00
Alejandro Abdelnur f9993b5ffb HADOOP-8309. Pseudo & Kerberos AuthenticationHandler should use getType() to create token (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329713 13f79535-47bb-0310-9956-ffa450edef68
2012-04-24 13:44:53 +00:00
Thomas Graves f340d6c894 MAPREDUCE-4079. Allow MR AppMaster to limit ephemeral port range.(bobby via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329694 13f79535-47bb-0310-9956-ffa450edef68
2012-04-24 13:03:15 +00:00
Eli Collins 858887e289 HADOOP-8152. Expand public APIs for security library classes. Contributed by Aaron T. Myers
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329541 13f79535-47bb-0310-9956-ffa450edef68
2012-04-24 03:59:35 +00:00
Alejandro Abdelnur ebe0e9a99b MAPREDUCE-4141. clover integration broken, also mapreduce poms are pulling in clover as a dependency. (phunt via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329493 13f79535-47bb-0310-9956-ffa450edef68
2012-04-23 22:32:06 +00:00
Alejandro Abdelnur 1ac0171b2b HADOOP-8284. clover integration broken, also mapreduce poms are pulling in clover as a dependency. (phunt via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329490 13f79535-47bb-0310-9956-ffa450edef68
2012-04-23 22:30:48 +00:00
Tsz-wo Sze 93c5585d31 HDFS-3312. In HftpFileSystem, the namenode URI is non-secure but the delegation tokens have to use secure URI. Contributed by Daryn Sharp
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329462 13f79535-47bb-0310-9956-ffa450edef68
2012-04-23 21:27:01 +00:00
Robert Joseph Evans 80ab78c217 MAPREDUCE-4133. MR over viewfs is broken (John George via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329403 13f79535-47bb-0310-9956-ffa450edef68
2012-04-23 19:44:30 +00:00
Robert Joseph Evans 796e1a48ac MAPREDUCE-4190. Improve web UI for task attempts userlog link (Tom Graves via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329398 13f79535-47bb-0310-9956-ffa450edef68
2012-04-23 19:38:28 +00:00
Sanjay Radia 589c68ae09 HADOOP-8285 Use ProtoBuf for RpcPayLoadHeader (sanjay radia)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329319 13f79535-47bb-0310-9956-ffa450edef68
2012-04-23 16:34:21 +00:00
Robert Joseph Evans 1eb1d0ae4f MAPREDUCE-3812. Lower default allocation sizes, fix allocation configurations and document them (Harsh J via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329282 13f79535-47bb-0310-9956-ffa450edef68
2012-04-23 15:26:35 +00:00
Tsz-wo Sze cdbe15ccdc HDFS-3308. Uses canonical URI to select delegation tokens in HftpFileSystem and WebHdfsFileSystem. Contributed by Daryn Sharp
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328541 13f79535-47bb-0310-9956-ffa450edef68
2012-04-20 23:59:19 +00:00
Tsz-wo Sze 201af20406 Revert r1328482 for HDFS-3308.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328487 13f79535-47bb-0310-9956-ffa450edef68
2012-04-20 19:32:23 +00:00
Tsz-wo Sze ab8f458742 HDFS-3308. Uses canonical URI to select delegation tokens in HftpFileSystem and WebHdfsFileSystem. Contributed by Daryn Sharp
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328482 13f79535-47bb-0310-9956-ffa450edef68
2012-04-20 19:16:58 +00:00
Aaron Myers 49ed783a3a HDFS-3305. GetImageServlet should consider SBN a valid requestor in a secure HA setup. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328115 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 20:43:03 +00:00
Robert Joseph Evans 8d09ab0da2 MAPREDUCE-3947. yarn.app.mapreduce.am.resource.mb not documented (Devaraj K via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328111 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 20:35:54 +00:00
Alejandro Abdelnur df654cca49 MAPREDUCE-3867. MiniMRYarn/MiniYarn uses fixed ports (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328109 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 20:33:11 +00:00
Robert Joseph Evans 7d2466c0c8 MAPREDUCE-4129. Lots of unneeded counters log messages (Ahmed Radwan via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328106 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 20:23:47 +00:00
Robert Joseph Evans d09cf903ab MAPREDUCE-4093. Improve RM WebApp start up when proxy address is not set (Devaraj K vai bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328090 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 19:42:32 +00:00
Robert Joseph Evans 5b35f7df64 MAPREDUCE-4165. Committing is misspelled as commiting in task logs (John Eagles via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328086 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 19:32:16 +00:00
Thomas White 0363ca0489 HADOOP-7350. Use ServiceLoader to discover compression codec classes.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328083 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 19:20:31 +00:00
Robert Joseph Evans e3806060ce MAPREDUCE-4159. Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero (Devaraj K via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328031 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 16:22:22 +00:00
Robert Joseph Evans f6cadd8610 HADOOP-8288. Remove references of mapred.child.ulimit etc. since they are not being used any more (Ravi Prakash via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328018 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 16:05:34 +00:00
Thomas Graves 97ae5b675f MAPREDUCE-4074. Client continuously retries to RM When RM goes down before launching Application Master (xieguiming via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327972 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 14:44:57 +00:00
Amar Kamat 3edc40e377 MAPREDUCE-4100. [Gridmix] Bug fixed in compression emulation feature for map only jobs. (amarrk)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327816 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 04:26:53 +00:00
Uma Maheswara Rao G ba4ec5f0aa iHDFS-3282. Expose getFileLength API. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327790 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 02:41:32 +00:00
Uma Maheswara Rao G c6d3537d33 HDFS-3282. Expose getFileLength API. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327788 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 02:34:44 +00:00
Eli Collins 4550627cab HDFS-3169. TestFsck should test multiple -move operations in a row. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327776 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 01:51:13 +00:00
Eli Collins 54e61ffdc0 HDFS-3206. Miscellaneous xml cleanups for OEV. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327768 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 01:31:53 +00:00
Eli Collins 0c16ec4d6e HDFS-891. DataNode no longer needs to check for dfs.network.script. Contributed by Harsh J
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327762 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 01:09:12 +00:00
Todd Lipcon cc052d2a4a Move HADOOP-8117 from 3.0 to 2.0 in CHANGES.txt after commit to branch-2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327707 13f79535-47bb-0310-9956-ffa450edef68
2012-04-18 22:22:49 +00:00
Tsz-wo Sze 2bf8be3c72 HDFS-3292. Remove the deprecated DiskStatus, getDiskStatus(), getRawCapacity() and getRawUsed() from DistributedFileSystem. Contributed by Arpit Gupta
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327664 13f79535-47bb-0310-9956-ffa450edef68
2012-04-18 20:21:08 +00:00
Alejandro Abdelnur 8bda086d04 HDFS-3263. HttpFS should read HDFS config from Hadoop site.xml files (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327627 13f79535-47bb-0310-9956-ffa450edef68
2012-04-18 18:51:22 +00:00