Commit Graph

5851 Commits

Author SHA1 Message Date
Chris Nauroth 2cf5084c32 HDFS-5358: Add updated editsStored file for tests.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1532863 13f79535-47bb-0310-9956-ffa450edef68
2013-10-16 18:58:38 +00:00
Andrew Wang af89caf9e4 HDFS-5359. Allow LightWeightGSet#Iterator to remove elements. (Contributed by Colin Patrick McCabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1532153 13f79535-47bb-0310-9956-ffa450edef68
2013-10-15 00:19:48 +00:00
Andrew Wang efe545b0c2 HDFS-5358. Add replication field to PathBasedCacheDirective. (Contributed by Colin Patrick McCabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1532124 13f79535-47bb-0310-9956-ffa450edef68
2013-10-14 22:56:11 +00:00
Colin McCabe 15d08c4778 HDFS-5349. DNA_CACHE and DNA_UNCACHE should be by blockId only (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1532116 13f79535-47bb-0310-9956-ffa450edef68
2013-10-14 22:19:10 +00:00
Andrew Wang 09e9e57a0b HDFS-5348. Fix error message when dfs.datanode.max.locked.memory is improperly configured. (Contributed by Colin Patrick McCabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1531460 13f79535-47bb-0310-9956-ffa450edef68
2013-10-11 23:13:13 +00:00
Chris Nauroth 8111c3af6b HDFS-5224. Refactor PathBasedCache* methods to use a Path rather than a String. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1531406 13f79535-47bb-0310-9956-ffa450edef68
2013-10-11 19:44:20 +00:00
Andrew Wang 3fc8792b5c HDFS-5304. Expose if a block replica is cached in getFileBlockLocations. (Contributed by Andrew Wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1530802 13f79535-47bb-0310-9956-ffa450edef68
2013-10-09 21:30:08 +00:00
Andrew Wang 54801ba4f9 Addenum for HDFS-5309, update binary edits again
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1530410 13f79535-47bb-0310-9956-ffa450edef68
2013-10-08 20:01:48 +00:00
Colin McCabe b60e18db74 HDFS-5314. Do not expose CachePool type in AddCachePoolOp (Colin Patrick McCabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1530073 13f79535-47bb-0310-9956-ffa450edef68
2013-10-07 21:26:01 +00:00
Andrew Wang 633b693517 HDFS-5309. Fix failing caching unit tests. (Andrew Wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1529646 13f79535-47bb-0310-9956-ffa450edef68
2013-10-06 17:06:03 +00:00
Andrew Wang eb2175db1a HDFS-5190. Move cache pool related CLI commands to CacheAdmin. (Contributed by Andrew Wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1529334 13f79535-47bb-0310-9956-ffa450edef68
2013-10-04 22:28:23 +00:00
Andrew Wang af1ac9a5e8 HDFS-5119. Persist CacheManager state in the edit log. (Contributed by Andrew Wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1529238 13f79535-47bb-0310-9956-ffa450edef68
2013-10-04 17:46:18 +00:00
Chris Nauroth 89c147d46f HDFS-5266. Addendum for addressing Findbugs warnings for lack of hashCode method and lack of null check in equals. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1527023 13f79535-47bb-0310-9956-ffa450edef68
2013-09-27 18:32:18 +00:00
Chris Nauroth 8f17d64527 HDFS-5266. ElasticByteBufferPool#Key does not implement equals. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1526671 13f79535-47bb-0310-9956-ffa450edef68
2013-09-26 20:30:14 +00:00
Colin McCabe 9a361c5821 HDFS-5191. Revisit zero-copy API in FSDataInputStream to make it more intuitive (Contributed by Colin Patrick McCabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1526020 13f79535-47bb-0310-9956-ffa450edef68
2013-09-24 21:40:53 +00:00
Andrew Wang 552e081a07 Delete a file for HDFS-5236.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1525184 13f79535-47bb-0310-9956-ffa450edef68
2013-09-21 00:22:02 +00:00
Andrew Wang a0d9a155a4 HDFS-5236. Change PathBasedCacheDirective APIs to be a single value rather than batch. (Contributed by Andrew Wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1525183 13f79535-47bb-0310-9956-ffa450edef68
2013-09-21 00:20:36 +00:00
Andrew Wang aae86e4f3f merge changes from trunk to HDFS-4949 branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1524865 13f79535-47bb-0310-9956-ffa450edef68
2013-09-19 23:42:10 +00:00
Andrew Wang e202d4d154 HDFS-5213. Separate PathBasedCacheEntry and PathBasedCacheDirectiveWithId. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1524561 13f79535-47bb-0310-9956-ffa450edef68
2013-09-18 20:43:40 +00:00
Andrew Wang 85c2036029 HDFS-5210. Fix some failing unit tests on HDFS-4949 branch. (Contributed by Andrew Wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1523754 13f79535-47bb-0310-9956-ffa450edef68
2013-09-16 18:41:27 +00:00
Chris Nauroth 68ec07cade HDFS-5197. Document dfs.cachereport.intervalMsec in hdfs-default.xml. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1523543 13f79535-47bb-0310-9956-ffa450edef68
2013-09-16 05:35:25 +00:00
Colin McCabe 50af34f778 HDFS-5201. NativeIO: consolidate getrlimit into NativeIO#getMemlockLimit. (Contributed by Colin Patrick McCabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1523153 13f79535-47bb-0310-9956-ffa450edef68
2013-09-14 00:05:29 +00:00
Andrew Wang 40eb94ade3 HDFS-5053. NameNode should invoke DataNode APIs to coordinate caching. (Andrew Wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1523145 13f79535-47bb-0310-9956-ffa450edef68
2013-09-13 23:27:22 +00:00
Chris Nauroth 1a1f49fa4f HDFS-5195. Prevent passing null pointer to mlock and munlock. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1523093 13f79535-47bb-0310-9956-ffa450edef68
2013-09-13 20:47:15 +00:00
Colin McCabe 2f8297215f HDFS-5198. NameNodeRpcServer must not send back DNA_FINALIZE in reply to a cache report.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1523087 13f79535-47bb-0310-9956-ffa450edef68
2013-09-13 20:36:11 +00:00
Chris Nauroth f152a7e788 YARN-1078. TestNodeManagerResync, TestNodeManagerShutdown, and TestNodeStatusUpdater fail on Windows. Contributed by Chuan Liu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1522644 13f79535-47bb-0310-9956-ffa450edef68
2013-09-12 15:58:34 +00:00
Devarajulu K a202855af5 MAPREDUCE-5164. mapred job and queue commands omit HADOOP_CLIENT_OPTS. Contributed by Nemon Lou.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1522595 13f79535-47bb-0310-9956-ffa450edef68
2013-09-12 14:32:20 +00:00
Colin McCabe 02e0e158a2 HDFS-5158. Add command-line support for manipulating cache directives
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1522272 13f79535-47bb-0310-9956-ffa450edef68
2013-09-12 03:55:10 +00:00
Thomas Graves c22091aecb YARN-1176. RM web services ClusterMetricsInfo total nodes doesn't include unhealthy nodes (Jonathan Eagles via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1522062 13f79535-47bb-0310-9956-ffa450edef68
2013-09-11 22:00:08 +00:00
Andrew Wang b6d9ef18c4 Move HDFS-4680 in CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1522049 13f79535-47bb-0310-9956-ffa450edef68
2013-09-11 21:17:30 +00:00
Andrew Wang e4374d8036 HDFS-4680. Audit logging of delegation tokens for MR tracing. (Andrew Wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1522012 13f79535-47bb-0310-9956-ffa450edef68
2013-09-11 19:57:37 +00:00
Vinod Kumar Vavilapalli 1c1ebc1553 MAPREDUCE-5497. Changed MRAppMaster to sleep only after doing everything else but just before ClientService to avoid race conditions during RM restart. Contributed by Jian He.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1521699 13f79535-47bb-0310-9956-ffa450edef68
2013-09-11 00:38:49 +00:00
Chris Nauroth b5c6ff164a YARN-1025. ResourceManager and NodeManager do not load native libraries on Windows. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1521670 13f79535-47bb-0310-9956-ffa450edef68
2013-09-10 22:51:27 +00:00
Jonathan Turner Eagles 220b21732b YARN-1119. Add ClusterMetrics checks to tho TestRMNodeTransitions tests (Mit Desai via jeagles)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1521611 13f79535-47bb-0310-9956-ffa450edef68
2013-09-10 19:53:49 +00:00
Jing Zhao 613979c8fd HDFS-5085. Refactor o.a.h.nfs to support different types of authentications. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1521601 13f79535-47bb-0310-9956-ffa450edef68
2013-09-10 19:29:45 +00:00
Thomas Graves 75c31df9dd MAPREDUCE-5020. Compile failure with JDK8 (Trevor Robinson via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1521576 13f79535-47bb-0310-9956-ffa450edef68
2013-09-10 18:31:50 +00:00
Bikas Saha bcb865314f YARN-1098. Separate out RM services into Always On and Active (Karthik Kambatla via bikas)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1521560 13f79535-47bb-0310-9956-ffa450edef68
2013-09-10 17:43:51 +00:00
Alejandro Abdelnur 11944e52fd Amending yarn CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1521454 13f79535-47bb-0310-9956-ffa450edef68
2013-09-10 12:14:49 +00:00
Vinod Kumar Vavilapalli 59b5490989 YARN-292. Fixed FifoScheduler and FairScheduler to make their applications data structures thread safe to avoid RM crashing with ArrayIndexOutOfBoundsException. Contributed by Zhijie Shen.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1521328 13f79535-47bb-0310-9956-ffa450edef68
2013-09-10 01:24:45 +00:00
Vinod Kumar Vavilapalli 0f91d8485a YARN-910. Augmented auxiliary services to listen for container starts and completions in addition to application events. Contributed by Alejandro Abdelnur.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1521298 13f79535-47bb-0310-9956-ffa450edef68
2013-09-09 21:48:09 +00:00
Vinod Kumar Vavilapalli 1a649aa51a YARN-1152. Fixed a bug in ResourceManager that was causing clients to get invalid client token key errors when an appliation is about to finish. Contributed by Jason Lowe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1521292 13f79535-47bb-0310-9956-ffa450edef68
2013-09-09 21:19:07 +00:00
Colin McCabe 3a9cd79e9d HDFS-5120. Add command-line support for manipulating cache pools.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1521240 13f79535-47bb-0310-9956-ffa450edef68
2013-09-09 18:53:01 +00:00
Alejandro Abdelnur f2e0a125f4 YARN-1144. Unmanaged AMs registering a tracking URI should not be proxy-fied. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1521039 13f79535-47bb-0310-9956-ffa450edef68
2013-09-09 11:12:45 +00:00
Alejandro Abdelnur 1cd7b067f7 YARN-1049. ContainerExistStatus should define a status for preempted containers. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1521036 13f79535-47bb-0310-9956-ffa450edef68
2013-09-09 11:07:49 +00:00
Devarajulu K b2af6c7024 MAPREDUCE-5414. TestTaskAttempt fails in JDK7 with NPE. Contributed by Nemon Lou.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1520964 13f79535-47bb-0310-9956-ffa450edef68
2013-09-09 06:42:42 +00:00
Andrew Wang 4f2bf68b73 HDFS-5170. BlockPlacementPolicyDefault uses the wrong classname when alerting to enable debug logging. (Andrew Wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1520961 13f79535-47bb-0310-9956-ffa450edef68
2013-09-09 04:54:57 +00:00
Ivan Mitic 40cf0068d8 HADOOP-9924. Addendum patch to address issue with an empty classpath entry on Windows. Contributed by Shanyu Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1520903 13f79535-47bb-0310-9956-ffa450edef68
2013-09-08 19:51:46 +00:00
Vinod Kumar Vavilapalli 03ae82a311 YARN-696. Changed RMWebservice apps call to take in multiple application states. Contributed by Trevor Lorimer.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1520736 13f79535-47bb-0310-9956-ffa450edef68
2013-09-07 07:28:19 +00:00
Vinod Kumar Vavilapalli f35983b805 YARN-1107. Fixed a bug in ResourceManager because of which RM in secure mode fails to restart. Contributed by Omkar Vinit Joshi.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1520726 13f79535-47bb-0310-9956-ffa450edef68
2013-09-07 05:43:04 +00:00
Andrew Wang efc1048ffe Revert HADOOP-9877 because of breakage reported in HADOOP-9912
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1520713 13f79535-47bb-0310-9956-ffa450edef68
2013-09-06 22:57:44 +00:00