Commit Graph

9741 Commits

Author SHA1 Message Date
Karthik Kambatla 84198564ba YARN-2984. Metrics for container's actual memory usage. (kasha) 2015-01-17 05:44:04 +05:30
Konstantin V Shvachko 60cbcff2f7 HDFS-7606. Fix potential NPE in INodeFile.getBlocks(). Contributed by Byron Wong. 2015-01-16 14:31:18 -08:00
cnauroth ec4389cf72 HDFS-7632. MiniDFSCluster configures DataNode data directories incorrectly if using more than 1 DataNode and more than 2 storage locations per DataNode. Contributed by Chris Nauroth. 2015-01-16 10:52:01 -08:00
cnauroth 9c94015e36 HDFS-7635. Remove TestCorruptFilesJsp from branch-2. Contributed by Chris Nauroth. 2015-01-16 10:39:27 -08:00
Steve Loughran 000ca83ea3 HADOOP-11261 Set custom endpoint for S3A. (Thomas Demoor via stevel) 2015-01-16 10:15:51 +00:00
Junping Du 5d1cca34fa YARN-3064. TestRMRestart/TestContainerResourceUsage/TestNodeManagerResync failure with allocation timeout. (Contributed by Jian He) 2015-01-16 00:08:36 -08:00
yliu c4ccbe62c0 HDFS-7189. Add trace spans for DFSClient metadata operations. (Colin P. McCabe via yliu) 2015-01-16 00:23:51 +08:00
Haohui Mai 3ab3a64988 HADOOP-11350. The size of header buffer of HttpServer is too small when HTTPS is enabled. Contributed by Benoy Antony. 2015-01-15 16:17:30 -08:00
Kihwal Lee 780a6bf145 HDFS-7457. DatanodeID generates excessive garbage. Contributed by Daryn Sharp. 2015-01-15 16:44:11 -06:00
Kihwal Lee 44eed6cbc9 HDFS-7615. Remove longReadLock. Contributed by Kihwal Lee. 2015-01-15 16:39:18 -06:00
Robert Kanter b6ff9c03a4 HADOOP-8757. Metrics should disallow names with invalid characters (rchiang via rkanter) 2015-01-15 11:39:43 -08:00
Jian He 9e33116d1d YARN-2861. Fixed Timeline DT secret manager to not reuse RM's configs. Contributed by Zhijie Shen 2015-01-15 11:07:43 -08:00
Arpit Agarwal a6efbb21c2 HDFS-7591. hdfs classpath command should support same options as hadoop classpath. (Contributed by Varun Saxena) 2015-01-15 11:02:17 -08:00
Akira Ajisaka ce29074685 HADOOP-11318. Update the document for hadoop fs -stat 2015-01-16 00:55:20 +09:00
Allen Wittenauer ce0117636a HDFS-7581. HDFS documentation needs updating post-shell rewrite (aw) 2015-01-15 07:48:55 -08:00
Akira Ajisaka 533e551eb4 YARN-3005. [JDK7] Use switch statement for String instead of if-else statement in RegistrySecurity.java (Contributed by Kengo Seki) 2015-01-15 21:27:39 +09:00
Akira Ajisaka db51548f70 HADOOP-11483. HardLink.java should use the jdk7 createLink method 2015-01-15 20:54:44 +09:00
Karthik Kambatla ba5116ec8e YARN-2217. [YARN-1492] Shared cache client side changes. (Chris Trezzo via kasha) 2015-01-15 14:28:44 +05:30
Colin Patrick Mccabe 5805dc0f04 Add CHANGES.txt for HADOOP-11481 2015-01-14 18:06:04 -08:00
Colin Patrick Mccabe a5a033c7ca HDFS-7067. ClassCastException while using a key created by keytool to create encryption zone. (Charles Lamb via Colin P. McCabe) 2015-01-14 17:42:59 -08:00
Tsz-Wo Nicholas Sze 6464a8929a HDFS-5782. Change BlockListAsLongs constructor to take Replica as parameter type instead of concrete classes Block and ReplicaInfo. Contributed by David Powell and Joe Pallas 2015-01-14 13:46:06 -08:00
Tsz-Wo Nicholas Sze 7fe0f25ad2 HDFS-2219. Change fsck to support fully qualified paths so that a particular namenode in a federated cluster with multiple namenodes can be specified in the path parameter. 2015-01-14 11:31:18 -08:00
Colin Patrick Mccabe 446545c496 HDFS-7585. Get TestEnhancedByteBufferAccess working on CPU architectures with page sizes other than 4096 (Sam Liu via Colin P. McCabe) 2015-01-14 11:13:55 -08:00
Xuan d15cbae73c YARN-2807. Option "--forceactive" not works as described in usage of
"yarn rmadmin -transitionToActive". Contributed by Masatake Iwasaki
2015-01-14 11:04:03 -08:00
Akira Ajisaka d336d13678 MAPREDUCE-6210. Use getApplicationAttemptId() instead of getApplicationID() for logging AttemptId in RMContainerAllocator.java (Contributed by Leitao Guo) 2015-01-14 17:38:35 +09:00
Junping Du f92e503800 YARN-3019. Make work-preserving-recovery the default mechanism for RM recovery. (Contributed by Jian He) 2015-01-13 18:20:57 -08:00
Jian He c53420f583 YARN-2637. Fixed max-am-resource-percent calculation in CapacityScheduler when activating applications. Contributed by Craig Welch 2015-01-13 17:32:07 -08:00
cnauroth 85aec75ce5 HDFS-7570. SecondaryNameNode need twice memory when calling reloadFromImageFile. Contributed by zhaoyunjiong. 2015-01-13 16:10:28 -08:00
Xuan 10ac5abb86 MAPREDUCE-6173. Document the configuration of deploying MR over
distributed cache with enabling wired encryption at the same time.
Contributed by Junping Du.
2015-01-13 10:04:31 -08:00
Konstantin V Shvachko 08ac06283a HDFS-7056. Snapshot support for truncate. Contributed by Konstantin Shvachko and Plamen Jeliazkov. 2015-01-13 00:24:23 -08:00
Plamen Jeliazkov 7e9358feb3 HDFS-3107. Introduce truncate. Contributed by Plamen Jeliazkov. 2015-01-12 22:50:04 -08:00
Arpit Agarwal c4cba6165a HADOOP-11465. Fix findbugs warnings in hadoop-gridmix. (Contributed by Varun Saxena) 2015-01-12 21:22:58 -08:00
Robert Kanter 51881535e6 YARN-2643. Don't create a new DominantResourceCalculator on every FairScheduler.allocate call. (kasha via rkanter) 2015-01-12 17:51:00 -08:00
Jing Zhao 6f3a63a41b HDFS-7600. Refine hdfs admin classes to reuse common code. Contributed by Jing Zhao. 2015-01-12 17:32:33 -08:00
Colin Patrick Mccabe f761bd8fe4 HDFS-5445. PacketReceiver populates the packetLen field in PacketHeader incorrectly (Jonathan Mace via Colin P. McCabe) 2015-01-12 17:11:03 -08:00
Colin Patrick Mccabe b3ddd7ee39 HDFS-7598. Remove dependency on old version of Guava in TestDFSClientCache#testEviction (Sangjin Lee via Colin P. McCabe) 2015-01-12 17:07:18 -08:00
Ravi Prakash f3507fa35c HADOOP-11473. test-patch says "-1 overall" even when all checks are +1
(Jason Lowe via raviprak)
2015-01-12 14:20:11 -08:00
Kihwal Lee 6bbf9fdd04 HDFS-7533. Datanode sometimes does not shutdown on receiving upgrade shutdown command. Contributed by Eric Payne. 2015-01-12 15:36:55 -06:00
Colin Patrick Mccabe b78b4a1536 HDFS-7326. Add documentation for hdfs debug commands (Vijay Bhat via Colin P. McCabe) 2015-01-12 12:16:36 -08:00
Robert Kanter f451631915 YARN-2957. Create unit test to automatically compare YarnConfiguration and yarn-default.xml. (rchiang via rkanter) 2015-01-12 12:00:30 -08:00
Robert Kanter ae7bf31fe1 YARN-3027. Scheduler should use totalAvailable resource from node instead of availableResource for maxAllocation. (adhoot via rkanter) 2015-01-12 10:47:52 -08:00
yliu 5b0d060d2a HDFS-7323. Move the get/setStoragePolicy commands out from dfsadmin. (jing9 via yliu) 2015-01-12 00:35:43 +08:00
cnauroth ef3c3a832c HDFS-7596. NameNode should prune dead storages from storageMap. Contributed by Arpit Agarwal. 2015-01-10 09:18:33 -08:00
Ravi Prakash 4d29142100 HADOOP-11400. GraphiteSink does not reconnect to Graphite after 'broken pipe'
(Kamil Gorlo via raviprak)
2015-01-10 08:35:40 -08:00
Jian He a260406268 YARN-3014. Replaces labels on a host should update all NM's labels on that host. Contributed by Wangda Tan 2015-01-09 17:49:53 -08:00
Jian He 27a489cba6 YARN-2956. Added missing links in YARN documentation. Contributed by Masatake Iwasaki 2015-01-09 17:46:36 -08:00
Jing Zhao 2a06101e61 HDFS-7182. JMX metrics aren't accessible when NN is busy. Contributed by Ming Ma. 2015-01-09 17:35:57 -08:00
Brandon Li 09d31bc630 HADOOP-9992. Modify the NN loadGenerator to optionally run as a MapReduce job. Contributed by Akshay Radia 2015-01-09 17:24:22 -08:00
cnauroth 8c3e888dcd HADOOP-11464. Reinstate support for launching Hadoop processes on Windows using Cygwin. Contributed by Chris Nauroth. 2015-01-09 15:01:50 -08:00
Allen Wittenauer ab5cd99177 YARN-3002. YARN documentation needs updating post-shell rewrite (aw) 2015-01-09 15:01:29 -08:00