Commit Graph

8058 Commits

Author SHA1 Message Date
Sanford Ryza 342da5b4d3 YARN-596. Use scheduling policies throughout the queue hierarchy to decide which containers to preempt (Wei Yan via Sandy Ryza)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598197 13f79535-47bb-0310-9956-ffa450edef68
2014-05-29 04:01:24 +00:00
Andrew Wang 66c5bcfc6d HDFS-6453. Use Time#monotonicNow to avoid system clock reset. Contributed by Liang Xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598144 13f79535-47bb-0310-9956-ffa450edef68
2014-05-28 21:24:49 +00:00
Jason Darrell Lowe 4bb4de93d6 MAPREDUCE-5862. Line records longer than 2x split size aren't handled correctly. Contributed by bc Wong
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598111 13f79535-47bb-0310-9956-ffa450edef68
2014-05-28 19:37:52 +00:00
Zhijie Shen 001078e067 YARN-2107. Refactored timeline classes into o.a.h.y.s.timeline package. Contributed by Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598094 13f79535-47bb-0310-9956-ffa450edef68
2014-05-28 18:09:04 +00:00
Colin McCabe cfd8647d0f HDFS-6448. BlockReaderLocalLegacy should set socket timeout based on conf.socketTimeout (liangxie via cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598079 13f79535-47bb-0310-9956-ffa450edef68
2014-05-28 17:44:14 +00:00
Arpit Agarwal e976652a6e HDFS-6442. Fix TestEditLogAutoroll and TestStandbyCheckpoints failure caused by port conficts. (Contributed by Zesheng Wu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598078 13f79535-47bb-0310-9956-ffa450edef68
2014-05-28 17:38:25 +00:00
Xuan Gong fc1e525da0 HADOOP-10625. Trim configuration names when putting/getting them to properties
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598072 13f79535-47bb-0310-9956-ffa450edef68
2014-05-28 17:10:36 +00:00
Sanford Ryza edfbc8ad4a YARN-2105. Fix TestFairScheduler after YARN-2012. (Ashwin Shankar via Sandy Ryza)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597902 13f79535-47bb-0310-9956-ffa450edef68
2014-05-27 23:46:22 +00:00
Brandon Li 0ec6fc9e3c HDFS-6411. nfs-hdfs-gateway mount raises I/O error and hangs when a unauthorized user attempts to access it. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597895 13f79535-47bb-0310-9956-ffa450edef68
2014-05-27 22:58:55 +00:00
Brandon Li 1c867b1de8 HDFS-6416. Use Time#monotonicNow in OpenFileCtx and OpenFileCtxCatch to avoid system clock bugs. Contributed by Abhiraj Butala
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597868 13f79535-47bb-0310-9956-ffa450edef68
2014-05-27 20:21:33 +00:00
Jing Zhao 8d9e8cec9f HDFS-6227. ShortCircuitCache#unref should purge ShortCircuitReplicas whose streams have been closed by java interrupts. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597829 13f79535-47bb-0310-9956-ffa450edef68
2014-05-27 17:21:41 +00:00
Michael Stack 1228f8f6fb HBASE-6110 adding more slow action log in critical write path (Liang Xie via stack)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597633 13f79535-47bb-0310-9956-ffa450edef68
2014-05-26 19:38:05 +00:00
Arpit Agarwal 978e3a6813 HDFS-6443. Fix MiniQJMHACluster related test failures. (Contributed by Zesheng Wu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597238 13f79535-47bb-0310-9956-ffa450edef68
2014-05-24 05:09:04 +00:00
Vinod Kumar Vavilapalli 4dd2003373 YARN-2071. Modified levelDB store permissions to be readable only by the server user. Contributed by Zhijie Shen.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597231 13f79535-47bb-0310-9956-ffa450edef68
2014-05-24 01:24:26 +00:00
Karthik Kambatla 7dd378c274 YARN-2096. Race in TestRMRestart#testQueueMetricsOnRMRestart. (Anubhav Dhoot via kasha)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597223 13f79535-47bb-0310-9956-ffa450edef68
2014-05-23 23:51:00 +00:00
Sanford Ryza a00b2d4f37 YARN-2073. Fair Scheduler: Add a utilization threshold to prevent preempting resources when cluster is free (Karthik Kambatla via Sandy Ryza)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597209 13f79535-47bb-0310-9956-ffa450edef68
2014-05-23 22:52:46 +00:00
Vinod Kumar Vavilapalli 7f0724dddb YARN-2059. Added admin ACLs support to Timeline Server. Contributed by Zhijie Shen.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597207 13f79535-47bb-0310-9956-ffa450edef68
2014-05-23 22:40:52 +00:00
Sanford Ryza 6c56612af5 YARN-2012. Fair Scheduler: allow default queue placement rule to take an arbitrary queue (Ashwin Shankar via Sandy Ryza)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597204 13f79535-47bb-0310-9956-ffa450edef68
2014-05-23 22:38:52 +00:00
Vinod Kumar Vavilapalli 892ada8fb3 YARN-1937. Added owner-only ACLs support for Timeline Client and server. Contributed by Zhijie Shen.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597186 13f79535-47bb-0310-9956-ffa450edef68
2014-05-23 21:19:15 +00:00
Vinod Kumar Vavilapalli af8b09af75 YARN-1936. Added security support for the Timeline Client. Contributed by Zhijie Shen.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597153 13f79535-47bb-0310-9956-ffa450edef68
2014-05-23 18:47:57 +00:00
Vinod Kumar Vavilapalli b867b69556 YARN-2049. Added delegation-token support for the Timeline Server. Contributed by Zhijie Shen.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597130 13f79535-47bb-0310-9956-ffa450edef68
2014-05-23 17:09:47 +00:00
Andrew Wang 1ba203e3e0 HDFS-6435. Add support for specifying a static uid/gid mapping for the NFS gateway. (atm via wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596966 13f79535-47bb-0310-9956-ffa450edef68
2014-05-22 20:44:30 +00:00
Arpit Agarwal 3c4c16a4f7 HADOOP-10618. Remove SingleNodeSetup.apt.vm (Contributed by Akira Ajisaka)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596964 13f79535-47bb-0310-9956-ffa450edef68
2014-05-22 20:41:21 +00:00
Jing Zhao 3671a5e16f MAPREDUCE-5899. Support incremental data copy in DistCp. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596931 13f79535-47bb-0310-9956-ffa450edef68
2014-05-22 18:17:11 +00:00
Jing Zhao 5b1e88b6d2 HDFS-6423. Diskspace quota usage should be updated when appending data to partial block. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596774 13f79535-47bb-0310-9956-ffa450edef68
2014-05-22 08:07:16 +00:00
Jing Zhao 752a9d84bb HDFS-6438. DeleteSnapshot should be a DELETE request in WebHdfs. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596772 13f79535-47bb-0310-9956-ffa450edef68
2014-05-22 07:30:18 +00:00
Karthik Kambatla 619ec833fc YARN-2089. FairScheduler: QueuePlacementPolicy and QueuePlacementRule are missing audience annotations. (Zhihai Xu via kasha)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596765 13f79535-47bb-0310-9956-ffa450edef68
2014-05-22 06:13:24 +00:00
Vinod Kumar Vavilapalli 82f3454f5a YARN-2017. Merged some of the common scheduler code. Contributed by Jian He.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596753 13f79535-47bb-0310-9956-ffa450edef68
2014-05-22 05:32:26 +00:00
Chris Nauroth 6b2e615f5f HDFS-6433. Replace BytesMoved class with AtomicLong. Contributed by Benoy Antony.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596742 13f79535-47bb-0310-9956-ffa450edef68
2014-05-22 04:50:53 +00:00
Chris Nauroth b2f4e53e2b HDFS-6409. Fix typo in log message about NameNode layout version upgrade. Contributed by Chen He.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596739 13f79535-47bb-0310-9956-ffa450edef68
2014-05-22 04:38:20 +00:00
Zhijie Shen 28058894dd YARN-2081. Fixed TestDistributedShell failure after YARN-1962. Contributed by Zhiguo Hong.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596724 13f79535-47bb-0310-9956-ffa450edef68
2014-05-22 01:16:14 +00:00
Andrew Wang 4dfedd81a4 HDFS-6396. Remove support for ACL feature from INodeSymlink. Contributed by Charles Lamb.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596713 13f79535-47bb-0310-9956-ffa450edef68
2014-05-22 00:10:30 +00:00
Vinod Kumar Vavilapalli fdb5870d49 YARN-1938. Added kerberos login for the Timeline Server. Contributed by Zhijie Shen.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596710 13f79535-47bb-0310-9956-ffa450edef68
2014-05-21 23:20:08 +00:00
Uma Maheswara Rao G ac23a55547 Merge HDFS-2006 HDFS XAttrs branch to Trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596575 13f79535-47bb-0310-9956-ffa450edef68
2014-05-21 13:57:33 +00:00
Arpit Agarwal 011b53be7f HADOOP-10562. Fix CHANGES.txt entry again
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596386 13f79535-47bb-0310-9956-ffa450edef68
2014-05-20 20:16:17 +00:00
Arpit Agarwal 14ff0a14f9 HADOOP-10562. Fix CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596378 13f79535-47bb-0310-9956-ffa450edef68
2014-05-20 19:28:45 +00:00
Kihwal Lee cb5682b859 HDFS-6419. TestBookKeeperHACheckpoints.TestSBNCheckpoints fails on trunk. Contributed by Akira AJISAKA.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596344 13f79535-47bb-0310-9956-ffa450edef68
2014-05-20 18:13:01 +00:00
Jing Zhao 44e9d346e9 HDFS-6432. Add snapshot related APIs to webhdfs. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596334 13f79535-47bb-0310-9956-ffa450edef68
2014-05-20 17:33:31 +00:00
Colin McCabe 668f70db66 HDFS-6421. Fix vecsum.c compile on BSD and some other systems (Mit Desai via Colin Patrick McCabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596324 13f79535-47bb-0310-9956-ffa450edef68
2014-05-20 17:19:39 +00:00
Jason Darrell Lowe 64ec743e6c YARN-2050. Fix LogCLIHelpers to create the correct FileContext. Contributed by Ming Ma
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596310 13f79535-47bb-0310-9956-ffa450edef68
2014-05-20 16:19:55 +00:00
Jason Darrell Lowe 1f8bb1001a MAPREDUCE-5309. 2.0.4 JobHistoryParser can't parse certain failed job history files generated by 2.0.3 history server. Contributed by Rushabh S Shah
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596295 13f79535-47bb-0310-9956-ffa450edef68
2014-05-20 15:46:54 +00:00
Tsz-wo Sze 0796bddd39 Add .classpath, .project and .settings to svn:ignore.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596097 13f79535-47bb-0310-9956-ffa450edef68
2014-05-20 00:46:09 +00:00
Brandon Li 674c523db1 HADOOP-10612. NFS failed to refresh the user group id mapping table. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596075 13f79535-47bb-0310-9956-ffa450edef68
2014-05-19 22:16:11 +00:00
Andrew Wang 4a839f0cc1 Fix CRLFs in TestKillAMPreemptionPolicy.java
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596058 13f79535-47bb-0310-9956-ffa450edef68
2014-05-19 21:18:55 +00:00
Jason Darrell Lowe 161dcf1d12 Updated CHANGES.txt to reflect revert of HADOOP 10474 and 10485 from branch-2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596049 13f79535-47bb-0310-9956-ffa450edef68
2014-05-19 20:37:49 +00:00
Aaron Myers bd64a2a9cd HADOOP-10489. UserGroupInformation#getTokens and UserGroupInformation#addToken can lead to ConcurrentModificationException. Contributed by Robert Kanter.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596020 13f79535-47bb-0310-9956-ffa450edef68
2014-05-19 19:56:29 +00:00
Kihwal Lee 35058fc020 HDFS-6397. NN shows inconsistent value in deadnode count. Contributed by Mohammad Kamrul Islam.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595978 13f79535-47bb-0310-9956-ffa450edef68
2014-05-19 17:52:55 +00:00
Devarajulu K f74e446355 MAPREDUCE-5867. Fix NPE in KillAMPreemptionPolicy related to ProportionalCapacityPreemptionPolicy. Contributed by Sunil G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595754 13f79535-47bb-0310-9956-ffa450edef68
2014-05-19 06:42:29 +00:00
Konstantin Boudnik 9a0ed1c4af HDFS-6325. Append should fail if the last block has insufficient number of replicas (Keith Pak via cos)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595744 13f79535-47bb-0310-9956-ffa450edef68
2014-05-19 05:24:24 +00:00
Sanford Ryza 1e4e98aa35 HADOOP-10614. CBZip2InputStream is not threadsafe (Xiangrui Meng via Sandy Ryza)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595521 13f79535-47bb-0310-9956-ffa450edef68
2014-05-17 18:04:03 +00:00