Commit Graph

6668 Commits

Author SHA1 Message Date
Alejandro Abdelnur 3a6f8b8785 MAPREDUCE-5724. JobHistoryServer does not start if HDFS is not running. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558852 13f79535-47bb-0310-9956-ffa450edef68
2014-01-16 17:10:20 +00:00
Jing Zhao e02ded811f HDFS-5777. Update LayoutVersion for the new editlog op OP_ADD_BLOCK. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558675 13f79535-47bb-0310-9956-ffa450edef68
2014-01-16 02:28:10 +00:00
Brandon Li a506df8e48 HDFS-5775. Consolidate the code for serialization in CacheManager. Contributed by Haohui Mai
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558599 13f79535-47bb-0310-9956-ffa450edef68
2014-01-15 23:15:24 +00:00
Brandon Li ca5d73d1ab HDFS-5768. Consolidate the serialization code in DelegationTokenSecretManager. Contributed by Haohui Mai
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558598 13f79535-47bb-0310-9956-ffa450edef68
2014-01-15 23:11:01 +00:00
Sanford Ryza 7274b5ff93 YARN-1351. Invalid string format in Fair Scheduler log warn message (Konstantin Weitz via Sandy Ryza)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558597 13f79535-47bb-0310-9956-ffa450edef68
2014-01-15 23:09:32 +00:00
Brandon Li 51a9755794 Fix CHANGE.txt for the contributor's name
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558578 13f79535-47bb-0310-9956-ffa450edef68
2014-01-15 21:53:47 +00:00
Brandon Li d3cb721ce0 HADOOP-10125. no need to process RPC request if the client connection has been dropped. Contributed by Min Ma
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558575 13f79535-47bb-0310-9956-ffa450edef68
2014-01-15 21:51:55 +00:00
Colin McCabe c3b236ce5d HDFS-5766. In DFSInputStream, do not add datanode to deadNodes after InvalidEncryptionKeyException in fetchBlockByteRange (Liang Xie via Colin Patrick McCabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558536 13f79535-47bb-0310-9956-ffa450edef68
2014-01-15 19:23:31 +00:00
Colin McCabe 037a89abc5 HDFS-5762. BlockReaderLocal does not return -1 on EOF when doing zero-length reads (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558526 13f79535-47bb-0310-9956-ffa450edef68
2014-01-15 19:17:50 +00:00
Suresh Srinivas 349f25a132 HADOOP-10236. Fix typo in o.a.h.ipc.Client#checkResponse. Contributed by Akira Ajisaka.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558498 13f79535-47bb-0310-9956-ffa450edef68
2014-01-15 18:27:59 +00:00
Alejandro Abdelnur 0ff3d6397e YARN-1601. 3rd party JARs are missing from hadoop-dist output. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558465 13f79535-47bb-0310-9956-ffa450edef68
2014-01-15 17:00:36 +00:00
Junping Du 4d413350d7 YARN-1603. Remove two *.orig files which were unexpectedly committed. (Zhijie Shen via junping_du)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558340 13f79535-47bb-0310-9956-ffa450edef68
2014-01-15 11:05:15 +00:00
Junping Du 2400f79db0 svn merge -c -1558337 . for reverting YARN-1603, which only partly committed.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558339 13f79535-47bb-0310-9956-ffa450edef68
2014-01-15 11:02:23 +00:00
Junping Du 5ed1772f38 YARN-1603. Remove two *.orig files which were unexpectedly committed. (Zhijie Shen via junping_du)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558337 13f79535-47bb-0310-9956-ffa450edef68
2014-01-15 10:19:28 +00:00
Chris Nauroth a913cdb398 HADOOP-10234. "hadoop.cmd jar" does not propagate exit code. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558296 13f79535-47bb-0310-9956-ffa450edef68
2014-01-15 05:45:24 +00:00
Jing Zhao 578dae9ef3 HDFS-5704. Change OP_UPDATE_BLOCKS with a new OP_ADD_BLOCK. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558255 13f79535-47bb-0310-9956-ffa450edef68
2014-01-15 01:06:53 +00:00
Karthik Kambatla d13c2eeca6 YARN-1598. HA-related rmadmin commands don't work on a secure cluster (kasha)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558251 13f79535-47bb-0310-9956-ffa450edef68
2014-01-15 00:57:28 +00:00
Sanford Ryza f4fd050dee YARN-1567. In Fair Scheduler, allow empty queues to change between leaf and parent on allocation file reload (Sandy Ryza)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558228 13f79535-47bb-0310-9956-ffa450edef68
2014-01-14 22:33:56 +00:00
Konstantin Boudnik 4b16c2b65e HDFS-5677. Need error checking for HA cluster configuration. Contributed by Vincent Sheffer.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558217 13f79535-47bb-0310-9956-ffa450edef68
2014-01-14 21:59:51 +00:00
Konstantin Boudnik 0b6a236258 Adding 2.0.6-alpha release to the CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558215 13f79535-47bb-0310-9956-ffa450edef68
2014-01-14 21:49:59 +00:00
Chris Nauroth 782a223add HADOOP-10228. FsPermission#fromShort() should cache FsAction.values(). Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558139 13f79535-47bb-0310-9956-ffa450edef68
2014-01-14 18:20:18 +00:00
Jing Zhao e210519d32 HDFS-5579. Under construction files make DataNode decommission take very long hours. Contributed by zhaoyunjiong.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1557904 13f79535-47bb-0310-9956-ffa450edef68
2014-01-14 02:02:15 +00:00
Jing Zhao e06ae2d567 HDFS-5710. FSDirectory#getFullPathName should check inodes against null. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1557803 13f79535-47bb-0310-9956-ffa450edef68
2014-01-13 18:37:56 +00:00
Vinod Kumar Vavilapalli 7c8b654ba5 YARN-888. Cleaned up POM files so that non-leaf modules don't include any dependencies and thus compact the dependency list for leaf modules. Contributed by Alejandro Abdelnur.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1557801 13f79535-47bb-0310-9956-ffa450edef68
2014-01-13 18:34:02 +00:00
Alejandro Abdelnur bc2a443418 HADOOP-10223. MiniKdc#main() should close the FileReader it creates. (Ted Yu via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1557627 13f79535-47bb-0310-9956-ffa450edef68
2014-01-12 23:24:37 +00:00
Vinod Kumar Vavilapalli aa0c489a28 YARN-1566. Changed Distributed Shell to retain containers across application attempts. Contributed by Jian He.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1557322 13f79535-47bb-0310-9956-ffa450edef68
2014-01-11 07:42:16 +00:00
Vinod Kumar Vavilapalli 25bc68d15e YARN-1041. Added the ApplicationMasterProtocol API for applications to use the ability in ResourceManager to optionally not kill containers when the ApplicationMaster exits. Contributed by Jian He.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1557318 13f79535-47bb-0310-9956-ffa450edef68
2014-01-11 07:07:17 +00:00
Jian He f677175f35 YARN-1166. Fixed app-specific and attempt-specific QueueMetrics to be triggered by accordingly app event and attempt event. Contributed by Zhijie Shen
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1557296 13f79535-47bb-0310-9956-ffa450edef68
2014-01-11 01:15:49 +00:00
Arpit Agarwal 9d382a4174 HDFS-5747. Fix NPEs in BlockManager. (Arpit Agarwal)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1557289 13f79535-47bb-0310-9956-ffa450edef68
2014-01-11 00:05:55 +00:00
Karthik Kambatla 6608b75829 YARN-1574. RMDispatcher should be reset on transition to standby. (Xuan Gong via kasha)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1557248 13f79535-47bb-0310-9956-ffa450edef68
2014-01-10 20:15:00 +00:00
Andrew Wang 7354547a02 HDFS-5756. hadoopRzOptionsSetByteBufferPool does not accept NULL argument, contrary to docs. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1557244 13f79535-47bb-0310-9956-ffa450edef68
2014-01-10 20:10:44 +00:00
Chris Nauroth 8e0ba42df4 HADOOP-10178. Configuration deprecation always emit "deprecated" warnings when a new key is used. Contributed by Shanyu Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1557236 13f79535-47bb-0310-9956-ffa450edef68
2014-01-10 19:57:51 +00:00
Karthik Kambatla a0ecb98a77 YARN-1033. Expose RM active/standby state to Web UI and REST API (kasha)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1557181 13f79535-47bb-0310-9956-ffa450edef68
2014-01-10 16:35:52 +00:00
Vinod Kumar Vavilapalli 1393581bce YARN-1490. Introduced the ability to make ResourceManager optionally not kill all containers when an ApplicationMaster exits. Contributed by Jian He.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1557143 13f79535-47bb-0310-9956-ffa450edef68
2014-01-10 15:04:39 +00:00
Karthik Kambatla 3f9828851a YARN-1579. ActiveRMInfoProto fields should be optional (kasha)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1557001 13f79535-47bb-0310-9956-ffa450edef68
2014-01-10 00:49:15 +00:00
Andrew Wang ed3f1454ec HADOOP-9420. Add percentile or max metric for rpcQueueTime, processing time. Contributed by Liang Xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556983 13f79535-47bb-0310-9956-ffa450edef68
2014-01-09 23:41:41 +00:00
Chris Nauroth 8b2c8a657e YARN-1138. yarn.application.classpath is set to point to etc., which does not work on Windows. Contributed by Chuan Liu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556978 13f79535-47bb-0310-9956-ffa450edef68
2014-01-09 23:04:18 +00:00
Kihwal Lee b4d6c5823b HDFS-5449. WebHdfs compatibility broken between 2.2 and 1.x / 23.x. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556927 13f79535-47bb-0310-9956-ffa450edef68
2014-01-09 19:24:07 +00:00
Junping Du 7186000367 HDFS-5721. sharedEditsImage in Namenode#initializeSharedEdits() should be closed before method returns. (Ted Yu via junping_du)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556803 13f79535-47bb-0310-9956-ffa450edef68
2014-01-09 13:33:08 +00:00
Karthik Kambatla 519d5d3014 HADOOP-10214. Fix multithreaded correctness warnings in ActiveStandbyElector (Liang Xie via kasha)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556734 13f79535-47bb-0310-9956-ffa450edef68
2014-01-09 06:34:54 +00:00
Colin McCabe fbf1227008 HADOOP-10207. TestUserGroupInformation#testLogin is flaky (jxiang via cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556664 13f79535-47bb-0310-9956-ffa450edef68
2014-01-08 23:06:34 +00:00
Jing Zhao 963e174276 HADOOP-10208. Remove duplicate initialization in StringUtils.getStringCollection. Contributed by Benoy Antony.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556602 13f79535-47bb-0310-9956-ffa450edef68
2014-01-08 18:36:15 +00:00
Karthik Kambatla 49ec397340 YARN-1568. Rename clusterid to clusterId in ActiveRMInfoProto (kasha)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556435 13f79535-47bb-0310-9956-ffa450edef68
2014-01-08 03:30:49 +00:00
Jing Zhao 076ecf79ca HDFS-5726. Fix compilation error in AbstractINodeDiff for JDK7. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556433 13f79535-47bb-0310-9956-ffa450edef68
2014-01-08 03:19:41 +00:00
Brandon Li 1be8ee2424 HDFS-5649. Unregister NFS and Mount service when NFS gateway is shutting down. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556405 13f79535-47bb-0310-9956-ffa450edef68
2014-01-07 23:43:04 +00:00
Colin McCabe 53b27fc60b HDFS-5724. modifyCacheDirective logging audit log command wrongly as addCacheDirective (Uma Maheswara Rao G via Colin Patrick McCabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556386 13f79535-47bb-0310-9956-ffa450edef68
2014-01-07 22:27:06 +00:00
Vinod Kumar Vavilapalli 4931545f76 YARN-1482. Modified WebApplicationProxy to make it work across ResourceManager fail-over. Contributed by Xuan Gong.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556380 13f79535-47bb-0310-9956-ffa450edef68
2014-01-07 22:16:30 +00:00
Jing Zhao 70cff9e2f0 HDFS-5715. Use Snapshot ID to indicate the corresponding Snapshot for a FileDiff/DirectoryDiff. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556353 13f79535-47bb-0310-9956-ffa450edef68
2014-01-07 20:52:48 +00:00
Jian He 332c2704d4 YARN-1293. Fixed TestContainerLaunch#testInvalidEnvSyntaxDiagnostics failure caused by non-English system locale. Contributed by Tsuyoshi OZAWA.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556318 13f79535-47bb-0310-9956-ffa450edef68
2014-01-07 19:00:21 +00:00
Jason Darrell Lowe 785c12056c YARN-1409. NonAggregatingLogHandler can throw RejectedExecutionException. Contributed by Tsuyoshi OZAWA
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556282 13f79535-47bb-0310-9956-ffa450edef68
2014-01-07 17:11:09 +00:00