Commit Graph

6332 Commits

Author SHA1 Message Date
Tsz-wo Sze c46525ef27 Add TestOpenFilesWithSnapshot.java for HDFS-5283.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1532860 13f79535-47bb-0310-9956-ffa450edef68
2013-10-16 18:44:21 +00:00
Tsz-wo Sze ffe347151e HDFS-5283. Under construction blocks only inside snapshots should not be counted in safemode threshhold. Contributed by Vinay
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1532857 13f79535-47bb-0310-9956-ffa450edef68
2013-10-16 18:38:31 +00:00
Jing Zhao 2145486ea9 HDFS-5130. Add test for snapshot related FsShell and DFSAdmin commands. Contributed by Binglin Chang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1532580 13f79535-47bb-0310-9956-ffa450edef68
2013-10-15 22:45:08 +00:00
Brandon Li a9befa6f0a HDFS-5330. fix readdir and readdirplus for large directories. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1532539 13f79535-47bb-0310-9956-ffa450edef68
2013-10-15 21:23:00 +00:00
Sanford Ryza 6a55ed333a YARN-1295. In UnixLocalWrapperScriptBuilder, using bash -c can cause Text file busy errors. (Sandy Ryza)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1532532 13f79535-47bb-0310-9956-ffa450edef68
2013-10-15 21:14:47 +00:00
Andrew Wang 98b29a3621 HADOOP-100046. Print a log message when SSL is enabled (David S. Wang via wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1532477 13f79535-47bb-0310-9956-ffa450edef68
2013-10-15 18:35:49 +00:00
Tsz-wo Sze 0a5f0efcb4 HDFS-5338. Add a conf to disable hostname check in datanode registration.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1532468 13f79535-47bb-0310-9956-ffa450edef68
2013-10-15 18:21:22 +00:00
Devarajulu K 4407d5f65f MAPREDUCE-5518. Fixed typo "can't read paritions file". Contributed by Albert Chu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1532208 13f79535-47bb-0310-9956-ffa450edef68
2013-10-15 06:28:22 +00:00
Jing Zhao 258c181ade HDFS-5352. Server#initLog() doesn't close InputStream in httpfs. Contributed by Ted Yu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1532158 13f79535-47bb-0310-9956-ffa450edef68
2013-10-15 01:17:21 +00:00
Andrew Wang af89caf9e4 HDFS-5359. Allow LightWeightGSet#Iterator to remove elements. (Contributed by Colin Patrick McCabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1532153 13f79535-47bb-0310-9956-ffa450edef68
2013-10-15 00:19:48 +00:00
Chris Nauroth 86b5f80e8c HADOOP-10040. Correct native.vcxproj for inclusion of lz4hc.c. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1532136 13f79535-47bb-0310-9956-ffa450edef68
2013-10-14 23:31:08 +00:00
Andrew Wang efe545b0c2 HDFS-5358. Add replication field to PathBasedCacheDirective. (Contributed by Colin Patrick McCabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1532124 13f79535-47bb-0310-9956-ffa450edef68
2013-10-14 22:56:11 +00:00
Colin McCabe 15d08c4778 HDFS-5349. DNA_CACHE and DNA_UNCACHE should be by blockId only (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1532116 13f79535-47bb-0310-9956-ffa450edef68
2013-10-14 22:19:10 +00:00
Sanford Ryza 989db9ee55 YARN-1182. MiniYARNCluster creates and inits the RM/NM only on start() (Karthik Kambatla via Sandy Ryza)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1532109 13f79535-47bb-0310-9956-ffa450edef68
2013-10-14 21:42:31 +00:00
Sanford Ryza cd7e7c3cdd YARN-1259. In Fair Scheduler web UI, queue num pending and num active apps switched. (Robert Kanter via Sandy Ryza)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1532094 13f79535-47bb-0310-9956-ffa450edef68
2013-10-14 21:06:01 +00:00
Jing Zhao cf0cf0a691 HDFS-5342. Provide more information in the FSNamesystem JMX interfaces. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1532090 13f79535-47bb-0310-9956-ffa450edef68
2013-10-14 20:56:37 +00:00
Chris Nauroth ed45d97ed7 MAPREDUCE-5546. mapred.cmd on Windows set HADOOP_OPTS incorrectly. Contributed by Chuan Liu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1532016 13f79535-47bb-0310-9956-ffa450edef68
2013-10-14 18:36:34 +00:00
Jonathan Turner Eagles 87d7fae5c6 HADOOP-9494. Excluded auto-generated and examples code from clover reports (Andrey Klochkov via jeagles)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1532013 13f79535-47bb-0310-9956-ffa450edef68
2013-10-14 18:25:04 +00:00
Chris Nauroth edabf898d7 HADOOP-10040. Correct merge error on native.vcxproj. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531994 13f79535-47bb-0310-9956-ffa450edef68
2013-10-14 17:43:06 +00:00
Chris Nauroth cb26a58c2a HADOOP-10040. svn propset to native line endings on Windows files. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531983 13f79535-47bb-0310-9956-ffa450edef68
2013-10-14 17:13:38 +00:00
Chris Nauroth 11716cf390 HADOOP-10040. Revert svn propset for CRLF line endings on Windows files. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531977 13f79535-47bb-0310-9956-ffa450edef68
2013-10-14 17:01:33 +00:00
Sanford Ryza 6a1929fe31 MAPREDUCE-5463. Deprecate SLOTS_MILLIS counters. (Tzuyoshi Ozawa via Sandy Ryza)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531822 13f79535-47bb-0310-9956-ffa450edef68
2013-10-14 09:11:23 +00:00
Sanford Ryza 2caa899882 YARN-305. Fair scheduler logs too many "Node offered to app" messages. (Lohit Vijayarenu via Sandy Ryza)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531817 13f79535-47bb-0310-9956-ffa450edef68
2013-10-14 08:51:34 +00:00
Siddharth Seth f2745babf3 MAPREDUCE-5329. Allow MR applications to use additional AuxServices, which are compatible with the default MapReduce shuffle. Contributed by Avner BenHanoch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531741 13f79535-47bb-0310-9956-ffa450edef68
2013-10-13 20:17:53 +00:00
Brandon Li 7cd044b1aa HDFS-5329. Update FSNamesystem#getListing() to handle inode path in startAfter token. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531617 13f79535-47bb-0310-9956-ffa450edef68
2013-10-13 04:28:49 +00:00
Luke Lu b83364d1c7 Workaround git eol hell
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531501 13f79535-47bb-0310-9956-ffa450edef68
2013-10-12 04:55:06 +00:00
Luke Lu 0840906699 Fix typo (HDFS-5276 -> HDFS-5267) in CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531500 13f79535-47bb-0310-9956-ffa450edef68
2013-10-12 04:54:58 +00:00
Chris Nauroth bbac0cf05e HADOOP-10040. hadoop.cmd in UNIX format and would not run by default on Windows. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531491 13f79535-47bb-0310-9956-ffa450edef68
2013-10-12 03:14:24 +00:00
Andrew Wang 09e9e57a0b HDFS-5348. Fix error message when dfs.datanode.max.locked.memory is improperly configured. (Contributed by Colin Patrick McCabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1531460 13f79535-47bb-0310-9956-ffa450edef68
2013-10-11 23:13:13 +00:00
Sanford Ryza 5bed5bb829 YARN-1044. used/min/max resources do not display info in the scheduler page (Sangjin Lee via Sandy Ryza)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531447 13f79535-47bb-0310-9956-ffa450edef68
2013-10-11 22:13:57 +00:00
Jing Zhao f7eaacc103 HDFS-5322. HDFS delegation token not found in cache errors seen on secure HA clusters. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531436 13f79535-47bb-0310-9956-ffa450edef68
2013-10-11 21:49:01 +00:00
Sanford Ryza 335923be6f Delete fair-scheduler-allocation.xml for YARN-1300
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531425 13f79535-47bb-0310-9956-ffa450edef68
2013-10-11 21:25:59 +00:00
Sanford Ryza 156b9f2e88 YARN-1300. SLS tests fail because conf puts YARN properties in fair-scheduler.xml (Ted Yu via Sandy Ryza)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531423 13f79535-47bb-0310-9956-ffa450edef68
2013-10-11 21:18:48 +00:00
Chris Nauroth 8111c3af6b HDFS-5224. Refactor PathBasedCache* methods to use a Path rather than a String. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1531406 13f79535-47bb-0310-9956-ffa450edef68
2013-10-11 19:44:20 +00:00
Luke Lu 1d07c5cf17 Move HDFS-5276 to 2.3.0 in CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531228 13f79535-47bb-0310-9956-ffa450edef68
2013-10-11 08:31:34 +00:00
Luke Lu d0aaa5ba9f HDFS-5276. Remove volatile from LightWeightHashSet. (Junping Du via llu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531225 13f79535-47bb-0310-9956-ffa450edef68
2013-10-11 08:29:06 +00:00
Luke Lu 735d8b27f7 YARN-7. Support CPU resource for DistributedShell. (Junping Du via llu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531222 13f79535-47bb-0310-9956-ffa450edef68
2013-10-11 08:18:57 +00:00
Jing Zhao 0387ec792f HADOOP-10039. Add Hive to the list of projects using AbstractDelegationTokenSecretManager. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531158 13f79535-47bb-0310-9956-ffa450edef68
2013-10-11 01:25:01 +00:00
Suresh Srinivas f2f5cdb555 HDFS-5335. Hive query failed with possible race in dfs output stream. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531152 13f79535-47bb-0310-9956-ffa450edef68
2013-10-10 23:58:08 +00:00
Sanford Ryza f218527fff YARN-1265. Fair Scheduler chokes on unhealthy node reconnect (Sandy Ryza)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531146 13f79535-47bb-0310-9956-ffa450edef68
2013-10-10 22:49:56 +00:00
Suresh Srinivas 4f0089621c HADOOP-10029. Specifying har file to MR job fails in secure cluster. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531125 13f79535-47bb-0310-9956-ffa450edef68
2013-10-10 21:55:38 +00:00
Devarajulu K 22b332ff46 YARN-879. Fixed tests w.r.t o.a.h.y.server.resourcemanager.Application. Contributed by Junping Du.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530902 13f79535-47bb-0310-9956-ffa450edef68
2013-10-10 09:47:11 +00:00
Brandon Li 7429debd86 HDFS-5337. should do hsync for a commit request even there is no pending writes. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530835 13f79535-47bb-0310-9956-ffa450edef68
2013-10-10 00:52:54 +00:00
Chris Nauroth a75794567b HADOOP-10031. FsShell -get/copyToLocal/moveFromLocal should support Windows local path. Contributed by Chuan Liu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530823 13f79535-47bb-0310-9956-ffa450edef68
2013-10-09 22:57:59 +00:00
Vinod Kumar Vavilapalli 9b9ddf29e2 YARN-1283. Fixed RM to give a fully-qualified proxy URL for an application so that clients don't need to do scheme-mangling. Contributed by Omkar Vinit Joshi.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530819 13f79535-47bb-0310-9956-ffa450edef68
2013-10-09 22:49:06 +00:00
Jason Darrell Lowe 00395a0064 MAPREDUCE-5102. fix coverage org.apache.hadoop.mapreduce.lib.db and org.apache.hadoop.mapred.lib.db. Contributed by Aleksey Gorshkov, Andrey Klochkov, and Nathan Roberts
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530816 13f79535-47bb-0310-9956-ffa450edef68
2013-10-09 22:39:39 +00:00
Colin McCabe b8ae4e2a8e HDFS-5323. Remove some deadcode in BlockManager (Colin Patrick McCabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530814 13f79535-47bb-0310-9956-ffa450edef68
2013-10-09 22:27:27 +00:00
Andrew Wang 3fc8792b5c HDFS-5304. Expose if a block replica is cached in getFileBlockLocations. (Contributed by Andrew Wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1530802 13f79535-47bb-0310-9956-ffa450edef68
2013-10-09 21:30:08 +00:00
Alejandro Abdelnur a184fceddc Amending yarn CHANGES.txt moving YARN-1284 to 2.2.1
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530716 13f79535-47bb-0310-9956-ffa450edef68
2013-10-09 17:11:37 +00:00
Jason Darrell Lowe 7b7caa1e56 MAPREDUCE-5569. FloatSplitter is not generating correct splits. Contributed by Nathan Roberts
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530683 13f79535-47bb-0310-9956-ffa450edef68
2013-10-09 15:43:36 +00:00