Commit Graph

3184 Commits

Author SHA1 Message Date
Siddharth Seth 00874120d2 merge YARN-29 from trunk. Add a yarn-client module. (Contributed by Vinod Kumar Vavilapalli)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1377782 13f79535-47bb-0310-9956-ffa450edef68
2012-08-27 18:30:42 +00:00
Eli Collins 0e5d96e3ee HDFS-3731. Release upgrade must handle blocks being written from 1.0. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1377548 13f79535-47bb-0310-9956-ffa450edef68
2012-08-27 01:07:04 +00:00
Eli Collins 804c45867a HDFS-3853. Port MiniDFSCluster enableManagedDfsDirsRedundancy. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1377545 13f79535-47bb-0310-9956-ffa450edef68
2012-08-27 00:11:39 +00:00
Aaron Myers 6cac9aa7f9 HDFS-3683. Edit log replay progress indicator shows >100% complete. Contributed by Plamen Jeliazkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1377368 13f79535-47bb-0310-9956-ffa450edef68
2012-08-26 00:32:08 +00:00
Siddharth Seth bf08346d3c merge YARN-39 from trunk. RM-NM secret-keys should be randomly generated and rolled every so often. (Contributed by Vinod Kumar Vavilapalli and Siddharth Seth)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1377181 13f79535-47bb-0310-9956-ffa450edef68
2012-08-25 02:25:12 +00:00
Suresh Srinivas 5998a179b4 HDFS-3844. Merge change 1377168 from trunk. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1377176 13f79535-47bb-0310-9956-ffa450edef68
2012-08-25 01:23:52 +00:00
Alejandro Abdelnur 2ff2b79e33 MAPREDUCE-4408. allow jobs to set a JAR that is in the distributed cached (rkanter via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1377150 13f79535-47bb-0310-9956-ffa450edef68
2012-08-24 23:38:21 +00:00
Tsz-wo Sze a26cfc347f svn merge -c 1376928 from trunk for HDFS-3177. Update DFSClient and DataXceiver to handle different checkum types in file checksum computation.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376937 13f79535-47bb-0310-9956-ffa450edef68
2012-08-24 14:24:59 +00:00
Robert Joseph Evans 6175155cf4 svn merge -c 1376929 FIXES: HADOOP-8725. MR is broken when security is off (daryn via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376931 13f79535-47bb-0310-9956-ffa450edef68
2012-08-24 14:17:45 +00:00
Alejandro Abdelnur 76755a9374 HADOOP-8031. Configuration class fails to find embedded .jar resources; should use URL.openStream() (genman via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376775 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 23:28:50 +00:00
Alejandro Abdelnur eb04620e43 HADOOP-4572. Can not access user logs - Jetty is not configured by default to serve aliases/symlinks (ahmed via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376755 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 22:54:24 +00:00
Eli Collins f068e8db4b Revert HDFS-3837. Fix DataNode.recoverBlock findbugs warning.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376702 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 21:09:23 +00:00
Eli Collins 7f16809a3b Amend previous commit to remove TestFileCreationNamenodeRestart.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376699 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 21:03:25 +00:00
Eli Collins 7138f2b44f HDFS-3715. Fix TestFileCreation#testFileCreationNamenodeRestart. Contributed by Andrew Wang
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376692 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 20:52:30 +00:00
Robert Joseph Evans dc0376d6c5 svn merge -c 1376653 FIXES: HADOOP-8709. globStatus changed behavior from 0.20/1.x (Jason Lowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376655 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 19:19:19 +00:00
Aaron Myers 6b62c018e3 MAPREDUCE-2374. "Text File Busy" errors launching MR tasks. Contributed by Andy Isaacson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376634 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 18:25:10 +00:00
Robert Joseph Evans bc5f02bac0 svn merge -c 1376618 FIXES: HADOOP-8225. DistCp fails when invoked by Oozie (daryn via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376621 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 18:07:59 +00:00
Robert Joseph Evans 16ca767f0f svn merge -c 1376592 FIXES: HADOOP-8655. Fix TextInputFormat for large deliminators. (Gelesh via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376594 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 16:59:26 +00:00
Robert Joseph Evans 4219f17597 svn merge -c 1376543 FIXES: HADOOP-8632. Configuration leaking class-loaders (Costin Leau via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376546 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 15:26:42 +00:00
Jitendra Nath Pandey 041a1e0a52 Merged from trunk for HDFS-3819.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376360 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 04:05:12 +00:00
Alejandro Abdelnur 6e831b0f5e MAPREDUCE-4470. Fix TestCombineFileInputFormat.testForEmptyFile (ikatsov via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376326 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 00:24:36 +00:00
Eli Collins 135a721b0f HADOOP-8075. Lower native-hadoop library log from info to debug. Contributed by Hızır Sefa İrken
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376323 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 00:01:35 +00:00
Aaron Myers 0490537635 MAPREDUCE-4577. HDFS-3672 broke TestCombineFileInputFormat.testMissingBlocks() test. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376298 13f79535-47bb-0310-9956-ffa450edef68
2012-08-22 22:45:30 +00:00
Alejandro Abdelnur d7a90bc552 MAPREDUCE-4068. Jars in lib subdirectory of the submittable JAR are not added to the classpath (rkanter via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376255 13f79535-47bb-0310-9956-ffa450edef68
2012-08-22 21:23:09 +00:00
Aaron Myers e6bb7bf1a8 HADOOP-8721. ZKFC should not retry 45 times when attempting a graceful fence during a failover. Contributed by Vinayakumar B.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376195 13f79535-47bb-0310-9956-ffa450edef68
2012-08-22 18:56:02 +00:00
Aaron Myers 4e75deb4e7 HDFS-3835. Long-lived 2NN cannot perform a checkpoint if security is enabled and the NN restarts with outstanding delegation tokens. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376189 13f79535-47bb-0310-9956-ffa450edef68
2012-08-22 18:48:32 +00:00
Suresh Srinivas 8c28ebabcd HDFS-3832. Merging change 1376139 from trunk to branch-2. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376145 13f79535-47bb-0310-9956-ffa450edef68
2012-08-22 17:05:38 +00:00
Eli Collins 8340bb151e HDFS-3837. Fix DataNode.recoverBlock findbugs warning. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376130 13f79535-47bb-0310-9956-ffa450edef68
2012-08-22 16:28:22 +00:00
Eli Collins 1a6cb06197 HADOOP-8720. TestLocalFileSystem should use test root subdirectory. Contributed by Vlad Rozov
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376124 13f79535-47bb-0310-9956-ffa450edef68
2012-08-22 16:22:55 +00:00
Eli Collins 095553e7a6 HDFS-3830. test_libhdfs_threaded: use forceNewInstance. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376122 13f79535-47bb-0310-9956-ffa450edef68
2012-08-22 16:19:43 +00:00
Siddharth Seth d5190bbe00 merge YARN-22 from trunk. Fix ContainerLogs to work if the log-dir is specified as a URI. (Contributed by Mayank Bansal)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1375831 13f79535-47bb-0310-9956-ffa450edef68
2012-08-21 22:28:58 +00:00
Suresh Srinivas 63810d26ae HDFS-2686. Merging change 1375800 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1375806 13f79535-47bb-0310-9956-ffa450edef68
2012-08-21 21:33:17 +00:00
Robert Joseph Evans 1ee0c23b39 svn merge -c 1375687 FIXES: MAPREDUCE-4570. ProcfsBasedProcessTree#constructProcessInfo() prints a warning if procfsDir/<pid>/stat is not found. (Ahmed Radwan via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1375691 13f79535-47bb-0310-9956-ffa450edef68
2012-08-21 17:47:08 +00:00
Robert Joseph Evans f3f8edbd10 svn merge -c 1375602 FIXES: MAPREDUCE-3506. Calling getPriority on JobInfo after parsing a history log with JobHistoryParser throws a NullPointerException (Jason Lowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1375604 13f79535-47bb-0310-9956-ffa450edef68
2012-08-21 15:21:30 +00:00
Tsz-wo Sze c0b9b996f9 svn merge -c 1375450 from trunk for HADOOP-8239. Add subclasses of MD5MD5CRC32FileChecksum to support file checksum with CRC32C.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1375453 13f79535-47bb-0310-9956-ffa450edef68
2012-08-21 09:49:00 +00:00
Eli Collins 08bd69a851 HDFS-2727. libhdfs should get the default block size from the server. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1375384 13f79535-47bb-0310-9956-ffa450edef68
2012-08-21 03:49:28 +00:00
Eli Collins 566f3d5917 HDFS-3707. TestFSInputChecker: improper use of skip. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1375338 13f79535-47bb-0310-9956-ffa450edef68
2012-08-21 00:01:43 +00:00
Eli Collins c2a3da8fce HADOOP-8686. Fix warnings in native code. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1375311 13f79535-47bb-0310-9956-ffa450edef68
2012-08-20 23:22:28 +00:00
Eli Collins fbc102e94f HADOOP-8614. IOUtils#skipFully hangs forever on EOF. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1375255 13f79535-47bb-0310-9956-ffa450edef68
2012-08-20 21:50:27 +00:00
Robert Joseph Evans e8e50e50ad svn merge -c 1375221 FIXES: HADOOP-8611. Allow fall-back to the shell-based implementation when JNI-based users-group mapping fails (Robert Parker via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1375222 13f79535-47bb-0310-9956-ffa450edef68
2012-08-20 21:18:49 +00:00
Jonathan Turner Eagles 9f82b74cbe svn merge -c 1375164 from trunk FIXES: MAPREDUCE-4323. NM leaks filesystems (Jason Lowe via jeagles)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1375178 13f79535-47bb-0310-9956-ffa450edef68
2012-08-20 19:32:11 +00:00
Thomas Graves d6c75fbbb1 merge -r 1375082:1375083 from trunk. FIXES: YARN-27
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1375084 13f79535-47bb-0310-9956-ffa450edef68
2012-08-20 16:06:25 +00:00
Thomas Graves 8a5ab9229d merge -r 1375065:1375066 from trunk. FIXES: YARN-27
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1375067 13f79535-47bb-0310-9956-ffa450edef68
2012-08-20 15:37:43 +00:00
Tsz-wo Sze fa76c71e62 svn merge -c 1374696 from trunk for HADOOP-8240. Add a new API to allow users to specify a checksum type on FileSystem.create(..).
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1374697 13f79535-47bb-0310-9956-ffa450edef68
2012-08-19 05:51:37 +00:00
Suresh Srinivas b082909c32 HDFS-3816. Merging 1374645 from trunk to branch-2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1374648 13f79535-47bb-0310-9956-ffa450edef68
2012-08-18 19:57:36 +00:00
Eli Collins 5eebedb974 HADOOP-8710. Remove ability for users to easily run the trash emptier. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1374477 13f79535-47bb-0310-9956-ffa450edef68
2012-08-17 23:27:50 +00:00
Eli Collins 7da3b52623 HADOOP-8689. Make trash a server side configuration option. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1374474 13f79535-47bb-0310-9956-ffa450edef68
2012-08-17 23:24:36 +00:00
Thomas Graves 6657f195a2 merge -r 1374446:1374447 from trunk. FIXES: HADOOP-8695
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1374449 13f79535-47bb-0310-9956-ffa450edef68
2012-08-17 21:44:35 +00:00
Thomas Graves e94632c765 merge -r 1374423:1374424 from trunk. FIXES: YARN-25
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1374425 13f79535-47bb-0310-9956-ffa450edef68
2012-08-17 20:31:09 +00:00
Aaron Myers 8ab1c7a47b HDFS-3672. Expose disk-location information for blocks to enable better scheduling. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1374359 13f79535-47bb-0310-9956-ffa450edef68
2012-08-17 17:03:32 +00:00