Commit Graph

3226 Commits

Author SHA1 Message Date
Eli Collins 2715385c4e HDFS-4018. TestDataNodeMultipleRegistrations#testMiniDFSClusterWithMultipleNN is missing some cluster cleanup. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1395822 13f79535-47bb-0310-9956-ffa450edef68
2012-10-09 00:22:37 +00:00
Vinod Kumar Vavilapalli 1b099a7cbf YARN-40. Fixed CHANGES.txt from previous commit.
svn merge --ignore-ancestry -c 1395799 ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1395800 13f79535-47bb-0310-9956-ffa450edef68
2012-10-08 22:36:47 +00:00
Vinod Kumar Vavilapalli 8792f157a4 YARN-40. Provided support for missing YARN commands Contributed by Devaraj K and Vinod Kumar Vavilapalli.
svn merge --ignore-ancestry -c 1395793 ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1395794 13f79535-47bb-0310-9956-ffa450edef68
2012-10-08 22:19:43 +00:00
Aaron Myers c5fc614266 Revert initial commit of HADOOP-8884 per feedback from Todd.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1395784 13f79535-47bb-0310-9956-ffa450edef68
2012-10-08 21:26:43 +00:00
Vinod Kumar Vavilapalli 59da1ac1fc YARN-127. Move RMAdmin tool to its correct location - the client module. Contributed by Vinod Kumar Vavilapalli.
svn merge --ignore-ancestry -c 1395781 ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1395782 13f79535-47bb-0310-9956-ffa450edef68
2012-10-08 21:24:37 +00:00
Robert Joseph Evans 09f0aee7f8 svn merge -c 1395769 FIXES: MAPREDUCE-4554. Job Credentials are not transmitted if security is turned off (Benoy Antony via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1395772 13f79535-47bb-0310-9956-ffa450edef68
2012-10-08 20:55:21 +00:00
Todd Lipcon 88a3f46ddb HDFS-4007. Rehabilitate bit-rotted unit tests under hadoop-hdfs-project/hadoop-hdfs/src/test/unit/. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1395730 13f79535-47bb-0310-9956-ffa450edef68
2012-10-08 19:19:13 +00:00
Thomas Graves 279d3cc66a merge -r 1394608:1394609 from trunk. FIXES: MAPREDUCE-4712
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1395726 13f79535-47bb-0310-9956-ffa450edef68
2012-10-08 19:04:43 +00:00
Aaron Myers 35ee354a81 HADOOP-8884. DEBUG should be WARN for DEBUG util.NativeCodeLoader: Failed to load native-hadoop with error: java.lang.UnsatisfiedLinkError. Contributed by Anthony Rojas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1395718 13f79535-47bb-0310-9956-ffa450edef68
2012-10-08 18:46:15 +00:00
Eli Collins 67360e4545 HADOOP-8804. Improve Web UIs when the wildcard address is used. Contributed by Senthil Kumar
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1395704 13f79535-47bb-0310-9956-ffa450edef68
2012-10-08 18:21:09 +00:00
Eli Collins 2a2fec7128 HDFS-4008. TestBalancerWithEncryptedTransfer needs a timeout. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1395701 13f79535-47bb-0310-9956-ffa450edef68
2012-10-08 18:12:29 +00:00
Eli Collins 99e7354cd5 HDFS-4006. TestCheckpoint#testSecondaryHasVeryOutOfDateImage occasionally fails due to unexpected exit. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1395388 13f79535-47bb-0310-9956-ffa450edef68
2012-10-07 21:50:14 +00:00
Eli Collins d61d75abe5 HDFS-3682. MiniDFSCluster#init should provide more info when it fails. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1395386 13f79535-47bb-0310-9956-ffa450edef68
2012-10-07 21:22:31 +00:00
Todd Lipcon 029f68bd96 HADOOP-8889. Upgrade to Surefire 2.12.3. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1394880 13f79535-47bb-0310-9956-ffa450edef68
2012-10-06 00:58:29 +00:00
Aaron Myers 9a69c2d501 HDFS-3483. Better error message when hdfs fsck is run against a ViewFS config. Contributed by Stephen Fritz.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1394866 13f79535-47bb-0310-9956-ffa450edef68
2012-10-06 00:16:08 +00:00
Thomas Graves 6827ab09c3 merge -r 1394608:1394609 from trunk. FIXES: HDFS-3829
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1394610 13f79535-47bb-0310-9956-ffa450edef68
2012-10-05 15:52:18 +00:00
Aaron Myers 49959f95ff HDFS-3813. Log error message if security and WebHDFS are enabled but principal/keytab are not configured. Contributed by Stephen Chu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1394341 13f79535-47bb-0310-9956-ffa450edef68
2012-10-05 00:56:09 +00:00
Alejandro Abdelnur ae68ae6919 YARN-23. FairScheduler: FSQueueSchedulable#updateDemand() - potential redundant aggregation. (kkambatl via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1394322 13f79535-47bb-0310-9956-ffa450edef68
2012-10-04 23:02:28 +00:00
Alejandro Abdelnur 437ce1aff0 HDFS-3999. HttpFS OPEN operation expects len parameter, it should be length. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1394170 13f79535-47bb-0310-9956-ffa450edef68
2012-10-04 17:46:39 +00:00
Alejandro Abdelnur 241c528166 HADOOP-8881. FileBasedKeyStoresFactory initialization logging should be debug not info. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1394166 13f79535-47bb-0310-9956-ffa450edef68
2012-10-04 17:40:54 +00:00
Eli Collins 3be0d367f4 HDFS-3916. libwebhdfs (C client) code cleanups. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1393896 13f79535-47bb-0310-9956-ffa450edef68
2012-10-04 03:03:17 +00:00
Eli Collins 5705cffc35 HDFS-4000. TestParallelLocalRead fails with "input ByteBuffers must be direct buffers". Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1393885 13f79535-47bb-0310-9956-ffa450edef68
2012-10-04 02:42:19 +00:00
Eli Collins 3bb5fb6f08 Amend HDFS-3753 to ignore TestHdfsNativeCodeLoader. To be fixed in HDFS-4003.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1393831 13f79535-47bb-0310-9956-ffa450edef68
2012-10-03 23:38:28 +00:00
Eli Collins dd16390e9c HDFS-3996. Add debug log removed in HDFS-3873 back. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1393778 13f79535-47bb-0310-9956-ffa450edef68
2012-10-03 21:31:04 +00:00
Siddharth Seth aa53f366c8 merge MAPREDUCE-4123 from trunk. Remove the 'mapred groups' command, which is no longer supported. (Contributed by Devaraj K)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1393776 13f79535-47bb-0310-9956-ffa450edef68
2012-10-03 21:28:49 +00:00
Siddharth Seth 60a5f6b520 merge YARN-102 from trunk. Move the apache header to the top of the file in MemStore.java. (Contributed by Devaraj K)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1393771 13f79535-47bb-0310-9956-ffa450edef68
2012-10-03 21:20:10 +00:00
Daryn Sharp 594176ed04 HADOOP-8783. Improve RPC.Server's digest auth (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1393498 13f79535-47bb-0310-9956-ffa450edef68
2012-10-03 14:08:15 +00:00
Siddharth Seth 9f3f66375e merge YARN-131 from trunk. Fix incorrect ACL properties in capacity scheduler documentation. (Contributed by Ahmed Radwan)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1393263 13f79535-47bb-0310-9956-ffa450edef68
2012-10-03 02:57:25 +00:00
Eli Collins 47f60c4951 HADOOP-8756. Fix SEGV when libsnappy is in java.library.path but not LD_LIBRARY_PATH. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1393244 13f79535-47bb-0310-9956-ffa450edef68
2012-10-03 00:10:22 +00:00
Eli Collins 04988bb77b HDFS-3753. Tests don't run with native libraries. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1393188 13f79535-47bb-0310-9956-ffa450edef68
2012-10-02 21:15:10 +00:00
Aaron Myers b9131749aa HADOOP-8616. ViewFS configuration requires a trailing slash. Contributed by Sandy Ryza.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1392709 13f79535-47bb-0310-9956-ffa450edef68
2012-10-02 01:30:08 +00:00
Arun Murthy 2cc97b78a7 Updated release notes for 2.0.2-alpha.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1392681 13f79535-47bb-0310-9956-ffa450edef68
2012-10-01 22:53:09 +00:00
Arun Murthy a28e01b337 HADOOP-8738. Reverted since it broke MR based system tests.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1392676 13f79535-47bb-0310-9956-ffa450edef68
2012-10-01 22:44:08 +00:00
Aaron Myers cae0e5653a HADOOP-8851. Use -XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests. Contributed by Ivan A. Veselovsky.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1392469 13f79535-47bb-0310-9956-ffa450edef68
2012-10-01 17:45:29 +00:00
Arun Murthy bfb69f6eea Merge -c 1392075 from trunk to branch-2 to fix MAPREDUCE-4681. Fix unit tests broken by HDFS-3910. Contributed by Arun C. Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1392076 13f79535-47bb-0310-9956-ffa450edef68
2012-09-30 17:02:27 +00:00
Arun Murthy 10f82d1922 Release notes.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1391966 13f79535-47bb-0310-9956-ffa450edef68
2012-09-30 08:27:54 +00:00
Arun Murthy 41aa8aeb07 Merge -c 1391944 from trunk to branch-2 to fix YARN-138. Ensure default values for minimum/maximum container sizes is sane. Contributed by Harsh J and Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1391945 13f79535-47bb-0310-9956-ffa450edef68
2012-09-30 03:46:51 +00:00
Arun Murthy 7418b5f357 Merge -c 1391929 from trunk to branch-2 to fix YARN-137. Change the default YARN scheduler to be the CapacityScheduler. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1391930 13f79535-47bb-0310-9956-ffa450edef68
2012-09-30 00:44:15 +00:00
Siddharth Seth 060e4f256d merge YARN-116 from trunk. Add the ability to change the RM include/exclude file without a restart. (Contributed by xieguiming and Harsh J)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1391913 13f79535-47bb-0310-9956-ffa450edef68
2012-09-29 22:40:58 +00:00
Robert Joseph Evans 76aa144c64 Preparing for release 0.23.4
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1391806 13f79535-47bb-0310-9956-ffa450edef68
2012-09-29 14:18:27 +00:00
Aaron Myers f15b6b9959 HDFS-3992. Method org.apache.hadoop.hdfs.TestHftpFileSystem.tearDown() sometimes throws NPEs. Contributed by Ivan A. Veselovsky.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1391764 13f79535-47bb-0310-9956-ffa450edef68
2012-09-29 07:31:48 +00:00
Aaron Myers 288e052acd HADOOP-8866. SampleQuantiles#query is O(N^2) instead of O(N). Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1391712 13f79535-47bb-0310-9956-ffa450edef68
2012-09-29 01:00:05 +00:00
Aaron Myers d95daf370d HDFS-3896. Add descriptions for dfs.namenode.rpc-address and dfs.namenode.servicerpc-address to hdfs-default.xml. Contributed by Jeff Lord.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1391709 13f79535-47bb-0310-9956-ffa450edef68
2012-09-29 00:53:23 +00:00
Robert Joseph Evans 81b14fae80 svn merge -c 1391679 FIXES: MAPREDUCE-4689. JobClient.getMapTaskReports on failed job results in NPE (jlowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1391680 13f79535-47bb-0310-9956-ffa450edef68
2012-09-28 22:18:32 +00:00
Jason Darrell Lowe f40997309e svn merge -c 1391671 FIXES: MAPREDUCE-4691. Historyserver can report "Unknown job" after RM says job has completed. Contributed by Robert Joseph Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1391675 13f79535-47bb-0310-9956-ffa450edef68
2012-09-28 22:00:42 +00:00
Robert Joseph Evans b2db4b2917 svn merge -c 1391649 FIXES: YARN-106. Nodemanager needs to set permissions of local directories (jlowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1391651 13f79535-47bb-0310-9956-ffa450edef68
2012-09-28 20:53:14 +00:00
Robert Joseph Evans 587f499b88 svn merge -c 1391121 FIXES: HDFS-3831. Failure to renew tokens due to test-sources left in classpath (jlowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1391122 13f79535-47bb-0310-9956-ffa450edef68
2012-09-27 17:32:53 +00:00
Robert Joseph Evans aa94aea3c2 svn merge -c 1382072 FIXES: YARN-57. Allow process-tree based resource calculation et al. to be pluggable to support it on multiple platforms. Contributed by Radim Kolar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1391094 13f79535-47bb-0310-9956-ffa450edef68
2012-09-27 16:38:54 +00:00
Eli Collins 1e1591788d HADOOP-8855. SSL-based image transfer does not work when Kerberos is disabled. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1390843 13f79535-47bb-0310-9956-ffa450edef68
2012-09-27 05:08:06 +00:00
Vinod Kumar Vavilapalli f1749af465 Fix NodeManager to verify the application's user-name
svn merge --ignore-ancestry -c 1390825 ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1390826 13f79535-47bb-0310-9956-ffa450edef68
2012-09-27 03:45:05 +00:00