Commit Graph

3340 Commits

Author SHA1 Message Date
Eli Collins 22cb0ec82a HADOOP-8422. Deprecate FileSystem#getDefault* and getServerDefault methods that don't take a Path argument. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342495 13f79535-47bb-0310-9956-ffa450edef68
2012-05-25 04:10:15 +00:00
Eli Collins 39661c06f7 Revert HDFS-3058
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342493 13f79535-47bb-0310-9956-ffa450edef68
2012-05-25 03:56:12 +00:00
Uma Maheswara Rao G 64ec449010 HDFS-3058. HA: Bring BookKeeperJournalManager up to date with HA changes. Contributed by Ivan Kelly.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342483 13f79535-47bb-0310-9956-ffa450edef68
2012-05-25 01:31:23 +00:00
Alejandro Abdelnur e937068c0b HDFS-3460. HttpFS proxyuser validation with Kerberos ON uses full principal name. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342334 13f79535-47bb-0310-9956-ffa450edef68
2012-05-24 16:51:04 +00:00
Thomas Graves c4f17d242d MAPREDUCE-4224. TestFifoScheduler throws org.apache.hadoop.metrics2.MetricsException (Devaraj K via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342244 13f79535-47bb-0310-9956-ffa450edef68
2012-05-24 13:10:57 +00:00
Todd Lipcon 6c544adeb3 Merge HDFS-3042 (automatic failover) to trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342112 13f79535-47bb-0310-9956-ffa450edef68
2012-05-24 00:56:20 +00:00
Todd Lipcon 14bf2d4357 HDFS-1013. Miscellaneous improvements to HTML markup for web UIs. Contributed by Eugene Koontz.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342102 13f79535-47bb-0310-9956-ffa450edef68
2012-05-24 00:27:51 +00:00
Alejandro Abdelnur cf7b017422 MAPREDUCE-4276. Allow setting yarn.nodemanager.delete.debug-delay-sec property to -1 for easier container debugging. (ahmed via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342075 13f79535-47bb-0310-9956-ffa450edef68
2012-05-23 22:22:55 +00:00
Sanjay Radia 266a0f1de9 HADOOP-8367 Improve documentation of declaringClassProtocolName in rpc headers (Sanjay Radia)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342051 13f79535-47bb-0310-9956-ffa450edef68
2012-05-23 21:16:39 +00:00
Todd Lipcon 74dfa8f1f2 HDFS-2982. Startup performance suffers when there are many edit log segments. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342042 13f79535-47bb-0310-9956-ffa450edef68
2012-05-23 20:42:48 +00:00
Thomas Graves 432c4a6ffc MAPREDUCE-4262. NM gives wrong log message saying Connected to ResourceManager before trying to connect. (Devaraj K via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341972 13f79535-47bb-0310-9956-ffa450edef68
2012-05-23 18:37:37 +00:00
Tsz-wo Sze ade42bce10 HDFS-3436. In DataNode.transferReplicaForPipelineRecovery(..), it should use the stored generation stamp to check if the block is valid. Contributed by Vinay
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341961 13f79535-47bb-0310-9956-ffa450edef68
2012-05-23 17:59:30 +00:00
Eli Collins 445018cea8 HDFS-3454. Balancer unconditionally logs InterruptedException at INFO level on shutdown if security is enabled. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341916 13f79535-47bb-0310-9956-ffa450edef68
2012-05-23 15:56:59 +00:00
Tsz-wo Sze aa80e6895d HDFS-3415. Make sure all layout versions are the same for all storage directories in the Namenode. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341676 13f79535-47bb-0310-9956-ffa450edef68
2012-05-22 23:18:04 +00:00
Aaron Myers 23b96766ad Amend HADOOP-8408 per Daryn's post-commit feedback.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341338 13f79535-47bb-0310-9956-ffa450edef68
2012-05-22 07:50:00 +00:00
Thomas Graves d74bec2f88 MAPREDUCE-3870. Invalid App Metrics (Bhallamudi Venkata Siva Kamesh via tgraves).
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341160 13f79535-47bb-0310-9956-ffa450edef68
2012-05-21 19:15:41 +00:00
Robert Joseph Evans 2eebc21a55 MAPREDUCE-4274 MapOutputBuffer should use native byte order for kvmeta. (todd via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341151 13f79535-47bb-0310-9956-ffa450edef68
2012-05-21 19:05:19 +00:00
Tsz-wo Sze d69510a7f8 HDFS-3394. Do not use generic in INodeFile.getLastBlock(): the run-time ClassCastException check is useless since generic type information is only available in compile-time.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341141 13f79535-47bb-0310-9956-ffa450edef68
2012-05-21 18:51:15 +00:00
Robert Joseph Evans 99a552fd70 HADOOP-8413. test-patch.sh gives out the wrong links for newPatchFindbugsWarnings (Colin Patrick McCabe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341113 13f79535-47bb-0310-9956-ffa450edef68
2012-05-21 17:08:58 +00:00
Thomas Graves d239307d00 MAPREDUCE-4269. documentation: Gridmix has javadoc warnings in StressJobFactory (Jonathon Eagles via tgraves).
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340880 13f79535-47bb-0310-9956-ffa450edef68
2012-05-21 01:55:44 +00:00
Eli Collins 260dfa367e HDFS-2885. Remove "federation" from the nameservice config options. Contributed by Tsz Wo (Nicholas), SZE
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340841 13f79535-47bb-0310-9956-ffa450edef68
2012-05-20 21:13:17 +00:00
Uma Maheswara Rao G 75041b9950 HDFS-2717. BookKeeper Journal output stream doesn't check addComplete rc. Contributed by Ivan Kelly.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340750 13f79535-47bb-0310-9956-ffa450edef68
2012-05-20 15:14:53 +00:00
Todd Lipcon a37aa28e4a MAPREDUCE-4002. MultiFileWordCount job fails if the input path is not from default file system. Contributed by Bhallamudi Venkata Siva Kamesh.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340630 13f79535-47bb-0310-9956-ffa450edef68
2012-05-20 07:41:56 +00:00
Todd Lipcon 1a3bd5d42f Merge trunk into auto-HA branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1340622 13f79535-47bb-0310-9956-ffa450edef68
2012-05-20 06:12:14 +00:00
Todd Lipcon d1a54b872d HDFS-3438. BootstrapStandby should not require a rollEdits on active node. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340343 13f79535-47bb-0310-9956-ffa450edef68
2012-05-19 05:13:38 +00:00
Eli Collins 20f935eaea HADOOP-8329. Build fails with Java 7. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340268 13f79535-47bb-0310-9956-ffa450edef68
2012-05-18 21:43:02 +00:00
Aaron Myers ea0baa3609 HDFS-3444. hdfs groups command doesn't work with security enabled. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340260 13f79535-47bb-0310-9956-ffa450edef68
2012-05-18 21:25:21 +00:00
Todd Lipcon 7d1f97b821 HDFS-3440. More effectively limit stream memory consumption when reading corrupt edit logs. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339978 13f79535-47bb-0310-9956-ffa450edef68
2012-05-18 05:28:18 +00:00
Eli Collins eae281c130 HADOOP-8408. MR doesn't work with a non-default ViewFS mount table and security enabled. Contributed by Aaron T. Myers
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339970 13f79535-47bb-0310-9956-ffa450edef68
2012-05-18 04:20:28 +00:00
Thomas Graves bacb4080a0 MAPREDUCE-4197. Include the hsqldb jar in the hadoop-mapreduce tar file (Ravi Prakash via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339957 13f79535-47bb-0310-9956-ffa450edef68
2012-05-18 02:50:48 +00:00
Eli Collins fe07758ad0 HADOOP-8287. etc/hadoop is missing hadoop-env.sh. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339906 13f79535-47bb-0310-9956-ffa450edef68
2012-05-17 22:47:41 +00:00
Todd Lipcon 5258d6bf3f HDFS-3391. Fix InvalidateBlocks to compare blocks including their generation stamps. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339897 13f79535-47bb-0310-9956-ffa450edef68
2012-05-17 22:30:46 +00:00
Todd Lipcon 15ddb6634f HDFS-2800. Fix cancellation of checkpoints in the standby node to be more reliable. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339745 13f79535-47bb-0310-9956-ffa450edef68
2012-05-17 17:49:48 +00:00
Eli Collins 5ef725eb53 HDFS-3434. InvalidProtocolBufferException when visiting DN browseDirectory.jsp. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339712 13f79535-47bb-0310-9956-ffa450edef68
2012-05-17 17:01:13 +00:00
Eli Collins 6d71407582 HDFS-1153. dfsnodelist.jsp should handle invalid input parameters. Contributed by Ravi Phulari
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339706 13f79535-47bb-0310-9956-ffa450edef68
2012-05-17 16:55:49 +00:00
Thomas Graves dcf84707ab MAPREDUCE-3543. Mavenize Gridmix. (tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339629 13f79535-47bb-0310-9956-ffa450edef68
2012-05-17 15:06:33 +00:00
Harsh J e1f09365ca HADOOP-8360. empty-configuration.xml fails xml validation. Contributed by Radim Kolar. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339613 13f79535-47bb-0310-9956-ffa450edef68
2012-05-17 14:20:07 +00:00
Aaron Myers 1377709b4c HDFS-3433. GetImageServlet should allow administrative requestors when security is enabled. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339540 13f79535-47bb-0310-9956-ffa450edef68
2012-05-17 10:23:18 +00:00
Todd Lipcon 026d0b4d53 HADOOP-8406. CompressionCodecFactory.CODEC_PROVIDERS iteration is thread-unsafe. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339476 13f79535-47bb-0310-9956-ffa450edef68
2012-05-17 04:28:35 +00:00
Todd Lipcon ba1e4a823a HDFS-3422. TestStandbyIsHot timeouts too aggressive. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339452 13f79535-47bb-0310-9956-ffa450edef68
2012-05-17 02:45:47 +00:00
Todd Lipcon 7b1d347b43 HADOOP-8405. ZKFC tests leak ZK instances. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1339435 13f79535-47bb-0310-9956-ffa450edef68
2012-05-17 00:38:59 +00:00
Todd Lipcon 0600e834be HDFS-3432. TestDFSZKFailoverController tries to fail over too early. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1339434 13f79535-47bb-0310-9956-ffa450edef68
2012-05-17 00:36:13 +00:00
Eli Collins 97e1d5c9ad HDFS-860. fuse-dfs truncate behavior causes issues with scp. Contributed by Brian Bockelman
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339413 13f79535-47bb-0310-9956-ffa450edef68
2012-05-16 22:57:18 +00:00
Todd Lipcon e14e10fb86 Merge trunk into auto-HA branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1339410 13f79535-47bb-0310-9956-ffa450edef68
2012-05-16 22:47:37 +00:00
Alejandro Abdelnur 235502d60b HADOOP-8400. All commands warn 'Kerberos krb5 configuration not found' when security is not enabled. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339298 13f79535-47bb-0310-9956-ffa450edef68
2012-05-16 18:19:36 +00:00
Aaron Myers 7286e8a9da HDFS-3413. TestFailureToReadEdits timing out. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339250 13f79535-47bb-0310-9956-ffa450edef68
2012-05-16 16:24:38 +00:00
Thomas Graves 7e3d016845 MAPREDUCE-4102. job counters not available in Jobhistory webui for killed jobs (Bhallamudi Venkata Siva Kamesh via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339174 13f79535-47bb-0310-9956-ffa450edef68
2012-05-16 14:08:08 +00:00
Todd Lipcon 9142dcac9e Move changes from 2.0.0-alpha to 2.0.1-alpha in CHANGES.txt for those that did not make rc1
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339019 13f79535-47bb-0310-9956-ffa450edef68
2012-05-16 05:48:16 +00:00
Alejandro Abdelnur 2eeafa78c9 MAPREDUCE-4250. hadoop-config.sh missing variable exports, causes Yarn jobs to fail with ClassNotFoundException MRAppMaster. (phunt via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339000 13f79535-47bb-0310-9956-ffa450edef68
2012-05-16 04:15:02 +00:00
Alejandro Abdelnur c743168bf2 HADOOP-8393. hadoop-config.sh missing variable exports, causes Yarn jobs to fail with ClassNotFoundException MRAppMaster. (phunt via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338998 13f79535-47bb-0310-9956-ffa450edef68
2012-05-16 04:12:46 +00:00