Commit Graph

3106 Commits

Author SHA1 Message Date
Todd Lipcon c0016ba85f HDFS-2825. Add test hook to turn off the writer preferring its local DN. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235025 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 22:07:49 +00:00
Todd Lipcon 8d1c996242 HDFS-2688. Add tests for quota tracking in an HA cluster. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235017 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 21:57:00 +00:00
Todd Lipcon c10853a6b9 HDFS-2820. Add a simple sanity check for HA config. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235013 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 21:49:43 +00:00
Mahadev Konar f07d91a1fc HADOOP-7981. Improve documentation for org.apache.hadoop.io.compress.Decompressor.getRemaining (Jonathan Eagles via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235007 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 21:44:49 +00:00
Mahadev Konar 4b36997b1b MAPREDUCE-3702. internal server error trying access application master via proxy with filter enabled. (Thomas Graves via mahadev.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234991 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 21:22:09 +00:00
Mahadev Konar c415dee2b7 MAPREDUCE-3691. webservices add support to compress response. (Thomas Graves via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234989 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 21:15:55 +00:00
Todd Lipcon 12645ff6c0 HDFS-2822. processMisReplicatedBlock incorrectly identifies under-construction blocks as under-replicated. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234925 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 18:11:09 +00:00
Aaron Myers e42bbfbca2 Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1234924 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 18:07:27 +00:00
Harsh J ece854211f HDFS-2818. Fix a missing space issue in HDFS webapps' title tags. (Devaraj K via harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234555 13f79535-47bb-0310-9956-ffa450edef68
2012-01-22 17:30:33 +00:00
Aaron Myers c3e62de9ce HDFS-2737. Automatically trigger log rolls periodically on the active NN. Contributed by Todd Lipcon and Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1234256 13f79535-47bb-0310-9956-ffa450edef68
2012-01-21 03:17:26 +00:00
Mahadev Konar 355ba01374 MAPREDUCE-3705. ant build fails on 0.23 branch. (Thomas Graves via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234227 13f79535-47bb-0310-9956-ffa450edef68
2012-01-21 01:15:24 +00:00
Mahadev Konar 8a1719e999 MAPREDUCE-3549. write api documentation for web service apis for RM, NM, mapreduce app master, and job history server (Thomas Graves via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234222 13f79535-47bb-0310-9956-ffa450edef68
2012-01-21 00:53:02 +00:00
Todd Lipcon c840548d6b HDFS-2817. Combine the two TestSafeMode test suites. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234221 13f79535-47bb-0310-9956-ffa450edef68
2012-01-21 00:42:35 +00:00
Mahadev Konar b49aae0635 MAPREDUCE-3689. RM web UI doesn't handle newline in job name. (Thomas Graves via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234148 13f79535-47bb-0310-9956-ffa450edef68
2012-01-20 21:27:39 +00:00
Alejandro Abdelnur 654b90fa23 HDFS-2816. Fix missing license header in httpfs findbugsExcludeFile.xml. (hitesh via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234135 13f79535-47bb-0310-9956-ffa450edef68
2012-01-20 21:04:24 +00:00
Mahadev Konar c6923061d0 MAPREDUCE-3698. Client cannot talk to the history server in secure mode. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234120 13f79535-47bb-0310-9956-ffa450edef68
2012-01-20 20:44:17 +00:00
Vinod Kumar Vavilapalli 959d1d0181 HADOOP-7986. Adding config for MapReduce History Server protocol in hadoop-policy.xml for service level authorization. Contributed by Mahadev Konar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234097 13f79535-47bb-0310-9956-ffa450edef68
2012-01-20 19:49:05 +00:00
Aaron Myers 2abe5c818d Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1234087 13f79535-47bb-0310-9956-ffa450edef68
2012-01-20 19:30:53 +00:00
Todd Lipcon f7d20b2198 HDFS-2751. Datanode may incorrectly drop OS cache behind reads even for short reads. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1233796 13f79535-47bb-0310-9956-ffa450edef68
2012-01-20 07:32:06 +00:00
Todd Lipcon 520a39ac2d HDFS-2810. Leases not getting renewed properly by clients. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1233794 13f79535-47bb-0310-9956-ffa450edef68
2012-01-20 07:26:19 +00:00
Todd Lipcon b7eb5334f5 HADOOP-7982. UserGroupInformation fails to login if thread's context classloader can't load HadoopLoginModule. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1233751 13f79535-47bb-0310-9956-ffa450edef68
2012-01-20 03:33:50 +00:00
Todd Lipcon 1aed1296dd HDFS-2812. When becoming active, the NN should treat all leases as freshly renewed. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1233612 13f79535-47bb-0310-9956-ffa450edef68
2012-01-19 22:35:04 +00:00
Eli Collins 6861560098 MAPREDUCE-3692. yarn-resourcemanager out and log files can get big. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1233605 13f79535-47bb-0310-9956-ffa450edef68
2012-01-19 22:23:53 +00:00
Eli Collins fa6033a029 HDFS-2768. BackupNode stop can not close proxy connections because it is not a proxy instance. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1233584 13f79535-47bb-0310-9956-ffa450edef68
2012-01-19 21:41:50 +00:00
Aaron Myers 02919e61f6 HDFS-2367. Enable the configuration of multiple HA cluster addresses. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1233549 13f79535-47bb-0310-9956-ffa450edef68
2012-01-19 19:41:48 +00:00
Aaron Myers 3e17cdde56 Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1233533 13f79535-47bb-0310-9956-ffa450edef68
2012-01-19 19:02:07 +00:00
Todd Lipcon 1d2e706dd1 HDFS-2803. Add logging to LeaseRenewer for better lease expiration debugging. Contributed by Jimmy Xiang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1233453 13f79535-47bb-0310-9956-ffa450edef68
2012-01-19 16:35:25 +00:00
Aaron Myers 6177bf6c8f Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1233105 13f79535-47bb-0310-9956-ffa450edef68
2012-01-18 23:02:17 +00:00
Alejandro Abdelnur 10325d9732 MAPREDUCE-3582. Move successfully passing MR1 tests to MR2 maven tree.(ahmed via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1233090 13f79535-47bb-0310-9956-ffa450edef68
2012-01-18 22:10:12 +00:00
Thomas White 8b2f6909ec MAPREDUCE-3684. LocalDistributedCacheManager does not shut down its thread pool.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1232981 13f79535-47bb-0310-9956-ffa450edef68
2012-01-18 18:20:13 +00:00
Arun Murthy d737c323a6 MAPREDUCE-3669. Allow clients to talk to MR HistoryServer using both delegation tokens and kerberos. Contributed by Mahadev Konar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1232580 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 21:25:08 +00:00
Todd Lipcon a380dc8732 HDFS-2592. Balancer support for HA namenodes. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1232531 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 18:39:09 +00:00
Todd Lipcon 4c7a6c6c3f Amend HDFS-2795. Fix PersistBlocks failure due to an NPE in isPopulatingReplQueues()
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1232510 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 17:57:36 +00:00
Arun Murthy 5ffff3aea9 HADOOP-7971. Adding back job/pipes/queue commands to bin/hadoop for backward compatibility. Contributed by Prashath Sharma.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1232322 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 06:56:52 +00:00
Arun Murthy d05e6d2671 MAPREDUCE-2450. Fixed a corner case with interrupted communication threads leading to a long timeout in Task. Contributed by Rajesh Balamohan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1232314 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 06:10:50 +00:00
Todd Lipcon 0c1450ca5d HDFS-2795. Standby NN takes a long time to recover from a dead DN starting up. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1232285 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 03:21:08 +00:00
Todd Lipcon 212678f036 HDFS-2767. ConfiguredFailoverProxyProvider should support NameNodeProtocol. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1232284 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 03:10:25 +00:00
Eli Collins c53c94ec46 Update changelog for HDFS-362 to reflect the merge.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1232205 13f79535-47bb-0310-9956-ffa450edef68
2012-01-16 22:43:11 +00:00
Aaron Myers d880c7cc78 HDFS-2772. On transition to active, standby should not swallow ELIE. Contributed by Aaron T. Myers
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1232197 13f79535-47bb-0310-9956-ffa450edef68
2012-01-16 22:16:15 +00:00
Aaron Myers 940eeb866c Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1232184 13f79535-47bb-0310-9956-ffa450edef68
2012-01-16 21:57:28 +00:00
Vinod Kumar Vavilapalli 4a343c9d4a MAPREDUCE-3641. Making CapacityScheduler more conservative so as to assign only one off-switch container in a single scheduling iteration. Contributed by Arun C Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1232182 13f79535-47bb-0310-9956-ffa450edef68
2012-01-16 21:56:14 +00:00
Todd Lipcon 2f26475a39 HDFS-2747. Entering safe mode after starting SBN can NPE. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1232176 13f79535-47bb-0310-9956-ffa450edef68
2012-01-16 21:46:05 +00:00
Mahadev Konar c81995e370 MAPREDUCE-3657. State machine visualize build fails. (Jason Lowe via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1232167 13f79535-47bb-0310-9956-ffa450edef68
2012-01-16 21:22:21 +00:00
Mahadev Konar a24339e50d MAPREDUCE-3649. Job End notification gives an error on calling back. (Ravi Prakash via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1232126 13f79535-47bb-0310-9956-ffa450edef68
2012-01-16 19:35:06 +00:00
Harsh J a9002bfea1 HADOOP-7968. Errant println left in RPC.getHighestSupportedProtocol (Sho Shimauchi via harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1231732 13f79535-47bb-0310-9956-ffa450edef68
2012-01-15 19:15:04 +00:00
Eli Collins aee1bb81c6 HADOOP-7974. TestViewFsTrash incorrectly determines the user's home directory. Contributed by Harsh J
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1231640 13f79535-47bb-0310-9956-ffa450edef68
2012-01-15 08:51:48 +00:00
Harsh J 69290d383c HADOOP-7975. Add LZ4 as an entry in the default codec list, missed by HADOOP-7657 (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1231627 13f79535-47bb-0310-9956-ffa450edef68
2012-01-15 05:18:59 +00:00
Eli Collins 1c24ae0cd8 HDFS-2789. TestHAAdmin.testFailover is failing. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1231577 13f79535-47bb-0310-9956-ffa450edef68
2012-01-14 20:19:55 +00:00
Eli Collins f02ea82bd1 HDFS-2790. FSNamesystem.setTimes throws exception with wrong configuration name in the message. Contributed by Arpit Gupta
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1231572 13f79535-47bb-0310-9956-ffa450edef68
2012-01-14 19:50:14 +00:00
Eli Collins 6b8bcfa916 HDFS-2788. HdfsServerConstants#DN_KEEPALIVE_TIMEOUT is dead code. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1231569 13f79535-47bb-0310-9956-ffa450edef68
2012-01-14 19:45:12 +00:00