Commit Graph

3516 Commits

Author SHA1 Message Date
Aaron Myers 026873c155 HADOOP-9152. HDFS can report negative DFS Used on clusters with very small amounts of data. Contributed by Brock Noland.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1423604 13f79535-47bb-0310-9956-ffa450edef68
2012-12-18 19:50:46 +00:00
Thomas White 01c5d0eb77 Merge -r 1423469:1423470 from trunk to branch-2. Fixes: MAPREDUCE-4845. ClusterStatus.getMaxMemory() and getUsedMemory() exist in MR1 but not MR2. Contributed by Sandy Ryza.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1423471 13f79535-47bb-0310-9956-ffa450edef68
2012-12-18 15:25:09 +00:00
Suresh Srinivas 5f5b9006de HADOOP-9147. Merging change 1423444 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1423450 13f79535-47bb-0310-9956-ffa450edef68
2012-12-18 14:45:03 +00:00
Aaron Myers 16d0c440de HDFS-4140. fuse-dfs handles open(O_TRUNC) poorly. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1423260 13f79535-47bb-0310-9956-ffa450edef68
2012-12-18 02:43:32 +00:00
Todd Lipcon 113c27a039 HADOOP-9004. Allow security unit tests to use external KDC. Contributed by Stephen Chu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1423241 13f79535-47bb-0310-9956-ffa450edef68
2012-12-18 01:15:28 +00:00
Aaron Myers 9c7a53cf3b HDFS-4315. DNs with multiple BPs can have BPOfferServices fail to start due to unsynchronized map access. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1422780 13f79535-47bb-0310-9956-ffa450edef68
2012-12-17 07:53:35 +00:00
Luke Lu 1ad091b214 Update CHANGES.txt separately for clean cherry-picks.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1422436 13f79535-47bb-0310-9956-ffa450edef68
2012-12-16 00:50:06 +00:00
Luke Lu 6eb512df7a HADOOP-9041. FsUrlStreamHandlerFactory could cause an infinite loop in FileSystem initialization. (Yanbo Liang and Radim Kolar via llu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1422435 13f79535-47bb-0310-9956-ffa450edef68
2012-12-16 00:49:55 +00:00
Luke Lu 5e6114cd38 HADOOP-8561. Introduce HADOOP_PROXY_USER for secure impersonation in child hadoop client processes. (Yu Gao via llu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1422434 13f79535-47bb-0310-9956-ffa450edef68
2012-12-16 00:49:30 +00:00
Aaron Myers b4022a08ed Move HDFS-2264 and HDFS-4294 to the correct section in CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1421604 13f79535-47bb-0310-9956-ffa450edef68
2012-12-13 22:56:42 +00:00
Aaron Myers f21ec6ebde HADOOP-9127. Update documentation for ZooKeeper Failover Controller. Contributed by Daisuke Kobayashi.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1421593 13f79535-47bb-0310-9956-ffa450edef68
2012-12-13 22:44:44 +00:00
Alejandro Abdelnur 6a29bf5703 YARN-264. y.s.rm.DelegationTokenRenewer attempts to renew token even after removing an app. (kkambatl via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1421578 13f79535-47bb-0310-9956-ffa450edef68
2012-12-13 22:21:16 +00:00
Aaron Myers eed48f54f5 HDFS-4307. SocketCache should use monotonic time. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1421573 13f79535-47bb-0310-9956-ffa450edef68
2012-12-13 22:13:07 +00:00
Todd Lipcon 7f341b7b39 HADOOP-9135. JniBasedUnixGroupsMappingWithFallback should log at debug rather than info during fallback. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1421012 13f79535-47bb-0310-9956-ffa450edef68
2012-12-12 22:06:48 +00:00
Thomas White 30eaf879e3 Merge -r 1420703:1420704 from trunk to branch-2. Fixes: YARN-267. Fix fair scheduler web UI. Contributed by Sandy Ryza.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1420706 13f79535-47bb-0310-9956-ffa450edef68
2012-12-12 14:36:07 +00:00
Thomas White fc70cd9538 Merge -r 1420633:1420634 from trunk to branch-2. Fixes: MAPREDUCE-4856. TestJobOutputCommitter uses same directory as TestJobCleanup. Contributed by Sandy Ryza.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1420635 13f79535-47bb-0310-9956-ffa450edef68
2012-12-12 12:14:08 +00:00
Eli Collins 3b15fe6686 HADOOP-9113. o.a.h.fs.TestDelegationTokenRenewer is failing intermittently. Contributed by Karthik Kambatla
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1420495 13f79535-47bb-0310-9956-ffa450edef68
2012-12-12 00:16:48 +00:00
Alejandro Abdelnur 1fce56fd24 MAPREDUCE-4549. Distributed cache conflicts breaks backwards compatability. (Robert Evans via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1420363 13f79535-47bb-0310-9956-ffa450edef68
2012-12-11 19:50:32 +00:00
Alejandro Abdelnur 680b437f2f MAPREDUCE-4861. Cleanup: Remove unused mapreduce.security.token.DelegationTokenRenewal. (kkambatl via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1420350 13f79535-47bb-0310-9956-ffa450edef68
2012-12-11 19:29:18 +00:00
Jason Darrell Lowe e2c0cf69ca svn merge -c 1420232 FIXES: YARN-266. RM and JHS Web UIs are blank because AppsBlock is not escaping string properly. Contributed by Ravi Prakash
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1420233 13f79535-47bb-0310-9956-ffa450edef68
2012-12-11 15:51:12 +00:00
Aaron Myers 42f6c0fd63 HDFS-2264. NamenodeProtocol has the wrong value for clientPrincipal in KerberosInfo annotation. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1419951 13f79535-47bb-0310-9956-ffa450edef68
2012-12-11 00:54:24 +00:00
Aaron Myers 29ad19e950 HDFS-4294. Backwards compatibility is not maintained for TestVolumeId. Contributed by Ivan A. Veselovsky and Robert Parker.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1419877 13f79535-47bb-0310-9956-ffa450edef68
2012-12-10 23:49:48 +00:00
Todd Lipcon f38fdbf648 HDFS-4295. Using port 1023 should be valid when starting Secure DataNode. Contributed by Stephen Chu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1419855 13f79535-47bb-0310-9956-ffa450edef68
2012-12-10 22:47:10 +00:00
Todd Lipcon c835eba0a9 HADOOP-9126. FormatZK and ZKFC startup can fail due to zkclient connection establishment delay. Contributed by Rakesh R and Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1419832 13f79535-47bb-0310-9956-ffa450edef68
2012-12-10 22:10:02 +00:00
Todd Lipcon ee7ca279a0 HADOOP-6762. Exception while doing RPC I/O closes channel. Contributed by Sam Rash and Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1419783 13f79535-47bb-0310-9956-ffa450edef68
2012-12-10 21:25:38 +00:00
Todd Lipcon f8f4269cd7 HDFS-4292. Sanity check not correct in RemoteBlockReader2.newBlockReader. Contributed by Binglin Chang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1419676 13f79535-47bb-0310-9956-ffa450edef68
2012-12-10 19:13:09 +00:00
Todd Lipcon 8fa6d8a074 HDFS-4291. edit log unit tests leave stray test_edit_log_file around. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1419664 13f79535-47bb-0310-9956-ffa450edef68
2012-12-10 18:55:06 +00:00
Uma Maheswara Rao G b5a959d39d HDFS-4130. BKJM: The reading for editlog at NN starting using bkjm is not efficient. Contributed by Han Xiao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1419661 13f79535-47bb-0310-9956-ffa450edef68
2012-12-10 18:52:35 +00:00
Alejandro Abdelnur 89b9fc3034 MAPREDUCE-4703. Add the ability to start the MiniMRClientCluster using the configurations used before it is being stopped. (ahmed.radwan via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1419619 13f79535-47bb-0310-9956-ffa450edef68
2012-12-10 18:10:22 +00:00
Eric Yang ddd84ebedb HADOOP-8418. Update UGI Principal classes name for running with
IBM JDK on 64 bits Windows.  (Yu Gao via eyang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1418573 13f79535-47bb-0310-9956-ffa450edef68
2012-12-08 00:49:02 +00:00
Aaron Myers 2e12de45a4 HDFS-4279. NameNode does not initialize generic conf keys when started with -recover. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1418560 13f79535-47bb-0310-9956-ffa450edef68
2012-12-07 23:54:31 +00:00
Alejandro Abdelnur 3ff00d4aaa HADOOP-9054. Add AuthenticationHandler that uses Kerberos but allows for an alternate form of authentication for browsers. (rkanter via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1418432 13f79535-47bb-0310-9956-ffa450edef68
2012-12-07 18:49:32 +00:00
Suresh Srinivas 448882534b HDFS-4236. Merge change 1418356 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1418363 13f79535-47bb-0310-9956-ffa450edef68
2012-12-07 15:40:24 +00:00
Todd Lipcon 6fe949979a HDFS-4282. TestEditLog.testFuzzSequences FAILED in all pre-commit test. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1418212 13f79535-47bb-0310-9956-ffa450edef68
2012-12-07 08:17:38 +00:00
Aaron Myers 3607109ae1 HDFS-3680. Allow customized audit logging in HDFS FSNamesystem. Contributed by Marcelo Vanzin.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1418115 13f79535-47bb-0310-9956-ffa450edef68
2012-12-06 22:30:07 +00:00
Jason Darrell Lowe 1e5a61e3e8 svn merge -c 1417948 FIXES: YARN-258. RM web page UI shows Invalid Date for start and finish times. Contributed by Ravi Prakash
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1417950 13f79535-47bb-0310-9956-ffa450edef68
2012-12-06 15:41:20 +00:00
Konstantin Shvachko f87b3c68bf HDFS-4268. Remove redundant enum NNHAStatusHeartbeat.State. Contributed by Konstantin Shvachko.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1417753 13f79535-47bb-0310-9956-ffa450edef68
2012-12-06 07:23:41 +00:00
Aaron Myers 31e97a7757 HADOOP-9070. Kerberos SASL server cannot find kerberos key. Contributed by Daryn Sharp.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1417730 13f79535-47bb-0310-9956-ffa450edef68
2012-12-06 02:56:02 +00:00
Todd Lipcon 46f2591a9e HDFS-4238. Standby namenode should not do purging of shared storage edits. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1417652 13f79535-47bb-0310-9956-ffa450edef68
2012-12-05 21:18:16 +00:00
Todd Lipcon df9d2b0394 HADOOP-9103. UTF8 class does not properly decode Unicode characters outside the basic multilingual plane. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1417650 13f79535-47bb-0310-9956-ffa450edef68
2012-12-05 21:14:01 +00:00
Todd Lipcon 4d57c660df HDFS-3935. Add JournalNode to the start/stop scripts. Contributed by Andy Isaacson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1417599 13f79535-47bb-0310-9956-ffa450edef68
2012-12-05 19:28:02 +00:00
Todd Lipcon 0bac725e19 HDFS-4153. Add START_MSG/SHUTDOWN_MSG for JournalNode. Contributed by Liang Xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1417598 13f79535-47bb-0310-9956-ffa450edef68
2012-12-05 19:26:39 +00:00
Todd Lipcon 9c19d236ef HDFS-4110. Refine a log printed in JNStorage. Contributed by Liang Xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1417597 13f79535-47bb-0310-9956-ffa450edef68
2012-12-05 19:24:47 +00:00
Todd Lipcon fd032dd9e3 Merge HDFS-3077 (QuorumJournalManager) backport into branch-2.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1417596 13f79535-47bb-0310-9956-ffa450edef68
2012-12-05 19:22:17 +00:00
Todd Lipcon 2f8a18ce95 HDFS-3571. Allow EditLogFileInputStream to read from a remote URL. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1417589 13f79535-47bb-0310-9956-ffa450edef68
2012-12-05 19:15:53 +00:00
Todd Lipcon 857c428a90 HDFS-3049. During the normal NN startup process, fall back on a different edit log if we see one that is corrupt. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1417588 13f79535-47bb-0310-9956-ffa450edef68
2012-12-05 19:13:29 +00:00
Aaron Myers d6a9d9f76c HDFS-4199. Provide test for HdfsVolumeId. Contributed by Ivan A. Veselovsky.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1417264 13f79535-47bb-0310-9956-ffa450edef68
2012-12-05 01:48:12 +00:00
Suresh Srinivas 8be0df5b4b HADOOP-9090. Merging change 1416538 from trunk to release 2.0.3
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1416543 13f79535-47bb-0310-9956-ffa450edef68
2012-12-03 14:29:58 +00:00
Thomas White 25bb7ad028 Merge -r 1416483:1416484 from trunk to branch-2. Fixes: YARN-72. NM should handle cleaning up containers when it shuts down. Contributed by Sandy Ryza.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1416485 13f79535-47bb-0310-9956-ffa450edef68
2012-12-03 12:14:04 +00:00
Konstantin Shvachko f0a1fb73ff HDFS-4231. BackupNode: Introduce BackupState. Contributed by Konstantin Shvachko.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1416289 13f79535-47bb-0310-9956-ffa450edef68
2012-12-02 23:18:17 +00:00