Commit Graph

954 Commits

Author SHA1 Message Date
Suresh Srinivas b1fe072e04 HADOOP-9173. Merging changes r1428970 and r1428972 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1429030 13f79535-47bb-0310-9956-ffa450edef68
2013-01-04 18:54:12 +00:00
Tsz-wo Sze 3e68d15c1e svn merge -c 1428739 from trunk for HDFS-4270. Introduce soft and hard limits for max replication so that replications of the highest priority are allowed to choose a source datanode that has reached its soft limit but not the hard limit.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1428743 13f79535-47bb-0310-9956-ffa450edef68
2013-01-04 08:13:52 +00:00
Todd Lipcon b4b26fc0a1 HDFS-4302. Fix fatal exception when starting NameNode with DEBUG logs. Contributed by Eugene Koontz.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1428591 13f79535-47bb-0310-9956-ffa450edef68
2013-01-03 20:55:09 +00:00
Konstantin Shvachko 485b5b4058 HDFS-4349. Add test for reading files from BackupNode. Contributed by Konstantin Shvachko.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1427291 13f79535-47bb-0310-9956-ffa450edef68
2013-01-01 03:40:27 +00:00
Konstantin Shvachko a3e393afaf HDFS-4347. Avoid infinite waiting checkpoint to complete in TestBackupNode. Contributed by Plamen Jeliazkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1426706 13f79535-47bb-0310-9956-ffa450edef68
2012-12-29 04:28:38 +00:00
Konstantin Shvachko 6a4b1b881c HDFS-4308. addBlock() should persist file blocks once. Contributed by Plamen Jeliazkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1426703 13f79535-47bb-0310-9956-ffa450edef68
2012-12-29 04:18:00 +00:00
Arun Murthy 6796f8d226 Merge -c 1425560 from trunk to branch-2 to fix HDFS-4326. bump up Tomcat version for HttpFS to 6.0.36. Contributed by Alejandro Abdelnur.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1425562 13f79535-47bb-0310-9956-ffa450edef68
2012-12-24 00:16:23 +00:00
Alejandro Abdelnur 7194c52ec3 HADOOP-8427. Convert Forrest docs to APT, incremental. (adi2 via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1425527 13f79535-47bb-0310-9956-ffa450edef68
2012-12-23 21:15:42 +00:00
Arun Murthy f68da35bb2 Reverting HDFS-4326 since it caused 'mvn package' to break.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1425400 13f79535-47bb-0310-9956-ffa450edef68
2012-12-23 03:52:42 +00:00
Alejandro Abdelnur e30516f017 HDFS-4326. bump up Tomcat version for HttpFS to 6.0.36. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1424064 13f79535-47bb-0310-9956-ffa450edef68
2012-12-19 20:00:47 +00:00
Aaron Myers 16d0c440de HDFS-4140. fuse-dfs handles open(O_TRUNC) poorly. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1423260 13f79535-47bb-0310-9956-ffa450edef68
2012-12-18 02:43:32 +00:00
Todd Lipcon 113c27a039 HADOOP-9004. Allow security unit tests to use external KDC. Contributed by Stephen Chu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1423241 13f79535-47bb-0310-9956-ffa450edef68
2012-12-18 01:15:28 +00:00
Aaron Myers 9c7a53cf3b HDFS-4315. DNs with multiple BPs can have BPOfferServices fail to start due to unsynchronized map access. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1422780 13f79535-47bb-0310-9956-ffa450edef68
2012-12-17 07:53:35 +00:00
Aaron Myers b4022a08ed Move HDFS-2264 and HDFS-4294 to the correct section in CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1421604 13f79535-47bb-0310-9956-ffa450edef68
2012-12-13 22:56:42 +00:00
Aaron Myers eed48f54f5 HDFS-4307. SocketCache should use monotonic time. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1421573 13f79535-47bb-0310-9956-ffa450edef68
2012-12-13 22:13:07 +00:00
Aaron Myers 42f6c0fd63 HDFS-2264. NamenodeProtocol has the wrong value for clientPrincipal in KerberosInfo annotation. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1419951 13f79535-47bb-0310-9956-ffa450edef68
2012-12-11 00:54:24 +00:00
Aaron Myers 29ad19e950 HDFS-4294. Backwards compatibility is not maintained for TestVolumeId. Contributed by Ivan A. Veselovsky and Robert Parker.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1419877 13f79535-47bb-0310-9956-ffa450edef68
2012-12-10 23:49:48 +00:00
Todd Lipcon f38fdbf648 HDFS-4295. Using port 1023 should be valid when starting Secure DataNode. Contributed by Stephen Chu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1419855 13f79535-47bb-0310-9956-ffa450edef68
2012-12-10 22:47:10 +00:00
Todd Lipcon f8f4269cd7 HDFS-4292. Sanity check not correct in RemoteBlockReader2.newBlockReader. Contributed by Binglin Chang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1419676 13f79535-47bb-0310-9956-ffa450edef68
2012-12-10 19:13:09 +00:00
Todd Lipcon 8fa6d8a074 HDFS-4291. edit log unit tests leave stray test_edit_log_file around. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1419664 13f79535-47bb-0310-9956-ffa450edef68
2012-12-10 18:55:06 +00:00
Uma Maheswara Rao G b5a959d39d HDFS-4130. BKJM: The reading for editlog at NN starting using bkjm is not efficient. Contributed by Han Xiao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1419661 13f79535-47bb-0310-9956-ffa450edef68
2012-12-10 18:52:35 +00:00
Aaron Myers 2e12de45a4 HDFS-4279. NameNode does not initialize generic conf keys when started with -recover. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1418560 13f79535-47bb-0310-9956-ffa450edef68
2012-12-07 23:54:31 +00:00
Suresh Srinivas 448882534b HDFS-4236. Merge change 1418356 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1418363 13f79535-47bb-0310-9956-ffa450edef68
2012-12-07 15:40:24 +00:00
Todd Lipcon 6fe949979a HDFS-4282. TestEditLog.testFuzzSequences FAILED in all pre-commit test. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1418212 13f79535-47bb-0310-9956-ffa450edef68
2012-12-07 08:17:38 +00:00
Aaron Myers 3607109ae1 HDFS-3680. Allow customized audit logging in HDFS FSNamesystem. Contributed by Marcelo Vanzin.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1418115 13f79535-47bb-0310-9956-ffa450edef68
2012-12-06 22:30:07 +00:00
Konstantin Shvachko f87b3c68bf HDFS-4268. Remove redundant enum NNHAStatusHeartbeat.State. Contributed by Konstantin Shvachko.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1417753 13f79535-47bb-0310-9956-ffa450edef68
2012-12-06 07:23:41 +00:00
Todd Lipcon 46f2591a9e HDFS-4238. Standby namenode should not do purging of shared storage edits. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1417652 13f79535-47bb-0310-9956-ffa450edef68
2012-12-05 21:18:16 +00:00
Todd Lipcon 4d57c660df HDFS-3935. Add JournalNode to the start/stop scripts. Contributed by Andy Isaacson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1417599 13f79535-47bb-0310-9956-ffa450edef68
2012-12-05 19:28:02 +00:00
Todd Lipcon 0bac725e19 HDFS-4153. Add START_MSG/SHUTDOWN_MSG for JournalNode. Contributed by Liang Xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1417598 13f79535-47bb-0310-9956-ffa450edef68
2012-12-05 19:26:39 +00:00
Todd Lipcon 9c19d236ef HDFS-4110. Refine a log printed in JNStorage. Contributed by Liang Xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1417597 13f79535-47bb-0310-9956-ffa450edef68
2012-12-05 19:24:47 +00:00
Todd Lipcon fd032dd9e3 Merge HDFS-3077 (QuorumJournalManager) backport into branch-2.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1417596 13f79535-47bb-0310-9956-ffa450edef68
2012-12-05 19:22:17 +00:00
Todd Lipcon 2f8a18ce95 HDFS-3571. Allow EditLogFileInputStream to read from a remote URL. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1417589 13f79535-47bb-0310-9956-ffa450edef68
2012-12-05 19:15:53 +00:00
Todd Lipcon 857c428a90 HDFS-3049. During the normal NN startup process, fall back on a different edit log if we see one that is corrupt. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1417588 13f79535-47bb-0310-9956-ffa450edef68
2012-12-05 19:13:29 +00:00
Aaron Myers d6a9d9f76c HDFS-4199. Provide test for HdfsVolumeId. Contributed by Ivan A. Veselovsky.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1417264 13f79535-47bb-0310-9956-ffa450edef68
2012-12-05 01:48:12 +00:00
Konstantin Shvachko f0a1fb73ff HDFS-4231. BackupNode: Introduce BackupState. Contributed by Konstantin Shvachko.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1416289 13f79535-47bb-0310-9956-ffa450edef68
2012-12-02 23:18:17 +00:00
Tsz-wo Sze 76029e926c svn merge -c 1416064 from trunk for HDFS-4248. Renaming directories may incorrectly remove the paths in leases under the tree.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1416066 13f79535-47bb-0310-9956-ffa450edef68
2012-12-01 22:41:17 +00:00
Daryn Sharp 85a5ad4bf9 svn merge -c 1416034 FIXES: HDFS-4247. saveNamespace should be tolerant of dangling lease (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1416035 13f79535-47bb-0310-9956-ffa450edef68
2012-12-01 18:23:55 +00:00
Tsz-wo Sze 5c0153d833 svn merge -c 1415799 from trunk for HDFS-4213. Add an API to hsync for updating the last block length at the namenode.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1415801 13f79535-47bb-0310-9956-ffa450edef68
2012-11-30 19:30:36 +00:00
Tsz-wo Sze 208cfa37a9 svn merge -c 1415480 from trunk for HDFS-4242. Map.Entry is incorrectly used in LeaseManager since the behavior of it is undefined after the iteration or modifications of the map.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1415481 13f79535-47bb-0310-9956-ffa450edef68
2012-11-30 02:52:03 +00:00
Aaron Myers e34575d076 HDFS-4214. OfflineEditsViewer should print out the offset at which it encountered an error. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1414505 13f79535-47bb-0310-9956-ffa450edef68
2012-11-28 01:41:28 +00:00
Tsz-wo Sze c14334d536 svn merge -c 1412237 from trunk for HDFS-4216. Do not ignore QuotaExceededException when adding symlinks.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1412244 13f79535-47bb-0310-9956-ffa450edef68
2012-11-21 19:33:46 +00:00
Thomas White 7a8bc99858 Merge -r 1412076:1412077 from trunk to branch-2. Fixes: HADOOP-9049. DelegationTokenRenewer needs to be Singleton and FileSystems should register/deregister to/from. Contributed by Karthik Kambatla.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1412079 13f79535-47bb-0310-9956-ffa450edef68
2012-11-21 12:37:42 +00:00
Eli Collins 5c7d4bd9f1 HADOOP-9042. Add a test for umask in FileSystemContractBaseTest. Contributed by Colin McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1411882 13f79535-47bb-0310-9956-ffa450edef68
2012-11-20 21:20:07 +00:00
Konstantin Shvachko 4688f839d2 HDFS-4179. BackupNode: allow reads, fix checkpointing, safeMode. Contributed by Konstantin Shvachko.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1411509 13f79535-47bb-0310-9956-ffa450edef68
2012-11-20 02:04:02 +00:00
Daryn Sharp 30b507934a svn merge -c 1411229 FIXES: HDFS-4178. Shell scripts should not close stderr (Andy Isaacson via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1411231 13f79535-47bb-0310-9956-ffa450edef68
2012-11-19 15:05:59 +00:00
Alejandro Abdelnur edf729ebed HDFS-4171. WebHDFS and HttpFs should accept only valid Unix user names. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1410828 13f79535-47bb-0310-9956-ffa450edef68
2012-11-18 05:34:52 +00:00
Eli Collins 7c4324f6bd Amend HDFS-4156.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1410827 13f79535-47bb-0310-9956-ffa450edef68
2012-11-18 05:25:13 +00:00
Eli Collins b4d01a0041 HDFS-4156. Seeking to a negative position should throw an IOE. Contributed by Eli Reisman
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1410813 13f79535-47bb-0310-9956-ffa450edef68
2012-11-18 02:19:16 +00:00
Jitendra Nath Pandey e90d0ef396 Merged r1410691 from trunk for HDFS-4105.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1410702 13f79535-47bb-0310-9956-ffa450edef68
2012-11-17 06:38:46 +00:00
Aaron Myers cd3e17fb0a HDFS-3507. DFS#isInSafeMode needs to execute only on Active NameNode. Contributed by Vinay.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1410590 13f79535-47bb-0310-9956-ffa450edef68
2012-11-16 21:59:54 +00:00