Commit Graph

478 Commits

Author SHA1 Message Date
Tsz-wo Sze 83cf475050 HDFS-744. Support hsync in HDFS. Contributed by Lars Hofhans
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344419 13f79535-47bb-0310-9956-ffa450edef68
2012-05-30 19:10:09 +00:00
Harsh J e576bac2f7 HADOOP-8444. Fix the tests FSMainOperationsBaseTest.java and FileContextMainOperationsBaseTest.java to avoid potential test failure. Contributed by Madhukara Phatak. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343732 13f79535-47bb-0310-9956-ffa450edef68
2012-05-29 14:12:17 +00:00
Harsh J d2b57e00bc HADOOP-8358. Config-related WARN for dfs.web.ugi can be avoided. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343290 13f79535-47bb-0310-9956-ffa450edef68
2012-05-28 15:36:00 +00:00
Harsh J 4709160d75 HADOOP-6871. When the value of a configuration key is set to its unresolved form, it causes an IllegalStateException in Configuration.get() stating that substitution depth is too large. Contributed by Arvind Prabhakar (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342626 13f79535-47bb-0310-9956-ffa450edef68
2012-05-25 14:02:01 +00:00
Harsh J ceaf168dc7 HADOOP-7659. fs -getmerge isn't guaranteed to work well over non-HDFS filesystems (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342600 13f79535-47bb-0310-9956-ffa450edef68
2012-05-25 12:46:22 +00:00
Harsh J e62a76a40c HADOOP-8323. Add javadoc and tests for Text.clear() behavior (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342514 13f79535-47bb-0310-9956-ffa450edef68
2012-05-25 06:38:16 +00:00
Harsh J 458be39423 HADOOP-8415. Add getDouble() and setDouble() in org.apache.hadoop.conf.Configuration. Contributed by Jan van der Lugt. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342501 13f79535-47bb-0310-9956-ffa450edef68
2012-05-25 06:06:01 +00:00
Eli Collins 22cb0ec82a HADOOP-8422. Deprecate FileSystem#getDefault* and getServerDefault methods that don't take a Path argument. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342495 13f79535-47bb-0310-9956-ffa450edef68
2012-05-25 04:10:15 +00:00
Todd Lipcon 6c544adeb3 Merge HDFS-3042 (automatic failover) to trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342112 13f79535-47bb-0310-9956-ffa450edef68
2012-05-24 00:56:20 +00:00
Sanjay Radia 266a0f1de9 HADOOP-8367 Improve documentation of declaringClassProtocolName in rpc headers (Sanjay Radia)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342051 13f79535-47bb-0310-9956-ffa450edef68
2012-05-23 21:16:39 +00:00
Aaron Myers 23b96766ad Amend HADOOP-8408 per Daryn's post-commit feedback.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341338 13f79535-47bb-0310-9956-ffa450edef68
2012-05-22 07:50:00 +00:00
Todd Lipcon 1a3bd5d42f Merge trunk into auto-HA branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1340622 13f79535-47bb-0310-9956-ffa450edef68
2012-05-20 06:12:14 +00:00
Eli Collins eae281c130 HADOOP-8408. MR doesn't work with a non-default ViewFS mount table and security enabled. Contributed by Aaron T. Myers
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339970 13f79535-47bb-0310-9956-ffa450edef68
2012-05-18 04:20:28 +00:00
Eli Collins fe07758ad0 HADOOP-8287. etc/hadoop is missing hadoop-env.sh. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339906 13f79535-47bb-0310-9956-ffa450edef68
2012-05-17 22:47:41 +00:00
Harsh J e1f09365ca HADOOP-8360. empty-configuration.xml fails xml validation. Contributed by Radim Kolar. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339613 13f79535-47bb-0310-9956-ffa450edef68
2012-05-17 14:20:07 +00:00
Aaron Myers 1377709b4c HDFS-3433. GetImageServlet should allow administrative requestors when security is enabled. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339540 13f79535-47bb-0310-9956-ffa450edef68
2012-05-17 10:23:18 +00:00
Todd Lipcon 026d0b4d53 HADOOP-8406. CompressionCodecFactory.CODEC_PROVIDERS iteration is thread-unsafe. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339476 13f79535-47bb-0310-9956-ffa450edef68
2012-05-17 04:28:35 +00:00
Todd Lipcon 7b1d347b43 HADOOP-8405. ZKFC tests leak ZK instances. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1339435 13f79535-47bb-0310-9956-ffa450edef68
2012-05-17 00:38:59 +00:00
Todd Lipcon 0600e834be HDFS-3432. TestDFSZKFailoverController tries to fail over too early. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1339434 13f79535-47bb-0310-9956-ffa450edef68
2012-05-17 00:36:13 +00:00
Todd Lipcon e14e10fb86 Merge trunk into auto-HA branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1339410 13f79535-47bb-0310-9956-ffa450edef68
2012-05-16 22:47:37 +00:00
Alejandro Abdelnur c743168bf2 HADOOP-8393. hadoop-config.sh missing variable exports, causes Yarn jobs to fail with ClassNotFoundException MRAppMaster. (phunt via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338998 13f79535-47bb-0310-9956-ffa450edef68
2012-05-16 04:12:46 +00:00
Todd Lipcon 52ecdb751e HDFS-3412. Fix findbugs warnings in auto-HA branch. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1338817 13f79535-47bb-0310-9956-ffa450edef68
2012-05-15 18:16:49 +00:00
Eli Collins b64cd82a34 HADOOP-8398. Cleanup BlockLocation. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338806 13f79535-47bb-0310-9956-ffa450edef68
2012-05-15 17:25:49 +00:00
Harsh J f22276ee3f HADOOP-8297. Writable javadocs don't carry default constructor (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338557 13f79535-47bb-0310-9956-ffa450edef68
2012-05-15 06:42:42 +00:00
Todd Lipcon 4cd70e87be Merge trunk into auto-HA branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1337645 13f79535-47bb-0310-9956-ffa450edef68
2012-05-12 20:52:34 +00:00
Harsh J 810ae618fd HADOOP-8395. Text shell command unnecessarily demands that a SequenceFile's key class be WritableComparable (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337449 13f79535-47bb-0310-9956-ffa450edef68
2012-05-12 06:03:39 +00:00
Eli Collins f092e9fc8a HADOOP-8224. Don't hardcode hdfs.audit.logger in the scripts. Contributed by Tomohiko Kinebuchi
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337339 13f79535-47bb-0310-9956-ffa450edef68
2012-05-11 19:25:07 +00:00
Eli Collins e2af2f1b87 HADOOP-8316. Audit logging should be disabled by default. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337334 13f79535-47bb-0310-9956-ffa450edef68
2012-05-11 19:21:57 +00:00
Sanjay Radia 2116f28d9e HADOOP-8366 Use ProtoBuf for RpcResponseHeader (sanjay radia)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337283 13f79535-47bb-0310-9956-ffa450edef68
2012-05-11 16:56:52 +00:00
Eli Collins 235a28874b HADOOP-8276. Auto-HA: add config for java options to pass to zkfc daemon. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1337276 13f79535-47bb-0310-9956-ffa450edef68
2012-05-11 16:45:59 +00:00
Aaron Myers cc9c6bdce2 HADOOP-8353. hadoop-daemon.sh and yarn-daemon.sh can be misleading on stop. Contributed by Roman Shaposhnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337251 13f79535-47bb-0310-9956-ffa450edef68
2012-05-11 16:15:18 +00:00
Thomas White aea890f7d2 MAPREDUCE-4148. MapReduce should not have a compile-time dependency on HDFS.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337199 13f79535-47bb-0310-9956-ffa450edef68
2012-05-11 15:00:48 +00:00
Eli Collins dfd733401d HADOOP-8388. Remove unused BlockLocation serialization. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336966 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 23:48:12 +00:00
Eli Collins 1a4539abf7 Remove SHORT_STRING_MAX, left out of the previous commit.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336946 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 23:17:29 +00:00
Eli Collins 032216a3a7 HADOOP-8361. Avoid out-of-memory problems when deserializing strings. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336945 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 23:15:53 +00:00
Aaron Myers f5960f71d9 HDFS-3395. NN doesn't start with HA+security enabled and HTTP address set to 0.0.0.0. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336690 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 13:49:06 +00:00
Eli Collins 1849fde096 HADOOP-7868. Hadoop native fails to compile when default linker option is -Wl,--as-needed. Contributed by Trevor Robinson
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336491 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 06:16:01 +00:00
Todd Lipcon b75f0187c8 HDFS-3341, HADOOP-8340. SNAPSHOT build versions should compare as less than their eventual release. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336459 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 00:30:53 +00:00
Suresh Srinivas 1ceecf2aa2 HADOOP-8372. NetUtils.normalizeHostName() incorrectly handles hostname starting with a numeric character. Contributed by Junping Du.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336446 13f79535-47bb-0310-9956-ffa450edef68
2012-05-09 23:18:15 +00:00
Robert Joseph Evans c853a425a0 HADOOP-8373. Port RPC.getServerAddress to 0.23 (Daryn Sharp via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336299 13f79535-47bb-0310-9956-ffa450edef68
2012-05-09 17:06:27 +00:00
Tsz-wo Sze 07280c9761 HADOOP-8359. Fix javadoc warnings in Configuration. Contributed by Anupam Seth
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335258 13f79535-47bb-0310-9956-ffa450edef68
2012-05-07 21:11:01 +00:00
Thomas White 35a33067bb HADOOP-8328. Duplicate FileSystem Statistics object for 'file' scheme.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335085 13f79535-47bb-0310-9956-ffa450edef68
2012-05-07 16:00:56 +00:00
Harsh J e7d03636a0 HADOOP-8323. Revert HADOOP-7940, cause it may cause a performance regression. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334603 13f79535-47bb-0310-9956-ffa450edef68
2012-05-06 11:20:16 +00:00
Aaron Myers 51e520c68a HADOOP-8349. ViewFS doesn't work when the root of a file system is mounted. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334231 13f79535-47bb-0310-9956-ffa450edef68
2012-05-04 22:14:10 +00:00
Eli Collins 5dbbe0e0a5 HDFS-2617. Replaced Kerberized SSL for image transfer and fsck with SPNEGO-based solution. Contributed by Jakob Homan, Alejandro Abdelnur, and Aaron T. Myers
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334216 13f79535-47bb-0310-9956-ffa450edef68
2012-05-04 21:58:44 +00:00
Alejandro Abdelnur a70587f368 HADOOP-8343. Allow configuration of authorization for JmxJsonServlet and MetricsServlet (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333750 13f79535-47bb-0310-9956-ffa450edef68
2012-05-04 03:31:44 +00:00
Alejandro Abdelnur af66607406 HADOOP-8356. FileSystem service loading mechanism should print the FileSystem impl it is failing to load (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333744 13f79535-47bb-0310-9956-ffa450edef68
2012-05-04 03:10:26 +00:00
Todd Lipcon 6b58fa6494 Amend previous commit of HADOOP-8350 (missed new SocketInputWrapper file)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333650 13f79535-47bb-0310-9956-ffa450edef68
2012-05-03 21:58:08 +00:00
Todd Lipcon 03181022ab HADOOP-8350. Improve NetUtils.getInputStream to return a stream which has a tunable timeout. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333649 13f79535-47bb-0310-9956-ffa450edef68
2012-05-03 21:57:10 +00:00
Eli Collins d948998777 HADOOP-8347. Hadoop Common logs misspell 'successful'. Contributed by Philip Zeyliger
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333321 13f79535-47bb-0310-9956-ffa450edef68
2012-05-03 06:35:45 +00:00