Commit Graph

722 Commits

Author SHA1 Message Date
Tsz-wo Sze 87fee9cb2a MAPREDUCE-2588. Change raid to the new DataTransferProtocol API.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1135209 13f79535-47bb-0310-9956-ffa450edef68
2011-06-13 18:16:45 +00:00
Todd Lipcon adfa76a8a1 Add HADOOP-7106 to CHANGES.txt for trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1135001 13f79535-47bb-0310-9956-ffa450edef68
2011-06-12 23:04:43 +00:00
Todd Lipcon a196766ea0 HADOOP-7106. Reorganize SVN layout to combine HDFS, Common, and MR in a single tree (project unsplit)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1134994 13f79535-47bb-0310-9956-ffa450edef68
2011-06-12 22:00:51 +00:00
Eli Collins a285fb5eff HADOOP-7374. Don't add tools.jar to the classpath when running Hadoop. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1134861 13f79535-47bb-0310-9956-ffa450edef68
2011-06-12 04:13:40 +00:00
Eli Collins b39e5f93f5 HADOOP-7383. HDFS needs to export protobuf library dependency in pom. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1134857 13f79535-47bb-0310-9956-ffa450edef68
2011-06-12 03:29:25 +00:00
Eli Collins 50688744ba HADOOP-7375. Add resolvePath method to FileContext. Contributed by Sanjay Radia
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1134854 13f79535-47bb-0310-9956-ffa450edef68
2011-06-12 01:36:13 +00:00
Eli Collins 245c628819 HADOOP-1886. Undocumented parameters in FilesSystem. Contributed by Frank Conrad
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1134218 13f79535-47bb-0310-9956-ffa450edef68
2011-06-10 07:43:30 +00:00
Thomas White 8576c3984b HADOOP-7323. Add capability to resolve compression codec based on codec name. Contributed by Alejandro Abdelnur.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1133125 13f79535-47bb-0310-9956-ffa450edef68
2011-06-07 18:31:26 +00:00
Todd Lipcon cde5b33ba2 HADOOP-7356. RPM packages broke bin/hadoop script in developer environment. Contributed by Eric Yang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1132776 13f79535-47bb-0310-9956-ffa450edef68
2011-06-06 21:15:42 +00:00
Todd Lipcon 8336b05ec8 HADOOP-7325. The hadoop command should not accept class names starting with a hyphen. Contributed by Brock Noland.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1132769 13f79535-47bb-0310-9956-ffa450edef68
2011-06-06 20:58:14 +00:00
Todd Lipcon 44a35b5d9a HADOOP-7353. Cleanup FsShell and prevent masking of RTE stack traces. Contributed by Daryn Sharp.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1132764 13f79535-47bb-0310-9956-ffa450edef68
2011-06-06 20:53:37 +00:00
Eli Collins 0bcd7e9f86 HADOOP-7335. Force entropy to come from non-true random for tests. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1132511 13f79535-47bb-0310-9956-ffa450edef68
2011-06-06 01:21:03 +00:00
Todd Lipcon a7a3653b70 HADOOP-7341. Fix options parsing in CommandFormat. Contributed by Daryn Sharp.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1132505 13f79535-47bb-0310-9956-ffa450edef68
2011-06-05 23:42:39 +00:00
Matthew Foley a94b6a0529 HADOOP-7342. Add an utility API in FileUtil for JDK File.list avoid NPEs on File.list(). Contributed by Bharath Mundlapudi.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1131330 13f79535-47bb-0310-9956-ffa450edef68
2011-06-04 06:50:44 +00:00
Christopher Douglas babd19de33 HADOOP-7144. Expose JMX metrics via JSON servlet.
Contributed by Robert Joseph Evans


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1131289 13f79535-47bb-0310-9956-ffa450edef68
2011-06-03 23:40:53 +00:00
Eli Collins 01b83a1e32 HADOOP-7316. Add public javadocs to FSDataInputStream and FSDataOutputStream. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1131268 13f79535-47bb-0310-9956-ffa450edef68
2011-06-03 22:25:52 +00:00
Todd Lipcon 90a9262611 HADOOP-7346. Send back nicer error message to clients using outdated IPC version. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1131254 13f79535-47bb-0310-9956-ffa450edef68
2011-06-03 21:36:17 +00:00
Todd Lipcon 1e8c213e18 HADOOP-7331. Make hadoop-daemon.sh return exit code 1 if daemon processes did not get started. Contributed by Tanping Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1130833 13f79535-47bb-0310-9956-ffa450edef68
2011-06-02 21:42:56 +00:00
Todd Lipcon 8ed5d34214 HADOOP-7349. HADOOP-7121 accidentally disabled some tests in TestIPC. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1130758 13f79535-47bb-0310-9956-ffa450edef68
2011-06-02 19:23:43 +00:00
Michael Stack 3c863fada4 HADOOP-7351 Regression: HttpServer#getWebAppsPath used to be protected so subclasses could supply alternate webapps path but it was made private by HADOOP-6461 -- Fix commit message; I'd put it in wrong location under 'new features' rather than under 'bugs'
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1130738 13f79535-47bb-0310-9956-ffa450edef68
2011-06-02 19:01:53 +00:00
Michael Stack f4598b3f08 HADOOP-7351 Regression: HttpServer#getWebAppsPath used to be protected so subclasses could supply alternate webapps path but it was made private by HADOOP-6461
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1130730 13f79535-47bb-0310-9956-ffa450edef68
2011-06-02 18:56:32 +00:00
Michael Stack 01b24a077a HADOOP-7355 Add audience and stability annotations to HttpServer class
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1130729 13f79535-47bb-0310-9956-ffa450edef68
2011-06-02 18:54:40 +00:00
Sanjay Radia 3db6c4a944 HADOOP-7284 Trash and shell's rm does not work for viewfs
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1129989 13f79535-47bb-0310-9956-ffa450edef68
2011-06-01 03:27:23 +00:00
Todd Lipcon e05a6d1dce HADOOP-7121. Exceptions while serializing IPC call responses are not handled well. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1129982 13f79535-47bb-0310-9956-ffa450edef68
2011-06-01 02:00:57 +00:00
Jitendra Nath Pandey fe45b6ed79 HADOOP-7336. TestFileContextResolveAfs will fail with default test.build.data property.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1129905 13f79535-47bb-0310-9956-ffa450edef68
2011-05-31 20:29:09 +00:00
Todd Lipcon b0c968e2b9 HADOOP-7208. Fix implementation of equals() and hashCode() in StandardSocketFactory. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1129840 13f79535-47bb-0310-9956-ffa450edef68
2011-05-31 18:41:33 +00:00
Tsz-wo Sze 0317cf74cd HADOOP-7337. Change PureJavaCrc32 annotations to public stable.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1128789 13f79535-47bb-0310-9956-ffa450edef68
2011-05-28 22:29:54 +00:00
Eli Collins 5ec9e9e0a2 HADOOP-7276. Hadoop native builds fail on ARM due to -m32. Contributed by Trevor Robinson
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1128475 13f79535-47bb-0310-9956-ffa450edef68
2011-05-27 21:46:37 +00:00
Todd Lipcon 6891b254f4 HADOOP-7333. Performance improvement in PureJavaCrc32. Contributed by Eric Caspole.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1128425 13f79535-47bb-0310-9956-ffa450edef68
2011-05-27 18:58:14 +00:00
Owen O'Malley dec6fcdb00 HADOOP-6255. Create RPM and Debian packages for common. Changes deployment
layout to be consistent across the binary tgz, rpm, and deb. Adds setup
scripts for easy one node cluster configuration and user creation.
(Eric Yang via omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1128385 13f79535-47bb-0310-9956-ffa450edef68
2011-05-27 16:35:02 +00:00
Todd Lipcon 7df9a15ea6 HADOOP-7312. Update value of hadoop.common.configuration.version. Contributed by Harsh J Chouraria.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1128003 13f79535-47bb-0310-9956-ffa450edef68
2011-05-26 17:43:05 +00:00
Todd Lipcon 2f6c03ad54 HADOOP-7146. RPC server leaks file descriptors. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1127811 13f79535-47bb-0310-9956-ffa450edef68
2011-05-26 07:48:03 +00:00
Matthew Foley 42a185b57d HADOOP-7322. Adding a util method in FileUtil for directory listing, avoid NPEs on File.listFiles(). Contributed by Bharath Mundlapudi.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1127697 13f79535-47bb-0310-9956-ffa450edef68
2011-05-25 21:51:35 +00:00
Todd Lipcon e79d8afcd0 Revert HADOOP-7284 (r1127642) since it broke the HDFS build.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1127679 13f79535-47bb-0310-9956-ffa450edef68
2011-05-25 20:45:27 +00:00
Sanjay Radia 1596a106e4 HADOOP-7284 Trash and shell's rm does not work for viewfs (Sanjay Radia)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1127642 13f79535-47bb-0310-9956-ffa450edef68
2011-05-25 19:23:18 +00:00
Todd Lipcon 77b4fd6572 HADOOP-7320. Refactor the copy and move commands to conform to new FsCommand class. Contributed by Daryn Sharp.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1127591 13f79535-47bb-0310-9956-ffa450edef68
2011-05-25 17:29:20 +00:00
Todd Lipcon a7ce0bbf8a HADOOP-7329. Improve help message for "df" to include "-h" flag. Contributed by Xie Xianshan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1127576 13f79535-47bb-0310-9956-ffa450edef68
2011-05-25 16:32:58 +00:00
Owen O'Malley 1e7fd0c23c HADOOP-7258. The Gzip codec should not return null decompressors. (omalley)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1127215 13f79535-47bb-0310-9956-ffa450edef68
2011-05-24 18:48:37 +00:00
Todd Lipcon f8841bea4d HADOOP-7287. Configuration deprecation mechanism doesn't work properly for GenericOptionsParser and Tools. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1126719 13f79535-47bb-0310-9956-ffa450edef68
2011-05-23 20:30:48 +00:00
Eli Collins 18ac8283b6 HADOOP-7318. MD5Hash factory should reset the digester it returns. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1126287 13f79535-47bb-0310-9956-ffa450edef68
2011-05-23 01:27:43 +00:00
Todd Lipcon 088693f0a0 HADOOP-7302. webinterface.private.actions should be renamed and moved to the MapReduce project. Contributed by Ari Rabkin.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1125221 13f79535-47bb-0310-9956-ffa450edef68
2011-05-20 03:37:03 +00:00
Todd Lipcon 4977f4bfe3 HADOOP-7306. Start metrics system even if config files are missing. Contributed by Luke Lu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1125216 13f79535-47bb-0310-9956-ffa450edef68
2011-05-20 03:22:03 +00:00
Todd Lipcon 2a0bbd9979 HADOOP-7305. Eclipse project classpath should include tools.jar from JDK. Contributed by Niels Basjes.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1125051 13f79535-47bb-0310-9956-ffa450edef68
2011-05-19 18:47:12 +00:00
Christopher Douglas da15b2118c HADOOP-6832. Add an authentication plugin using a configurable static user
for the web UI. Contributed by Owen O'Malley and Todd Lipcon


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1125043 13f79535-47bb-0310-9956-ffa450edef68
2011-05-19 18:32:39 +00:00
Eli Collins ef543e386d HADOOP-7137. Remove hod contrib docs. Contributed by Nigel Daley
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1124456 13f79535-47bb-0310-9956-ffa450edef68
2011-05-18 22:41:05 +00:00
Eli Collins 14fd85cdc5 HADOOP-7301. FSDataInputStream should expose a getWrappedStream method. Contributed by Jonathan Hsieh
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1124406 13f79535-47bb-0310-9956-ffa450edef68
2011-05-18 20:17:16 +00:00
Todd Lipcon d1eaaf30e2 HADOOP-7300. Configuration methods that return collections are inconsistent about mutability. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1124368 13f79535-47bb-0310-9956-ffa450edef68
2011-05-18 18:30:04 +00:00
Tsz-wo Sze 31a77f91cf HADOOP-7282. ipc.Server.getRemoteIp() may return null. Contributed by John George
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1104426 13f79535-47bb-0310-9956-ffa450edef68
2011-05-17 17:41:14 +00:00
Thomas White 2e6063b006 HADOOP-7296. The FsPermission(FsPermission) constructor does not use the sticky bit. Contributed by Siddharth Seth
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1104374 13f79535-47bb-0310-9956-ffa450edef68
2011-05-17 16:10:41 +00:00
Todd Lipcon af8be47f26 HADOOP-7292. Fix racy test case TestSinkQueue. Contributed by Luke Lu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1103971 13f79535-47bb-0310-9956-ffa450edef68
2011-05-17 01:08:08 +00:00