Commit Graph

4702 Commits

Author SHA1 Message Date
Alejandro Abdelnur 0f430e53fd MAPREDUCE-2264. Job status exceeds 100% in some cases. (devaraj.k and sandyr via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1440076 13f79535-47bb-0310-9956-ffa450edef68
2013-01-29 19:38:40 +00:00
Aaron Myers 33cee25aad HADOOP-9190. packaging docs is broken. Contributed by Andy Isaacson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439796 13f79535-47bb-0310-9956-ffa450edef68
2013-01-29 09:17:40 +00:00
Harsh J 203a9c0f72 Revert HADOOP-9241 properly this time. Left the core-default.xml in previous commit.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439750 13f79535-47bb-0310-9956-ffa450edef68
2013-01-29 05:36:45 +00:00
Harsh J 159b991e72 Reverting HADOOP-9241. To be fixed and reviewed.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439748 13f79535-47bb-0310-9956-ffa450edef68
2013-01-29 05:33:02 +00:00
Siddharth Seth c163dc2fce MAPREDUCE-4838. Add additional fields like Locality, Avataar to the JobHistory logs. Contributed by Zhijie Shen
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439714 13f79535-47bb-0310-9956-ffa450edef68
2013-01-29 00:21:58 +00:00
Kihwal Lee df10249669 YARN-133. Update web services docs for RM clusterMetrics. Contributed by Ravi Prakash.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439653 13f79535-47bb-0310-9956-ffa450edef68
2013-01-28 21:51:36 +00:00
Jason Darrell Lowe 1137fb06df HADOOP-9246. Execution phase for hadoop-maven-plugin should be process-resources. Contributed by Karthik Kambatla and Chris Nauroth
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439620 13f79535-47bb-0310-9956-ffa450edef68
2013-01-28 20:52:14 +00:00
Siddharth Seth 8a5fadc5a0 MAPREDUCE-4803. Remove duplicate copy of TestIndexCache. Contributed by Mariappan Asokan
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439590 13f79535-47bb-0310-9956-ffa450edef68
2013-01-28 19:18:35 +00:00
Thomas Graves 32cc389382 HADOOP-9255. relnotes.py missing last jira (tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439588 13f79535-47bb-0310-9956-ffa450edef68
2013-01-28 19:18:10 +00:00
Alejandro Abdelnur da4cab1099 Revering MAPREDUCE-2264
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439561 13f79535-47bb-0310-9956-ffa450edef68
2013-01-28 18:58:34 +00:00
Suresh Srinivas 58c0c6f069 HDFS-4444. Add space between total transaction time and number of transactions in FSEditLog#printStatistics. Contributed by Stephen Chu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439559 13f79535-47bb-0310-9956-ffa450edef68
2013-01-28 18:56:37 +00:00
Suresh Srinivas 7480aa8110 Move HADOOP-9247 to release 0.23.7 section in CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439539 13f79535-47bb-0310-9956-ffa450edef68
2013-01-28 18:05:31 +00:00
Harsh J 96d724b441 HADOOP-9241. DU refresh interval is not configurable. Contributed by Harsh J. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439129 13f79535-47bb-0310-9956-ffa450edef68
2013-01-27 17:52:16 +00:00
Harsh J 9639f37ee2 HDFS-4259. Improve pipeline DN replacement failure message. Contributed by Harsh J. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439126 13f79535-47bb-0310-9956-ffa450edef68
2013-01-27 17:42:25 +00:00
Tsz-wo Sze 86f6dfb338 HDFS-4443. Remove a trailing '`' character from the HTML code generated by NamenodeJspHelper.generateNodeData(..). Contributed by Christian Rohling
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1438808 13f79535-47bb-0310-9956-ffa450edef68
2013-01-26 01:17:45 +00:00
Alejandro Abdelnur 759a3fae86 Amending MR CHANGES.txt to reflect that MAPREDUCE-4049/4809/4807/4808 are in branch-2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1438799 13f79535-47bb-0310-9956-ffa450edef68
2013-01-26 00:44:56 +00:00
Suresh Srinivas 804ae2a692 HADOOP-9247. Parametrize Clover generateXxx properties to make them re-definable via -D in mvn calls. Contributed by Ivan A. Veselovsky.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1438698 13f79535-47bb-0310-9956-ffa450edef68
2013-01-25 20:53:17 +00:00
Alejandro Abdelnur f7d333c152 HADOOP-8857. hadoop.http.authentication.signature.secret.file docs should not state that secret is randomly generated. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1438601 13f79535-47bb-0310-9956-ffa450edef68
2013-01-25 17:27:50 +00:00
Alejandro Abdelnur 539153a679 MAPREDUCE-2264. Job status exceeds 100% in some cases. (devaraj.k and sandyr via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1438277 13f79535-47bb-0310-9956-ffa450edef68
2013-01-25 00:25:59 +00:00
Suresh Srinivas e625e6d296 HADOOP-9245. mvn clean without running mvn install before fails. Contributed by Karthik Kambatla.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1438239 13f79535-47bb-0310-9956-ffa450edef68
2013-01-24 22:35:12 +00:00
Suresh Srinivas 16acd69e58 HADOOP-9242. Duplicate surefire plugin config in hadoop-common. Contributed by Andrey Klochkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1438213 13f79535-47bb-0310-9956-ffa450edef68
2013-01-24 21:51:34 +00:00
Tsz-wo Sze cf7e9e7ef9 Add .classpath, .project, .settings and target to svn:ignore.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1437844 13f79535-47bb-0310-9956-ffa450edef68
2013-01-24 02:47:30 +00:00
Jason Darrell Lowe 2e9e7601e1 YARN-354. WebAppProxyServer exits immediately after startup. Contributed by Liang Xie
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1437775 13f79535-47bb-0310-9956-ffa450edef68
2013-01-23 22:05:55 +00:00
Suresh Srinivas a1e6df6bc4 HDFS-4426. Secondary namenode shuts down immediately after startup. Contributed by Arpit Agarwal.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1437627 13f79535-47bb-0310-9956-ffa450edef68
2013-01-23 19:00:39 +00:00
Thomas White 345bcee066 YARN-319. Submitting a job to a fair scheduler queue for which the user does not have permission causes the client to wait forever. Contributed by shenhong.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1437336 13f79535-47bb-0310-9956-ffa450edef68
2013-01-23 10:53:05 +00:00
Hitesh Shah 29ddce96a2 YARN-231. RM Restart - Add FS-based persistent store implementation for RMStateStore. Contributed by Bikas Saha
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1437245 13f79535-47bb-0310-9956-ffa450edef68
2013-01-23 00:57:37 +00:00
Hitesh Shah f5551bf809 YARN-277. Use AMRMClient in DistributedShell to exemplify the approach. Contributed by Bikas Saha
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1437156 13f79535-47bb-0310-9956-ffa450edef68
2013-01-22 20:49:09 +00:00
Suresh Srinivas 937ab16736 HADOOP-9231. Add missing CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1437143 13f79535-47bb-0310-9956-ffa450edef68
2013-01-22 20:16:49 +00:00
Suresh Srinivas 8535747cea HADOOP-9231. Parametrize staging URL for the uniformity of distributionManagement. Contributed by Konstantin Boudnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1437140 13f79535-47bb-0310-9956-ffa450edef68
2013-01-22 20:09:48 +00:00
Siddharth Seth 74ffc7a74d MAPREDUCE-4946. Fix a performance problem for large jobs by reducing the number of map completion event type conversions. Contributed by Jason Lowe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1437103 13f79535-47bb-0310-9956-ffa450edef68
2013-01-22 19:07:08 +00:00
Alejandro Abdelnur bb81a17e0b MAPREDUCE-4949. Enable multiple pi jobs to run in parallel. (sandyr via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1437029 13f79535-47bb-0310-9956-ffa450edef68
2013-01-22 16:26:29 +00:00
Alejandro Abdelnur 73fd247c76 MAPREDUCE-4808. Refactor MapOutput and MergeManager to facilitate reuse by Shuffle implementations. (masokan via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1436936 13f79535-47bb-0310-9956-ffa450edef68
2013-01-22 14:10:42 +00:00
Todd Lipcon cfae13306a HDFS-4403. DFSClient can infer checksum type when not provided by reading first byte. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1436730 13f79535-47bb-0310-9956-ffa450edef68
2013-01-22 02:59:25 +00:00
Suresh Srinivas c5b01ce424 HADOOP-8924. Add CHANGES.txt description missed in commit r1435380.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1436181 13f79535-47bb-0310-9956-ffa450edef68
2013-01-21 03:49:00 +00:00
Jonathan Turner Eagles 88c7fdd065 MAPREDUCE-4458. Warn if java.library.path is used for AM or Task (Robert Parker via jeagles)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1435386 13f79535-47bb-0310-9956-ffa450edef68
2013-01-18 22:41:19 +00:00
Suresh Srinivas ae270e72cf HADOOP-8924. Add maven plugin alternative to shell script to save package-info.java. Contributed by Alejandro Abdelnur and Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1435380 13f79535-47bb-0310-9956-ffa450edef68
2013-01-18 22:35:58 +00:00
Suresh Srinivas f8cca2df8a HADOOP-8924. Revert r1435372 that missed some files
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1435379 13f79535-47bb-0310-9956-ffa450edef68
2013-01-18 22:32:49 +00:00
Suresh Srinivas 98db9f5930 HADOOP-8924. Add maven plugin alternative to shell script to save package-info.java. Contributed by Alejandro Abdelnur and Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1435372 13f79535-47bb-0310-9956-ffa450edef68
2013-01-18 22:18:12 +00:00
Siddharth Seth 76f9af4ccf MAPREDUCE-4948. Fix a failing unit test - TestYARNRunner.testHistoryServerToken. Contributed by Junping Du
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1435312 13f79535-47bb-0310-9956-ffa450edef68
2013-01-18 19:30:00 +00:00
Aaron Myers d3d350ef0f HDFS-4359. Slow RPC responses from NN can prevent metrics collection on DNs. Contributed by liang xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1435299 13f79535-47bb-0310-9956-ffa450edef68
2013-01-18 18:39:24 +00:00
Alejandro Abdelnur f85b583731 YARN-302. Fair scheduler assignmultiple should default to false. (sandyr via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434996 13f79535-47bb-0310-9956-ffa450edef68
2013-01-18 00:48:22 +00:00
Alejandro Abdelnur 1c308188bb MAPREDUCE-4923. Add toString method to TaggedInputSplit. (sandyr via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434993 13f79535-47bb-0310-9956-ffa450edef68
2013-01-18 00:40:58 +00:00
Alejandro Abdelnur c9dd4fa67f YARN-331. Fill in missing fair scheduler documentation. (sandyr via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434990 13f79535-47bb-0310-9956-ffa450edef68
2013-01-18 00:37:23 +00:00
Aaron Myers b3b9485271 HDFS-4415. HostnameFilter should handle hostname resolution failures and continue processing. Contributed by Robert Kanter.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434951 13f79535-47bb-0310-9956-ffa450edef68
2013-01-17 23:08:47 +00:00
Robert Joseph Evans 5c5e6ed13a HADOOP-8849. FileUtil#fullyDelete should grant the target directories +rwx permissions (Ivan A. Veselovsky via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434868 13f79535-47bb-0310-9956-ffa450edef68
2013-01-17 19:19:10 +00:00
Suresh Srinivas 8f70a25b1c HDFS-4393. Make empty request and responses in protocol translators can be static final members. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434844 13f79535-47bb-0310-9956-ffa450edef68
2013-01-17 18:21:29 +00:00
Todd Lipcon db17fadd38 HADOOP-9216. CompressionCodecFactory#getCodecClasses should trim the result of parsing by Configuration. Contributed by Tsuyoshi Ozawa.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434569 13f79535-47bb-0310-9956-ffa450edef68
2013-01-17 07:19:41 +00:00
Todd Lipcon e322e0a05f HADOOP-9215. when using cmake-2.6, libhadoop.so doesn't get created (only libhadoop.so.1.0.0). Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434530 13f79535-47bb-0310-9956-ffa450edef68
2013-01-17 01:37:41 +00:00
Todd Lipcon c0e7c58e79 HADOOP-9193. hadoop script can inadvertently expand wildcard arguments when delegating to hdfs script. Contributed by Andy Isaacson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434450 13f79535-47bb-0310-9956-ffa450edef68
2013-01-16 22:29:53 +00:00
Daryn Sharp 74e86c0401 HADOOP-8999. Move to incompatible section of changelog
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434370 13f79535-47bb-0310-9956-ffa450edef68
2013-01-16 20:34:03 +00:00