Commit Graph

4868 Commits

Author SHA1 Message Date
Siddharth Seth c163dc2fce MAPREDUCE-4838. Add additional fields like Locality, Avataar to the JobHistory logs. Contributed by Zhijie Shen
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439714 13f79535-47bb-0310-9956-ffa450edef68
2013-01-29 00:21:58 +00:00
Kihwal Lee df10249669 YARN-133. Update web services docs for RM clusterMetrics. Contributed by Ravi Prakash.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439653 13f79535-47bb-0310-9956-ffa450edef68
2013-01-28 21:51:36 +00:00
Jason Darrell Lowe 1137fb06df HADOOP-9246. Execution phase for hadoop-maven-plugin should be process-resources. Contributed by Karthik Kambatla and Chris Nauroth
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439620 13f79535-47bb-0310-9956-ffa450edef68
2013-01-28 20:52:14 +00:00
Siddharth Seth 8a5fadc5a0 MAPREDUCE-4803. Remove duplicate copy of TestIndexCache. Contributed by Mariappan Asokan
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439590 13f79535-47bb-0310-9956-ffa450edef68
2013-01-28 19:18:35 +00:00
Thomas Graves 32cc389382 HADOOP-9255. relnotes.py missing last jira (tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439588 13f79535-47bb-0310-9956-ffa450edef68
2013-01-28 19:18:10 +00:00
Alejandro Abdelnur da4cab1099 Revering MAPREDUCE-2264
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439561 13f79535-47bb-0310-9956-ffa450edef68
2013-01-28 18:58:34 +00:00
Suresh Srinivas 58c0c6f069 HDFS-4444. Add space between total transaction time and number of transactions in FSEditLog#printStatistics. Contributed by Stephen Chu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439559 13f79535-47bb-0310-9956-ffa450edef68
2013-01-28 18:56:37 +00:00
Suresh Srinivas 7480aa8110 Move HADOOP-9247 to release 0.23.7 section in CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439539 13f79535-47bb-0310-9956-ffa450edef68
2013-01-28 18:05:31 +00:00
Harsh J 96d724b441 HADOOP-9241. DU refresh interval is not configurable. Contributed by Harsh J. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439129 13f79535-47bb-0310-9956-ffa450edef68
2013-01-27 17:52:16 +00:00
Harsh J 9639f37ee2 HDFS-4259. Improve pipeline DN replacement failure message. Contributed by Harsh J. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439126 13f79535-47bb-0310-9956-ffa450edef68
2013-01-27 17:42:25 +00:00
Tsz-wo Sze 86f6dfb338 HDFS-4443. Remove a trailing '`' character from the HTML code generated by NamenodeJspHelper.generateNodeData(..). Contributed by Christian Rohling
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1438808 13f79535-47bb-0310-9956-ffa450edef68
2013-01-26 01:17:45 +00:00
Alejandro Abdelnur 759a3fae86 Amending MR CHANGES.txt to reflect that MAPREDUCE-4049/4809/4807/4808 are in branch-2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1438799 13f79535-47bb-0310-9956-ffa450edef68
2013-01-26 00:44:56 +00:00
Suresh Srinivas 804ae2a692 HADOOP-9247. Parametrize Clover generateXxx properties to make them re-definable via -D in mvn calls. Contributed by Ivan A. Veselovsky.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1438698 13f79535-47bb-0310-9956-ffa450edef68
2013-01-25 20:53:17 +00:00
Alejandro Abdelnur f7d333c152 HADOOP-8857. hadoop.http.authentication.signature.secret.file docs should not state that secret is randomly generated. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1438601 13f79535-47bb-0310-9956-ffa450edef68
2013-01-25 17:27:50 +00:00
Aaron Myers c0e16efe91 HDFS-4440. Avoid annoying log message when dfs.domain.socket.path is not set. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1438280 13f79535-47bb-0310-9956-ffa450edef68
2013-01-25 00:44:37 +00:00
Aaron Myers 554774c6d1 HDFS-4438. TestDomainSocket fails when system umask is set to 0002. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1438279 13f79535-47bb-0310-9956-ffa450edef68
2013-01-25 00:39:02 +00:00
Alejandro Abdelnur 539153a679 MAPREDUCE-2264. Job status exceeds 100% in some cases. (devaraj.k and sandyr via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1438277 13f79535-47bb-0310-9956-ffa450edef68
2013-01-25 00:25:59 +00:00
Suresh Srinivas e625e6d296 HADOOP-9245. mvn clean without running mvn install before fails. Contributed by Karthik Kambatla.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1438239 13f79535-47bb-0310-9956-ffa450edef68
2013-01-24 22:35:12 +00:00
Suresh Srinivas 16acd69e58 HADOOP-9242. Duplicate surefire plugin config in hadoop-common. Contributed by Andrey Klochkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1438213 13f79535-47bb-0310-9956-ffa450edef68
2013-01-24 21:51:34 +00:00
Tsz-wo Sze cf7e9e7ef9 Add .classpath, .project, .settings and target to svn:ignore.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1437844 13f79535-47bb-0310-9956-ffa450edef68
2013-01-24 02:47:30 +00:00
Todd Lipcon f5ab88b5b7 Fix trivial javadoc warning on branch
(javadoc references parameter 'defaultVal' but it is actually 'defaultValue')


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1437797 13f79535-47bb-0310-9956-ffa450edef68
2013-01-23 23:18:57 +00:00
Jason Darrell Lowe 2e9e7601e1 YARN-354. WebAppProxyServer exits immediately after startup. Contributed by Liang Xie
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1437775 13f79535-47bb-0310-9956-ffa450edef68
2013-01-23 22:05:55 +00:00
Todd Lipcon 4e74c52e60 HDFS-4433. Make TestPeerCache not flaky. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1437680 13f79535-47bb-0310-9956-ffa450edef68
2013-01-23 20:01:33 +00:00
Suresh Srinivas a1e6df6bc4 HDFS-4426. Secondary namenode shuts down immediately after startup. Contributed by Arpit Agarwal.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1437627 13f79535-47bb-0310-9956-ffa450edef68
2013-01-23 19:00:39 +00:00
Todd Lipcon 797465820b Merge trunk into branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1437623 13f79535-47bb-0310-9956-ffa450edef68
2013-01-23 18:51:24 +00:00
Todd Lipcon d12f465c67 HDFS-4417. Fix case where local reads get disabled incorrectly. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1437616 13f79535-47bb-0310-9956-ffa450edef68
2013-01-23 18:38:56 +00:00
Thomas White 345bcee066 YARN-319. Submitting a job to a fair scheduler queue for which the user does not have permission causes the client to wait forever. Contributed by shenhong.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1437336 13f79535-47bb-0310-9956-ffa450edef68
2013-01-23 10:53:05 +00:00
Hitesh Shah 29ddce96a2 YARN-231. RM Restart - Add FS-based persistent store implementation for RMStateStore. Contributed by Bikas Saha
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1437245 13f79535-47bb-0310-9956-ffa450edef68
2013-01-23 00:57:37 +00:00
Hitesh Shah f5551bf809 YARN-277. Use AMRMClient in DistributedShell to exemplify the approach. Contributed by Bikas Saha
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1437156 13f79535-47bb-0310-9956-ffa450edef68
2013-01-22 20:49:09 +00:00
Suresh Srinivas 937ab16736 HADOOP-9231. Add missing CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1437143 13f79535-47bb-0310-9956-ffa450edef68
2013-01-22 20:16:49 +00:00
Suresh Srinivas 8535747cea HADOOP-9231. Parametrize staging URL for the uniformity of distributionManagement. Contributed by Konstantin Boudnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1437140 13f79535-47bb-0310-9956-ffa450edef68
2013-01-22 20:09:48 +00:00
Siddharth Seth 74ffc7a74d MAPREDUCE-4946. Fix a performance problem for large jobs by reducing the number of map completion event type conversions. Contributed by Jason Lowe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1437103 13f79535-47bb-0310-9956-ffa450edef68
2013-01-22 19:07:08 +00:00
Alejandro Abdelnur bb81a17e0b MAPREDUCE-4949. Enable multiple pi jobs to run in parallel. (sandyr via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1437029 13f79535-47bb-0310-9956-ffa450edef68
2013-01-22 16:26:29 +00:00
Alejandro Abdelnur 73fd247c76 MAPREDUCE-4808. Refactor MapOutput and MergeManager to facilitate reuse by Shuffle implementations. (masokan via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1436936 13f79535-47bb-0310-9956-ffa450edef68
2013-01-22 14:10:42 +00:00
Todd Lipcon cfae13306a HDFS-4403. DFSClient can infer checksum type when not provided by reading first byte. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1436730 13f79535-47bb-0310-9956-ffa450edef68
2013-01-22 02:59:25 +00:00
Todd Lipcon 89bd14913a HDFS-4416. Rename dfs.datanode.domain.socket.path to dfs.domain.socket.path. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1436568 13f79535-47bb-0310-9956-ffa450edef68
2013-01-21 19:29:06 +00:00
Suresh Srinivas c5b01ce424 HADOOP-8924. Add CHANGES.txt description missed in commit r1435380.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1436181 13f79535-47bb-0310-9956-ffa450edef68
2013-01-21 03:49:00 +00:00
Jonathan Turner Eagles 88c7fdd065 MAPREDUCE-4458. Warn if java.library.path is used for AM or Task (Robert Parker via jeagles)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1435386 13f79535-47bb-0310-9956-ffa450edef68
2013-01-18 22:41:19 +00:00
Suresh Srinivas ae270e72cf HADOOP-8924. Add maven plugin alternative to shell script to save package-info.java. Contributed by Alejandro Abdelnur and Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1435380 13f79535-47bb-0310-9956-ffa450edef68
2013-01-18 22:35:58 +00:00
Suresh Srinivas f8cca2df8a HADOOP-8924. Revert r1435372 that missed some files
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1435379 13f79535-47bb-0310-9956-ffa450edef68
2013-01-18 22:32:49 +00:00
Suresh Srinivas 98db9f5930 HADOOP-8924. Add maven plugin alternative to shell script to save package-info.java. Contributed by Alejandro Abdelnur and Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1435372 13f79535-47bb-0310-9956-ffa450edef68
2013-01-18 22:18:12 +00:00
Siddharth Seth 76f9af4ccf MAPREDUCE-4948. Fix a failing unit test - TestYARNRunner.testHistoryServerToken. Contributed by Junping Du
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1435312 13f79535-47bb-0310-9956-ffa450edef68
2013-01-18 19:30:00 +00:00
Aaron Myers d3d350ef0f HDFS-4359. Slow RPC responses from NN can prevent metrics collection on DNs. Contributed by liang xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1435299 13f79535-47bb-0310-9956-ffa450edef68
2013-01-18 18:39:24 +00:00
Alejandro Abdelnur f85b583731 YARN-302. Fair scheduler assignmultiple should default to false. (sandyr via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434996 13f79535-47bb-0310-9956-ffa450edef68
2013-01-18 00:48:22 +00:00
Alejandro Abdelnur 1c308188bb MAPREDUCE-4923. Add toString method to TaggedInputSplit. (sandyr via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434993 13f79535-47bb-0310-9956-ffa450edef68
2013-01-18 00:40:58 +00:00
Alejandro Abdelnur c9dd4fa67f YARN-331. Fill in missing fair scheduler documentation. (sandyr via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434990 13f79535-47bb-0310-9956-ffa450edef68
2013-01-18 00:37:23 +00:00
Todd Lipcon 52c5b8ea9f HDFS-4418. increase default FileInputStreamCache size. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1434953 13f79535-47bb-0310-9956-ffa450edef68
2013-01-17 23:11:30 +00:00
Aaron Myers b3b9485271 HDFS-4415. HostnameFilter should handle hostname resolution failures and continue processing. Contributed by Robert Kanter.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434951 13f79535-47bb-0310-9956-ffa450edef68
2013-01-17 23:08:47 +00:00
Robert Joseph Evans 5c5e6ed13a HADOOP-8849. FileUtil#fullyDelete should grant the target directories +rwx permissions (Ivan A. Veselovsky via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434868 13f79535-47bb-0310-9956-ffa450edef68
2013-01-17 19:19:10 +00:00
Suresh Srinivas 8f70a25b1c HDFS-4393. Make empty request and responses in protocol translators can be static final members. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434844 13f79535-47bb-0310-9956-ffa450edef68
2013-01-17 18:21:29 +00:00