Commit Graph

5489 Commits

Author SHA1 Message Date
Alejandro Abdelnur 334de8d211 ARN-803. factor out scheduler config validation from the ResourceManager to each scheduler implementation. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1493160 13f79535-47bb-0310-9956-ffa450edef68
2013-06-14 17:07:25 +00:00
Chris Nauroth 0ef156a86e HDFS-4783. TestDelegationTokensWithHA#testHAUtilClonesDelegationTokens fails on Windows. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1493149 13f79535-47bb-0310-9956-ffa450edef68
2013-06-14 16:44:22 +00:00
Vinod Kumar Vavilapalli fdc9412a81 YARN-806. Moved ContainerExitStatus from yarn.api to yarn.api.records. Contributed by Jian He.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1493138 13f79535-47bb-0310-9956-ffa450edef68
2013-06-14 16:10:37 +00:00
Alejandro Abdelnur 710a5eea62 YARN-782. vcores-pcores ratio functions differently from vmem-pmem ratio in misleading way. (sandyr via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1493064 13f79535-47bb-0310-9956-ffa450edef68
2013-06-14 13:41:45 +00:00
Arun Murthy 2166fa201e MAPREDUCE-5319. Set user.name in job.xml. Contributed by Xuan Gong.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1492962 13f79535-47bb-0310-9956-ffa450edef68
2013-06-14 06:26:55 +00:00
Arun Murthy aa14698fd6 YARN-812. Set default logger for application summary logger to hadoop.root.logger. Contributed by Siddarth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1492958 13f79535-47bb-0310-9956-ffa450edef68
2013-06-14 06:04:06 +00:00
Vinod Kumar Vavilapalli e9f753a11e YARN-792. Moved NodeHealthStatus from yarn.api.record to yarn.server.api.record. Contributed by Jian He.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1492943 13f79535-47bb-0310-9956-ffa450edef68
2013-06-14 03:17:03 +00:00
Tsz-wo Sze 4cd605413a HDFS-4845. FSNamesystem.deleteInternal should acquire write-lock before changing the inode map. Contributed by Arpit Agarwal
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1492941 13f79535-47bb-0310-9956-ffa450edef68
2013-06-14 03:12:08 +00:00
Vinod Kumar Vavilapalli f0eb4bc342 YARN-692. Creating NMToken master key on RM and sharing it with NM as a part of RM-NM heartbeat. Contributed by Omkar Vinit Joshi.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1492907 13f79535-47bb-0310-9956-ffa450edef68
2013-06-14 00:06:42 +00:00
Vinod Kumar Vavilapalli c0cd68d8fb YARN-773. Moved YarnRuntimeException from package api.yarn to api.yarn.exceptions. Contributed by Jian He.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1492903 13f79535-47bb-0310-9956-ffa450edef68
2013-06-13 23:25:14 +00:00
Jason Darrell Lowe 8dc0d5af43 MAPREDUCE-4019. -list-attempt-ids is not working. Contributed by Ashwin Shankar, Devaraj K, and B Anil Kumar
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1492868 13f79535-47bb-0310-9956-ffa450edef68
2013-06-13 21:01:37 +00:00
Vinod Kumar Vavilapalli b64572b06b MAPREDUCE-5199. Removing ApplicationTokens file as it is no longer needed. Contributed by Daryn Sharp.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1492848 13f79535-47bb-0310-9956-ffa450edef68
2013-06-13 20:20:33 +00:00
Jing Zhao 7e1744ccf9 HDFS-4902. DFSClient#getSnapshotDiffReport should use string path rather than o.a.h.fs.Path. Contributed by Binglin Chang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1492791 13f79535-47bb-0310-9956-ffa450edef68
2013-06-13 18:11:42 +00:00
Vinod Kumar Vavilapalli 686ac311c9 YARN-746. Renamed Service.register() and Service.unregister() to registerServiceListener() & unregisterServiceListener() respectively. Contributed by Steve Loughran.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1492780 13f79535-47bb-0310-9956-ffa450edef68
2013-06-13 17:49:14 +00:00
Vinod Kumar Vavilapalli 0928502029 YARN-530. Defined Service model strictly, implemented AbstractService for robust subclassing and migrated yarn-common services. Contributed by Steve Loughran.
YARN-117. Migrated rest of YARN to the new service model. Contributed by Steve Louhran.
MAPREDUCE-5298. Moved MapReduce services to YARN-530 stricter lifecycle. Contributed by Steve Loughran.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1492718 13f79535-47bb-0310-9956-ffa450edef68
2013-06-13 15:54:38 +00:00
Konstantin Shvachko 5244bf6860 Port HDFS-4878 to branch-0.23.9.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1492449 13f79535-47bb-0310-9956-ffa450edef68
2013-06-12 22:11:35 +00:00
Alejandro Abdelnur 1104c7d166 YARN-648. FS: Add documentation for pluggable policy. (kkambatl via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1492388 13f79535-47bb-0310-9956-ffa450edef68
2013-06-12 19:24:23 +00:00
Chris Nauroth 1ed916f6c6 YARN-700. TestInfoBlock fails on Windows because of line ending missmatch. Contributed by Ivan Mitic.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1492383 13f79535-47bb-0310-9956-ffa450edef68
2013-06-12 19:18:39 +00:00
Alejandro Abdelnur 80eb92aff0 YARN-600. Hook up cgroups CPU settings to the number of virtual cores allocated. (sandyr via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1492365 13f79535-47bb-0310-9956-ffa450edef68
2013-06-12 18:57:31 +00:00
Chris Nauroth b090bc1c21 MAPREDUCE-5259. TestTaskLog fails on Windows because of path separators missmatch. Contributed by Ivan Mitic.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1492364 13f79535-47bb-0310-9956-ffa450edef68
2013-06-12 18:54:56 +00:00
Alejandro Abdelnur c9fce677b3 MAPREDUCE-5304. mapreduce.Job killTask/failTask/getTaskCompletionEvents methods have incompatible signature changes. (kkambatl via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1492360 13f79535-47bb-0310-9956-ffa450edef68
2013-06-12 18:47:33 +00:00
Chris Nauroth c5821cf38b HADOOP-9638. Parallel test changes caused invalid test path for several HDFS tests on Windows. Contributed by Andrey Klochkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1492297 13f79535-47bb-0310-9956-ffa450edef68
2013-06-12 17:21:47 +00:00
Jonathan Turner Eagles b90755c296 YARN-427. Coverage fix for org.apache.hadoop.yarn.server.api.* (Aleksey Gorshkov via jeagles)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1492282 13f79535-47bb-0310-9956-ffa450edef68
2013-06-12 16:52:15 +00:00
Tsz-wo Sze f9186f3ae8 HDFS-4819. Update Snapshot doc to clarify that nested snapshots are not allowed.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1492062 13f79535-47bb-0310-9956-ffa450edef68
2013-06-12 05:43:35 +00:00
Alejandro Abdelnur e75ee47fc9 YARN-795. Fair scheduler queue metrics should subtract allocated vCores from available vCores. (ywskycn via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1492021 13f79535-47bb-0310-9956-ffa450edef68
2013-06-12 00:25:07 +00:00
Siddharth Seth 6d4d87008c YARN-731. RPCUtil.unwrapAndThrowException should unwrap remote RuntimeExceptions. Contributed by Zhijie Shen.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1492000 13f79535-47bb-0310-9956-ffa450edef68
2013-06-11 22:34:39 +00:00
Arun Murthy 25946da413 YARN-767. Initialize application metrics at RM bootup. Contributed by Jian He.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1491989 13f79535-47bb-0310-9956-ffa450edef68
2013-06-11 22:15:02 +00:00
Jing Zhao 390eca2cde HDFS-4873. callGetBlockLocations returns incorrect number of blocks for snapshotted files. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1491957 13f79535-47bb-0310-9956-ffa450edef68
2013-06-11 21:03:09 +00:00
Colin McCabe 0c88f38be8 HADOOP-9635. Fix potential stack overflow in DomainSocket.c (V. Karthik Kumar via cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1491927 13f79535-47bb-0310-9956-ffa450edef68
2013-06-11 19:56:25 +00:00
Daryn Sharp 6f59922e9d MAPREDUCE-5315. DistCp reports success even on failure. (mithun and jlowe via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1491917 13f79535-47bb-0310-9956-ffa450edef68
2013-06-11 19:27:05 +00:00
Daryn Sharp 723ef662a9 MAPREDUCE-5315. DistCp reports success even on failure. (mithun and jlowe via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1491914 13f79535-47bb-0310-9956-ffa450edef68
2013-06-11 19:22:53 +00:00
Arpit Gupta 59bd35daef HADOOP-9625. HADOOP_OPTS not picked up by hadoop command. Contributed by Paul Han
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1491907 13f79535-47bb-0310-9956-ffa450edef68
2013-06-11 19:01:40 +00:00
Siddharth Seth c6c41abf68 YARN-737. Throw some specific exceptions directly instead of wrapping them in YarnException. Contributed by Jian He.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1491896 13f79535-47bb-0310-9956-ffa450edef68
2013-06-11 18:47:16 +00:00
Luke Lu a841be808a HADOOP-9630. [RPC v9] Remove IpcSerializationType. (Junping Du via llu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1491682 13f79535-47bb-0310-9956-ffa450edef68
2013-06-11 03:30:41 +00:00
Konstantin Shvachko 8e0f166cf3 HDFS-4878. On Remove Block, block is not removed from neededReplications queue. Contributed by Tao Luo.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1491671 13f79535-47bb-0310-9956-ffa450edef68
2013-06-11 01:39:32 +00:00
Aaron Myers 5ab67b5c07 HADOOP-9604. Javadoc of FSDataOutputStream is slightly inaccurate. Contributed by Jingguo Yao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1491668 13f79535-47bb-0310-9956-ffa450edef68
2013-06-11 01:19:20 +00:00
Suresh Srinivas 8e23270e0d HDFS-4752. TestRBWBlockInvalidation fails on Windows due to file locking. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1491631 13f79535-47bb-0310-9956-ffa450edef68
2013-06-10 22:37:36 +00:00
Jason Darrell Lowe c0737b0bdb MAPREDUCE-5308. Shuffling to memory can get out-of-sync when fetching multiple compressed map outputs. Contributed by Nathan Roberts
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1491611 13f79535-47bb-0310-9956-ffa450edef68
2013-06-10 21:39:34 +00:00
Jason Darrell Lowe b088524750 HADOOP-9581. hadoop --config non-existent directory should result in error. Contributed by Ashwin Shankar
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1491548 13f79535-47bb-0310-9956-ffa450edef68
2013-06-10 18:12:36 +00:00
Konstantin Boudnik f3b322e023 Setting release date for 2.0.5-alpha release
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1491139 13f79535-47bb-0310-9956-ffa450edef68
2013-06-09 04:55:26 +00:00
Ivan Mitic cb11d68f40 HDFS-4677. Editlog should support synchronous writes. Contributed by Ivan Mitic.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1491096 13f79535-47bb-0310-9956-ffa450edef68
2013-06-08 23:28:37 +00:00
Alejandro Abdelnur d00d968c49 MAPREDUCE-5312. TestRMNMInfo is failing. (sandyr via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1491043 13f79535-47bb-0310-9956-ffa450edef68
2013-06-08 19:40:59 +00:00
Ivan Mitic 74e88105c9 HADOOP-9599. hadoop-config.cmd doesn't set JAVA_LIBRARY_PATH correctly. Contributed by Mostafa Elhemali.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1491030 13f79535-47bb-0310-9956-ffa450edef68
2013-06-08 19:01:14 +00:00
Vinod Kumar Vavilapalli 0b0be8d4dd YARN-642. Removed health parameter from ResourceManager /nodes web-service and cleaned the behaviour of the status parameter. Contributed by Sandy Ryza.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1490890 13f79535-47bb-0310-9956-ffa450edef68
2013-06-08 00:54:22 +00:00
Vinod Kumar Vavilapalli 176315d697 YARN-777. Removed unreferenced objects from .proto files. Contributed by Jian He.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1490882 13f79535-47bb-0310-9956-ffa450edef68
2013-06-08 00:11:12 +00:00
Brandon Li 8ef140d38b HADOOP-9509. Implement ONCRPC and XDR. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1490845 13f79535-47bb-0310-9956-ffa450edef68
2013-06-07 21:45:06 +00:00
Alejandro Abdelnur af8514eef2 YARN-686. Flatten NodeReport. (sandyr via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1490827 13f79535-47bb-0310-9956-ffa450edef68
2013-06-07 20:59:23 +00:00
Kihwal Lee 2a76cddcd5 HDFS-4832. Namenode doesn't change the number of missing blocks in safemode when DNs rejoin or leave. Contributed by Ravi Prakash.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1490803 13f79535-47bb-0310-9956-ffa450edef68
2013-06-07 20:01:55 +00:00
Suresh Srinivas a764da16d6 HDFS-4880. Print the image and edits file loaded by the namenode in the logs. Contributed by Arpit Agarwal.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1490746 13f79535-47bb-0310-9956-ffa450edef68
2013-06-07 17:35:34 +00:00
Jason Darrell Lowe a8c330fd33 YARN-760. NodeManager throws AvroRuntimeException on failed start. Contributed by Niranjan Singh
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1490704 13f79535-47bb-0310-9956-ffa450edef68
2013-06-07 16:20:20 +00:00