Commit Graph

7592 Commits

Author SHA1 Message Date
Arpit Agarwal 763b8ebf46 MAPREDUCE-5794. SliveMapper always uses default FileSystem. (Contributed by szetszwo)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577281 13f79535-47bb-0310-9956-ffa450edef68
2014-03-13 18:55:29 +00:00
Suresh Srinivas 70aba7ffcf HDFS-5244. TestNNStorageRetentionManager#testPurgeMultipleDirs fails. Contributed bye Jinghui Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577254 13f79535-47bb-0310-9956-ffa450edef68
2014-03-13 17:21:09 +00:00
Jonathan Turner Eagles 2c6ce77c5a MAPREDUCE-5713. InputFormat and JobConf JavaDoc Fixes (Chen He via jeagles)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577239 13f79535-47bb-0310-9956-ffa450edef68
2014-03-13 16:49:27 +00:00
Jonathan Turner Eagles b44b648d08 HADOOP-10332. HttpServer's jetty audit log always logs 200 OK (jeagles)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577220 13f79535-47bb-0310-9956-ffa450edef68
2014-03-13 16:10:54 +00:00
Jason Darrell Lowe 87866d4a56 MAPREDUCE-5789. Average Reduce time is incorrect on Job Overview page. Contributed by Rushabh S Shah
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577202 13f79535-47bb-0310-9956-ffa450edef68
2014-03-13 15:35:34 +00:00
Jonathan Turner Eagles a8f302a1e6 MAPREDUCE-5765. Update hadoop-pipes examples README (Mit Desai via jeagles)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577188 13f79535-47bb-0310-9956-ffa450edef68
2014-03-13 15:13:07 +00:00
Zhijie Shen 6af044bb75 YARN-1389. Made ApplicationClientProtocol and ApplicationHistoryProtocol expose analogous getApplication(s)/Attempt(s)/Container(s) APIs. Contributed by Mayank Bansal.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577052 13f79535-47bb-0310-9956-ffa450edef68
2014-03-13 07:42:29 +00:00
Arpit Agarwal f0fa038c7e HDFS-6096. TestWebHdfsTokens may timeout. (Contributed by szetszwo)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576999 13f79535-47bb-0310-9956-ffa450edef68
2014-03-12 23:24:32 +00:00
Arpit Agarwal 20ec0c0474 HDFS-5705. Update CHANGES.txt for merging the original fix (r1555190) to branch-2 and branch-2.4.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576989 13f79535-47bb-0310-9956-ffa450edef68
2014-03-12 23:13:32 +00:00
Andrew Wang b849dd5df9 HDFS-6079. Timeout for getFileBlockStorageLocations does not work. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576979 13f79535-47bb-0310-9956-ffa450edef68
2014-03-12 22:54:57 +00:00
Jason Darrell Lowe 135700a611 YARN-1789. ApplicationSummary does not escape newlines in the app name. Contributed by Tsuyoshi OZAWA
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576960 13f79535-47bb-0310-9956-ffa450edef68
2014-03-12 22:25:01 +00:00
Arun Murthy 3bbd67173e MAPREDUCE-5553. Allow users to easily access completed/pending/successful/failed tasks on MR AM web-ui. Contributed by Paul Han.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576946 13f79535-47bb-0310-9956-ffa450edef68
2014-03-12 22:04:48 +00:00
Jason Darrell Lowe cbf1c72d1b MAPREDUCE-5778. JobSummary does not escape newlines in the job name. Contributed by Akira AJISAKA
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576940 13f79535-47bb-0310-9956-ffa450edef68
2014-03-12 21:57:34 +00:00
Vinod Kumar Vavilapalli 197217c95d YARN-1816. Fixed ResourceManager to get RMApp correctly handle ATTEMPT_FINISHED event at ACCEPTED state that can happen after RM restarts. Contributed by Jian He.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576911 13f79535-47bb-0310-9956-ffa450edef68
2014-03-12 21:18:55 +00:00
Vinod Kumar Vavilapalli 4de17c6052 YARN-1812. Fixed ResourceManager to synchrously renew tokens after recovery and thus recover app itself synchronously and avoid races with resyncing NodeManagers. Contributed by Jian He.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576843 13f79535-47bb-0310-9956-ffa450edef68
2014-03-12 18:25:33 +00:00
Arun Murthy 4ce0e4bf2e YARN-1444. Fix CapacityScheduler to deal with cases where applications specify host/rack requests without off-switch request. Contributed by Wangda Tan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576751 13f79535-47bb-0310-9956-ffa450edef68
2014-03-12 14:36:27 +00:00
Vinod Kumar Vavilapalli 8aab8533a1 YARN-1800. Fixed NodeManager to gracefully handle RejectedExecutionException in the public-localizer thread-pool. Contributed by Varun Vasudev.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576545 13f79535-47bb-0310-9956-ffa450edef68
2014-03-11 23:33:56 +00:00
Colin McCabe a3616c58dd HDFS-6086. Fix a case where zero-copy or no-checksum reads were not allowed even when the block was cached. (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576533 13f79535-47bb-0310-9956-ffa450edef68
2014-03-11 22:41:05 +00:00
Karthik Kambatla 477ed62b3f YARN-1821. NPE on registerNodeManager if the request has containers for UnmanagedAMs (kasha)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576525 13f79535-47bb-0310-9956-ffa450edef68
2014-03-11 22:18:54 +00:00
Haohui Mai b027ef8858 HDFS-6072. Clean up dead code of FSImage. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576513 13f79535-47bb-0310-9956-ffa450edef68
2014-03-11 21:44:38 +00:00
Chris Nauroth 8d29768704 HDFS-5638. HDFS implementation of FileContext API for ACLs. Contributed by Vinayakumar B.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576405 13f79535-47bb-0310-9956-ffa450edef68
2014-03-11 16:13:43 +00:00
Colin McCabe bab90b2222 HDFS-6085. Improve CacheReplicationMonitor log messages a bit (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576194 13f79535-47bb-0310-9956-ffa450edef68
2014-03-11 06:24:52 +00:00
Michael Stack 66cde6a17f HADOOP-10337 ConcurrentModificationException from MetricsDynamicMBeanBase.createMBeanInfo() (Liang Xie via stack)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576187 13f79535-47bb-0310-9956-ffa450edef68
2014-03-11 04:34:13 +00:00
Vinod Kumar Vavilapalli 98ecd4ffef MAPREDUCE-5028. Fixed a bug in MapTask that was causing mappers to fail when a large value of io.sort.mb is set. Contributed by Karthik Kambatla.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576170 13f79535-47bb-0310-9956-ffa450edef68
2014-03-11 01:29:56 +00:00
Vinod Kumar Vavilapalli 0edda25373 YARN-1764. Modified YarnClient to correctly handle failover of ResourceManager after the submitApplication call goes through. Contributed by Xuan Gong.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576160 13f79535-47bb-0310-9956-ffa450edef68
2014-03-11 00:52:03 +00:00
Andrew Wang 2e57b1fe86 Move HDFS-3405 to 2.4.0 section in CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576158 13f79535-47bb-0310-9956-ffa450edef68
2014-03-11 00:47:50 +00:00
Tsz-wo Sze 024f8e931f Move HDFS-5535 to Release 2.4.0 in CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576148 13f79535-47bb-0310-9956-ffa450edef68
2014-03-11 00:08:20 +00:00
Arpit Agarwal 109e88bf17 HADOOP-10394. TestAuthenticationFilter is flaky. (Arpit Agarwal)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576145 13f79535-47bb-0310-9956-ffa450edef68
2014-03-11 00:02:14 +00:00
Arpit Agarwal d74ec9dd20 HADOOP-10395. TestCallQueueManager is flaky. (Arpit Agarwal)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576141 13f79535-47bb-0310-9956-ffa450edef68
2014-03-10 23:56:24 +00:00
Chris Nauroth 8e68f64daa HADOOP-10399. FileContext API for ACLs. Contributed by Vinayakumar B.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576124 13f79535-47bb-0310-9956-ffa450edef68
2014-03-10 23:10:41 +00:00
Chris Nauroth 5bb794566e HDFS-6055. Change default configuration to limit file name length in HDFS. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576095 13f79535-47bb-0310-9956-ffa450edef68
2014-03-10 21:41:38 +00:00
Jing Zhao b674dfd480 HDFS-6077. running slive with webhdfs on secure HA cluster fails with unkown host exception. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576076 13f79535-47bb-0310-9956-ffa450edef68
2014-03-10 20:48:53 +00:00
Vinod Kumar Vavilapalli e4190b2a97 YARN-1788. Fixed a bug in ResourceManager to set the apps-completed and apps-killed metrics correctly for killed applications. Contributed by Varun Vasudev.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576072 13f79535-47bb-0310-9956-ffa450edef68
2014-03-10 20:36:34 +00:00
Andrew Wang daaa8f03f4 HDFS-6070. Cleanup use of ReadStatistics in DFSInputStream.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576047 13f79535-47bb-0310-9956-ffa450edef68
2014-03-10 19:04:05 +00:00
Haohui Mai a06b21cf67 HDFS-5892. TestDeleteBlockPool fails in branch-2. Contributed by Ted Yu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576035 13f79535-47bb-0310-9956-ffa450edef68
2014-03-10 18:16:57 +00:00
Jian He 7da07461ff YARN-1793. Fixed ClientRMService#forceKillApplication not killing unmanaged application. Contributed by Karthik Kambatla
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576023 13f79535-47bb-0310-9956-ffa450edef68
2014-03-10 17:58:55 +00:00
Colin McCabe d59dbc9e38 HDFS-6071. BlockReaderLocal does not return -1 on EOF when doing a zero-length read on a short file. (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575797 13f79535-47bb-0310-9956-ffa450edef68
2014-03-10 02:41:45 +00:00
Andrew Wang 94a1632fcb HDFS-3405. Checkpointing should use HTTP POST or PUT instead of GET-GET to send merged fsimages. Contributed by Vinayakumar B.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575611 13f79535-47bb-0310-9956-ffa450edef68
2014-03-08 21:25:13 +00:00
Andrew Wang dbd22b23c2 Revert HDFS-3405 for recommit with correct renamed files
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575610 13f79535-47bb-0310-9956-ffa450edef68
2014-03-08 21:15:41 +00:00
Andrew Wang 98594ab787 Remove extra file from HDFS-3405.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575609 13f79535-47bb-0310-9956-ffa450edef68
2014-03-08 21:11:04 +00:00
Arpit Agarwal 596004ac73 HDFS-6078. TestIncrementalBlockReports is flaky. (Arpit Agarwal)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575559 13f79535-47bb-0310-9956-ffa450edef68
2014-03-08 16:38:36 +00:00
Sanford Ryza e2530de4ea YARN-1790. Fair Scheduler UI not showing apps table (bc Wong via Sandy Ryza)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575487 13f79535-47bb-0310-9956-ffa450edef68
2014-03-08 05:12:45 +00:00
Vinod Kumar Vavilapalli 874cc955e0 YARN-1787. Fixed help messages for applicationattempt and container sub-commands in bin/yarn. Contributed by Zhijie Shen.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575482 13f79535-47bb-0310-9956-ffa450edef68
2014-03-08 04:49:52 +00:00
Vinod Kumar Vavilapalli 8497b870af YARN-1410. Added tests to validate that clients can fail-over to a new RM
after getting an application-ID but before submission and can still submit
to the newly active RM with no issues. Contributed by Xuan Gong.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575478 13f79535-47bb-0310-9956-ffa450edef68
2014-03-08 04:43:29 +00:00
Tsz-wo Sze b7428fe63d HADOOP-10393. Fix the javac warnings in hadoop-auth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575470 13f79535-47bb-0310-9956-ffa450edef68
2014-03-08 02:16:01 +00:00
Vinod Kumar Vavilapalli 0b1304d098 YARN-1781. Modified NodeManagers to allow admins to specify max disk utilization for local disks so as to be able to offline full disks. Contributed by Varun Vasudev.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575463 13f79535-47bb-0310-9956-ffa450edef68
2014-03-08 00:52:06 +00:00
Andrew Wang 0f595915a3 HDFS-3405. Checkpointing should use HTTP POST or PUT instead of GET-GET to send merged fsimages. Contributed by Vinayakumar B.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575457 13f79535-47bb-0310-9956-ffa450edef68
2014-03-08 00:39:23 +00:00
Tsz-wo Sze 1f6c2b09c6 HDFS-6076. DataNode with SimulatedDataSet should not create DatanodeRegistration with namenode layout version and namenode node type.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575452 13f79535-47bb-0310-9956-ffa450edef68
2014-03-07 23:47:43 +00:00
Andrew Wang 90b399c4bd HDFS-5064. Standby checkpoints should not block concurrent readers. Contributed by Aaron Twining Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575448 13f79535-47bb-0310-9956-ffa450edef68
2014-03-07 23:35:47 +00:00
Vinod Kumar Vavilapalli 1c4047b0e4 YARN-1783. Fixed a bug in NodeManager's status-updater that was losing completed container statuses when NodeManager is forced to resync by the ResourceManager. Contributed by Jian He.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575437 13f79535-47bb-0310-9956-ffa450edef68
2014-03-07 22:36:47 +00:00