Commit Graph

14801 Commits

Author SHA1 Message Date
Wangda Tan 90dd3a8148 YARN-2009. CapacityScheduler: Add intra-queue preemption for app priority support. (Sunil G via wangda) 2016-10-31 15:18:31 -07:00
Daniel Templeton 773c60bd7b YARN-5800. Delete LinuxContainerExecutor comment from yarn-default.xml (Contributed by Jan Hentschel via Daniel Templeton) 2016-10-31 14:47:48 -07:00
Steve Loughran a1761a841e HADOOP-13680. fs.s3a.readahead.range to use getLongBytes. Contributed by Abhishek Modi. 2016-10-31 20:54:46 +00:00
Daniel Templeton f3eb4c3c73 YARN-5793. Trim configuration values in DockerLinuxContainerRuntime (Contributed by Tianyin Xu via Daniel Templeton) 2016-10-31 13:51:07 -07:00
Daniel Templeton 2528bea67f YARN-4396. Log the trace information on FSAppAttempt#assignContainer (Contributed by Yiqun Li via Daniel Templeton) 2016-10-31 13:34:25 -07:00
Daniel Templeton cc2c993a8a YARN-4907. Make all MockRM#waitForState consistent. (Contributed by Yufei Gu via Daniel Templeton) 2016-10-31 13:20:56 -07:00
Arpit Agarwal a9d68d2e8e HDFS-11074. Remove unused method FsDatasetSpi#getFinalizedBlocksOnPersistentStorage. Contributed by Hanisha Koneru. 2016-10-31 12:39:30 -07:00
Akira Ajisaka f646fe34be MAPREDUCE-6799. Document mapreduce.jobhistory.webapp.https.address in mapred-default.xml. Contributed by Yiqun Lin. 2016-10-31 15:17:20 +09:00
Naganarasimha e0bebbbcdd YARN-4498. Application level node labels stats to be available in REST. Contributed by Bibin A Chundatt 2016-10-31 04:38:20 +05:30
Brahma Reddy Battula e9c7a97089 HDFS-10455. Logging the username when deny the setOwner operation. Contributed by Rakesh R. 2016-10-31 00:22:51 +05:30
Arun Suresh aa3cab1eb2 YARN-5799. Fix Opportunistic Allocation to set the correct value of Node Http Address. (asuresh) 2016-10-29 02:03:57 -07:00
Varun Saxena 1c8ab41e8b YARN-5773. RM recovery too slow due to LeafQueue#activateApplications (Bibin A Chundatt via Varun Saxena) 2016-10-29 13:47:39 +05:30
Robert Kanter ebb88231f8 HADOOP-10075. addendum to fix compilation on Windows 2016-10-28 17:35:28 -07:00
Chris Douglas 76a1042980 YARN-3460. TestSecureRMRegistryOperations fails with IBM_JAVA. Contributed by Pascal Oliva 2016-10-28 16:49:36 -07:00
Wei-Chiu Chuang 112f04eb1b HDFS-11061. Update dfs -count -t command line help and documentation. Contributed by Yiqun Lin. 2016-10-28 15:33:27 -07:00
Mingliang Liu 8a9388e5f6 HDFS-11048. Audit Log should escape control characters. Contributed by Eric Badger 2016-10-28 10:53:14 -07:00
Jason Lowe 1eae719bce YARN-4963. capacity scheduler: Make number of OFF_SWITCH assignments per heartbeat configurable. Contributed by Nathan Roberts 2016-10-28 17:30:15 +00:00
Jason Lowe 1b79c417dc YARN-5767. Fix the order that resources are cleaned up from the local Public/Private caches. Contributed by Chris Trezzo 2016-10-28 15:58:04 +00:00
Jason Lowe 7146359bfd YARN-5027. NM should clean up app log dirs after NM restart. Contributed by sandflee 2016-10-28 15:48:58 +00:00
Jason Lowe c017171da0 HADOOP-13770. Shell.checkIsBashSupported swallowed an interrupted exception. Contributed by Wei-Chiu Chuang 2016-10-28 14:57:50 +00:00
Naganarasimha 3de130252d YARN-5794. Fix the asflicense warnings. Contributed by Yiqun Lin 2016-10-28 12:37:37 +05:30
Kai Zheng 8fa2195697 HDFS-10926. Update staled configuration properties related to erasure coding. Contributed by Sammi Chen 2016-10-28 12:37:30 +06:00
Xiao Chen 57187fdb93 HDFS-11064. Mention the default NN rpc ports in hdfs-default.xml. Contributed by Yiqun Lin. 2016-10-27 18:13:06 -07:00
Xiao Chen b62bc2bbd8 HADOOP-13763. KMS REST API Documentation Decrypt URL typo. Contributed by Jeffrey E Rodriguez. 2016-10-27 18:05:40 -07:00
Karthik Kambatla 4df8ed63ed YARN-4743. FairSharePolicy breaks TimSort assumption. (Zephyr Guo and Yufei Gu via kasha) 2016-10-27 17:45:48 -07:00
Subru Krishnan b2c4f24c31 YARN-2306. Add test for leakage of reservation metrics in fair scheduler. (Hong Zhiguo and Yufei Gu via subru). 2016-10-27 17:43:13 -07:00
Naganarasimha 28660f51af MAPREDUCE-2631. Potential resource leaks in BinaryProtocol$TeeOutputStream.java. Contributed by Sunil G. 2016-10-28 05:50:13 +05:30
Robert Kanter 5877f20f9c HADOOP-10075. Update jetty dependency to version 9 (rkanter) 2016-10-27 16:09:00 -07:00
Mingliang Liu 9e03ee5279 HDFS-11047. Remove deep copies of FinalizedReplica to alleviate heap consumption on DataNode. Contributed by Xiaobing Zhou 2016-10-27 16:00:27 -07:00
Erik Krogen f3ac1f41b8 HDFS-9500. Fix software version counts for DataNodes during rolling upgrade. Contributed by Erik Krogen. 2016-10-27 15:58:25 -07:00
Vrushali Channapattan 022bf783aa YARN-4765 Split TestHBaseTimelineStorage into multiple test classes (Varun Saxena via Vrushali C)
(cherry picked from commit 513dcf6817dd76fde8096ff04cd888d7c908461d)
2016-10-27 15:37:36 -07:00
Li Lu 221582c4ab YARN-4668. Reuse objectMapper instance in Yarn. (Yiqun Lin via gtcarrera9) 2016-10-27 15:20:17 -07:00
Carlo Curino 892a8348fc YARN-3432. Cluster metrics have wrong Total Memory when there is reserved memory on CS. (Brahma Reddy Battula via curino) 2016-10-27 15:15:49 -07:00
Subru Krishnan 79ae78dcbe YARN-3568. TestAMRMTokens should use some random port. (Takashi Ohnishi via Subru). 2016-10-27 15:11:12 -07:00
Daniel Templeton b98fc8249f YARN-4710. Reduce logging application reserved debug info in FSAppAttempt#assignContainer (Contributed by Yiqun Lin via Daniel Templeton) 2016-10-27 14:42:19 -07:00
Robert Kanter 9449519a25 YARN-5776. Checkstyle: MonitoringThread.Run method length is too long (miklos.szegedi@cloudera.com via rkanter) 2016-10-27 14:36:38 -07:00
Varun Saxena dd4ed6a587 YARN-4388. Cleanup mapreduce.job.hdfs-servers from yarn-default.xml (Junping Du via Varun Saxena) 2016-10-28 02:22:25 +05:30
Jason Lowe 7e3c327d31 YARN-4831. Recovered containers will be killed after NM stateful restart. Contributed by Siqi Li 2016-10-27 20:42:52 +00:00
Wei-Chiu Chuang 31ff42b510 HDFS-11055. Update default-log4j.properties for httpfs to imporve test logging. Contributed by Wei-Chiu Chuang. 2016-10-27 13:37:00 -07:00
Jason Lowe b4a8fbcbbc YARN-5172. Update yarn daemonlog documentation due to HADOOP-12847. Contributed by Wei-Chiu Chuang 2016-10-27 19:43:02 +00:00
Robert Kanter 6fbfb501f2 YARN-4456. Clean up Lint warnings in nodemanager (templedf via rkanter) 2016-10-27 12:37:01 -07:00
Kihwal Lee ae48c496dc HDFS-11069. Tighten the authorization of datanode RPC. Contributed by Kihwal Lee 2016-10-27 14:17:16 -05:00
Kihwal Lee db41965996 Revert "HDFS-10455. Logging the username when deny the setOwner operation. Contributed by Tianyin Xiu"
This reverts commit ac35ee9393.
2016-10-27 14:07:28 -05:00
Varun Saxena 79aeddc88f YARN-5308. FairScheduler: Move continuous scheduling related tests to TestContinuousScheduling (Kai Sasaki via Varun Saxena) 2016-10-28 00:34:50 +05:30
Brahma Reddy Battula ac35ee9393 HDFS-10455. Logging the username when deny the setOwner operation. Contributed by Tianyin Xiu 2016-10-27 20:20:56 +05:30
Brahma Reddy Battula 0c837db8a8 HADOOP-13201. Print the directory paths when ViewFs denies the rename operation on internal dirs. Contributed by Tianyin Xiu 2016-10-27 19:46:41 +05:30
Steve Loughran b439517502 Revert "HADOOP-13514. Upgrade maven surefire plugin to 2.19.1. Contributed by Ewan Higgs."
This reverts commit dbd205762e.
2016-10-27 15:18:33 +02:00
Steve Loughran 94e77e9115 Revert "Addendum patch for HADOOP-13514 Upgrade maven surefire plugin to 2.19.1. Contributed by Akira Ajisaka."
This reverts commit e48b592f8b.
2016-10-27 15:18:24 +02:00
Naganarasimha b3c15e4ef7 YARN-5420. Delete org.apache.hadoop.yarn.server.resourcemanager.resource.Priority as its not necessary. Contributed by Sunil G. 2016-10-27 18:22:07 +05:30
Naganarasimha 060558c6f2 MAPREDUCE-6541. Exclude scheduled reducer memory when calculating available mapper slots from headroom to avoid deadlock. Contributed by Varun Saxena 2016-10-27 18:03:13 +05:30