Commit Graph

12436 Commits

Author SHA1 Message Date
Andrew Wang 9ede5ccfdd HADOOP-11088. Quash unnecessary safemode WARN message during NameNode startup. Contributed by Yiqun Lin.
(cherry picked from commit 5cad93d5c7)
2016-11-03 15:31:21 -07:00
Mingliang Liu 6d0cea4a5a HDFS-11076. Add unit test for extended Acls. Contributed by Chen Liang
(cherry picked from commit 7534aee09a)
2016-11-03 13:52:18 -07:00
Xiao Chen 1e29379244 HADOOP-12453. Support decoding KMS Delegation Token with its own Identifier. Contributed by Xiaoyu Yao.
(cherry picked from commit 7154a20bcb)
2016-11-03 13:10:37 -07:00
Arpit Agarwal 458b636a39 HDFS-11097. Fix warnings for deprecated StorageReceivedDeletedBlocks constructor. Contributed by Yiqun Lin. 2016-11-03 10:32:11 -07:00
Varun Vasudev 7676b89f43 YARN-5822. Log ContainerRuntime initialization error in LinuxContainerExecutor. Contributed by Sidharta Seethana.
(cherry picked from commit 9ee0e3172e)
2016-11-03 22:34:38 +05:30
Jason Lowe e2917180ee YARN-4862. Handle duplicate completed containers in RMNodeImpl. Contributed by Rohith Sharma K S
(cherry picked from commit 352cbaa7a5)
2016-11-03 14:03:56 +00:00
Naganarasimha 0c7caba087 YARN-5720. Update document for "rmadmin -replaceLabelOnNode". Contributred by Tao Jie
(cherry picked from commit 0e75496049)
2016-11-03 12:50:38 +05:30
Andrew Wang 99d0b3eb2b HDFS-11080. Update HttpFS to use ConfigRedactor. Contributed by Sean Mackrory. 2016-11-02 19:11:22 -07:00
Mingliang Liu 7a662bea89 HDFS-11095. BlockManagerSafeMode should respect extension period default config value (30s). Contributed by Mingliang Liu
(cherry picked from commit 9b0c17f852)
2016-11-02 15:02:08 -07:00
Varun Saxena b818773919 YARN-5815. Random failure of TestApplicationPriority.testOrderOfActivatingThePriorityApplicationOnRMRestart (Bibin A Chundatt via Varun Saxena) 2016-11-03 00:41:53 +05:30
Brahma Reddy Battula 35e6081020 HDFS-11031. Add additional unit test for DataNode startup behavior when volumes fail. Contributed by Mingliang Liu. 2016-11-02 10:39:12 +05:30
Robert Kanter 568b5eecd8 MAPREDUCE-6765. MR should not schedule container requests in cases where reducer or mapper containers demand resource larger than the maximum supported (haibochen via rkanter)
(cherry picked from commit fc2b69eba1)
2016-11-01 20:47:58 -07:00
Arpit Agarwal 148bb3e737 HADOOP-13738. DiskChecker should perform some disk IO. 2016-11-01 18:09:12 -07:00
Andrew Wang 92fff7d065 HADOOP-13583. Incorporate checkcompatibility script which runs Java API Compliance Checker.
(cherry picked from commit 0cd22d6669)
2016-11-01 16:36:37 -07:00
Naganarasimha 2612b509ef YARN-5697. Use CliParser to parse options in RMAdminCLI. Contributed by Tao jie
(cherry picked from commit aacf214a27)
2016-11-02 04:46:24 +05:30
Mingliang Liu 1dd59042ac HDFS-11065. Add space quota tests for heterogenous storages. Contributed by Xiaobing Zhou
(cherry picked from commit fa1512a740)
2016-11-01 14:46:24 -07:00
Jason Lowe f8d653ef34 YARN-5001. Aggregated Logs root directory is created with wrong group if nonexistent. Contributed by Haibo Chen
(cherry picked from commit 76893a4100)
2016-11-01 20:24:22 +00:00
Ravi Prakash 045501a538 HADOOP-13773. Wrong HADOOP_CLIENT_OPTS in hadoop-env on branch-2. Contributed by Fei Hui 2016-11-01 10:49:04 -07:00
Kihwal Lee 7c1a1834e4 HDFS-10997. Reduce number of path resolving methods. Contributed by Daryn Sharp. 2016-11-01 08:04:54 -05:00
Akira Ajisaka f0d4d7a178 HADOOP-13603. Ignore package line length checkstyle rule. Contributed by Shane Kumpf.
(cherry picked from commit 5b577f43a2)
2016-11-01 20:59:37 +09:00
Akira Ajisaka a3897f77ae MAPREDUCE-6795. Update the document for JobConf#setNumReduceTasks. Contributed by Yiqun Lin.
(cherry picked from commit 235f39b7c4)
2016-11-01 20:52:35 +09:00
Varun Saxena 91ddea5bfb YARN-5788. Apps not activiated and AM limit resource in UI and REST not updated after -replaceLabelsOnNode (Bibin A Chundatt via Varun Saxena) 2016-11-01 16:26:38 +05:30
Varun Saxena 2f0a101ab9 YARN-5805. Add isDebugEnabled check for debug logs in nodemanager (Bibin A Chundatt via Varun Saxena) 2016-11-01 16:23:12 +05:30
Brahma Reddy Battula 1c5708f6de HDFS-10455. Logging the username when deny the setOwner operation. Contributed by Rakesh R. 2016-11-01 10:49:43 +05:30
Karthik Kambatla 2226ae4924 YARN-4998. Minor cleanup to UGI use in AdminService. (Daniel Templeton via kasha)
(cherry picked from commit 733aa99313)
2016-10-31 16:26:15 -07:00
Varun Saxena 92b7491f23 YARN-5809. AsyncDispatcher possibly invokes multiple shutdown threads when handling exception (Jian He via Varun Saxena) 2016-11-01 04:37:56 +05:30
Mingliang Liu 6bb12ecc3f HDFS-11030. TestDataNodeVolumeFailure#testVolumeFailure is flaky (though passing). Contributed by Mingliang Liu 2016-10-31 16:03:02 -07:00
Wangda Tan cef281abe6 YARN-2009. CapacityScheduler: Add intra-queue preemption for app priority support. (Sunil G via wangda)
(cherry picked from commit 90dd3a8148)
2016-10-31 15:23:16 -07:00
Daniel Templeton 9d13a13160 YARN-5793. Trim configuration values in DockerLinuxContainerRuntime (Contributed by Tianyin Xu via Daniel Templeton)
(cherry picked from commit f3eb4c3c73)
2016-10-31 14:01:15 -07:00
Steve Loughran c4ccafdaff HADOOP-13680. fs.s3a.readahead.range to use getLongBytes. Contributed by Abhishek Modi. 2016-10-31 20:52:49 +00:00
Daniel Templeton ce13463e7a YARN-4396. Log the trace information on FSAppAttempt#assignContainer (Contributed by Yiqun Li via Daniel Templeton)
(cherry picked from commit 2528bea67f)
2016-10-31 13:36:24 -07:00
Daniel Templeton adceebc400 YARN-4907. Make all MockRM#waitForState consistent. (Contributed by Yufei Gu via Daniel Templeton)
(cherry picked from commit 155f06e0c1a5a15365fb620f3802dca8aa46c287)
2016-10-31 13:21:45 -07:00
Arpit Agarwal 56092e351b HDFS-11074. Remove unused method FsDatasetSpi#getFinalizedBlocksOnPersistentStorage. Contributed by Hanisha Koneru. 2016-10-31 12:39:54 -07:00
Naganarasimha e4023f0d81 YARN-4498. Application level node labels stats to be available in REST. Contributed by Bibin A Chundatt. 2016-10-31 19:07:56 +05:30
Akira Ajisaka ef13a5ef9d MAPREDUCE-6799. Document mapreduce.jobhistory.webapp.https.address in mapred-default.xml. Contributed by Yiqun Lin.
(cherry picked from commit f646fe34be)
2016-10-31 15:18:34 +09:00
Varun Saxena 0e6fcd3bd2 YARN-5773. RM recovery too slow due to LeafQueue#activateApplications (Bibin A Chundatt via Varun Saxena) 2016-10-29 13:51:02 +05:30
Wei-Chiu Chuang 9ba283c27d HDFS-11061. Update dfs -count -t command line help and documentation. Contributed by Yiqun Lin.
(cherry picked from commit 112f04eb1b)
2016-10-28 15:37:30 -07:00
Mingliang Liu 2848a27700 HDFS-11047. Remove deep copies of FinalizedReplica to alleviate heap consumption on DataNode. Contributed by Xiaobing Zhou 2016-10-28 11:11:31 -07:00
Mingliang Liu d0da47ad9f HDFS-11048. Audit Log should escape control characters. Contributed by Eric Badger
(cherry picked from commit 8a9388e5f6)
2016-10-28 10:57:20 -07:00
Jason Lowe b85b5c6b94 YARN-4963. capacity scheduler: Make number of OFF_SWITCH assignments per heartbeat configurable. Contributed by Nathan Roberts
(cherry picked from commit 1eae719bce)
2016-10-28 17:31:29 +00:00
Jason Lowe ea9a1be109 YARN-5767. Fix the order that resources are cleaned up from the local Public/Private caches. Contributed by Chris Trezzo
(cherry picked from commit 1b79c417dc)
2016-10-28 15:59:57 +00:00
Jason Lowe 2ab80a148a YARN-5027. NM should clean up app log dirs after NM restart. Contributed by sandflee
(cherry picked from commit 7146359bfd)
2016-10-28 15:49:54 +00:00
Jason Lowe 0f224d405f HADOOP-13770. Shell.checkIsBashSupported swallowed an interrupted exception. Contributed by Wei-Chiu Chuang
(cherry picked from commit c017171da0)
2016-10-28 15:06:23 +00:00
Naganarasimha 62d8536df6 Revert "YARN-5794. Fix the asflicense warnings. Contributed by Yiqun Lin"
This reverts commit b92ad5d857.
2016-10-28 12:58:42 +05:30
Naganarasimha b92ad5d857 YARN-5794. Fix the asflicense warnings. Contributed by Yiqun Lin
(cherry picked from commit 3de130252d)
2016-10-28 12:44:14 +05:30
Karthik Kambatla 950bfed1d3 YARN-4743. FairSharePolicy breaks TimSort assumption. (Zephyr Guo and Yufei Gu via kasha)
(cherry picked from commit 4df8ed63ed)
2016-10-27 17:48:24 -07:00
Subru Krishnan 334fd9e83f YARN-2306. Add test for leakage of reservation metrics in fair scheduler. (Hong Zhiguo and Yufei Gu via subru).
(cherry picked from commit b2c4f24c31)
2016-10-27 17:44:05 -07:00
Naganarasimha 1455f56b63 MAPREDUCE-2631. Potential resource leaks in BinaryProtocol$TeeOutputStream.java. Contributed by Sunil G.
(cherry picked from commit 28660f51af)
2016-10-28 06:00:29 +05:30
Erik Krogen ce8ace372c HDFS-9500. Fix software version counts for DataNodes during rolling upgrade. Contributed by Erik Krogen.
(cherry picked from commit f3ac1f41b8)
2016-10-27 16:00:39 -07:00
Li Lu 2b0fd1f4e2 YARN-4668. Reuse objectMapper instance in Yarn. (Yiqun Lin via gtcarrera9)
(cherry picked from commit 221582c4ab)
2016-10-27 15:26:05 -07:00