Commit Graph

12094 Commits

Author SHA1 Message Date
Mingliang Liu 0feb9bb4a9 HADOOP-13810. Add a test to verify that Configuration handles &-encoded characters. Contributed by Steve Loughran
This closes #158

(cherry picked from commit 04014c4c73)
2016-11-14 19:55:45 -08:00
Zhe Zhang efc0e640ed Addendum of HDFS-10872. Removed chan ge in MiniHadoopClusterManager.java 2016-11-14 16:43:43 -08:00
Zhe Zhang c6e7b631bd HDFS-10872. Add MutableRate metrics for FSNamesystemLock operations. Contributed by Erik Krogen.
(cherry picked from commit 818915aabb)
2016-11-14 16:39:26 -08:00
Jason Lowe 5b1b825ac8 MAPREDUCE-6797. Job history server scans can become blocked on a single, slow entry. Contributed by Prabhu Joseph
(cherry picked from commit 99c2bbd337)
2016-11-14 20:31:38 +00:00
Brahma Reddy Battula 4dc40fe28e HDFS-11135. The tests in TestBalancer run fails due to NPE. Contributed By Yiqun Lin
(cherry picked from commit 6efb8c9c60)
2016-11-14 20:42:50 +05:30
Erik Krogen 3d52459712 HDFS-11087. NamenodeFsck should check if the output writer is still writable. Contributed by Erik Krogen.
(cherry picked from commit 98d9e9c4c8)
2016-11-13 14:54:49 -08:00
Naganarasimha 59a3d9a576 Reverting it because of YARN-5287, blocker issue has been reported.
Revert "YARN-5287. LinuxContainerExecutor fails to set proper permission. Contributed by Ying Zhang."

This reverts commit 16c8fd9dca.
2016-11-13 17:43:01 +05:30
Mingliang Liu 4bcef1c616 HADOOP-13813. TestDelegationTokenFetcher#testDelegationTokenWithoutRenewer is failing. Contributed by Mingliang Liu
(cherry picked from commit fb3a5085e8)
2016-11-12 10:37:46 -08:00
Mingliang Liu fcedb6812b HDFS-11129. TestAppendSnapshotTruncate fails with bind exception. Contributed by Brahma Reddy Battula
(cherry picked from commit 2ee18fc15e)
2016-11-11 22:19:39 -08:00
Xiaoyu Yao c443ecb267 HDFS-10941. Improve BlockManager#processMisReplicatesAsync log. Contributed by Chen Liang.
(cherry picked from commit 4484b48498)
2016-11-11 14:32:11 -08:00
Mingliang Liu ae7a20f524 HDFS-11122. TestDFSAdmin#testReportCommand fails due to timed out. Contributed by Yiqun Lin
(cherry picked from commit aa6010ccca)
2016-11-11 12:35:21 -08:00
Brahma Reddy Battula 121b56de14 HDFS-11128. CreateEditsLog throws NullPointerException. Contributed by Hanisha Koneru.
(cherry picked from commit 1ae57f0f75)
2016-11-11 20:11:13 +05:30
Yongjun Zhang 51f5bab695 HADOOP-13720. Add more info to the msgs printed in AbstractDelegationTokenSecretManager. Contributed by Yongjun Zhang.
(cherry picked from commit fd2f22adec)
2016-11-10 23:41:48 -08:00
Eric Payne 1a6a5af44a YARN-4218. Metric for resource*time that was preempted. Contributed by Chang Li.
(cherry picked from commit dd5b9dabf9)
2016-11-10 23:32:17 +00:00
Xiao Chen d81706cd99 HDFS-11120. TestEncryptionZones should waitActive. Contributed by John Zhuge.
(cherry picked from commit 907b1431c0ead934e26cf7dbc51bfab5d7cc5ddc)
2016-11-09 17:16:36 -08:00
Naganarasimha 108f09a763 YARN-4498. Application level node labels stats to be available in REST (addendum patch). Contributed by Bibin A Chundatt.
(cherry picked from commit 8a2998c08c)
2016-11-10 05:24:12 +05:30
Wei-Chiu Chuang 1d75da8e26 HDFS-11056. Concurrent append and read operations lead to checksum error. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 16430c64b7)
2016-11-09 13:32:35 -08:00
Xiao Chen b1b609c003 HADOOP-13590. Retry until TGT expires even if the UGI renewal thread encountered exception.
(cherry picked from commit 367c3d4121)
(cherry picked from commit ede909144d)
2016-11-09 09:10:06 -08:00
Mingliang Liu ad992e05a6 HDFS-11083. Add unit test for DFSAdmin -report command. Contributed by Xiaobing Zhou
(cherry picked from commit 62d8c17dfd)
2016-11-08 17:10:59 -08:00
Zhe Zhang d93dc01e3d HADOOP-13782. Make MutableRates metrics thread-local write, aggregate-on-read. Contributed by Erik Krogen.
(cherry picked from commit 77c13c3857)
(cherry picked from commit 758638d08d)
2016-11-08 16:10:53 -08:00
Naganarasimha 5f386967a1 YARN-5720. Update document for "rmadmin -replaceLabelOnNode". Contributred by Tao Jie
(cherry picked from commit 0e75496049)
2016-11-08 10:37:34 +05:30
Varun Vasudev 3603e525b1 YARN-4884. Fix missing documentation about rmadmin command regarding node labels. Contributed by Kai Sasaki.
(cherry picked from commit f1b8f6b2c1)
2016-11-08 10:22:59 +05:30
Zhe Zhang 384b7b71a3 HADOOP-13804. MutableStat mean loses accuracy if add(long, long) is used. Contributed by Erik Krogen.
(cherry picked from commit 3dbad5d823)
(cherry picked from commit b245e9ce2f)
2016-11-07 16:15:20 -08:00
Steve Loughran 5231c527aa HADOOP-13797 Remove hardcoded absolute path for ls. Contributed by Christine Koppelt 2016-11-07 12:36:38 +00:00
Akira Ajisaka 21f210bada HADOOP-13798. TestHadoopArchives times out.
(cherry picked from commit b970446b2c)
(cherry picked from commit 3b279fe426)
2016-11-07 19:55:10 +09:00
Sunil ee5dd2c388 YARN-5802. updateApplicationPriority api in scheduler should ensure to re-insert app to correct ordering policy. Contributed by Bibin A Chundatt 2016-11-05 13:06:31 +05:30
Xiaoyu Yao 5073289c4a Revert "HADOOP-13565. KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request. Contributed by Xiaoyu Yao."
This reverts commit 5abc788825.
2016-11-04 16:22:45 -07:00
Jason Lowe 4cb4e4c0a1 YARN-5837. NPE when getting node status of a decommissioned node after an RM restart. Contributed by Robert Kanter
(cherry picked from commit 6bb741ff0e)
2016-11-04 22:25:35 +00:00
Mingliang Liu 00625004b7 HDFS-11085. Add unit test for NameNode failing to start when name dir is unwritable. Contributed by Xiaobing Zhou
(cherry picked from commit 0c0ab102ab)
2016-11-04 14:45:43 -07:00
Robert Kanter f9a7b83a53 HADOOP-7930. Kerberos relogin interval in UserGroupInformation should be configurable (xiaochen via rkanter)
(cherry picked from commit 0b36dcda7c)
2016-11-04 09:24:34 -07:00
Rohith Sharma K S c89d462761 YARN-5608. TestAMRMClient.setup() fails with ArrayOutOfBoundsException. Contributed by Daniel Templeton.
(cherry picked from commit f9557127b3)
2016-11-04 13:52:11 +00:00
Mingliang Liu b082d4b746 HDFS-11076. Add unit test for extended Acls. Contributed by Chen Liang
(cherry picked from commit 7534aee09a)
2016-11-03 13:55:43 -07:00
Xiao Chen a22ca0aa58 HADOOP-12453. Support decoding KMS Delegation Token with its own Identifier. Contributed by Xiaoyu Yao.
(cherry picked from commit 7154a20bcb)
2016-11-03 13:10:41 -07:00
Arpit Agarwal 3f2bfdba3e HDFS-11097. Fix warnings for deprecated StorageReceivedDeletedBlocks constructor. Contributed by Yiqun Lin. 2016-11-03 10:33:28 -07:00
Naganarasimha 605e9bf3bf YARN-5697. Use CliParser to parse options in RMAdminCLI. Contributed by Tao Jie. 2016-11-03 10:31:30 +05:30
Andrew Wang e393dd788e HDFS-11080. Update HttpFS to use ConfigRedactor. Contributed by Sean Mackrory. 2016-11-02 19:11:25 -07:00
Varun Saxena 8602e2cb0f YARN-5815. Random failure of TestApplicationPriority.testOrderOfActivatingThePriorityApplicationOnRMRestart (Bibin A Chundatt via Varun Saxena) 2016-11-03 00:43:28 +05:30
Brahma Reddy Battula 77142827e8 HDFS-11031. Add additional unit test for DataNode startup behavior when volumes fail. Contributed by Mingliang Liu.
(cherry picked from commit 35e6081020)
2016-11-02 10:40:22 +05:30
Andrew Wang 9b64e30ccf HADOOP-13583. Incorporate checkcompatibility script which runs Java API Compliance Checker.
(cherry picked from commit 0cd22d6669)
(cherry picked from commit 92fff7d065)
2016-11-01 16:36:40 -07:00
Mingliang Liu 10eb21e52e HDFS-11065. Add space quota tests for heterogenous storages. Contributed by Xiaobing Zhou
(cherry picked from commit fa1512a740)
2016-11-01 14:50:16 -07:00
Jason Lowe 4a70bd86da YARN-5001. Aggregated Logs root directory is created with wrong group if nonexistent. Contributed by Haibo Chen
(cherry picked from commit 76893a4100)
2016-11-01 20:24:44 +00:00
Ravi Prakash 8504e20b2e HADOOP-13773. Wrong HADOOP_CLIENT_OPTS in hadoop-env on branch-2. Contributed by Fei Hui
(cherry picked from commit 045501a538)
2016-11-01 10:49:45 -07:00
Kihwal Lee db6dfeca1a HDFS-10997. Reduce number of path resolving methods. Contributed by Daryn Sharp.
(cherry picked from commit 7c1a1834e4)
2016-11-01 08:26:25 -05:00
Akira Ajisaka 689bbade9a HADOOP-13603. Ignore package line length checkstyle rule. Contributed by Shane Kumpf.
(cherry picked from commit 5b577f43a2)
(cherry picked from commit f0d4d7a178)
2016-11-01 21:00:04 +09:00
Akira Ajisaka 61128c50de MAPREDUCE-6795. Update the document for JobConf#setNumReduceTasks. Contributed by Yiqun Lin.
(cherry picked from commit 235f39b7c4)
(cherry picked from commit a3897f77ae)
2016-11-01 20:52:52 +09:00
Brahma Reddy Battula c895f08936 HDFS-10455. Logging the username when deny the setOwner operation. Contributed by Rakesh R.
(cherry picked from commit 1c5708f6de)
2016-11-01 10:53:37 +05:30
Kihwal Lee 91640a0170 Addendum of HDFS-10722 to include HDFS-7964 logic.
(cherry picked from commit 4a8e6dc02f)
(cherry picked from commit 3b2554f3b0)
(cherry picked from commit c2bb9bf00c)
2016-10-31 16:37:00 -07:00
Zhe Zhang 7900b1e803 Revert "HDFS-10722. Fix race condition in TestEditLog#testBatchedSyncWithClosedLogs. Contributed by Daryn Sharp."
This reverts commit c2bb9bf00c.
2016-10-31 16:35:05 -07:00
Kihwal Lee c2bb9bf00c HDFS-10722. Fix race condition in TestEditLog#testBatchedSyncWithClosedLogs. Contributed by Daryn Sharp.
(cherry picked from commit 4a8e6dc02f)
(cherry picked from commit 3b2554f3b0)
2016-10-31 16:30:39 -07:00
Akira Ajisaka a17fc1dca3 HDFS-10485. Fix findbugs warning in FSEditLog.java. (aajisaka)
(cherry picked from commit e620530301)
(cherry picked from commit b8c1db6f63)
2016-10-31 16:24:35 -07:00