12075 Commits

Author SHA1 Message Date
Wangda Tan
269401dc83 HADOOP-13544. JDiff reports unncessarily show unannotated APIs and cause confusion while our javadocs only show annotated and public APIs. (vinodkv via wangda)
(cherry picked from commit 875062b5bc789158290bf93dadc71b5328ca4fee)
2016-09-27 11:27:25 -07:00
Arpit Agarwal
80628ee2c3 HDFS-10828. Fix usage of FsDatasetImpl object lock in ReplicaMap. (Arpit Agarwal) 2016-09-27 10:02:22 -07:00
Masatake Iwasaki
d17f03b625 HDFS-10426. TestPendingInvalidateBlock failed in trunk. Contributed by Yiqun Lin.
(cherry picked from commit f55eb981dd408ca61d49488f83c99c1fc1f83134)
2016-09-28 01:40:55 +09:00
Arpit Agarwal
b3c0656e90 HDFS-10713. Throttle FsNameSystem lock warnings. Contributed by Hanisha Koneru. 2016-09-27 09:00:39 -07:00
Brahma Reddy Battula
61368c8039 HDFS-10889. Remove outdated Fault Injection Framework documentaion. Contributed by Brahma Reddy Battula
(cherry picked from commit df1d0f5d56f375e82b0219a19675a7b6052aaf30)
2016-09-27 19:34:38 +05:30
Naganarasimha
86ec99e82d YARN-5660. Wrong audit constants are used in Get/Put of priority in RMWebService. Contributed by Rohith Sharma K S
(cherry picked from commit ebf528c443f3931c8b0f92ee76615fc203141675)
2016-09-27 16:42:21 +05:30
Brahma Reddy Battula
5737d04c5f HDFS-9885. Correct the distcp counters name while displaying counters. Contributed by Surendra Singh Lilhore
(cherry picked from commit e17a4970bea8213660bb6c550104783069153236)
2016-09-27 10:47:07 +05:30
Arpit Agarwal
809a45a60c HDFS-9895. Remove unnecessary conf cache from DataNode. Contributed by Xiaobing Zhou. 2016-09-26 19:24:16 -07:00
Wei-Chiu Chuang
bde787db23 HDFS-10609. Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 3ae652f82110a52bf239f3c1849b48981558eb19)
2016-09-26 14:44:48 -07:00
Xiao Chen
06187e4f98 HADOOP-13638. KMS should set UGI's Configuration object properly. Contributed by Wei-Chiu Chuang.
(cherry picked from commit fa397e74fe988bcbb05c816de73eb738794ace4b)

Conflicts:
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java
2016-09-26 13:02:57 -07:00
Arun Suresh
7484d0b1b9 YARN-5609. Expose upgrade and restart API in ContainerManagementProtocol. Contributed by Arun Suresh 2016-09-26 23:55:13 +08:00
Akira Ajisaka
74f2df16a9 YARN-5663. Small refactor in ZKRMStateStore. Contributed by Oleksii Dymytrov.
(cherry picked from commit 14a696f369f7e3802587f57c8fff3aa51b5ab576)
2016-09-26 15:01:13 +09:00
Naganarasimha
eec0afa098 YARN-3877. YarnClientImpl.submitApplication swallows exceptions. Contributed by Varun Saxena
(cherry picked from commit e4e72db5f9f305b493138ab36f073fe5d1750ad8)
2016-09-25 17:38:01 +05:30
Brahma Reddy Battula
74962e3451 HDFS-10869. Remove the unused method InodeId#checkId(). Contributed by Jagadesh Kiran N
(cherry picked from commit 3e37e243ee041e843e060b17c622ab50c8f9ff11)
2016-09-25 11:04:30 +05:30
Naganarasimha
733bfa552a YARN-5664. Fix Yarn documentation to link to correct versions. Contributed by Xiao Chen
(cherry picked from commit 4d16d2d72f085e4efb6db27d397802b21df18815)
2016-09-24 23:22:50 +05:30
Naganarasimha
0e4a5611ff YARN-3692. Allow REST API to set a user generated message when killing an application. Contributed by Rohith Sharma K S 2016-09-24 21:13:01 +05:30
Wei-Chiu Chuang
23984e1787 HADOOP-13535. Add jetty6 acceptor startup issue workaround to branch-2. Contributed by Min Shen. 2016-09-23 14:25:52 -07:00
Wei-Chiu Chuang
6c98455728 HDFS-10876. Dispatcher#dispatch should log IOException stacktrace. Contributed by Manoj Govindassamy.
(cherry picked from commit 74b3dd514c86b46197e2e19d9824a423715cab30)
2016-09-23 13:28:18 -07:00
Kihwal Lee
9dec68c269 YARN-5622. TestYarnCLI.testGetContainers fails due to mismatched date formats. Contributed by Eric Badger.
(cherry picked from commit 6e849cb658438c0561de485e01f3de7df47bf9ad)
2016-09-23 14:10:46 -05:00
Konstantin V Shvachko
c872ecaab4 HDFS-10843. Update space quota when a UC block is completed rather than committed. Contributed by Erik Krogen.
(cherry picked from commit a5bb88c8e0fd4bd19b6d377fecbe1d2d441514f6)
2016-09-23 10:40:09 -07:00
Brahma Reddy Battula
347131fe8d HDFS-10886. Replace fs.default.name with fs.defaultFS in viewfs document.
(cherry picked from commit bbdf350ff9fb624fe736c1eb9271c5dcb4e14b06)
2016-09-23 19:32:37 +05:30
Steve Loughran
247cdbb86a HADOOP-13643. Math error in AbstractContractDistCpTest. Contributed by Aaron Fabbri. 2016-09-23 10:00:32 +01:00
Varun Saxena
b58651d8d4 YARN-5539. TimelineClient failed to retry on java.net.SocketTimeoutException: Read timed out (Junping Du via Varun Saxena) 2016-09-23 13:30:56 +05:30
Robert Kanter
0e4f2a0edf YARN-4973. YarnWebParams next.fresh.interval should be next.refresh.interval (templedf via rkanter)
(cherry picked from commit 5ffd4b7c1e1f3168483c708c7ed307a565389eb2)
2016-09-22 16:46:27 -07:00
Robert Kanter
254041b71a MAPREDUCE-6632. Master.getMasterAddress() should be updated to use YARN-4629 (templedf via rkanter)
(cherry picked from commit 4fc632ae19a1d6b0ec09cc7ead789a3cab1c2f1c)
2016-09-22 16:13:24 -07:00
Tsuyoshi Ozawa
d73359382e HADOOP-13602. Fix some warnings by findbugs in hadoop-maven-plugin. (ozawa)
(cherry picked from commit 8d619b4896ac31f63fd0083594b6e7d207ef71a0)
2016-09-23 01:37:24 +09:00
Karthik Kambatla
a0b0767856 MAPREDUCE-6740. Enforce mapreduce.task.timeout to be at least mapreduce.task.progress-report.interval. (Haibo Chen via kasha)
(cherry picked from commit 537095d13cd38212ed162e0a360bdd9a8bd83498)
2016-09-21 18:30:42 -07:00
Masatake Iwasaki
1b91ebb714 HDFS-9333. Some tests using MiniDFSCluster errored complaining port in use. (iwasakims)
(cherry picked from commit 964e546ab1dba5f5d53b209ec6c9a70a85654765)

 Conflicts:
  hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlockTokenWithDFSStriped.java
2016-09-21 10:40:56 +09:00
Wangda Tan
b9b6396e09 YARN-4591. YARN Web UIs should provide a robots.txt. (Sidharta Seethana via wangda)
(cherry picked from commit 5a58bfee30a662b1b556048504f66f9cf00d182a)
2016-09-20 17:23:01 -07:00
Xiao Chen
81df2be017 HDFS-10879. TestEncryptionZonesWithKMS#testReadWrite fails intermittently. Contributed by Xiao Chen.
(cherry picked from commit d31bef575478fe78c0600fb602e117e4b81c9887)
2016-09-20 16:57:34 -07:00
Mingliang Liu
f98afb3bee HADOOP-13601. Fix a log message typo in AbstractDelegationTokenSecretManager. Contributed by Mehran Hassani.
(cherry picked from commit e80386d69d5fb6a08aa3366e42d2518747af569f)
2016-09-20 13:23:17 -07:00
Arun Suresh
2a9f809c96 YARN-5656. Fix ReservationACLsTestBase. (Sean Po via asuresh)
(cherry picked from commit 9f03b403ec69658fc57bc0f6b832da0e3c746497)
2016-09-20 12:27:50 -07:00
Wangda Tan
679652fcbd Addendum patch for fix javadocs failure which is caused by YARN-3141. (wangda)
(cherry picked from commit e45307c9a063248fcfb08281025d87c4abd343b1)
2016-09-20 11:21:47 -07:00
Jason Lowe
7231000149 YARN-5655. TestContainerManagerSecurity#testNMTokens is asserting. Contributed by Robert Kanter
(cherry picked from commit c6d1d742e70e7b8f1d89cf9a4780657646e6a367)
2016-09-20 14:16:47 +00:00
Jian He
3acd30df71 YARN-3140. Improve locks in AbstractCSQueue/LeafQueue/ParentQueue. Contributed by Wangda Tan
(cherry picked from commit 2b66d9ec5bdaec7e6b278926fbb6f222c4e3afaa)
2016-09-20 15:05:54 +08:00
Xiao Chen
4e376f162f HDFS-10875. Optimize du -x to cache intermediate result. Contributed by Xiao Chen.
(cherry picked from commit e52d6e7a46ceef74dd8d8a3d49c49420e3271365)
2016-09-19 21:45:05 -07:00
Xiao Chen
b6a60d715d HDFS-10489. Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones. Contributed by Xiao Chen.
(cherry picked from commit ea839bd48e4478fc7b6d0a69e0eaeae2de5e0f0d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/HdfsConfiguration.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
2016-09-19 16:38:18 -07:00
Chris Nauroth
e19f910245 HADOOP-13169. Randomize file list in SimpleCopyListing. Contributed by Rajesh Balamohan.
(cherry picked from commit 98bdb5139769eb55893971b43b9c23da9513a784)
2016-09-19 15:16:56 -07:00
Jason Lowe
035f5f8f1d YARN-5540. Scheduler spends too much time looking at empty priorities. Contributed by Jason Lowe
(cherry picked from commit 7558dbbb481eab055e794beb3603bbe5671a4b4c)
2016-09-19 20:33:59 +00:00
Jian He
9942ca2bf0 YARN-3141. Improve locks in SchedulerApplicationAttempt/FSAppAttempt/FiCaSchedulerApp. Contributed by Wangda Tan
(cherry picked from commit b8a30f2f170ffbd590e7366c3c944ab4919e40df)
2016-09-19 17:08:57 +08:00
Arun Suresh
dfaac56433 YARN-5637. Changes in NodeManager to support Container rollback and commit. (asuresh)
(cherry picked from commit 3552c2b99dff4f21489ff284f9dcba40e897a1e5)
2016-09-18 11:06:38 -07:00
Arun Suresh
00759f50be YARN-5657. Fix TestDefaultContainerExecutor. (asuresh)
(cherry picked from commit f67237cbe7bc48a1b9088e990800b37529f1db2a)
2016-09-17 09:32:55 -07:00
Naganarasimha
20729ead91 YARN-5642. Typos in 9 log messages. Contributed by Mehran Hassani 2016-09-17 10:37:42 +05:30
Naganarasimha
fa80972efb MAPREDUCE-6777. Typos in 4 log messages. Contributed by Mehran Hassani 2016-09-17 10:21:13 +05:30
Naganarasimha
656b520dc6 YARN-4232. TopCLI console support for HA mode. Contributed by Bibin A Chundatt
(cherry picked from commit ade7c2bc9ccf09d843ccb3dfa56c1453a9e87318)
2016-09-17 09:54:29 +05:30
Andrew Wang
b03a0be7a3 HDFS-10823. Implement HttpFSFileSystem#listStatusIterator.
(cherry picked from commit 8a40953058d50d421d62b71067a13b626b3cba1f)
2016-09-16 15:37:49 -07:00
Wei-Chiu Chuang
031d5f6c5b HADOOP-13580. If user is unauthorized, log "unauthorized" instead of "Invalid signed text:". Contributed by Wei-Chiu Chuang.
(cherry picked from commit f6f3a447bf3b2900a2e9a0615ad9877f9310e062)
2016-09-16 14:53:50 -07:00
Wei-Chiu Chuang
40089eadf5 HADOOP-13412. Move dev-support/checkstyle/suppressions.xml to hadoop-build-tools. Contributed by John Zhuge.
(cherry picked from commit cd099a63d58c6981c45db2b169430d4935e43bd1)
2016-09-16 14:42:13 -07:00
Steve Loughran
523bc88a28 HADOOP-13160. Suppress checkstyle JavadocPackage check for test source. John Zhuge via stevel
(cherry picked from commit dcbb7009b6f94e655724f6a0320723e1279ebc79)
2016-09-16 14:39:00 -07:00
Wei-Chiu Chuang
1a2c771501 HADOOP-13411. Checkstyle suppression by annotation or comment. Contributed by John Zhuge.
(cherry picked from commit 0e68e14d5506288bbda02cfc755babf1e9875187)
2016-09-16 14:17:20 -07:00