2989 Commits

Author SHA1 Message Date
Zhe Zhang
8bc33bf343 HADOOP-12765. HttpServer2 should switch to using the non-blocking SslSelectChannelConnector to prevent performance degradation when handling SSL connections. Contributed by Min Shen. Branch-2 patch contributed by Wei-Chiu Chuang.
(cherry picked from commit dfcbc12026b591745a7d7279f2b840152cb53a91)
2016-08-23 14:46:47 -07:00
Masatake Iwasaki
80d8e79e26 HADOOP-13497. fix wrong command in CredentialProviderAPI.md. Contributed by Yuanbo Liu.
(cherry picked from commit 8aae8d6bf03ade0607547ed461dc99a336a7e9d4)
2016-08-24 00:10:37 +09:00
Xiao Chen
0f9bed050d HADOOP-13487. Hadoop KMS should load old delegation tokens from Zookeeper on startup. Contributed by Xiao Chen.
(cherry picked from commit 2f21d53e3aaf97f425f954f52b50f36dddb6b886)
2016-08-22 14:42:20 -07:00
Mingliang Liu
9d304822f6 HADOOP-13527. Add Spark to CallerContext LimitedPrivate scope. (Contributed by Weiqing Yang)
(cherry picked from commit 115ecb52a86b49aad3d058a6b4c1c7926b8b0a40)
2016-08-21 09:42:06 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
b2efb2040c HADOOP-13428. Fixed hadoop-common build files to generate jdiff by working around a jdiff-bug. Contributed by Wangda Tan.
(cherry picked from commit 99603e902244f17b04cfd55122f47355d070b588)
2016-08-19 19:11:04 -07:00
Kihwal Lee
4f3df8e22a HDFS-7959. WebHdfs logging is missing on Datanode (Kihwal Lee via sjlee)
(cherry picked from commit ae90d4dd908cf3f9e9ff26fa8e92f028057a9ca1)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/webhdfs/WebHdfsHandler.java
2016-08-19 15:32:11 -05:00
Chris Nauroth
dd6c149c4a HADOOP-13252. Tune S3A provider plugin mechanism. Contributed by Steve Loughran.
(cherry picked from commit 763f0497bb996e331e40caed9ca0af966f5b3fac)
(cherry picked from commit 6dba38f08ba84109b01c8ce8d30c71354d089dbe)
2016-08-19 12:55:57 -07:00
Jing Zhao
5d91f9fe35 HADOOP-13503. Improve SaslRpcClient failure logging. Contributed by Xiaobing Zhou.
(cherry picked from commit 9fdd1ea72497f7a8aadbfedeba36688e0c16c52e)
2016-08-18 15:00:17 -07:00
Mingliang Liu
ef38aa64c6 HADOOP-13512. ReloadingX509TrustManager should keep reloading in case of exception. (Contributed by Mingliang Liu)
(cherry picked from commit 0f51eae0c085ded38216824377acf8122638c3a5)
2016-08-18 14:22:58 -07:00
Steve Loughran
c09797ce9f HADOOP-13405 doc for fs.s3a.acl.default indicates incorrect values. Contributed by Shen Yinjie 2016-08-18 14:35:26 +01:00
Mingliang Liu
00eb790622 HADOOP-13470. GenericTestUtils$LogCapturer is flaky. (Contributed by Mingliang Liu) 2016-08-16 17:41:51 -07:00
Mingliang Liu
b6d92c61fe Revert "HADOOP-13470. GenericTestUtils$LogCapturer is flaky. (Contributed by Mingliang Liu)"
This reverts commit 657064e59397feb92cec95094ac34c85e3040c50.
2016-08-16 16:27:36 -07:00
Andrew Wang
8b6eeb2595 HADOOP-13494. ReconfigurableBase can log sensitive information. Contributed by Sean Mackrory.
(cherry picked from commit 4b689e7a758a55cec2ca8398727feefc8ac21bfd)
(cherry picked from commit c91e6f28283d1f8ad4504a2338a01e284ced6b24)

 Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/CommonConfigurationKeysPublic.java
2016-08-16 15:14:06 -07:00
Mingliang Liu
657064e593 HADOOP-13470. GenericTestUtils$LogCapturer is flaky. (Contributed by Mingliang Liu) 2016-08-15 20:46:40 -07:00
Mingliang Liu
0b934c375e HDFS-10678. Documenting NNThroughputBenchmark tool. (Contributed by Mingliang Liu) 2016-08-15 20:46:28 -07:00
Mingliang Liu
6471ec31bc HDFS-10724. Document caller context config keys. (Contributed by Mingliang Liu)
(cherry picked from commit 4bcbef39f7ca07601092919a7f2bea531a2dfa07)
2016-08-15 20:46:03 -07:00
Varun Saxena
6fed7b9c45 HADOOP-13333. testConf.xml ls comparators in wrong order (Vrushali C via Varun Saxena) 2016-08-16 03:14:24 +05:30
Zhe Zhang
b8b4ea67d8 HDFS-9804. Allow long-running Balancer to login with keytab. Contributed by Xiao Chen.
(cherry picked from commit ccff6035f50769eb69701128ae61efc69e82609d)
(cherry picked from commit 7d402692b4b06af0459ea81129e93a5182291a27)
2016-08-11 12:42:17 -07:00
Xiaoyu Yao
cc49133281 HADOOP-13285. DecayRpcScheduler MXBean should only report decayed CallVolumeSummary. Contributed by Xiaoyu Yao.
(cherry picked from commit 0761379fe45898c44c8f161834c298ef932e4d8c)
2016-08-10 15:19:04 -07:00
Wei-Chiu Chuang
753edc4931 HDFS-8224. Schedule a block for scanning if its metadata file is corrupt. Contributed by Rushabh S Shah.
(cherry picked from commit 8efd4959f3fd48fe281aa26a46668071461dee8b)
2016-08-10 11:39:12 -07:00
Karthik Kambatla
5ea35b2af2 HADOOP-13299. JMXJsonServlet is vulnerable to TRACE. (Haibo Chen via kasha)
(cherry picked from commit 85422bb7c5d3e70a49f620ba1c8800e0ba4b64f2)
(cherry picked from commit 2df34ab6e261613526bc7b8e4ef303617f89c758)
2016-08-09 13:47:42 -07:00
Masatake Iwasaki
a9d957d77d HADOOP-13439. Fix race between TestMetricsSystemImpl and TestGangliaMetrics. Contributed by Chen Liang.
(cherry picked from commit 8f9b61852bf6600b65e49875fec172bac9e0a85d)
2016-08-09 10:06:14 +09:00
Arpit Agarwal
5006083806 HADOOP-13457. Remove hardcoded absolute path for shell executable. (Chen Liang) 2016-08-08 12:31:19 -07:00
Jitendra Pandey
f4bf3e22de HADOOP-10823. TestReloadingX509TrustManager is flaky. Contributed by Mingliang Liu.
Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/ssl/TestReloadingX509TrustManager.java
2016-08-08 11:06:05 -07:00
Naganarasimha
8055ff1c3c HADOOP-13353. LdapGroupsMapping getPassward shouldn't return null when IOException throws. Contributed by Wei-Chiu Chuang 2016-08-06 23:18:53 +05:30
Wei-Chiu Chuang
e7863da095 Revert "HADOOP-13353. LdapGroupsMapping getPassward shouldn't return null when IOException throws. Contributed by Zhaohao Liang and Wei-Chiu Chuang."
This reverts commit 7dbfe2f09963a6104f2b3b8c95015d4017bdc5d0.
2016-08-05 19:05:52 -07:00
Wei-Chiu Chuang
7dbfe2f099 HADOOP-13353. LdapGroupsMapping getPassward shouldn't return null when IOException throws. Contributed by Zhaohao Liang and Wei-Chiu Chuang.
(cherry picked from commit 49ba09a9221ad1e25e89800f6c455bbaad41483b)
(cherry picked from commit d875dfef3dfa91c3af6a90830a6d9c28df490db3)
2016-08-05 16:37:23 -07:00
Arpit Agarwal
46c07bd021 HADOOP-13466. Add an AutoCloseableLock class. (Chen Liang) 2016-08-04 12:32:39 -07:00
Arpit Agarwal
ad29c96075 HADOOP-13467. Shell#getSignalKillCommand should use the bash builtin on Linux. (Arpit Agarwal) 2016-08-04 10:28:55 -07:00
Kihwal Lee
1b97519987 HADOOP-13442. Optimize UGI group lookups. Contributed by Daryn Sharp.
(cherry picked from commit 94225152399e6e89fa7b4cff6d17d33e544329a3)
2016-08-04 10:49:19 -05:00
Jason Lowe
6fc68a379b HADOOP-10980. TestActiveStandbyElector fails occasionally in trunk. Contributed by Eric Badger
(cherry picked from commit c82745432a962c817a8a7db92bb830fb6af01e33)
2016-08-03 20:20:24 +00:00
Arpit Agarwal
ad653de2d7 HDFS-9353. Code and comment mismatch in JavaKeyStoreProvider. (Andras Bokor) 2016-08-02 15:18:24 -07:00
Arpit Agarwal
745ba1160b HADOOP-13434. Add bash quoting to Shell class. (Owen O'Malley) 2016-08-02 13:43:50 -07:00
Chris Nauroth
06df0cd87f HADOOP-13081. add the ability to create multiple UGIs/subjects from one kerberos login. Contributed by Sergey Shelukhin.
(cherry picked from commit 0458a2af6e925d023882714e8b7b0568eca7a775)
(cherry picked from commit ec522a19076314f309ef475a8fdf08ec840dafae)
2016-08-02 12:43:58 -07:00
Akira Ajisaka
f39ed9ea8e HADOOP-13444. Replace org.apache.commons.io.Charsets with java.nio.charset.StandardCharsets. Contributed by Vincent Poon.
(cherry picked from commit 5469e128d3e1150b7bf72a4c036a3fbbddc7f7d7)
2016-08-02 10:18:52 +09:00
Chris Nauroth
244285488d HADOOP-13422. ZKDelegationTokenSecretManager JaasConfig does not work well with other ZK users in process. Contributed by Sergey Shelukhin.
(cherry picked from commit 255ea45e50e102505ee61eb0ba45ea93035abe3c)
(cherry picked from commit df2ed6b2c4f5b42a57e211e58d4a7350c9ac6fb8)
2016-07-26 15:33:42 -07:00
Jing Zhao
54be36a6d6 HDFS-9894. Add unsetStoragePolicy API to FileContext/AbstractFileSystem and derivatives. Contributed by Xiaobing Zhou.
(cherry picked from commit 7149cdb3c2d9dd390cd8668883cbe5db94090e0a)
2016-07-25 09:51:59 -07:00
Arpit Agarwal
bbf711c030 HDFS-9534. Add CLI command to clear storage policy from a path. (Contributed by Xiaobing Zhou) 2016-07-25 09:51:59 -07:00
Chris Nauroth
0456069aca HADOOP-13207. Specify FileSystem listStatus, listFiles and RemoteIterator. Contributed by Steve Loughran.
(cherry picked from commit 5fda66e4a38c7597bc0bc9c94748c8491b7f3750)
(cherry picked from commit e6ba69b4db0463b99cfa594394eca0480478e965)
2016-07-22 15:39:12 -07:00
Chris Nauroth
af3c860bb1 HADOOP-13240. TestAclCommands.testSetfaclValidations fail. Contributed by John Zhuge.
(cherry picked from commit 43cf6b101dacd96bacfd199826b717f6946109af)
(cherry picked from commit 382bcf21e7f7f752ba901f856abf080e8700e890)
2016-07-21 14:12:47 -07:00
Jakob Homan
9442e1d48e HADOOP-12009. Clarify FileSystem.listStatus() sorting order & fix FileSystemContractBaseTest:testListStatus. backport to 2.8 2016-07-21 21:50:25 +01:00
Allen Wittenauer
35885e9540 HDFS-9852. hdfs dfs -setfacl error message is misleading (Wei-Chiu Chuang via aw)
(cherry picked from commit b3649adf6a1b2dc47566b4b0d652bd4e0a6a8056)
(cherry picked from commit 84c785036f5014d4e6066b344c2c235d1ea5028f)
2016-07-20 11:30:52 -07:00
Steve Loughran
0f1e02a298 HADOOP-13212 Provide an option to set the socket buffers in S3AFileSystem (Rajesh Balamohan) 2016-07-20 13:42:19 +01:00
Akira Ajisaka
f2508d78b2 HADOOP-12991. Conflicting default ports in DelegateToFileSystem. Contributed by Kai Sasaki.
(cherry picked from commit dc065dd64ca3e101b0c0a7bcc7d7a067b77d6c82)
(cherry picked from commit 8fe2c450b38ab51087eea867fd1dd960915a6fed)
2016-07-19 16:06:35 -07:00
Akira Ajisaka
cf79ac5fa9 HADOOP-13202. Avoid possible overflow in org.apache.hadoop.util.bloom.BloomFilter#getNBytes. Contributed by Kai Sasaki.
(cherry picked from commit c2bcffb34ebe4399b523a44f69d23761648bd0c4)
(cherry picked from commit 09375baad1ba732b73701cdbd0ee77618ed6f687)
2016-07-18 11:50:53 -07:00
Akira Ajisaka
bc21763da4 HADOOP-13289. Remove unused variables in TestFairCallQueue. Contributed by Ye Zhou.
(cherry picked from commit 13814832331ad691b898cd9f602b0a0a771d7928)
(cherry picked from commit 2231ef22f576d9a7d65276cf90efd0f45cb362f5)
2016-07-14 23:15:53 -07:00
Zhe Zhang
cbd885b6fa HADOOP-13290. Appropriate use of generics in FairCallQueue. Contributed by Jonathan Hung.
(cherry picked from commit 728bf7f6988e13f17f03d2e3a4037b7238c4fd45)
(cherry picked from commit b95f1af8a9aafb3e482c7b8825f2097f2ceb0e8e)
2016-07-13 16:47:01 -07:00
Akira Ajisaka
213b7f40de HADOOP-13366. Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc. Contributed by Rakesh R.
(cherry picked from commit 505ce884378f651991d04dda8c126f416bd69f56)
(cherry picked from commit ee1e45e4b253a6b9ece3e57e79280fc766cf56ce)
2016-07-13 13:10:27 -07:00
Tsuyoshi Ozawa
fa9ff4997e HADOOP-11361. Fix a race condition in MetricsSourceAdapter.updateJmxCache. Contributed by Vinayakumar B, Yongjun Zhang, and Brahma Reddy Battula. (ozawa)
(cherry picked from commit 77ffe7621212be9f462ca37a542a13d167eca4e0)
2016-07-13 21:41:11 +09:00
Lei Xu
d1d280fcfa HADOOP-13315. FileContext#umask is not initialized properly. (John Zhuge via lei)
(cherry picked from commit a290a98b6ab2424ae9b7faab0ce9496d09ca46f3)
2016-07-12 16:51:55 -07:00