3195 Commits

Author SHA1 Message Date
Zhe Zhang
b8b4ea67d8 HDFS-9804. Allow long-running Balancer to login with keytab. Contributed by Xiao Chen.
(cherry picked from commit ccff6035f50769eb69701128ae61efc69e82609d)
(cherry picked from commit 7d402692b4b06af0459ea81129e93a5182291a27)
2016-08-11 12:42:17 -07:00
Wei-Chiu Chuang
b0bc7681c3 HADOOP-13190. Mention LoadBalancingKMSClientProvider in KMS HA documentation. Contributed by Wei-Chiu Chuang.
(cherry picked from commit db719ef125b11b01eab3353e2dc4b48992bf88d5)
(cherry picked from commit 6d53e096b2d96b9aace46fa9f34cd93e7f0f22a6)
2016-08-11 12:33:15 -07:00
Xiaoyu Yao
cc49133281 HADOOP-13285. DecayRpcScheduler MXBean should only report decayed CallVolumeSummary. Contributed by Xiaoyu Yao.
(cherry picked from commit 0761379fe45898c44c8f161834c298ef932e4d8c)
2016-08-10 15:19:04 -07:00
Wei-Chiu Chuang
753edc4931 HDFS-8224. Schedule a block for scanning if its metadata file is corrupt. Contributed by Rushabh S Shah.
(cherry picked from commit 8efd4959f3fd48fe281aa26a46668071461dee8b)
2016-08-10 11:39:12 -07:00
Karthik Kambatla
5ea35b2af2 HADOOP-13299. JMXJsonServlet is vulnerable to TRACE. (Haibo Chen via kasha)
(cherry picked from commit 85422bb7c5d3e70a49f620ba1c8800e0ba4b64f2)
(cherry picked from commit 2df34ab6e261613526bc7b8e4ef303617f89c758)
2016-08-09 13:47:42 -07:00
Masatake Iwasaki
a9d957d77d HADOOP-13439. Fix race between TestMetricsSystemImpl and TestGangliaMetrics. Contributed by Chen Liang.
(cherry picked from commit 8f9b61852bf6600b65e49875fec172bac9e0a85d)
2016-08-09 10:06:14 +09:00
Wei-Chiu Chuang
7b042c5c72 HADOOP-13395. Enhance TestKMSAudit. Contributed by Xiao Chen.
(cherry picked from commit 070548943a16370a74277d1b1d10b713e2ca81d0)

Conflicts:
hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMSAudit.java

(cherry picked from commit cc20316b55ee108ccd880e8fb0565eacae2b90bd)
2016-08-08 15:18:19 -07:00
Arpit Agarwal
5006083806 HADOOP-13457. Remove hardcoded absolute path for shell executable. (Chen Liang) 2016-08-08 12:31:19 -07:00
Jitendra Pandey
f4bf3e22de HADOOP-10823. TestReloadingX509TrustManager is flaky. Contributed by Mingliang Liu.
Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/ssl/TestReloadingX509TrustManager.java
2016-08-08 11:06:05 -07:00
Naganarasimha
8055ff1c3c HADOOP-13353. LdapGroupsMapping getPassward shouldn't return null when IOException throws. Contributed by Wei-Chiu Chuang 2016-08-06 23:18:53 +05:30
Masatake Iwasaki
e1684f84e2 HADOOP-13418. Fix javadoc warnings by JDK8 in hadoop-nfs package. Contributed by Kai Sasaki.
(cherry picked from commit 10ed06a0c96cbb8b70e03deeb5bb94df700f9518)
2016-08-06 12:29:58 +09:00
Wei-Chiu Chuang
e7863da095 Revert "HADOOP-13353. LdapGroupsMapping getPassward shouldn't return null when IOException throws. Contributed by Zhaohao Liang and Wei-Chiu Chuang."
This reverts commit 7dbfe2f09963a6104f2b3b8c95015d4017bdc5d0.
2016-08-05 19:05:52 -07:00
Wei-Chiu Chuang
7dbfe2f099 HADOOP-13353. LdapGroupsMapping getPassward shouldn't return null when IOException throws. Contributed by Zhaohao Liang and Wei-Chiu Chuang.
(cherry picked from commit 49ba09a9221ad1e25e89800f6c455bbaad41483b)
(cherry picked from commit d875dfef3dfa91c3af6a90830a6d9c28df490db3)
2016-08-05 16:37:23 -07:00
Arpit Agarwal
46c07bd021 HADOOP-13466. Add an AutoCloseableLock class. (Chen Liang) 2016-08-04 12:32:39 -07:00
Arpit Agarwal
ad29c96075 HADOOP-13467. Shell#getSignalKillCommand should use the bash builtin on Linux. (Arpit Agarwal) 2016-08-04 10:28:55 -07:00
Kihwal Lee
1b97519987 HADOOP-13442. Optimize UGI group lookups. Contributed by Daryn Sharp.
(cherry picked from commit 94225152399e6e89fa7b4cff6d17d33e544329a3)
2016-08-04 10:49:19 -05:00
Jason Lowe
6fc68a379b HADOOP-10980. TestActiveStandbyElector fails occasionally in trunk. Contributed by Eric Badger
(cherry picked from commit c82745432a962c817a8a7db92bb830fb6af01e33)
2016-08-03 20:20:24 +00:00
Arpit Agarwal
ad653de2d7 HDFS-9353. Code and comment mismatch in JavaKeyStoreProvider. (Andras Bokor) 2016-08-02 15:18:24 -07:00
Arpit Agarwal
745ba1160b HADOOP-13434. Add bash quoting to Shell class. (Owen O'Malley) 2016-08-02 13:43:50 -07:00
Chris Nauroth
06df0cd87f HADOOP-13081. add the ability to create multiple UGIs/subjects from one kerberos login. Contributed by Sergey Shelukhin.
(cherry picked from commit 0458a2af6e925d023882714e8b7b0568eca7a775)
(cherry picked from commit ec522a19076314f309ef475a8fdf08ec840dafae)
2016-08-02 12:43:58 -07:00
Akira Ajisaka
f39ed9ea8e HADOOP-13444. Replace org.apache.commons.io.Charsets with java.nio.charset.StandardCharsets. Contributed by Vincent Poon.
(cherry picked from commit 5469e128d3e1150b7bf72a4c036a3fbbddc7f7d7)
2016-08-02 10:18:52 +09:00
Chris Nauroth
244285488d HADOOP-13422. ZKDelegationTokenSecretManager JaasConfig does not work well with other ZK users in process. Contributed by Sergey Shelukhin.
(cherry picked from commit 255ea45e50e102505ee61eb0ba45ea93035abe3c)
(cherry picked from commit df2ed6b2c4f5b42a57e211e58d4a7350c9ac6fb8)
2016-07-26 15:33:42 -07:00
Jing Zhao
54be36a6d6 HDFS-9894. Add unsetStoragePolicy API to FileContext/AbstractFileSystem and derivatives. Contributed by Xiaobing Zhou.
(cherry picked from commit 7149cdb3c2d9dd390cd8668883cbe5db94090e0a)
2016-07-25 09:51:59 -07:00
Arpit Agarwal
bbf711c030 HDFS-9534. Add CLI command to clear storage policy from a path. (Contributed by Xiaobing Zhou) 2016-07-25 09:51:59 -07:00
Chris Nauroth
0456069aca HADOOP-13207. Specify FileSystem listStatus, listFiles and RemoteIterator. Contributed by Steve Loughran.
(cherry picked from commit 5fda66e4a38c7597bc0bc9c94748c8491b7f3750)
(cherry picked from commit e6ba69b4db0463b99cfa594394eca0480478e965)
2016-07-22 15:39:12 -07:00
Chris Nauroth
af3c860bb1 HADOOP-13240. TestAclCommands.testSetfaclValidations fail. Contributed by John Zhuge.
(cherry picked from commit 43cf6b101dacd96bacfd199826b717f6946109af)
(cherry picked from commit 382bcf21e7f7f752ba901f856abf080e8700e890)
2016-07-21 14:12:47 -07:00
Jakob Homan
9442e1d48e HADOOP-12009. Clarify FileSystem.listStatus() sorting order & fix FileSystemContractBaseTest:testListStatus. backport to 2.8 2016-07-21 21:50:25 +01:00
Allen Wittenauer
35885e9540 HDFS-9852. hdfs dfs -setfacl error message is misleading (Wei-Chiu Chuang via aw)
(cherry picked from commit b3649adf6a1b2dc47566b4b0d652bd4e0a6a8056)
(cherry picked from commit 84c785036f5014d4e6066b344c2c235d1ea5028f)
2016-07-20 11:30:52 -07:00
Steve Loughran
0f1e02a298 HADOOP-13212 Provide an option to set the socket buffers in S3AFileSystem (Rajesh Balamohan) 2016-07-20 13:42:19 +01:00
Akira Ajisaka
f2508d78b2 HADOOP-12991. Conflicting default ports in DelegateToFileSystem. Contributed by Kai Sasaki.
(cherry picked from commit dc065dd64ca3e101b0c0a7bcc7d7a067b77d6c82)
(cherry picked from commit 8fe2c450b38ab51087eea867fd1dd960915a6fed)
2016-07-19 16:06:35 -07:00
Akira Ajisaka
cf79ac5fa9 HADOOP-13202. Avoid possible overflow in org.apache.hadoop.util.bloom.BloomFilter#getNBytes. Contributed by Kai Sasaki.
(cherry picked from commit c2bcffb34ebe4399b523a44f69d23761648bd0c4)
(cherry picked from commit 09375baad1ba732b73701cdbd0ee77618ed6f687)
2016-07-18 11:50:53 -07:00
Akira Ajisaka
bc21763da4 HADOOP-13289. Remove unused variables in TestFairCallQueue. Contributed by Ye Zhou.
(cherry picked from commit 13814832331ad691b898cd9f602b0a0a771d7928)
(cherry picked from commit 2231ef22f576d9a7d65276cf90efd0f45cb362f5)
2016-07-14 23:15:53 -07:00
Zhe Zhang
cbd885b6fa HADOOP-13290. Appropriate use of generics in FairCallQueue. Contributed by Jonathan Hung.
(cherry picked from commit 728bf7f6988e13f17f03d2e3a4037b7238c4fd45)
(cherry picked from commit b95f1af8a9aafb3e482c7b8825f2097f2ceb0e8e)
2016-07-13 16:47:01 -07:00
Akira Ajisaka
213b7f40de HADOOP-13366. Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc. Contributed by Rakesh R.
(cherry picked from commit 505ce884378f651991d04dda8c126f416bd69f56)
(cherry picked from commit ee1e45e4b253a6b9ece3e57e79280fc766cf56ce)
2016-07-13 13:10:27 -07:00
Tsuyoshi Ozawa
fa9ff4997e HADOOP-11361. Fix a race condition in MetricsSourceAdapter.updateJmxCache. Contributed by Vinayakumar B, Yongjun Zhang, and Brahma Reddy Battula. (ozawa)
(cherry picked from commit 77ffe7621212be9f462ca37a542a13d167eca4e0)
2016-07-13 21:41:11 +09:00
Lei Xu
d1d280fcfa HADOOP-13315. FileContext#umask is not initialized properly. (John Zhuge via lei)
(cherry picked from commit a290a98b6ab2424ae9b7faab0ce9496d09ca46f3)
2016-07-12 16:51:55 -07:00
Jitendra Pandey
324923e1bc HADOOP-13352. Make X-FRAME-OPTIONS configurable in HttpServer2. Contributed by Anu Engineer. 2016-07-12 14:38:20 -07:00
Robert Kanter
2e2caeb50e HADOOP-12964. Http server vulnerable to clickjacking (haibochen via rkanter)
(cherry picked from commit 042a3ae960883c263adc76f16d0ea3438d8b12be)
2016-07-12 14:37:57 -07:00
Steve Loughran
310c08454f HADOOP-13139 Branch-2: S3a to use thread pool that blocks clients. Contributed by Pieter Reuse. 2016-07-11 17:21:14 +01:00
Akira Ajisaka
a8cfcce542 Revert "HADOOP-10465. Fix use of generics within SortedMapWritable. Contributed by Bertrand Dechoux."
This reverts commit 1d175f0f3f80a066a6de71213392d288329d837f.
2016-07-09 21:01:07 -07:00
Jitendra Pandey
9c7ce389c7 HADOOP-13283. Support reset operation for new global storage statistics and per FS storage stats. Contributed by Mingliang Liu. 2016-07-07 15:04:47 -07:00
Jitendra Pandey
bc7fd76a1f HADOOP-13305. Define common statistics names across schemes. Contributed by Mingliang Liu. 2016-07-01 15:37:32 -07:00
Vinayakumar B
2c6e7f221e HADOOP-13314. Remove 'package-info.java' from 'test\java\org\apache\hadoop\fs\shell\' to remove eclipse compile error (Contributed by Vinayakumar B)
(cherry picked from commit c25021fb7196f498ccf1319dbd0c7f948f8518c1)
(cherry picked from commit 1458e66593511acfe4c2cd36853339bccc6fd93d)
2016-07-01 12:23:23 +05:30
Andrew Wang
ae2ab601c0 HADOOP-12345. Pad hostname correctly in CredentialsSys.java. Contributed by Pradeep Nayak Udupi Kadbet.
(cherry picked from commit 846ada2de33f9840d6e60fd7339ecc2d71f277c7)
(cherry picked from commit af581c0e2306970f4965f64cbbc2255c8bfc2191)
2016-06-29 17:32:52 -07:00
Masatake Iwasaki
b5dbd3b5ed HADOOP-12242. Add in-page TOC to filesystem specification pages. (iwasakims)
(cherry picked from commit 5c07c573db06481c89f1c9ad062e2d2aa19feaa0)
2016-06-30 07:30:37 +09:00
Steve Loughran
52dbafecc5 HADOOP-12229 Fix inconsistent subsection titles in filesystem.md. Contributed by Masatake Iwasaki 2016-06-29 14:31:13 +01:00
Andrew Wang
47c13c4f7d HADOOP-13316. Enforce Kerberos authentication for required ops in DelegationTokenAuthenticator. Contributed by Xiao Chen.
(cherry picked from commit 7d2070493e07198896bc49135bc84ef00499a375)
(cherry picked from commit 22eb53eb715deb95cb3fcc16cdf327e1406b9c64)
2016-06-27 18:46:59 -07:00
Andrew Wang
59a70977c3 HADOOP-13251. Authenticate with Kerberos credentials when renewing KMS delegation token. Contributed by Xiao Chen.
(cherry picked from commit 771f798edf97b27ae003395118c0317b484df6ee)

 Conflicts:
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java

(cherry picked from commit d8a69c873725b681b06b116cdd10bdb3c2082963)
2016-06-27 18:29:58 -07:00
Akira Ajisaka
a0f6109907 MAPREDUCE-6542. HistoryViewer uses SimpleDateFormat, but SimpleDateFormat is not threadsafe. Contributed by zhangyubiao. 2016-06-27 15:19:21 -07:00
Arpit Agarwal
f7bd302550 HADOOP-13263. Reload cached groups in background after expiry. (Contributed bt Stephen O'Donnell) 2016-06-27 09:51:16 -07:00