Commit Graph

3356 Commits

Author SHA1 Message Date
Mingliang Liu 9ea6b24c49 HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran
(cherry picked from commit fd26783aaf)
2017-03-10 00:21:58 -08:00
Lei Xu 01624f0c1b HADOOP-13956. Read ADLS credentials from Credential Provider. (John Zhuge via lei)
(cherry picked from commit e015b56319)
2017-03-09 15:16:28 -08:00
Arpit Agarwal 5cdcda34a2 HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru. 2017-03-09 14:34:10 -08:00
Jian He ea8d53de6a Revert "HADOOP-14062. ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled. Contributed by Steven Rand"
This reverts commit 36eda5af75.
2017-03-08 13:20:45 -08:00
John Zhuge f1fd20be82 Revert "HADOOP-13606 swift FS to add a service load metadata file. Contributed by Steve Loughran"
This reverts commit 53a12fa721.

(cherry picked from commit 98142d2f72)

Change-Id: Ia5fa901fa97391cd46d41f59cd05f7a19c7c7532
2017-03-08 11:46:27 -08:00
Jian He 36eda5af75 HADOOP-14062. ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled. Contributed by Steven Rand 2017-03-08 10:49:07 -08:00
Arpit Agarwal 8be80ccb72 HDFS-11508. Fix bind failure in SimpleTCPServer & Portmap where bind fails because socket is in TIME_WAIT state. Contributed by Mukul Kumar Singh. 2017-03-07 11:41:12 -08:00
Mingliang Liu ff050866bf HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth
(cherry picked from commit 686823529b)
2017-03-06 17:35:06 -08:00
Mingliang Liu 8323e651a1 Revert "HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth"
This reverts commit b26870c58e.
2017-03-06 17:18:36 -08:00
Ray Chiang d943480147 YARN-5665. Enhance documentation for yarn.resourcemanager.scheduler.class property. (Yufei Gu via rchiang)
(cherry picked from commit d9dc444dc7)
2017-03-06 14:05:09 -08:00
Andrew Wang cf5a1390aa HDFS-11441. Add escaping to error message in KMS web UI. Contributed by Aaron T. Myers.
(cherry picked from commit ec839b94c0)
2017-03-06 10:47:28 -08:00
Akira Ajisaka ed55bcee1f
HADOOP-14108. CLI MiniCluster: add an option to specify NameNode HTTP port. Contributed by Takanobu Asanuma.
(cherry picked from commit 209ecd1a5c)
2017-03-07 01:36:10 +09:00
Mingliang Liu b26870c58e HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth 2017-03-03 17:09:05 -08:00
Jason Lowe 9b949f49e3 YARN-6274. Documentation refers to incorrect nodemanager health checker interval property. Contributed by WeiWei Yang
(cherry picked from commit 05237636d3)
2017-03-03 08:01:40 -06:00
Harsh J d4c13df515 HADOOP-6801. io.sort.mb and io.sort.factor were renamed and moved to mapreduce but are still in CommonConfigurationKeysPublic.java and used in SequenceFile.java.
This closes #146

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit eb5a17954a)
2017-03-03 18:39:47 +09:00
Andrew Wang d737a26c5a Revert "HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru."
This reverts commit 5e760f8dc4.
2017-03-02 16:21:32 -08:00
Arpit Agarwal 5e760f8dc4 HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru. 2017-03-02 15:38:32 -08:00
John Zhuge 133857ba04 HADOOP-14131. kms.sh creates bogus dir for tomcat logs. Contributed by John Zhuge.
Change-Id: I444e10318eb64dcd4c0416b985d12049c72e8943
2017-03-01 16:31:34 -08:00
Arpit Agarwal ff08f54f41 HDFS-11479. Socket re-use address option should be used in SimpleUdpServer. Contributed by Mukul Kumar Singh. 2017-03-01 12:59:09 -08:00
Brahma Reddy Battula a545ee4d7f HDFS-11432. Federation : Support fully qualified path for Quota/Snapshot/cacheadmin/cryptoadmin commands. Contributed by Brahma Reddy Battula.
(cherry picked from commit dcd03df9f9)
2017-03-01 10:47:47 +05:30
Lei Xu 76bf47cb91 Add missing file hadoop-common-project/hadoop-kms/src/main/tomcat/catalina-default.properties for HADOOP-14083. (lei) 2017-02-27 20:49:35 -08:00
Lei Xu d440ad46b5 HADOOP-14083. KMS should support old SSL clients. (John Zhuge via Lei Xu) 2017-02-27 18:12:00 -08:00
Yiqun Lin 6cd39803ba HADOOP-14119. Remove unused imports from GzipCodec.java. Contributed by Yiqun Lin.
(cherry picked from commit 9db2e0c8d4)
2017-02-27 18:41:47 +08:00
Xuan 5c509f5f0c HADOOP-14116:FailoverOnNetworkExceptionRetry does not wait when failover
on certain exception. Contributed by Jian He

(cherry picked from commit 289bc50e66)
2017-02-24 11:43:22 -08:00
Harsh J c097d0343c HADOOP-13817. Add a finite shell command timeout to ShellBasedUnixGroupsMapping. (harsh)
(cherry picked from commit e8694deb6a)
2017-02-24 21:34:31 +05:30
Akira Ajisaka b5a8c49cf3 HADOOP-14097. Remove Java6 specific code from GzipCodec.java. Contributed by Elek, Marton.
(cherry picked from commit 50decd3613)
2017-02-25 00:29:40 +09:00
Wei-Chiu Chuang 12ad077aa6 HADOOP-13233. help of stat is confusing. Contributed by Attila Bukor.
(cherry picked from commit cc45da79fd)
2017-02-13 10:17:41 -08:00
Lei Xu 6d62d0ea87 HADOOP-13204. Add support for SSE-KMS and SSE-C in s3a filesystem. (Steve Moist via lei) 2017-02-11 15:02:19 -08:00
Arpit Agarwal 4c5655ef1a HDFS-11403. Addendum fix for branch-2. 2017-02-11 01:25:43 -08:00
Arpit Agarwal 32a0c2b5e7 HDFS-11403. Zookeper ACLs on NN HA enabled clusters should be handled consistently. Contributed by Hanisha Koneru. 2017-02-11 01:18:07 -08:00
Kihwal Lee 5de6f1b791 HADOOP-14033. Reduce fair call queue lock contention. Contributed by Daryn Sharp.
(cherry picked from commit 0c01cf5798)
2017-02-09 16:20:06 -06:00
Kihwal Lee d008b55153 HADOOP-14034. Allow ipc layer exceptions to selectively close connections. Contributed by Daryn Sharp. 2017-02-09 10:55:40 -06:00
Kihwal Lee 2039d021f9 HADOOP-14032. Reduce fair call queue priority inversion. Contributed by Daryn Sharp.
(cherry picked from commit a0bfb41504)
2017-02-09 10:13:37 -06:00
Junping Du 33e7c3044f YARN-6145. Improve log message on fail over. Contributed by Jian He.
(cherry picked from commit eec52e158b)
2017-02-08 02:15:11 -08:00
Junping Du b7d59e790b HADOOP-12097. Allow port range to be specified while starting webapp. Contributed by Varun Saxena.
(cherry picked from commit cce35c3815)

Conflicts:

	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/http/HttpServer2.java
2017-02-05 20:13:49 -08:00
Akira Ajisaka be9b02e0b6 HADOOP-14053. Update the link to HTrace SpanReceivers. Contributed by Yiqun Lin.
(cherry picked from commit cb8f3f3adf)
2017-02-04 10:59:18 +09:00
Xiao Chen 05ed48b75a HADOOP-14044. Synchronization issue in delegation token cancel functionality. Contributed by Hrishikesh Gadre.
(cherry picked from commit ba75bc7593)
2017-02-03 17:27:35 -08:00
Kihwal Lee 7baa6dac54 HADOOP-14050. Add process name to kms process. Contributed by Rushabh S Shah. 2017-02-03 15:38:55 -06:00
Jason Lowe 4703f5d20b YARN-5641. Localizer leaves behind tarballs after container is complete. Contributed by Eric Badger 2017-01-27 15:25:57 +00:00
Xiaoyu Yao 6b602c6e34 HADOOP-14029. Fix KMSClientProvider for non-secure proxyuser use case. Contributed by Xiaoyu Yao.
(cherry picked from commit 2034315763)
2017-01-26 20:36:43 -08:00
Xiao Chen 4a48f0e702 HADOOP-14003. Make additional KMS tomcat settings configurable. Contributed by Andrew Wang. 2017-01-26 11:22:16 -08:00
Jason Lowe b806201f0a Revert "YARN-5641. Localizer leaves behind tarballs after container is complete. Contributed by Eric Badger"
This reverts commit 45407acaed.
2017-01-26 14:42:22 +00:00
Jason Lowe 45407acaed YARN-5641. Localizer leaves behind tarballs after container is complete. Contributed by Eric Badger
(cherry picked from commit 9e19f758c1)
2017-01-25 21:54:17 +00:00
Xiaoyu Yao 9fa98cc45e HADOOP-13988. KMSClientProvider does not work with WebHDFS and Apache Knox w/ProxyUser. Contributed by Greg Senia and Xiaoyu Yao.
(cherry picked from commit a46933e8ce)
2017-01-25 13:34:42 -08:00
Steve Loughran bb46d40558 HADOOP-13433 Race in UGI.reloginFromKeytab. Contributed by Duo Zhang. 2017-01-25 21:26:01 +00:00
Arpit Agarwal b4078e1d0e HDFS-11194. Maintain aggregated peer performance metrics on NameNode. 2017-01-24 19:34:33 -08:00
Eric Yang efe8f941a9 HADOOP-13119. Add ability to secure log servlet using proxy users. Contribute by Yuanbo Liu.
(cherry picked from commit a847903b6e)
2017-01-21 15:47:13 -08:00
Daniel Templeton be7e4a0805 YARN-6028. Add document for container metrics (Contributed by Weiwei Yang via Daniel Templeton)
(cherry picked from commit f5839fd6df)
2017-01-20 10:07:49 -08:00
Akira Ajisaka c6c29d0080 HADOOP-14001. Improve delegation token validity checking.
(cherry picked from commit 1763467210)
2017-01-19 17:58:44 +09:00
Arpit Agarwal 42a14b6db9 HDFS-10917. Collect peer performance statistics on DataNode. Contributed by Xiaobing Zhou. 2017-01-17 15:31:18 -08:00