Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,810 Commits 326 Branches 371 Tags
Commit Graph

3248 Commits

Author SHA1 Message Date
Ray Chiang
d943480147 YARN-5665. Enhance documentation for yarn.resourcemanager.scheduler.class property. (Yufei Gu via rchiang) 
(cherry picked from commit d9dc444dc73fbe23f9e553d63baf83f12c636fa7)
 2017-03-06 14:05:09 -08:00
Akira Ajisaka
ed55bcee1f
HADOOP-14108. CLI MiniCluster: add an option to specify NameNode HTTP port. Contributed by Takanobu Asanuma. 
(cherry picked from commit 209ecd1a5c056e096a5d804759f88302608d503b)
 2017-03-07 01:36:10 +09:00
Mingliang Liu
b26870c58e HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth 2017-03-03 17:09:05 -08:00
Jason Lowe
9b949f49e3 YARN-6274. Documentation refers to incorrect nodemanager health checker interval property. Contributed by WeiWei Yang 
(cherry picked from commit 05237636d3a359dc502e8fa2d66bfdcea274f86c)
 2017-03-03 08:01:40 -06:00
Harsh J
d4c13df515 HADOOP-6801. io.sort.mb and io.sort.factor were renamed and moved to mapreduce but are still in CommonConfigurationKeysPublic.java and used in SequenceFile.java. 
This closes #146

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit eb5a17954a758fdb1f3f29ef34e129d5f37d3a26)
 2017-03-03 18:39:47 +09:00
Andrew Wang
d737a26c5a Revert "HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru." 
This reverts commit 5e760f8dc4bc007bd839f33fe4a99fa603755149.
 2017-03-02 16:21:32 -08:00
Arpit Agarwal
5e760f8dc4 HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru. 2017-03-02 15:38:32 -08:00
Brahma Reddy Battula
a545ee4d7f HDFS-11432. Federation : Support fully qualified path for Quota/Snapshot/cacheadmin/cryptoadmin commands. Contributed by Brahma Reddy Battula. 
(cherry picked from commit dcd03df9f9e0080d7e179060ffc8148336c31b3e)
 2017-03-01 10:47:47 +05:30
Yiqun Lin
6cd39803ba HADOOP-14119. Remove unused imports from GzipCodec.java. Contributed by Yiqun Lin. 
(cherry picked from commit 9db2e0c8d4b29971da60e2628ff55b5dabed2f7b)
 2017-02-27 18:41:47 +08:00
Xuan
5c509f5f0c HADOOP-14116:FailoverOnNetworkExceptionRetry does not wait when failover 
on certain exception. Contributed by Jian He

(cherry picked from commit 289bc50e663b882956878eeaefe0eaa1ef4ed39e)
 2017-02-24 11:43:22 -08:00
Harsh J
c097d0343c HADOOP-13817. Add a finite shell command timeout to ShellBasedUnixGroupsMapping. (harsh) 
(cherry picked from commit e8694deb6ad180449f8ce6c1c8b4f84873c0587a)
 2017-02-24 21:34:31 +05:30
Akira Ajisaka
b5a8c49cf3 HADOOP-14097. Remove Java6 specific code from GzipCodec.java. Contributed by Elek, Marton. 
(cherry picked from commit 50decd36130945e184734dcd55b8912be6f4550a)
 2017-02-25 00:29:40 +09:00
Wei-Chiu Chuang
12ad077aa6 HADOOP-13233. help of stat is confusing. Contributed by Attila Bukor. 
(cherry picked from commit cc45da79fda7dfba2795ac397d62f40a858dcdd9)
 2017-02-13 10:17:41 -08:00
Lei Xu
6d62d0ea87 HADOOP-13204. Add support for SSE-KMS and SSE-C in s3a filesystem. (Steve Moist via lei) 2017-02-11 15:02:19 -08:00
Arpit Agarwal
4c5655ef1a HDFS-11403. Addendum fix for branch-2. 2017-02-11 01:25:43 -08:00
Arpit Agarwal
32a0c2b5e7 HDFS-11403. Zookeper ACLs on NN HA enabled clusters should be handled consistently. Contributed by Hanisha Koneru. 2017-02-11 01:18:07 -08:00
Kihwal Lee
5de6f1b791 HADOOP-14033. Reduce fair call queue lock contention. Contributed by Daryn Sharp. 
(cherry picked from commit 0c01cf57987bcc7a17154a3538960b67f625a9e5)
 2017-02-09 16:20:06 -06:00
Kihwal Lee
d008b55153 HADOOP-14034. Allow ipc layer exceptions to selectively close connections. Contributed by Daryn Sharp. 2017-02-09 10:55:40 -06:00
Kihwal Lee
2039d021f9 HADOOP-14032. Reduce fair call queue priority inversion. Contributed by Daryn Sharp. 
(cherry picked from commit a0bfb4150464013a618f30c2e38d88fc6de11ad2)
 2017-02-09 10:13:37 -06:00
Junping Du
33e7c3044f YARN-6145. Improve log message on fail over. Contributed by Jian He. 
(cherry picked from commit eec52e158b7bc14b2d3d53512323ba05e15e09e3)
 2017-02-08 02:15:11 -08:00
Junping Du
b7d59e790b HADOOP-12097. Allow port range to be specified while starting webapp. Contributed by Varun Saxena. 
(cherry picked from commit cce35c38159b23eb55204b3c9afcaa3215f4f4ef)

Conflicts:

	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/http/HttpServer2.java
 2017-02-05 20:13:49 -08:00
Akira Ajisaka
be9b02e0b6 HADOOP-14053. Update the link to HTrace SpanReceivers. Contributed by Yiqun Lin. 
(cherry picked from commit cb8f3f3adf7a22e8fb6fdfc44f3ec781c1526bfd)
 2017-02-04 10:59:18 +09:00
Xiao Chen
05ed48b75a HADOOP-14044. Synchronization issue in delegation token cancel functionality. Contributed by Hrishikesh Gadre. 
(cherry picked from commit ba75bc759334c8987e5f7dd4b21d025f0cccbde7)
 2017-02-03 17:27:35 -08:00
Jason Lowe
4703f5d20b YARN-5641. Localizer leaves behind tarballs after container is complete. Contributed by Eric Badger 2017-01-27 15:25:57 +00:00
Xiaoyu Yao
6b602c6e34 HADOOP-14029. Fix KMSClientProvider for non-secure proxyuser use case. Contributed by Xiaoyu Yao. 
(cherry picked from commit 2034315763cd7b1eb77e96c719918fc14e2dabf6)
 2017-01-26 20:36:43 -08:00
Jason Lowe
b806201f0a Revert "YARN-5641. Localizer leaves behind tarballs after container is complete. Contributed by Eric Badger" 
This reverts commit 45407acaed05284ad897d04f4575ab0a4ee7a88b.
 2017-01-26 14:42:22 +00:00
Jason Lowe
45407acaed YARN-5641. Localizer leaves behind tarballs after container is complete. Contributed by Eric Badger 
(cherry picked from commit 9e19f758c1950cbcfcd1969461a8a910efca0767)
 2017-01-25 21:54:17 +00:00
Xiaoyu Yao
9fa98cc45e HADOOP-13988. KMSClientProvider does not work with WebHDFS and Apache Knox w/ProxyUser. Contributed by Greg Senia and Xiaoyu Yao. 
(cherry picked from commit a46933e8ce4c1715c11e3e3283bf0e8c2b53b837)
 2017-01-25 13:34:42 -08:00
Steve Loughran
bb46d40558 HADOOP-13433 Race in UGI.reloginFromKeytab. Contributed by Duo Zhang. 2017-01-25 21:26:01 +00:00
Arpit Agarwal
b4078e1d0e HDFS-11194. Maintain aggregated peer performance metrics on NameNode. 2017-01-24 19:34:33 -08:00
Eric Yang
efe8f941a9 HADOOP-13119. Add ability to secure log servlet using proxy users. Contribute by Yuanbo Liu. 
(cherry picked from commit a847903b6e64c6edb11d852b91f2c816b1253eb3)
 2017-01-21 15:47:13 -08:00
Daniel Templeton
be7e4a0805 YARN-6028. Add document for container metrics (Contributed by Weiwei Yang via Daniel Templeton) 
(cherry picked from commit f5839fd6df77786353160b41eb4b5ceea9380017)
 2017-01-20 10:07:49 -08:00
Akira Ajisaka
c6c29d0080 HADOOP-14001. Improve delegation token validity checking. 
(cherry picked from commit 176346721006a03f41d028560e9e29b5931d5be2)
 2017-01-19 17:58:44 +09:00
Arpit Agarwal
42a14b6db9 HDFS-10917. Collect peer performance statistics on DataNode. Contributed by Xiaobing Zhou. 2017-01-17 15:31:18 -08:00
Kihwal Lee
3017069a76 HADOOP-13976. Path globbing does not match newlines. Contributed by Eric Badger. 
(cherry picked from commit 706d630eb9db9658083d57d1d99b6a0f11cc5657)
 2017-01-17 15:12:50 -06:00
Arpit Agarwal
52fdd387ec HDFS-11299. Support multiple Datanode File IO hooks. Contributed by Hanisha Koneru. 2017-01-16 22:42:13 -08:00
Arpit Agarwal
ae0082a3fc HDFS-11282. Document the missing metrics of DataNode Volume IO operations. Contributed by Yiqun Lin. 2017-01-16 22:24:49 -08:00
Akira Ajisaka
2d6be7ea23 HADOOP-13933. Add haadmin -getAllServiceState option to get the HA state of all the NameNodes/ResourceManagers. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit e407449ddb52c36b74358f22db498424e82ec4a7)
 2017-01-17 10:22:29 +09:00
Arpit Agarwal
954dae26cd HDFS-11337. (HDFS-10958 backport). Add instrumentation hooks around Datanode disk IO. 2017-01-16 13:53:30 -08:00
Lei Xu
00dec84cc2 HADOOP-13928. TestAdlFileContextMainOperationsLive.testGetFileContext1 runtime error. (John Zhuge via lei) 
(cherry picked from commit 15066a3e8ddacd36bf7be9fba0b10c350ae45668)
 2017-01-15 14:36:21 +08:00
Steve Loughran
ec2f5b18ab HADOOP-13336 S3A to support per-bucket configuration. Contributed by Steve Loughran 2017-01-11 17:24:25 +00:00
Wei-Chiu Chuang
76d62b0632 HADOOP-13953. Make FTPFileSystem's data connection mode and transfer mode configurable. Contributed by Xiao Chen. 
(cherry picked from commit 0a212a40fcbd12a11294bff7a31e7433111733c9)

Conflicts:
   hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/conf/TestCommonConfigurationFields.java
 2017-01-09 15:59:36 -08:00
Jason Lowe
db947fb870 HADOOP-13578. Add Codec for ZStandard Compression. Contributed by churro morales 2017-01-04 14:46:44 +00:00
Akira Ajisaka
3e2d26a97f HADOOP-12733. Remove references to obsolete io.seqfile configuration variables. Contributed by Ray Chiang. 
(cherry picked from commit 01d31fe9389ccdc153d7f4bf6574bf8e509867c1)
 2017-01-04 14:15:00 +09:00
Mingliang Liu
1b8cb0b9c9 Revert "HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran" 
This reverts commit a447efa2abd550abd268a6402070f529db3d69ff.
 2017-01-03 14:45:19 -08:00
Mingliang Liu
a447efa2ab HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran 
(cherry picked from commit 451efb08fe0680d002c6856c104ebb366acee8a0)
 2017-01-03 13:09:29 -08:00
Robert Kanter
2f32a6aea2 YARN-5529. Create new DiskValidator class with metrics (yufeigu via rkanter) 
(cherry picked from commit 591fb159444037bf4cb651aa1228914f5d71e1bf)
 2017-01-03 12:14:13 -08:00
Brahma Reddy Battula
d6e5e4288c HADOOP-13883. Addendum patch to correct the message and alphabetized with the earlier patch. Contributed by Yiqun Lin. 
(cherry picked from commit 6938b677111a5fa6bf654717b310220f98b7cf20)
 2016-12-31 16:17:15 +05:30
Akira Ajisaka
74dd2770cc HADOOP-13943. TestCommonConfigurationFields#testCompareXmlAgainstConfigurationClass fails after HADOOP-13863. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 0665c5f09afb2d6f59b6c4d4980f8b1ff9cbe620)
 2016-12-28 01:41:56 +09:00
Daniel Templeton
28b605dd1a HADOOP-13940. Document the missing envvars commands (Contributed by Yiqun Lin via Daniel Templeton) 
(cherry picked from commit d432173737a532b7106682116013b751ba162ff0)
 2016-12-27 07:19:37 -08:00