David Mollitor
1b30b3fbe7
HADOOP-15246. SpanReceiverInfo - Prefer ArrayList over LinkedList. Contributed by David Mollitor.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 901652e26321832ac42ce54daa18ebc1813772b5)
2019-08-18 18:43:52 -07:00
Chen Liang
d8a6098a96
HDFS-14611. Move handshake secret field from Token to BlockAccessToken. Contributed by Chen Liang.
2019-08-16 10:50:00 -07:00
Chen Liang
f507bc059d
HDFS-13699. Add DFSClient sending handshake token to DataNode, and allow DataNode overwrite downstream QOP. Contributed by Chen Liang.
2019-08-16 10:50:00 -07:00
Chen Liang
ca15968d09
HDFS-13617. Allow wrapping NN QOP into token in encrypted message. Contributed by Chen Liang
2019-08-16 10:50:00 -07:00
Chen Liang
22d81f7fd0
HDFS-13566. Add configurable additional RPC listener to NameNode. Contributed by Chen Liang.
2019-08-16 10:49:59 -07:00
Christopher Gregorian
e4b650f91e
HDFS-14403. Cost-based extension to the RPC Fair Call Queue. Contributed by Christopher Gregorian.
...
(cherry picked from 129576f628
)
2019-08-14 13:33:33 -07:00
Masatake Iwasaki
d7ca016d63
HDFS-14423. Percent (%) and plus (+) characters no longer work in WebHDFS.
...
Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>
(cherry picked from commit da0006fe04
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java
2019-08-14 08:45:10 +09:00
Jianfei Jiang
0c02217d9b
HDFS-14691. Wrong usage hint for hadoop fs command "test".
...
Contributed by Jianfei Jiang.
Change-Id: I9f5e89721ff210641375fbf42a70043f0d74458e
(cherry picked from commit 71aad60e51
)
2019-08-05 13:09:39 +01:00
Wei-Chiu Chuang
490b18fd4f
HADOOP-15681. AuthenticationFilter should generate valid date format for Set-Cookie header regardless of default Locale. Contributed by Cao Manh Dat.
...
(cherry picked from commit e20b19543b
)
2019-08-01 17:36:48 -07:00
He Xiaoqiao
a405db8014
HDFS-13529. Fix default trash policy emptier trigger time correctly. Contributed by He Xiaoqiao.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit f86de6f76a
)
2019-08-01 14:56:38 -07:00
Christopher Gregorian
d4492bdd9e
HADOOP-16459. Backport of HADOOP-16266. Add more fine-grained processing time metrics to the RPC layer. Contributed by Christopher Gregorian.
...
This commit also includes the follow-on commit 827a84778a
.
(cherry-picked from f96a2df38d
)
2019-07-30 14:41:36 -07:00
Akira Ajisaka
f921c72fda
HADOOP-16435. RpcMetrics should not retained forever. Contributed by Zoltan Haindrich.
...
(cherry picked from commit cbfa3f3e98
)
2019-07-29 17:39:05 -07:00
Erik Krogen
5ec34bf43a
HADOOP-16245. Restrict the effect of LdapGroupsMapping SSL configurations to avoid interfering with other SSL connections. Contributed by Erik Krogen.
...
(cherry-picked from 62efb63006
)
2019-07-26 11:39:14 -07:00
Steve Loughran
7418764a67
HADOOP-9844. NPE when trying to create an error message response of SASL RPC
...
This closes #55
Change-Id: I10a20380565fa89762f4aa564b2f1c83b9aeecdc
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 07530314c2
)
2019-07-26 17:54:32 +09:00
S O'Donnell
23b470ee92
HADOOP-16443. Improve help text for setfacl --set option.
...
Contributed by S O'Donnell.
Change-Id: I1da46c4c414a5d2b07ee15867508f0799440a413
2019-07-23 10:25:59 +01:00
Gopal V
76d2cd2283
HADOOP-16341. ShutDownHookManager: Regressed performance on Hook removals after HADOOP-15679
...
Contributed by Gopal V and Atilla Magyar.
Change-Id: I066d5eece332a1673594de0f9b484443f95530ec
2019-07-17 13:52:58 +01:00
Inigo Goiri
1dbaf74985
HADOOP-16385. Namenode crashes with 'RedundancyMonitor thread received Runtime exception'. Contributed by Ayush Saxena.
...
(cherry picked from commit aa9f0850e8
)
2019-07-02 13:23:55 -07:00
Konstantin V Shvachko
c936562c72
HDFS-14170. [SBN read] Fix checkstyle warnings related to SBN reads. Contributed by Konstantin V Shvachko.
2019-06-28 14:23:14 -07:00
Chao Sun
eb7d7fa5e2
HDFS-14149. [SBN read] Fix annotations on new interfaces/classes for SBN reads. Contributed by Chao Sun.
2019-06-28 14:23:13 -07:00
Erik Krogen
e917ac2854
HDFS-14146. [SBN read] Handle exceptions from and prevent handler threads from blocking within internalQueueCall. Contributed by Chao Sun.
2019-06-28 14:23:12 -07:00
Chen Liang
790831824f
HDFS-14138. [SBN read] Description errors in the comparison logic of transaction ID. Contributed by xiangheng.
2019-06-28 14:23:12 -07:00
Erik Krogen
c1c061d767
HDFS-13873. [SBN read] ObserverNode should reject read requests when it is too far behind. Contributed by Konstantin Shvachko.
2019-06-28 14:23:12 -07:00
Chao Sun
45d6834d4c
HDFS-14067. [SBN read] Allow manual failover between standby and observer. Contributed by Chao Sun.
2019-06-28 14:23:10 -07:00
Chao Sun
cc70e81931
HDFS-13924. [SBN read] Handle BlockMissingException when reading from observer. Contributed by Chao Sun.
2019-06-28 14:23:09 -07:00
Chen Liang
3998bab3da
HDFS-13791. Limit logging frequency of edit tail related statements. Contributed by Erik Krogen.
2019-06-28 14:23:05 -07:00
Chen Liang
4c4ca86286
HDFS-13880. Add mechanism to allow certain RPC calls to bypass sync. Contributed by Chen Liang.
2019-06-28 14:22:11 -07:00
Chen Liang
e2337bfc57
HDFS-13767. Add msync server implementation. Contributed by Chen Liang.
2019-06-28 14:22:10 -07:00
Plamen Jeliazkov
7e0a71dd7f
HDFS-13665. [SBN read] Move RPC response serialization into Server.doResponse(). Contributed by Plamen Jeliazkov.
2019-06-28 14:22:08 -07:00
Chao Sun
a97f00e1c6
HDFS-12976. [SBN read] Introduce ObserverReadProxyProvider. Contributed by Chao Sun.
2019-06-28 14:22:08 -07:00
Erik Krogen
b13110a6f0
HDFS-13608. [SBN read] Edit Tail Fast Path Part 2: Add ability for JournalNode to serve edits via RPC. Contributed by Erik Krogen.
2019-06-28 14:22:07 -07:00
Plamen Jeliazkov
a3521c53fe
HDFS-13399. [SBN read] Make Client field AlignmentContext non-static. Contributed by Plamen Jeliazkov.
2019-06-28 14:22:03 -07:00
Erik Krogen
49d7bb6a92
HDFS-13286. [SBN read] Add haadmin commands to transition between standby and observer. Contributed by Chao Sun.
2019-06-28 14:20:01 -07:00
Erik Krogen
c0ca2bb853
HDFS-13331. [SBN read] Add lastSeenStateId to RpcRequestHeader. Contributed by Plamen Jeliazkov.
2019-06-28 14:20:01 -07:00
Plamen Jeliazkov
1eeca2d9fb
HDFS-12977. [SBN read] Add stateId to RPC headers. Contributed by Plamen Jeliazkov.
2019-06-28 14:20:00 -07:00
Wei-Chiu Chuang
77e391fd8b
HADOOP-14385. HttpExceptionUtils#validateResponse swallows exceptions. Contributed by Wei-Chiu Chuang.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 840d02ca5b
)
2019-06-20 19:58:17 -07:00
Inigo Goiri
f046b881f6
HADOOP-16028. Fix NetworkTopology chooseRandom function to support excluded nodes. Contributed by Sihai Ke.
...
(cherry picked from commit f4e18242bd
)
2019-06-20 13:38:00 -07:00
Shweta Yakkali
99abd35a75
HADOOP-16156. [Clean-up] Remove NULL check before instanceof and fix checkstyle in InnerNodeImpl. Contributed by Shweta Yakkali.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit dd4a7633ec
)
2019-06-17 23:48:29 -07:00
Adam Antal
2667177248
HADOOP-15914. hadoop jar command has no help argument. Contributed by Adam Antal.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 9f47a2e4a9845b84cc963708c7924b92df2964f6)
2019-06-17 22:56:04 -07:00
Wei-Chiu Chuang
e8db39b0e9
HADOOP-9157. Better option for curl in hadoop-auth-examples. Contributed by Andras Bokor.
...
(cherry picked from commit f1c239c6a4
)
2019-06-17 21:55:55 -07:00
Takanobu Asanuma
73829589b7
HADOOP-16369. Fix zstandard shortname misspelled as zts. Contributed by Jonathan Eagles.
...
(cherry picked from commit 54f9f75a44
)
2019-06-14 10:18:46 +09:00
Sean Mackrory
e0b3cbd221
HADOOP-16213. Update guava to 27.0-jre. Contributed by Gabor Bota.
2019-06-13 07:53:40 -06:00
Erik Krogen
f607efd195
HADOOP-16345. Fix a potential NPE when instantiating FairCallQueue metrics. Contributed by Erik Krogen.
...
(cherry-picked from 76b94c274f
)
2019-06-07 14:22:08 -07:00
Takanobu Asanuma
a9a3450560
HADOOP-16331. Fix ASF License check in pom.xml. Contributed by Akira Ajisaka.
...
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
2019-05-29 17:34:16 +09:00
Akira Ajisaka
855dc997d6
HADOOP-16323. https everywhere in Maven settings.
2019-05-27 15:27:33 +09:00
Shweta
7a5d9ab9ee
HDFS-14451. Incorrect header or version mismatch log message. Contributed by Shweta.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 93d7630062
)
2019-05-24 18:43:30 +02:00
Alexis Daboville
3f05b699ef
HADOOP-16248. MutableQuantiles leak memory under heavy load.
...
Contributed by Alexis Daboville,
(cherry picked from commit 4cb3da6ac7
)
2019-05-17 15:16:59 +01:00
David Mollitor
6eb48542f1
HADOOP-16307. Intern User Name and Group Name in FileStatus.
...
Author: David Mollitor
(cherry picked from commit 2713dcf6e9
)
2019-05-16 16:03:06 +02:00
Bharat Viswanadham
2c72f48527
HADOOP-16247. NPE in FsUrlConnection. Contributed by Karthik Palanisamy.
...
(cherry picked from commit d4c8858586
)
2019-05-15 17:56:22 -07:00
Siyao Meng
095815220d
HADOOP-16289. Allow extra jsvc startup option in hadoop_start_secure_daemon in hadoop-functions.sh. Contributed by Siyao Meng.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 93f2283a69
)
2019-05-06 15:47:58 -07:00
Erik Krogen
28ff96f367
HADOOP-16265. Fix bug causing Configuration#getTimeDuration to use incorrect units when the default value is used. Contributed by starphin.
...
(cherry-picked from 1ddb48872f
)
2019-04-22 08:18:17 -07:00
Akira Ajisaka
b28fdb98ee
HADOOP-14635. Javadoc correction for AccessControlList#buildACL. Contributed by Yeliang Cang.
...
(cherry picked from commit ab645b3caa
)
2019-04-08 15:19:17 +09:00
David Mollitor
50fc9577c0
HADOOP-16208. Do Not Log InterruptedException in Client.
...
Contributed by David Mollitor.
(cherry picked from commit c90736350b
)
2019-04-04 16:16:57 +01:00
Steve Loughran
b6ebe74526
HADOOP-16233. S3AFileStatus to declare that isEncrypted() is always true ( #685 )
...
This is needed to fix up some confusion about caching of job.addCache() handling of S3A paths; all parent dirs -the files are downloaded by the NM without using the DTs of the user submitting the job. This means that when you submit jobs to an EC2 cluster with lower IAM permissions than the user, cached resources don't get downloaded and the job doesn't start.
Production code changes:
* S3AFileStatus Adds "true" to the superclass's encrypted flag during construction.
Tests
* Base AbstractContractOpenTest can control whether zero byte files created in tests are encrypted. Not done via an XML attribute, just a subclass point. Thoughts?
* Verify that the filecache considers paths to not have the permissions which trigger reduce-privilege downloads
* And extend ITestDelegatedMRJob to test a completely different bucket (open street map), to verify that cached resources do get their tokens picked up
Docs:
* Advise FS developers to say all files are encrypted. It's otherwise harmless and it'll stop other people seeing impossible to debug error messages on app launch.
Contributed by Steve Loughran.
Change-Id: Ifaae4c9d735ccc5eafeebd2584b65daf2d4e5da3
(cherry picked from commit 366186d999
)
2019-04-03 21:35:19 +01:00
Akira Ajisaka
b6039e241d
HADOOP-16226. new Path(String str) does not remove all the trailing slashes of str
...
(cherry picked from commit aaaf856f4b
)
2019-04-03 13:18:36 +09:00
Akira Ajisaka
8037052c2b
HADOOP-16225. Fix links to the developer mailing lists in DownstreamDev.md. Contributed by Wanqiang Ji.
...
(cherry picked from commit ebd0d21538
)
2019-04-02 10:54:16 +09:00
David Mollitor
397b63ad0b
HADOOP-16181. HadoopExecutors shutdown Cleanup.
...
Author: David Mollitor <david.mollitor@cloudera.com>
(cherry picked from commit d18d0859eb
)
2019-03-22 10:30:21 +00:00
David Mollitor
9a449ac075
HADOOP-16196. Path Parameterize Comparable.
...
Author: David Mollitor <david.mollitor@cloudera.com>
(cherry picked from commit 246ab77f28
)
2019-03-22 10:27:17 +00:00
Erik Krogen
0de8b55a09
HADOOP-16192. Fix CallQueue backoff bugs: perform backoff when add() is used and update backoff when refreshed.
...
(cherry-picked from 8c95cb9d6b
)
2019-03-18 08:46:53 -07:00
Ben Roling
43e8ac6097
HADOOP-15625. S3A input stream to use etags/version number to detect changed source files.
...
Author: Ben Roling <ben.roling@gmail.com>
Initial patch from Brahma Reddy Battula.
2019-03-14 19:46:34 +00:00
Erik Krogen
fec7c5f3eb
HDFS-14346. Add better time precision to Configuration#getTimeDuration, allowing return unit and default unit to be specified independently. Contributed by Chao Sun.
...
(cherry picked from commit 66357574ae
)
2019-03-13 13:19:18 -07:00
Steve Loughran
b6f6c34223
HADOOP-16109. Parquet reading S3AFileSystem causes EOF
...
Nobody gets seek right. No matter how many times they think they have.
Reproducible test from: Dave Christianson
Fixed seek() logic: Steve Loughran
2019-03-11 11:15:25 +00:00
Praveen Krishna
451844fee5
HADOOP-16114. NetUtils#canonicalizeHost gives different value for same host.
...
Author: Praveen Krishna <praveenkrishna@tutanota.com>
(cherry picked from commit 2b94e51a8f
)
2019-03-07 11:08:48 +00:00
Stephen O'Donnell
3fe31b36fa
HADOOP-16140. hadoop fs expunge to add -immediate option to purge trash immediately.
...
Contributed by Stephen O'Donnell.
(cherry picked from commit 686c0141ef
)
Signed-off-by: Steve Loughran <stevel@apache.org>
2019-03-05 14:11:49 +00:00
Daryn Sharp
ae8839e6e8
HADOOP-15813. Enable more reliable SSL connection reuse. Contributed by Daryn Sharp.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit a87e458432
)
2019-02-20 18:21:14 -08:00
Akira Ajisaka
3e3275a80b
YARN-9308. fairscheduler-statedump.log gets generated regardless of service again after the merge of HDFS-7240. Contributed by Wilfred Spiegelenburg.
...
(cherry picked from commit dabfeab785
)
2019-02-15 14:53:36 +09:00
Vinayakumar B
49af36b25c
HADOOP-16108. Tail Follow Interval Should Allow To Specify The Sleep Interval To Save Unnecessary RPC's. Contributed by Ayush Saxena.
2019-02-13 16:45:34 +05:30
Wangda Tan
649da5af04
Make upstream aware of 3.1.2 release
...
Change-Id: I397bc6ef75498726df4763bd07a8bf8fe1c38365
(cherry picked from commit 308f3168fa
)
2019-02-05 14:05:51 -08:00
Steve Loughran
bdd17be9ec
HDFS-13713. Add specification of Multipart Upload API to FS specification, with contract tests.
...
Contributed by Ewan Higgs and Steve Loughran.
(cherry picked from commit c1d24f8483
)
2019-02-04 17:10:19 +00:00
Steve Loughran
3b47371fe2
HADOOP-16079. Token.toString faulting if any token listed can't load.
...
Contributed by Steve Loughran.
(cherry picked from commit 7f46d13dac
)
2019-02-01 14:34:11 +00:00
Eric Yang
65d2b13dc2
HADOOP-15922. Fixed DelegationTokenAuthenticator URL decoding for doAs user.
...
Contributed by He Xiaoqiao
(cherry picked from commit 0dd35e218f
)
2019-01-22 19:39:05 -05:00
Chen Liang
54d4abdfe9
HADOOP-15481. Emit FairCallQueue stats as metrics. Contributed by Christopher Gregorian.
2019-01-18 11:54:20 -08:00
luhuachao
18becec548
HADOOP-16019. ZKDelegationTokenSecretManager won't log exception message occured in function setJaasConfiguration.
...
Contributed by luhuachao.
(cherry picked from commit ccc43621ab
)
2019-01-15 13:16:07 +00:00
Inigo Goiri
c1c15c1bd8
HADOOP-16045. Don't run TestDU on Windows. Contributed by Lukas Majercak.
...
(cherry picked from commit 35fa3bd685
)
2019-01-11 18:08:14 -08:00
Akira Ajisaka
d345b1f441
HADOOP-16016. TestSSLFactory#testServerWeakCiphers fails on Java 1.8.0_191 or upper
...
(cherry picked from commit d4ca907da6
)
2019-01-11 13:04:40 +09:00
Jason Lowe
6236de9e23
Revert "HDFS-14084. Need for more stats in DFSClient. Contributed by Pranay Singh."
...
This reverts commit 1f39eae7e6
.
2019-01-09 17:41:52 -06:00
Eric Yang
febafd0e4f
HADOOP-15996. Improved Kerberos username mapping strategy in Hadoop.
...
Contributed by Bolke de Bruin
(cherry picked from commit d43af8b3db
)
2019-01-04 18:02:30 -05:00
Sunil G
7d752c1b9b
HADOOP-15997. KMS client uses wrong UGI after HADOOP-14445. Contributed by Wei-Chiu Chuang.
...
(cherry picked from commit 51427cbdfb
)
2019-01-04 21:49:59 +05:30
Pranay Singh
1f39eae7e6
HDFS-14084. Need for more stats in DFSClient. Contributed by Pranay Singh.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit ecdeaa7e6a
)
2019-01-03 09:57:08 -08:00
Surendra Singh Lilhore
5ab79f6377
HDFS-14166. Ls with -e option not giving the result in proper format. Contributed by Shubham Dewan.
...
(cherry picked from commit 763e96ea2b
)
2018-12-22 12:39:51 +05:30
Jason Lowe
9c89e2ea76
HADOOP-15973. Configuration: Included properties are not cached if resource is a stream. Contributed by Eric Payne
...
(cherry picked from commit 3961690037
)
2018-12-20 09:33:22 -06:00
Takanobu Asanuma
1b941a680d
HDFS-13661. Ls command with e option fails when the filesystem is not HDFS.
...
(cherry picked from commit d963575918
)
2018-12-20 10:05:02 +09:00
Steve Loughran
bbe1ddd309
HADOOP-15808. Harden Token service loader use.
...
Contributed by Steve Loughran.
(cherry picked from commit 202926ac33
)
2018-12-11 17:34:16 +00:00
Steve Loughran
05e41dd4fe
HADOOP-15966. Hadoop Kerberos broken on macos as java.security.krb5.realm is reset.
...
Contributed by Steve Loughran
(cherry picked from commit db2d8b01c6
)
2018-12-04 15:36:50 +00:00
Giovanni Matteo Fumarola
7cfcabc473
HADOOP-15950. Failover for LdapGroupsMapping. Contributed by Lukas Majercak.
2018-12-03 12:44:19 -08:00
Eric Yang
69be6e7352
HADOOP-15922. Revert patch 004.
...
(cherry picked from commit 38ea3814bd
)
2018-11-30 12:51:58 -05:00
Akira Ajisaka
b722bfd6f5
MAPREDUCE-7165. mapred-site.xml is misformatted in single node setup document. Contributed by Zhaohui Xin.
...
(cherry picked from commit c9bfca217f
)
2018-11-30 13:30:32 +09:00
Steve Loughran
1a448565a8
HADOOP-15959. Revert "HADOOP-12751. While using kerberos Hadoop incorrectly assumes names with '@' to be non-simple"
...
This reverts commit 829a2e4d27
.
(cherry picked from commit d0edd37269
)
2018-11-29 17:53:23 +00:00
Eric Yang
f089796251
HADOOP-15922. Fixed doAsUser decoding for DelegationTokenAuthenticationFilter.
...
Contributed by He Xiaoqiao
(cherry picked from commit a9d96948ed
)
2018-11-26 13:52:42 -05:00
Vinayakumar B
1b937d701d
HADOOP-15948. Inconsistency in get and put syntax if filename/dirname contains space. Contributed by Ayush Saxena.
...
(cherry picked from commit 23b441c225
)
2018-11-26 18:13:09 +05:30
Akira Ajisaka
f6227367fb
Add 2.9.2 release notes and changes documents.
...
(cherry picked from commit 1a00b4e325
)
2018-11-20 14:25:48 +09:00
Surendra Singh Lilhore
86deff0a06
HADOOP-15869. BlockDecompressorStream#decompress should not return -1 in case of IOException. Contributed by Surendra Singh Lilhore
...
(cherry picked from commit 75291e6d53
)
2018-11-13 21:26:22 +05:30
Steve Loughran
d4afeac285
HADOOP-15110. Gauges are getting logged in exceptions from AutoRenewalThreadForUserCreds.
...
Contributed by LiXin Ge.
(cherry picked from commit 3c9d97b8f7
)
2018-11-12 12:58:53 +00:00
Jason Lowe
9265934201
YARN-8865. RMStateStore contains large number of expired RMDelegationToken. Contributed by Wilfred Spiegelenburg
...
(cherry picked from commit ab6aa4c726
)
2018-11-06 08:47:30 -06:00
Lars Francke
a15bcf97a4
HADOOP-15687. Credentials class should allow access to aliases.
...
Author: Lars Francke <lars.francke@gmail.com>
(cherry picked from commit cb8d679c95
)
2018-11-03 16:29:56 +00:00
Steve Loughran
d79ea3844c
HADOOP-15855. Review hadoop credential doc, including object store details.
...
Contributed by Steve Loughran.
(cherry picked from commit 62d98ca92a
)
2018-10-30 15:58:44 +00:00
Wei-Chiu Chuang
5f8dd40647
Revert "HADOOP-15864. Job submitter / executor fail when SBN domain name can not resolved. Contributed by He Xiaoqiao."
...
This reverts commit fd02c501c0
.
2018-10-28 17:05:45 -07:00
Wei-Chiu Chuang
fd02c501c0
HADOOP-15864. Job submitter / executor fail when SBN domain name can not resolved. Contributed by He Xiaoqiao.
...
(cherry picked from commit fb2b72e6fc
)
2018-10-25 09:36:28 -07:00
Akira Ajisaka
63396beab4
HADOOP-15822. zstd compressor can fail with a small output buffer. Contributed by Jason Lowe.
...
(cherry picked from commit 8f97d6f2cd
)
2018-10-24 13:50:30 +09:00
Steve Loughran
85bf008405
HADOOP-15866. Renamed HADOOP_SECURITY_GROUP_SHELL_COMMAND_TIMEOUT keys break compatibility.
...
Contributed by Wei-Chiu Chuang.
(cherry picked from commit cb8d11e7bf5055508949a6a4f074efacc8cb1305)
2018-10-22 11:08:30 +01:00
Sunil G
bde4fd5ed9
Preparing for 3.2.0 release
2018-10-18 17:07:45 +05:30
Jason Lowe
30fc5966a2
HADOOP-15859. ZStandardDecompressor.c mistakes a class for an instance. Contributed by Jason Lowe
...
(cherry picked from commit 9abda83947
)
2018-10-17 14:40:57 -05:00
Steve Loughran
88ea877ac0
HADOOP-15861. Move DelegationTokenIssuer to the right path.
...
Contributed by Wei-Chiu Chuang.
(cherry picked from commit 41b3603b5b
)
2018-10-17 11:02:47 +01:00
Márton Elek
7b06383163
HADOOP-15857. Addendum. Remove ozonefs class name definition from core-default.xml. Contributed by Elek, Marton.
2018-10-16 15:51:59 +02:00
Sunil G
c5bf07154f
HADOOP-15857. Remove ozonefs class name definition from core-default.xml. Contributed by Elek, Marton.
2018-10-16 18:56:49 +05:30
Xiao Chen
ced2596094
HADOOP-14445. Addendum: Use DelegationTokenIssuer to create KMS delegation tokens that can authenticate to all KMS instances.
...
(cherry picked from commit b6fc72a025
)
2018-10-15 11:00:21 -07:00
Xiao Chen
9cb0654fbb
HADOOP-14445. Use DelegationTokenIssuer to create KMS delegation tokens that can authenticate to all KMS instances.
...
Contributed by Daryn Sharp, Xiao Chen, Rushabh S Shah.
(cherry picked from commit 5ec86b445c
)
2018-10-12 12:08:08 -07:00
Steve Loughran
1ee09906ce
HADOOP-15839. Review + update cloud store sensitive keys in hadoop.security.sensitive-config-keys.
...
Contributed by Steve Loughran.
(cherry picked from commit cdc4350718
)
2018-10-10 17:02:00 +01:00
Jason Lowe
5f97c0cd76
HADOOP-15820. ZStandardDecompressor native code sets an integer field as a long. Contributed by Jason Lowe
...
(cherry picked from commit f13e231025
)
2018-10-10 07:00:19 -07:00
Eric Yang
614d6cf99c
YARN-8845. Removed unused hadoop.registry.rm reference.
...
Contributed by Íñigo Goiri
(cherry picked from commit bf04f19456
)
2018-10-09 15:56:04 -04:00
Vidura Mudalige
71faacd175
HADOOP-15818. Fix deprecated maven-surefire-plugin configuration in hadoop-kms module
...
This closes #425
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit a30b1d1824
)
2018-10-09 12:57:06 +09:00
Sunil G
2c392da8aa
HADOOP-15791. Remove Ozone related sources from the 3.2 branch. Contributed by Elek, Marton.
2018-10-05 16:10:47 +05:30
Yiqun Lin
e185ae2d17
HADOOP-15817. Reuse Object Mapper in KMSJSONReader. Contributed by Jonathan Eagles.
...
(cherry picked from commit 81f635f47f
)
2018-10-04 11:04:39 +08:00
Ewan Higgs
6fab6886f6
HDFS-13936. Multipart upload to HDFS to support 0 byte upload. Contributed by Ewan Higgs.
2018-10-02 14:05:35 +02:00
Akira Ajisaka
5c8d90763c
HADOOP-15764. Addendum patch: Fix NPE in SecurityUtil.
2018-09-28 10:03:22 +09:00
Akira Ajisaka
c62b440421
HADOOP-15693. Typo in Secure Mode documentation. Contributed by Thomas Levine.
2018-09-26 10:30:43 +09:00
Akira Ajisaka
93b0f540ed
HADOOP-15783. [JDK10] TestSFTPFileSystem.testGetModifyTime fails.
2018-09-25 16:03:28 +09:00
Sunil G
d060cbea48
HDFS-13937. Multipart Uploader APIs to be marked as private/unstable in 3.2.0. Contributed by Steve Loughran.
2018-09-24 21:19:47 +05:30
Sean Mackrory
0def61482b
Merge branch 'HADOOP-15407' into trunk
2018-09-22 21:19:12 -06:00
Ewan Higgs
429a07e08c
HADOOP-15764. [JDK10] Migrate from sun.net.dns.ResolverConfiguration to the replacement. Contributed by Akira Ajisaka.
2018-09-20 15:13:55 +02:00
Ewan Higgs
3da94a36e2
HADOOP-15756. [JDK10] Migrate from sun.net.util.IPAddressUtil to the replacement. Contributed by Akira Ajisaka.
2018-09-20 14:53:21 +02:00
Steve Loughran
646874c326
HADOOP-15748. S3 listing inconsistency can raise NPE in globber.
...
Contributed by Steve Loughran.
2018-09-20 13:04:52 +01:00
Vinayakumar B
7ad27e97f0
HADOOP-15736. Trash : Negative Value For Deletion Interval Leads To Abnormal Behaviour. Contributed by Ayush Saxena.
2018-09-20 09:31:35 +05:30
Chen Liang
a30b4f9e71
HADOOP-15726. Create utility to limit frequency of log statements. Contributed by Erik Krogen.
2018-09-19 13:22:37 -07:00
Jason Lowe
e71f61ecb8
HADOOP-15755. StringUtils#createStartupShutdownMessage throws NPE when args is null. Contributed by Lokesh Jain and Dinesh Chitlangia
2018-09-18 15:57:33 -05:00
Steve Loughran
1cf38a38da
HADOOP-15744. AbstractContractAppendTest fails against HDFS on HADOOP-15407 branch.
...
Contributed by Steve Loughran.
2018-09-18 10:56:56 +01:00
Takanobu Asanuma
f796cfde76
HADOOP-15304. [JDK10] Migrate from com.sun.tools.doclets to the replacement. Contributed by Akira Ajisaka.
2018-09-18 18:48:25 +09:00
Yiqun Lin
ee051ef9fe
HADOOP-15742. Log if ipc backoff is enabled in CallQueueManager. Contributed by Ryan Wu.
2018-09-18 11:10:33 +08:00
Sean Mackrory
9475fd902a
HADOOP-15745. ABFS: Add ABFS configuration to ConfigRedactor.
2018-09-17 19:54:01 +00:00
Thomas Marquardt
81dc4a995c
HADOOP-15663. ABFS: Simplify configuration.
...
Contributed by Da Zhou.
2018-09-17 19:54:01 +00:00
Thomas Marquardt
ce03a93f78
HADOOP-15446. ABFS: tune imports & javadocs; stabilise tests.
...
Contributed by Steve Loughran and Da Zhou.
2018-09-17 19:54:01 +00:00
Steve Loughran
f044deedbb
HADOOP-15407. HADOOP-15540. Support Windows Azure Storage - Blob file system "ABFS" in Hadoop: Core Commit.
...
Contributed by Shane Mainali, Thomas Marquardt, Zichen Sun, Georgi Chalakov, Esfandiar Manii, Amit Singh, Dana Kaban, Da Zhou, Junhua Gu, Saher Ahwal, Saurabh Pant, James Baker, Shaoyu Zhang, Lawrence Chen, Kevin Chen and Steve Loughran
2018-09-17 19:54:01 +00:00
Brahma Reddy Battula
ef5c776a42
HADOOP-15733. Correct the log when Invalid emptier Interval configured. Contributed by Ayush Saxena
2018-09-14 07:32:27 +05:30
Hanisha Koneru
291dcf2247
HDDS-423. Introduce an ozone specific log4j.properties. Contributed by Elek, Marton.
2018-09-13 16:37:44 -07:00
Takanobu Asanuma
5d084d7eca
HADOOP-12760. sun.misc.Cleaner has moved to a new location in OpenJDK 9. Contributed by Akira Ajisaka.
2018-09-13 20:42:09 +09:00
Steve Loughran
d7c0a08a1c
HADOOP-15426 Make S3guard client resilient to DDB throttle events and network failures (Contributed by Steve Loughran)
2018-09-12 21:04:49 -07:00
bibinchundatt
c44088ac19
YARN-8739. Fix jenkins issues for Node Attributes branch. Contributed by Sunil Govindan.
2018-09-12 16:01:01 +05:30
Naganarasimha
2475fb0a1e
YARN-6856. [YARN-3409] Support CLI for Node Attributes Mapping. Contributed by Naganarasimha G R.
2018-09-12 16:00:59 +05:30
Mingliang Liu
87f63b6479
HADOOP-14833. Remove s3a user:secret authentication. Contributed by Steve Loughran
2018-09-11 17:18:42 -07:00
Allen Wittenauer
4b8c2b1c1c
HADOOP-14671. Upgrade Apache Yetus to 0.8.0
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-09-11 08:55:34 -07:00
Inigo Goiri
527288ef89
HDFS-13836. RBF: Handle mount table znode with null value. Contributed by yanghuafeng.
2018-09-06 16:47:54 -07:00
Vrushali C
962089ab59
HADOOP-15657 Registering MutableQuantiles via Metric annotation. Contributed by Sushil Ks
2018-09-05 20:53:21 -07:00
Giovanni Matteo Fumarola
9af96d4ed4
HADOOP-15707. Add IsActiveServlet to be used for Load Balancers. Contributed by Lukas Majercak.
2018-09-05 10:50:25 -07:00
Wei-Chiu Chuang
e780556ae9
HADOOP-15696. KMS performance regression due to too many open file descriptors after Jetty migration. Contributed by Wei-Chiu Chuang.
2018-09-05 09:52:35 -07:00
Steve Loughran
9e96ac666d
HADOOP-10219. ipc.Client.setupIOstreams() needs to check for ClientCache.stopClient requested shutdowns.
...
Contributed by Kihwal Lee and Lukas Majercak.
2018-09-04 16:46:12 +01:00
Daniel Templeton
f2c2a68ec2
HADOOP-15706. Typo in compatibility doc: SHOUD -> SHOULD
...
(Contributed by Laszlo Kollar via Daniel Templeton)
Change-Id: I6e2459d0700df7f3bad4eac8297a11690191c3ba
2018-08-30 09:12:36 -07:00
Steve Loughran
2e6c1109dc
HADOOP-15667. FileSystemMultipartUploader should verify that UploadHandle has non-0 length.
...
Contributed by Ewan Higgs
2018-08-30 14:33:16 +01:00
Kitti Nanasi
781437c219
HADOOP-15698. KMS log4j is not initialized properly at startup. Contributed by Kitti Nanasi.
2018-08-29 22:07:49 -07:00
Daniel Templeton
d53a10b0a5
HADOOP-15705. Typo in the definition of "stable" in the interface classification
...
Change-Id: I3eae2143400a534903db4f186400561fc8d2bd56
2018-08-29 13:59:32 -07:00
John Zhuge
f9c6fd9471
HADOOP-15633. fs.TrashPolicyDefault: Can't create trash directory. Contributed by Fei Hui.
2018-08-27 09:22:59 -07:00
Konstantin V Shvachko
a4121c71c2
HDFS-13848. Refactor NameNode failover proxy providers. Contributed by Konstantin Shvachko.
2018-08-24 18:27:30 -07:00
Takanobu Asanuma
bed8cb6979
HADOOP-14314. The OpenSolaris taxonomy link is dead in InterfaceClassification.md. Contributed by Rui Gao.
2018-08-23 21:54:38 +09:00
Steve Loughran
34577d2c21
HADOOP-15679. ShutdownHookManager shutdown time needs to be configurable & extended.
...
Contributed by Steve Loughran.
2018-08-20 18:36:24 -07:00
Giovanni Matteo Fumarola
79c97f6a0b
HADOOP-14624. Add GenericTestUtils.DelayAnswer that accept slf4j logger API. Contributed by Ian Pickering and Wenxin He.
2018-08-17 14:40:00 -07:00
Xiao Chen
60ffec9f79
HADOOP-9214. Create a new touch command to allow modifying atime and mtime. Contributed by Hrishikesh Gadre.
2018-08-17 11:18:09 -07:00
Jason Lowe
a17eed1b87
HDFS-13822. speedup libhdfs++ build (enable parallel build). Contributed by Allen Wittenauer and Pradeep Ambati
2018-08-17 12:25:36 -05:00
Xiao Chen
8d7c93186e
HADOOP-15674. Test failure TestSSLHttpServer.testExcludedCiphers with TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256 cipher suite. Contributed by Szilard Nemeth.
2018-08-17 10:09:23 -07:00
Márton Elek
77b015000a
HADOOP-8807. Update README and website to reflect HADOOP-8662. Contributed by Andras Bokor.
2018-08-17 11:10:29 +02:00
Xiao Chen
edeb2a356a
HADOOP-15655. Enhance KMS client retry behavior. Contributed by Kitti Nanasi.
2018-08-16 22:42:03 -07:00
Akira Ajisaka
3e3963b035
HADOOP-15552. Move logging APIs over to slf4j in hadoop-tools - Part2. Contributed by Ian Pickering.
2018-08-16 00:31:59 +09:00
Márton Elek
7e822ec246
HDDS-324. Addendum: remove the q letter which is accidentally added to the hadoop-functions.sh.
2018-08-14 20:54:33 +02:00
Xiaoyu Yao
b4031a8f1b
HDDS-324. Use pipeline name as Ratis groupID to allow datanode to report pipeline info. Contributed by Mukul Kumar Singh.
2018-08-13 12:47:49 -07:00
Xiao Chen
b94c8874e2
HADOOP-15638. KMS Accept Queue Size default changed from 500 to 128 in Hadoop 3.x. Contributed by Wei-Chiu Chuang.
2018-08-13 10:40:31 -07:00
Steve Loughran
da9a39eed1
HADOOP-15583. Stabilize S3A Assumed Role support.
...
Contributed by Steve Loughran.
2018-08-08 22:57:24 -07:00
Wangda Tan
49c687608b
Make 3.1.1 awared by other branches
2018-08-08 13:02:12 -07:00
Xiao Chen
9499df7b81
HDFS-13658. Expose HighestPriorityLowRedundancy blocks statistics. Contributed by Kitti Nanasi.
2018-08-08 10:40:20 -07:00
Ewan Higgs
2ec97abb2e
HADOOP-15576. S3A Multipart Uploader to work with S3Guard and encryption Originally contributed by Ewan Higgs with refinements by Steve Loughran.
2018-08-08 13:50:23 +02:00
Mukul Kumar Singh
6ed8593d18
HDDS-301. ozone command shell does not contain subcommand to run ozoneFS commands. Contributed by Nilotpal Nandi.
2018-08-07 16:09:53 +05:30
Yiqun Lin
2e4e02b4df
HDFS-13792. Fix FSN read/write lock metrics name. Contributed by Chao Sun.
2018-08-07 09:32:51 +08:00
Arpit Agarwal
f2e29acbfa
HADOOP-15476. fix logging for split-dns multihome . Contributed by Ajay Kumar.
2018-08-01 12:32:01 -07:00
Chen Liang
e8f952ef06
HADOOP-15637. LocalFs#listLocatedStatus does not filter out hidden .crc files. Contributed by Erik Krogen.
2018-07-30 10:25:07 -07:00
Eric Yang
77721f39e2
HADOOP-15593. Fixed NPE in UGI spawnAutoRenewalThreadForUserCreds.
...
Contributed by Gabor Bota
2018-07-26 18:35:36 -04:00
Xiao Chen
be150a17b1
HDFS-13622. mkdir should print the parent directory in the error message when parent directories do not exist. Contributed by Shweta.
2018-07-26 10:24:32 -07:00
Yiqun Lin
9089790cab
HADOOP-15611. Log more details for FairCallQueue. Contributed by Ryan Wu.
2018-07-26 18:08:28 +08:00
Mukul Kumar Singh
5f0b924360
HADOOP-15395. DefaultImpersonationProvider fails to parse proxy user config if username has . in it. Contributed by Ajay Kumar.
2018-07-25 21:09:11 +05:30
Xiao Chen
81d59506e5
HADOOP-15609. Retry KMS calls when SSLHandshakeException occurs. Contributed by Kitti Nanasi.
2018-07-24 21:45:43 -07:00
Daniel Templeton
849c45db18
HDFS-13448. HDFS Block Placement - Ignore Locality for First Block Replica
...
(Contributed by BELUGA BEHR via Daniel Templeton)
Change-Id: I965d1cfa642ad24296038b83e3d5c9983545267d
2018-07-24 16:05:27 -07:00
Gera Shegalov
6bec03cfc8
HADOOP-15612. Improve exception when tfile fails to load LzoCodec. (gera)
2018-07-24 14:32:30 -07:00
bibinchundatt
8461278833
YARN-8544. [DS] AM registration fails when hadoop authorization is enabled. Contributed by Bibin A Chundatt.
2018-07-24 13:09:17 +05:30
Haibo Chen
17e26163ec
HADOOP-15586. Fix wrong log statement in AbstractService. (Szilard Nemeth via Haibo Chen)
2018-07-23 11:18:25 -07:00
Xiao Chen
993ec026d1
HADOOP-15596. Stack trace should not be printed out when running hadoop key commands. Contributed by Kitti Nanasi.
2018-07-20 19:46:46 -07:00
Haibo Chen
e6873dfde0
YARN-7300. DiskValidator is not used in LocalDirAllocator. (Szilard Nemeth via Haibo Chen)
2018-07-19 16:27:11 -07:00
Kihwal Lee
ccf2db7fc2
HADOOP-15614. TestGroupsCaching.testExceptionOnBackgroundRefreshHandled reliably fails. Contributed by Weiwei Yang.
2018-07-19 11:13:37 -05:00
Wei-Chiu Chuang
d215357718
HDFS-13485. DataNode WebHDFS endpoint throws NPE. Contributed by Siyao Meng.
2018-07-16 15:45:55 -07:00
Xiao Chen
d2874e0417
HDFS-13690. Improve error message when creating encryption zone while KMS is unreachable. Contributed by Kitti Nanasi.
2018-07-16 13:19:53 -07:00
Wei-Chiu Chuang
0c7a578927
HADOOP-15598. DataChecksum calculate checksum is contented on hashtable synchronization. Contributed by Prasanth Jayachandran.
2018-07-16 11:32:45 -07:00
Akira Ajisaka
88625f5cd9
HADOOP-15531. Use commons-text instead of commons-lang in some classes to fix deprecation warnings. Contributed by Takanobu Asanuma.
2018-07-13 11:42:12 -04:00
Sean Mackrory
4f3f9391b0
HADOOP-15316. GenericTestUtils can exceed maxSleepTime. Contributed by Adam Antal.
2018-07-12 17:24:01 +02:00
Wei-Chiu Chuang
162228e8db
HDFS-13723. Occasional "Should be different group" error in TestRefreshUserMappings#testGroupMappingRefresh. Contributed by Siyao Meng.
2018-07-11 10:02:08 -07:00
Akira Ajisaka
4a08ddfa68
HADOOP-15568. fix some typos in the .sh comments. Contributed by Steve Loughran.
2018-07-09 15:43:38 -04:00
Xiao Chen
895845e9b0
HADOOP-15581. Set default jetty log level to INFO in KMS. Contributed by Kitti Nanasi.
2018-07-09 12:06:50 -07:00
Xiao Chen
def9d94a40
HADOOP-15591. KMSClientProvider should log KMS DT acquisition at INFO level. Contributed by Kitti Nanasi.
2018-07-09 12:01:52 -07:00
Yiqun Lin
7a68ac607c
HDFS-13674. Improve documentation on Metrics. Contributed by Chao Sun.
2018-07-09 14:27:34 +08:00
Arpit Agarwal
061b168529
HDDS-167. Rename KeySpaceManager to OzoneManager. Contributed by Arpit Agarwal.
2018-07-06 12:09:05 -07:00
Xiaoyu Yao
498e3bfb6b
HADOOP-15571. Multiple FileContexts created with the same configuration object should be allowed to have different umask. Contributed by Vinod Kumar Vavilapalli.
2018-07-06 11:56:09 -07:00
Andrew Wang
f51da9c4d1
HADOOP-15554. Improve JIT performance for Configuration parsing. Contributed by Todd Lipcon.
2018-07-02 18:31:21 +02:00
Nanda kumar
d40121845e
HADOOP-15574: Suppress build error if there are no docs after excluding private annotations. Contributed by Takanobu Asanuma.
2018-07-01 17:11:46 +05:30
Eric E Payne
d36f6b9e93
HADOOP-15548: Randomize local dirs. Contributed by Jim Brennan.
2018-06-29 18:18:32 +00:00
Eric Yang
384764cdea
YARN-8409. Fixed NPE in ActiveStandbyElectorBasedElectorService.
...
Contributed by Chandni Singh
2018-06-28 12:39:49 -04:00
Bharat Viswanadham
d3fa83a44b
HDFS-13705:The native ISA-L library loading failure should be made warning rather than an error message. Contributed by Shashikant Banerjee.
2018-06-28 09:21:56 -07:00
Akira Ajisaka
ddbff7c8d3
HADOOP-14313. Replace/improve Hadoop's byte[] comparator. Contributed by Vikas Vishwakarma.
2018-06-28 14:58:40 +09:00
Akira Ajisaka
2b2399d623
HADOOP-15495. Upgrade commons-lang version to 3.7 in hadoop-common-project and hadoop-tools. Contributed by Takanobu Asanuma.
2018-06-28 14:37:22 +09:00
Todd Lipcon
7a3c6e9c3c
HADOOP-15550. Avoid static initialization of ObjectMappers
2018-06-25 15:36:45 -07:00
Inigo Goiri
abc3e4bad9
HADOOP-15458. TestLocalFileSystem#testFSOutputStreamBuilder fails on Windows. Contributed by Xiao Liang.
2018-06-25 09:50:27 -07:00
Steve Loughran
1ba4e62304
HADOOP-14396. Add builder interface to FileContext.
...
Contributed by Lei (Eddy) Xu.
2018-06-25 14:38:57 +01:00
Eric E Payne
6432128622
YARN-8444: NodeResourceMonitor crashes on bad swapFree value. Contributed by Jim Brennan.
2018-06-22 17:15:29 +00:00
Todd Lipcon
59de967954
HADOOP-15549. Upgrade to commons-configuration 2.1 regresses task CPU consumption
2018-06-21 10:32:52 -07:00
Todd Lipcon
43541a1890
HADOOP-15551. Avoid use of Arrays.stream in Configuration.addTags
2018-06-20 16:43:10 -07:00
Xiao Chen
32f867a6a9
HDFS-13682. Cannot create encryption zone after KMS auth token expires.
2018-06-20 15:58:26 -07:00
Eric Yang
2d87592fc6
HADOOP-15527. Improve delay check for stopping processes.
...
Fixed script location.
Contributed by Vinod Kumar Vavilapalli
2018-06-19 13:38:13 -04:00
Chris Douglas
980031bb04
HADOOP-13186. Multipart Uploader API. Contributed by Ewan Higgs
2018-06-17 11:54:26 -07:00
Surendra Singh Lilhore
3905fdb793
HADOOP-15523. Shell command timeout given is in seconds whereas it is taken as millisec while scheduling. Contributed by Bilwa S T.
2018-06-17 12:12:01 +05:30
Yiqun Lin
8e7548d33b
HDFS-13641. Add metrics for edit log tailing. Contributed by Chao Sun.
2018-06-13 20:05:55 +08:00
Eric Yang
108da85320
HADOOP-15527. Improve delay check for stopping processes.
...
Contributed by Vinod Kumar Vavilapalli
2018-06-12 20:40:32 -04:00
Inigo Goiri
aeaf9fec62
HADOOP-15532. TestBasicDiskValidator fails with NoSuchFileException. Contributed by Giovanni Matteo Fumarola.
2018-06-12 14:16:14 -07:00
Xiao Chen
a16623df21
HADOOP-15307. NFS: flavor AUTH_SYS should use VerifierNone. Contributed by Gabor Bota.
2018-06-12 11:16:24 -07:00
Rohith Sharma K S
2df73dace0
YARN-8405. RM zk-state-store.parent-path ACLs has been changed since HADOOP-14773. Contributed by Íñigo Goiri.
2018-06-12 17:13:09 +05:30
Yongjun Zhang
7c3dc39083
Update CHANGES, RELEASENOTES, and jdiff for 3.0.3 release.
...
(cherry picked from commit 5a82f10e32
)
2018-06-11 15:13:18 -07:00
Sammi Chen
18201b882a
HADOOP-15499. Performance severe drops when running RawErasureCoderBenchmark with NativeRSRawErasureCoder. Contributed by Sammi Chen.
2018-06-11 13:53:37 +08:00
Steve Loughran
ef0118b91e
HADOOP-15520. Add tests for various org.apache.hadoop.util classes.
...
Contributed by Arash Nabili
2018-06-09 15:33:38 +01:00
Inigo Goiri
12be8bad7d
HADOOP-15516. Add test cases to cover FileUtil#readLink. Contributed by Giovanni Matteo Fumarola.
2018-06-07 13:34:52 -07:00
Steve Loughran
f494f0b896
HADOOP-15512. Clean up Shell from JDK7 workarounds.
...
Contributed by Zsolt Venczel.
2018-06-07 15:55:49 +01:00
Inigo Goiri
db81f85e84
HADOOP-15513. Add additional test cases to cover some corner cases for FileUtil#symlink. Contributed by Giovanni Matteo Fumarola.
2018-06-06 11:44:17 -07:00
Xiao Chen
ba4011d64f
HADOOP-15217. FsUrlConnection does not handle paths with spaces. Contributed by Joseph Fourny and Zsolt Venczel.
2018-06-05 21:18:31 -07:00
Chen Liang
1b0d4f4606
HDFS-13547. Add ingress port based sasl resolver. Contributed by Chen Liang.
2018-06-05 11:51:29 -07:00
Xiao Chen
6d5e87aec2
HADOOP-15507. Add MapReduce counters about EC bytes read.
2018-06-04 21:13:47 -07:00
Haibo Chen
04cf699dd5
YARN-8388. TestCGroupElasticMemoryController.testNormalExit() hangs on Linux. (Miklos Szegedi via Haibo Chen)
2018-06-04 14:23:08 -07:00
Haibo Chen
4880d890ee
YARN-8375. TestCGroupElasticMemoryController fails surefire build. (Miklos Szegedi via Haibo Chen)
2018-06-01 16:29:13 -07:00
Daniel Templeton
cba3194998
HDFS-13636. Cross-Site Scripting vulnerability in HttpServer2
...
(Contributed by Haibo Yan via Daniel Templeton)
Change-Id: I28edde8125dd20d8d270f0e609d1c04d8173c8b7
2018-06-01 14:42:39 -07:00
Wei-Chiu Chuang
32671d8713
HADOOP-14783. [KMS] Add missing configuration properties into kms-default.xml. Contributed by Chetna Chaudhari.
2018-05-31 16:09:33 -07:00
Takanobu Asanuma
d1e2b80980
MAPREDUCE-7098. Upgrade common-langs version to 3.7 in hadoop-mapreduce-project
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-05-31 18:31:10 +09:00
Kihwal Lee
e3236a9680
Additional check when unpacking archives. Contributed by Wilfred Spiegelenburg.
2018-05-29 14:15:12 -05:00
Inigo Goiri
3c75f8e493
HADOOP-15497. TestTrash should use proper test path to avoid failing on Windows. Contributed by Anbang Hu.
2018-05-29 09:11:08 -07:00
Wei-Chiu Chuang
438ef4951a
HADOOP-15455. Incorrect debug message in KMSACL#hasAccess. Contributed by Yuen-Kuei Hsueh.
2018-05-28 17:32:32 -07:00
Karthik Palanisamy
61df174e8b
HADOOP-15449. Increase default timeout of ZK session to avoid frequent NameNode failover
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-05-28 19:41:07 +09:00
Johan Gustavsson
d14e26b31f
HADOOP-15477. Make unjar in RunJar overrideable
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-05-28 17:29:59 +09:00
Xiao Chen
02322de3f9
HADOOP-15473. Configure serialFilter in KeyProvider to avoid UnrecoverableKeyException caused by JDK-8189997. Contributed by Gabor Bota.
2018-05-25 09:10:51 -07:00
Steve Loughran
bddfe796f2
HADOOP-15494. TestRawLocalFileSystemContract fails on Windows.
...
Contributed by Anbang Hu.
2018-05-25 11:12:47 +01:00
Arpit Agarwal
51ce02bb54
HADOOP-15486. Make NetworkTopology#netLock fair. Contributed by Nanda kumar.
2018-05-23 10:30:12 -07:00
Robert Kanter
aa23d49fc8
HADOOP-15457. Add Security-Related HTTP Response Header in WEBUIs. (kanwaljeets via rkanter)
2018-05-23 10:24:09 -07:00
Sammi Chen
34e8b9f9a8
HDFS-13540. DFSStripedInputStream should only allocate new buffers when reading. Contributed by Xiao Chen.
2018-05-23 19:10:09 +08:00
Akira Ajisaka
745f203e57
Additional check when unpacking archives. Contributed by Jason Lowe and Akira Ajisaka.
2018-05-23 17:16:23 +09:00
Miklos Szegedi
3e5f7ea986
YARN-8310. Handle old NMTokenIdentifier, AMRMTokenIdentifier, and ContainerTokenIdentifier formats. Contributed by Robert Kanter.
2018-05-22 18:10:33 -07:00
Kihwal Lee
bcc8e76bad
HADOOP-15450. Avoid fsync storm triggered by DiskChecker and handle disk full situation. Contributed by Arpit Agarwal.
2018-05-22 11:20:51 -05:00
Mukul Kumar Singh
57c2feb0d3
HADOOP-15474. Rename properties introduced for <tags>. Contributed by Zsolt Venczel.
2018-05-22 13:33:31 +05:30
Rushabh Shah
73e9120ad7
Skip the proxy user check if the ugi has not been initialized. Contributed by Daryn Sharp
2018-05-21 12:33:00 -05:00
Xiao Chen
89f5911392
HADOOP-15154. Abstract new method assertCapability for StreamCapabilities testing. Contributed by Zsolt Venczel.
2018-05-18 11:29:20 -07:00
Inigo Goiri
8783613696
HDFS-13586. Fsync fails on directories on Windows. Contributed by Lukas Majercack.
2018-05-17 19:26:44 -07:00
Inigo Goiri
53b807a6a8
HDFS-13560. Insufficient system resources exist to complete the requested service for some tests on Windows. Contributed by Anbang Hu.
2018-05-17 17:03:23 -07:00
Steve Loughran
07d8505f75
HADOOP-15466. Correct units in adl.http.timeout.
...
Contributed by Sean Mackrory,
2018-05-15 16:19:03 +01:00
Sammi Chen
f3f544b004
Add 2.9.1 release notes and changes documents
2018-05-14 15:14:02 +08:00