Konstantin V Shvachko
c138682e04
HADOOP-12862. LDAP Group Mapping over SSL can not specify trust store. Contributed by Wei-Chiu Chuang and Konstantin Shvachko.
...
(cherry picked from commit 2216bde322
)
2018-03-29 18:03:32 -07:00
Wei-Chiu Chuang
827d2015c4
HADOOP-15312. Undocumented KeyProvider configuration keys. Contributed by LiXin Ge.
...
(cherry picked from commit 3fe41c65d8
)
(cherry picked from commit 1176a128d6
)
(cherry picked from commit c6939e9330
)
2018-03-27 13:38:06 -07:00
Inigo Goiri
d6df90f7b5
HDFS-13268. TestWebHdfsFileContextMainOperations fails on Windows. Contributed by Xiao Liang.
...
(cherry picked from commit fe224ff972
)
2018-03-20 11:21:44 -07:00
Inigo Goiri
30d9a5db29
HDFS-13296. GenericTestUtils generates paths with drive letter in Windows and fail webhdfs related test cases. Contributed by Xiao Liang.
...
(cherry picked from commit e65ff1c8be
)
2018-03-19 17:21:55 -07:00
Inigo Goiri
36451f2d54
HADOOP-15308. TestConfiguration fails on Windows because of paths. Contributed by Xiao Liang.
...
(cherry picked from commit 427fd027a3
)
2018-03-13 20:06:07 -07:00
Chris Douglas
340cd5f1b1
HADOOP-14696. parallel tests don't work for Windows. Contributed by Allen Wittenauer
...
(cherry picked from commit 45d1b0fdcc
)
(cherry picked from commit 09940b1eb3
)
(cherry picked from commit a03c8ea61f
)
2018-03-12 20:08:46 -07:00
Ajay Kumar
d5d38918d7
HADOOP-15286. Remove unused imports from TestKMSWithZK.java
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 3dc30bc24e
)
2018-03-04 07:20:40 -08:00
Nanda kumar
45ec3e18e3
HADOOP-15275. Incorrect javadoc for return type of RetryPolicy#shouldRetry
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 55d04a6db1
)
2018-03-01 19:04:57 +09:00
Arpit Agarwal
0945f0eb23
HADOOP-15266. [branch-2] Upper/Lower case conversion support for group names in LdapGroupsMapping. Contributed by Nanda kumar.
2018-02-26 13:45:51 -08:00
Ray Chiang
eeb731307f
HADOOP-14799. Update nimbus-jose-jwt to 4.41.1. (rchiang)
...
(cherry picked from commit 556812c179
)
2018-02-22 18:08:52 +05:30
Robert Kanter
14f5797eff
HADOOP-15235. Authentication Tokens should use HMAC instead of MAC (rkanter)
...
(cherry picked from commit 324e5a7cf2
)
2018-02-20 17:25:12 -08:00
Jason Lowe
b1d5e73c1f
HADOOP-15206. BZip2 drops and duplicates records when input split size is small. Contributed by Aki Tanaka
...
(cherry picked from commit 0898ff42e9
)
2018-02-16 15:00:10 -06:00
Kihwal Lee
56b950d777
Revert "HADOOP-14799. Update nimbus-jose-jwt to 4.41.1. (rchiang)"
...
This reverts commit 577a267198
.
2018-02-14 15:20:45 -06:00
Ray Chiang
577a267198
HADOOP-14799. Update nimbus-jose-jwt to 4.41.1. (rchiang)
...
(cherry picked from commit 556812c179
)
2018-02-14 00:07:09 +05:30
Kihwal Lee
34466c6b16
HADOOP-15212. Add independent secret manager method for logging expired tokens. Contributed by Daryn Sharp.
...
(cherry picked from commit 2dd960de98
)
2018-02-06 15:36:32 -06:00
Xiao Chen
0922ea0aaf
HDFS-12974. Exception message is not printed when creating an encryption zone fails with AuthorizationException. Contributed by fang zhenyi.
...
(cherry picked from commit b63dcd583f
)
(cherry picked from commit 75be15cf02
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/EncryptionFaultInjector.java
2018-01-28 22:30:14 -08:00
Steve Loughran
312c571694
HADOOP-15039/HADOOP-15189. Move SemaphoredDelegatingExecutor to hadoop-common
...
Contributed by Genmao Yu
2018-01-27 20:31:21 -08:00
Chris Douglas
9bd439e2c5
MapFile.fix creates a wrong index file in case of block-compressed data file. Contributed by Grigori Rybkine
...
(cherry picked from commit 91db424c4360d7556660e8c57ac9a266e6688e01)
(cherry picked from commit 7f35487788
)
2018-01-26 09:15:53 -08:00
Wei Yan
cefe4b7bb6
HDFS-13049. RBF: Inconsistent Router OPTS config in branch-2 and branch-3. Contributed by Wei Yan.
2018-01-25 12:58:16 -08:00
Masahiro Tanaka
ab482ebe73
HADOOP-15181. Typo in SecureMode.md
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 6e27b20b4d
)
2018-01-22 17:15:31 +09:00
Brahma Reddy Battula
8181367c62
HADOOP-15150. in FsShell, UGI params should be overidden through env vars(-D arg). Contributed by Brahma Reddy Battula.
...
(cherry picked from commit 08332e12d0
)
2018-01-18 10:56:58 +05:30
Miklos Szegedi
679ad2ced0
HADOOP-15060. TestShellBasedUnixGroupsMapping.testFiniteGroupResolutionTime flaky. Contributed by Miklos Szegedi.
...
(cherry picked from commit 12d0645
)
2018-01-10 11:15:58 -08:00
Jitendra Pandey
cb60c05c3a
HADOOP-15143. NPE due to Invalid KerberosTicket in UGI. Contributed by Mukul Kumar Singh.
2018-01-01 21:51:48 -08:00
Xiao Chen
e20173d557
HADOOP-15149. CryptoOutputStream should implement StreamCapabilities.
...
(cherry picked from commit 81127616c5
)
(cherry picked from commit 8c275c63ff
)
2017-12-29 13:57:39 -08:00
Steve Loughran
1ef906e29e
HADOOP-15123. KDiag tries to load krb5.conf from KRB5CCNAME instead of KRB5_CONFIG.
...
Contributed by Vipin Rathor.
2017-12-18 18:48:32 +00:00
Jason Lowe
93fdc3d935
HADOOP-15085. Output streams closed with IOUtils suppressing write errors. Contributed by Jim Brennan
2017-12-15 17:17:25 -06:00
Yiqun Lin
22bc62058b
HDFS-12883. RBF: Document Router and State Store metrics. Contributed by Yiqun Lin.
...
(cherry picked from commit 91c96bdf8e
)
2017-12-14 16:03:34 +08:00
John Zhuge
5e0f4f212d
HADOOP-14872. CryptoInputStream should implement unbuffer. Contributed by John Zhuge.
...
(cherry picked from commit 6c32ddad30
)
(cherry picked from commit fc9e156484
)
2017-12-07 21:26:12 -08:00
Xiao Chen
31436a12d5
HADOOP-15056. Fix TestUnbuffer#testUnbufferException failure. Contributed by Jack Bearden.
...
(cherry picked from commit 19e0894209
)
(cherry picked from commit 1d1401ad38
)
2017-12-07 21:20:33 -08:00
Xiao Chen
c9d48352c2
HADOOP-15012. Add readahead, dropbehind, and unbuffer to StreamCapabilities. Contributed by John Zhuge.
2017-12-07 21:20:33 -08:00
Chris Douglas
afc606c3aa
HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak
2017-12-07 00:43:21 -08:00
Xiao Chen
274bbb193f
HDFS-12396. Webhdfs file system should get delegation token from kms provider. Contributed by Rushabh S Shah.
2017-12-04 10:40:22 -08:00
Xiao Chen
a4674c3e40
HADOOP-15067. GC time percentage reported in JvmMetrics should be a gauge, not counter. Contributed by Misha Dmitriev.
...
(cherry picked from commit d162252d7a
)
2017-11-23 09:02:23 -08:00
Robert Kanter
8db49df4a2
HADOOP-14982. Clients using FailoverOnNetworkExceptionRetry can go into a loop if they're used without authenticating with kerberos in HA env (pbacsko via rkanter)
...
(cherry picked from commit f2efaf013f
)
2017-11-16 11:12:01 -08:00
Xiao Chen
ba2eab9122
HADOOP-15023. ValueQueue should also validate (int) (lowWatermark * numValues) > 0 on construction.
...
(cherry picked from commit b1941b200d
)
2017-11-15 16:45:06 -08:00
Arun Suresh
4e847d63a3
Addendum patch for Configuration fix. (Jason Lowe via asuresh)
2017-11-13 13:49:08 -08:00
Xiao Chen
39fb402da4
HADOOP-14960. Add GC time percentage monitor/alerter. Contributed by Misha Dmitriev.
...
(cherry picked from commit 3c6adda291
)
2017-11-09 21:06:55 -08:00
Arun Suresh
7af9b8ad1e
Fixing Job History Server Configuration parsing. (Jason Lowe via asuresh)
2017-11-09 15:10:21 -08:00
Brahma Reddy Battula
135abcac4b
HDFS-12783. [branch-2] dfsrouter should use hdfsScript. Contributed by Brahma Reddy Battula
2017-11-08 01:45:53 +05:30
Arun Suresh
71a55bebfb
Preparing for 2.10.0 development
2017-10-31 12:51:14 -07:00
Jason Lowe
347997c959
HADOOP-14919. BZip2 drops records when reading data in splits. Contributed by Jason Lowe
...
(cherry picked from commit 2fae63aa60
)
2017-10-31 09:32:45 -05:00
Chris Douglas
9e721775a4
HADOOP-14986. Enforce JDK limitations.
...
(cherry picked from commit b50def3697
)
(cherry picked from commit 1660a638f0
)
2017-10-27 21:42:42 -07:00
Steve Loughran
3fbcf76324
HADOOP-14553. Add (parallelized) integration tests to hadoop-azure.
...
Contributed by Steve Loughran.
(backport JIRA HADOOP-14870)
2017-10-27 12:55:12 +01:00
Junping Du
3793d2b9cf
Add CHANGES.md and RELEASENOTES for 2.8.2 release.
2017-10-26 23:23:39 -07:00
Junping Du
1f2a2ba2be
Add several jdiff xml files for 2.8.2 release.
...
(cherry picked from commit a25b5aa0cf
)
2017-10-26 23:20:24 -07:00
Varun Saxena
0c8a2c2609
HADOOP-9657. NetUtils.wrapException to have special handling for 0.0.0.0 addresses and :0 ports. Contributed by Varun Saxena.
...
(cherry picked from commit 67e7673750
)
2017-10-25 03:09:07 +05:30
Naganarasimha
2b04ae918c
HADOOP-14966. Handle JDK-8071638 for hadoop-common. Contributed by Bibin A Chundatt.
...
(cherry picked from commit 6b8122458e
)
2017-10-23 23:47:33 +05:30
Arpit Agarwal
a373094bf9
HDFS-12683. DFSZKFailOverController re-order logic for logging Exception. Contributed by Bharat Viswanadham.
2017-10-23 10:47:35 -07:00
Xiao Chen
a6370dde90
HADOOP-14944. Add JvmMetrics to KMS.
2017-10-19 22:37:35 -07:00
Wei-Chiu Chuang
9eb33d0e87
HADOOP-14880. [KMS] Document&test missing KMS client side configs. Contributed by Gabor Bota.
...
(cherry picked from commit 97c70c7ac6
)
Conflicts:
hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java
2017-10-19 06:06:01 -07:00
Junping Du
e7e2b8158d
HADOOP-14958. Fix source-level compatibility after HADOOP-11252. Contributed by Junping Du.
...
(cherry picked from commit b016f08f67
)
(cherry picked from commit 9433f9eb09
)
2017-10-18 15:07:59 -07:00
Wangda Tan
d894f910d0
YARN-6608. Backport all SLS improvements from trunk to branch-2. (Carlo Curino via wangda)
2017-10-17 19:45:09 -07:00
Rohith Sharma K S
4e1af68ae1
YARN-7038. [Atsv2 Security] CollectorNodemanagerProtocol RPC interface doesn't work when service authorization is enabled. Contributed by Varun Saxena.
...
(cherry picked from commit 387dd3da87759860dd18bd8aa95c60d962b1e6a9)
2017-10-17 23:36:39 +05:30
Sangjin Lee
e212e562ec
YARN-5355. Backported YARN-2928 into our branch-2 feature branch.
2017-10-17 23:36:33 +05:30
Xiao Chen
a103b323e6
Revert "HADOOP-14948. Document missing config key hadoop.treat.subject.external. Contributed by Ajay Kumar."
...
This reverts commit 1452ba139e
.
2017-10-17 10:11:38 -07:00
Robert Kanter
8a1ed84c77
HADOOP-14938. Configuration.updatingResource map should be initialized lazily (misha@cloudera.com via rkanter)
2017-10-16 16:51:28 -07:00
Wei-Chiu Chuang
1452ba139e
HADOOP-14948. Document missing config key hadoop.treat.subject.external. Contributed by Ajay Kumar.
...
(cherry picked from commit e906108fc9
)
2017-10-16 16:44:35 -07:00
Xiao Chen
0bddcf10ef
HADOOP-14949. TestKMS#testACLs fails intermittently.
...
(cherry picked from commit 152317d40ece8abfa76fb5bd29f04878c1b0d3d8)
Conflicts:
hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java
2017-10-16 14:20:05 -07:00
Anu Engineer
5933068e70
HADOOP-13102. Update GroupsMapping documentation to reflect the new changes. Contributed by Esther Kundin.
...
(cherry picked from commit 075358eb6f
)
2017-10-11 16:15:59 -07:00
Arun Suresh
fb8bd4d2d7
HADOOP-13556. Change Configuration.getPropsWithPrefix to use getProps instead of iterator. (Larry McCay via asuresh)
...
(cherry picked from commit b6c2c9058e
)
2017-10-11 15:22:51 -07:00
Steve Loughran
ccfd1a4a56
HADOOP-14913. Sticky bit implementation for rename() operation in Azure WASB.
...
Contributed by Varada Hemeswari.
Cherry-picked from commit ref 3de574413c
2017-10-11 18:09:13 +01:00
Jason Lowe
63d86ee3a5
HADOOP-14912. FairCallQueue may defer servicing calls. Contributed by Daryn Sharp
...
(cherry picked from commit 1123f8f0b6
)
2017-10-10 14:50:15 -05:00
Xiaoyu Yao
65b5e81752
HADOOP-14920. KMSClientProvider won't work with KMS delegation token retrieved from non-Java client. Contributed by Xiaoyu Yao.
...
(cherry picked from commit 2b08a1fc64
)
2017-10-06 10:39:37 -07:00
Xiao Chen
dd0113d777
HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah.
...
(cherry picked from commit 212342d6db14673f8f5652a5209e1c4fcc0f0ede)
2017-10-05 19:47:04 -07:00
Wangda Tan
73d1b02d5a
HADOOP-13835. Move Google Test Framework code from mapreduce to hadoop-common. (Varun Vasudev via wangda)
...
Change-Id: I1031a4fa4e0c5c76928d03c5e61971978ec7e6ab
2017-10-05 17:02:00 -07:00
Xiao Chen
78d6dd414a
HADOOP-14095. Document caveats about the default JavaKeyStoreProvider in KMS.
...
(cherry picked from commit d7ecac379a02876919d3e6081d42f0937f54e664)
Conflicts:
hadoop-common-project/hadoop-kms/src/site/markdown/index.md.vm
2017-09-29 19:34:50 -07:00
Steve Loughran
a1afc6aa59
HADOOP-13345 S3Guard: Improved Consistency for S3A.
...
Contributed by: Chris Nauroth, Aaron Fabbri, Mingliang Liu, Lei (Eddy) Xu,
Sean Mackrory, Steve Loughran and others.
(cherry-picked from/based on commit 621b43e254
)
2017-09-29 11:29:22 +01:00
Jason Lowe
11ac10fe1d
HADOOP-14902. LoadGenerator#genFile write close timing is incorrectly calculated. Contributed by Hanisha Koneru
...
(cherry picked from commit 6f789fe057
)
2017-09-28 16:40:18 -05:00
Jason Lowe
0aac5af6e1
HADOOP-14891. Remove references to Guava Objects.toStringHelper. Contributed by Jonathan Eagles
2017-09-26 10:08:06 -05:00
Akira Ajisaka
b017af2391
HADOOP-14893. WritableRpcEngine should use Time.monotonicNow. Contributed by Chetna Chaudhari.
...
(cherry picked from commit d08b8c801a
)
2017-09-26 16:47:50 +09:00
Anu Engineer
17b17aed0f
HADOOP-14901. ReuseObjectMapper in Hadoop Common. Contributed by Hanisha Koneru.
2017-09-25 13:44:51 -07:00
Jason Lowe
09be0acae0
HADOOP-14881. LoadGenerator should use Time.monotonicNow() to measure durations. Contributed by Bharat Viswanadham
...
(cherry picked from commit ac05a51bbb
)
2017-09-25 15:38:52 -05:00
Akira Ajisaka
6004fb4676
HADOOP-14892. MetricsSystemImpl should use Time.monotonicNow for measuring durations. Contributed by Chetna Chaudhari.
...
(cherry picked from commit 3a10367a17
)
2017-09-26 01:48:24 +09:00
Akira Ajisaka
6581f2dea3
HADOOP-7308. Remove unused TaskLogAppender configurations from log4j.properties. Contributed by Todd Lipcon and J.Andreina.
...
(cherry picked from commit 7e58b2478c
)
2017-09-20 21:08:54 +09:00
Robert Kanter
4e36452d02
YARN-7162. Remove XML excludes file format (rkanter)
2017-09-15 09:53:55 -07:00
John Zhuge
eaef8446f6
HADOOP-14864. FSDataInputStream#unbuffer UOE should include stream class name. Contributed by Bharat Viswanadham.
...
(cherry picked from commit 7ee02d1065
)
2017-09-14 11:29:34 -07:00
Xiao Chen
0a8ed025e4
Revert "HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah."
...
This reverts commit 5337c2511d
.
2017-09-12 19:53:14 -07:00
Jason Lowe
c314a66353
HADOOP-14843. Improve FsPermission symbolic parsing unit test coverage. Contributed by Bharat Viswanadham
...
(cherry picked from commit 86f4d1c66c
)
Conflicts:
hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/permission/TestFsPermission.java
2017-09-12 17:00:22 -05:00
Steve Loughran
a46204437b
HADOOP-14851 LambdaTestUtils.eventually() doesn't spin on Assertion failures.
...
Contributed by Steve Loughran
(cherry picked from commit 180e814b08
)
2017-09-11 21:33:44 +01:00
Xuan
02ae3f8202
YARN-7072. Add a new log aggregation file format controller (xgong)
2017-09-10 23:18:31 -07:00
John Zhuge
1421196d20
HADOOP-14844. Remove requirement to specify TenantGuid for MSI Token Provider. Contributed by Atul Sikaria.
...
(cherry picked from commit a4661850c1
)
2017-09-08 14:15:51 -07:00
Jason Lowe
f39a444120
HADOOP-14827. Allow StopWatch to accept a Timer parameter for tests. Contributed by Erik Krogen
...
(cherry picked from commit dd814946f6
)
2017-09-06 16:05:58 -05:00
Wei-Chiu Chuang
aada99a376
HADOOP-14688. Intern strings in KeyVersion and EncryptedKeyVersion. Contributed by Xiao Chen.
...
(cherry picked from commit ad32759fd9
)
(cherry picked from commit c16ecf0fe8
)
2017-09-05 15:14:13 -07:00
Yiqun Lin
41d8e4e9b3
HDFS-12317. HDFS metrics render error in the page of Github. Contributed by Yiqun Lin.
2017-09-01 10:13:01 +08:00
Steve Loughran
25e9c29608
HADOOP-14802. Add support for using container saskeys for all accesses.
...
Contributed by Sivaguru Sankaridurg
(cherry picked from commit 021974f4cb
)
Conflicts:
hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
2017-08-30 22:40:50 +01:00
Junping Du
7dd5bb9492
HADOOP-14814. Fix incompatible API change on FsServerDefaults to HADOOP-14104. Contributed by Junping Du.
...
(cherry picked from commit 41480233a9
)
2017-08-30 13:30:48 -07:00
Arpit Agarwal
ae69c99068
HDFS-11577. Combine the old and the new chooseRandom for better performance. Contributed by Chen Liang.
2017-08-24 11:17:36 -07:00
John Zhuge
6e8c696651
HADOOP-14251. Credential provider should handle property key deprecation. Contributed by John Zhuge.
...
(cherry picked from commit 7e6463d2fb
)
Conflicts:
hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/conf/TestConfiguration.java
2017-08-23 11:59:47 -07:00
Subru Krishnan
a45ffdcddc
YARN-7053. Move curator transaction support to ZKCuratorManager. (Jonathan Hung via Subru).
...
(cherry picked from commit 4249172e14
)
2017-08-22 19:21:35 -07:00
Jason Lowe
45c1f8ac8e
HADOOP-14687. AuthenticatedURL will reuse bad/expired session cookies. Contributed by Daryn Sharp
...
(cherry picked from commit c379310212
)
2017-08-22 16:53:51 -05:00
Arpit Agarwal
b3ea11dfdb
HDFS-11482. Add storage type demand to into DFSNetworkTopology#chooseRandom. Contributed by Chen Liang.
2017-08-21 14:07:59 -07:00
Arpit Agarwal
d5379cc564
HDFS-12325. SFTPFileSystem operations should restore cwd. Contributed by Chen Liang.
2017-08-20 23:41:16 -07:00
Arpit Agarwal
d8d2a221f8
HDFS-11450. HDFS specific network topology classes with storage type info included. Contributed by Chen Liang.
2017-08-18 11:43:17 -07:00
Arpit Agarwal
850593133b
Revert "HADOOP-14732. ProtobufRpcEngine should use Time.monotonicNow to measure durations. Contributed by Hanisha Koneru."
...
This reverts commit bdc425057e
.
2017-08-18 10:16:13 -07:00
Mingliang Liu
03d15fa58e
HDFS-11430. Separate class InnerNode from class NetworkTopology and make it extendable. Contributed by Tsz Wo Nicholas Sze
2017-08-16 16:06:13 -07:00
Steve Loughran
d5680c08ed
HADOOP-14660. wasb: improve throughput by 34% when account limit exceeded.
...
Contributed by Thomas Marquardt.
2017-08-16 13:49:47 +01:00
Subru Krishnan
ad46a90872
HADOOP-14773. Extend ZKCuratorManager API for more reusability. (Íñigo Goiri via Subru).
...
(cherry picked from commit 75dd866bfb
)
2017-08-15 16:54:48 -07:00
Arpit Agarwal
bdc425057e
HADOOP-14732. ProtobufRpcEngine should use Time.monotonicNow to measure durations. Contributed by Hanisha Koneru.
2017-08-14 15:53:43 -07:00
Subru Krishnan
a70efb6138
HADOOP-14741. Refactor curator based ZooKeeper communication into common library. (Íñigo Goiri via Subru).
2017-08-14 11:03:50 -07:00
John Zhuge
0efc590e6d
HADOOP-14627. Support MSI and DeviceCode token provider in ADLS. Contributed by Atul Sikaria.
...
(cherry picked from commit 7769e96149
)
2017-08-13 00:27:33 -07:00