Commit Graph

3615 Commits

Author SHA1 Message Date
Konstantin V Shvachko 2b05559b2e Revert "HADOOP-13119. Add ability to secure log servlet using proxy users. Contribute by Yuanbo Liu."
This reverts commit b13492a0ab.
2018-03-16 16:59:04 -07:00
Inigo Goiri 60feb43b7c HADOOP-15308. TestConfiguration fails on Windows because of paths. Contributed by Xiao Liang.
(cherry picked from commit 427fd027a3)
(cherry picked from commit 36451f2d54)
2018-03-13 20:07:09 -07:00
Chris Douglas f12f540c62 HADOOP-14696. parallel tests don't work for Windows. Contributed by Allen Wittenauer
(cherry picked from commit 45d1b0fdcc)
(cherry picked from commit 09940b1eb3)
(cherry picked from commit a03c8ea61f)
(cherry picked from commit 340cd5f1b1)
2018-03-12 20:08:56 -07:00
Nanda kumar 2599b97697
HADOOP-15275. Incorrect javadoc for return type of RetryPolicy#shouldRetry
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 55d04a6db1)
(cherry picked from commit 45ec3e18e3)
2018-03-01 19:05:22 +09:00
Ray Chiang ed17197305 HADOOP-14799. Update nimbus-jose-jwt to 4.41.1. (rchiang)
(cherry picked from commit 556812c179)
2018-02-22 18:11:20 +05:30
Jason Lowe 03a4d9a7b4 HADOOP-15206. BZip2 drops and duplicates records when input split size is small. Contributed by Aki Tanaka
(cherry picked from commit 0898ff42e9)
2018-02-16 15:08:43 -06:00
Kihwal Lee 5b4725fb04 Revert "HADOOP-14799. Update nimbus-jose-jwt to 4.41.1. (rchiang)"
This reverts commit 557d6f2814.
2018-02-14 15:22:05 -06:00
Ray Chiang 557d6f2814 HADOOP-14799. Update nimbus-jose-jwt to 4.41.1. (rchiang)
(cherry picked from commit 556812c179)
2018-02-14 00:24:14 +05:30
Kihwal Lee 39963d53df HADOOP-15212. Add independent secret manager method for logging expired tokens. Contributed by Daryn Sharp.
(cherry picked from commit 2dd960de98)
2018-02-06 15:38:32 -06:00
Steve Loughran d9875b046f HADOOP-15039/HADOOP-15189. Move SemaphoredDelegatingExecutor to hadoop-common
Contributed by Genmao Yu

(cherry picked from commit 312c571694)
2018-01-27 21:00:25 -08:00
Chris Douglas e062e2b08c MapFile.fix creates a wrong index file in case of block-compressed data file. Contributed by Grigori Rybkine
(cherry picked from commit 91db424c4360d7556660e8c57ac9a266e6688e01)
(cherry picked from commit 7f35487788)
(cherry picked from commit 9bd439e2c5)
2018-01-26 09:16:08 -08:00
Wei Yan 9951c2d04f HDFS-13049. RBF: Inconsistent Router OPTS config in branch-2 and branch-3. Contributed by Wei Yan.
(cherry picked from commit cefe4b7bb6)
2018-01-25 12:59:36 -08:00
Masahiro Tanaka 93220f90ea
HADOOP-15181. Typo in SecureMode.md
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 6e27b20b4d)
(cherry picked from commit ab482ebe73)
2018-01-22 17:15:54 +09:00
Jitendra Pandey dd1de1ea37 HADOOP-15143. NPE due to Invalid KerberosTicket in UGI. Contributed by Mukul Kumar Singh.
(cherry picked from commit cb60c05c3a)
2018-01-18 20:18:19 -08:00
Brahma Reddy Battula 3cdc392150 HADOOP-15150. in FsShell, UGI params should be overidden through env vars(-D arg). Contributed by Brahma Reddy Battula.
(cherry picked from commit 08332e12d0)
2018-01-18 11:02:38 +05:30
Xiao Chen e4df9ef10a HADOOP-15149. CryptoOutputStream should implement StreamCapabilities.
(cherry picked from commit 81127616c5)
(cherry picked from commit 8c275c63ff)
(cherry picked from commit 9dee5c6779f12597c0d6134bb639876649da9cd3)
2017-12-29 13:57:55 -08:00
John Zhuge a1334ea177 HADOOP-14872. CryptoInputStream should implement unbuffer. Contributed by John Zhuge.
(cherry picked from commit 6c32ddad30)
(cherry picked from commit fc9e156484)
(cherry picked from commit 5e0f4f212d)
2017-12-29 13:57:55 -08:00
Xiao Chen 141cc8ffa2 HADOOP-15056. Fix TestUnbuffer#testUnbufferException failure. Contributed by Jack Bearden.
(cherry picked from commit 19e0894209)
(cherry picked from commit 1d1401ad38)
(cherry picked from commit 31436a12d5)
2017-12-29 13:57:55 -08:00
Xiao Chen 52adaa43db HADOOP-15012. Add readahead, dropbehind, and unbuffer to StreamCapabilities. Contributed by John Zhuge.
(cherry picked from commit c9d48352c2)
2017-12-29 13:57:55 -08:00
Junping Du c6f5d36ff2 Add 2.8.3 release jdiff files.
(cherry picked from commit c89f99aade)
2017-12-18 22:38:26 -08:00
Junping Du 63ae39bc23 Add 2.8.3 Releasenotes and Changes.
(cherry picked from commit 7bdd324028)
2017-12-18 22:33:58 -08:00
Jason Lowe 7b447e261b HADOOP-15085. Output streams closed with IOUtils suppressing write errors. Contributed by Jim Brennan
(cherry picked from commit 93fdc3d935)
2017-12-15 17:18:32 -06:00
Yiqun Lin 053a6fc126 HDFS-12883. RBF: Document Router and State Store metrics. Contributed by Yiqun Lin.
(cherry picked from commit 91c96bdf8e)
2017-12-14 16:04:31 +08:00
Chris Douglas ae3dc443f4 HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak
(cherry picked from commit afc606c3aa)
2017-12-07 00:47:02 -08:00
Xiao Chen 55df9df9fb HDFS-12396. Webhdfs file system should get delegation token from kms provider. Contributed by Rushabh S Shah.
(cherry picked from commit 274bbb193f)
2017-12-04 10:45:30 -08:00
Arun Suresh ed0658a579 Addendum patch for Configuration fix. (Jason Lowe via asuresh)
(cherry picked from commit 4e847d63a3)
2017-11-13 13:50:44 -08:00
Arun Suresh d754b24738 Fixing Job History Server Configuration parsing. (Jason Lowe via asuresh)
(cherry picked from commit 7af9b8ad1e)
2017-11-09 15:17:59 -08:00
Brahma Reddy Battula 53891b7f8f HDFS-12783. [branch-2] dfsrouter should use hdfsScript. Contributed by Brahma Reddy Battula
(cherry picked from commit 135abcac4b)
2017-11-08 10:19:58 +05:30
Arun Suresh bb6a1aa5fa Preparing for 2.9.1 development 2017-11-02 22:49:38 -07:00
Jason Lowe 347997c959 HADOOP-14919. BZip2 drops records when reading data in splits. Contributed by Jason Lowe
(cherry picked from commit 2fae63aa60)
2017-10-31 09:32:45 -05:00
Chris Douglas 9e721775a4 HADOOP-14986. Enforce JDK limitations.
(cherry picked from commit b50def3697)
(cherry picked from commit 1660a638f0)
2017-10-27 21:42:42 -07:00
Steve Loughran 3fbcf76324 HADOOP-14553. Add (parallelized) integration tests to hadoop-azure.
Contributed by Steve Loughran.

(backport JIRA HADOOP-14870)
2017-10-27 12:55:12 +01:00
Junping Du 3793d2b9cf Add CHANGES.md and RELEASENOTES for 2.8.2 release. 2017-10-26 23:23:39 -07:00
Junping Du 1f2a2ba2be Add several jdiff xml files for 2.8.2 release.
(cherry picked from commit a25b5aa0cf)
2017-10-26 23:20:24 -07:00
Varun Saxena 0c8a2c2609 HADOOP-9657. NetUtils.wrapException to have special handling for 0.0.0.0 addresses and :0 ports. Contributed by Varun Saxena.
(cherry picked from commit 67e7673750)
2017-10-25 03:09:07 +05:30
Naganarasimha 2b04ae918c HADOOP-14966. Handle JDK-8071638 for hadoop-common. Contributed by Bibin A Chundatt.
(cherry picked from commit 6b8122458e)
2017-10-23 23:47:33 +05:30
Arpit Agarwal a373094bf9 HDFS-12683. DFSZKFailOverController re-order logic for logging Exception. Contributed by Bharat Viswanadham. 2017-10-23 10:47:35 -07:00
Xiao Chen a6370dde90 HADOOP-14944. Add JvmMetrics to KMS. 2017-10-19 22:37:35 -07:00
Wei-Chiu Chuang 9eb33d0e87 HADOOP-14880. [KMS] Document&test missing KMS client side configs. Contributed by Gabor Bota.
(cherry picked from commit 97c70c7ac6)

Conflicts:
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java
2017-10-19 06:06:01 -07:00
Junping Du e7e2b8158d HADOOP-14958. Fix source-level compatibility after HADOOP-11252. Contributed by Junping Du.
(cherry picked from commit b016f08f67)
(cherry picked from commit 9433f9eb09)
2017-10-18 15:07:59 -07:00
Wangda Tan d894f910d0 YARN-6608. Backport all SLS improvements from trunk to branch-2. (Carlo Curino via wangda) 2017-10-17 19:45:09 -07:00
Rohith Sharma K S 4e1af68ae1 YARN-7038. [Atsv2 Security] CollectorNodemanagerProtocol RPC interface doesn't work when service authorization is enabled. Contributed by Varun Saxena.
(cherry picked from commit 387dd3da87759860dd18bd8aa95c60d962b1e6a9)
2017-10-17 23:36:39 +05:30
Sangjin Lee e212e562ec YARN-5355. Backported YARN-2928 into our branch-2 feature branch. 2017-10-17 23:36:33 +05:30
Xiao Chen a103b323e6 Revert "HADOOP-14948. Document missing config key hadoop.treat.subject.external. Contributed by Ajay Kumar."
This reverts commit 1452ba139e.
2017-10-17 10:11:38 -07:00
Robert Kanter 8a1ed84c77 HADOOP-14938. Configuration.updatingResource map should be initialized lazily (misha@cloudera.com via rkanter) 2017-10-16 16:51:28 -07:00
Wei-Chiu Chuang 1452ba139e HADOOP-14948. Document missing config key hadoop.treat.subject.external. Contributed by Ajay Kumar.
(cherry picked from commit e906108fc9)
2017-10-16 16:44:35 -07:00
Xiao Chen 0bddcf10ef HADOOP-14949. TestKMS#testACLs fails intermittently.
(cherry picked from commit 152317d40ece8abfa76fb5bd29f04878c1b0d3d8)

Conflicts:
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java
2017-10-16 14:20:05 -07:00
Anu Engineer 5933068e70 HADOOP-13102. Update GroupsMapping documentation to reflect the new changes. Contributed by Esther Kundin.
(cherry picked from commit 075358eb6f)
2017-10-11 16:15:59 -07:00
Arun Suresh fb8bd4d2d7 HADOOP-13556. Change Configuration.getPropsWithPrefix to use getProps instead of iterator. (Larry McCay via asuresh)
(cherry picked from commit b6c2c9058e)
2017-10-11 15:22:51 -07:00
Steve Loughran ccfd1a4a56 HADOOP-14913. Sticky bit implementation for rename() operation in Azure WASB.
Contributed by Varada Hemeswari.

Cherry-picked from commit ref 3de574413c
2017-10-11 18:09:13 +01:00