Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,301 Commits 326 Branches 371 Tags
Commit Graph

3615 Commits

Author SHA1 Message Date
Konstantin V Shvachko
2b05559b2e Revert "HADOOP-13119. Add ability to secure log servlet using proxy users. Contribute by Yuanbo Liu." 
This reverts commit b13492a0ab6e92517528d2f622591d4682071ead.
 2018-03-16 16:59:04 -07:00
Inigo Goiri
60feb43b7c HADOOP-15308. TestConfiguration fails on Windows because of paths. Contributed by Xiao Liang. 
(cherry picked from commit 427fd027a353f665846f43dfd73faf7561fedc07)
(cherry picked from commit 36451f2d544ec493b2dd676a4095c869ccb18721)
 2018-03-13 20:07:09 -07:00
Chris Douglas
f12f540c62 HADOOP-14696. parallel tests don't work for Windows. Contributed by Allen Wittenauer 
(cherry picked from commit 45d1b0fdcc04a86be91a9b72073cdc30bec04d3b)
(cherry picked from commit 09940b1eb3b7ed764149f4a993c1857e9c6ad938)
(cherry picked from commit a03c8ea61f6e30a9d462571ace23858b6e0fd1c9)
(cherry picked from commit 340cd5f1b137dccc033023ed92cc87b7e47f45c2)
 2018-03-12 20:08:56 -07:00
Nanda kumar
2599b97697
HADOOP-15275. Incorrect javadoc for return type of RetryPolicy#shouldRetry 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 55d04a6db10d0e58cfe0ff82fa646bb6ba57aaac)
(cherry picked from commit 45ec3e18e33bd93a26b24a33c95d13afbe0a313d)
 2018-03-01 19:05:22 +09:00
Ray Chiang
ed17197305 HADOOP-14799. Update nimbus-jose-jwt to 4.41.1. (rchiang) 
(cherry picked from commit 556812c179aa094c21acf610439a8d69fe6420ab)
 2018-02-22 18:11:20 +05:30
Jason Lowe
03a4d9a7b4 HADOOP-15206. BZip2 drops and duplicates records when input split size is small. Contributed by Aki Tanaka 
(cherry picked from commit 0898ff42e9e5c53f2fce7ccdeb4e1cd7d0f123b3)
 2018-02-16 15:08:43 -06:00
Kihwal Lee
5b4725fb04 Revert "HADOOP-14799. Update nimbus-jose-jwt to 4.41.1. (rchiang)" 
This reverts commit 557d6f28145e46c8ff21b291362808e88010bbde.
 2018-02-14 15:22:05 -06:00
Ray Chiang
557d6f2814 HADOOP-14799. Update nimbus-jose-jwt to 4.41.1. (rchiang) 
(cherry picked from commit 556812c179aa094c21acf610439a8d69fe6420ab)
 2018-02-14 00:24:14 +05:30
Kihwal Lee
39963d53df HADOOP-15212. Add independent secret manager method for logging expired tokens. Contributed by Daryn Sharp. 
(cherry picked from commit 2dd960de983a30bf0d9ee957bdb09f825f9d40a3)
 2018-02-06 15:38:32 -06:00
Steve Loughran
d9875b046f HADOOP-15039/HADOOP-15189. Move SemaphoredDelegatingExecutor to hadoop-common 
Contributed by Genmao Yu

(cherry picked from commit 312c5716943b31f0f6363f6df02523f959eb981e)
 2018-01-27 21:00:25 -08:00
Chris Douglas
e062e2b08c MapFile.fix creates a wrong index file in case of block-compressed data file. Contributed by Grigori Rybkine 
(cherry picked from commit 91db424c4360d7556660e8c57ac9a266e6688e01)
(cherry picked from commit 7f354877889b343878a8a09792d5cec8d2846a50)
(cherry picked from commit 9bd439e2c535b95ff0d2b5767b05a7ef43479298)
 2018-01-26 09:16:08 -08:00
Wei Yan
9951c2d04f HDFS-13049. RBF: Inconsistent Router OPTS config in branch-2 and branch-3. Contributed by Wei Yan. 
(cherry picked from commit cefe4b7bb6322e7c89d7b129b41f5e1a2689ebcf)
 2018-01-25 12:59:36 -08:00
Masahiro Tanaka
93220f90ea
HADOOP-15181. Typo in SecureMode.md 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 6e27b20b4d695ed94bd44c60f191cfbb5cdb32e2)
(cherry picked from commit ab482ebe73fbe24bf5242e705793e224f0f73500)
 2018-01-22 17:15:54 +09:00
Jitendra Pandey
dd1de1ea37 HADOOP-15143. NPE due to Invalid KerberosTicket in UGI. Contributed by Mukul Kumar Singh. 
(cherry picked from commit cb60c05c3aff762c39d7d81df9a7b6e071acb181)
 2018-01-18 20:18:19 -08:00
Brahma Reddy Battula
3cdc392150 HADOOP-15150. in FsShell, UGI params should be overidden through env vars(-D arg). Contributed by Brahma Reddy Battula. 
(cherry picked from commit 08332e12d055d85472f0c9371fefe9b56bfea1ed)
 2018-01-18 11:02:38 +05:30
Xiao Chen
e4df9ef10a HADOOP-15149. CryptoOutputStream should implement StreamCapabilities. 
(cherry picked from commit 81127616c571b7cd25686e60a1105f96ca0626b7)
(cherry picked from commit 8c275c63ffd06db2cde26cbadc6a2ce4195c7b43)
(cherry picked from commit 9dee5c6779f12597c0d6134bb639876649da9cd3)
 2017-12-29 13:57:55 -08:00
John Zhuge
a1334ea177 HADOOP-14872. CryptoInputStream should implement unbuffer. Contributed by John Zhuge. 
(cherry picked from commit 6c32ddad30240a251caaefdf7fec9ff8ad177a7c)
(cherry picked from commit fc9e156484824fcb59faef2b2914f3cb53901b87)
(cherry picked from commit 5e0f4f212d0a2889edb7a7efb030f539faa4a8b9)
 2017-12-29 13:57:55 -08:00
Xiao Chen
141cc8ffa2 HADOOP-15056. Fix TestUnbuffer#testUnbufferException failure. Contributed by Jack Bearden. 
(cherry picked from commit 19e089420999dd9d97d981dcd0abd64b6166152d)
(cherry picked from commit 1d1401ad3898834a740f4b9bfcea83d28635a3b6)
(cherry picked from commit 31436a12d5cd7c8d96414fcf37f9b8aebe497cd3)
 2017-12-29 13:57:55 -08:00
Xiao Chen
52adaa43db HADOOP-15012. Add readahead, dropbehind, and unbuffer to StreamCapabilities. Contributed by John Zhuge. 
(cherry picked from commit c9d48352c232ac9e031559cb99a18ff249d2b6c1)
 2017-12-29 13:57:55 -08:00
Junping Du
c6f5d36ff2 Add 2.8.3 release jdiff files. 
(cherry picked from commit c89f99aade575ab1f6a9836df719cda272293d90)
 2017-12-18 22:38:26 -08:00
Junping Du
63ae39bc23 Add 2.8.3 Releasenotes and Changes. 
(cherry picked from commit 7bdd324028a263cff51ce094107c6492f2b54869)
 2017-12-18 22:33:58 -08:00
Jason Lowe
7b447e261b HADOOP-15085. Output streams closed with IOUtils suppressing write errors. Contributed by Jim Brennan 
(cherry picked from commit 93fdc3d935cd940d5776cd923938b0bfabcd0dcd)
 2017-12-15 17:18:32 -06:00
Yiqun Lin
053a6fc126 HDFS-12883. RBF: Document Router and State Store metrics. Contributed by Yiqun Lin. 
(cherry picked from commit 91c96bdf8eb9a06193b719186b527563091d7666)
 2017-12-14 16:04:31 +08:00
Chris Douglas
ae3dc443f4 HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak 
(cherry picked from commit afc606c3aa9fc886ff2c17ec9a6a83e30c1adad0)
 2017-12-07 00:47:02 -08:00
Xiao Chen
55df9df9fb HDFS-12396. Webhdfs file system should get delegation token from kms provider. Contributed by Rushabh S Shah. 
(cherry picked from commit 274bbb193f34d6f9a31d3d2f55d1b66ada6b47d4)
 2017-12-04 10:45:30 -08:00
Arun Suresh
ed0658a579 Addendum patch for Configuration fix. (Jason Lowe via asuresh) 
(cherry picked from commit 4e847d63a39268d8a34e0f22ddb5e40c5ef71e3a)
 2017-11-13 13:50:44 -08:00
Arun Suresh
d754b24738 Fixing Job History Server Configuration parsing. (Jason Lowe via asuresh) 
(cherry picked from commit 7af9b8ad1e993ef791aa38740b6aabc4c233a30f)
 2017-11-09 15:17:59 -08:00
Brahma Reddy Battula
53891b7f8f HDFS-12783. [branch-2] dfsrouter should use hdfsScript. Contributed by Brahma Reddy Battula 
(cherry picked from commit 135abcac4ba3fda0e287b0766c415ce4e0c37931)
 2017-11-08 10:19:58 +05:30
Arun Suresh
bb6a1aa5fa Preparing for 2.9.1 development 2017-11-02 22:49:38 -07:00
Jason Lowe
347997c959 HADOOP-14919. BZip2 drops records when reading data in splits. Contributed by Jason Lowe 
(cherry picked from commit 2fae63aa60c43b62bd908a9499562fe528603185)
 2017-10-31 09:32:45 -05:00
Chris Douglas
9e721775a4 HADOOP-14986. Enforce JDK limitations. 
(cherry picked from commit b50def36970e0afa65bd3fd3f40d8c4f81119200)
(cherry picked from commit 1660a638f04435ca363fe4f07c7f03f109a6784a)
 2017-10-27 21:42:42 -07:00
Steve Loughran
3fbcf76324 HADOOP-14553. Add (parallelized) integration tests to hadoop-azure. 
Contributed by Steve Loughran.

(backport JIRA HADOOP-14870)
 2017-10-27 12:55:12 +01:00
Junping Du
3793d2b9cf Add CHANGES.md and RELEASENOTES for 2.8.2 release. 2017-10-26 23:23:39 -07:00
Junping Du
1f2a2ba2be Add several jdiff xml files for 2.8.2 release. 
(cherry picked from commit a25b5aa0cf5189247fa38e7b0a188d568eba1b6c)
 2017-10-26 23:20:24 -07:00
Varun Saxena
0c8a2c2609 HADOOP-9657. NetUtils.wrapException to have special handling for 0.0.0.0 addresses and :0 ports. Contributed by Varun Saxena. 
(cherry picked from commit 67e7673750e731f5ecfa84e82b84b7fc7ee0b233)
 2017-10-25 03:09:07 +05:30
Naganarasimha
2b04ae918c HADOOP-14966. Handle JDK-8071638 for hadoop-common. Contributed by Bibin A Chundatt. 
(cherry picked from commit 6b8122458ede9ececb138bed99d368580e5439a1)
 2017-10-23 23:47:33 +05:30
Arpit Agarwal
a373094bf9 HDFS-12683. DFSZKFailOverController re-order logic for logging Exception. Contributed by Bharat Viswanadham. 2017-10-23 10:47:35 -07:00
Xiao Chen
a6370dde90 HADOOP-14944. Add JvmMetrics to KMS. 2017-10-19 22:37:35 -07:00
Wei-Chiu Chuang
9eb33d0e87 HADOOP-14880. [KMS] Document&test missing KMS client side configs. Contributed by Gabor Bota. 
(cherry picked from commit 97c70c7ac6881f87eee1575bcbdd28b31ecac231)

Conflicts:
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java
 2017-10-19 06:06:01 -07:00
Junping Du
e7e2b8158d HADOOP-14958. Fix source-level compatibility after HADOOP-11252. Contributed by Junping Du. 
(cherry picked from commit b016f08f67830ed3ca741bc6a10c3f5164781be5)
(cherry picked from commit 9433f9eb09af0ca61f01a2eb42ff3ffe31a94d5f)
 2017-10-18 15:07:59 -07:00
Wangda Tan
d894f910d0 YARN-6608. Backport all SLS improvements from trunk to branch-2. (Carlo Curino via wangda) 2017-10-17 19:45:09 -07:00
Rohith Sharma K S
4e1af68ae1 YARN-7038. [Atsv2 Security] CollectorNodemanagerProtocol RPC interface doesn't work when service authorization is enabled. Contributed by Varun Saxena. 
(cherry picked from commit 387dd3da87759860dd18bd8aa95c60d962b1e6a9)
 2017-10-17 23:36:39 +05:30
Sangjin Lee
e212e562ec YARN-5355. Backported YARN-2928 into our branch-2 feature branch. 2017-10-17 23:36:33 +05:30
Xiao Chen
a103b323e6 Revert "HADOOP-14948. Document missing config key hadoop.treat.subject.external. Contributed by Ajay Kumar." 
This reverts commit 1452ba139ea845ad9e82a5902d239b59a789bff3.
 2017-10-17 10:11:38 -07:00
Robert Kanter
8a1ed84c77 HADOOP-14938. Configuration.updatingResource map should be initialized lazily (misha@cloudera.com via rkanter) 2017-10-16 16:51:28 -07:00
Wei-Chiu Chuang
1452ba139e HADOOP-14948. Document missing config key hadoop.treat.subject.external. Contributed by Ajay Kumar. 
(cherry picked from commit e906108fc98a011630d12a43e557b81d7ef7ea5d)
 2017-10-16 16:44:35 -07:00
Xiao Chen
0bddcf10ef HADOOP-14949. TestKMS#testACLs fails intermittently. 
(cherry picked from commit 152317d40ece8abfa76fb5bd29f04878c1b0d3d8)

Conflicts:
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java
 2017-10-16 14:20:05 -07:00
Anu Engineer
5933068e70 HADOOP-13102. Update GroupsMapping documentation to reflect the new changes. Contributed by Esther Kundin. 
(cherry picked from commit 075358eb6fff5ae4a40ac4dfde292e2a9a4ceddf)
 2017-10-11 16:15:59 -07:00
Arun Suresh
fb8bd4d2d7 HADOOP-13556. Change Configuration.getPropsWithPrefix to use getProps instead of iterator. (Larry McCay via asuresh) 
(cherry picked from commit b6c2c9058e83116dcca46cd6934db3428f931347)
 2017-10-11 15:22:51 -07:00
Steve Loughran
ccfd1a4a56 HADOOP-14913. Sticky bit implementation for rename() operation in Azure WASB. 
Contributed by Varada Hemeswari.

Cherry-picked from commit ref 3de574413c4d5554213d02bd0ad343ba82cf82aa
 2017-10-11 18:09:13 +01:00