4526 Commits

Author SHA1 Message Date
Xiao Chen
3106552b75 HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah.
(cherry picked from commit 212342d6db14673f8f5652a5209e1c4fcc0f0ede)
2017-10-05 19:47:13 -07:00
Akira Ajisaka
5c2f07eed7
HADOOP-14616. Client fails to read a block with erasure code (XOR, native) when one of the data block is lost. Contributed by Huafeng Wang.
(cherry picked from commit fe84cdc9daa37af791a23a390e080777090c5e24)
2017-10-05 11:07:33 +09:00
Daniel Templeton
280b1fe1b4 HADOOP-14459. SerializationFactory shouldn't throw a NullPointerException if the serializations list is not defined
(Contributed by Nandor Kollar via Daniel Templeton)

(cherry picked from commit 20e9ce3ab33599d2ac6859a8319e1ce0bf0a4363)
2017-10-04 15:11:03 +02:00
Akira Ajisaka
b658ae002f
YARN-6943. Update Yarn to YARN in documentation. Contributed by Chetna Chaudhari.
(cherry picked from commit c9b525bd943fe7e098e72fb9be5623862c7ab5ff)
2017-10-04 07:02:31 +09:00
Xiao Chen
3dd3f924fc HADOOP-14095. Document caveats about the default JavaKeyStoreProvider in KMS.
(cherry picked from commit d7ecac379a02876919d3e6081d42f0937f54e664)
2017-09-29 19:34:42 -07:00
Junping Du
c3eade44d0 YARN-7072. Add a new log aggregation file format controller. Contributed by Xuan Gong.
(cherry picked from commit 3fddabc2fe4fbdb8ef3f9ce7558955c4f0794dcc)
2017-09-29 16:49:44 -07:00
Jason Lowe
a6630f703c HADOOP-14902. LoadGenerator#genFile write close timing is incorrectly calculated. Contributed by Hanisha Koneru
(cherry picked from commit 6f789fe05766a61b12ca10df3f26ee354eac84aa)
2017-09-28 16:39:47 -05:00
Andrew Wang
5a4f37019a Preparing for 3.0.0 GA development 2017-09-28 11:32:01 -07:00
Aaron Fabbri
2223393ad1 HADOOP-14851 LambdaTestUtils.eventually() doesn't spin on Assertion failures. Contributed by Steve Loughran
(cherry picked from commit 180e814b081d3707c95641171d649b547db41a04)
2017-09-28 10:25:17 -07:00
Akira Ajisaka
739d3ef809
HADOOP-14893. WritableRpcEngine should use Time.monotonicNow. Contributed by Chetna Chaudhari.
(cherry picked from commit d08b8c801a908b4242e7b21a54f3b1e4072f1eae)
2017-09-26 16:46:46 +09:00
Jason Lowe
bfad0ca3b0 HADOOP-14881. LoadGenerator should use Time.monotonicNow() to measure durations. Contributed by Bharat Viswanadham
(cherry picked from commit ac05a51bbb2a3fad4e85f9334a3408571967900a)
2017-09-25 15:38:24 -05:00
Akira Ajisaka
366ce11ac0
HADOOP-14892. MetricsSystemImpl should use Time.monotonicNow for measuring durations. Contributed by Chetna Chaudhari.
(cherry picked from commit 3a10367a17b99e2c3035ec54048f94f334d93227)
2017-09-26 01:47:59 +09:00
Daniel Templeton
dca2fb5ac5 HADOOP-14897. Loosen compatibility guidelines for native dependencies
(cherry picked from commit 0807470808156af13e0992285cac070052d86c26)
2017-09-25 16:15:56 +02:00
Daniel Templeton
972250923f HADOOP-13714. Tighten up our compatibility guidelines for Hadoop 3
(cherry picked from commit 7618fa9194b40454405f11a25bec4e2d79506912)
2017-09-23 00:05:25 +02:00
Akira Ajisaka
5c158f2f51
HADOOP-7308. Remove unused TaskLogAppender configurations from log4j.properties. Contributed by Todd Lipcon and J.Andreina.
(cherry picked from commit 7e58b2478ce10f54b9b9a647f22a69dd528a81e6)
2017-09-20 21:08:35 +09:00
Robert Kanter
d3d32d3580 YARN-7162. Remove XML excludes file format (rkanter) 2017-09-15 09:48:59 -07:00
Steve Loughran
9f6b08f840
HADOOP-14553. Add (parallelized) integration tests to hadoop-azure
Contributed by Steve Loughran

(cherry picked from commit 2d2d97fa7d4224369b3c13bc4a45e8cc9e29afb1)
2017-09-15 17:04:43 +01:00
Aaron Fabbri
62e8a5ceed
HADOOP-14738 Remove S3N and obsolete bits of S3A; rework docs. Contributed by Steve Loughran. 2017-09-14 16:12:29 -07:00
John Zhuge
9e1e81396e HADOOP-14864. FSDataInputStream#unbuffer UOE should include stream class name. Contributed by Bharat Viswanadham.
(cherry picked from commit 7ee02d1065268511ec10a8b8852d0d6327419b9c)
2017-09-14 11:28:58 -07:00
Andrew Wang
7b6b2dc93a HADOOP-14857. Fix downstream shaded client integration test. Contributed by Sean Busbey.
(cherry picked from commit 8277fab2be3b0898ba326d15e4cb641da2ac51ce)
2017-09-13 10:59:08 -07:00
Chen Liang
d1fcab3ea9 HADOOP-14804. correct wrong parameters format order in core-default.xml. Contributed by Chen Hongfei. 2017-09-13 10:55:13 -07:00
Andrew Wang
4687d3d6f6 HDFS-12222. Document and test BlockLocation for erasure-coded files. Contributed by Huafeng Wang.
(cherry picked from commit f4b6267465d139bfdaf75e25761672eaf61d8a11)
2017-09-12 17:35:33 -07:00
Jason Lowe
4e147f7e96 HADOOP-14843. Improve FsPermission symbolic parsing unit test coverage. Contributed by Bharat Viswanadham
(cherry picked from commit 86f4d1c66c8b541465ff769e5d951305c41c715c)
2017-09-12 16:52:39 -05:00
Ray Chiang
656c6d1acc HADOOP-14799. Update nimbus-jose-jwt to 4.41.1. (rchiang)
(cherry picked from commit 556812c179aa094c21acf610439a8d69fe6420ab)
2017-09-12 10:19:58 -07:00
Ray Chiang
f811306c86 HADOOP-14798. Update sshd-core and related mina-core library versions. (rchiang)
(cherry picked from commit 3876fe4e500efcb88fff93a86acf9626d961c8c7)
2017-09-12 10:00:25 -07:00
Andrew Wang
cb95c442da Revert "HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah."
This reverts commit 0a6d5c0cf1d963da9131aa12326fc576f0e92d2c.
2017-09-11 13:35:48 -07:00
Haibo Chen
1a2e8196d1 YARN-7181. CPUTimeTracker.updateElapsedJiffies can report negative usage. (Miklos Szegedi via Haibo Chen)
(cherry picked from commit d2d8f665e62a6ddfe20457fb3a07cc2bea9a856b)
2017-09-11 12:48:38 -07:00
John Zhuge
bb107f5d28 HADOOP-14844. Remove requirement to specify TenantGuid for MSI Token Provider. Contributed by Atul Sikaria.
(cherry picked from commit a4661850c1e0794baf493a468191e12681d68ab4)
2017-09-08 12:57:58 -07:00
Steve Loughran
70c95d15e3
HADOOP-13421. Switch to v2 of the S3 List Objects API in S3A.
Contributed by Aaron Fabbri

(cherry picked from commit 5bbca80428ffbe776650652de86a3bba885edb31)
2017-09-08 12:08:36 +01:00
Xiao Chen
3a3762d9e7 HDFS-12400. Provide a way for NN to drain the local key cache before re-encryption.
(cherry picked from commit 420baed31fdd811ac94c74dc53502ee79f37ba91)
2017-09-07 20:51:09 -07:00
Jason Lowe
b2c564bca1 HADOOP-14827. Allow StopWatch to accept a Timer parameter for tests. Contributed by Erik Krogen
(cherry picked from commit dd814946f68d52a9b1627ac4dd61f9ab093423ae)
2017-09-06 16:05:31 -05:00
Chris Douglas
270bca6aec HADOOP-12077. Provide a multi-URI replication Inode for ViewFs. Contributed by Gera Shegalov
(cherry picked from commit 1f3bc63e6772be81bc9a6a7d93ed81d2a9e066c0)
2017-09-05 23:52:08 -07:00
Wei-Chiu Chuang
c16ecf0fe8 HADOOP-14688. Intern strings in KeyVersion and EncryptedKeyVersion. Contributed by Xiao Chen.
(cherry picked from commit ad32759fd9f33e7bd18758ad1a5a464dab3bcbd9)
2017-09-05 15:13:20 -07:00
Jitendra Pandey
063b6d0c93 HADOOP-14674. Correct javadoc for getRandomizedTempPath. Contributed by Mukul Kumar Singh. 2017-09-01 10:17:12 -07:00
Allen Wittenauer
a3fee475f7
HADOOP-14414. Calling maven-site-plugin directly for docs profile is unnecessary (Andras Bokor via aw) 2017-09-01 08:38:30 -07:00
Steve Loughran
621b43e254
HADOOP-13345 HS3Guard: Improved Consistency for S3A.
Contributed by: Chris Nauroth, Aaron Fabbri, Mingliang Liu, Lei (Eddy) Xu,
Sean Mackrory, Steve Loughran and others.
2017-09-01 14:13:41 +01:00
Allen Wittenauer
27359b7139
HADOOP-14781. Clarify that HADOOP_CONF_DIR shouldn't actually be set in hadoop-env.sh
Signed-off-by: Andrew Wang <wang@apache.org>
2017-08-31 21:10:52 -07:00
Allen Wittenauer
0adc3a0533
YARN-6721. container-executor should have stack checking
Signed-off-by: Chris Douglas <cdouglas@apache.org>
2017-08-31 19:39:31 -07:00
Allen Wittenauer
190410085b
HADOOP-14364. refresh changelog/release notes with newer Apache Yetus build
Signed-off-by: Andrew Wang <wang@apache.org>
2017-08-31 19:06:49 -07:00
Yiqun Lin
ac12e153a8 HDFS-12317. HDFS metrics render error in the page of Github. Contributed by Yiqun Lin. 2017-08-31 17:23:17 +08:00
Allen Wittenauer
71bbb86d69
HADOOP-14670. Increase minimum cmake version for all platforms
Signed-off-by: Chris Douglas <cdouglas@apache.org>
2017-08-30 21:47:24 -07:00
Junping Du
41480233a9 HADOOP-14814. Fix incompatible API change on FsServerDefaults to HADOOP-14104. Contributed by Junping Du. 2017-08-30 13:30:14 -07:00
Rohith Sharma K S
32188d3295 YARN-7038. [Atsv2 Security] CollectorNodemanagerProtocol RPC interface doesn't work when service authorization is enabled. Contributed by Varun Saxena. 2017-08-30 11:29:54 +05:30
Steve Loughran
021974f4cb
HADOOP-14802. Add support for using container saskeys for all accesses.
Contributed by Sivaguru Sankaridurg
2017-08-29 19:02:43 +01:00
Arpit Agarwal
8b7cbe3840 HADOOP-14729. Upgrade JUnit 3 test cases to JUnit 4. Contributed by Ajay Kumar. 2017-08-25 09:55:46 -07:00
Steve Loughran
8196a07c32
HDFS-12344. LocatedFileStatus regression: no longer accepting null FSPermission.
Contributed by Ewan Higgs
2017-08-24 16:17:30 +01:00
John Zhuge
7e6463d2fb HADOOP-14251. Credential provider should handle property key deprecation. Contributed by John Zhuge. 2017-08-23 11:37:18 -07:00
Subru Krishnan
4249172e14 YARN-7053. Move curator transaction support to ZKCuratorManager. (Jonathan Hung via Subru). 2017-08-22 19:20:57 -07:00
Jason Lowe
c379310212 HADOOP-14687. AuthenticatedURL will reuse bad/expired session cookies. Contributed by Daryn Sharp 2017-08-22 16:50:01 -05:00
Xiao Chen
4ec5acc704 HADOOP-14705. Add batched interface reencryptEncryptedKeys to KMS. 2017-08-22 07:47:39 -07:00