Commit Graph

4681 Commits

Author SHA1 Message Date
Daniel Templeton 9a02c4ff65 HADOOP-15706. Typo in compatibility doc: SHOUD -> SHOULD
(Contributed by Laszlo Kollar via Daniel Templeton)

Change-Id: I6e2459d0700df7f3bad4eac8297a11690191c3ba
(cherry picked from commit f2c2a68ec2)
(cherry picked from commit 68301ad7d3)
2018-08-30 09:15:25 -07:00
Kitti Nanasi fa32269cee HADOOP-15698. KMS log4j is not initialized properly at startup. Contributed by Kitti Nanasi.
(cherry picked from commit 781437c219)
2018-08-29 22:09:13 -07:00
Daniel Templeton fbaa11ef4c HADOOP-15705. Typo in the definition of "stable" in the interface classification
Change-Id: I3eae2143400a534903db4f186400561fc8d2bd56
(cherry picked from commit d53a10b0a5)
(cherry picked from commit 90c8cca783)
2018-08-29 14:01:19 -07:00
John Zhuge 2260718e24
HADOOP-15633. fs.TrashPolicyDefault: Can't create trash directory. Contributed by Fei Hui.
(cherry picked from commit f9c6fd9471)
2018-08-27 15:22:19 -07:00
Konstantin V Shvachko 27abdb390b HDFS-13848. Refactor NameNode failover proxy providers. Contributed by Konstantin Shvachko.
(cherry picked from commit a4121c71c2)
2018-08-24 18:51:42 -07:00
Takanobu Asanuma cd8ac03357 HADOOP-14314. The OpenSolaris taxonomy link is dead in InterfaceClassification.md. Contributed by Rui Gao.
(cherry picked from commit bed8cb6979)
2018-08-23 21:55:55 +09:00
Steve Loughran 53ce37ad29
HADOOP-15679. ShutdownHookManager shutdown time needs to be configurable & extended. Contributed by Steve Loughran.
Change-Id: Ifd4a6e3f796b4dc88e97f63066289e2534c77a29
(cherry picked from commit 95fcdc0435)
2018-08-20 19:18:37 -07:00
Xiao Chen a41f18098b HADOOP-15674. Test failure TestSSLHttpServer.testExcludedCiphers with TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256 cipher suite. Contributed by Szilard Nemeth.
(cherry picked from commit 8d7c93186e)
2018-08-17 10:20:20 -07:00
Xiao Chen 7730a85233 HADOOP-15638. KMS Accept Queue Size default changed from 500 to 128 in Hadoop 3.x. Contributed by Wei-Chiu Chuang.
(cherry picked from commit b94c8874e2)
2018-08-13 10:41:14 -07:00
Wangda Tan 8b4392769c Make 3.1.1 awared by other branches
(cherry picked from commit 49c687608b)
(cherry picked from commit 781620a44d)
2018-08-08 13:07:09 -07:00
Chen Liang 207f08bab4 HADOOP-15637. LocalFs#listLocatedStatus does not filter out hidden .crc files. Contributed by Erik Krogen. 2018-07-30 17:00:51 -07:00
Chen Liang 6c48d6a484 Revert "HADOOP-15637. LocalFs#listLocatedStatus does not filter out hidden .crc files. Contributed by Erik Krogen."
This reverts commit f60b50be3d.
2018-07-30 12:04:26 -07:00
Chen Liang f60b50be3d HADOOP-15637. LocalFs#listLocatedStatus does not filter out hidden .crc files. Contributed by Erik Krogen. 2018-07-30 10:33:24 -07:00
Xiao Chen 7f64a6886f HADOOP-15609. Retry KMS calls when SSLHandshakeException occurs. Contributed by Kitti Nanasi.
(cherry picked from commit 81d59506e5)
2018-07-24 21:46:31 -07:00
Gera Shegalov aab32c8cda HADOOP-15612. Improve exception when tfile fails to load LzoCodec. (gera)
(cherry picked from commit 6bec03cfc8)
2018-07-24 17:25:28 -07:00
Daniel Templeton 3210b3d8aa HDFS-13448. HDFS Block Placement - Ignore Locality for First Block Replica
(Contributed by BELUGA BEHR via Daniel Templeton)

Change-Id: I965d1cfa642ad24296038b83e3d5c9983545267d
(cherry picked from commit 849c45db18)
(cherry picked from commit 00c476abd8)
2018-07-24 16:13:30 -07:00
Kihwal Lee 00ac5ba90b HADOOP-15614. TestGroupsCaching.testExceptionOnBackgroundRefreshHandled reliably fails. Contributed by Weiwei Yang.
(cherry picked from commit ccf2db7fc2)
2018-07-19 11:27:38 -05:00
Wei-Chiu Chuang 67ee584fd8 HADOOP-15598. DataChecksum calculate checksum is contented on hashtable synchronization. Contributed by Prasanth Jayachandran.
(cherry picked from commit 0c7a578927)
(cherry picked from commit 34f1dd03ee)
2018-07-16 11:34:28 -07:00
Wei-Chiu Chuang 74aa4be92d HDFS-13723. Occasional "Should be different group" error in TestRefreshUserMappings#testGroupMappingRefresh. Contributed by Siyao Meng.
(cherry picked from commit 162228e8db)
(cherry picked from commit f9fa3cb157)
2018-07-11 10:04:38 -07:00
Xiaoyu Yao 3042aa2685 HADOOP-15571. Multiple FileContexts created with the same configuration object should be allowed to have different umask. Contributed by Vinod Kumar Vavilapalli.
(cherry picked from commit 498e3bfb6b)
2018-07-06 21:20:57 -07:00
Andrew Wang a4d0336ba2 HADOOP-15554. Improve JIT performance for Configuration parsing. Contributed by Todd Lipcon. 2018-07-02 18:32:07 +02:00
Eric E Payne c5f2fb5ae6 HADOOP-15548: Randomize local dirs. Contributed by Jim Brennan.
(cherry picked from commit d36f6b9e93)
2018-06-29 18:35:47 +00:00
Inigo Goiri f3efeb899a HADOOP-15458. TestLocalFileSystem#testFSOutputStreamBuilder fails on Windows. Contributed by Xiao Liang.
(cherry picked from commit abc3e4bad9)
2018-06-25 09:51:25 -07:00
Eric E Payne e977876428 YARN-8444: NodeResourceMonitor crashes on bad swapFree value. Contributed by Jim Brennan.
(cherry picked from commit 6432128622)
2018-06-22 17:30:01 +00:00
Xiao Chen aca66f6155 HDFS-13682. Cannot create encryption zone after KMS auth token expires.
(cherry picked from commit 32f867a6a9)
2018-06-20 15:59:45 -07:00
Surendra Singh Lilhore 34f89f5af7 HADOOP-15523. Shell command timeout given is in seconds whereas it is taken as millisec while scheduling. Contributed by Bilwa S T.
(cherry picked from commit 3905fdb793)
2018-06-17 12:49:09 +05:30
Yiqun Lin b94b071b10 HDFS-13641. Add metrics for edit log tailing. Contributed by Chao Sun.
(cherry picked from commit 8e7548d33b)
2018-06-13 20:24:12 +08:00
Inigo Goiri 189b6bac8c HADOOP-15532. TestBasicDiskValidator fails with NoSuchFileException. Contributed by Giovanni Matteo Fumarola.
(cherry picked from commit aeaf9fec62)
2018-06-12 14:18:19 -07:00
Rohith Sharma K S 96e7b7e8ae YARN-8405. RM zk-state-store.parent-path ACLs has been changed since HADOOP-14773. Contributed by Íñigo Goiri.
(cherry picked from commit 2df73dace0)
2018-06-12 17:25:22 +05:30
Yongjun Zhang 8202c334fe Update CHANGES, RELEASENOTES, and jdiff for 3.0.3 release.
(cherry picked from commit 5a82f10e32)
2018-06-11 14:28:44 -07:00
Sammi Chen b874110275 HADOOP-15499. Performance severe drops when running RawErasureCoderBenchmark with NativeRSRawErasureCoder. Contributed by Sammi Chen.
(cherry picked from commit 18201b882a)
2018-06-11 13:58:57 +08:00
Xiao Chen 3843abe482 HADOOP-15217. FsUrlConnection does not handle paths with spaces. Contributed by Joseph Fourny and Zsolt Venczel.
(cherry picked from commit ba4011d64f)
2018-06-05 21:19:19 -07:00
Daniel Templeton f13e01fdfe HDFS-13636. Cross-Site Scripting vulnerability in HttpServer2
(Contributed by Haibo Yan via Daniel Templeton)

Change-Id: I28edde8125dd20d8d270f0e609d1c04d8173c8b7
(cherry picked from commit cba3194998)
(cherry picked from commit 09fd1348e8)
2018-06-01 14:45:01 -07:00
Yongjun Zhang f0de11ba98 Preparing for 3.0.4 development 2018-05-29 23:40:26 -07:00
Kihwal Lee 65e55097da Additional check when unpacking archives. Contributed by Wilfred Spiegelenburg. 2018-05-29 14:30:29 -05:00
Inigo Goiri 1f594f31dd HADOOP-15497. TestTrash should use proper test path to avoid failing on Windows. Contributed by Anbang Hu.
(cherry picked from commit 3c75f8e493)
2018-05-29 09:12:08 -07:00
Karthik Palanisamy a2cc099ddf
HADOOP-15449. Increase default timeout of ZK session to avoid frequent NameNode failover
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 61df174e8b)
2018-05-28 19:42:26 +09:00
Xiao Chen c2c2c57e21 HADOOP-15473. Configure serialFilter in KeyProvider to avoid UnrecoverableKeyException caused by JDK-8189997. Contributed by Gabor Bota.
(cherry picked from commit 02322de3f9)
2018-05-25 09:42:01 -07:00
Miklos Szegedi b0f7b0dfd5 YARN-8310. Handle old NMTokenIdentifier, AMRMTokenIdentifier, and ContainerTokenIdentifier formats. Contributed by Robert Kanter. 2018-05-24 15:36:35 -07:00
Arpit Agarwal 0e7ea77354 HADOOP-15486. Make NetworkTopology#netLock fair. Contributed by Nanda kumar. 2018-05-23 14:25:08 -07:00
Sammi Chen 6db710b9d8 HDFS-13540. DFSStripedInputStream should only allocate new buffers when reading. Contributed by Xiao Chen.
(cherry picked from commit 34e8b9f9a8)
(cherry picked from commit 7d71b3a1cc)
2018-05-23 19:20:32 +08:00
Akira Ajisaka bd98d4e77c
Additional check when unpacking archives. Contributed by Jason Lowe and Akira Ajisaka. 2018-05-23 17:19:18 +09:00
Kihwal Lee 96313e03c1 HADOOP-15450. Avoid fsync storm triggered by DiskChecker and handle disk full situation. Contributed by Arpit Agarwal.
(cherry picked from commit bcc8e76bad)
2018-05-22 11:23:55 -05:00
Rushabh Shah 603ca19a17 Skip the proxy user check if the ugi has not been initialized. Contributed by Daryn Sharp
(cherry picked from commit 73e9120ad7)
2018-05-21 12:41:05 -05:00
Inigo Goiri 7336d0123d HDFS-13586. Fsync fails on directories on Windows. Contributed by Lukas Majercack.
(cherry picked from commit 8783613696)
2018-05-17 19:27:51 -07:00
Inigo Goiri cdc16b3a2f HDFS-13560. Insufficient system resources exist to complete the requested service for some tests on Windows. Contributed by Anbang Hu.
(cherry picked from commit 53b807a6a8)
2018-05-17 17:04:23 -07:00
Sammi Chen a700d05f72 Add 2.9.1 release notes and changes documents
(cherry picked from commit f3f544b004)
2018-05-14 15:18:19 +08:00
Rushabh Shah 9519c2ce1e HADOOP-15441. Log kms url and token service at debug level. Contributed by Gabor Bota
(cherry picked from commit a5449d3631)
2018-05-12 12:26:25 -05:00
Inigo Goiri 054a17387c HADOOP-15454. TestRollingFileSystemSinkWithLocal fails on Windows. Contributed by Xiao Liang.
(cherry picked from commit 1da8d4190d)
2018-05-10 09:42:01 -07:00
Yongjun Zhang 21bf02023c Revert "HADOOP-13055. Implement linkMergeSlash and linkFallback for ViewFileSystem"
This reverts commit 218a21a0f0.
2018-05-08 22:22:06 -07:00