Commit Graph

4772 Commits

Author SHA1 Message Date
Wangda Tan 5583711419 Preparing for 3.1.2 release
Change-Id: If2793e2ed2b5b349a9e1f98f78df43f309dcfcbd
2018-07-31 13:08:55 -07:00
Chen Liang 5194994757 HADOOP-15637. LocalFs#listLocatedStatus does not filter out hidden .crc files. Contributed by Erik Krogen. 2018-07-30 16:44:22 -07:00
Chen Liang 46fcbc5030 Revert "HADOOP-15637. LocalFs#listLocatedStatus does not filter out hidden .crc files. Contributed by Erik Krogen."
This reverts commit 6812535b0b.
2018-07-30 12:05:08 -07:00
Chen Liang 6812535b0b HADOOP-15637. LocalFs#listLocatedStatus does not filter out hidden .crc files. Contributed by Erik Krogen. 2018-07-30 10:33:02 -07:00
Eric Yang a869bd970e HADOOP-15593. Fixed NPE in UGI spawnAutoRenewalThreadForUserCreds.
Contributed by Gabor Bota

(cherry picked from commit 77721f39e2)
2018-07-26 18:47:58 -04:00
Gera Shegalov 1396fa2a27 HADOOP-15612. Improve exception when tfile fails to load LzoCodec. (gera)
(cherry picked from commit 6bec03cfc8)
2018-07-24 23:05:34 -07:00
Xiao Chen 40c06b389a HADOOP-15609. Retry KMS calls when SSLHandshakeException occurs. Contributed by Kitti Nanasi.
(cherry picked from commit 81d59506e5)
2018-07-24 21:46:21 -07:00
Daniel Templeton 00c476abd8 HDFS-13448. HDFS Block Placement - Ignore Locality for First Block Replica
(Contributed by BELUGA BEHR via Daniel Templeton)

Change-Id: I965d1cfa642ad24296038b83e3d5c9983545267d
(cherry picked from commit 849c45db18)
2018-07-24 16:12:43 -07:00
bibinchundatt 0710107f8d YARN-8544. [DS] AM registration fails when hadoop authorization is enabled. Contributed by Bibin A Chundatt.
(cherry picked from commit 8461278833)
2018-07-24 13:11:31 +05:30
Kihwal Lee a147098c4f HADOOP-15614. TestGroupsCaching.testExceptionOnBackgroundRefreshHandled reliably fails. Contributed by Weiwei Yang.
(cherry picked from commit ccf2db7fc2)
2018-07-19 11:19:19 -05:00
Wei-Chiu Chuang 34f1dd03ee HADOOP-15598. DataChecksum calculate checksum is contented on hashtable synchronization. Contributed by Prasanth Jayachandran.
(cherry picked from commit 0c7a578927)
2018-07-16 11:33:43 -07:00
Wei-Chiu Chuang f9fa3cb157 HDFS-13723. Occasional "Should be different group" error in TestRefreshUserMappings#testGroupMappingRefresh. Contributed by Siyao Meng.
(cherry picked from commit 162228e8db)
2018-07-11 10:04:07 -07:00
Xiaoyu Yao ffe2019887 HADOOP-15571. Multiple FileContexts created with the same configuration object should be allowed to have different umask. Contributed by Vinod Kumar Vavilapalli.
(cherry picked from commit 629f7008b531bad469903e6a1f6f8cb4be691f36)
2018-07-06 11:56:51 -07:00
Andrew Wang 9f2d57697a HADOOP-15554. Improve JIT performance for Configuration parsing. Contributed by Todd Lipcon.
(cherry picked from commit f51da9c4d1)
2018-07-02 18:31:27 +02:00
Nanda kumar e1cd5732a6 HADOOP-15574: Suppress build error if there are no docs after excluding private annotations. Contributed by Takanobu Asanuma.
(cherry picked from commit d40121845e)
2018-07-01 17:16:48 +05:30
Eric E Payne 012baf4313 HADOOP-15548: Randomize local dirs. Contributed by Jim Brennan.
(cherry picked from commit d36f6b9e93)
2018-06-29 18:22:51 +00:00
Eric Yang 3ce3571a34 YARN-8409. Fixed NPE in ActiveStandbyElectorBasedElectorService.
Contributed by Chandni Singh
2018-06-28 13:11:56 -04:00
Bharat Viswanadham 8fa530746f HDFS-13705:The native ISA-L library loading failure should be made warning rather than an error message. Contributed by Shashikant Banerjee.
(cherry picked from commit d3fa83a44b)
2018-06-28 09:26:58 -07:00
Inigo Goiri cbe15066c8 HADOOP-15458. TestLocalFileSystem#testFSOutputStreamBuilder fails on Windows. Contributed by Xiao Liang.
(cherry picked from commit abc3e4bad9)
2018-06-25 09:51:01 -07:00
Eric E Payne 1974dfa44d YARN-8444: NodeResourceMonitor crashes on bad swapFree value. Contributed by Jim Brennan.
(cherry picked from commit 6432128622)
2018-06-22 17:18:37 +00:00
Xiao Chen e8655b8c72 HDFS-13682. Cannot create encryption zone after KMS auth token expires.
(cherry picked from commit 32f867a6a9)
2018-06-20 15:59:23 -07:00
Eric Yang a31a966a20 HADOOP-15527. Improve delay check for stopping processes.
Fixed script location.
               Contributed by Vinod Kumar Vavilapalli

(cherry picked from commit 2d87592fc6)
2018-06-19 13:40:10 -04:00
Surendra Singh Lilhore 40652e77e0 HADOOP-15523. Shell command timeout given is in seconds whereas it is taken as millisec while scheduling. Contributed by Bilwa S T.
(cherry picked from commit 3905fdb793)
2018-06-17 12:14:20 +05:30
Yiqun Lin 5c1248b2da HDFS-13641. Add metrics for edit log tailing. Contributed by Chao Sun.
(cherry picked from commit 8e7548d33b)
2018-06-13 20:10:46 +08:00
Eric Yang f516a7a85f HADOOP-15527. Improve delay check for stopping processes.
Contributed by Vinod Kumar Vavilapalli

(cherry picked from commit 108da85320)
2018-06-12 21:12:21 -04:00
Inigo Goiri 6f31faf92b HADOOP-15532. TestBasicDiskValidator fails with NoSuchFileException. Contributed by Giovanni Matteo Fumarola.
(cherry picked from commit aeaf9fec62)
2018-06-12 14:17:25 -07:00
Rohith Sharma K S af0309d793 YARN-8405. RM zk-state-store.parent-path ACLs has been changed since HADOOP-14773. Contributed by Íñigo Goiri.
(cherry picked from commit 2df73dace0)
2018-06-12 17:23:22 +05:30
Yongjun Zhang 425fe4e217 Update CHANGES, RELEASENOTES, and jdiff for 3.0.3 release.
(cherry picked from commit 5a82f10e32)
2018-06-11 14:31:46 -07:00
Sammi Chen e3c96354a7 HADOOP-15499. Performance severe drops when running RawErasureCoderBenchmark with NativeRSRawErasureCoder. Contributed by Sammi Chen.
(cherry picked from commit 18201b882a)
(cherry picked from commit b874110275)
2018-06-11 14:03:39 +08:00
Inigo Goiri 8526ba9a69 HADOOP-15516. Add test cases to cover FileUtil#readLink. Contributed by Giovanni Matteo Fumarola.
(cherry picked from commit 12be8bad7d)
2018-06-07 13:35:32 -07:00
Xiao Chen f1c91e9fda HADOOP-15217. FsUrlConnection does not handle paths with spaces. Contributed by Joseph Fourny and Zsolt Venczel.
(cherry picked from commit ba4011d64f)
2018-06-05 21:19:11 -07:00
Daniel Templeton 09fd1348e8 HDFS-13636. Cross-Site Scripting vulnerability in HttpServer2
(Contributed by Haibo Yan via Daniel Templeton)

Change-Id: I28edde8125dd20d8d270f0e609d1c04d8173c8b7
(cherry picked from commit cba3194998)
2018-06-01 14:44:22 -07:00
Kihwal Lee 11a425d11a Additional check when unpacking archives. Contributed by Wilfred Spiegelenburg.
(cherry picked from commit e3236a9680)
2018-05-29 15:02:33 -05:00
Inigo Goiri 1dd9670ddd HADOOP-15497. TestTrash should use proper test path to avoid failing on Windows. Contributed by Anbang Hu.
(cherry picked from commit 3c75f8e493)
2018-05-29 09:11:38 -07:00
Karthik Palanisamy b0ce76d71f
HADOOP-15449. Increase default timeout of ZK session to avoid frequent NameNode failover
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 61df174e8b)
2018-05-28 19:41:58 +09:00
Xiao Chen 1c0ee35662 HADOOP-15473. Configure serialFilter in KeyProvider to avoid UnrecoverableKeyException caused by JDK-8189997. Contributed by Gabor Bota.
(cherry picked from commit 02322de3f9)
2018-05-25 09:41:04 -07:00
Miklos Szegedi 1483c90379 YARN-8310. Handle old NMTokenIdentifier, AMRMTokenIdentifier, and ContainerTokenIdentifier formats. Contributed by Robert Kanter.
(cherry picked from commit 3e5f7ea986)
2018-05-24 15:14:15 -07:00
Arpit Agarwal 76f38f3f8b HADOOP-15486. Make NetworkTopology#netLock fair. Contributed by Nanda kumar. 2018-05-23 10:30:37 -07:00
Sammi Chen 7d71b3a1cc HDFS-13540. DFSStripedInputStream should only allocate new buffers when reading. Contributed by Xiao Chen.
(cherry picked from commit 34e8b9f9a8)
2018-05-23 19:12:04 +08:00
Akira Ajisaka fc4c20fc34
Additional check when unpacking archives. Contributed by Jason Lowe and Akira Ajisaka.
(cherry picked from commit 745f203e57)
2018-05-23 17:18:19 +09:00
Kihwal Lee 6b8a5af6ef HADOOP-15450. Avoid fsync storm triggered by DiskChecker and handle disk full situation. Contributed by Arpit Agarwal.
(cherry picked from commit bcc8e76bad)
2018-05-22 11:22:22 -05:00
Rushabh Shah 1c594639f1 Skip the proxy user check if the ugi has not been initialized. Contributed by Daryn Sharp
(cherry picked from commit 73e9120ad7)
2018-05-21 12:39:59 -05:00
Inigo Goiri 472495ed1e HDFS-13586. Fsync fails on directories on Windows. Contributed by Lukas Majercack.
(cherry picked from commit 8783613696)
2018-05-17 19:27:23 -07:00
Inigo Goiri df54cdbaea HDFS-13560. Insufficient system resources exist to complete the requested service for some tests on Windows. Contributed by Anbang Hu.
(cherry picked from commit 53b807a6a8)
2018-05-17 17:03:56 -07:00
Steve Loughran f729faaabb HADOOP-15250. Split-DNS MultiHomed Server Network Cluster Network IPC Client Bind Addr Wrong
Contributed by Ajay Kumar

(cherry picked from commit 8f42dafcf8)
2018-05-17 10:14:27 -07:00
Sammi Chen e5281d9f8b Add 2.9.1 release notes and changes documents 2018-05-14 15:26:00 +08:00
Rushabh Shah 4d9a58756c HADOOP-15441. Log kms url and token service at debug level. Contributed by Gabor Bota
(cherry picked from commit a5449d3631)
2018-05-12 12:21:01 -05:00
Inigo Goiri f4f2912820 HADOOP-15454. TestRollingFileSystemSinkWithLocal fails on Windows. Contributed by Xiao Liang.
(cherry picked from commit 1da8d4190d)
2018-05-10 09:41:42 -07:00
Xiao Chen 752092a860 Revert "HADOOP-14445. Delegation tokens are not shared between KMS instances. Contributed by Xiao Chen and Rushabh S Shah."
This reverts commit 583fa6ed48.

 Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/key/kms/KMSTokenRenewer.java
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java

(cherry picked from commit a3a1552c33)

 Conflicts:
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java
2018-05-07 13:47:52 -07:00
Rushabh Shah 864640c1e3 HADOOP-14841 Kms client should disconnect if unable to get output stream from connection. Contributed by Rushabh S Shah
(cherry picked from commit 4cdbdce752)
2018-05-04 15:49:39 -05:00