4805 Commits

Author SHA1 Message Date
Steve Loughran
142d878c90 HADOOP-10219. ipc.Client.setupIOstreams() needs to check for ClientCache.stopClient requested shutdowns.
Contributed by Kihwal Lee and Lukas Majercak.

(cherry picked from commit 9e96ac666d783376a8cdea9c3cc84098c5bdcb56)
2018-09-04 12:00:31 -07:00
Daniel Templeton
68301ad7d3 HADOOP-15706. Typo in compatibility doc: SHOUD -> SHOULD
(Contributed by Laszlo Kollar via Daniel Templeton)

Change-Id: I6e2459d0700df7f3bad4eac8297a11690191c3ba
(cherry picked from commit f2c2a68ec208f640e778fc41f95f0284fcc44729)
2018-08-30 09:14:29 -07:00
Daniel Templeton
90c8cca783 HADOOP-15705. Typo in the definition of "stable" in the interface classification
Change-Id: I3eae2143400a534903db4f186400561fc8d2bd56
(cherry picked from commit d53a10b0a552155de700e396fd7f450a4c5f9c22)
2018-08-29 14:00:42 -07:00
John Zhuge
84d761d49c
HADOOP-15633. fs.TrashPolicyDefault: Can't create trash directory. Contributed by Fei Hui.
(cherry picked from commit f9c6fd94711458b77ecf3fa425aad7fda5089376)
2018-08-27 15:21:39 -07:00
Konstantin V Shvachko
60fd202a59 HDFS-13848. Refactor NameNode failover proxy providers. Contributed by Konstantin Shvachko.
(cherry picked from commit a4121c71c29d13866a605d9c0d013e5de9c147c3)
2018-08-24 18:44:04 -07:00
Takanobu Asanuma
4fa97013a9 HADOOP-14314. The OpenSolaris taxonomy link is dead in InterfaceClassification.md. Contributed by Rui Gao.
(cherry picked from commit bed8cb6979e0460141ed77e3b15d4f18db098a8e)
2018-08-23 21:55:40 +09:00
Steve Loughran
95fcdc0435
HADOOP-15679. ShutdownHookManager shutdown time needs to be configurable & extended. Contributed by Steve Loughran.
Change-Id: Ifd4a6e3f796b4dc88e97f63066289e2534c77a29
2018-08-20 18:48:49 -07:00
Xiao Chen
3712b79b38 HADOOP-9214. Create a new touch command to allow modifying atime and mtime. Contributed by Hrishikesh Gadre. 2018-08-20 14:59:14 -07:00
Xiao Chen
a630a27c53 HADOOP-15655. Enhance KMS client retry behavior. Contributed by Kitti Nanasi. 2018-08-20 14:57:51 -07:00
Xiao Chen
c0ac0a5337 HDFS-13658. Expose HighestPriorityLowRedundancy blocks statistics. Contributed by Kitti Nanasi. 2018-08-20 14:52:28 -07:00
Yiqun Lin
e4b75ad583 HDFS-13792. Fix FSN read/write lock metrics name. Contributed by Chao Sun. 2018-08-20 14:50:47 -07:00
Xiao Chen
7556b09e9a HADOOP-15674. Test failure TestSSLHttpServer.testExcludedCiphers with TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256 cipher suite. Contributed by Szilard Nemeth.
(cherry picked from commit 8d7c93186e3090b19aa59006bb6b32ba929bd8e6)
2018-08-17 10:20:12 -07:00
Wangda Tan
781620a44d Make 3.1.1 awared by other branches
(cherry picked from commit 49c687608b65b772faeed614700ece8e526432e8)
2018-08-08 13:04:05 -07:00
Arpit Agarwal
c8fbe7921b HADOOP-15476. fix logging for split-dns multihome . Contributed by Ajay Kumar. 2018-08-01 12:32:13 -07:00
Wangda Tan
5583711419 Preparing for 3.1.2 release
Change-Id: If2793e2ed2b5b349a9e1f98f78df43f309dcfcbd
2018-07-31 13:08:55 -07:00
Chen Liang
5194994757 HADOOP-15637. LocalFs#listLocatedStatus does not filter out hidden .crc files. Contributed by Erik Krogen. 2018-07-30 16:44:22 -07:00
Chen Liang
46fcbc5030 Revert "HADOOP-15637. LocalFs#listLocatedStatus does not filter out hidden .crc files. Contributed by Erik Krogen."
This reverts commit 6812535b0b4a0ec212e174637e5aedd3ff582f4c.
2018-07-30 12:05:08 -07:00
Chen Liang
6812535b0b HADOOP-15637. LocalFs#listLocatedStatus does not filter out hidden .crc files. Contributed by Erik Krogen. 2018-07-30 10:33:02 -07:00
Eric Yang
a869bd970e HADOOP-15593. Fixed NPE in UGI spawnAutoRenewalThreadForUserCreds.
Contributed by Gabor Bota

(cherry picked from commit 77721f39e26b630352a1f4087524a3fbd21ff06e)
2018-07-26 18:47:58 -04:00
Gera Shegalov
1396fa2a27 HADOOP-15612. Improve exception when tfile fails to load LzoCodec. (gera)
(cherry picked from commit 6bec03cfc8bdcf6aa3df9c22231ab959ba31f2f5)
2018-07-24 23:05:34 -07:00
Xiao Chen
40c06b389a HADOOP-15609. Retry KMS calls when SSLHandshakeException occurs. Contributed by Kitti Nanasi.
(cherry picked from commit 81d59506e539673edde12e19c0df5c2edd9d02ad)
2018-07-24 21:46:21 -07:00
Daniel Templeton
00c476abd8 HDFS-13448. HDFS Block Placement - Ignore Locality for First Block Replica
(Contributed by BELUGA BEHR via Daniel Templeton)

Change-Id: I965d1cfa642ad24296038b83e3d5c9983545267d
(cherry picked from commit 849c45db187224095b13fe297a4d7377fbb9d2cd)
2018-07-24 16:12:43 -07:00
bibinchundatt
0710107f8d YARN-8544. [DS] AM registration fails when hadoop authorization is enabled. Contributed by Bibin A Chundatt.
(cherry picked from commit 84612788339392fcda1aef0e27c43f5c6b2a19e5)
2018-07-24 13:11:31 +05:30
Kihwal Lee
a147098c4f HADOOP-15614. TestGroupsCaching.testExceptionOnBackgroundRefreshHandled reliably fails. Contributed by Weiwei Yang.
(cherry picked from commit ccf2db7fc2688d262df3309007cb12a4dfedc179)
2018-07-19 11:19:19 -05:00
Wei-Chiu Chuang
34f1dd03ee HADOOP-15598. DataChecksum calculate checksum is contented on hashtable synchronization. Contributed by Prasanth Jayachandran.
(cherry picked from commit 0c7a578927032d5d1ef3469283d7d1fb7dee2a56)
2018-07-16 11:33:43 -07:00
Wei-Chiu Chuang
f9fa3cb157 HDFS-13723. Occasional "Should be different group" error in TestRefreshUserMappings#testGroupMappingRefresh. Contributed by Siyao Meng.
(cherry picked from commit 162228e8db937d4bdb9cf61d15ed555f1c96368f)
2018-07-11 10:04:07 -07:00
Xiaoyu Yao
ffe2019887 HADOOP-15571. Multiple FileContexts created with the same configuration object should be allowed to have different umask. Contributed by Vinod Kumar Vavilapalli.
(cherry picked from commit 629f7008b531bad469903e6a1f6f8cb4be691f36)
2018-07-06 11:56:51 -07:00
Andrew Wang
9f2d57697a HADOOP-15554. Improve JIT performance for Configuration parsing. Contributed by Todd Lipcon.
(cherry picked from commit f51da9c4d1423c2ac92eb4f40e973264e7e968cc)
2018-07-02 18:31:27 +02:00
Eric E Payne
012baf4313 HADOOP-15548: Randomize local dirs. Contributed by Jim Brennan.
(cherry picked from commit d36f6b9e93e4c30d24d0e837cb00bd24ffa8f274)
2018-06-29 18:22:51 +00:00
Eric Yang
3ce3571a34 YARN-8409. Fixed NPE in ActiveStandbyElectorBasedElectorService.
Contributed by Chandni Singh
2018-06-28 13:11:56 -04:00
Bharat Viswanadham
8fa530746f HDFS-13705:The native ISA-L library loading failure should be made warning rather than an error message. Contributed by Shashikant Banerjee.
(cherry picked from commit d3fa83a44b01c85f39bfb4deaf2972912ac61ca3)
2018-06-28 09:26:58 -07:00
Inigo Goiri
cbe15066c8 HADOOP-15458. TestLocalFileSystem#testFSOutputStreamBuilder fails on Windows. Contributed by Xiao Liang.
(cherry picked from commit abc3e4bad905efde5a4881e8a072c68f6e910ade)
2018-06-25 09:51:01 -07:00
Eric E Payne
1974dfa44d YARN-8444: NodeResourceMonitor crashes on bad swapFree value. Contributed by Jim Brennan.
(cherry picked from commit 6432128622d64f3f9dd638b9c254c77cdf5408aa)
2018-06-22 17:18:37 +00:00
Xiao Chen
e8655b8c72 HDFS-13682. Cannot create encryption zone after KMS auth token expires.
(cherry picked from commit 32f867a6a907c05a312657139d295a92756d98ef)
2018-06-20 15:59:23 -07:00
Eric Yang
a31a966a20 HADOOP-15527. Improve delay check for stopping processes.
Fixed script location.
               Contributed by Vinod Kumar Vavilapalli

(cherry picked from commit 2d87592fc6a56bfe77dd3c11953caea2b701c846)
2018-06-19 13:40:10 -04:00
Surendra Singh Lilhore
40652e77e0 HADOOP-15523. Shell command timeout given is in seconds whereas it is taken as millisec while scheduling. Contributed by Bilwa S T.
(cherry picked from commit 3905fdb793e6370243d05d0c3036ca69898fe3fb)
2018-06-17 12:14:20 +05:30
Yiqun Lin
5c1248b2da HDFS-13641. Add metrics for edit log tailing. Contributed by Chao Sun.
(cherry picked from commit 8e7548d33be9c4874daab18b2e774bdc2ed216d3)
2018-06-13 20:10:46 +08:00
Eric Yang
f516a7a85f HADOOP-15527. Improve delay check for stopping processes.
Contributed by Vinod Kumar Vavilapalli

(cherry picked from commit 108da85320d65e37fe835de65866b818e5420587)
2018-06-12 21:12:21 -04:00
Inigo Goiri
6f31faf92b HADOOP-15532. TestBasicDiskValidator fails with NoSuchFileException. Contributed by Giovanni Matteo Fumarola.
(cherry picked from commit aeaf9fec62f10699d1c809d66444520fe4533c2c)
2018-06-12 14:17:25 -07:00
Rohith Sharma K S
af0309d793 YARN-8405. RM zk-state-store.parent-path ACLs has been changed since HADOOP-14773. Contributed by Íñigo Goiri.
(cherry picked from commit 2df73dace06cfd2b3193a14cd455297f8f989617)
2018-06-12 17:23:22 +05:30
Yongjun Zhang
425fe4e217 Update CHANGES, RELEASENOTES, and jdiff for 3.0.3 release.
(cherry picked from commit 5a82f10e3254bc0745c2dda6bcef888d3ff0d1c3)
2018-06-11 14:31:46 -07:00
Sammi Chen
e3c96354a7 HADOOP-15499. Performance severe drops when running RawErasureCoderBenchmark with NativeRSRawErasureCoder. Contributed by Sammi Chen.
(cherry picked from commit 18201b882a38ad875358c5d23c09b0ef903c2f91)
(cherry picked from commit b8741102758f70e79eb4043b71433560f5ca713e)
2018-06-11 14:03:39 +08:00
Inigo Goiri
8526ba9a69 HADOOP-15516. Add test cases to cover FileUtil#readLink. Contributed by Giovanni Matteo Fumarola.
(cherry picked from commit 12be8bad7debd67c9ea72b979a39c8cf42c5f37d)
2018-06-07 13:35:32 -07:00
Xiao Chen
f1c91e9fda HADOOP-15217. FsUrlConnection does not handle paths with spaces. Contributed by Joseph Fourny and Zsolt Venczel.
(cherry picked from commit ba4011d64fadef3bee5920ccedbcdac01794cc23)
2018-06-05 21:19:11 -07:00
Daniel Templeton
09fd1348e8 HDFS-13636. Cross-Site Scripting vulnerability in HttpServer2
(Contributed by Haibo Yan via Daniel Templeton)

Change-Id: I28edde8125dd20d8d270f0e609d1c04d8173c8b7
(cherry picked from commit cba319499822a2475c60c43ea71f8e78237e139f)
2018-06-01 14:44:22 -07:00
Kihwal Lee
11a425d11a Additional check when unpacking archives. Contributed by Wilfred Spiegelenburg.
(cherry picked from commit e3236a9680709de7a95ffbc11b20e1bdc95a8605)
2018-05-29 15:02:33 -05:00
Inigo Goiri
1dd9670ddd HADOOP-15497. TestTrash should use proper test path to avoid failing on Windows. Contributed by Anbang Hu.
(cherry picked from commit 3c75f8e4933221fa60a87e86a3db5e4727530b6f)
2018-05-29 09:11:38 -07:00
Karthik Palanisamy
b0ce76d71f
HADOOP-15449. Increase default timeout of ZK session to avoid frequent NameNode failover
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 61df174e8b3d582183306cabfa2347c8b96322ff)
2018-05-28 19:41:58 +09:00
Xiao Chen
1c0ee35662 HADOOP-15473. Configure serialFilter in KeyProvider to avoid UnrecoverableKeyException caused by JDK-8189997. Contributed by Gabor Bota.
(cherry picked from commit 02322de3f95ba78a22c057037ef61aa3ab1d3824)
2018-05-25 09:41:04 -07:00
Miklos Szegedi
1483c90379 YARN-8310. Handle old NMTokenIdentifier, AMRMTokenIdentifier, and ContainerTokenIdentifier formats. Contributed by Robert Kanter.
(cherry picked from commit 3e5f7ea986600e084fcac723b0423e7de1b3bb8a)
2018-05-24 15:14:15 -07:00