Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
19,535 Commits 326 Branches 371 Tags
Commit Graph

4953 Commits

Author SHA1 Message Date
Eric E Payne
1974dfa44d YARN-8444: NodeResourceMonitor crashes on bad swapFree value. Contributed by Jim Brennan. 
(cherry picked from commit 6432128622d64f3f9dd638b9c254c77cdf5408aa)
 2018-06-22 17:18:37 +00:00
Xiao Chen
e8655b8c72 HDFS-13682. Cannot create encryption zone after KMS auth token expires. 
(cherry picked from commit 32f867a6a907c05a312657139d295a92756d98ef)
 2018-06-20 15:59:23 -07:00
Eric Yang
a31a966a20 HADOOP-15527. Improve delay check for stopping processes. 
Fixed script location.
               Contributed by Vinod Kumar Vavilapalli

(cherry picked from commit 2d87592fc6a56bfe77dd3c11953caea2b701c846)
 2018-06-19 13:40:10 -04:00
Surendra Singh Lilhore
40652e77e0 HADOOP-15523. Shell command timeout given is in seconds whereas it is taken as millisec while scheduling. Contributed by Bilwa S T. 
(cherry picked from commit 3905fdb793e6370243d05d0c3036ca69898fe3fb)
 2018-06-17 12:14:20 +05:30
Yiqun Lin
5c1248b2da HDFS-13641. Add metrics for edit log tailing. Contributed by Chao Sun. 
(cherry picked from commit 8e7548d33be9c4874daab18b2e774bdc2ed216d3)
 2018-06-13 20:10:46 +08:00
Eric Yang
f516a7a85f HADOOP-15527. Improve delay check for stopping processes. 
Contributed by Vinod Kumar Vavilapalli

(cherry picked from commit 108da85320d65e37fe835de65866b818e5420587)
 2018-06-12 21:12:21 -04:00
Inigo Goiri
6f31faf92b HADOOP-15532. TestBasicDiskValidator fails with NoSuchFileException. Contributed by Giovanni Matteo Fumarola. 
(cherry picked from commit aeaf9fec62f10699d1c809d66444520fe4533c2c)
 2018-06-12 14:17:25 -07:00
Rohith Sharma K S
af0309d793 YARN-8405. RM zk-state-store.parent-path ACLs has been changed since HADOOP-14773. Contributed by Íñigo Goiri. 
(cherry picked from commit 2df73dace06cfd2b3193a14cd455297f8f989617)
 2018-06-12 17:23:22 +05:30
Yongjun Zhang
425fe4e217 Update CHANGES, RELEASENOTES, and jdiff for 3.0.3 release. 
(cherry picked from commit 5a82f10e3254bc0745c2dda6bcef888d3ff0d1c3)
 2018-06-11 14:31:46 -07:00
Sammi Chen
e3c96354a7 HADOOP-15499. Performance severe drops when running RawErasureCoderBenchmark with NativeRSRawErasureCoder. Contributed by Sammi Chen. 
(cherry picked from commit 18201b882a38ad875358c5d23c09b0ef903c2f91)
(cherry picked from commit b8741102758f70e79eb4043b71433560f5ca713e)
 2018-06-11 14:03:39 +08:00
Inigo Goiri
8526ba9a69 HADOOP-15516. Add test cases to cover FileUtil#readLink. Contributed by Giovanni Matteo Fumarola. 
(cherry picked from commit 12be8bad7debd67c9ea72b979a39c8cf42c5f37d)
 2018-06-07 13:35:32 -07:00
Xiao Chen
f1c91e9fda HADOOP-15217. FsUrlConnection does not handle paths with spaces. Contributed by Joseph Fourny and Zsolt Venczel. 
(cherry picked from commit ba4011d64fadef3bee5920ccedbcdac01794cc23)
 2018-06-05 21:19:11 -07:00
Daniel Templeton
09fd1348e8 HDFS-13636. Cross-Site Scripting vulnerability in HttpServer2 
(Contributed by Haibo Yan via Daniel Templeton)

Change-Id: I28edde8125dd20d8d270f0e609d1c04d8173c8b7
(cherry picked from commit cba319499822a2475c60c43ea71f8e78237e139f)
 2018-06-01 14:44:22 -07:00
Kihwal Lee
11a425d11a Additional check when unpacking archives. Contributed by Wilfred Spiegelenburg. 
(cherry picked from commit e3236a9680709de7a95ffbc11b20e1bdc95a8605)
 2018-05-29 15:02:33 -05:00
Inigo Goiri
1dd9670ddd HADOOP-15497. TestTrash should use proper test path to avoid failing on Windows. Contributed by Anbang Hu. 
(cherry picked from commit 3c75f8e4933221fa60a87e86a3db5e4727530b6f)
 2018-05-29 09:11:38 -07:00
Karthik Palanisamy
b0ce76d71f
HADOOP-15449. Increase default timeout of ZK session to avoid frequent NameNode failover 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 61df174e8b3d582183306cabfa2347c8b96322ff)
 2018-05-28 19:41:58 +09:00
Xiao Chen
1c0ee35662 HADOOP-15473. Configure serialFilter in KeyProvider to avoid UnrecoverableKeyException caused by JDK-8189997. Contributed by Gabor Bota. 
(cherry picked from commit 02322de3f95ba78a22c057037ef61aa3ab1d3824)
 2018-05-25 09:41:04 -07:00
Miklos Szegedi
1483c90379 YARN-8310. Handle old NMTokenIdentifier, AMRMTokenIdentifier, and ContainerTokenIdentifier formats. Contributed by Robert Kanter. 
(cherry picked from commit 3e5f7ea986600e084fcac723b0423e7de1b3bb8a)
 2018-05-24 15:14:15 -07:00
Arpit Agarwal
76f38f3f8b HADOOP-15486. Make NetworkTopology#netLock fair. Contributed by Nanda kumar. 2018-05-23 10:30:37 -07:00
Sammi Chen
7d71b3a1cc HDFS-13540. DFSStripedInputStream should only allocate new buffers when reading. Contributed by Xiao Chen. 
(cherry picked from commit 34e8b9f9a86fb03156861482643fba11bdee1dd4)
 2018-05-23 19:12:04 +08:00
Akira Ajisaka
fc4c20fc34
Additional check when unpacking archives. Contributed by Jason Lowe and Akira Ajisaka. 
(cherry picked from commit 745f203e577bacb35b042206db94615141fa5e6f)
 2018-05-23 17:18:19 +09:00
Kihwal Lee
6b8a5af6ef HADOOP-15450. Avoid fsync storm triggered by DiskChecker and handle disk full situation. Contributed by Arpit Agarwal. 
(cherry picked from commit bcc8e76badc1341a6cf995c8e44fa5e422158de8)
 2018-05-22 11:22:22 -05:00
Rushabh Shah
1c594639f1 Skip the proxy user check if the ugi has not been initialized. Contributed by Daryn Sharp 
(cherry picked from commit 73e9120ad79c73703de21e0084591861813f3279)
 2018-05-21 12:39:59 -05:00
Inigo Goiri
472495ed1e HDFS-13586. Fsync fails on directories on Windows. Contributed by Lukas Majercack. 
(cherry picked from commit 8783613696674aba4ae1739c6e8f48cda0d1c386)
 2018-05-17 19:27:23 -07:00
Inigo Goiri
df54cdbaea HDFS-13560. Insufficient system resources exist to complete the requested service for some tests on Windows. Contributed by Anbang Hu. 
(cherry picked from commit 53b807a6a8486cefe0b036f7893de9f619bd44a1)
 2018-05-17 17:03:56 -07:00
Steve Loughran
f729faaabb HADOOP-15250. Split-DNS MultiHomed Server Network Cluster Network IPC Client Bind Addr Wrong 
Contributed by Ajay Kumar

(cherry picked from commit 8f42dafcf82d5b426dd931dc5ddd177dd6f283f7)
 2018-05-17 10:14:27 -07:00
Sammi Chen
e5281d9f8b Add 2.9.1 release notes and changes documents 2018-05-14 15:26:00 +08:00
Rushabh Shah
4d9a58756c HADOOP-15441. Log kms url and token service at debug level. Contributed by Gabor Bota 
(cherry picked from commit a5449d36312c3de953e05ba8b3b5acf818a0c7e7)
 2018-05-12 12:21:01 -05:00
Inigo Goiri
f4f2912820 HADOOP-15454. TestRollingFileSystemSinkWithLocal fails on Windows. Contributed by Xiao Liang. 
(cherry picked from commit 1da8d4190d6e574347ab9d3380513e9401569573)
 2018-05-10 09:41:42 -07:00
Xiao Chen
752092a860 Revert "HADOOP-14445. Delegation tokens are not shared between KMS instances. Contributed by Xiao Chen and Rushabh S Shah." 
This reverts commit 583fa6ed48ad3df40bcaa9c591d5ccd07ce3ea81.

 Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/key/kms/KMSTokenRenewer.java
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java

(cherry picked from commit a3a1552c33d5650fbd0a702369fccd21b8c9d3e2)

 Conflicts:
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java
 2018-05-07 13:47:52 -07:00
Rushabh Shah
864640c1e3 HADOOP-14841 Kms client should disconnect if unable to get output stream from connection. Contributed by Rushabh S Shah 
(cherry picked from commit 4cdbdce752e192b45c2b9756c2d4bd24ceffdabd)
 2018-05-04 15:49:39 -05:00
Daniel Templeton
57e4115436 HDFS-13481. TestRollingFileSystemSinkWithHdfs#testFlushThread: test failed intermittently 
(Contributed by Gabor Bota via Daniel Templeton)

Change-Id: I9921981dfa69669fe7912dd2a31ae8b638283204
(cherry picked from commit 87c23ef643393c39e8353ca9f495b0c8f97cdbd9)
 2018-05-02 17:17:46 -07:00
Jason Lowe
cacd267b0d
HADOOP-15406. hadoop-nfs dependencies for mockito and junit are not test scope 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit e07156e8b07552b877a22565641465e211144f6f)
 2018-05-02 17:32:08 +09:00
Wangda Tan
da9d5a3fee HADOOP-15411. AuthenticationFilter should use Configuration.getPropsWithPrefix instead of iterator. (Suma Shivaprasad via wangda) 
Change-Id: Ia19458a43aceb4ffdb1e8eccc519655235d92ba9
(cherry picked from commit 3559d8b1dacf5cf207424de37cb6ba8865d26ffe)
 2018-04-25 22:16:07 -07:00
Robert Kanter
ea7ad50499 HADOOP-15390. Yarn RM logs flooded by DelegationTokenRenewer trying to renew KMS tokens (xiaochen via rkanter) 
(cherry picked from commit 7ab08a9c37a76edbe02d556fcfb2e637f45afc21)
 2018-04-23 16:25:41 -07:00
Mukul Kumar Singh
94076c4028 HADOOP-15366. Add a helper shutdown routine in HadoopExecutor to ensure clean shutdown. Contributed by Shashikant Banerjee. 2018-04-18 16:30:59 +05:30
Virajith Jalaparti
70830d9f9c HDFS-13311. RBF: TestRouterAdminCLI#testCreateInvalidEntry fails on Windows. Contributed by Inigo Goiri 2018-04-16 16:06:25 -07:00
Xiao Chen
805e33b62c HDFS-13056. Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts. Contributed by Dennis Huo. 2018-04-16 11:58:10 -07:00
Yufei Gu
6891da1e75 HADOOP-15331. Fix a race condition causing parsing error of java.io.BufferedInputStream in class org.apache.hadoop.conf.Configuration. Contributed by Miklos Szegedi. 2018-04-13 10:13:34 -07:00
fang zhenyi
922a0db13c HADOOP-15330. Remove jdk1.7 profile from hadoop-annotations module 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2018-04-13 10:12:27 -07:00
Yufei Gu
9014f98b60 HADOOP-15062. TestCryptoStreamsWithOpensslAesCtrCryptoCodec fails on Debian 9. Contributed by Miklos Szegedi. 2018-04-13 10:12:01 -07:00
Chris Douglas
ffc39ec3ab HADOOP-14667. Flexible Visual Studio support. Contributed by Allen Wittenauer 2018-04-13 10:11:35 -07:00
Bharat Viswanadham
b652e915fb HADOOP-15379. Make IrqHandler.bind() public. Contributed by Ajay Kumar 
(cherry picked from commit ec1e8c1a8ca3d01b82ca82d73ba1132b6625d659)
 2018-04-12 21:55:40 -07:00
Xiao Chen
6d6f65f224 HADOOP-14445. Delegation tokens are not shared between KMS instances. Contributed by Xiao Chen and Rushabh S Shah. 
(cherry picked from commit 583fa6ed48ad3df40bcaa9c591d5ccd07ce3ea81)
 2018-04-10 15:45:35 -07:00
Xiao Chen
96af1af28f HADOOP-15313. TestKMS should close providers. 
(cherry picked from commit c22d62b338cb16d93c4576a9c634041e3610a116)
 2018-04-10 15:45:34 -07:00
Jason Lowe
ffceb907fe HADOOP-15357. Configuration.getPropsWithPrefix no longer does variable substitution. Contributed by Jim Brennan 
(cherry picked from commit e81397545a273cf9a090010eb644b836e0ef8c7b)
 2018-04-10 16:49:27 -05:00
Ewan Higgs
c9da1e97f8
HADOOP-15376. Remove double semi colons on imports that make Clover fall over. 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit cef8eb79810383f9970ed3713deecc18fbf0ffaa)
 2018-04-10 23:59:34 +09:00
Wangda Tan
25bf1d3ac6 Updated branch-3.1 to track 3.1.1 
Change-Id: Idd55c79921b8acacc8a8a3258450e476f3abb706
 2018-04-09 10:58:50 -07:00
Wangda Tan
a336561e2b Added CHANGES/RELEASES/Jdiff for 3.1.0 release 
Change-Id: Ied5067a996151c04d15cad46c46ac98b60c37b39
(cherry picked from commit 2d96570452a72569befdf9cfe9b90c9fa2e0e261)
 2018-04-05 15:52:02 -07:00
Wei Yan
89efe30f65 HDFS-13353. RBF: TestRouterWebHDFSContractCreate failed. Contributed by Takanobu Asanuma. 
(cherry picked from commit 3121e8c29361cb560df29188e1cd1061a5fc34c4)
 2018-04-05 13:13:16 -07:00