17468 Commits

Author SHA1 Message Date
Shashikant Banerjee
2c4b1c2b15
HADOOP-15396. Some java source files are executable
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit e4c39f3247da77d03c6015de4f18be75924fcb22)
2018-04-19 08:36:59 +09:00
Erik Krogen
1f8fd96eaf
HDFS-12828. OIV ReverseXML Processor fails with escaped characters
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 2d9e791a9073de9f65fef5407efd3a42894bc97f)
2018-04-18 14:40:24 +09:00
Wei Yan
0124c7ffd6 HDFS-13466. RBF: Add more router-related information to the UI.
(cherry picked from commit e4313e7e4725261b652dd7202048ff2373b05e28)
2018-04-17 15:04:05 -07:00
Inigo Goiri
282bbd56e8 HDFS-13462. Add BIND_HOST configuration for JournalNode's HTTP and RPC Servers. Contributed by Lukas Majercak.
(cherry picked from commit c9b33514b8d11db44b5f95b4df43789ed45c47a7)
2018-04-17 14:29:20 -07:00
Jason Lowe
391ac5cdd2 YARN-7189. Container-executor doesn't remove Docker containers that error out early. Contributed by Eric Badger 2018-04-17 09:45:55 -05:00
Inigo Goiri
688933e6c7 YARN-8165. Incorrect queue name logging in AbstractContainerAllocator. Contributed by Weiwei Yan.
(cherry picked from commit dd5e18c4aecba56f140c3cc11affc2cb5e61c79d)
2018-04-17 15:29:39 +05:30
Yiqun Lin
24bdad925e HDFS-13435. RBF: Improve the error loggings for printing the stack trace.
(cherry picked from commit c4d3636c21acaeb2b7d56d19cd4996aa25151bd1)
2018-04-17 11:26:13 +08:00
Virajith Jalaparti
f06b55bbf1 HDFS-13311. RBF: TestRouterAdminCLI#testCreateInvalidEntry fails on Windows. Contributed by Inigo Goiri 2018-04-16 16:05:17 -07:00
Rohith Sharma K S
7e37979472 YARN-8156. Increase the default value of yarn.timeline-service.app-collector.linger-period.ms. Contributed by Charan Hebri.
(cherry picked from commit 669eb7bdea34f26e9b9b8a2260ae4356791622e7)
2018-04-14 11:10:16 +05:30
Wei-Chiu Chuang
dc01e323ed HDFS-13330. ShortCircuitCache#fetchOrCreate never retries. Contributed by Gabor Bota.
(cherry picked from commit e66e287efe2b43e710137a628f03c7df3ebdf498)
(cherry picked from commit ca8bb322be5e21ce00bb49cecfc4f515b49d2a37)
2018-04-13 12:20:01 -07:00
Erik Krogen
bce57a139b HADOOP-14970. MiniHadoopClusterManager doesn't respect lack of format option. Contributed by Erik Krogen
(cherry picked from commit 1a407bc9906306801690bc75ff0f0456f8f265fd)
2018-04-12 23:35:58 -07:00
Akira Ajisaka
64105868e9
HDFS-13436. Fix javadoc of package-info.java
(cherry picked from commit 9b0b9f2af2f6827d7430f995d3203c4cb7ef7e48)
2018-04-13 13:25:19 +09:00
Sammi Chen
ce7ebbe2cc HADOOP-14999. AliyunOSS: provide one asynchronous multi-part based uploading mechanism. Contributed by Genmao Yu.
(cherry picked from commit 6542d17ea460ec222137c4b275b13daf15d3fca3)
(cherry picked from commit e96c7bf82de1e9fd97df5fb6b763e211ebad5913)
2018-04-13 10:17:46 +08:00
Jason Lowe
d416a0c9b7 YARN-8027. Setting hostname of docker container breaks for --net=host in docker 1.13. Contributed by Jim Brennan 2018-04-12 16:04:20 -05:00
Lei Xu
3717df89ee Preparing for 3.0.3 development 2018-04-12 13:57:46 -07:00
Eric E Payne
43d2ee9de6 YARN-8147. TestClientRMService#testGetApplications sporadically fails. Contributed by Jason Lowe
(cherry picked from commit 18844599aef42f79d2af4500aa2eee472dda95cb)
2018-04-12 18:10:42 +00:00
Eric E Payne
081ea1ec39 YARN-8120. JVM can crash with SIGSEGV when exiting due to custom leveldb logger. Contributed by Jason Lowe.
(cherry picked from commit 6bb128dfb893cf0e4aa2d3ecc65440668a1fc8d7)
2018-04-12 16:22:48 +00:00
Akira Ajisaka
94daa4f3b3
HDFS-13427. Fix the section titles of transparent encryption document.
(cherry picked from commit c7cd362afd21add324c3a82c594b133d41cf8d03)
2018-04-12 10:46:40 +09:00
Eric Yang
f2cf11416c YARN-7810. Update TestDockerContainerRuntime to test with current user credential.
(contributed by Shane Kumpf)

            Cherry-picked from: 59828be1978ec942dda38774a1d9f741efa96f71
2018-04-11 20:04:24 -04:00
Inigo Goiri
5fe2b97dd0 HDFS-13386. RBF: Wrong date information in list file(-ls) result. Contributed by Dibyendu Karmakar.
(cherry picked from commit 18de6f2042b70f9f0d7a2620c60de022768a7b13)
2018-04-11 12:03:57 -07:00
Inigo Goiri
670abc4121 HDFS-13428. RBF: Remove LinkedList From StateStoreFileImpl.java. Contributed by BELUGA BEHR.
(cherry picked from commit 6a881cd842fb4eab596a386b39670ea03536891a)
2018-04-11 10:41:40 -07:00
Wei Yan
8433f6256c HDFS-13045. RBF: Improve error message returned from subcluster. Contributed by Inigo Goiri. 2018-04-11 08:51:47 -07:00
Rohith Sharma K S
7cca3486b7 MAPREDUCE-7062. Update mapreduce.job.tags description for making use for ATSv2 purpose. Contributed by Charan Hebri.
(cherry picked from commit 6cc59a09e7330dc893b386d84c8f2aa86c02eace)
2018-04-11 09:49:38 +05:30
Vrushali C
ec258b8ed1 YARN-8073 TimelineClientImpl doesn't honor yarn.timeline-service.versions configuration. Contributed by Rohith Sharma K S
(cherry picked from commit 345e7624d58a058a1bad666bd1e5ce4b346a9056)
2018-04-11 09:49:25 +05:30
Xiao Chen
72acda1449 HADOOP-14445. Delegation tokens are not shared between KMS instances. Contributed by Xiao Chen and Rushabh S Shah.
(cherry picked from commit 583fa6ed48ad3df40bcaa9c591d5ccd07ce3ea81)
2018-04-10 15:45:48 -07:00
Xiao Chen
46edbedd99 HADOOP-15313. TestKMS should close providers.
(cherry picked from commit c22d62b338cb16d93c4576a9c634041e3610a116)
2018-04-10 15:45:47 -07:00
Jason Lowe
eef5d1947e HADOOP-15357. Configuration.getPropsWithPrefix no longer does variable substitution. Contributed by Jim Brennan
(cherry picked from commit e81397545a273cf9a090010eb644b836e0ef8c7b)
2018-04-10 16:54:17 -05:00
Rakesh Radhakrishnan
afbdd8fdcf HDFS-13328. Abstract ReencryptionHandler recursive logic in separate class. Contributed by Surendra Singh Lilhore.
(cherry picked from commit f89594f0b80e8efffdcb887daa4a18a2b0a228b3)
2018-04-10 23:43:28 +05:30
Inigo Goiri
fe7a70e586 Revert "HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun."
This reverts commit 877f963a059d21e942b0b5cbff5f60ce23c5b5fe.
2018-04-10 10:08:34 -07:00
Weiwei Yang
1a0ce93696 HDFS-13420. License header is displayed in ArchivalStorage/MemoryStorage html pages. Contributed by Akira Ajisaka.
(cherry picked from commit 6729047a8ba273d27edcc6a1a9d397a096f44d84)
2018-04-10 22:16:25 +08:00
Yiqun Lin
d4e438ff63 HDFS-13384. RBF: Improve timeout RPC call mechanism. Contributed by Inigo Goiri.
(cherry picked from commit e87be8a2a49573897e40bfdf43541e3635e35c98)
2018-04-10 15:38:18 +08:00
Yiqun Lin
0a216c3285 HDFS-13410. RBF: Support federation with no subclusters. Contributed by Inigo Goiri.
(cherry picked from commit a92200f4a6cec57b7080d1cd6e2a20d79d772dd6)
2018-04-10 14:34:25 +08:00
Inigo Goiri
877f963a05 HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun.
(cherry picked from commit ac32b3576da4cc463dff85118163ccfff02215fc)
2018-04-09 09:18:03 -07:00
bibinchundatt
952bb0f371 YARN-7905. Parent directory permission incorrect during public localization. Contributed by Bilwa S T.
(cherry picked from commit eb47c3de74ba4b8b3ef47eaf3a44e5562fd22fc9)
2018-04-08 14:57:11 +05:30
Yiqun Lin
c3d8eda9bd HDFS-13402. RBF: Fix java doc for StateStoreFileSystemImpl. Contributed by Yiran Wu.
(cherry picked from commit 5700556cd65a558f4393e05acb7ea8db3ccd2f36)
2018-04-08 12:05:32 +08:00
Manoj Govindassamy
218a21a0f0 HADOOP-13055. Implement linkMergeSlash and linkFallback for ViewFileSystem
(cherry picked from commit 133d7ca76e3d4b60292d57429d4259e80bec650a)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/ViewFs.md
2018-04-06 15:19:01 -07:00
Arpit Agarwal
492a597942 HDFS-11968. ViewFS: StoragePolicies commands fail with HDFS federation. Contributed by Mukul Kumar Singh.
(cherry picked from commit b91305119b434d23b99ae7e755aea6639f48b6ab)
2018-04-06 15:19:01 -07:00
Haibo Chen
ca105d1c8e YARN-8107. Give an informative message when incorrect format is used in ATSv2 filter attributes. (Rohith Sharma K S via Haibo Chen)
(cherry picked from commit 024d7c08704e6a5fcc1f53a8f56a44c84c8d5fa0)
(cherry picked from commit b232dcab33c4f3e131b9699119167af8916879c4)
2018-04-06 09:43:06 -07:00
Wei Yan
9638c3fe67 HDFS-13353. RBF: TestRouterWebHDFSContractCreate failed. Contributed by Takanobu Asanuma.
(cherry picked from commit 3121e8c29361cb560df29188e1cd1061a5fc34c4)
2018-04-05 13:19:05 -07:00
Haibo Chen
9cb378f5c7 YARN-6936. [Atsv2] Retrospect storing entities into sub application table from client perspective. (Rohith Sharma K S via Haibo Chen)
(cherry picked from commit f8b8bd53c4797d406bea5b1b0cdb179e209169cc)
(cherry picked from commit 6658018410defe3d7e4ea2a465e68d1cfdde6ada)
2018-04-05 11:38:44 -07:00
Lei Xu
9fe337096d HDFS-13350. Negative legacy block ID will confuse Erasure Coding to be considered as striped block. (Contributed by Lei (Eddy) Xu).
(cherry picked from commit 1cbf23df145af01692b8aaa438642b64e330cd05)
2018-04-05 09:54:15 -07:00
Yiqun Lin
f2d89d7bf9 HDFS-13364. Addendum to fix branch-3.0 compilation. 2018-04-05 09:52:50 +08:00
Yiqun Lin
794ecb0284 HDFS-13364. RBF: Support NamenodeProtocol in the Router. Contributed by Inigo Goiri.
(cherry picked from commit 2be64eb201134502a92f7239bef8aa780771ca0b)
2018-04-03 15:26:02 +08:00
Xiao Chen
973a7b16b9 HADOOP-15355. TestCommonConfigurationFields is broken by HADOOP-15312. Contributed by LiXin Ge.
(cherry picked from commit f614b44fe583033947cc78d8f04cfe6fb64fc892)
2018-04-02 23:10:26 -07:00
Xiao Chen
ce37f586f5 HADOOP-15317. Improve NetworkTopology chooseRandom's loop.
(cherry picked from commit 57374c4737ab0fccf52dae3cea911fc6bd90e1b7)
2018-04-02 22:49:03 -07:00
Steve Loughran
a3945e4cf1 HADOOP-14651. Update okhttp version to 2.7.5. Contributed by Ray Chiang and John Zhuge.
(cherry picked from commit 8aca46e53f5962217851dc2103211f99a4ef7258)
2018-04-02 16:38:19 +01:00
Inigo Goiri
8266696aa3 HDFS-13289. RBF: TestConnectionManager#testCleanup() test case need correction. Contributed by Dibyendu Karmakar.
(cherry picked from commit dc8e3432013153ac11d31d6b462aa96f8ca2c443)
2018-03-31 09:47:06 -07:00
Konstantin V Shvachko
4ba5efa96f HADOOP-15253. Should update maxQueueSize when refresh call queue. Contributed by Tao Jie.
(cherry picked from commit acfd764fcc9990e507c0e7cea746652375aaa632)
2018-03-30 19:05:01 -07:00
Yiqun Lin
7483acf484
HDFS-13349. Unresolved merge conflict in ViewFs.md
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-03-30 23:28:59 +09:00
Konstantin V Shvachko
3912bdb2b0 HADOOP-12862. LDAP Group Mapping over SSL can not specify trust store. Contributed by Wei-Chiu Chuang and Konstantin Shvachko.
(cherry picked from commit 2216bde322961c0fe33b5822510880a65d5c45fd)
2018-03-29 17:22:53 -07:00