Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,681 Commits 326 Branches 371 Tags
Commit Graph

17681 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Junping Du
51194439ba YARN-7598. Document how to use classpath isolation for aux-services in YARN. Contributed by Xuan Gong. 
(cherry picked from commit 56788d759f47b4b158617701f543a9dcb4df69cd)
 2018-04-24 18:30:26 +08:00
Yiqun Lin
14cfcf6b71 HDFS-13490. RBF: Fix setSafeMode in the Router. Contributed by Inigo Goiri. 
(cherry picked from commit b06601acce38ed60b726b99e2830f38a1ee3d2b5)
 2018-04-24 11:28:06 +08:00
Inigo Goiri
7bb2709c4a HDFS-13336. Test cases of TestWriteToReplica failed in windows. Contributed by Xiao Liang. 
(cherry picked from commit df92a17e02fe86279a6f4e413719d0a465b50837)
 2018-04-23 19:13:25 -07:00
Robert Kanter
101d9005dd HADOOP-15390. Yarn RM logs flooded by DelegationTokenRenewer trying to renew KMS tokens (xiaochen via rkanter) 
(cherry picked from commit 7ab08a9c37a76edbe02d556fcfb2e637f45afc21)
 2018-04-23 15:53:53 -07:00
Lei Xu
463fcfb50a Update CHANGES, RELEASENOTES, and jdiff for 3.0.2 release. 
(cherry picked from commit f6ecb76d0b919b9836600fe28ec9e637b223cd54)

Conflicts:
	hadoop-project-dist/pom.xml
 2018-04-23 14:17:29 -07:00
Chris Douglas
956ab12ede HDFS-13408. MiniDFSCluster to support being built on randomized base directory. Contributed by Xiao Liang 
(cherry picked from commit f411de6a79a0a87f03c09366cfe7a7d0726ed932)
(cherry picked from commit cf272c5179a9cb4b524016c0fca7c69c9eaa92f1)
 2018-04-23 11:15:15 -07:00
Arpit Agarwal
e8f62357c0 HDFS-13433. webhdfs requests can be routed incorrectly in federated cluster. Contributed by Arpit Agarwal. 2018-04-23 10:09:16 -07:00
Yiqun Lin
45b11fe359 HDFS-13478. RBF: Disabled Nameservice store API. Contributed by Inigo Goiri. 
(cherry picked from commit b6dae26f4490bbd03360b8df19ef00cf843430f3)
 2018-04-21 14:43:49 +08:00
Sangjin Lee
6becb3de0b
HDFS-10183. Prevent race condition during class initialization. Contributed by Pavel Avgustinov. 
(cherry picked from commit f40969a141ec6aff254c41e4185cc61ea9e4e554)
 2018-04-20 21:10:39 -07:00
Jason Lowe
4bff2df137 YARN-7786. NullPointerException while launching ApplicationMaster. Contributed by lujie 
(cherry picked from commit 766544c0b008da9e78bcea6285b2c478653df75a)
 2018-04-20 13:26:29 -05:00
Inigo Goiri
f8330d969d HDFS-13453. RBF: getMountPointDates should fetch latest subdir time/date when parent dir is not present but /parent/child dirs are present in mount table. Contributed by Dibyendu Karmakar. 
(cherry picked from commit 1134af9ad1daf683204df8f95a8f03d7baaa74d4)
 2018-04-19 14:57:33 -07:00
Sunil G
070bee57a3 YARN-6827. [ATS1/1.5] NPE exception while publishing recovering applications into ATS during RM restart. Contributed by Rohith Sharma K S. 
(cherry picked from commit 7d06806dfdeb3252ac0defe23e8c468eabfa8b5e)
 2018-04-20 00:07:12 +05:30
Xiao Chen
9f19c3b03e HDFS-13430. Fix TestEncryptionZonesWithKMS failure due to HADOOP-14445. 
(cherry picked from commit 650359371175fba416331e73aa03d2a96ccb90e5)
 2018-04-18 22:35:30 -05:00
Shashikant Banerjee
2c4b1c2b15
HADOOP-15396. Some java source files are executable 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit e4c39f3247da77d03c6015de4f18be75924fcb22)
 2018-04-19 08:36:59 +09:00
Erik Krogen
1f8fd96eaf
HDFS-12828. OIV ReverseXML Processor fails with escaped characters 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 2d9e791a9073de9f65fef5407efd3a42894bc97f)
 2018-04-18 14:40:24 +09:00
Wei Yan
0124c7ffd6 HDFS-13466. RBF: Add more router-related information to the UI. 
(cherry picked from commit e4313e7e4725261b652dd7202048ff2373b05e28)
 2018-04-17 15:04:05 -07:00
Inigo Goiri
282bbd56e8 HDFS-13462. Add BIND_HOST configuration for JournalNode's HTTP and RPC Servers. Contributed by Lukas Majercak. 
(cherry picked from commit c9b33514b8d11db44b5f95b4df43789ed45c47a7)
 2018-04-17 14:29:20 -07:00
Jason Lowe
391ac5cdd2 YARN-7189. Container-executor doesn't remove Docker containers that error out early. Contributed by Eric Badger 2018-04-17 09:45:55 -05:00
Inigo Goiri
688933e6c7 YARN-8165. Incorrect queue name logging in AbstractContainerAllocator. Contributed by Weiwei Yan. 
(cherry picked from commit dd5e18c4aecba56f140c3cc11affc2cb5e61c79d)
 2018-04-17 15:29:39 +05:30
Yiqun Lin
24bdad925e HDFS-13435. RBF: Improve the error loggings for printing the stack trace. 
(cherry picked from commit c4d3636c21acaeb2b7d56d19cd4996aa25151bd1)
 2018-04-17 11:26:13 +08:00
Virajith Jalaparti
f06b55bbf1 HDFS-13311. RBF: TestRouterAdminCLI#testCreateInvalidEntry fails on Windows. Contributed by Inigo Goiri 2018-04-16 16:05:17 -07:00
Rohith Sharma K S
7e37979472 YARN-8156. Increase the default value of yarn.timeline-service.app-collector.linger-period.ms. Contributed by Charan Hebri. 
(cherry picked from commit 669eb7bdea34f26e9b9b8a2260ae4356791622e7)
 2018-04-14 11:10:16 +05:30
Wei-Chiu Chuang
dc01e323ed HDFS-13330. ShortCircuitCache#fetchOrCreate never retries. Contributed by Gabor Bota. 
(cherry picked from commit e66e287efe2b43e710137a628f03c7df3ebdf498)
(cherry picked from commit ca8bb322be5e21ce00bb49cecfc4f515b49d2a37)
 2018-04-13 12:20:01 -07:00
Erik Krogen
bce57a139b HADOOP-14970. MiniHadoopClusterManager doesn't respect lack of format option. Contributed by Erik Krogen 
(cherry picked from commit 1a407bc9906306801690bc75ff0f0456f8f265fd)
 2018-04-12 23:35:58 -07:00
Akira Ajisaka
64105868e9
HDFS-13436. Fix javadoc of package-info.java 
(cherry picked from commit 9b0b9f2af2f6827d7430f995d3203c4cb7ef7e48)
 2018-04-13 13:25:19 +09:00
Sammi Chen
ce7ebbe2cc HADOOP-14999. AliyunOSS: provide one asynchronous multi-part based uploading mechanism. Contributed by Genmao Yu. 
(cherry picked from commit 6542d17ea460ec222137c4b275b13daf15d3fca3)
(cherry picked from commit e96c7bf82de1e9fd97df5fb6b763e211ebad5913)
 2018-04-13 10:17:46 +08:00
Jason Lowe
d416a0c9b7 YARN-8027. Setting hostname of docker container breaks for --net=host in docker 1.13. Contributed by Jim Brennan 2018-04-12 16:04:20 -05:00
Lei Xu
3717df89ee Preparing for 3.0.3 development 2018-04-12 13:57:46 -07:00
Eric E Payne
43d2ee9de6 YARN-8147. TestClientRMService#testGetApplications sporadically fails. Contributed by Jason Lowe 
(cherry picked from commit 18844599aef42f79d2af4500aa2eee472dda95cb)
 2018-04-12 18:10:42 +00:00
Eric E Payne
081ea1ec39 YARN-8120. JVM can crash with SIGSEGV when exiting due to custom leveldb logger. Contributed by Jason Lowe. 
(cherry picked from commit 6bb128dfb893cf0e4aa2d3ecc65440668a1fc8d7)
 2018-04-12 16:22:48 +00:00
Akira Ajisaka
94daa4f3b3
HDFS-13427. Fix the section titles of transparent encryption document. 
(cherry picked from commit c7cd362afd21add324c3a82c594b133d41cf8d03)
 2018-04-12 10:46:40 +09:00
Eric Yang
f2cf11416c YARN-7810. Update TestDockerContainerRuntime to test with current user credential. 
(contributed by Shane Kumpf)

            Cherry-picked from: 59828be1978ec942dda38774a1d9f741efa96f71
 2018-04-11 20:04:24 -04:00
Inigo Goiri
5fe2b97dd0 HDFS-13386. RBF: Wrong date information in list file(-ls) result. Contributed by Dibyendu Karmakar. 
(cherry picked from commit 18de6f2042b70f9f0d7a2620c60de022768a7b13)
 2018-04-11 12:03:57 -07:00
Inigo Goiri
670abc4121 HDFS-13428. RBF: Remove LinkedList From StateStoreFileImpl.java. Contributed by BELUGA BEHR. 
(cherry picked from commit 6a881cd842fb4eab596a386b39670ea03536891a)
 2018-04-11 10:41:40 -07:00
Wei Yan
8433f6256c HDFS-13045. RBF: Improve error message returned from subcluster. Contributed by Inigo Goiri. 2018-04-11 08:51:47 -07:00
Rohith Sharma K S
7cca3486b7 MAPREDUCE-7062. Update mapreduce.job.tags description for making use for ATSv2 purpose. Contributed by Charan Hebri. 
(cherry picked from commit 6cc59a09e7330dc893b386d84c8f2aa86c02eace)
 2018-04-11 09:49:38 +05:30
Vrushali C
ec258b8ed1 YARN-8073 TimelineClientImpl doesn't honor yarn.timeline-service.versions configuration. Contributed by Rohith Sharma K S 
(cherry picked from commit 345e7624d58a058a1bad666bd1e5ce4b346a9056)
 2018-04-11 09:49:25 +05:30
Xiao Chen
72acda1449 HADOOP-14445. Delegation tokens are not shared between KMS instances. Contributed by Xiao Chen and Rushabh S Shah. 
(cherry picked from commit 583fa6ed48ad3df40bcaa9c591d5ccd07ce3ea81)
 2018-04-10 15:45:48 -07:00
Xiao Chen
46edbedd99 HADOOP-15313. TestKMS should close providers. 
(cherry picked from commit c22d62b338cb16d93c4576a9c634041e3610a116)
 2018-04-10 15:45:47 -07:00
Jason Lowe
eef5d1947e HADOOP-15357. Configuration.getPropsWithPrefix no longer does variable substitution. Contributed by Jim Brennan 
(cherry picked from commit e81397545a273cf9a090010eb644b836e0ef8c7b)
 2018-04-10 16:54:17 -05:00
Rakesh Radhakrishnan
afbdd8fdcf HDFS-13328. Abstract ReencryptionHandler recursive logic in separate class. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit f89594f0b80e8efffdcb887daa4a18a2b0a228b3)
 2018-04-10 23:43:28 +05:30
Inigo Goiri
fe7a70e586 Revert "HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun." 
This reverts commit 877f963a059d21e942b0b5cbff5f60ce23c5b5fe.
 2018-04-10 10:08:34 -07:00
Weiwei Yang
1a0ce93696 HDFS-13420. License header is displayed in ArchivalStorage/MemoryStorage html pages. Contributed by Akira Ajisaka. 
(cherry picked from commit 6729047a8ba273d27edcc6a1a9d397a096f44d84)
 2018-04-10 22:16:25 +08:00
Yiqun Lin
d4e438ff63 HDFS-13384. RBF: Improve timeout RPC call mechanism. Contributed by Inigo Goiri. 
(cherry picked from commit e87be8a2a49573897e40bfdf43541e3635e35c98)
 2018-04-10 15:38:18 +08:00
Yiqun Lin
0a216c3285 HDFS-13410. RBF: Support federation with no subclusters. Contributed by Inigo Goiri. 
(cherry picked from commit a92200f4a6cec57b7080d1cd6e2a20d79d772dd6)
 2018-04-10 14:34:25 +08:00
Inigo Goiri
877f963a05 HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun. 
(cherry picked from commit ac32b3576da4cc463dff85118163ccfff02215fc)
 2018-04-09 09:18:03 -07:00
bibinchundatt
952bb0f371 YARN-7905. Parent directory permission incorrect during public localization. Contributed by Bilwa S T. 
(cherry picked from commit eb47c3de74ba4b8b3ef47eaf3a44e5562fd22fc9)
 2018-04-08 14:57:11 +05:30
Yiqun Lin
c3d8eda9bd HDFS-13402. RBF: Fix java doc for StateStoreFileSystemImpl. Contributed by Yiran Wu. 
(cherry picked from commit 5700556cd65a558f4393e05acb7ea8db3ccd2f36)
 2018-04-08 12:05:32 +08:00
Manoj Govindassamy
218a21a0f0 HADOOP-13055. Implement linkMergeSlash and linkFallback for ViewFileSystem 
(cherry picked from commit 133d7ca76e3d4b60292d57429d4259e80bec650a)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/ViewFs.md
 2018-04-06 15:19:01 -07:00
Arpit Agarwal
492a597942 HDFS-11968. ViewFS: StoragePolicies commands fail with HDFS federation. Contributed by Mukul Kumar Singh. 
(cherry picked from commit b91305119b434d23b99ae7e755aea6639f48b6ab)
 2018-04-06 15:19:01 -07:00