Commit Graph

17478 Commits

Author SHA1 Message Date
Robert Kanter 101d9005dd HADOOP-15390. Yarn RM logs flooded by DelegationTokenRenewer trying to renew KMS tokens (xiaochen via rkanter)
(cherry picked from commit 7ab08a9c37)
2018-04-23 15:53:53 -07:00
Lei Xu 463fcfb50a Update CHANGES, RELEASENOTES, and jdiff for 3.0.2 release.
(cherry picked from commit f6ecb76d0b)

Conflicts:
	hadoop-project-dist/pom.xml
2018-04-23 14:17:29 -07:00
Chris Douglas 956ab12ede HDFS-13408. MiniDFSCluster to support being built on randomized base directory. Contributed by Xiao Liang
(cherry picked from commit f411de6a79)
(cherry picked from commit cf272c5179)
2018-04-23 11:15:15 -07:00
Arpit Agarwal e8f62357c0 HDFS-13433. webhdfs requests can be routed incorrectly in federated cluster. Contributed by Arpit Agarwal. 2018-04-23 10:09:16 -07:00
Yiqun Lin 45b11fe359 HDFS-13478. RBF: Disabled Nameservice store API. Contributed by Inigo Goiri.
(cherry picked from commit b6dae26f44)
2018-04-21 14:43:49 +08:00
Sangjin Lee 6becb3de0b
HDFS-10183. Prevent race condition during class initialization. Contributed by Pavel Avgustinov.
(cherry picked from commit f40969a141)
2018-04-20 21:10:39 -07:00
Jason Lowe 4bff2df137 YARN-7786. NullPointerException while launching ApplicationMaster. Contributed by lujie
(cherry picked from commit 766544c0b0)
2018-04-20 13:26:29 -05:00
Inigo Goiri f8330d969d HDFS-13453. RBF: getMountPointDates should fetch latest subdir time/date when parent dir is not present but /parent/child dirs are present in mount table. Contributed by Dibyendu Karmakar.
(cherry picked from commit 1134af9ad1)
2018-04-19 14:57:33 -07:00
Sunil G 070bee57a3 YARN-6827. [ATS1/1.5] NPE exception while publishing recovering applications into ATS during RM restart. Contributed by Rohith Sharma K S.
(cherry picked from commit 7d06806dfd)
2018-04-20 00:07:12 +05:30
Xiao Chen 9f19c3b03e HDFS-13430. Fix TestEncryptionZonesWithKMS failure due to HADOOP-14445.
(cherry picked from commit 6503593711)
2018-04-18 22:35:30 -05:00
Shashikant Banerjee 2c4b1c2b15
HADOOP-15396. Some java source files are executable
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit e4c39f3247)
2018-04-19 08:36:59 +09:00
Erik Krogen 1f8fd96eaf
HDFS-12828. OIV ReverseXML Processor fails with escaped characters
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 2d9e791a90)
2018-04-18 14:40:24 +09:00
Wei Yan 0124c7ffd6 HDFS-13466. RBF: Add more router-related information to the UI.
(cherry picked from commit e4313e7e47)
2018-04-17 15:04:05 -07:00
Inigo Goiri 282bbd56e8 HDFS-13462. Add BIND_HOST configuration for JournalNode's HTTP and RPC Servers. Contributed by Lukas Majercak.
(cherry picked from commit c9b33514b8)
2018-04-17 14:29:20 -07:00
Jason Lowe 391ac5cdd2 YARN-7189. Container-executor doesn't remove Docker containers that error out early. Contributed by Eric Badger 2018-04-17 09:45:55 -05:00
Inigo Goiri 688933e6c7 YARN-8165. Incorrect queue name logging in AbstractContainerAllocator. Contributed by Weiwei Yan.
(cherry picked from commit dd5e18c4ae)
2018-04-17 15:29:39 +05:30
Yiqun Lin 24bdad925e HDFS-13435. RBF: Improve the error loggings for printing the stack trace.
(cherry picked from commit c4d3636c21)
2018-04-17 11:26:13 +08:00
Virajith Jalaparti f06b55bbf1 HDFS-13311. RBF: TestRouterAdminCLI#testCreateInvalidEntry fails on Windows. Contributed by Inigo Goiri 2018-04-16 16:05:17 -07:00
Rohith Sharma K S 7e37979472 YARN-8156. Increase the default value of yarn.timeline-service.app-collector.linger-period.ms. Contributed by Charan Hebri.
(cherry picked from commit 669eb7bdea)
2018-04-14 11:10:16 +05:30
Wei-Chiu Chuang dc01e323ed HDFS-13330. ShortCircuitCache#fetchOrCreate never retries. Contributed by Gabor Bota.
(cherry picked from commit e66e287efe)
(cherry picked from commit ca8bb322be)
2018-04-13 12:20:01 -07:00
Erik Krogen bce57a139b HADOOP-14970. MiniHadoopClusterManager doesn't respect lack of format option. Contributed by Erik Krogen
(cherry picked from commit 1a407bc990)
2018-04-12 23:35:58 -07:00
Akira Ajisaka 64105868e9
HDFS-13436. Fix javadoc of package-info.java
(cherry picked from commit 9b0b9f2af2)
2018-04-13 13:25:19 +09:00
Sammi Chen ce7ebbe2cc HADOOP-14999. AliyunOSS: provide one asynchronous multi-part based uploading mechanism. Contributed by Genmao Yu.
(cherry picked from commit 6542d17ea4)
(cherry picked from commit e96c7bf82d)
2018-04-13 10:17:46 +08:00
Jason Lowe d416a0c9b7 YARN-8027. Setting hostname of docker container breaks for --net=host in docker 1.13. Contributed by Jim Brennan 2018-04-12 16:04:20 -05:00
Lei Xu 3717df89ee Preparing for 3.0.3 development 2018-04-12 13:57:46 -07:00
Eric E Payne 43d2ee9de6 YARN-8147. TestClientRMService#testGetApplications sporadically fails. Contributed by Jason Lowe
(cherry picked from commit 18844599ae)
2018-04-12 18:10:42 +00:00
Eric E Payne 081ea1ec39 YARN-8120. JVM can crash with SIGSEGV when exiting due to custom leveldb logger. Contributed by Jason Lowe.
(cherry picked from commit 6bb128dfb8)
2018-04-12 16:22:48 +00:00
Akira Ajisaka 94daa4f3b3
HDFS-13427. Fix the section titles of transparent encryption document.
(cherry picked from commit c7cd362afd)
2018-04-12 10:46:40 +09:00
Eric Yang f2cf11416c YARN-7810. Update TestDockerContainerRuntime to test with current user credential.
(contributed by Shane Kumpf)

            Cherry-picked from: 59828be197
2018-04-11 20:04:24 -04:00
Inigo Goiri 5fe2b97dd0 HDFS-13386. RBF: Wrong date information in list file(-ls) result. Contributed by Dibyendu Karmakar.
(cherry picked from commit 18de6f2042)
2018-04-11 12:03:57 -07:00
Inigo Goiri 670abc4121 HDFS-13428. RBF: Remove LinkedList From StateStoreFileImpl.java. Contributed by BELUGA BEHR.
(cherry picked from commit 6a881cd842fb4eab596a386b39670ea03536891a)
2018-04-11 10:41:40 -07:00
Wei Yan 8433f6256c HDFS-13045. RBF: Improve error message returned from subcluster. Contributed by Inigo Goiri. 2018-04-11 08:51:47 -07:00
Rohith Sharma K S 7cca3486b7 MAPREDUCE-7062. Update mapreduce.job.tags description for making use for ATSv2 purpose. Contributed by Charan Hebri.
(cherry picked from commit 6cc59a09e7)
2018-04-11 09:49:38 +05:30
Vrushali C ec258b8ed1 YARN-8073 TimelineClientImpl doesn't honor yarn.timeline-service.versions configuration. Contributed by Rohith Sharma K S
(cherry picked from commit 345e7624d5)
2018-04-11 09:49:25 +05:30
Xiao Chen 72acda1449 HADOOP-14445. Delegation tokens are not shared between KMS instances. Contributed by Xiao Chen and Rushabh S Shah.
(cherry picked from commit 583fa6ed48)
2018-04-10 15:45:48 -07:00
Xiao Chen 46edbedd99 HADOOP-15313. TestKMS should close providers.
(cherry picked from commit c22d62b338)
2018-04-10 15:45:47 -07:00
Jason Lowe eef5d1947e HADOOP-15357. Configuration.getPropsWithPrefix no longer does variable substitution. Contributed by Jim Brennan
(cherry picked from commit e81397545a)
2018-04-10 16:54:17 -05:00
Rakesh Radhakrishnan afbdd8fdcf HDFS-13328. Abstract ReencryptionHandler recursive logic in separate class. Contributed by Surendra Singh Lilhore.
(cherry picked from commit f89594f0b8)
2018-04-10 23:43:28 +05:30
Inigo Goiri fe7a70e586 Revert "HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun."
This reverts commit 877f963a05.
2018-04-10 10:08:34 -07:00
Weiwei Yang 1a0ce93696 HDFS-13420. License header is displayed in ArchivalStorage/MemoryStorage html pages. Contributed by Akira Ajisaka.
(cherry picked from commit 6729047a8b)
2018-04-10 22:16:25 +08:00
Yiqun Lin d4e438ff63 HDFS-13384. RBF: Improve timeout RPC call mechanism. Contributed by Inigo Goiri.
(cherry picked from commit e87be8a2a4)
2018-04-10 15:38:18 +08:00
Yiqun Lin 0a216c3285 HDFS-13410. RBF: Support federation with no subclusters. Contributed by Inigo Goiri.
(cherry picked from commit a92200f4a6)
2018-04-10 14:34:25 +08:00
Inigo Goiri 877f963a05 HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun.
(cherry picked from commit ac32b3576d)
2018-04-09 09:18:03 -07:00
bibinchundatt 952bb0f371 YARN-7905. Parent directory permission incorrect during public localization. Contributed by Bilwa S T.
(cherry picked from commit eb47c3de74)
2018-04-08 14:57:11 +05:30
Yiqun Lin c3d8eda9bd HDFS-13402. RBF: Fix java doc for StateStoreFileSystemImpl. Contributed by Yiran Wu.
(cherry picked from commit 5700556cd6)
2018-04-08 12:05:32 +08:00
Manoj Govindassamy 218a21a0f0 HADOOP-13055. Implement linkMergeSlash and linkFallback for ViewFileSystem
(cherry picked from commit 133d7ca76e)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/ViewFs.md
2018-04-06 15:19:01 -07:00
Arpit Agarwal 492a597942 HDFS-11968. ViewFS: StoragePolicies commands fail with HDFS federation. Contributed by Mukul Kumar Singh.
(cherry picked from commit b91305119b)
2018-04-06 15:19:01 -07:00
Haibo Chen ca105d1c8e YARN-8107. Give an informative message when incorrect format is used in ATSv2 filter attributes. (Rohith Sharma K S via Haibo Chen)
(cherry picked from commit 024d7c0870)
(cherry picked from commit b232dcab33)
2018-04-06 09:43:06 -07:00
Wei Yan 9638c3fe67 HDFS-13353. RBF: TestRouterWebHDFSContractCreate failed. Contributed by Takanobu Asanuma.
(cherry picked from commit 3121e8c293)
2018-04-05 13:19:05 -07:00
Haibo Chen 9cb378f5c7 YARN-6936. [Atsv2] Retrospect storing entities into sub application table from client perspective. (Rohith Sharma K S via Haibo Chen)
(cherry picked from commit f8b8bd53c4)
(cherry picked from commit 6658018410)
2018-04-05 11:38:44 -07:00