Commit Graph

17441 Commits

Author SHA1 Message Date
Rakesh Radhakrishnan afbdd8fdcf HDFS-13328. Abstract ReencryptionHandler recursive logic in separate class. Contributed by Surendra Singh Lilhore.
(cherry picked from commit f89594f0b8)
2018-04-10 23:43:28 +05:30
Inigo Goiri fe7a70e586 Revert "HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun."
This reverts commit 877f963a05.
2018-04-10 10:08:34 -07:00
Weiwei Yang 1a0ce93696 HDFS-13420. License header is displayed in ArchivalStorage/MemoryStorage html pages. Contributed by Akira Ajisaka.
(cherry picked from commit 6729047a8b)
2018-04-10 22:16:25 +08:00
Yiqun Lin d4e438ff63 HDFS-13384. RBF: Improve timeout RPC call mechanism. Contributed by Inigo Goiri.
(cherry picked from commit e87be8a2a4)
2018-04-10 15:38:18 +08:00
Yiqun Lin 0a216c3285 HDFS-13410. RBF: Support federation with no subclusters. Contributed by Inigo Goiri.
(cherry picked from commit a92200f4a6)
2018-04-10 14:34:25 +08:00
Inigo Goiri 877f963a05 HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun.
(cherry picked from commit ac32b3576d)
2018-04-09 09:18:03 -07:00
bibinchundatt 952bb0f371 YARN-7905. Parent directory permission incorrect during public localization. Contributed by Bilwa S T.
(cherry picked from commit eb47c3de74)
2018-04-08 14:57:11 +05:30
Yiqun Lin c3d8eda9bd HDFS-13402. RBF: Fix java doc for StateStoreFileSystemImpl. Contributed by Yiran Wu.
(cherry picked from commit 5700556cd6)
2018-04-08 12:05:32 +08:00
Manoj Govindassamy 218a21a0f0 HADOOP-13055. Implement linkMergeSlash and linkFallback for ViewFileSystem
(cherry picked from commit 133d7ca76e)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/ViewFs.md
2018-04-06 15:19:01 -07:00
Arpit Agarwal 492a597942 HDFS-11968. ViewFS: StoragePolicies commands fail with HDFS federation. Contributed by Mukul Kumar Singh.
(cherry picked from commit b91305119b)
2018-04-06 15:19:01 -07:00
Haibo Chen ca105d1c8e YARN-8107. Give an informative message when incorrect format is used in ATSv2 filter attributes. (Rohith Sharma K S via Haibo Chen)
(cherry picked from commit 024d7c0870)
(cherry picked from commit b232dcab33)
2018-04-06 09:43:06 -07:00
Wei Yan 9638c3fe67 HDFS-13353. RBF: TestRouterWebHDFSContractCreate failed. Contributed by Takanobu Asanuma.
(cherry picked from commit 3121e8c293)
2018-04-05 13:19:05 -07:00
Haibo Chen 9cb378f5c7 YARN-6936. [Atsv2] Retrospect storing entities into sub application table from client perspective. (Rohith Sharma K S via Haibo Chen)
(cherry picked from commit f8b8bd53c4)
(cherry picked from commit 6658018410)
2018-04-05 11:38:44 -07:00
Lei Xu 9fe337096d HDFS-13350. Negative legacy block ID will confuse Erasure Coding to be considered as striped block. (Contributed by Lei (Eddy) Xu).
(cherry picked from commit 1cbf23df145af01692b8aaa438642b64e330cd05)
2018-04-05 09:54:15 -07:00
Yiqun Lin f2d89d7bf9 HDFS-13364. Addendum to fix branch-3.0 compilation. 2018-04-05 09:52:50 +08:00
Yiqun Lin 794ecb0284 HDFS-13364. RBF: Support NamenodeProtocol in the Router. Contributed by Inigo Goiri.
(cherry picked from commit 2be64eb201)
2018-04-03 15:26:02 +08:00
Xiao Chen 973a7b16b9 HADOOP-15355. TestCommonConfigurationFields is broken by HADOOP-15312. Contributed by LiXin Ge.
(cherry picked from commit f614b44fe583033947cc78d8f04cfe6fb64fc892)
2018-04-02 23:10:26 -07:00
Xiao Chen ce37f586f5 HADOOP-15317. Improve NetworkTopology chooseRandom's loop.
(cherry picked from commit 57374c4737)
2018-04-02 22:49:03 -07:00
Steve Loughran a3945e4cf1 HADOOP-14651. Update okhttp version to 2.7.5. Contributed by Ray Chiang and John Zhuge.
(cherry picked from commit 8aca46e53f)
2018-04-02 16:38:19 +01:00
Inigo Goiri 8266696aa3 HDFS-13289. RBF: TestConnectionManager#testCleanup() test case need correction. Contributed by Dibyendu Karmakar.
(cherry picked from commit dc8e343201)
2018-03-31 09:47:06 -07:00
Konstantin V Shvachko 4ba5efa96f HADOOP-15253. Should update maxQueueSize when refresh call queue. Contributed by Tao Jie.
(cherry picked from commit acfd764fcc)
2018-03-30 19:05:01 -07:00
Yiqun Lin 7483acf484
HDFS-13349. Unresolved merge conflict in ViewFs.md
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-03-30 23:28:59 +09:00
Konstantin V Shvachko 3912bdb2b0 HADOOP-12862. LDAP Group Mapping over SSL can not specify trust store. Contributed by Wei-Chiu Chuang and Konstantin Shvachko.
(cherry picked from commit 2216bde322)
2018-03-29 17:22:53 -07:00
Xiao Chen cd74a281a7 HDFS-13087. Snapshotted encryption zone information should be immutable. Contributed by LiXin Ge.
(cherry picked from commit 2c6cfad5a3)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirEncryptionZoneOp.java
2018-03-29 16:07:09 -07:00
Sean Mackrory ca92d1810b HADOOP-15342. Updating ADLS connector to use the current SDK version (2.2.7). Contributed by Atul Sikaria.
(cherry picked from commit 9d7a9031a5)
2018-03-29 14:05:42 -06:00
Arpit Agarwal 198f2bc35e HDFS-13314. NameNode should optionally exit if it detects FsImage corruption. Contributed by Arpit Agarwal. 2018-03-28 12:49:09 -07:00
Zhe Zhang f3b41bb1ad YARN-7623. Fix the CapacityScheduler Queue configuration documentation. Contributed by Jonathan Hung.
(cherry picked from commit 0b1c2b5fe1)
(cherry picked from commit 0db6b8c93c)
2018-03-28 11:43:34 -07:00
Weiwei Yang bedf30e594 YARN-7734. Fix UT failure TestContainerLogsPage#testContainerLogPageAccess. Contributed by Tao Yang. 2018-03-28 17:44:45 +08:00
Yiqun Lin c903efeb51 HDFS-13347. RBF: Cache datanode reports. Contributed by Inigo Goiri.
(cherry picked from commit a71656c1c1)
2018-03-28 11:05:58 +08:00
Wei-Chiu Chuang c6939e9330 HADOOP-15312. Undocumented KeyProvider configuration keys. Contributed by LiXin Ge.
(cherry picked from commit 3fe41c65d8)
(cherry picked from commit 1176a128d6)
2018-03-27 13:37:14 -07:00
Inigo Goiri 7cc06217de HDFS-13352. RBF: Add xsl stylesheet for hdfs-rbf-default.xml. Contributed by Takanobu Asanuma.
(cherry picked from commit 4cef01147f)
2018-03-27 10:32:56 -07:00
Wangda Tan 48778eee52 YARN-8068. Application Priority field causes NPE in app timeline publish when Hadoop 2.7 based clients to 2.8+ (Sunil G via wangda)
Change-Id: I7910bd1064a1b4dbbe2084080c060822ea6f3b48
(cherry picked from commit 9eef19b2ad)
2018-03-26 11:33:33 -07:00
Wangda Tan a465026207 YARN-8062. yarn rmadmin -getGroups returns group from which the user has been removed. (Sunil G via wangda)
Change-Id: I80ed63846502bf7751b890b6c6c6a7c0679e2b4a
(cherry picked from commit 5d381570f8)
2018-03-26 11:33:24 -07:00
Inigo Goiri b8e82a4f66 HDFS-13204. RBF: Optimize name service safe mode icon. Contributed by liuhongtong.
(cherry picked from commit 947b282984)
2018-03-26 09:43:59 -07:00
Yiqun Lin fdcd139c55 HDFS-13291. RBF: Implement available space based OrderResolver. Contributed by Yiqun Lin.
(cherry picked from commit cfc3a1c8f0)
2018-03-26 18:37:40 +08:00
Lei Xu beb98bb419 Update 3.0.1 jdiff file and jdiff stable api version 2018-03-23 11:51:40 -07:00
Lei Xu 7b47400ce0 Update releasenotes and changelogs for 3.0.1 release 2018-03-23 11:51:32 -07:00
Wei Yan f4d6fee96b HDFS-12512. RBF: Add WebHDFS.
(cherry picked from commit 6e31a09084)
2018-03-23 08:55:26 -07:00
Arpit Agarwal 26b08e002f
HDFS-12781. After Datanode down, In Namenode UI Datanode tab is throwing warning message.. Contributed by Brahma Reddy Battula.
(cherry picked from commit 46c93453e9)
2018-03-23 18:12:48 +09:00
Rohith Sharma K S dc02823d2c YARN-7986. ATSv2 REST API queries do not return results for uppercase application tags. Contributed by Charan Hebri.
(cherry picked from commit 75fc05f369)
2018-03-23 12:24:38 +05:30
Sunil G 2f6d6cc0d6 YARN-8063. DistributedShellTimelinePlugin wrongly check for entityId instead of entityType. Contributed by Rohith Sharma K S.
(cherry picked from commit 22c5ddb7c4)
2018-03-23 10:55:46 +05:30
Inigo Goiri 50b6dc9f3e HDFS-12792. RBF: Test Router-based federation using HDFSContract. Contributed by Inigo Goiri.
(cherry picked from commit e196d158a2)
2018-03-22 13:35:24 -07:00
Arpit Agarwal cdf3e758cc HADOOP-15334. Upgrade Maven surefire plugin. Contributed by Arpit Agarwal. 2018-03-22 10:55:30 -07:00
Kihwal Lee 7212c98ba5 HDFS-13195. DataNode conf page cannot display the current value after reconfig. Contributed by maobaolong.
(cherry picked from commit 66461ed98b)
2018-03-22 12:29:21 -05:00
Inigo Goiri 471f758673 HDFS-13318. RBF: Fix FindBugs in hadoop-hdfs-rbf. Contributed by Ekanth S.
(cherry picked from commit 3d0ee8b804)
2018-03-22 09:22:46 -07:00
Konstantin V Shvachko 987d90aa4c HDFS-12884. BlockUnderConstructionFeature.truncateBlock should be of type BlockInfo. Contributed by chencan.
(cherry picked from commit 8d898ab25f)
2018-03-21 17:17:41 -07:00
Jason Lowe 8f60b50f28 YARN-8054. Improve robustness of the LocalDirsHandlerService MonitoringTimerTask thread. Contributed by Jonathan Eagles
(cherry picked from commit 5aa7052e31)
2018-03-21 17:23:01 -05:00
Yiqun Lin e65db99799 HDFS-13250. RBF: Router to manage requests across multiple subclusters. Contributed by Inigo Goiri.
(cherry picked from commit 2caba999bb)
2018-03-21 11:41:14 +08:00
Inigo Goiri 981fda128f HDFS-13268. TestWebHdfsFileContextMainOperations fails on Windows. Contributed by Xiao Liang.
(cherry picked from commit fe224ff972)
2018-03-20 11:21:09 -07:00
weiy 62a819d5ee HDFS-13215. RBF: Move Router to its own module. 2018-03-19 23:15:53 -07:00