Commit Graph

18112 Commits

Author SHA1 Message Date
Jason Lowe ffceb907fe HADOOP-15357. Configuration.getPropsWithPrefix no longer does variable substitution. Contributed by Jim Brennan
(cherry picked from commit e81397545a)
2018-04-10 16:49:27 -05:00
Rakesh Radhakrishnan 3414bf6dbb HDFS-13328. Abstract ReencryptionHandler recursive logic in separate class. Contributed by Surendra Singh Lilhore.
(cherry picked from commit f89594f0b8)
2018-04-10 23:40:26 +05:30
Ewan Higgs c9da1e97f8
HADOOP-15376. Remove double semi colons on imports that make Clover fall over.
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit cef8eb7981)
2018-04-10 23:59:34 +09:00
Weiwei Yang b104de3f64 HDFS-13420. License header is displayed in ArchivalStorage/MemoryStorage html pages. Contributed by Akira Ajisaka. 2018-04-10 22:13:08 +08:00
Sunil G 5387b3f066 YARN-7804. [UI2] Refresh action on Grid view page should not be redirected to graph view. Contributed by Gergely Novák.
(cherry picked from commit 7c1e77dda4)
2018-04-10 16:09:49 +05:30
Takanobu Asanuma 77cca3befc
HADOOP-15374. Add links of the new features of 3.1.0 to the top page
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 7623cc5a98)
2018-04-10 19:01:18 +09:00
Yiqun Lin 5eb32396d7 HDFS-13384. RBF: Improve timeout RPC call mechanism. Contributed by Inigo Goiri.
(cherry picked from commit e87be8a2a4)
2018-04-10 15:36:48 +08:00
Yiqun Lin 9a86cb0494 HDFS-13410. RBF: Support federation with no subclusters. Contributed by Inigo Goiri.
(cherry picked from commit a92200f4a6)
2018-04-10 14:31:59 +08:00
Wangda Tan 25bf1d3ac6 Updated branch-3.1 to track 3.1.1
Change-Id: Idd55c79921b8acacc8a8a3258450e476f3abb706
2018-04-09 10:58:50 -07:00
Inigo Goiri 1c9038bae5 HDFS-13380. RBF: mv/rm fail after the directory exceeded the quota limit. Contributed by Yiqun Lin.
(cherry picked from commit e9b9f48dad)
2018-04-09 10:09:55 -07:00
Inigo Goiri 8c9dab978e HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun.
(cherry picked from commit ac32b3576d)
2018-04-09 09:17:35 -07:00
Sunil G 8311fcc75b YARN-7574. Add support for Node Labels on Auto Created Leaf Queue Template. Contributed by Suma Shivaprasad.
(cherry picked from commit 821b0de4c5)
2018-04-09 21:17:56 +05:30
bibinchundatt 091db4d0eb YARN-7905. Parent directory permission incorrect during public localization. Contributed by Bilwa S T.
(cherry picked from commit eb47c3de74)
2018-04-08 14:49:36 +05:30
Yiqun Lin ac5703207d HDFS-13402. RBF: Fix java doc for StateStoreFileSystemImpl. Contributed by Yiran Wu.
(cherry picked from commit 5700556cd6)
2018-04-08 12:03:35 +08:00
Subru Krishnan b9bad94596 YARN-8110. AMRMProxy recover should catch for all throwable to avoid premature exit. (Botong Huang via Subru).
(cherry picked from commit 00905efab2)
2018-04-06 16:35:29 -07:00
Haibo Chen b232dcab33 YARN-8107. Give an informative message when incorrect format is used in ATSv2 filter attributes. (Rohith Sharma K S via Haibo Chen)
(cherry picked from commit 024d7c0870)
2018-04-06 09:39:45 -07:00
Sunil G 58a5ee378a YARN-8083. [UI2] All YARN related configurations are paged together in conf page. Contributed by Gergely Novák.
(cherry picked from commit b17dc9f5f5)
2018-04-06 21:53:49 +05:30
Wangda Tan a336561e2b Added CHANGES/RELEASES/Jdiff for 3.1.0 release
Change-Id: Ied5067a996151c04d15cad46c46ac98b60c37b39
(cherry picked from commit 2d96570452a72569befdf9cfe9b90c9fa2e0e261)
2018-04-05 15:52:02 -07:00
Wei Yan 89efe30f65 HDFS-13353. RBF: TestRouterWebHDFSContractCreate failed. Contributed by Takanobu Asanuma.
(cherry picked from commit 3121e8c293)
2018-04-05 13:13:16 -07:00
Haibo Chen 6658018410 YARN-6936. [Atsv2] Retrospect storing entities into sub application table from client perspective. (Rohith Sharma K S via Haibo Chen)
(cherry picked from commit f8b8bd53c4)
2018-04-05 11:31:17 -07:00
Rohith Sharma K S b11c228660 YARN-8119. [UI2] Timeline Server address' url scheme should be removed while accessing via KNOX. Contributed by Sunil G.
(cherry picked from commit f32d6275ba)
2018-04-05 23:34:40 +05:30
Lei Xu 2543a9dd77 HDFS-13350. Negative legacy block ID will confuse Erasure Coding to be considered as striped block. (Contributed by Lei (Eddy) Xu).
(cherry picked from commit 1cbf23df145af01692b8aaa438642b64e330cd05)
2018-04-05 10:01:05 -07:00
Konstantinos Karanasos fa464c12ad YARN-8013. Support application tags when defining application namespaces for placement constraints. Contributed by Weiwei Yang.
(cherry picked from commit 7853ec8d2f)
2018-04-04 10:53:33 -07:00
Sunil G 4db13cb944 YARN-8115. [UI2] URL data like nodeHTTPAddress must be encoded in UI before using to access NM. Contributed by Sreenath Somarajapuram.
(cherry picked from commit 42cd367c93)
2018-04-04 22:24:31 +05:30
Wangda Tan 2f326159f1 YARN-8106. Update LogAggregationIndexedFileController to use readFull instead read to avoid IOException while loading log meta. (Prabhu Joseph via wangda)
Change-Id: I63a65f73f8d1636e2c99ed9c8c2bbd05efcff80f
(cherry picked from commit b779f4f0f6)
2018-04-03 21:15:37 -07:00
Sunil G 1a125dd92f YARN-7764. Findbugs warning: Resource#getResources may expose internal representation. Contributed by Weiwei Yang.
(cherry picked from commit f7a17b029d)
2018-04-04 09:23:39 +05:30
Wangda Tan 78832eca8a YARN-8002. Support NOT_SELF and ALL namespace types for allocation tag. (Weiwei Yang via wangda)
Change-Id: I63b4e4192a95bf7ded98c54e46a2871c72869700
2018-04-04 09:42:49 +08:00
Yiqun Lin b89dc00302 HDFS-13364. RBF: Support NamenodeProtocol in the Router. Contributed by Inigo Goiri.
(cherry picked from commit 2be64eb201)
2018-04-03 15:23:39 +08:00
Xiao Chen 8d755371f2 HADOOP-15355. TestCommonConfigurationFields is broken by HADOOP-15312. Contributed by LiXin Ge.
(cherry picked from commit f614b44fe583033947cc78d8f04cfe6fb64fc892)
2018-04-02 23:10:17 -07:00
Xiao Chen dcb2176c5d HADOOP-15317. Improve NetworkTopology chooseRandom's loop.
(cherry picked from commit 57374c4737)
2018-04-02 22:48:54 -07:00
Inigo Goiri 3c9983547c HDFS-13289. RBF: TestConnectionManager#testCleanup() test case need correction. Contributed by Dibyendu Karmakar.
(cherry picked from commit dc8e343201)
2018-03-31 09:46:44 -07:00
Konstantin V Shvachko 4ce45a8ec7 HADOOP-15253. Should update maxQueueSize when refresh call queue. Contributed by Tao Jie.
(cherry picked from commit acfd764fcc)
2018-03-30 18:57:18 -07:00
Sammi Chen e96c7bf82d HADOOP-14999. AliyunOSS: provide one asynchronous multi-part based uploading mechanism. Contributed by Genmao Yu.
(cherry picked from commit 6542d17ea4)
2018-03-30 20:26:35 +08:00
Konstantin V Shvachko 99b5b9dce1 HADOOP-12862. LDAP Group Mapping over SSL can not specify trust store. Contributed by Wei-Chiu Chuang and Konstantin Shvachko.
(cherry picked from commit 2216bde322)
2018-03-29 17:20:28 -07:00
Xiao Chen 2960592c6f HDFS-13087. Snapshotted encryption zone information should be immutable. Contributed by LiXin Ge.
(cherry picked from commit 2c6cfad5a3)
2018-03-29 16:07:01 -07:00
Wangda Tan b64bf56131 YARN-8086. ManagedParentQueue with no leaf queues cause JS error in new UI. (Suma Shivaprasad via wangda)
Change-Id: I6d82af91adec02698afddde6883b1fe1924e6041
(cherry picked from commit e7e20190df)
2018-03-29 15:19:31 -07:00
Sean Mackrory b038e21440 HADOOP-15342. Updating ADLS connector to use the current SDK version (2.2.7). Contributed by Atul Sikaria.
(cherry picked from commit 9d7a9031a5)
2018-03-29 14:04:55 -06:00
Sunil G 73cd67d7e3 YARN-8085. ResourceProfilesManager should be set in RMActiveServiceContext. Contributed by Tao Yang.
(cherry picked from commit 7a59d60e0c)
2018-03-29 21:41:52 +05:30
Sunil G 04161bad78 YARN-8076. Support to specify application tags in distributed shell. Contributed by Weiwei Yang.
(cherry picked from commit 431076f637)
2018-03-29 16:02:49 +05:30
Eric Yang 570d7f3072 YARN-8069. Clean up example hostnames for RegistryDNS.
Contributed by Billie Rinaldi

(cherry picked from commit 3d185d62fc)
2018-03-28 20:20:06 -04:00
Arpit Agarwal d54e19a913 HDFS-13314. NameNode should optionally exit if it detects FsImage corruption. Contributed by Arpit Agarwal. 2018-03-28 12:49:14 -07:00
Chris Douglas ac16e8f4d3 HADOOP-15320. Remove customized getFileBlockLocations for hadoop-azure and hadoop-azure-datalake. Contributed by Shanyu Zhao
(cherry picked from commit 081c350188)
2018-03-28 11:59:08 -07:00
Zhe Zhang 0db6b8c93c YARN-7623. Fix the CapacityScheduler Queue configuration documentation. Contributed by Jonathan Hung.
(cherry picked from commit 0b1c2b5fe1)
2018-03-28 11:42:16 -07:00
Subru Krishnan a0091ec4b3 YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru).
(cherry picked from commit 09999d7e01)
2018-03-28 11:35:45 -07:00
Subru Krishnan ed49f59e18 Revert "YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru)."
This reverts commit 85eebf1beb.
2018-03-28 11:35:30 -07:00
Wangda Tan a2b4daab55 YARN-6629. NPE occurred when container allocation proposal is applied but its resource requests are removed before. (Tao Yang via wangda)
Change-Id: I805880f90b3f6798ec96ed8e8e75755f390a9ad5
(cherry picked from commit 47f711eebc)
2018-03-28 11:22:26 -07:00
Yiqun Lin 99766992e6 HDFS-13347. RBF: Cache datanode reports. Contributed by Inigo Goiri.
(cherry picked from commit a71656c1c1)
2018-03-28 11:04:36 +08:00
Sunil G 6c904388f4 YARN-8075. DShell does not fail when we ask more GPUs than available even though AM throws 'InvalidResourceRequestException'. Contributed by Wangda Tan.
(cherry picked from commit d1e378d02b)
2018-03-28 08:03:59 +05:30
Subru Krishnan 85eebf1beb YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru).
(cherry picked from commit 2a2ef15caf)
2018-03-27 17:44:00 -07:00
Wei-Chiu Chuang 1176a128d6 HADOOP-15312. Undocumented KeyProvider configuration keys. Contributed by LiXin Ge.
(cherry picked from commit 3fe41c65d8)
2018-03-27 13:36:00 -07:00