Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,109 Commits 326 Branches 371 Tags
Commit Graph

18109 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Weiwei Yang
b104de3f64 HDFS-13420. License header is displayed in ArchivalStorage/MemoryStorage html pages. Contributed by Akira Ajisaka. 2018-04-10 22:13:08 +08:00
Sunil G
5387b3f066 YARN-7804. [UI2] Refresh action on Grid view page should not be redirected to graph view. Contributed by Gergely Novák. 
(cherry picked from commit 7c1e77dda4cb3ba8952328d142aafcf0366b5903)
 2018-04-10 16:09:49 +05:30
Takanobu Asanuma
77cca3befc
HADOOP-15374. Add links of the new features of 3.1.0 to the top page 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 7623cc5a982219fff2bdd9a84650f45106cbdf47)
 2018-04-10 19:01:18 +09:00
Yiqun Lin
5eb32396d7 HDFS-13384. RBF: Improve timeout RPC call mechanism. Contributed by Inigo Goiri. 
(cherry picked from commit e87be8a2a49573897e40bfdf43541e3635e35c98)
 2018-04-10 15:36:48 +08:00
Yiqun Lin
9a86cb0494 HDFS-13410. RBF: Support federation with no subclusters. Contributed by Inigo Goiri. 
(cherry picked from commit a92200f4a6cec57b7080d1cd6e2a20d79d772dd6)
 2018-04-10 14:31:59 +08:00
Wangda Tan
25bf1d3ac6 Updated branch-3.1 to track 3.1.1 
Change-Id: Idd55c79921b8acacc8a8a3258450e476f3abb706
 2018-04-09 10:58:50 -07:00
Inigo Goiri
1c9038bae5 HDFS-13380. RBF: mv/rm fail after the directory exceeded the quota limit. Contributed by Yiqun Lin. 
(cherry picked from commit e9b9f48dad5ebb58ee529f918723089e8356c480)
 2018-04-09 10:09:55 -07:00
Inigo Goiri
8c9dab978e HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun. 
(cherry picked from commit ac32b3576da4cc463dff85118163ccfff02215fc)
 2018-04-09 09:17:35 -07:00
Sunil G
8311fcc75b YARN-7574. Add support for Node Labels on Auto Created Leaf Queue Template. Contributed by Suma Shivaprasad. 
(cherry picked from commit 821b0de4c59156d4a65112de03ba3e7e1c88e309)
 2018-04-09 21:17:56 +05:30
bibinchundatt
091db4d0eb YARN-7905. Parent directory permission incorrect during public localization. Contributed by Bilwa S T. 
(cherry picked from commit eb47c3de74ba4b8b3ef47eaf3a44e5562fd22fc9)
 2018-04-08 14:49:36 +05:30
Yiqun Lin
ac5703207d HDFS-13402. RBF: Fix java doc for StateStoreFileSystemImpl. Contributed by Yiran Wu. 
(cherry picked from commit 5700556cd65a558f4393e05acb7ea8db3ccd2f36)
 2018-04-08 12:03:35 +08:00
Subru Krishnan
b9bad94596 YARN-8110. AMRMProxy recover should catch for all throwable to avoid premature exit. (Botong Huang via Subru). 
(cherry picked from commit 00905efab22edd9857e0a3828c201bf70f03cb96)
 2018-04-06 16:35:29 -07:00
Haibo Chen
b232dcab33 YARN-8107. Give an informative message when incorrect format is used in ATSv2 filter attributes. (Rohith Sharma K S via Haibo Chen) 
(cherry picked from commit 024d7c08704e6a5fcc1f53a8f56a44c84c8d5fa0)
 2018-04-06 09:39:45 -07:00
Sunil G
58a5ee378a YARN-8083. [UI2] All YARN related configurations are paged together in conf page. Contributed by Gergely Novák. 
(cherry picked from commit b17dc9f5f54fd91defc1d8646f8229da5fe7ccbb)
 2018-04-06 21:53:49 +05:30
Wangda Tan
a336561e2b Added CHANGES/RELEASES/Jdiff for 3.1.0 release 
Change-Id: Ied5067a996151c04d15cad46c46ac98b60c37b39
(cherry picked from commit 2d96570452a72569befdf9cfe9b90c9fa2e0e261)
 2018-04-05 15:52:02 -07:00
Wei Yan
89efe30f65 HDFS-13353. RBF: TestRouterWebHDFSContractCreate failed. Contributed by Takanobu Asanuma. 
(cherry picked from commit 3121e8c29361cb560df29188e1cd1061a5fc34c4)
 2018-04-05 13:13:16 -07:00
Haibo Chen
6658018410 YARN-6936. [Atsv2] Retrospect storing entities into sub application table from client perspective. (Rohith Sharma K S via Haibo Chen) 
(cherry picked from commit f8b8bd53c4797d406bea5b1b0cdb179e209169cc)
 2018-04-05 11:31:17 -07:00
Rohith Sharma K S
b11c228660 YARN-8119. [UI2] Timeline Server address' url scheme should be removed while accessing via KNOX. Contributed by Sunil G. 
(cherry picked from commit f32d6275ba9e377fb722e2440986033d7ce8b602)
 2018-04-05 23:34:40 +05:30
Lei Xu
2543a9dd77 HDFS-13350. Negative legacy block ID will confuse Erasure Coding to be considered as striped block. (Contributed by Lei (Eddy) Xu). 
(cherry picked from commit 1cbf23df145af01692b8aaa438642b64e330cd05)
 2018-04-05 10:01:05 -07:00
Konstantinos Karanasos
fa464c12ad YARN-8013. Support application tags when defining application namespaces for placement constraints. Contributed by Weiwei Yang. 
(cherry picked from commit 7853ec8d2fb8731b7f7c28fd87491a0a2d47967e)
 2018-04-04 10:53:33 -07:00
Sunil G
4db13cb944 YARN-8115. [UI2] URL data like nodeHTTPAddress must be encoded in UI before using to access NM. Contributed by Sreenath Somarajapuram. 
(cherry picked from commit 42cd367c9308b944bc71de6c07b6c3f028a0d874)
 2018-04-04 22:24:31 +05:30
Wangda Tan
2f326159f1 YARN-8106. Update LogAggregationIndexedFileController to use readFull instead read to avoid IOException while loading log meta. (Prabhu Joseph via wangda) 
Change-Id: I63a65f73f8d1636e2c99ed9c8c2bbd05efcff80f
(cherry picked from commit b779f4f0f614fe47e05bc2be5494cf3cbcf6f63c)
 2018-04-03 21:15:37 -07:00
Sunil G
1a125dd92f YARN-7764. Findbugs warning: Resource#getResources may expose internal representation. Contributed by Weiwei Yang. 
(cherry picked from commit f7a17b029ddd61ca73c2c2c88f5451dbf05fc501)
 2018-04-04 09:23:39 +05:30
Wangda Tan
78832eca8a YARN-8002. Support NOT_SELF and ALL namespace types for allocation tag. (Weiwei Yang via wangda) 
Change-Id: I63b4e4192a95bf7ded98c54e46a2871c72869700
 2018-04-04 09:42:49 +08:00
Yiqun Lin
b89dc00302 HDFS-13364. RBF: Support NamenodeProtocol in the Router. Contributed by Inigo Goiri. 
(cherry picked from commit 2be64eb201134502a92f7239bef8aa780771ca0b)
 2018-04-03 15:23:39 +08:00
Xiao Chen
8d755371f2 HADOOP-15355. TestCommonConfigurationFields is broken by HADOOP-15312. Contributed by LiXin Ge. 
(cherry picked from commit f614b44fe583033947cc78d8f04cfe6fb64fc892)
 2018-04-02 23:10:17 -07:00
Xiao Chen
dcb2176c5d HADOOP-15317. Improve NetworkTopology chooseRandom's loop. 
(cherry picked from commit 57374c4737ab0fccf52dae3cea911fc6bd90e1b7)
 2018-04-02 22:48:54 -07:00
Inigo Goiri
3c9983547c HDFS-13289. RBF: TestConnectionManager#testCleanup() test case need correction. Contributed by Dibyendu Karmakar. 
(cherry picked from commit dc8e3432013153ac11d31d6b462aa96f8ca2c443)
 2018-03-31 09:46:44 -07:00
Konstantin V Shvachko
4ce45a8ec7 HADOOP-15253. Should update maxQueueSize when refresh call queue. Contributed by Tao Jie. 
(cherry picked from commit acfd764fcc9990e507c0e7cea746652375aaa632)
 2018-03-30 18:57:18 -07:00
Sammi Chen
e96c7bf82d HADOOP-14999. AliyunOSS: provide one asynchronous multi-part based uploading mechanism. Contributed by Genmao Yu. 
(cherry picked from commit 6542d17ea460ec222137c4b275b13daf15d3fca3)
 2018-03-30 20:26:35 +08:00
Konstantin V Shvachko
99b5b9dce1 HADOOP-12862. LDAP Group Mapping over SSL can not specify trust store. Contributed by Wei-Chiu Chuang and Konstantin Shvachko. 
(cherry picked from commit 2216bde322961c0fe33b5822510880a65d5c45fd)
 2018-03-29 17:20:28 -07:00
Xiao Chen
2960592c6f HDFS-13087. Snapshotted encryption zone information should be immutable. Contributed by LiXin Ge. 
(cherry picked from commit 2c6cfad5a31ca4d9126ecd2b3c43cca8543aacb4)
 2018-03-29 16:07:01 -07:00
Wangda Tan
b64bf56131 YARN-8086. ManagedParentQueue with no leaf queues cause JS error in new UI. (Suma Shivaprasad via wangda) 
Change-Id: I6d82af91adec02698afddde6883b1fe1924e6041
(cherry picked from commit e7e20190dface4117abe70dcfd96d19b0e4f5339)
 2018-03-29 15:19:31 -07:00
Sean Mackrory
b038e21440 HADOOP-15342. Updating ADLS connector to use the current SDK version (2.2.7). Contributed by Atul Sikaria. 
(cherry picked from commit 9d7a9031a5978efc8d97566e35ebaace20db2353)
 2018-03-29 14:04:55 -06:00
Sunil G
73cd67d7e3 YARN-8085. ResourceProfilesManager should be set in RMActiveServiceContext. Contributed by Tao Yang. 
(cherry picked from commit 7a59d60e0c50e8264e07f6b1dadaeedba676c8c2)
 2018-03-29 21:41:52 +05:30
Sunil G
04161bad78 YARN-8076. Support to specify application tags in distributed shell. Contributed by Weiwei Yang. 
(cherry picked from commit 431076f63751f855ab6036ff85825a8552257b93)
 2018-03-29 16:02:49 +05:30
Eric Yang
570d7f3072 YARN-8069. Clean up example hostnames for RegistryDNS. 
Contributed by Billie Rinaldi

(cherry picked from commit 3d185d62fc392dd5313f8e36b9674b9200638463)
 2018-03-28 20:20:06 -04:00
Arpit Agarwal
d54e19a913 HDFS-13314. NameNode should optionally exit if it detects FsImage corruption. Contributed by Arpit Agarwal. 2018-03-28 12:49:14 -07:00
Chris Douglas
ac16e8f4d3 HADOOP-15320. Remove customized getFileBlockLocations for hadoop-azure and hadoop-azure-datalake. Contributed by Shanyu Zhao 
(cherry picked from commit 081c3501885c543bb1f159929d456d1ba2e3650c)
 2018-03-28 11:59:08 -07:00
Zhe Zhang
0db6b8c93c YARN-7623. Fix the CapacityScheduler Queue configuration documentation. Contributed by Jonathan Hung. 
(cherry picked from commit 0b1c2b5fe1b5c225d208936ecb1d3e307a535ee6)
 2018-03-28 11:42:16 -07:00
Subru Krishnan
a0091ec4b3 YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru). 
(cherry picked from commit 09999d7e014fde717e8b122773b68664f4594106)
 2018-03-28 11:35:45 -07:00
Subru Krishnan
ed49f59e18 Revert "YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru)." 
This reverts commit 85eebf1bebc7b191dcd692395f77903257cd85c4.
 2018-03-28 11:35:30 -07:00
Wangda Tan
a2b4daab55 YARN-6629. NPE occurred when container allocation proposal is applied but its resource requests are removed before. (Tao Yang via wangda) 
Change-Id: I805880f90b3f6798ec96ed8e8e75755f390a9ad5
(cherry picked from commit 47f711eebca315804c80012eea5f31275ac25518)
 2018-03-28 11:22:26 -07:00
Yiqun Lin
99766992e6 HDFS-13347. RBF: Cache datanode reports. Contributed by Inigo Goiri. 
(cherry picked from commit a71656c1c1bf6c680f1382a76ddcac870061f320)
 2018-03-28 11:04:36 +08:00
Sunil G
6c904388f4 YARN-8075. DShell does not fail when we ask more GPUs than available even though AM throws 'InvalidResourceRequestException'. Contributed by Wangda Tan. 
(cherry picked from commit d1e378d02bdaec2f078ccc89698e7959ffcc71b3)
 2018-03-28 08:03:59 +05:30
Subru Krishnan
85eebf1beb YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru). 
(cherry picked from commit 2a2ef15caf791f30c471526c1b74e68803f0c405)
 2018-03-27 17:44:00 -07:00
Wei-Chiu Chuang
1176a128d6 HADOOP-15312. Undocumented KeyProvider configuration keys. Contributed by LiXin Ge. 
(cherry picked from commit 3fe41c65d84843f817a4f9ef8999dbf862db6674)
 2018-03-27 13:36:00 -07:00
Inigo Goiri
c1fc87dcce HDFS-13352. RBF: Add xsl stylesheet for hdfs-rbf-default.xml. Contributed by Takanobu Asanuma. 
(cherry picked from commit 4cef01147f98451de8acaa90f42a4d4cd4d0af45)
 2018-03-27 10:32:07 -07:00
Jitendra Pandey
91b98ad03a HADOOP-14067. VersionInfo should load version-info.properties from its own classloader. Contributed by Thejas M Nair. 2018-03-27 10:24:04 -07:00
Haibo Chen
e00e08365e YARN-7794. SLSRunner is not loading timeline service jars, causing failure. (Yufei Gu via Haibo Chen) 
(cherry picked from commit fcea5a4d798a517443afd0b441883ccc4e9136ba)
 2018-03-26 14:33:46 -07:00