Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,097 Commits 326 Branches 371 Tags
Commit Graph

18097 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Haibo Chen
b232dcab33 YARN-8107. Give an informative message when incorrect format is used in ATSv2 filter attributes. (Rohith Sharma K S via Haibo Chen) 
(cherry picked from commit 024d7c08704e6a5fcc1f53a8f56a44c84c8d5fa0)
 2018-04-06 09:39:45 -07:00
Sunil G
58a5ee378a YARN-8083. [UI2] All YARN related configurations are paged together in conf page. Contributed by Gergely Novák. 
(cherry picked from commit b17dc9f5f54fd91defc1d8646f8229da5fe7ccbb)
 2018-04-06 21:53:49 +05:30
Wangda Tan
a336561e2b Added CHANGES/RELEASES/Jdiff for 3.1.0 release 
Change-Id: Ied5067a996151c04d15cad46c46ac98b60c37b39
(cherry picked from commit 2d96570452a72569befdf9cfe9b90c9fa2e0e261)
 2018-04-05 15:52:02 -07:00
Wei Yan
89efe30f65 HDFS-13353. RBF: TestRouterWebHDFSContractCreate failed. Contributed by Takanobu Asanuma. 
(cherry picked from commit 3121e8c29361cb560df29188e1cd1061a5fc34c4)
 2018-04-05 13:13:16 -07:00
Haibo Chen
6658018410 YARN-6936. [Atsv2] Retrospect storing entities into sub application table from client perspective. (Rohith Sharma K S via Haibo Chen) 
(cherry picked from commit f8b8bd53c4797d406bea5b1b0cdb179e209169cc)
 2018-04-05 11:31:17 -07:00
Rohith Sharma K S
b11c228660 YARN-8119. [UI2] Timeline Server address' url scheme should be removed while accessing via KNOX. Contributed by Sunil G. 
(cherry picked from commit f32d6275ba9e377fb722e2440986033d7ce8b602)
 2018-04-05 23:34:40 +05:30
Lei Xu
2543a9dd77 HDFS-13350. Negative legacy block ID will confuse Erasure Coding to be considered as striped block. (Contributed by Lei (Eddy) Xu). 
(cherry picked from commit 1cbf23df145af01692b8aaa438642b64e330cd05)
 2018-04-05 10:01:05 -07:00
Konstantinos Karanasos
fa464c12ad YARN-8013. Support application tags when defining application namespaces for placement constraints. Contributed by Weiwei Yang. 
(cherry picked from commit 7853ec8d2fb8731b7f7c28fd87491a0a2d47967e)
 2018-04-04 10:53:33 -07:00
Sunil G
4db13cb944 YARN-8115. [UI2] URL data like nodeHTTPAddress must be encoded in UI before using to access NM. Contributed by Sreenath Somarajapuram. 
(cherry picked from commit 42cd367c9308b944bc71de6c07b6c3f028a0d874)
 2018-04-04 22:24:31 +05:30
Wangda Tan
2f326159f1 YARN-8106. Update LogAggregationIndexedFileController to use readFull instead read to avoid IOException while loading log meta. (Prabhu Joseph via wangda) 
Change-Id: I63a65f73f8d1636e2c99ed9c8c2bbd05efcff80f
(cherry picked from commit b779f4f0f614fe47e05bc2be5494cf3cbcf6f63c)
 2018-04-03 21:15:37 -07:00
Sunil G
1a125dd92f YARN-7764. Findbugs warning: Resource#getResources may expose internal representation. Contributed by Weiwei Yang. 
(cherry picked from commit f7a17b029ddd61ca73c2c2c88f5451dbf05fc501)
 2018-04-04 09:23:39 +05:30
Wangda Tan
78832eca8a YARN-8002. Support NOT_SELF and ALL namespace types for allocation tag. (Weiwei Yang via wangda) 
Change-Id: I63b4e4192a95bf7ded98c54e46a2871c72869700
 2018-04-04 09:42:49 +08:00
Yiqun Lin
b89dc00302 HDFS-13364. RBF: Support NamenodeProtocol in the Router. Contributed by Inigo Goiri. 
(cherry picked from commit 2be64eb201134502a92f7239bef8aa780771ca0b)
 2018-04-03 15:23:39 +08:00
Xiao Chen
8d755371f2 HADOOP-15355. TestCommonConfigurationFields is broken by HADOOP-15312. Contributed by LiXin Ge. 
(cherry picked from commit f614b44fe583033947cc78d8f04cfe6fb64fc892)
 2018-04-02 23:10:17 -07:00
Xiao Chen
dcb2176c5d HADOOP-15317. Improve NetworkTopology chooseRandom's loop. 
(cherry picked from commit 57374c4737ab0fccf52dae3cea911fc6bd90e1b7)
 2018-04-02 22:48:54 -07:00
Inigo Goiri
3c9983547c HDFS-13289. RBF: TestConnectionManager#testCleanup() test case need correction. Contributed by Dibyendu Karmakar. 
(cherry picked from commit dc8e3432013153ac11d31d6b462aa96f8ca2c443)
 2018-03-31 09:46:44 -07:00
Konstantin V Shvachko
4ce45a8ec7 HADOOP-15253. Should update maxQueueSize when refresh call queue. Contributed by Tao Jie. 
(cherry picked from commit acfd764fcc9990e507c0e7cea746652375aaa632)
 2018-03-30 18:57:18 -07:00
Sammi Chen
e96c7bf82d HADOOP-14999. AliyunOSS: provide one asynchronous multi-part based uploading mechanism. Contributed by Genmao Yu. 
(cherry picked from commit 6542d17ea460ec222137c4b275b13daf15d3fca3)
 2018-03-30 20:26:35 +08:00
Konstantin V Shvachko
99b5b9dce1 HADOOP-12862. LDAP Group Mapping over SSL can not specify trust store. Contributed by Wei-Chiu Chuang and Konstantin Shvachko. 
(cherry picked from commit 2216bde322961c0fe33b5822510880a65d5c45fd)
 2018-03-29 17:20:28 -07:00
Xiao Chen
2960592c6f HDFS-13087. Snapshotted encryption zone information should be immutable. Contributed by LiXin Ge. 
(cherry picked from commit 2c6cfad5a31ca4d9126ecd2b3c43cca8543aacb4)
 2018-03-29 16:07:01 -07:00
Wangda Tan
b64bf56131 YARN-8086. ManagedParentQueue with no leaf queues cause JS error in new UI. (Suma Shivaprasad via wangda) 
Change-Id: I6d82af91adec02698afddde6883b1fe1924e6041
(cherry picked from commit e7e20190dface4117abe70dcfd96d19b0e4f5339)
 2018-03-29 15:19:31 -07:00
Sean Mackrory
b038e21440 HADOOP-15342. Updating ADLS connector to use the current SDK version (2.2.7). Contributed by Atul Sikaria. 
(cherry picked from commit 9d7a9031a5978efc8d97566e35ebaace20db2353)
 2018-03-29 14:04:55 -06:00
Sunil G
73cd67d7e3 YARN-8085. ResourceProfilesManager should be set in RMActiveServiceContext. Contributed by Tao Yang. 
(cherry picked from commit 7a59d60e0c50e8264e07f6b1dadaeedba676c8c2)
 2018-03-29 21:41:52 +05:30
Sunil G
04161bad78 YARN-8076. Support to specify application tags in distributed shell. Contributed by Weiwei Yang. 
(cherry picked from commit 431076f63751f855ab6036ff85825a8552257b93)
 2018-03-29 16:02:49 +05:30
Eric Yang
570d7f3072 YARN-8069. Clean up example hostnames for RegistryDNS. 
Contributed by Billie Rinaldi

(cherry picked from commit 3d185d62fc392dd5313f8e36b9674b9200638463)
 2018-03-28 20:20:06 -04:00
Arpit Agarwal
d54e19a913 HDFS-13314. NameNode should optionally exit if it detects FsImage corruption. Contributed by Arpit Agarwal. 2018-03-28 12:49:14 -07:00
Chris Douglas
ac16e8f4d3 HADOOP-15320. Remove customized getFileBlockLocations for hadoop-azure and hadoop-azure-datalake. Contributed by Shanyu Zhao 
(cherry picked from commit 081c3501885c543bb1f159929d456d1ba2e3650c)
 2018-03-28 11:59:08 -07:00
Zhe Zhang
0db6b8c93c YARN-7623. Fix the CapacityScheduler Queue configuration documentation. Contributed by Jonathan Hung. 
(cherry picked from commit 0b1c2b5fe1b5c225d208936ecb1d3e307a535ee6)
 2018-03-28 11:42:16 -07:00
Subru Krishnan
a0091ec4b3 YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru). 
(cherry picked from commit 09999d7e014fde717e8b122773b68664f4594106)
 2018-03-28 11:35:45 -07:00
Subru Krishnan
ed49f59e18 Revert "YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru)." 
This reverts commit 85eebf1bebc7b191dcd692395f77903257cd85c4.
 2018-03-28 11:35:30 -07:00
Wangda Tan
a2b4daab55 YARN-6629. NPE occurred when container allocation proposal is applied but its resource requests are removed before. (Tao Yang via wangda) 
Change-Id: I805880f90b3f6798ec96ed8e8e75755f390a9ad5
(cherry picked from commit 47f711eebca315804c80012eea5f31275ac25518)
 2018-03-28 11:22:26 -07:00
Yiqun Lin
99766992e6 HDFS-13347. RBF: Cache datanode reports. Contributed by Inigo Goiri. 
(cherry picked from commit a71656c1c1bf6c680f1382a76ddcac870061f320)
 2018-03-28 11:04:36 +08:00
Sunil G
6c904388f4 YARN-8075. DShell does not fail when we ask more GPUs than available even though AM throws 'InvalidResourceRequestException'. Contributed by Wangda Tan. 
(cherry picked from commit d1e378d02bdaec2f078ccc89698e7959ffcc71b3)
 2018-03-28 08:03:59 +05:30
Subru Krishnan
85eebf1beb YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru). 
(cherry picked from commit 2a2ef15caf791f30c471526c1b74e68803f0c405)
 2018-03-27 17:44:00 -07:00
Wei-Chiu Chuang
1176a128d6 HADOOP-15312. Undocumented KeyProvider configuration keys. Contributed by LiXin Ge. 
(cherry picked from commit 3fe41c65d84843f817a4f9ef8999dbf862db6674)
 2018-03-27 13:36:00 -07:00
Inigo Goiri
c1fc87dcce HDFS-13352. RBF: Add xsl stylesheet for hdfs-rbf-default.xml. Contributed by Takanobu Asanuma. 
(cherry picked from commit 4cef01147f98451de8acaa90f42a4d4cd4d0af45)
 2018-03-27 10:32:07 -07:00
Jitendra Pandey
91b98ad03a HADOOP-14067. VersionInfo should load version-info.properties from its own classloader. Contributed by Thejas M Nair. 2018-03-27 10:24:04 -07:00
Haibo Chen
e00e08365e YARN-7794. SLSRunner is not loading timeline service jars, causing failure. (Yufei Gu via Haibo Chen) 
(cherry picked from commit fcea5a4d798a517443afd0b441883ccc4e9136ba)
 2018-03-26 14:33:46 -07:00
Wangda Tan
dc99611878 YARN-8072. RM log is getting flooded with MemoryPlacementConstraintManager info logs. (Zian Chen via wangda) 
Change-Id: I2567f4669ad868e13c4301fe44c4bde85bb92c37
(cherry picked from commit 24bc5e0e4d919fddae983fc13d4ba4e4e5cb9533)
 2018-03-26 11:27:40 -07:00
Wangda Tan
62b9537332 YARN-8068. Application Priority field causes NPE in app timeline publish when Hadoop 2.7 based clients to 2.8+ (Sunil G via wangda) 
Change-Id: I7910bd1064a1b4dbbe2084080c060822ea6f3b48
(cherry picked from commit 9eef19b2ad78b8464da252d0e23c08675898b9d8)
 2018-03-26 11:27:32 -07:00
Wangda Tan
54da6a0d78 YARN-8062. yarn rmadmin -getGroups returns group from which the user has been removed. (Sunil G via wangda) 
Change-Id: I80ed63846502bf7751b890b6c6c6a7c0679e2b4a
(cherry picked from commit 5d381570f83022b411a8740d58486a7f68ab2af6)
 2018-03-26 11:27:21 -07:00
Inigo Goiri
0dc16559ee HDFS-13204. RBF: Optimize name service safe mode icon. Contributed by liuhongtong. 
(cherry picked from commit 947b2829844f2b4ce42f72b7e3ee27d7c4a27df2)
 2018-03-26 09:43:28 -07:00
Yiqun Lin
1e01ddfe4f HDFS-13291. RBF: Implement available space based OrderResolver. Contributed by Yiqun Lin. 
(cherry picked from commit cfc3a1c8f06fba4f4bd5ffe8bb2a6944d066948e)
 2018-03-26 18:36:22 +08:00
Wangda Tan
c98dd3bf18 YARN-8070. Yarn Service API site doc broken due to unwanted character in YarnServiceAPI.md (Gour Saha via wangda) 
Change-Id: I22428b2f128d16e79ebbdeaf32869566963d0c6f
(cherry picked from commit 24f75e097a67ae90d2ff382bb2f2559caa02f32f)
 2018-03-23 17:53:33 -07:00
Lei Xu
4859cd7cc9 Update 3.0.1 jdiff file and jdiff stable api version 2018-03-23 11:53:30 -07:00
Lei Xu
98d7a5aaef Update releasenotes and changelogs for 3.0.1 release 2018-03-23 11:53:16 -07:00
weiy
d17aa8d052 HDFS-12512. RBF: Add WebHDFS. 
(cherry picked from commit 6e31a090842f8aeedb331b653b075499f8df6c60)
 2018-03-23 08:40:04 -07:00
Rohith Sharma K S
91791a8abd YARN-7986. ATSv2 REST API queries do not return results for uppercase application tags. Contributed by Charan Hebri. 
(cherry picked from commit 75fc05f369929db768b767d79351bca8c13ad9ba)
 2018-03-23 12:18:43 +05:30
Sunil G
e10e6c9012 YARN-8063. DistributedShellTimelinePlugin wrongly check for entityId instead of entityType. Contributed by Rohith Sharma K S. 
(cherry picked from commit 22c5ddb7c4fb48d5bf5a7456d0b1b27d48c2a485)
 2018-03-23 10:55:13 +05:30
Inigo Goiri
59ab86311c HDFS-12792. RBF: Test Router-based federation using HDFSContract. Contributed by Inigo Goiri. 
(cherry picked from commit e196d158a275bfdcfaf372e0f5bcbbc8bbe24106)
 2018-03-22 13:33:24 -07:00