Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,153 Commits 326 Branches 371 Tags
Commit Graph

4384 Commits

Author SHA1 Message Date
Sunil G
d98c3ca5fd YARN-8040. [UI2] New YARN UI webapp does not respect current pathname for REST api. Contributed by Sunil G. 2018-04-13 10:18:39 -07:00
Sunil G
21717db6a0 YARN-8028. Support authorizeUserAccessToQueue in RMWebServices. Contributed by Wangda Tan. 2018-04-13 10:18:12 -07:00
Wangda Tan
c962371430 YARN-1151. Ability to configure auxiliary services from HDFS-based JAR files. (Xuan Gong via wangda) 
Change-Id: Ied37ff11e507fc86847753ba79486652c8fadfe9
 2018-04-13 10:17:47 -07:00
Weiwei Yang
84531ad9b6 YARN-8153. Guaranteed containers always stay in SCHEDULED on NM after restart. Contributed by Yang Wang. 2018-04-13 13:29:43 +08:00
Weiwei Yang
7be71ec55b YARN-8154. Fix missing titles in PlacementConstraints document. Contributed by Weiwei Yang. 2018-04-13 13:10:05 +08:00
Eric Yang
a375fe8263 YARN-7984. Improved YARN service stop/destroy and clean up. 
Contributed by Billie Rinaldi

(cherry picked from commit d553799030a5a64df328319aceb35734d0b2de20)
 2018-04-12 18:19:58 -07:00
Eric Yang
150085cc64 YARN-8018. Added support for initiating yarn service upgrade. 
Contributed by Chandni Singh

(cherry picked from commit 27d60a16342fd39973d43b61008f54a8815a6237)
 2018-04-12 17:08:27 -04:00
Billie Rinaldi
23179c06a3 YARN-7936. Add default service AM Xmx. Contributed by Jian He 
(cherry picked from commit 53b3e594732e7a567dda4e08b9a8af5f87a4472a)
 2018-04-12 12:43:30 -07:00
Eric E Payne
9693d8b99d YARN-8147. TestClientRMService#testGetApplications sporadically fails. Contributed by Jason Lowe 
(cherry picked from commit 18844599aef42f79d2af4500aa2eee472dda95cb)
 2018-04-12 17:58:41 +00:00
Eric E Payne
f955d52f39 YARN-8120. JVM can crash with SIGSEGV when exiting due to custom leveldb logger. Contributed by Jason Lowe. 
(cherry picked from commit 6bb128dfb893cf0e4aa2d3ecc65440668a1fc8d7)
 2018-04-12 16:11:57 +00:00
Billie Rinaldi
11f1d49823 YARN-7221. Add security check for privileged docker container. Contributed by Eric Yang 
(cherry picked from commit 933477e9e0526e2ed81ea454f8806de31981822a)
 2018-04-11 12:15:00 -07:00
Weiwei Yang
c2036af196 YARN-8127. Resource leak when async scheduling is enabled. Contributed by Tao Yang. 
(cherry picked from commit 7eb783e2634d8c11fb646f1f2fdf597336325312)
 2018-04-11 17:21:47 +08:00
Vrushali C
67cd7acf99 YARN-8073 TimelineClientImpl doesn't honor yarn.timeline-service.versions configuration. Contributed by Rohith Sharma K S 
(cherry picked from commit 345e7624d58a058a1bad666bd1e5ce4b346a9056)
 2018-04-11 09:41:04 +05:30
Rohith Sharma K S
c1b4c6adf4 YARN-7941. Transitive dependencies for component are not resolved. Contributed by Billie Rinaldi. 
(cherry picked from commit c0487110990958fa985d273eb178bdf76002cf3a)
 2018-04-11 09:19:48 +05:30
Wangda Tan
53abef4e30 YARN-8133. Doc link broken for yarn-service from overview page. (Rohith Sharma K S via wangda) 
Change-Id: Iacf9a004585dd59e1c0cd8f8c618a38f047cc0fe
(cherry picked from commit d919eb6efa1072517017c75fb323e391f4418dc8)
 2018-04-10 17:38:37 -07:00
Wangda Tan
f5dc7d1edf YARN-8116. Nodemanager fails with NumberFormatException: For input string: . (Chandni Singh via wangda) 
Change-Id: Idd30cfca59982d3fc6e47aa1b88f844a78fae94d
(cherry picked from commit 2bf9cc2c73944c9f7cde56714b8cf6995cfa539b)
 2018-04-10 17:38:31 -07:00
Sunil G
5387b3f066 YARN-7804. [UI2] Refresh action on Grid view page should not be redirected to graph view. Contributed by Gergely Novák. 
(cherry picked from commit 7c1e77dda4cb3ba8952328d142aafcf0366b5903)
 2018-04-10 16:09:49 +05:30
Wangda Tan
25bf1d3ac6 Updated branch-3.1 to track 3.1.1 
Change-Id: Idd55c79921b8acacc8a8a3258450e476f3abb706
 2018-04-09 10:58:50 -07:00
Sunil G
8311fcc75b YARN-7574. Add support for Node Labels on Auto Created Leaf Queue Template. Contributed by Suma Shivaprasad. 
(cherry picked from commit 821b0de4c59156d4a65112de03ba3e7e1c88e309)
 2018-04-09 21:17:56 +05:30
bibinchundatt
091db4d0eb YARN-7905. Parent directory permission incorrect during public localization. Contributed by Bilwa S T. 
(cherry picked from commit eb47c3de74ba4b8b3ef47eaf3a44e5562fd22fc9)
 2018-04-08 14:49:36 +05:30
Subru Krishnan
b9bad94596 YARN-8110. AMRMProxy recover should catch for all throwable to avoid premature exit. (Botong Huang via Subru). 
(cherry picked from commit 00905efab22edd9857e0a3828c201bf70f03cb96)
 2018-04-06 16:35:29 -07:00
Haibo Chen
b232dcab33 YARN-8107. Give an informative message when incorrect format is used in ATSv2 filter attributes. (Rohith Sharma K S via Haibo Chen) 
(cherry picked from commit 024d7c08704e6a5fcc1f53a8f56a44c84c8d5fa0)
 2018-04-06 09:39:45 -07:00
Sunil G
58a5ee378a YARN-8083. [UI2] All YARN related configurations are paged together in conf page. Contributed by Gergely Novák. 
(cherry picked from commit b17dc9f5f54fd91defc1d8646f8229da5fe7ccbb)
 2018-04-06 21:53:49 +05:30
Wangda Tan
a336561e2b Added CHANGES/RELEASES/Jdiff for 3.1.0 release 
Change-Id: Ied5067a996151c04d15cad46c46ac98b60c37b39
(cherry picked from commit 2d96570452a72569befdf9cfe9b90c9fa2e0e261)
 2018-04-05 15:52:02 -07:00
Haibo Chen
6658018410 YARN-6936. [Atsv2] Retrospect storing entities into sub application table from client perspective. (Rohith Sharma K S via Haibo Chen) 
(cherry picked from commit f8b8bd53c4797d406bea5b1b0cdb179e209169cc)
 2018-04-05 11:31:17 -07:00
Rohith Sharma K S
b11c228660 YARN-8119. [UI2] Timeline Server address' url scheme should be removed while accessing via KNOX. Contributed by Sunil G. 
(cherry picked from commit f32d6275ba9e377fb722e2440986033d7ce8b602)
 2018-04-05 23:34:40 +05:30
Konstantinos Karanasos
fa464c12ad YARN-8013. Support application tags when defining application namespaces for placement constraints. Contributed by Weiwei Yang. 
(cherry picked from commit 7853ec8d2fb8731b7f7c28fd87491a0a2d47967e)
 2018-04-04 10:53:33 -07:00
Sunil G
4db13cb944 YARN-8115. [UI2] URL data like nodeHTTPAddress must be encoded in UI before using to access NM. Contributed by Sreenath Somarajapuram. 
(cherry picked from commit 42cd367c9308b944bc71de6c07b6c3f028a0d874)
 2018-04-04 22:24:31 +05:30
Wangda Tan
2f326159f1 YARN-8106. Update LogAggregationIndexedFileController to use readFull instead read to avoid IOException while loading log meta. (Prabhu Joseph via wangda) 
Change-Id: I63a65f73f8d1636e2c99ed9c8c2bbd05efcff80f
(cherry picked from commit b779f4f0f614fe47e05bc2be5494cf3cbcf6f63c)
 2018-04-03 21:15:37 -07:00
Sunil G
1a125dd92f YARN-7764. Findbugs warning: Resource#getResources may expose internal representation. Contributed by Weiwei Yang. 
(cherry picked from commit f7a17b029ddd61ca73c2c2c88f5451dbf05fc501)
 2018-04-04 09:23:39 +05:30
Wangda Tan
78832eca8a YARN-8002. Support NOT_SELF and ALL namespace types for allocation tag. (Weiwei Yang via wangda) 
Change-Id: I63b4e4192a95bf7ded98c54e46a2871c72869700
 2018-04-04 09:42:49 +08:00
Wangda Tan
b64bf56131 YARN-8086. ManagedParentQueue with no leaf queues cause JS error in new UI. (Suma Shivaprasad via wangda) 
Change-Id: I6d82af91adec02698afddde6883b1fe1924e6041
(cherry picked from commit e7e20190dface4117abe70dcfd96d19b0e4f5339)
 2018-03-29 15:19:31 -07:00
Sunil G
73cd67d7e3 YARN-8085. ResourceProfilesManager should be set in RMActiveServiceContext. Contributed by Tao Yang. 
(cherry picked from commit 7a59d60e0c50e8264e07f6b1dadaeedba676c8c2)
 2018-03-29 21:41:52 +05:30
Sunil G
04161bad78 YARN-8076. Support to specify application tags in distributed shell. Contributed by Weiwei Yang. 
(cherry picked from commit 431076f63751f855ab6036ff85825a8552257b93)
 2018-03-29 16:02:49 +05:30
Eric Yang
570d7f3072 YARN-8069. Clean up example hostnames for RegistryDNS. 
Contributed by Billie Rinaldi

(cherry picked from commit 3d185d62fc392dd5313f8e36b9674b9200638463)
 2018-03-28 20:20:06 -04:00
Zhe Zhang
0db6b8c93c YARN-7623. Fix the CapacityScheduler Queue configuration documentation. Contributed by Jonathan Hung. 
(cherry picked from commit 0b1c2b5fe1b5c225d208936ecb1d3e307a535ee6)
 2018-03-28 11:42:16 -07:00
Subru Krishnan
a0091ec4b3 YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru). 
(cherry picked from commit 09999d7e014fde717e8b122773b68664f4594106)
 2018-03-28 11:35:45 -07:00
Subru Krishnan
ed49f59e18 Revert "YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru)." 
This reverts commit 85eebf1bebc7b191dcd692395f77903257cd85c4.
 2018-03-28 11:35:30 -07:00
Wangda Tan
a2b4daab55 YARN-6629. NPE occurred when container allocation proposal is applied but its resource requests are removed before. (Tao Yang via wangda) 
Change-Id: I805880f90b3f6798ec96ed8e8e75755f390a9ad5
(cherry picked from commit 47f711eebca315804c80012eea5f31275ac25518)
 2018-03-28 11:22:26 -07:00
Sunil G
6c904388f4 YARN-8075. DShell does not fail when we ask more GPUs than available even though AM throws 'InvalidResourceRequestException'. Contributed by Wangda Tan. 
(cherry picked from commit d1e378d02bdaec2f078ccc89698e7959ffcc71b3)
 2018-03-28 08:03:59 +05:30
Subru Krishnan
85eebf1beb YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru). 
(cherry picked from commit 2a2ef15caf791f30c471526c1b74e68803f0c405)
 2018-03-27 17:44:00 -07:00
Wangda Tan
dc99611878 YARN-8072. RM log is getting flooded with MemoryPlacementConstraintManager info logs. (Zian Chen via wangda) 
Change-Id: I2567f4669ad868e13c4301fe44c4bde85bb92c37
(cherry picked from commit 24bc5e0e4d919fddae983fc13d4ba4e4e5cb9533)
 2018-03-26 11:27:40 -07:00
Wangda Tan
62b9537332 YARN-8068. Application Priority field causes NPE in app timeline publish when Hadoop 2.7 based clients to 2.8+ (Sunil G via wangda) 
Change-Id: I7910bd1064a1b4dbbe2084080c060822ea6f3b48
(cherry picked from commit 9eef19b2ad78b8464da252d0e23c08675898b9d8)
 2018-03-26 11:27:32 -07:00
Wangda Tan
54da6a0d78 YARN-8062. yarn rmadmin -getGroups returns group from which the user has been removed. (Sunil G via wangda) 
Change-Id: I80ed63846502bf7751b890b6c6c6a7c0679e2b4a
(cherry picked from commit 5d381570f83022b411a8740d58486a7f68ab2af6)
 2018-03-26 11:27:21 -07:00
Wangda Tan
c98dd3bf18 YARN-8070. Yarn Service API site doc broken due to unwanted character in YarnServiceAPI.md (Gour Saha via wangda) 
Change-Id: I22428b2f128d16e79ebbdeaf32869566963d0c6f
(cherry picked from commit 24f75e097a67ae90d2ff382bb2f2559caa02f32f)
 2018-03-23 17:53:33 -07:00
Rohith Sharma K S
91791a8abd YARN-7986. ATSv2 REST API queries do not return results for uppercase application tags. Contributed by Charan Hebri. 
(cherry picked from commit 75fc05f369929db768b767d79351bca8c13ad9ba)
 2018-03-23 12:18:43 +05:30
Sunil G
e10e6c9012 YARN-8063. DistributedShellTimelinePlugin wrongly check for entityId instead of entityType. Contributed by Rohith Sharma K S. 
(cherry picked from commit 22c5ddb7c4fb48d5bf5a7456d0b1b27d48c2a485)
 2018-03-23 10:55:13 +05:30
Jason Lowe
5d4b2c31a1 YARN-8054. Improve robustness of the LocalDirsHandlerService MonitoringTimerTask thread. Contributed by Jonathan Eagles 
(cherry picked from commit 5aa7052e319c3273243dda9993fb6c2d776eb7cc)
 2018-03-21 17:20:36 -05:00
Rohith Sharma K S
bbfe36d686 YARN-7581. HBase filters are not constructed correctly in ATSv2. Contributed by Habio Chen. 
(cherry picked from commit 29acea5000337a7f529bb1810a2af2b0af4d5f1d)
 2018-03-21 08:26:56 +05:30
Haibo Chen
d8764f1c90 YARN-8053. Add hadoop-distcp in exclusion in hbase-server dependencies for timelineservice-hbase packages. (Rohith Sharma K S via Haibo Chen) 
(cherry picked from commit 3ff6977d3e29cff455a71f668bec8ed35fb90774)
 2018-03-21 08:26:56 +05:30