Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
16,765 Commits 326 Branches 371 Tags
Commit Graph

3696 Commits

Author SHA1 Message Date
Akira Ajisaka
149d3ad6ba
YARN-7153. Remove duplicated code in AMRMClientAsyncImpl.java. Contributed by Sen Zhao. 
(cherry picked from commit e928ee583c5a1367e24eab34057f8d8496891452)
 2017-09-26 02:04:23 +09:00
Junping Du
b58cc16171 YARN-7118. AHS REST API can return NullPointerException. Contributed by Billie Rinaldi. 
(cherry picked from commit 4002bf0a9e7e3619a3bdcff071f0369cbf2873ad)
 2017-09-22 14:00:40 -07:00
Jason Lowe
a294bfd80e YARN-4266. Allow users to enter containers as UID:GID pair instead of by username. Contributed by luhuichun, Zhankun Tang, and Eric Badger. 
(cherry picked from commit bfd1a72ba8fbb06da73fede2a85e0b544d6ab43f)
 2017-09-21 17:43:51 -05:00
Junping Du
9e3313f8a1 YARN-7034. DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor. Contributed by Miklos Szegedi. 
(cherry picked from commit e5e1851d803bf8d8b96fec1b5c0058014e9329d0)
 2017-09-21 14:06:45 -07:00
Wangda Tan
4dbf7a501a YARN-6991. "Kill application" button does not show error if other user tries to kill the application for secure cluster. (Suma Shivaprasad via wangda) 
Change-Id: I7e7894b24609709f89064ee5882f055dbb09080b
(cherry picked from commit 263e2c692a4b0013766cd1f6b6d7ed674b2b1040)
 2017-09-21 12:27:18 -07:00
Jason Lowe
1e55972273 YARN-6968. Hardcoded absolute pathname in DockerLinuxContainerRuntime. Contributed by Eric Badger 
(cherry picked from commit 10d7493587643b52cee5fde87eca9ef99c422a70)
 2017-09-21 08:44:16 -05:00
Sangjin Lee
f919bcadb7 YARN-6771. Use classloader inside configuration class to make new 
classes. Contributed by Jongyoul Lee.

(cherry picked from commit 8b336632acad10e45d029596c5e3196e1857d891)
 2017-09-20 22:54:30 -07:00
Junping Du
974605c025 YARN-7186. Fix finicky TestContainerManager tests. Contributed by Arun Suresh. 
(cherry picked from commit 647b7527a9cdf4717e7dcbbb660e5812b67a17f1)
 2017-09-19 18:31:54 -07:00
Arun Suresh
2ccfe92a4e YARN-7203. Add container ExecutionType into ContainerReport. (Botong Huang via asuresh) 
(cherry picked from commit 56ef5279c1db93d03b2f1e04badbfe804f548918)
 2017-09-18 15:50:39 -07:00
Andrew Wang
531290c2c8 HADOOP-14835. mvn site build throws SAX errors. Contributed by Andrew Wang and Sean Mackrory. 
(cherry picked from commit 3cf3540f19b5fd1a174690db9f1b7be2977d96ba)
 2017-09-18 15:13:45 -07:00
Xuan
e91447ccc9 YARN-6570. No logs were found for running application, running 
container. Contributed by Junping Du

(cherry picked from commit 7c732924a889cd280e972882619a1827877fbafa)
 2017-09-18 14:05:02 -07:00
Jason Lowe
7e72be9456 YARN-7192. Add a pluggable StateMachine Listener that is notified of NM Container State changes. Contributed by Arun Suresh 
(cherry picked from commit a4f9c7c9247801dd37beec6fc195622af1b884ad)
 2017-09-18 10:23:22 -05:00
Rohith Sharma K S
508e93e48c YARN-7157. Add admin configuration to filter per-user's apps in secure cluster. Contributed by Sunil G. 2017-09-18 22:56:52 +10:00
Wangda Tan
e3a0104980 YARN-7149. Cross-queue preemption sometimes starves an underserved queue. (Eric Payne via wangda) 
Change-Id: Ib269991dbebce160378e8372ee6d24849c4a5ed6
(cherry picked from commit 3dfa937a1fadfc62947755872515f549b3b15e6a)
 2017-09-17 21:19:20 -07:00
Wangda Tan
03b6e95fa5 YARN-6977. Node information is not provided for non am containers in RM logs. (Suma Shivaprasad via wangda) 
Change-Id: I0c44d09a560446dee2ba68c2b9ae69fce0ec1d3e
(cherry picked from commit 8a42e922fad613f3cf1cc6cb0f3fa72546a9cc56)
 2017-09-17 21:19:20 -07:00
Junping Du
21f6aa77ab YARN-7174. Add retry logic in LogsCLI when fetch running application logs. Contributed by Xuan Gong. 
(cherry picked from commit 1a84c24b0cf6674fa755403971fa57d8e412b320)
 2017-09-15 15:34:30 -07:00
Yufei Gu
6362a9503d YARN-6799. Remove the duplicated code in CGroupsHandlerImp.java. (Contributed by Weiyuan via Yufei Gu) 
(cherry picked from commit 5ab21dfe9c8e14585db71e02bcb021a526507f98)
 2017-09-15 09:51:50 -07:00
Robert Kanter
d3d32d3580 YARN-7162. Remove XML excludes file format (rkanter) 2017-09-15 09:48:59 -07:00
Yufei Gu
8d49c2fc3b YARN-7057. FSAppAttempt#getResourceUsage doesn't need to consider resources queued for preemption. (Contributed by Karthik via Yufei Gu) 
(cherry picked from commit 82c5dd1d508292ed88eda0f5356776437ba67d4c)
 2017-09-14 15:48:48 -07:00
Robert Kanter
aa21b01fcb YARN-7146. Many RM unit tests failing with FairScheduler (rkanter) 
(cherry picked from commit bb34ae955496c1aa595dc1186153d605a41f5378)
 2017-09-13 15:45:28 -07:00
Eric Payne
4f6e8e08dc YARN-4727. Unable to override the $HADOOP_CONF_DIR env variable for container. Contributed by Jason Lowe. 
(cherry picked from commit 3860be7961580ac20dd505d665b580f0a04ac4f8)
 2017-09-13 14:46:04 -05:00
Arun Suresh
783db4792c YARN-7185. [Addendum patch] Minor javadoc and checkstyle fix. 
(cherry picked from commit a1c398e0dc85e424b45c50a3c3a0a784c04ed737)
 2017-09-12 17:04:25 -07:00
Arun Suresh
1230b60fa6 YARN-7185. ContainerScheduler should only look at availableResource for GUARANTEED containers when OPPORTUNISTIC container queuing is enabled. (Wangda Tan via asuresh) 
(cherry picked from commit 2ae72692fc370267141a1ee55ef372ff62302b54)
 2017-09-12 16:38:58 -07:00
Wangda Tan
d2e3818823 YARN-7173. Container update RM-NM communication fix for backward compatibility. (Arun Suresh via wangda) 
Change-Id: I1c39ed5c59dee739ba5044b61b3ef5ed203b79c1
(cherry picked from commit e74d1be04be47969943b0501a4f335b0b5188287)
 2017-09-12 08:09:47 -07:00
Haibo Chen
13310f91a5 YARN-7132. FairScheduler.initScheduler() contains a surprising unary plus. (Yeliang Cang via Haibo Chen) 
(cherry picked from commit fa531788fd7c9eee70808818a2f6aec9bdc3bec7)
 2017-09-11 20:49:33 -07:00
Haibo Chen
4f58533389 YARN-7128. The error message in TimelineSchemaCreator is not enough to find out the error. (Jinjiang Ling via Haibo Chen) 
(cherry picked from commit 661f5eb0c6791148f2d15d5730635ccb668601e3)
 2017-09-11 16:22:06 -07:00
Sunil G
07cbb81e8b YARN-7163. RMContext need not to be injected to webapp and other Always Running services. Contributed by Rohith Sharma K S. 
(cherry picked from commit 722ee841948db1f246f0056acec9a1ac464fe1f9)
 2017-09-11 10:36:29 +05:30
Sunil G
ad09c8f299 YARN-7104. Improve Nodes Heatmap in new YARN UI with better color coding. Contributed by Da Ding. 
(cherry picked from commit ab8368d2e0f3931615e6ef4550ad75d9e56047d2)
 2017-09-09 06:54:26 +05:30
Sunil G
6b54eec371 YARN-7022. Improve click interaction in queue topology in new YARN UI. Contributed by Abdullah Yousufi. 
(cherry picked from commit ed162b7aa01a60488d0c95294d4503aac725bd9e)
 2017-09-09 06:42:55 +05:30
Sunil G
fd63f8112b YARN-7075. Better styling for donut charts in new YARN UI. Contributed by Da Ding. 
(cherry picked from commit 275980bb1e3ae2dd5c64673e3cb384eb104a947d)
 2017-09-09 06:33:14 +05:30
Sunil G
f3c9b2e40e YARN-6992. Kill application button is visible even if the application is FINISHED in RM UI. Contributed by Suma Shivaprasad. 
(cherry picked from commit 6f101e7df10d477cf7469f6979d0cb8269315a3e)
 2017-09-09 06:25:53 +05:30
Haibo Chen
8ff2523687 HADOOP-14847. Remove Guava Supplier and change to java Supplier in AMRMClient and AMRMClientAysnc. (Bharat Viswanadham via Haibo Chen) 
(cherry picked from commit 8edc60531fec4f4070955b3e82a78ba70ba40ec0)
 2017-09-08 14:35:03 -07:00
Rohith Sharma K S
720718eecc YARN-7130. ATSv2 documentation changes post merge. Contributed by Varun Saxena. 
(cherry picked from commit 0bfb3a256612aa54437ee9c8c928c3c41d69fc52)
 2017-09-08 22:42:02 +05:30
Rohith Sharma K S
e8e1a73cf5 YARN-7140. CollectorInfo should have Public visibility. Contributed by Varun Saxena. 
(cherry picked from commit 4a83170be477e6f39f134207f74084888174e96b)
 2017-09-08 22:41:52 +05:30
Arun Suresh
abe3085f23 YARN-6849. NMContainerStatus should have the Container ExecutionType. (Kartheek Muthyala via asuresh) 
(cherry picked from commit 1f53ae79728065417c6a99eb6fcc8d3a080ab4cc)
 2017-09-08 09:25:14 -07:00
Sunil G
dfc174b747 YARN-6600. Introduce default and max lifetime of application at LeafQueue level. Contributed by Rohith Sharma K S. 
(cherry picked from commit 56d93d2e39ead89bb79c4f4096554820dc77e84b)
 2017-09-08 20:06:06 +05:30
Jason Lowe
7287932397 YARN-6930. Admins should be able to explicitly enable specific LinuxContainerRuntime in the NodeManager. Contributed by Shane Kumpf 
(cherry picked from commit b0b535d9d5727cd84fd6368c6d1b38363616504e)
 2017-09-07 16:25:41 -05:00
Arun Suresh
05b4abf537 YARN-6978. Add updateContainer API to NMClient. (Kartheek Muthyala via asuresh) 
(cherry picked from commit c41118a7f826dcbb269b4bd3d5877b35fbbee2b1)
 2017-09-07 10:28:18 -07:00
Junping Du
2608b53910 YARN-7144. Log Aggregation controller should not swallow the exceptions when it calls closeWriter and closeReader. Contributed by Xuan Gong. 
(cherry picked from commit 22de9449f8aa72c5b0bb586b8253390773502189)
 2017-09-06 15:02:23 -07:00
Junping Du
00594eb686 YARN-7148. TestLogsCLI fails in trunk and branch-2 and javadoc error. Contributed by Xuan Gong. 
(cherry picked from commit 63231a2a3008794c5ebcbc9d3855638fc5f28216)
 2017-09-06 15:01:35 -07:00
Jason Lowe
6ec611d8c1 YARN-7164. TestAMRMClientOnRMRestart fails sporadically with bind address in use. Contributed by Jason Lowe 
(cherry picked from commit 704267cb4909bf9968dd30067617f74543e07ffb)
 2017-09-06 15:28:45 -05:00
Varun Saxena
5323335fca YARN-7152. [ATSv2] Registering timeline client before AMRMClient service init throw exception (Rohith Sharma K S via Varun Saxena) 
(cherry picked from commit ef87d34a0e96f6b6390b7086c4ea2d5b7a4c2754)
 2017-09-04 20:21:08 +05:30
Oleg Danilov
305528768c
YARN-7023. Incorrect ReservationId.compareTo() implementation. 
This closes #262

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit c5281a85e108c7cab6e84dfe351843483d720b9b)
 2017-09-01 21:35:03 +02:00
Jason Lowe
99a7f5d451 YARN-7120. CapacitySchedulerPage NPE in "Aggregate scheduler counts" section. Contributed by Eric Payne 2017-09-01 11:09:14 -05:00
Sunil G
a756704f5a YARN-7071. Add vcores and number of containers in new YARN UI node heat map. Contributed by Abdullah Yousufi. 2017-09-01 20:46:39 +05:30
bibinchundatt
dcd0bedcc8 YARN-7141. Move logging APIs to slf4j in timelineservice after ATSv2 merge. Contributed by Varun Saxena 2017-09-01 11:29:16 +05:30
Allen Wittenauer
0adc3a0533
YARN-6721. container-executor should have stack checking 
Signed-off-by: Chris Douglas <cdouglas@apache.org>
 2017-08-31 19:39:31 -07:00
Allen Wittenauer
190410085b
HADOOP-14364. refresh changelog/release notes with newer Apache Yetus build 
Signed-off-by: Andrew Wang <wang@apache.org>
 2017-08-31 19:06:49 -07:00
Junping Du
91cc070d67 YARN-6877. Create an abstract log reader for extendability. Contributed by Xuan Gong. 2017-08-31 16:41:43 -07:00
Subru Krishnan
bac4e8cca8 YARN-7095. Federation: routing getNode/getNodes/getMetrics REST invocations transparently to multiple RMs. (Giovanni Matteo Fumarola via Subru). 2017-08-31 15:05:41 -07:00