81da221c75
YARN-10388. RMNode updatedCapability flag not set while RecommissionNodeTransition. Contributed by Pranjal Protim Borah
2020-08-07 08:36:52 +05:30
c7e71a6c0b
YARN-10361. Make custom DAO classes configurable into RMWebApp#JAXBContextResolver.
...
Contributed by Bilwa ST.
2020-08-06 13:19:52 +05:30
5edd8b925e
YARN-4575. ApplicationResourceUsageReport should return ALL reserved resource.
...
Contributed by Bibin Chundatt and Eric Payne.
2020-08-05 18:47:49 +00:00
0277856738
YARN-10377. Fix filter index to show apps while clicking on queue in RM UI
...
Contributed by Tarun Parimi.
2020-08-04 23:10:45 +05:30
aa5afa72c5
YARN-10381. Add application attempt state in AppAttempts RM REST API
...
Contributed by Siddharth Ahuja. Reviewed by Bilwa ST.
2020-08-04 23:07:28 +05:30
ab2b3df2de
YARN-10383. YarnCommands.md is inconsistent with the source code ( #2177 )
2020-08-04 12:02:16 +09:00
eac558380f
YARN-10229. [Federation] Client should be able to submit application to RM directly using normal client conf. Contributed by Bilwa S T.
2020-08-03 12:54:36 +05:30
5323e83edf
YARN-10359. Log container report only if list is not empty. Contributed by Bilwa S T.
2020-08-01 13:03:46 +05:30
e0c9653166
YARN-1529: Add Localization overhead metrics to NM. Contributed by Jim_Brennan.
2020-07-30 15:30:22 +00:00
5d8600e80a
YARN-10369. Make NMTokenSecretManagerInRM sending NMToken for nodeId DEBUG. Contributed by Jim Brennan.
2020-07-29 23:26:08 +05:30
3eaf62726f
YARN-10343. Legacy RM UI should include labeled metrics for allocated, total, and reserved resources. Contributed by Eric Payne
2020-07-28 13:43:19 -07:00
5dadf963d3
YARN-10208. Add capacityScheduler metric for NODE_UPDATE interval. Contributed by Pranjal Protim Borah.
2020-07-28 11:55:47 +05:30
60a254621a
YARN-10366. Fix Yarn rmadmin help message shows two labels for one node for --replaceLabelsOnNode.
...
Contributed by Tanu Ajmera.
2020-07-27 12:23:21 +05:30
d02be17a26
YARN-10362. Javadoc for TimelineReaderAuthenticationFilterInitializer is broken. Contributed by Xieming Li.
2020-07-27 01:55:04 +09:00
ac5f21dbef
YARN-4771. Some containers can be skipped during log aggregation after NM
...
restart. Contributed by Jason Lowe and Jim Brennan.
2020-07-24 22:35:16 +00:00
247eb0979b
YARN-10319. Record Last N Scheduler Activities from ActivitiesManager
...
Reviewed by Tao Yang and Adam Antal.
2020-07-24 11:43:31 +05:30
bfcd775381
YARN-10315. Avoid sending RMNodeResourceupdate event if resource is same. Contributed by Sushil Ks.
2020-07-23 16:41:35 +05:30
1b29c9bfee
HADOOP-17138. Fix spotbugs warnings surfaced after upgrade to 4.0.6. ( #2155 )
2020-07-22 13:40:20 +09:00
736bed6d6d
[YARN-10353] Log vcores used and cumulative cpu in containers monitor.
...
Contributed by Jim Brennan
2020-07-20 18:08:27 +00:00
6bcb24d269
HADOOP-17100. Replace Guava Supplier with Java8+ Supplier in Hadoop. Contributed by Ahmed Hussein.
2020-07-18 14:33:43 +05:30
cc71d50b21
YARN-10339. Fix TimelineClient in NodeManager failing when Simple Http Auth used in Secure Cluster
...
Contributed by Tarun Parimi.
2020-07-16 23:36:49 +05:30
1f71c4ae71
HADOOP-17099. Replace Guava Predicate with Java8+ Predicate
...
Signed-off-by: Jonathan Eagles <jeagles@gmail.com>
2020-07-15 11:39:06 -05:00
98fcffe93f
HADOOP-17101. Replace Guava Function with Java8+ Function
...
Signed-off-by: Jonathan Eagles <jeagles@gmail.com>
2020-07-15 09:53:18 -05:00
8980c23fc2
YARN-10350. TestUserGroupMappingPlacementRule fails
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2020-07-15 14:31:34 +09:00
48f90115b5
YARN-10348. Allow RM to always cancel tokens after app completes. Contributed by
...
Jim Brennan
2020-07-13 23:10:39 +00:00
0427100b75
YARN-10297. TestContinuousScheduling#testFairSchedulerContinuousSchedulingInitTime fails intermittently. Contributed by Jim Brennan (Jim_Brennan)
2020-07-13 18:57:50 +00:00
f91a8ad88b
HADOOP-17079. Optimize UGI#getGroups by adding UGI#getGroupsSet. ( #2085 )
2020-07-09 11:33:37 -07:00
5dd270e208
YARN-10333. YarnClient obtain Delegation Token for Log Aggregation Path. Contributed by Prabhu Joseph.
2020-07-09 12:50:25 +05:30
dfe60392c9
YARN-10341. Yarn Service Container Completed event doesn't get processed. Contributed by Bilwa S T.
2020-07-09 12:34:52 +05:30
10d218934c
YARN-10344. Sync netty versions in hadoop-yarn-csi. ( #2126 )
2020-07-09 10:29:47 +05:30
3a4d05b850
YARN-8047. RMWebApp make external class pluggable.
...
Contributed by Bilwa S T.
2020-07-08 12:43:20 +05:30
2bbd00dff4
YARN-10337. Fix failing testcase TestRMHATimelineCollectors.
...
Contributed by Bilwa S T.
2020-07-07 17:10:59 +05:30
639acb6d89
HADOOP-17111. Replace Guava Optional with Java8+ Optional. Contributed by Ahmed Hussein.
2020-07-06 16:08:36 +09:00
04abd0eb17
YARN-10330. Add missing test scenarios to TestUserGroupMappingPlacementRule and TestAppNameMappingPlacementRule. Contributed by Peter Bacsko
2020-07-01 14:10:55 +02:00
9b5557a9e8
YARN-10325. Document max-parallel-apps for Capacity Scheduler. Contributed by Peter Bacsko
2020-07-01 13:41:30 +02:00
e8dc862d38
YARN-9809. Added node manager health status to resource manager registration call.
...
Contributed by Eric Badger via eyang
2020-06-30 11:39:16 -07:00
cd188ea9f0
YARN-10331. Upgrade node.js to 10.21.0. ( #2106 )
2020-06-30 16:52:57 +09:00
74fc13cf91
YARN-9903: Support reservations continue looking for Node Labels. Contributed by Jim Brennan (Jim_Brennan).
2020-06-29 18:39:53 +00:00
0be26811f3
YARN-10328. Fixed ZK Curator NodeExists exception in YARN service AM logs
...
Contributed by Bilwa S T via eyang
2020-06-29 09:21:24 -07:00
2c03524fa4
YARN-6526. Refactoring SQLFederationStateStore by avoiding to recreate a connection at every call. COntributed by Bilwa S T.
2020-06-26 20:43:27 +05:30
e0c1d8a969
YARN-10327. Remove duplication of checking for invalid application ID in TestLogsCLI. Contributed by Marton Hudaky
2020-06-26 13:21:55 +02:00
6459cc73e6
YARN-10318. ApplicationHistory Web UI incorrect column indexing. Contributed by Andras Gyori
2020-06-26 13:15:14 +02:00
33d3df7ee2
YARN-10277. CapacityScheduler test TestUserGroupMappingPlacementRule should build proper hierarchy. Contributed by Szilard Nemeth
2020-06-26 11:14:24 +02:00
6a8fd73b27
YARN-10279. Avoid unnecessary QueueMappingEntity creations. Contributed by Marton Hudaky
2020-06-25 17:27:58 +02:00
03f855e3e7
YARN-10316. FS-CS converter: convert maxAppsDefault, maxRunningApps settings. Contributed by Peter Bacsko
2020-06-23 12:13:04 +02:00
ce1008fe61
YARN-10321. Break down TestUserGroupMappingPlacementRule#testMapping into test scenarios
...
Contributed by Szilard Nemeth. Reviewed by Gergely Pollak.
2020-06-22 12:49:14 +05:30
b2facc84a1
YARN-9460. QueueACLsManager and ReservationsACLManager should not use instanceof checks. Contributed by Bilwa S T.
2020-06-20 20:09:31 +05:30
469841446f
YARN-9930. Support max running app logic for CapacityScheduler. Contributed by Peter Bacsko
2020-06-19 14:50:24 +02:00
89689c52c3
YARN-10308. Update javadoc and variable names for YARN service.
...
Contributed by Bilwa S T via eyang
2020-06-17 09:04:26 -07:00
5b1a56f9f1
YARN-10281. Redundant QueuePath usage in UserGroupMappingPlacementRule and AppNameMappingPlacementRule. Contributed by Gergely Pollak
2020-06-17 14:34:40 +02:00
e154084770
HADOOP-17046. Support downstreams' existing Hadoop-rpc implementations using non-shaded protobuf classes ( #2026 )
2020-06-12 23:16:33 +05:30
7c4de59fc1
YARN-10293. Reserved Containers not allocated from available space of other nodes in CandidateNodeSet for MultiNodePlacement. Contributed by Prabhu Joseph.
2020-06-12 22:10:25 +08:00
fed6fecd3a
YARN-10312. Add support for yarn logs -logFile to retain backward compatibility.
...
Contributed by Jim Brennan.
2020-06-11 21:02:41 +00:00
56247db302
YARN-10300: appMasterHost not set in RM ApplicationSummary when AM fails before first heartbeat. Contributed by Eric Badger (ebadger).
2020-06-09 18:43:16 +00:00
8abff5151a
YARN-10292. FS-CS converter: add an option to enable asynchronous scheduling in CapacityScheduler. Contributed by Benjamin Teke
2020-06-05 15:00:39 +02:00
8b146c17b3
YARN-10274. Merge QueueMapping and QueueMappingEntity. Contributed by Gergely Pollak
2020-06-05 11:38:32 +02:00
a4835db95a
YARN-10296. Make ContainerPBImpl#getId/setId synchronized. Contributed by Benjamin Teke
2020-06-05 10:11:40 +02:00
b5efdea4fd
YARN-10254. CapacityScheduler incorrect User Group Mapping after leaf queue change. Contributed by Gergely Pollak
2020-06-02 18:29:15 +02:00
aa6d13455b
YARN-10284. Add lazy initialization of LogAggregationFileControllerFactory in LogServlet. Contributed by Adam Antal
2020-06-02 15:53:48 +02:00
e0a0741ac8
YARN-10286. PendingContainers bugs in the scheduler outputs. Contributed by Andras Gyori
2020-06-02 15:42:39 +02:00
593af878c0
YARN-10108. FS-CS converter: nestedUserQueue with default rule results in invalid queue mapping. Contributed by Gergely Pollak
2020-05-27 13:05:52 +02:00
fb030f3239
Revert "FS-CS converter: nestedUserQueue with default rule results in invalid queue mapping. Contributed by Gergely Pollak"
...
This reverts commit ac4540dd8e
2020-05-27 13:04:48 +02:00
c30c23cb66
YARN-6492. Generate queue metrics for each partition. Contributed by Manikandan R
2020-05-26 16:29:42 -07:00
ac4540dd8e
FS-CS converter: nestedUserQueue with default rule results in invalid queue mapping. Contributed by Gergely Pollak
2020-05-21 13:11:44 +02:00
726b8e324b
YARN-10228. Relax restriction of file path character in yarn.service.am.java.opts.
...
Contributed by Bilwa S T via eyang
2020-05-20 09:23:56 -07:00
cef0756929
YARN-9606. Set sslfactory for AuthenticatedURL() while creating LogsCLI#webServiceClient.
...
Contributed by Bilwa S T. Reviewed by Akira Ajisaka.
2020-05-20 11:36:52 +05:30
b65815d691
Revert "YARN-9606. Set sslfactory for AuthenticatedURL() while creating LogsCLI#webServiceClient."
...
This reverts commit 7836bc4c35
2020-05-18 16:29:07 +09:00
7836bc4c35
YARN-9606. Set sslfactory for AuthenticatedURL() while creating LogsCLI#webServiceClient.
...
Contributed by Bilwa S T. Reviewed by Brahma Reddy Battula.
2020-05-14 19:40:42 +05:30
6ce295b787
YARN-10259. Fix reservation logic in Multi Node Placement.
...
Reviewed by Wangda Tan.
2020-05-14 16:52:11 +05:30
1958cb7c2b
YARN-10265. Upgrade Netty-all dependency to latest version 4.1.50 to fix ARM support issue. Contributed by liusheng
2020-05-14 15:09:34 +05:30
0918433b4d
YARN-9898. Dependency netty-all-4.1.27.Final doesn't support ARM platform. Contributed by liusheng.
2020-05-14 00:36:20 +05:30
108ecf992f
YARN-8942. PriorityBasedRouterPolicy throws exception if all sub-cluster weights have negative value. Contributed by Bilwa S T.
2020-05-13 10:04:12 -07:00
450e5aa9dd
YARN-10154. Addendum Patch which fixes below bugs
...
1. RM fails to start when LeafQueueTemplate max capacity is not specified.
2. Job stuck in ACCEPTED state with DominantResourceCalculator as Queue
Capacity is set to NaN during RM startup with clusterResource is zero.
Reviewed by Sunil G and Manikandan R.
2020-05-13 14:35:37 +05:30
fff1d2c122
YARN-10260. Allow transitioning queue from DRAINING to RUNNING state. Contributed by Bilwa S T
2020-05-12 10:48:54 -07:00
a3f945fb84
HADOOP-17035. fixed typos (timeout, interruped) ( #2007 )
...
Co-authored-by: Sungpeo Kook <elixir.kook@kakaocorp.com>
2020-05-12 10:50:04 -05:00
35010120fb
YARN-9017. PlacementRule order is not maintained in CS. Contributed by Bilwa S T.
2020-05-06 13:22:54 -07:00
92e3ebb401
YARN-8959. TestContainerResizing fails randomly (Ahmed Hussein via jeagles)
...
Signed-off-by: Jonathan Eagles <jeagles@gmail.com>
2020-05-06 12:27:17 -05:00
cb6399c109
YARN-10257. FS-CS converter: skip increment properties for mem/vcores and fix DRF check. Contributed by Peter Bacsko
2020-05-05 16:00:43 +02:00
0debe55d6c
YARN-10160. Add auto queue creation related configs to RMWebService#CapacitySchedulerQueueInfo. Contributed by Prabhu Joseph
2020-05-05 13:11:28 +02:00
f5081a9a5d
YARN-10256. Refactor TestContainerSchedulerQueuing.testContainerUpdateExecTypeGuaranteedToOpportunistic (Ahmed Hussein via jeagles)
...
Signed-off-by: Jonathan Eagles <jeagles@gmail.com>
2020-05-04 10:13:51 -05:00
257b04ce4e
YARN-6553. Replace MockResourceManagerFacade with MockRM for AMRMProxy/Router tests. Contributed by Bilwa S T.
2020-05-02 12:43:20 +05:30
d125d39108
YARN-6973. Adding RM Cluster Id in ApplicationReport. Contributed by Bilwa S T.
2020-04-29 11:23:58 -07:00
410c605aec
YARN-10247. Application priority queue ACLs are not respected. Contributed by Sunil G
2020-04-29 15:53:30 +02:00
ab36429559
YARN-10215. Endpoint for obtaining direct URL for the logs. Contributed by Andras Gyori
2020-04-28 18:53:28 +02:00
6ef01646ba
YARN-9848. Revert YARN-4946. Contributed by Steven Rand.
2020-04-28 05:35:36 +09:00
9224568b0e
YARN-10156. Destroy Jersey Client in TimelineConnector.
...
Contributed by Tanu Ajmera.
2020-04-27 18:49:15 +05:30
f91e21ac10
YARN-10194. YARN RMWebServices /scheduler-conf/validate leaks ZK Connections. Contributed by Prabhu Joseph
2020-04-27 08:26:11 +02:00
d4874585f4
YARN-10237. Add isAbsoluteResource config for queue in scheduler response. Contributed by Prabhu Joseph
2020-04-24 17:04:47 +02:00
9827ff2961
YARN-10223. Remove jersey-test-framework-core dependency from yarn-server-common. ( #1939 )
2020-04-24 09:32:25 +09:00
60fa15366e
YARN-10240. Prevent Fatal CancelledException in TimelineV2Client when stopping
...
Contributed by Tarun Parimi.
2020-04-21 12:01:33 +05:30
92b28e38b7
YARN-9996. Code cleanup in QueueAdminConfigurationMutationACLPolicy. Contributed by Siddharth Ahuja
2020-04-18 10:13:37 +02:00
76900b4f5b
YARN-10189. Code cleanup in LeveldbRMStateStore. Contributed by Benjamin Teke
2020-04-18 09:57:27 +02:00
3601054822
YARN-9954. Configurable max application tags and max tag length. Contributed by Bilwa S T
2020-04-17 10:34:44 -07:00
2fe122e322
YARN-10154. CS Dynamic Queues cannot be configured with absolute resources. Contributed by Manikandan R.
2020-04-17 18:51:19 +05:30
4db598e0e6
YARN-9999. TestFSSchedulerConfigurationStore: Extend from ConfigurationStoreBaseTest, general code cleanup. Contributed by Benjamin Teke
2020-04-15 13:18:44 +02:00
94f7470c71
YARN-10233. Fix YARN UI2 Daemon Logs
...
Contributed by Akhil PB.
2020-04-15 13:39:37 +05:30
55fcbcb5c2
YARN-10234. FS-CS converter: don't enable auto-create queue property for root. Contributed by Peter Bacsko
2020-04-15 07:24:04 +02:00
c791b0e90e
YARN-10219. Fix YARN Native Service Placement Constraints with Node Attributes.
...
Contributed by Eric Yang.
2020-04-14 12:34:53 +05:30
23481ad378
YARN-10212. Create separate configuration for max global AM attempts. Contributed by Bilwa S T
2020-04-09 11:06:11 -07:00
c04a484aed
YARN-9995. Code cleanup in TestSchedConfCLI. Contributed by Bilwa S T.
2020-04-09 15:46:25 +02:00
bibinchundatt
Prabhu Joseph
Eric Badger
kevinzhao1661
Brahma Reddy Battula
Eric E Payne
Jonathan Hung
Akira Ajisaka
Masatake Iwasaki
Ayush Saxena
Ahmed Hussein
Bilwa S T
Xiaoyu Yao
Sunil G
Szilard Nemeth
Eric Yang
Surendra Singh Lilhore
Vinayakumar B
Tao Yang
Prabhu Joseph
Inigo Goiri
Elixir Kook
Prabhu Joseph