80182809ae
YARN-4863. AHS Security login should be in serviceInit() instead of serviceStart(). Contributed by Junping Du
2016-03-28 22:17:45 -07:00
948b758070
YARN-4773. Log aggregation performs extraneous filesystem operations when rolling log aggregation is disabled. Contributed by Jun Gong
2016-03-28 23:00:56 +00:00
524bc3c33a
YARN-998. Keep NM resource updated through dynamic resource config for RM/NM restart. Contributed by Junping Du
2016-03-28 11:12:33 -07:00
8831b18c65
Missing file for YARN-4117.
2016-03-28 09:59:47 -07:00
55ae143923
YARN-4117. End to end unit test with mini YARN cluster for AMRMProxy Service. Contributed by Giovanni Matteo Fumarola
2016-03-27 20:22:12 -07:00
49ff54c860
YARN-4805. Don't go through all schedulers in ParameterizedTestBase. (kasha)
2016-03-26 21:45:13 -07:00
00bebb7e58
YARN-4823. Refactor the nested reservation id field in listReservation to simple string field. (subru via asuresh)
2016-03-25 15:54:38 -07:00
e8fc81f9c8
YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. Contributed by Xuan Gong
2016-03-25 20:15:49 +00:00
2e1d0ff4e9
YARN-4687. Document Reservation ACLs (Contributed by Sean Po)
2016-03-24 10:40:51 -07:00
d820975c1a
YARN-4683. Document the List Reservations REST API. (Contributed by Sean Po)
2016-03-24 10:30:29 -07:00
d82e797b65
YARN-4825. Remove redundant code in ClientRMService::listReservations. (subru via asuresh)
2016-03-24 09:59:55 -07:00
b1394d6307
YARN-4850. test-fair-scheduler.xml isn't valid xml (Yufei Gu via aw)
2016-03-24 08:15:58 -07:00
19b645c938
YARN-4820. ResourceManager web redirects in HA mode drops query parameters. Contributed by Varun Vasudev.
2016-03-23 19:34:30 -07:00
738155063e
HADOOP-12857. rework hadoop-tools (aw)
2016-03-23 13:46:38 -07:00
af1d125f9c
YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. Contributed by Xuan Gong.
2016-03-23 08:57:16 -07:00
7fae4c68e6
YARN-4732. *ProcessTree classes have too many whitespace issues
2016-03-20 10:47:38 -07:00
92b7e0d413
YARN-4686. MiniYARNCluster.start() returns before cluster is completely started. Contributed by Eric Badger.
2016-03-18 16:12:47 +00:00
ca8106d2dd
YARN-4785. inconsistent value type of the type field for LeafQueueInfo in response of RM REST API.
2016-03-17 09:04:41 -07:00
f84af8bd58
YARN-4812. TestFairScheduler#testContinuousScheduling fails intermittently. (kasha)
2016-03-17 05:54:06 -07:00
ae14e5d07f
YARN-4108. CapacityScheduler: Improve preemption to only kill containers that would satisfy the incoming request. (Wangda Tan)
...
(cherry picked from commit 7e8c9beb41
2016-03-16 17:02:33 -07:00
fa7a43529d
Revert "CapacityScheduler: Improve preemption to only kill containers that would satisfy the incoming request. (Wangda Tan)"
...
This reverts commit 7e8c9beb41
2016-03-16 17:02:10 -07:00
7e8c9beb41
CapacityScheduler: Improve preemption to only kill containers that would satisfy the incoming request. (Wangda Tan)
2016-03-16 16:59:59 -07:00
3ef5500783
YARN-4560. Make scheduler error checking message more user friendly. (Ray Chiang via kasha)
2016-03-15 23:45:01 -07:00
a888b5bc53
Revert "YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. (Xuan Gong via gtcarrera9)"
...
This reverts commit 3a0b695441
2016-03-15 22:10:39 -07:00
5176a69868
YARN-4817. Change Log Level to DEBUG for putDomain call in ATS 1.5. (Xuan Gong via gtcarrera9)
2016-03-15 11:47:39 -07:00
3a0b695441
YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. (Xuan Gong via gtcarrera9)
2016-03-15 11:40:54 -07:00
22ca176dfe
TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IllegalArgumentException from cleanup (templedf via rkanter)
2016-03-15 10:05:10 -07:00
eba66a64d2
YARN-4816. Fix incompatible change in SystemClock.
2016-03-14 20:14:33 -07:00
20d389ce61
YARN-4719. Add a helper library to maintain node state and allows common queries. (kasha)
2016-03-14 14:19:05 -07:00
f291d82cd4
YARN-4545. Allow YARN distributed shell to use ATS v1.5 APIs. Li Lu via junping_du
2016-03-14 08:28:38 -07:00
017d2c127b
YARN-4696. Improving EntityGroupFSTimelineStore on exception handling, test setup, and concurrency.
...
This commit amends commit d49cfb3504
2016-03-10 13:02:28 -08:00
d49cfb3504
YARN-4696. Improving EntityGroupFSTimelineStore on exception handling, test setup, and concurrency. (Steve Loughran via gtcarrera9)
2016-03-10 10:51:55 -08:00
0233d4e0ee
YARN-4465. SchedulerUtils#validateRequest for Label check should happen only when nodelabel enabled. (Bibin A Chundatt via wangda)
2016-03-08 14:27:03 -08:00
3c33158d1c
YARN-4764. Application submission fails when submitted queue is not available in scheduler xml. Contributed by Bibin A Chundatt
2016-03-08 13:07:57 -08:00
f86850b544
HADOOP-12860. Expand section "Data Encryption on HTTP" in SecureMode documentation. Contributed by Wei-Chiu Chuang.
2016-03-08 14:28:47 +09:00
b2661765a5
YARN-4762. Fixed CgroupHandler's creation and usage to avoid NodeManagers crashing when LinuxContainerExecutor is enabled. (Sidharta Seethana via vinodkv)
2016-03-07 11:08:17 -08:00
4163e36c2b
YARN-4760. proxy redirect to history server uses wrong URL. Contributed by Eric Badger
2016-03-07 15:56:33 +00:00
059caf9989
YARN-4744. Too many signal to container failure in case of LCE. Contributed by Sidharta Seethana
2016-03-07 15:40:01 +00:00
8ed2e060e8
YARN-4245. Generalize config file handling in container-executor. Contributed by Sidharta Seethana.
2016-03-07 16:18:35 +05:30
e51a8c1056
YARN-4737. Add CSRF filter support in YARN. Contributed by Jonathan Maron.
2016-03-07 15:26:44 +05:30
e1ccc9622b
YARN-4761. NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations on fair scheduler. Contributed by Sangjin Lee
2016-03-06 19:46:09 -08:00
19ee185907
YARN-4763. RMApps Page crashes with NPE. (Bibin A Chundatt via rohithsharmaks)
2016-03-05 13:02:57 +05:30
cbd31328a6
HADOOP-12470. In-page TOC of documentation should be automatically generated by doxia macro (iwasakims)
2016-03-04 14:11:36 +09:00
5c465df904
YARN-4671. There is no need to acquire CS lock when completing a container. Contributed by Meng Ding
2016-03-01 13:14:12 -08:00
d93c22ec27
YARN-4748. ApplicationHistoryManagerOnTimelineStore should not swallow exceptions on generateApplicationReport. Contributed by Li Lu
2016-02-29 18:19:09 -08:00
9dafaaaf0d
YARN-4704. TestResourceManager#testResourceAllocation() fails when using FairScheduler. (Yufei Gu via kasha)
2016-02-29 16:10:12 -08:00
0fa54d45b1
HADOOP-12813. Migrate TestRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng.
2016-02-29 11:41:00 -08:00
c58a6d53c5
YARN-4731. container-executor should not follow symlinks in recursive_unlink_children. Contributed by Colin Patrick McCabe
2016-02-29 15:24:35 +00:00
e0b14f26f5
YARN-4566. Fix test failure in TestMiniYarnClusterNodeUtilization. (Takashi Ohnishi via rohithsharmaks)
2016-02-29 10:38:14 +08:00
f9692770a5
YARN-4718. Rename variables in SchedulerNode to reduce ambiguity post YARN-1011. (Inigo Goiri via kasha)
2016-02-28 09:35:59 -08:00
6b0f813e89
YARN-4723. NodesListManager$UnknownNodeId ClassCastException. Contributed by Kuhu Shukla
2016-02-26 20:24:50 +00:00
7f3139e54d
YARN-4720. Skip unnecessary NN operations in log aggregation. (Jun Gong via mingma)
2016-02-26 08:40:05 -08:00
d7fdec1e6b
YARN-4579. Allow DefaultContainerExecutor container log directory permissions to be configurable (rchiang via rkanter)
2016-02-25 16:36:38 -08:00
c4d4df8de0
YARN-4701. When task logs are not available, port 8041 is referenced instead of port 8042 (haibochen via rkanter)
2016-02-25 12:48:02 -08:00
c684f2b007
YARN-4729. SchedulerApplicationAttempt#getTotalRequiredResources can throw an NPE. (kasha)
2016-02-24 18:33:57 -08:00
954dd57043
YARN-4697. NM aggregation thread pool is not bound by limits (haibochen via rkanter)
2016-02-24 15:00:24 -08:00
9e0f7b8b69
YARN-4680. TimerTasks leak in ATS V1.5 Writer. (Xuan Gong via
...
gtcarrera9)
2016-02-24 13:43:09 -08:00
553b591ba0
YARN-4722. AsyncDispatcher logs redundant event queue sizes (Jason Lowe via sjlee)
2016-02-24 09:29:41 -08:00
d284e187b8
YARN-2046. Out of band heartbeats are sent only on container kill and possibly too early. Contributed by Ming Ma
2016-02-23 20:49:09 +00:00
9ed17f181d
YARN-3223. Resource update during NM graceful decommission. Contributed by Brook Zhou.
2016-02-23 03:30:26 -08:00
0e12114c9c
YARN-4648. Move preemption related tests from TestFairScheduler to TestFairSchedulerPreemption. Contributed by Kai Sasaki.
2016-02-23 19:50:08 +09:00
de09f41147
YARN-4651. Document movetoqueue option in 'YARN Commands'. (Takashi Ohnishi via rohithsharmaks)
2016-02-23 18:03:42 +08:00
140cb5d745
YARN-4709. NMWebServices produces incorrect JSON for containers. Contributed by Varun Saxena.
2016-02-23 12:29:25 +05:30
a2fdfff02d
HADOOP-12668. Support excluding weak Ciphers in HttpServer2 through ssl-server.conf. Contributed by Vijay Singh.
...
Change-Id: Ie46a5427d29188935427f67e55203c19fcd83335
2016-02-22 14:13:54 -08:00
3fab88540f
YARN-4386. refreshNodesGracefully() should send recommission event to active RMNodes only. Contributed by Kuhu Shukla.
2016-02-22 07:04:19 -08:00
5e7d4d51f8
YARN-4707. Remove the extra char (>) from SecureContainer.md. Contributed by Brahma Reddy Battula.
2016-02-22 17:17:40 +09:00
b68901d7dd
YARN-4708. Missing default mapper type in TimelineServer performance test tool usage. Contributed by Kai Sasaki.
2016-02-22 07:54:53 +09:00
c1afac3a98
YARN-4654. Yarn node label CLI should parse "=" correctly when trying to remove all labels on a node. (Naganarasimha G R via rohithsharmaks)
2016-02-18 14:10:37 +05:30
7de70680fe
YARN-4690. Skip object allocation in FSAppAttempt#getResourceUsage when possible (Ming Ma via sjlee)
2016-02-17 20:55:21 -08:00
a0c95b5fc4
YARN-4569. Remove incorrect part of maxResources in FairScheduler documentation. (Ray Chiang via kasha)
2016-02-17 18:36:12 -08:00
2ab4c476ed
YARN-4689. FairScheduler: Cleanup preemptContainer to be more readable. (Kai Sasaki via kasha)
2016-02-17 18:16:15 -08:00
dea90c9a86
YARN-4653. Document YARN security model from the perspective of Application Developers. Contributed by Steve Loughran
2016-02-14 17:13:15 +08:00
51fc7f5427
YARN-4682. AMRM client to log when AMRM token updated. (Prabhu Joseph via stevel)
2016-02-12 11:02:08 +00:00
2fb423e195
YARN-4684. TestYarnCLI#testGetContainers failing in CN locale. Contributed by Bibin A Chundatt.
2016-02-12 12:06:55 +05:30
23f937e3b7
YARN-2575. Create separate ACLs for Reservation create/update/delete/list ops (Sean Po via asuresh)
2016-02-11 10:47:43 -08:00
fa00d3e205
YARN-4655. Log uncaught exceptions/errors in various thread pools in YARN. Contributed by Sidharta Seethana.
2016-02-11 12:06:42 +05:30
663a80031c
YARN-4628. Display application priority in yarn top. Contributed by Bibin A Chundatt.
2016-02-11 11:56:09 +05:30
d16b17b4d2
YARN-4138. Roll back container resource allocation after resource increase token expires. Contributed by Meng Ding
2016-02-11 10:06:27 +08:00
b706cbc1bc
YARN-4420. Add REST API for List Reservations (Sean Po via curino)
2016-02-10 10:19:26 -08:00
5cf5c41a89
YARN-4360. Improve GreedyReservationAgent to support "early" allocations, and performance improvements (curino via asuresh)
2016-02-10 09:11:15 -08:00
e9a622606f
YARN-4629. Distributed shell breaks under strong security. (Daniel Templeton via stevel)
2016-02-10 13:01:10 +00:00
565af873d5
YARN-4667. RM Admin CLI for refreshNodesResources throws NPE when nothing
...
is configured. Contributed by Naganarasimha G R.
2016-02-08 15:01:54 +05:30
22a2b2231d
YARN-4669. Fix logging statements in resource manager's Application class. Contributed by Sidharta Seethana.
2016-02-04 13:51:25 +05:30
308d63f382
YARN-4307. Display blacklisted nodes for AM container in the RM web UI. Contributed by Naganarasimha G R.
2016-02-04 13:32:54 +05:30
fa328e2d39
YARN-4594. container-executor fails to remove directory tree when chmod required. Contributed by Colin Patrick McCabe
2016-02-03 17:21:12 +00:00
1adb64e09b
YARN-4625. Make ApplicationSubmissionContext and ApplicationSubmissionContextInfo more consistent. Contributed by Xuan Gong.
2016-02-03 16:26:28 +05:30
db144eb1c5
YARN-4100. Add Documentation for Distributed and Delegated-Centralized
...
Node Labels feature. Contributed by Naganarasimha G R.
2016-02-02 12:06:51 +05:30
1cd55e0c17
YARN-4649. Add additional logging to some NM state store operations. Contributed by Sidharta Seethana
2016-02-02 09:25:23 +05:30
9875325d5c
YARN-4340. Add list API to reservation system. (Sean Po via wangda)
2016-02-02 10:17:33 +08:00
ed55950164
YARN-3102. Decommisioned Nodes not listed in Web UI. Contributed by Kuhu Shukla
2016-02-01 23:15:26 +00:00
2673cbaf55
YARN-4615. Fix random test failure in TestAbstractYarnScheduler#testResourceRequestRecoveryToTheRightAppAttempt. (Sunil G via rohithsharmaks)
2016-02-01 10:43:56 +05:30
772ea7b41b
YARN-4428. Redirect RM page to AHS page when AHS turned on and RM page is not available. Contributed by Chang Li
2016-01-29 21:48:54 +00:00
f4a57d4a53
YARN-4617. LeafQueue#pendingOrderingPolicy should always use fixed ordering policy instead of using same as active applications ordering policy. Contributed by Rohith Sharma K S
2016-01-29 12:22:23 -08:00
c9a09d6926
YARN-4647. Make RegisterNodeManagerRequestPBImpl thread-safe. (kasha)
2016-01-29 08:12:54 -08:00
a277bdc9ed
YARN-4411. RMAppAttemptImpl#createApplicationAttemptReport throws
...
IllegalArgumentException. Contributed by Bibin A Chundatt and yarntime.
2016-01-29 13:51:37 +05:30
ac68666803
YARN-4543. Fix random test failure in TestNodeStatusUpdater.testStopReentrant. (Akihiro Suda via rohithsharmaks)
2016-01-29 12:29:54 +05:30
09d831c95b
YARN-4219. addendum patch to fix javadoc errors
2016-01-29 11:51:47 +05:30
7f46636495
YARN-4519. Potential deadlock of CapacityScheduler between decrease container and assign containers. Contributed by Meng Ding
2016-01-28 14:51:00 -08:00
9fab22b366
YARN-4219. New levelDB cache storage for timeline v1.5. Contributed by
...
Li Lu
2016-01-28 14:24:22 -08:00
61382ff8fa
YARN-4643. Container recovery is broken with delegating container runtime. Contributed by Sidharta Seethana
2016-01-28 18:59:35 +00:00
ef343be82b
YARN-4633. Fix random test failure in TestRMRestart#testRMRestartAfterPreemption. (Bibin A Chundatt via rohithsharmaks)
2016-01-28 21:53:45 +05:30
fb238d7e5d
YARN-4462. FairScheduler: Disallow preemption from a queue. (Tao Jie via kasha)
2016-01-27 12:29:06 -08:00
c01bee0108
YARN-4573. Fix test failure in TestRMAppTransitions#testAppRunningKill and testAppKilledKilled. (Takashi Ohnishi via rohithsharmaks)
2016-01-27 08:23:02 +05:30
2085e60a96
YARN-3542. Refactored existing CPU cgroups support to use the newer and integrated ResourceHandler mechanism, and also deprecated the old LCEResourceHandler inteface hierarchy. Contributed by Varun Vasudev.
2016-01-25 16:19:36 -08:00
992dd2f783
YARN-4520. Finished app info is unnecessarily persisted in NM state-store if container is acquired but not lunched on this node. Contributed by sandflee
2016-01-25 15:36:14 -08:00
56a0c17508
YARN-4592. Remove unused GetContainerStatus proto. Contributed by Chang Li.
2016-01-25 15:20:29 +09:00
10dc2c0493
YARN-4613. Fix test failure in TestClientRMService#testGetClusterNodes. (Takashi Ohnishi via rohithsharmaks)
2016-01-24 23:36:15 +05:30
99829eb221
YARN-4614. Fix random failure in TestApplicationPriority#testApplicationPriorityAllocationWithChangeInPriority. (Sunil G via rohithsharmaks)
2016-01-23 07:56:57 +05:30
618bfd6ac2
YARN-4496. Improve HA ResourceManager Failover detection on the client.
...
Contributed by Jian He
2016-01-22 18:20:38 -08:00
46e5ea81e0
YARN-4598. Invalid event: RESOURCE_FAILED at CONTAINER_CLEANEDUP_AFTER_KILL. Contributed by tangshangwen
2016-01-22 21:55:01 +00:00
e91e8b711c
YARN-4371. "yarn application -kill" should take multiple application ids. Contributed by Sunil G
2016-01-22 21:36:15 +00:00
34a3900773
YARN-4574. Fix random failure in TestAMRMClientOnRMRestart. (Takashi Ohnishi via rohithsharmaks)
2016-01-22 21:17:37 +05:30
d6258b33a7
YARN-4497. RM might fail to restart when recovering apps whose attempts are missing. (Jun Gong via rohithsharmaks)
2016-01-22 20:27:38 +05:30
8f58f742ae
YARN-4605. Spelling mistake in the help message of "yarn applicationattempt" command. Contributed by Weiwei Yang.
2016-01-22 19:43:06 +09:00
b41a7e89d1
YARN-4578. Directories that are mounted in docker containers need to be more restrictive/container-specific. Contributed by Sidharta Seethana.
2016-01-22 14:43:14 +05:30
e30668106d
YARN-4584. RM startup failure when AM attempts greater than max-attempts. (Bibin A Chundatt via rohithsharmaks)
2016-01-22 10:14:46 +05:30
468a53b22f
YARN-4610. Reservations continue looking for one app causes other apps to starve. Contributed by Jason Lowe
2016-01-21 18:31:29 +00:00
3ac9511da2
YARN-4608. Redundant code statement in WritingYarnApplications. Contributed by Kai Sasaki.
2016-01-22 02:14:31 +09:00
4992398aee
YARN-4603. FairScheduler should mention user requested queuename in error message when failed in queue ACL check. (Tao Jie via kasha)
2016-01-21 17:40:59 +01:00
f858ac2426
YARN-4492. Add documentation for preemption supported in Capacity scheduler. Contributed by Naganarasimha G R
2016-01-21 15:38:40 +00:00
5ff5f67332
YARN-4557. Fix improper Queues sorting in PartitionedQueueComparator when accessible-node-labels=*. (Naganarasimha G R via wangda)
2016-01-21 11:21:06 +08:00
890a2ebd1a
YARN-4559. Make leader elector and zk store share the same curator
...
client. Contributed by Jian He
2016-01-20 14:48:10 -08:00
89d1fd5dac
HADOOP-12356. Fix computing CPU usage statistics on Windows. (Inigo Goiri via wangda)
2016-01-19 21:27:38 +08:00
edc43a9097
YARN-4565. Fix a bug that leads to AM resource limit not hornored when sizeBasedWeight enabled for FairOrderingPolicy. Contributed by Wangda Tan
2016-01-18 21:04:36 -08:00
a44ce3f14f
YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)
2016-01-19 09:30:04 +08:00
150f5ae034
Revert "YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)"
...
This reverts commit 3fe5728563
2016-01-19 09:27:36 +08:00
f385851141
YARN-4596. SystemMetricPublisher should not swallow error messages from TimelineClient#putEntities. Contributed by Li Lu
2016-01-18 16:58:39 -08:00
d40859fab1
YARN-4526. Make SystemClock singleton so AppSchedulingInfo could use it. (kasha)
2016-01-18 10:58:14 +01:00
3fe5728563
YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)
...
(cherry picked from commit 805a9ed85e
2016-01-18 17:06:05 +08:00
adf260a728
Revert "YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)"
...
This reverts commit 805a9ed85e
2016-01-18 16:50:45 +08:00
b08ecf5c75
YARN-4304. AM max resource configuration per partition to be displayed/updated correctly in UI and in various partition related metrics. (Sunil G via wangda)
2016-01-18 11:11:32 +08:00
805a9ed85e
YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)
2016-01-18 11:04:25 +08:00
9523648d57
YARN-4538. QueueMetrics pending cores and memory metrics wrong. (Bibin A Chundatt via wangda)
2016-01-18 10:57:14 +08:00
02f597c5db
YARN-4265. Provide new timeline plugin storage to support fine-grained entity caching. Contributed by Li Lu and Jason Lowe
2016-01-17 17:37:40 -08:00
b2c155f810
HADOOP-12712. Fix some cmake plugin and native build warnings (cmccabe)
2016-01-15 12:29:18 -08:00
fc6d3a3b23
YARN-4581. AHS writer thread leak makes RM crash while RM is recovering. Contributed by sandflee.
2016-01-15 08:40:56 -08:00
f7736f464f
YARN-4389. Allow application to enable or disable am blacklisting. (Sunil G via rohithsharmaks)
2016-01-15 21:38:26 +05:30
b1ed28fa77
HADOOP-8887. Use a Maven plugin to build the native code using CMake (cmccabe)
2016-01-14 11:02:34 -08:00
9d04f26d4c
YARN-3446. FairScheduler headroom calculation should exclude nodes in the blacklist. (Zhihai Xu via kasha)
2016-01-14 08:33:23 -08:00
3ddb92bd30
YARN-4553. Add cgroups support for docker containers. Contributed by Sidharta Seethana.
2016-01-14 14:29:29 +05:30
62b0d61513
YARN-4534. Remove the redundant symbol in yarn rmadmin help msg. Contributed by Lin Yiqun.
2016-01-14 13:59:39 +09:00
321072ba81
YARN-4551. Address the duplication between StatusUpdateWhenHealthy and StatusUpdateWhenUnhealthy transitions. (Sunil G via kasha)
2016-01-13 12:09:34 -08:00
c0537bcd2c
YARN-4571. Make app id/name available to the yarn authorizer provider for better auditing. (Jian He via wangda)
2016-01-13 13:18:31 +08:00
13de8359a1
YARN-4414. Nodemanager connection errors are retried at multiple levels. Contributed by Chang Li
2016-01-12 15:56:15 +00:00
da1e3e3c57
YARN-4567. javadoc failing on java 8. Contributed by Steve Loughran. This closes #67 .
2016-01-12 15:12:17 +09:00
9e792da014
YARN-4582. Label-related invalid resource request exception should be able to properly handled by application. (Bibin A Chundatt via wangda)
2016-01-12 12:53:31 +08:00
56b9500bbd
HADOOP-12584. Disable browsing the static directory in HttpServer2. Contributed by Robert Kanter.
2016-01-12 13:34:18 +09:00
5fab4ec31c
Missing file for YARN-4580
2016-01-11 17:00:44 -08:00
b8942be888
YARN-4537. Pull out priority comparison from fifocomparator and use compound comparator for FifoOrdering policy. Contributed by Rohith Sharma K S
2016-01-11 16:44:28 -08:00
109e528ef5
YARN-4479. Change CS LeafQueue pendingOrderingPolicy to hornor recovered apps. Contributed by Rohith Sharma K S
2016-01-08 15:51:10 -08:00
89022f8d4b
YARN-4438. Implement RM leader election with curator. Contributed by Jian He
2016-01-07 14:33:06 -08:00
52b77577c4
YARN-4544. All the log messages about rolling monitoring interval are shown with WARN level. Contributed by Takashi Ohnishi.
2016-01-08 01:12:46 +09:00
07d1cb612c
YARN-4550. Some tests in TestContainerLanch fails on non-english locale environment. (Takashi Ohnishi via stevel)
2016-01-07 14:30:20 +00:00
791c1639ae
YARN-4393. Fix intermittent test failure for TestResourceLocalizationService#testFailedDirsResourceRelease (Varun Saxana via rohithsharmaks)
2016-01-07 09:38:47 +05:30
c1462a67ff
YARN-4546. ResourceManager crash due to scheduling opportunity overflow. Contributed by Jason Lowe.
2016-01-06 05:49:24 -08:00
6da6d87872
YARN-4535. Fix checkstyle error in CapacityScheduler.java (Naganarasimha G R via rohithsharmaks)
2016-01-05 12:09:57 +05:30
f9e36dea96
YARN-4530. LocalizedResource trigger a NPE Cause the NodeManager exit. (tangshangwen via rohithsharmaks)
2016-01-04 09:58:13 +05:30
4e4b3a8465
YARN-4524. Cleanup AppSchedulingInfo. (Karthik Kambatla via wangda)
...
(cherry picked from commit 05fa852d75
2015-12-30 15:39:34 -08:00
8310b2e9ff
YARN-4522. Queue acl can be checked at app submission. (Jian He via wangda)
2015-12-30 15:30:12 -08:00
223ce323bb
YARN-1382. Remove unusableRMNodesConcurrentSet (never used) in NodeListManager to get rid of memory leak. Contributed by Rohith Sharma K S.
2015-12-30 07:52:07 -08:00
ad997fab67
YARN-4098. Document ApplicationPriority feature. Contributed by Rohith Sharma K S
2015-12-29 16:51:55 -08:00
5273413411
YARN-3480. Remove attempts that are beyond max-attempt limit from state store. Contributed by Jun Gong
2015-12-29 15:58:39 -08:00
561abb9fee
YARN-4315. NaN in Queue percentage for cluster apps page. (Bibin A Chundatt via wangda)
2015-12-29 13:28:00 -08:00
d0a22bae9b
YARN-4417. Make RM and Timeline-server REST APIs more consistent. Contributed by Wangda Tan
2015-12-28 15:52:45 -08:00
fb00794368
YARN-2882. Add an OPPORTUNISTIC ExecutionType. (Konstantinos Karanasos and Inigo Goiri via kasha)
2015-12-26 20:22:16 -08:00
2c17b81569
YARN-2934. Improve handling of container's stderr. (Naganarasimha G R via gera)
2015-12-24 23:48:05 -08:00
0af492b4bd
YARN-4156. TestAMRestart#testAMBlacklistPreventsRestartOnSameNode assumes CapacityScheduler. (Anubhav Dhoot via kasha)
2015-12-23 17:52:36 -08:00
bb5df272b9
YARN-4400. AsyncDispatcher.waitForDrained should be final. Contributed by Daniel Templeton.
2015-12-23 08:55:12 -08:00
882f2f0464
YARN-4234. New put APIs in TimelineClient for ats v1.5. Contributed by Xuan Gong.
2015-12-23 05:26:51 -08:00
8c180a13c8
YARN-4109. Exception on RM scheduler page loading with labels. (Mohammad Shahid Khan via rohithsharmaks)
2015-12-23 09:12:32 +05:30
e88422df45
YARN-4477. FairScheduler: Handle condition which can result in an infinite loop in attemptScheduling. (Tao Jie via asuresh)
2015-12-21 22:41:09 -08:00
114b590955
YARN-3458. CPU resource monitoring in Windows. Contributed by Inigo Goiri.
2015-12-21 16:59:09 -08:00
a0de702851
YARN-4290. Add -showDetails option to YARN Nodes CLI to print all nodes reports information. (Sunil G via wangda)
2015-12-21 11:36:22 -08:00
bc038b382c
YARN-4454. NM to nodelabel mapping going wrong after RM restart. (Bibin A Chundatt via wangda)
2015-12-21 11:30:13 -08:00
0f82b5d878
YARN-4480. Clean up some inappropriate imports. (Kai Zheng via umamahesh)
2015-12-19 23:10:13 -08:00
85c2466048
YARN-4164. Changed updateApplicationPriority API to return the updated application priority. Contributed by Rohith Sharma K S
2015-12-18 14:13:48 -08:00
1de56b0448
YARN-3226. UI changes for decommissioning node. Contributed by Sunil G.
2015-12-17 15:20:17 -08:00
4e7d32c0db
YARN-1856. Added cgroups based memory monitoring for containers as another alternative to custom memory-monitoring. Contributed by Varun Vasudev.
2015-12-17 12:13:03 -08:00
91828fef6b
YARN-4461. Redundant nodeLocalityDelay log in LeafQueue. Contributed by Eric Payne
2015-12-16 23:22:31 +00:00
9b856d9787
YARN-4416. Deadlock due to synchronised get Methods in AbstractCSQueue. (Naganarasimha G R via wangda)
2015-12-16 13:22:37 -08:00
7faa406f27
YARN-4225. Add preemption status to yarn queue -status for capacity scheduler. (Eric Payne via wangda)
2015-12-16 13:19:40 -08:00
79c41b1d83
YARN-4293. ResourceUtilization should be a part of yarn node CLI. (Sunil G via wangda)
2015-12-16 13:18:19 -08:00
0f708d465f
YARN-4207. Add a non-judgemental YARN app completion status. Contributed by Rich Haase.
2015-12-16 11:33:55 -08:00
50bd067e1d
YARN-4452. NPE when submit Unmanaged application. Contributed by Naganarasimha G R.
2015-12-16 10:57:39 -08:00
2aaed10327
YARN-4440. FSAppAttempt#getAllowedLocalityLevelByTime should init the lastScheduler time. Contributed by Lin Yiqun
2015-12-15 00:17:21 -08:00
d8a45425eb
YARN-4439. Clarify NMContainerStatus#toString method. Contributed by
...
Jian He
2015-12-14 15:41:28 -08:00
915cd6c3f4
YARN-4402. TestNodeManagerShutdown And TestNodeManagerResync fails with bind exception. Contributed by Brahma Reddy Battula
2015-12-14 14:59:01 -08:00
1cb3299b48
YARN-4403. (AM/NM/Container)LivelinessMonitor should use monotonic time when calculating period. Contributed by Junping Du
2015-12-14 13:51:23 -08:00
07b0fb996a
YARN-4418. AM Resource Limit per partition can be updated to ResourceUsage as well. (Sunil G via wangda)
2015-12-14 11:24:30 -08:00
dfcbbddb09
YARN-4309. Add container launch related debug information to container logs when a container fails. (Varun Vasudev via wangda)
2015-12-14 11:13:22 -08:00
6cb0af3c39
YARN-3946. Update exact reason as to why a submitted app is in ACCEPTED state to app's diagnostic message. (Naganarasimha G R via wangda)
2015-12-14 10:52:46 -08:00
7fb212e5e6
YARN-4358 addendum patch to fix javadoc error
2015-12-12 22:22:55 -08:00
e8964589de
YARN-4341. add doc about timeline performance tool usage (Chang Li via sjlee)
2015-12-11 09:46:32 -08:00
21daa6c68a
YARN-3623-Addendum: Improve the description for Timeline Service Version configuration in yarn-default.xml
2015-12-10 10:56:12 -08:00
f910e4f639
YARN-3623. Add a config to indicate the Timeline Service version. Contributed by Xuan Gong.
2015-12-10 02:53:47 -08:00
50edcb947c
YARN-4434. NodeManager Disk Checker parameter documentation is not correct. Contributed by Weiwei Yang.
2015-12-09 16:32:33 +09:00
a5e2e1ecb0
YARN-4421. Remove dead code in RmAppImpl.RMAppRecoveredTransition. (Daniel Templeton via rohithsharmaks)
2015-12-09 11:31:51 +05:30
15c3e7ffe3
YARN-4431. Not necessary to do unRegisterNM() if NM get stop due to failed to connect to RM. (Junpin Du via rohithsharmaks)
2015-12-09 10:50:43 +05:30
7e4715186d
YARN-4424. Fix deadlock in RMAppImpl. (Jian he via wangda)
2015-12-08 14:25:16 -08:00
9f50e13d5d
YARN-4248. Followup patch adding asf-licence exclusions for json test files
2015-12-08 12:08:04 -08:00
c25a635459
YARN-4248. REST API for submit/update/delete Reservations. (curino)
2015-12-07 13:33:28 -08:00
4ff973f96a
YARN-4422. Generic AHS sometimes doesn't show started, node, or logs on App page (Eric Payne via jeagles)
2015-12-07 15:04:48 -06:00
4546c7582b
YARN-4392. ApplicationCreatedEvent event time resets after RM
...
restart/failover. Contributed by Naganarasimha G R and Xuan Gong
2015-12-07 12:24:55 -08:00
01a641bc44
YARN-3456. Improve handling of incomplete TimelineEntities. (Varun Saxena via rohithsharmaks)
2015-12-07 15:16:56 +05:30
65f395226b
HADOOP-12321. Make JvmPauseMonitor an AbstractService. (Sunil G via Stevel) [includes HDFS-8947 MAPREDUCE-6462 and YARN-4072]
2015-12-06 17:43:35 +00:00
742632e346
YARN-4358. Reservation System: Improve relationship between SharingPolicy and ReservationAgent. (Carlo Curino via asuresh)
2015-12-05 21:26:16 -08:00
e84d6ca2df
Add missing file for YARN-4419
2015-12-03 19:07:28 -08:00
755dda8dd8
YARN-4405. Support node label store in non-appendable file system. Contributed by Wangda Tan
2015-12-03 17:45:31 -08:00
a2c3bfc8c1
YARN-4292. ResourceUtilization should be a part of NodeInfo REST API. (Sunil G via wangda)
2015-12-03 14:28:32 -08:00
9f77ccad73
YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999). Contributed by Mohammad Shahid Khan and Varun Saxena
2015-12-03 12:48:50 -08:00
62e9348bc1
YARN-4408. Fix issue that NodeManager still reports negative running containers. Contributed by Robert Kanter.
2015-12-03 06:36:37 -08:00
6b9a5beb2b
YARN-4398. Remove unnecessary synchronization in RMStateStore. Contributed by Ning Ding
2015-12-02 11:07:18 -08:00
0656d2dc83
YARN-4380. TestResourceLocalizationService.testDownloadingResourcesOnContainerKill fails intermittently. Contributed by Varun Saxena.
2015-11-26 01:10:02 +09:00
23c625ec57
YARN-4384. updateNodeResource CLI should not accept negative values for resource. (Junping Du via wangda)
2015-11-24 16:35:56 -08:00
f5acf94eca
YARN-4365. FileSystemNodeLabelStore should check for root dir existence on startup. Contributed by Kuhu Shukla
2015-11-24 23:47:10 +00:00
4ac6799d4a
YARN-4132. Separate configs for nodemanager to resourcemanager connection timeout and retries. Contributed by Chang Li
2015-11-24 22:35:37 +00:00
28dfe721b8
YARN-4387. Fix typo in FairScheduler log message. Contributed by Xin Wang.
2015-11-24 19:24:01 +09:00
8c0133f3d4
YARN-4298. Fix findbugs warnings in hadoop-yarn-common. Contributed by Sunil G.
2015-11-24 18:40:33 +09:00
52948bb20b
YARN-3980. Plumb resource-utilization info in node heartbeat through to the scheduler. (Inigo Goiri via kasha)
2015-11-24 13:47:17 +05:30
8676a118a1
YARN-4349. Support CallerContext in YARN. Contributed by Wangda Tan
2015-11-23 17:19:48 -08:00
d36b6e045f
YARN-4344. NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations. Contributed by Varun Vasudev
2015-11-23 20:30:26 +00:00
da1016365a
YARN-3454. Add efficient merge operation to RLESparseResourceAllocation (Carlo Curino via asuresh)
2015-11-21 09:59:41 -08:00
2346fa3141
YARN-3769. Consider user limit when calculating total pending resource for preemption policy in Capacity Scheduler. (Eric Payne via wangda)
2015-11-20 15:55:50 -08:00
060cdcbe5d
YARN-4374. RM capacity scheduler UI rounds user limit factor. Contributed by Chang Li
2015-11-20 23:12:29 +00:00
f114e728da
YARN-2859.addendum: fix the remaining issue from the previous patch
2015-11-19 10:08:38 -08:00
253e0404f3
YARN-4279. Mark ApplicationId and ApplicationAttemptId static methods as @Public, @Unstable. (stevel)
2015-11-18 21:41:39 +00:00
6a61928fb7
YARN-4184. Remove update reservation state api from state store as its not used by ReservationSystem (Sean Po via asuresh)
2015-11-17 15:50:34 -08:00
fcd7888029
Revert "YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan"
...
This reverts commit 8fbea531d7
2015-11-16 20:18:44 -08:00
855d52927b
YARN-4354. Public resource localization fails with NPE. Contributed by Jason Lowe.
2015-11-15 04:43:57 -08:00
7ff280fca9
YARN-1509. Make AMRMClient support send increase container request and get increased/decreased containers. (Meng Ding via wangda)
2015-11-12 11:50:00 -08:00
7f55a18071
YARN-4347. Resource manager fails with Null pointer exception. (Jian He via wangda)
2015-11-12 11:23:40 -08:00
796638d9bc
YARN-4287. Capacity Scheduler: Rack Locality improvement (Nathan Roberts via wangda)
2015-11-12 11:09:37 -08:00
06a70311b9
YARN-4345. yarn rmadmin -updateNodeResource doesn't work. Contributed by Junping Du
2015-11-12 14:49:06 +00:00
6351d3fa63
YARN-4183. Reverting the patch to fix behaviour change.
...
Revert "YARN-4183. Enabling generic application history forces every job to get a timeline service delegation token (jeagles)"
This reverts commit c293c58954
2015-11-11 10:40:43 -08:00
23d0db551c
YARN-4241. Fix typo of property name in yarn-default.xml. Contributed by Anthony Rojas.
2015-11-11 16:13:08 +09:00
c99925d6dd
YARN-1510. Make NMClient support change container resources. (Meng Ding via wangda)
2015-11-10 11:45:46 -08:00
8fbea531d7
YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan
2015-11-09 10:43:45 -08:00
b76b0ce51e
HADOOP-12366. expose calculated paths (aw)
2015-11-07 08:32:56 -08:00
73b9c7b82b
HADOOP-10787. Rename/remove non-HADOOP_*, etc from the shell scripts. Contributed by Allen Wittenauer.
2015-11-04 15:56:17 +05:30
0783184f4b
YARN-4326. Fix TestDistributedShell timeout as AHS in MiniYarnCluster no longer binds to default port 8188. (Meng Ding via wangda)
2015-11-03 11:18:34 -08:00
ce31b22739
YARN-4320. TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no longer binds to default port 8188. Contributed by Varun Saxena.
2015-10-30 18:00:20 +09:00
e5b1733e04
YARN-4127. RM fail with noAuth error if switched from failover to non-failover. Contributed by Varun Saxena
2015-10-29 15:42:57 -07:00
c293c58954
YARN-4183. Enabling generic application history forces every job to get a timeline service delegation token (jeagles)
2015-10-29 16:41:10 -05:00
58d1df585c
YARN-4310. FairScheduler: Log skipping reservation messages at DEBUG level (asuresh)
2015-10-29 13:42:09 -07:00
e2267de207
YARN-2902. Killing a container that is localizing can orphan resources in the DOWNLOADING state. Contributed by Varun Saxena
2015-10-29 16:34:25 +00:00
c41699965e
YARN-4288. Fixed RMProxy to retry on IOException from local host. Contributed by Junping Du
2015-10-29 00:00:48 -07:00
656c8f9527
YARN-4130. Duplicate declaration of ApplicationId in RMAppManager#submitApplication method. (Kai Sasaki via rohithsharmaks)
2015-10-29 12:22:44 +05:30
27414dac66
YARN-2859. ApplicationHistoryServer binds to default port 8188 in
...
MiniYARNCluster. Contributed by Vinod Kumar Vavilapalli
2015-10-28 10:32:16 -07:00
9f4dfdf4eb
YARN-4251. TestAMRMClientOnRMRestart#testAMRMClientOnAMRMTokenRollOverOnRMRestart is failing. Contributed by Brahma Reddy Battula.
2015-10-28 17:39:12 +09:00
96677bef00
YARN-3573. MiniMRYarnCluster constructor that starts the timeline server using a boolean should be marked deprecated. Contributed by Brahma Reddy Battula.
2015-10-27 12:35:01 +09:00
Xuan
Jason Lowe
Jian He
Karthik Kambatla
Arun Suresh
Allen Wittenauer
Junping Du
Karthik Kambatla
Eric Payne
Wangda Tan
Li Lu
Robert Kanter
Siddharth Seth
Akira Ajisaka
Vinod Kumar Vavilapalli
Varun Vasudev
Zhihai Xu
Rohith Sharma K S
Masatake Iwasaki
Haohui Mai
Ming Ma
Sangjin Lee
Tsuyoshi Ozawa
Zhe Zhang
Steve Loughran
=
Devaraj K
Colin Patrick Mccabe
Gera Shegalov
cnauroth
Uma Mahesh
Chris Douglas
Jonathan Eagles