Robert Kanter
c4d4df8de0
YARN-4701. When task logs are not available, port 8041 is referenced instead of port 8042 (haibochen via rkanter)
2016-02-25 12:48:02 -08:00
Karthik Kambatla
c684f2b007
YARN-4729. SchedulerApplicationAttempt#getTotalRequiredResources can throw an NPE. (kasha)
2016-02-24 18:33:57 -08:00
Robert Kanter
954dd57043
YARN-4697. NM aggregation thread pool is not bound by limits (haibochen via rkanter)
2016-02-24 15:00:24 -08:00
Li Lu
9e0f7b8b69
YARN-4680. TimerTasks leak in ATS V1.5 Writer. (Xuan Gong via
...
gtcarrera9)
2016-02-24 13:43:09 -08:00
Sangjin Lee
553b591ba0
YARN-4722. AsyncDispatcher logs redundant event queue sizes (Jason Lowe via sjlee)
2016-02-24 09:29:41 -08:00
Jason Lowe
d284e187b8
YARN-2046. Out of band heartbeats are sent only on container kill and possibly too early. Contributed by Ming Ma
2016-02-23 20:49:09 +00:00
Junping Du
9ed17f181d
YARN-3223. Resource update during NM graceful decommission. Contributed by Brook Zhou.
2016-02-23 03:30:26 -08:00
Tsuyoshi Ozawa
0e12114c9c
YARN-4648. Move preemption related tests from TestFairScheduler to TestFairSchedulerPreemption. Contributed by Kai Sasaki.
2016-02-23 19:50:08 +09:00
Rohith Sharma K S
de09f41147
YARN-4651. Document movetoqueue option in 'YARN Commands'. (Takashi Ohnishi via rohithsharmaks)
2016-02-23 18:03:42 +08:00
Varun Vasudev
140cb5d745
YARN-4709. NMWebServices produces incorrect JSON for containers. Contributed by Varun Saxena.
2016-02-23 12:29:25 +05:30
Zhe Zhang
a2fdfff02d
HADOOP-12668. Support excluding weak Ciphers in HttpServer2 through ssl-server.conf. Contributed by Vijay Singh.
...
Change-Id: Ie46a5427d29188935427f67e55203c19fcd83335
2016-02-22 14:13:54 -08:00
Junping Du
3fab88540f
YARN-4386. refreshNodesGracefully() should send recommission event to active RMNodes only. Contributed by Kuhu Shukla.
2016-02-22 07:04:19 -08:00
Akira Ajisaka
5e7d4d51f8
YARN-4707. Remove the extra char (>) from SecureContainer.md. Contributed by Brahma Reddy Battula.
2016-02-22 17:17:40 +09:00
Tsuyoshi Ozawa
b68901d7dd
YARN-4708. Missing default mapper type in TimelineServer performance test tool usage. Contributed by Kai Sasaki.
2016-02-22 07:54:53 +09:00
Rohith Sharma K S
c1afac3a98
YARN-4654. Yarn node label CLI should parse "=" correctly when trying to remove all labels on a node. (Naganarasimha G R via rohithsharmaks)
2016-02-18 14:10:37 +05:30
Sangjin Lee
7de70680fe
YARN-4690. Skip object allocation in FSAppAttempt#getResourceUsage when possible (Ming Ma via sjlee)
2016-02-17 20:55:21 -08:00
Karthik Kambatla
a0c95b5fc4
YARN-4569. Remove incorrect part of maxResources in FairScheduler documentation. (Ray Chiang via kasha)
2016-02-17 18:36:12 -08:00
Karthik Kambatla
2ab4c476ed
YARN-4689. FairScheduler: Cleanup preemptContainer to be more readable. (Kai Sasaki via kasha)
2016-02-17 18:16:15 -08:00
Jian He
dea90c9a86
YARN-4653. Document YARN security model from the perspective of Application Developers. Contributed by Steve Loughran
2016-02-14 17:13:15 +08:00
Steve Loughran
51fc7f5427
YARN-4682. AMRM client to log when AMRM token updated. (Prabhu Joseph via stevel)
2016-02-12 11:02:08 +00:00
Varun Vasudev
2fb423e195
YARN-4684. TestYarnCLI#testGetContainers failing in CN locale. Contributed by Bibin A Chundatt.
2016-02-12 12:06:55 +05:30
Arun Suresh
23f937e3b7
YARN-2575. Create separate ACLs for Reservation create/update/delete/list ops (Sean Po via asuresh)
2016-02-11 10:47:43 -08:00
Varun Vasudev
fa00d3e205
YARN-4655. Log uncaught exceptions/errors in various thread pools in YARN. Contributed by Sidharta Seethana.
2016-02-11 12:06:42 +05:30
Varun Vasudev
663a80031c
YARN-4628. Display application priority in yarn top. Contributed by Bibin A Chundatt.
2016-02-11 11:56:09 +05:30
Jian He
d16b17b4d2
YARN-4138. Roll back container resource allocation after resource increase token expires. Contributed by Meng Ding
2016-02-11 10:06:27 +08:00
=
b706cbc1bc
YARN-4420. Add REST API for List Reservations (Sean Po via curino)
2016-02-10 10:19:26 -08:00
Arun Suresh
5cf5c41a89
YARN-4360. Improve GreedyReservationAgent to support "early" allocations, and performance improvements (curino via asuresh)
2016-02-10 09:11:15 -08:00
Steve Loughran
e9a622606f
YARN-4629. Distributed shell breaks under strong security. (Daniel Templeton via stevel)
2016-02-10 13:01:10 +00:00
Devaraj K
565af873d5
YARN-4667. RM Admin CLI for refreshNodesResources throws NPE when nothing
...
is configured. Contributed by Naganarasimha G R.
2016-02-08 15:01:54 +05:30
Varun Vasudev
22a2b2231d
YARN-4669. Fix logging statements in resource manager's Application class. Contributed by Sidharta Seethana.
2016-02-04 13:51:25 +05:30
Varun Vasudev
308d63f382
YARN-4307. Display blacklisted nodes for AM container in the RM web UI. Contributed by Naganarasimha G R.
2016-02-04 13:32:54 +05:30
Jason Lowe
fa328e2d39
YARN-4594. container-executor fails to remove directory tree when chmod required. Contributed by Colin Patrick McCabe
2016-02-03 17:21:12 +00:00
Varun Vasudev
1adb64e09b
YARN-4625. Make ApplicationSubmissionContext and ApplicationSubmissionContextInfo more consistent. Contributed by Xuan Gong.
2016-02-03 16:26:28 +05:30
Devaraj K
db144eb1c5
YARN-4100. Add Documentation for Distributed and Delegated-Centralized
...
Node Labels feature. Contributed by Naganarasimha G R.
2016-02-02 12:06:51 +05:30
Varun Vasudev
1cd55e0c17
YARN-4649. Add additional logging to some NM state store operations. Contributed by Sidharta Seethana
2016-02-02 09:25:23 +05:30
Wangda Tan
9875325d5c
YARN-4340. Add list API to reservation system. (Sean Po via wangda)
2016-02-02 10:17:33 +08:00
Jason Lowe
ed55950164
YARN-3102. Decommisioned Nodes not listed in Web UI. Contributed by Kuhu Shukla
2016-02-01 23:15:26 +00:00
Rohith Sharma K S
2673cbaf55
YARN-4615. Fix random test failure in TestAbstractYarnScheduler#testResourceRequestRecoveryToTheRightAppAttempt. (Sunil G via rohithsharmaks)
2016-02-01 10:43:56 +05:30
Jason Lowe
772ea7b41b
YARN-4428. Redirect RM page to AHS page when AHS turned on and RM page is not available. Contributed by Chang Li
2016-01-29 21:48:54 +00:00
Jian He
f4a57d4a53
YARN-4617. LeafQueue#pendingOrderingPolicy should always use fixed ordering policy instead of using same as active applications ordering policy. Contributed by Rohith Sharma K S
2016-01-29 12:22:23 -08:00
Karthik Kambatla
c9a09d6926
YARN-4647. Make RegisterNodeManagerRequestPBImpl thread-safe. (kasha)
2016-01-29 08:12:54 -08:00
Devaraj K
a277bdc9ed
YARN-4411. RMAppAttemptImpl#createApplicationAttemptReport throws
...
IllegalArgumentException. Contributed by Bibin A Chundatt and yarntime.
2016-01-29 13:51:37 +05:30
Rohith Sharma K S
ac68666803
YARN-4543. Fix random test failure in TestNodeStatusUpdater.testStopReentrant. (Akihiro Suda via rohithsharmaks)
2016-01-29 12:29:54 +05:30
Rohith Sharma K S
09d831c95b
YARN-4219. addendum patch to fix javadoc errors
2016-01-29 11:51:47 +05:30
Jian He
7f46636495
YARN-4519. Potential deadlock of CapacityScheduler between decrease container and assign containers. Contributed by Meng Ding
2016-01-28 14:51:00 -08:00
Xuan
9fab22b366
YARN-4219. New levelDB cache storage for timeline v1.5. Contributed by
...
Li Lu
2016-01-28 14:24:22 -08:00
Jason Lowe
61382ff8fa
YARN-4643. Container recovery is broken with delegating container runtime. Contributed by Sidharta Seethana
2016-01-28 18:59:35 +00:00
Rohith Sharma K S
ef343be82b
YARN-4633. Fix random test failure in TestRMRestart#testRMRestartAfterPreemption. (Bibin A Chundatt via rohithsharmaks)
2016-01-28 21:53:45 +05:30
Karthik Kambatla
fb238d7e5d
YARN-4462. FairScheduler: Disallow preemption from a queue. (Tao Jie via kasha)
2016-01-27 12:29:06 -08:00
Rohith Sharma K S
c01bee0108
YARN-4573. Fix test failure in TestRMAppTransitions#testAppRunningKill and testAppKilledKilled. (Takashi Ohnishi via rohithsharmaks)
2016-01-27 08:23:02 +05:30
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
2085e60a96
YARN-3542. Refactored existing CPU cgroups support to use the newer and integrated ResourceHandler mechanism, and also deprecated the old LCEResourceHandler inteface hierarchy. Contributed by Varun Vasudev.
2016-01-25 16:19:36 -08:00
Jian He
992dd2f783
YARN-4520. Finished app info is unnecessarily persisted in NM state-store if container is acquired but not lunched on this node. Contributed by sandflee
2016-01-25 15:36:14 -08:00
Akira Ajisaka
56a0c17508
YARN-4592. Remove unused GetContainerStatus proto. Contributed by Chang Li.
2016-01-25 15:20:29 +09:00
rohithsharmaks
10dc2c0493
YARN-4613. Fix test failure in TestClientRMService#testGetClusterNodes. (Takashi Ohnishi via rohithsharmaks)
2016-01-24 23:36:15 +05:30
rohithsharmaks
99829eb221
YARN-4614. Fix random failure in TestApplicationPriority#testApplicationPriorityAllocationWithChangeInPriority. (Sunil G via rohithsharmaks)
2016-01-23 07:56:57 +05:30
Xuan
618bfd6ac2
YARN-4496. Improve HA ResourceManager Failover detection on the client.
...
Contributed by Jian He
2016-01-22 18:20:38 -08:00
Jason Lowe
46e5ea81e0
YARN-4598. Invalid event: RESOURCE_FAILED at CONTAINER_CLEANEDUP_AFTER_KILL. Contributed by tangshangwen
2016-01-22 21:55:01 +00:00
Jason Lowe
e91e8b711c
YARN-4371. "yarn application -kill" should take multiple application ids. Contributed by Sunil G
2016-01-22 21:36:15 +00:00
rohithsharmaks
34a3900773
YARN-4574. Fix random failure in TestAMRMClientOnRMRestart. (Takashi Ohnishi via rohithsharmaks)
2016-01-22 21:17:37 +05:30
rohithsharmaks
d6258b33a7
YARN-4497. RM might fail to restart when recovering apps whose attempts are missing. (Jun Gong via rohithsharmaks)
2016-01-22 20:27:38 +05:30
Akira Ajisaka
8f58f742ae
YARN-4605. Spelling mistake in the help message of "yarn applicationattempt" command. Contributed by Weiwei Yang.
2016-01-22 19:43:06 +09:00
Varun Vasudev
b41a7e89d1
YARN-4578. Directories that are mounted in docker containers need to be more restrictive/container-specific. Contributed by Sidharta Seethana.
2016-01-22 14:43:14 +05:30
Rohith Sharma K S
e30668106d
YARN-4584. RM startup failure when AM attempts greater than max-attempts. (Bibin A Chundatt via rohithsharmaks)
2016-01-22 10:14:46 +05:30
Jason Lowe
468a53b22f
YARN-4610. Reservations continue looking for one app causes other apps to starve. Contributed by Jason Lowe
2016-01-21 18:31:29 +00:00
Akira Ajisaka
3ac9511da2
YARN-4608. Redundant code statement in WritingYarnApplications. Contributed by Kai Sasaki.
2016-01-22 02:14:31 +09:00
Karthik Kambatla
4992398aee
YARN-4603. FairScheduler should mention user requested queuename in error message when failed in queue ACL check. (Tao Jie via kasha)
2016-01-21 17:40:59 +01:00
Jason Lowe
f858ac2426
YARN-4492. Add documentation for preemption supported in Capacity scheduler. Contributed by Naganarasimha G R
2016-01-21 15:38:40 +00:00
Wangda Tan
5ff5f67332
YARN-4557. Fix improper Queues sorting in PartitionedQueueComparator when accessible-node-labels=*. (Naganarasimha G R via wangda)
2016-01-21 11:21:06 +08:00
Xuan
890a2ebd1a
YARN-4559. Make leader elector and zk store share the same curator
...
client. Contributed by Jian He
2016-01-20 14:48:10 -08:00
Wangda Tan
89d1fd5dac
HADOOP-12356. Fix computing CPU usage statistics on Windows. (Inigo Goiri via wangda)
2016-01-19 21:27:38 +08:00
Jian He
edc43a9097
YARN-4565. Fix a bug that leads to AM resource limit not hornored when sizeBasedWeight enabled for FairOrderingPolicy. Contributed by Wangda Tan
2016-01-18 21:04:36 -08:00
Wangda Tan
a44ce3f14f
YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)
2016-01-19 09:30:04 +08:00
Wangda Tan
150f5ae034
Revert "YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)"
...
This reverts commit 3fe5728563
.
Conflicts:
hadoop-yarn-project/CHANGES.txt
2016-01-19 09:27:36 +08:00
Jian He
f385851141
YARN-4596. SystemMetricPublisher should not swallow error messages from TimelineClient#putEntities. Contributed by Li Lu
2016-01-18 16:58:39 -08:00
Karthik Kambatla
d40859fab1
YARN-4526. Make SystemClock singleton so AppSchedulingInfo could use it. (kasha)
2016-01-18 10:58:14 +01:00
Wangda Tan
3fe5728563
YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)
...
(cherry picked from commit 805a9ed85e
)
2016-01-18 17:06:05 +08:00
Wangda Tan
adf260a728
Revert "YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)"
...
This reverts commit 805a9ed85e
.
2016-01-18 16:50:45 +08:00
Wangda Tan
b08ecf5c75
YARN-4304. AM max resource configuration per partition to be displayed/updated correctly in UI and in various partition related metrics. (Sunil G via wangda)
2016-01-18 11:11:32 +08:00
Wangda Tan
805a9ed85e
YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)
2016-01-18 11:04:25 +08:00
Wangda Tan
9523648d57
YARN-4538. QueueMetrics pending cores and memory metrics wrong. (Bibin A Chundatt via wangda)
2016-01-18 10:57:14 +08:00
Junping Du
02f597c5db
YARN-4265. Provide new timeline plugin storage to support fine-grained entity caching. Contributed by Li Lu and Jason Lowe
2016-01-17 17:37:40 -08:00
Colin Patrick Mccabe
b2c155f810
HADOOP-12712. Fix some cmake plugin and native build warnings (cmccabe)
2016-01-15 12:29:18 -08:00
Junping Du
fc6d3a3b23
YARN-4581. AHS writer thread leak makes RM crash while RM is recovering. Contributed by sandflee.
2016-01-15 08:40:56 -08:00
rohithsharmaks
f7736f464f
YARN-4389. Allow application to enable or disable am blacklisting. (Sunil G via rohithsharmaks)
2016-01-15 21:38:26 +05:30
Colin Patrick Mccabe
b1ed28fa77
HADOOP-8887. Use a Maven plugin to build the native code using CMake (cmccabe)
2016-01-14 11:02:34 -08:00
Karthik Kambatla
9d04f26d4c
YARN-3446. FairScheduler headroom calculation should exclude nodes in the blacklist. (Zhihai Xu via kasha)
2016-01-14 08:33:23 -08:00
Varun Vasudev
3ddb92bd30
YARN-4553. Add cgroups support for docker containers. Contributed by Sidharta Seethana.
2016-01-14 14:29:29 +05:30
Akira Ajisaka
62b0d61513
YARN-4534. Remove the redundant symbol in yarn rmadmin help msg. Contributed by Lin Yiqun.
2016-01-14 13:59:39 +09:00
Karthik Kambatla
321072ba81
YARN-4551. Address the duplication between StatusUpdateWhenHealthy and StatusUpdateWhenUnhealthy transitions. (Sunil G via kasha)
2016-01-13 12:09:34 -08:00
Wangda Tan
c0537bcd2c
YARN-4571. Make app id/name available to the yarn authorizer provider for better auditing. (Jian He via wangda)
2016-01-13 13:18:31 +08:00
Jason Lowe
13de8359a1
YARN-4414. Nodemanager connection errors are retried at multiple levels. Contributed by Chang Li
2016-01-12 15:56:15 +00:00
Akira Ajisaka
da1e3e3c57
YARN-4567. javadoc failing on java 8. Contributed by Steve Loughran. This closes #67 .
2016-01-12 15:12:17 +09:00
Wangda Tan
9e792da014
YARN-4582. Label-related invalid resource request exception should be able to properly handled by application. (Bibin A Chundatt via wangda)
2016-01-12 12:53:31 +08:00
Akira Ajisaka
56b9500bbd
HADOOP-12584. Disable browsing the static directory in HttpServer2. Contributed by Robert Kanter.
2016-01-12 13:34:18 +09:00
Jian He
5fab4ec31c
Missing file for YARN-4580
2016-01-11 17:00:44 -08:00
Jian He
b8942be888
YARN-4537. Pull out priority comparison from fifocomparator and use compound comparator for FifoOrdering policy. Contributed by Rohith Sharma K S
2016-01-11 16:44:28 -08:00
Jian He
109e528ef5
YARN-4479. Change CS LeafQueue pendingOrderingPolicy to hornor recovered apps. Contributed by Rohith Sharma K S
2016-01-08 15:51:10 -08:00
Xuan
89022f8d4b
YARN-4438. Implement RM leader election with curator. Contributed by Jian He
2016-01-07 14:33:06 -08:00
Akira Ajisaka
52b77577c4
YARN-4544. All the log messages about rolling monitoring interval are shown with WARN level. Contributed by Takashi Ohnishi.
2016-01-08 01:12:46 +09:00
Steve Loughran
07d1cb612c
YARN-4550. Some tests in TestContainerLanch fails on non-english locale environment. (Takashi Ohnishi via stevel)
2016-01-07 14:30:20 +00:00
rohithsharmaks
791c1639ae
YARN-4393. Fix intermittent test failure for TestResourceLocalizationService#testFailedDirsResourceRelease (Varun Saxana via rohithsharmaks)
2016-01-07 09:38:47 +05:30
Junping Du
c1462a67ff
YARN-4546. ResourceManager crash due to scheduling opportunity overflow. Contributed by Jason Lowe.
2016-01-06 05:49:24 -08:00
rohithsharmaks
6da6d87872
YARN-4535. Fix checkstyle error in CapacityScheduler.java (Naganarasimha G R via rohithsharmaks)
2016-01-05 12:09:57 +05:30
Rohith Sharma K S
f9e36dea96
YARN-4530. LocalizedResource trigger a NPE Cause the NodeManager exit. (tangshangwen via rohithsharmaks)
2016-01-04 09:58:13 +05:30
Wangda Tan
4e4b3a8465
YARN-4524. Cleanup AppSchedulingInfo. (Karthik Kambatla via wangda)
...
(cherry picked from commit 05fa852d75
)
2015-12-30 15:39:34 -08:00
Wangda Tan
8310b2e9ff
YARN-4522. Queue acl can be checked at app submission. (Jian He via wangda)
2015-12-30 15:30:12 -08:00
Junping Du
223ce323bb
YARN-1382. Remove unusableRMNodesConcurrentSet (never used) in NodeListManager to get rid of memory leak. Contributed by Rohith Sharma K S.
2015-12-30 07:52:07 -08:00
Jian He
ad997fab67
YARN-4098. Document ApplicationPriority feature. Contributed by Rohith Sharma K S
2015-12-29 16:51:55 -08:00
Jian He
5273413411
YARN-3480. Remove attempts that are beyond max-attempt limit from state store. Contributed by Jun Gong
2015-12-29 15:58:39 -08:00
Wangda Tan
561abb9fee
YARN-4315. NaN in Queue percentage for cluster apps page. (Bibin A Chundatt via wangda)
2015-12-29 13:28:00 -08:00
Jian He
d0a22bae9b
YARN-4417. Make RM and Timeline-server REST APIs more consistent. Contributed by Wangda Tan
2015-12-28 15:52:45 -08:00
Karthik Kambatla
fb00794368
YARN-2882. Add an OPPORTUNISTIC ExecutionType. (Konstantinos Karanasos and Inigo Goiri via kasha)
2015-12-26 20:22:16 -08:00
Gera Shegalov
2c17b81569
YARN-2934. Improve handling of container's stderr. (Naganarasimha G R via gera)
2015-12-24 23:48:05 -08:00
Karthik Kambatla
0af492b4bd
YARN-4156. TestAMRestart#testAMBlacklistPreventsRestartOnSameNode assumes CapacityScheduler. (Anubhav Dhoot via kasha)
2015-12-23 17:52:36 -08:00
Junping Du
bb5df272b9
YARN-4400. AsyncDispatcher.waitForDrained should be final. Contributed by Daniel Templeton.
2015-12-23 08:55:12 -08:00
Junping Du
882f2f0464
YARN-4234. New put APIs in TimelineClient for ats v1.5. Contributed by Xuan Gong.
2015-12-23 05:26:51 -08:00
rohithsharmaks
8c180a13c8
YARN-4109. Exception on RM scheduler page loading with labels. (Mohammad Shahid Khan via rohithsharmaks)
2015-12-23 09:12:32 +05:30
Arun Suresh
e88422df45
YARN-4477. FairScheduler: Handle condition which can result in an infinite loop in attemptScheduling. (Tao Jie via asuresh)
2015-12-21 22:41:09 -08:00
cnauroth
114b590955
YARN-3458. CPU resource monitoring in Windows. Contributed by Inigo Goiri.
2015-12-21 16:59:09 -08:00
Wangda Tan
a0de702851
YARN-4290. Add -showDetails option to YARN Nodes CLI to print all nodes reports information. (Sunil G via wangda)
2015-12-21 11:36:22 -08:00
Wangda Tan
bc038b382c
YARN-4454. NM to nodelabel mapping going wrong after RM restart. (Bibin A Chundatt via wangda)
2015-12-21 11:30:13 -08:00
Uma Mahesh
0f82b5d878
YARN-4480. Clean up some inappropriate imports. (Kai Zheng via umamahesh)
2015-12-19 23:10:13 -08:00
Jian He
85c2466048
YARN-4164. Changed updateApplicationPriority API to return the updated application priority. Contributed by Rohith Sharma K S
2015-12-18 14:13:48 -08:00
Junping Du
1de56b0448
YARN-3226. UI changes for decommissioning node. Contributed by Sunil G.
2015-12-17 15:20:17 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
4e7d32c0db
YARN-1856. Added cgroups based memory monitoring for containers as another alternative to custom memory-monitoring. Contributed by Varun Vasudev.
2015-12-17 12:13:03 -08:00
Jason Lowe
91828fef6b
YARN-4461. Redundant nodeLocalityDelay log in LeafQueue. Contributed by Eric Payne
2015-12-16 23:22:31 +00:00
Wangda Tan
9b856d9787
YARN-4416. Deadlock due to synchronised get Methods in AbstractCSQueue. (Naganarasimha G R via wangda)
2015-12-16 13:22:37 -08:00
Wangda Tan
7faa406f27
YARN-4225. Add preemption status to yarn queue -status for capacity scheduler. (Eric Payne via wangda)
2015-12-16 13:19:40 -08:00
Wangda Tan
79c41b1d83
YARN-4293. ResourceUtilization should be a part of yarn node CLI. (Sunil G via wangda)
2015-12-16 13:18:19 -08:00
Siddharth Seth
0f708d465f
YARN-4207. Add a non-judgemental YARN app completion status. Contributed by Rich Haase.
2015-12-16 11:33:55 -08:00
Junping Du
50bd067e1d
YARN-4452. NPE when submit Unmanaged application. Contributed by Naganarasimha G R.
2015-12-16 10:57:39 -08:00
Zhihai Xu
2aaed10327
YARN-4440. FSAppAttempt#getAllowedLocalityLevelByTime should init the lastScheduler time. Contributed by Lin Yiqun
2015-12-15 00:17:21 -08:00
Xuan
d8a45425eb
YARN-4439. Clarify NMContainerStatus#toString method. Contributed by
...
Jian He
2015-12-14 15:41:28 -08:00
Jian He
915cd6c3f4
YARN-4402. TestNodeManagerShutdown And TestNodeManagerResync fails with bind exception. Contributed by Brahma Reddy Battula
2015-12-14 14:59:01 -08:00
Jian He
1cb3299b48
YARN-4403. (AM/NM/Container)LivelinessMonitor should use monotonic time when calculating period. Contributed by Junping Du
2015-12-14 13:51:23 -08:00
Wangda Tan
07b0fb996a
YARN-4418. AM Resource Limit per partition can be updated to ResourceUsage as well. (Sunil G via wangda)
2015-12-14 11:24:30 -08:00
Wangda Tan
dfcbbddb09
YARN-4309. Add container launch related debug information to container logs when a container fails. (Varun Vasudev via wangda)
2015-12-14 11:13:22 -08:00
Wangda Tan
6cb0af3c39
YARN-3946. Update exact reason as to why a submitted app is in ACCEPTED state to app's diagnostic message. (Naganarasimha G R via wangda)
2015-12-14 10:52:46 -08:00
Arun Suresh
7fb212e5e6
YARN-4358 addendum patch to fix javadoc error
2015-12-12 22:22:55 -08:00
Sangjin Lee
e8964589de
YARN-4341. add doc about timeline performance tool usage (Chang Li via sjlee)
2015-12-11 09:46:32 -08:00
Xuan
21daa6c68a
YARN-3623-Addendum: Improve the description for Timeline Service Version configuration in yarn-default.xml
2015-12-10 10:56:12 -08:00
Junping Du
f910e4f639
YARN-3623. Add a config to indicate the Timeline Service version. Contributed by Xuan Gong.
2015-12-10 02:53:47 -08:00
Akira Ajisaka
50edcb947c
YARN-4434. NodeManager Disk Checker parameter documentation is not correct. Contributed by Weiwei Yang.
2015-12-09 16:32:33 +09:00
rohithsharmaks
a5e2e1ecb0
YARN-4421. Remove dead code in RmAppImpl.RMAppRecoveredTransition. (Daniel Templeton via rohithsharmaks)
2015-12-09 11:31:51 +05:30
rohithsharmaks
15c3e7ffe3
YARN-4431. Not necessary to do unRegisterNM() if NM get stop due to failed to connect to RM. (Junpin Du via rohithsharmaks)
2015-12-09 10:50:43 +05:30
Wangda Tan
7e4715186d
YARN-4424. Fix deadlock in RMAppImpl. (Jian he via wangda)
2015-12-08 14:25:16 -08:00
Chris Douglas
9f50e13d5d
YARN-4248. Followup patch adding asf-licence exclusions for json test files
2015-12-08 12:08:04 -08:00
=
c25a635459
YARN-4248. REST API for submit/update/delete Reservations. (curino)
2015-12-07 13:33:28 -08:00
Jonathan Eagles
4ff973f96a
YARN-4422. Generic AHS sometimes doesn't show started, node, or logs on App page (Eric Payne via jeagles)
2015-12-07 15:04:48 -06:00
Xuan
4546c7582b
YARN-4392. ApplicationCreatedEvent event time resets after RM
...
restart/failover. Contributed by Naganarasimha G R and Xuan Gong
2015-12-07 12:24:55 -08:00
rohithsharmaks
01a641bc44
YARN-3456. Improve handling of incomplete TimelineEntities. (Varun Saxena via rohithsharmaks)
2015-12-07 15:16:56 +05:30
Steve Loughran
65f395226b
HADOOP-12321. Make JvmPauseMonitor an AbstractService. (Sunil G via Stevel) [includes HDFS-8947 MAPREDUCE-6462 and YARN-4072]
2015-12-06 17:43:35 +00:00
Arun Suresh
742632e346
YARN-4358. Reservation System: Improve relationship between SharingPolicy and ReservationAgent. (Carlo Curino via asuresh)
2015-12-05 21:26:16 -08:00
Jian He
e84d6ca2df
Add missing file for YARN-4419
2015-12-03 19:07:28 -08:00
Jian He
755dda8dd8
YARN-4405. Support node label store in non-appendable file system. Contributed by Wangda Tan
2015-12-03 17:45:31 -08:00
Wangda Tan
a2c3bfc8c1
YARN-4292. ResourceUtilization should be a part of NodeInfo REST API. (Sunil G via wangda)
2015-12-03 14:28:32 -08:00
Jian He
9f77ccad73
YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999). Contributed by Mohammad Shahid Khan and Varun Saxena
2015-12-03 12:48:50 -08:00
Junping Du
62e9348bc1
YARN-4408. Fix issue that NodeManager still reports negative running containers. Contributed by Robert Kanter.
2015-12-03 06:36:37 -08:00
Jian He
6b9a5beb2b
YARN-4398. Remove unnecessary synchronization in RMStateStore. Contributed by Ning Ding
2015-12-02 11:07:18 -08:00
Tsuyoshi Ozawa
0656d2dc83
YARN-4380. TestResourceLocalizationService.testDownloadingResourcesOnContainerKill fails intermittently. Contributed by Varun Saxena.
2015-11-26 01:10:02 +09:00
Wangda Tan
23c625ec57
YARN-4384. updateNodeResource CLI should not accept negative values for resource. (Junping Du via wangda)
2015-11-24 16:35:56 -08:00
Jason Lowe
f5acf94eca
YARN-4365. FileSystemNodeLabelStore should check for root dir existence on startup. Contributed by Kuhu Shukla
2015-11-24 23:47:10 +00:00
Jason Lowe
4ac6799d4a
YARN-4132. Separate configs for nodemanager to resourcemanager connection timeout and retries. Contributed by Chang Li
2015-11-24 22:35:37 +00:00
Tsuyoshi Ozawa
28dfe721b8
YARN-4387. Fix typo in FairScheduler log message. Contributed by Xin Wang.
2015-11-24 19:24:01 +09:00
Akira Ajisaka
8c0133f3d4
YARN-4298. Fix findbugs warnings in hadoop-yarn-common. Contributed by Sunil G.
2015-11-24 18:40:33 +09:00
Karthik Kambatla
52948bb20b
YARN-3980. Plumb resource-utilization info in node heartbeat through to the scheduler. (Inigo Goiri via kasha)
2015-11-24 13:47:17 +05:30
Jian He
8676a118a1
YARN-4349. Support CallerContext in YARN. Contributed by Wangda Tan
2015-11-23 17:19:48 -08:00
Jason Lowe
d36b6e045f
YARN-4344. NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations. Contributed by Varun Vasudev
2015-11-23 20:30:26 +00:00
Arun Suresh
da1016365a
YARN-3454. Add efficient merge operation to RLESparseResourceAllocation (Carlo Curino via asuresh)
2015-11-21 09:59:41 -08:00
Wangda Tan
2346fa3141
YARN-3769. Consider user limit when calculating total pending resource for preemption policy in Capacity Scheduler. (Eric Payne via wangda)
2015-11-20 15:55:50 -08:00
Jason Lowe
060cdcbe5d
YARN-4374. RM capacity scheduler UI rounds user limit factor. Contributed by Chang Li
2015-11-20 23:12:29 +00:00
Xuan
f114e728da
YARN-2859.addendum: fix the remaining issue from the previous patch
2015-11-19 10:08:38 -08:00
Steve Loughran
253e0404f3
YARN-4279. Mark ApplicationId and ApplicationAttemptId static methods as @Public, @Unstable. (stevel)
2015-11-18 21:41:39 +00:00
Arun Suresh
6a61928fb7
YARN-4184. Remove update reservation state api from state store as its not used by ReservationSystem (Sean Po via asuresh)
2015-11-17 15:50:34 -08:00
Jian He
fcd7888029
Revert "YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan"
...
This reverts commit 8fbea531d7
.
Conflicts:
hadoop-yarn-project/CHANGES.txt
2015-11-16 20:18:44 -08:00
Junping Du
855d52927b
YARN-4354. Public resource localization fails with NPE. Contributed by Jason Lowe.
2015-11-15 04:43:57 -08:00
Wangda Tan
7ff280fca9
YARN-1509. Make AMRMClient support send increase container request and get increased/decreased containers. (Meng Ding via wangda)
2015-11-12 11:50:00 -08:00
Wangda Tan
7f55a18071
YARN-4347. Resource manager fails with Null pointer exception. (Jian He via wangda)
2015-11-12 11:23:40 -08:00
Wangda Tan
796638d9bc
YARN-4287. Capacity Scheduler: Rack Locality improvement (Nathan Roberts via wangda)
2015-11-12 11:09:37 -08:00
Jason Lowe
06a70311b9
YARN-4345. yarn rmadmin -updateNodeResource doesn't work. Contributed by Junping Du
2015-11-12 14:49:06 +00:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
6351d3fa63
YARN-4183. Reverting the patch to fix behaviour change.
...
Revert "YARN-4183. Enabling generic application history forces every job to get a timeline service delegation token (jeagles)"
This reverts commit c293c58954
.
2015-11-11 10:40:43 -08:00
Akira Ajisaka
23d0db551c
YARN-4241. Fix typo of property name in yarn-default.xml. Contributed by Anthony Rojas.
2015-11-11 16:13:08 +09:00
Wangda Tan
c99925d6dd
YARN-1510. Make NMClient support change container resources. (Meng Ding via wangda)
2015-11-10 11:45:46 -08:00
Jian He
8fbea531d7
YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan
2015-11-09 10:43:45 -08:00
Allen Wittenauer
b76b0ce51e
HADOOP-12366. expose calculated paths (aw)
2015-11-07 08:32:56 -08:00
Varun Vasudev
73b9c7b82b
HADOOP-10787. Rename/remove non-HADOOP_*, etc from the shell scripts. Contributed by Allen Wittenauer.
2015-11-04 15:56:17 +05:30
Wangda Tan
0783184f4b
YARN-4326. Fix TestDistributedShell timeout as AHS in MiniYarnCluster no longer binds to default port 8188. (Meng Ding via wangda)
2015-11-03 11:18:34 -08:00
Tsuyoshi Ozawa
ce31b22739
YARN-4320. TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no longer binds to default port 8188. Contributed by Varun Saxena.
2015-10-30 18:00:20 +09:00
Jian He
e5b1733e04
YARN-4127. RM fail with noAuth error if switched from failover to non-failover. Contributed by Varun Saxena
2015-10-29 15:42:57 -07:00
Jonathan Eagles
c293c58954
YARN-4183. Enabling generic application history forces every job to get a timeline service delegation token (jeagles)
2015-10-29 16:41:10 -05:00
Arun Suresh
58d1df585c
YARN-4310. FairScheduler: Log skipping reservation messages at DEBUG level (asuresh)
2015-10-29 13:42:09 -07:00
Jason Lowe
e2267de207
YARN-2902. Killing a container that is localizing can orphan resources in the DOWNLOADING state. Contributed by Varun Saxena
2015-10-29 16:34:25 +00:00
Jian He
c41699965e
YARN-4288. Fixed RMProxy to retry on IOException from local host. Contributed by Junping Du
2015-10-29 00:00:48 -07:00
Rohith Sharma K S
656c8f9527
YARN-4130. Duplicate declaration of ApplicationId in RMAppManager#submitApplication method. (Kai Sasaki via rohithsharmaks)
2015-10-29 12:22:44 +05:30
Xuan
27414dac66
YARN-2859. ApplicationHistoryServer binds to default port 8188 in
...
MiniYARNCluster. Contributed by Vinod Kumar Vavilapalli
2015-10-28 10:32:16 -07:00
Tsuyoshi Ozawa
9f4dfdf4eb
YARN-4251. TestAMRMClientOnRMRestart#testAMRMClientOnAMRMTokenRollOverOnRMRestart is failing. Contributed by Brahma Reddy Battula.
2015-10-28 17:39:12 +09:00
Tsuyoshi Ozawa
96677bef00
YARN-3573. MiniMRYarnCluster constructor that starts the timeline server using a boolean should be marked deprecated. Contributed by Brahma Reddy Battula.
2015-10-27 12:35:01 +09:00
Akira Ajisaka
8a68630dd1
YARN-4300. [JDK8] Fix javadoc errors caused by wrong tags. (aajisaka)
2015-10-27 10:28:01 +09:00
Wangda Tan
56e4f6237a
YARN-3216. Max-AM-Resource-Percentage should respect node labels. (Sunil G via wangda)
2015-10-26 16:44:39 -07:00
Wangda Tan
6f606214e7
YARN-4169. Fix racing condition of TestNodeStatusUpdaterForLabels. (Naganarasimha G R via wangda)
2015-10-26 16:36:34 -07:00
Wangda Tan
3cc73773eb
YARN-4285. Display resource usage as percentage of queue and cluster in the RM UI (Varun Vasudev via wangda)
2015-10-26 13:07:39 -07:00
Jason Lowe
33a03af3c3
YARN-4284. condition for AM blacklisting is too narrow. Contributed by Sangjin Lee
2015-10-26 19:53:03 +00:00
Rohith Sharma K S
5acdde4744
YARN-2729. Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup. (Naganarasimha G R via rohithsharmaks)
2015-10-26 15:42:42 +05:30
Rohith Sharma K S
092883b34a
YARN-4223. Fixed findbugs warnings in hadoop-yarn-server-nodemanager project. (varun saxena via rohithsharmaks)
2015-10-26 15:23:51 +05:30
Tsuyoshi Ozawa
ce60b4fc8b
YARN-3528. Tests with 12345 as hard-coded port break jenkins. Contributed by Brahma Reddy Battula.
2015-10-26 16:45:11 +09:00
Rohith Sharma K S
b57f08c0d2
YARN-4246. NPE while listing app attempt. (Nijel S F via rohithsharmaks)
2015-10-26 11:56:36 +05:30
Allen Wittenauer
1aa735c188
YARN-3724. Use POSIX nftw(3) instead of fts(3) (Alan Burlison via aw)
2015-10-25 21:43:23 -07:00
Arun Suresh
ab8eb8770c
YARN-3738. Add support for recovery of reserved apps running under dynamic queues (subru via asuresh)
2015-10-24 22:53:10 -07:00
Steve Loughran
446212a39e
YARN-4296. DistributedShell Log.info is not friendly. (Xiaowei Wang via stevel)
2015-10-24 12:55:36 +01:00
Steve Loughran
14f8dd0423
YARN-4289. TestDistributedShell failing with bind exception. (Brahma Reddy Battula via stevel)
2015-10-24 12:48:15 +01:00
Akira Ajisaka
7781fe1b9e
YARN-4294. [JDK8] Fix javadoc errors caused by wrong reference and illegal tag. (aajisaka)
2015-10-24 11:54:42 +09:00
Jason Lowe
d3a34a4f38
YARN-4041. Slow delegation token renewal can severely prolong RM recovery. Contributed by Sunil G
2015-10-23 20:57:01 +00:00
Ming Ma
934d96a334
YARN-2913. Fair scheduler should have ability to set MaxResourceDefault for each queue. (Siqi Li via mingma)
2015-10-23 08:36:33 -07:00
Jonathan Eagles
f8adeb712d
YARN-4009. CORS support for ResourceManager REST API. ( Varun Vasudev via jeagles)
2015-10-23 10:34:08 -05:00
Junping Du
0fce5f9a49
YARN-4243. Add retry on establishing Zookeeper conenction in EmbeddedElectorService#serviceInit. Contributed by Xuan Gong.
2015-10-22 13:41:09 -07:00
Zhihai Xu
960201b79b
YARN-4256. YARN fair scheduler vcores with decimal values. Contributed by Jun Gong
2015-10-22 12:28:03 -07:00
Anubhav Dhoot
2798723a54
YARN-3739. Add reservation system recovery to RM recovery process. Contributed by Subru Krishnan.
2015-10-22 06:51:00 -07:00
Jonathan Eagles
25f8f801d1
YARN-2513. Host framework UIs in YARN for use with the ATS (jeagles)
2015-10-21 15:38:08 -05:00
Arun Suresh
506d1b1dbc
YARN-3985. Make ReservationSystem persist state using RMStateStore reservation APIs. (adhoot via asuresh)
2015-10-20 16:46:14 -07:00
Arun Suresh
7e2837f830
YARN-4270. Limit application resource reservation on nodes for non-node/rack specific requests (asuresh)
2015-10-19 20:00:38 -07:00
Varun Vasudev
151eab2a12
YARN-4267. Add additional logging to container launch implementations in container-executor. Contributed by Sidharta Seethana.
2015-10-19 20:56:01 +05:30
Varun Vasudev
e39ae0e676
YARN-4262. Allow whitelisted users to run privileged docker containers. Contributed by Sidharta Seethana.
2015-10-19 20:19:22 +05:30
Steve Loughran
e2d59e2c7b
YARN-4155. TestLogAggregationService.testLogAggregationServiceWithInterval failing. (Bibin A Chundatt via stevel)
2015-10-18 12:03:57 +01:00
Jian He
f9da5cdb2b
YARN-4170. AM need to be notified with priority in AllocateResponse. Contributed by Sunil G
2015-10-16 15:26:27 -07:00
Wangda Tan
4337b263aa
YARN-4162. CapacityScheduler: Add resource usage by partition and queue capacity by partition to REST API. (Naganarasimha G R via wangda)
2015-10-16 15:06:28 -07:00
Jian He
cf23f2c2b5
YARN-4000. RM crashes with NPE if leaf queue becomes parent queue during restart. Contributed by Varun Saxena
2015-10-15 17:12:46 -07:00
Varun Vasudev
63020c54c1
YARN-4258. Add support for controlling capabilities for docker containers. Contributed by Sidharta Seethana.
2015-10-15 13:41:20 +05:30
Steve Loughran
dfa7848463
HADOOP-12478. Shell.getWinUtilsPath() has been renamed Shell.getWinutilsPath(). (stevel)
2015-10-14 20:25:47 +01:00
rohithsharmaks
d6c8bad869
YARN-4250. NPE in AppSchedulingInfo#isRequestLabelChanged. (Brahma Reddy Battula via rohithsharmaks)
2015-10-14 16:11:34 +05:30
Varun Vasudev
da1ee078f9
YARN-4255. container-executor does not clean up docker operation command files. Contributed by Sidharta Seethana.
2015-10-14 15:25:21 +05:30
Varun Vasudev
fb9c1519b3
YARN-4252. Log container-executor invocation details when exit code is non-zero. Contributed by Sidharta Seethana.
2015-10-14 15:18:08 +05:30
Varun Vasudev
8d59293089
YARN-4253. Standardize on using PrivilegedOperationExecutor for all invocations of container-executor in LinuxContainerExecutor. Contributed by Sidharta Seethana.
2015-10-14 14:58:10 +05:30
Steve Loughran
c59af2fdf8
HADOOP-10775. Shell operations to fail with meaningful errors on windows if winutils.exe not found. (stevel)
2015-10-13 21:49:28 +01:00
Varun Vasudev
5b6bae0094
YARN-4017. container-executor overuses PATH_MAX. Contributed by Sidharta Seethana
2015-10-13 12:48:30 +05:30
Jian He
9849c8b386
YARN-4230. RM crashes with NPE when increasing container resource if there is no headroom left. Contributed by Meng Ding
2015-10-12 11:51:33 -07:00
Zhihai Xu
049c6e8dc0
YARN-4201. AMBlacklist does not work for minicluster. Contributed by Jun Gong.
2015-10-12 00:14:25 -07:00
Devaraj K
db93047881
YARN-3964. Support NodeLabelsProvider at Resource Manager side.
...
Contributed by Dian Fu.
2015-10-11 11:21:29 +05:30
Wangda Tan
def374e666
YARN-4140. RM container allocation delayed incase of app submitted to Nodelabel partition. (Bibin A Chundatt via wangda)
2015-10-09 16:38:59 -07:00
Karthik Kambatla
4aa9b3e75c
MAPREDUCE-6302. Incorrect headroom can lead to a deadlock between map and reduce allocations. (kasha)
2015-10-09 07:37:39 -07:00
Jason Lowe
a0bca2b5ad
YARN-261. Ability to fail AM attempts. Contributed by Andrey Klochkov and Rohith Sharma K S
2015-10-09 14:17:38 +00:00
Rohith Sharma K S
8f195387a4
YARN-4235. FairScheduler PrimaryGroup does not handle empty groups returned for a user. (Anubhav Dhoot via rohithsharmaks)
2015-10-09 10:09:26 +05:30
Jason Lowe
8d226225d0
YARN-3943. Use separate threshold configurations for disk-full detection and disk-not-full detection. Contributed by Zhihai Xu
2015-10-08 22:25:34 +00:00
Rohith Sharma K S
3793cbe4c3
YARN-4228. FileSystemRMStateStore use IOUtils#close instead of fs#close. (Bibin A Chundatt via rohithsharmaks)
2015-10-07 10:12:14 +05:30
Rohith Sharma K S
9156fc60c6
YARN-4209. RMStateStore FENCED state doesn’t work due to updateFencedState called by stateMachine.doTransition. (Zhihai Xu via rohithsharmaks)
2015-10-07 09:34:59 +05:30
Wangda Tan
29a582ada0
YARN-4215. RMNodeLabels Manager Need to verify and replace node labels for the only modified Node Label Mappings in the request. (Naganarasimha G R via wangda)
2015-10-06 11:56:04 -07:00
Wangda Tan
30ac69c6bd
YARN-4176. Resync NM nodelabels with RM periodically for distributed nodelabels. (Bibin A Chundatt via wangda)
2015-10-05 15:47:21 -07:00
Vinod Kumar Vavilapalli
f1c19b9365
HADOOP-12441. Fixed shell-kill command behaviour to work correctly on some Linux distributions after HADOOP-12317. Contributed by Wangda Tan.
2015-10-05 10:56:55 -07:00
Harsh J
c918f7be5e
HADOOP-12458. Retries is typoed to spell Retires in parts of hadoop-yarn and hadoop-common. Contributed by Neelesh Srinivas Salian.
2015-10-03 18:37:58 +05:30
Xuan
8f08532bde
YARN-1897. CLI and core support for signal container functionality. Contributed by Ming Ma
2015-10-02 18:50:47 -07:00
Jason Lowe
fdf02d1f26
YARN-3619. ContainerMetrics unregisters during getMetrics and leads to ConcurrentModificationException. Contributed by Zhihai Xu
2015-10-02 20:20:31 +00:00
Jason Lowe
854d25b0c3
YARN-3727. For better error recovery, check if the directory exists before using it for localization. Contributed by Zhihai Xu
2015-09-30 14:59:44 +00:00
Karthik Kambatla
a0b5a0a419
YARN-4066. Large number of queues choke fair scheduler. (Johan Gustavsson via kasha)
2015-09-29 07:55:34 -07:00
Anubhav Dhoot
9735afe967
YARN-4180. AMLauncher does not retry on failures when talking to NM. (adhoot)
2015-09-28 16:13:41 -07:00
Jason Lowe
9f53a95ff6
YARN-4141. Runtime Application Priority change should not throw exception for applications at finishing states. Contributed by Sunil G
2015-09-28 22:55:20 +00:00
Anubhav Dhoot
fb2e525c07
YARN-4204. ConcurrentModificationException in FairSchedulerQueueInfo. (adhoot)
2015-09-28 09:05:45 -07:00
Xuan
d1b9b85244
YARN-3624. ApplicationHistoryServer should not reverse the order of the
...
filters it gets. Contributed by Mit Desai
2015-09-24 15:01:17 -07:00
Rohith Sharma K S
a9aafad12b
YARN-4044. Running applications information changes such as movequeue is not published to TimeLine server. (Sunil G via rohithsharmaks)
2015-09-24 12:13:22 +05:30
Rohith Sharma K S
8ed0d4b744
YARN-4152. NodeManager crash with NPE when LogAggregationService#stopContainer called for absent container. (Bibin A Chundatt via rohithsharmaks)
2015-09-24 11:24:14 +05:30
Jian He
b3f6b641dc
YARN-4171. Fix findbugs warnings in YARN-1197 branch. Contributed by Wangda Tan
2015-09-23 13:29:38 -07:00
Jian He
89cab1ba5f
YARN-1651. CapacityScheduler side changes to support container resize. Contributed by Wangda Tan
2015-09-23 13:29:38 -07:00
Jian He
c57eac5dfe
YARN-3868. Recovery support for container resizing. Contributed by Meng Ding
2015-09-23 13:29:38 -07:00
Jian He
c3dc1af072
YARN-1644. RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing. Contributed by Meng Ding
2015-09-23 13:29:37 -07:00
Jian He
c59ae4eeb1
YARN-1643. Make ContainersMonitor support changing monitoring size of an allocated container. Contributed by Meng Ding and Wangda Tan
2015-09-23 13:29:37 -07:00
Jian He
5f5a968d65
YARN-3867. ContainerImpl changes to support container resizing. Contributed by Meng Ding
2015-09-23 13:29:37 -07:00
Jian He
ffd820c27a
YARN-1645. ContainerManager implementation to support container resizing. Contributed by Meng Ding & Wangda Tan
2015-09-23 13:29:37 -07:00
Jian He
83a18add10
YARN-1449. AM-NM protocol changes to support container resizing. Contributed by Meng Ding & Wangda Tan)
2015-09-23 13:29:36 -07:00
Jian He
dfe2cb849f
YARN-3866. AM-RM protocol changes to support container resizing. Contributed by Meng Ding
2015-09-23 13:29:36 -07:00
Jason Lowe
692d51c09d
YARN-3975. WebAppProxyServlet should not redirect to RM page if AHS is enabled. Contributed by Mit Desai
2015-09-23 16:38:55 +00:00
Jason Lowe
c890c51a91
YARN-4095. Avoid sharing AllocatorPerContext object in LocalDirAllocator between ShuffleHandler and LocalDirsHandlerService. Contributed by Zhihai Xu
2015-09-23 15:42:01 +00:00
Tsuyoshi Ozawa
dfd807afab
HADOOP-12428. Fix inconsistency between log-level guards and statements. Contributed by Jagadesh Kiran N and Jackie Chang.
2015-09-22 12:54:29 +09:00
Chris Douglas
8e01b0d97a
YARN-4188. Make MoveApplicationAcrossQueues abstract, newInstance static
...
Contributed by Giovanni Matteo Fumarola
2015-09-21 17:51:48 -07:00
Wangda Tan
b00392dd9c
YARN-4113. RM should respect retry-interval when uses RetryPolicies.RETRY_FOREVER. (Sunil G via wangda)
2015-09-21 11:04:03 -07:00
Rohith Sharma K S
c9cb6a5960
YARN-4167. NPE on RMActiveServices#serviceStop when store is null. (Bibin A Chundatt via rohithsharmaks)
2015-09-21 09:59:30 +05:30
Arun Suresh
94dec5a916
YARN-3920. FairScheduler container reservation on a node should be configurable to limit it to large containers (adhoot via asuresh)
2015-09-18 14:02:55 -07:00
Wangda Tan
9bc913a35c
YARN-3212. RMNode State Transition Update with DECOMMISSIONING state. (Junping Du via wangda)
2015-09-18 10:04:17 -07:00
Steve Loughran
a7201d635f
YARN-2597 MiniYARNCluster should propagate reason for AHS not starting
2015-09-18 09:45:35 +01:00
Rohith Sharma K S
723c31d45b
YARN-4135. Improve the assertion message in MockRM while failing after waiting for the state.(Nijel S F via rohithsharmaks)
2015-09-18 08:44:10 +05:30
Jian He
6c6e734f0b
YARN-4034. Render cluster Max Priority in scheduler metrics in RM web UI. Contributed by Rohith Sharma K S
2015-09-17 14:55:50 +08:00
Steve Loughran
bf2f2b4fc4
YARN-3433. Jersey tests failing with Port in Use -again. (Brahma Reddy Battula)
2015-09-16 10:31:02 +01:00
Jian He
452079af8b
YARN-4078. Add getPendingResourceRequestForAttempt in YarnScheduler interface. Contributed by Naganarasimha G R
2015-09-16 14:59:20 +08:00
Xuan
34ef1a092b
YARN-4149. yarn logs -am should provide an option to fetch all the log
...
files. Contributed by Varun Vasudev
2015-09-15 14:36:30 -07:00
Jason Lowe
8c1cdb17a0
YARN-4158. Remove duplicate close for LogWriter in AppLogAggregatorImpl#uploadLogsForContainers. Contributed by Zhihai Xu
2015-09-15 20:21:33 +00:00
Wangda Tan
ae5308fe1d
YARN-3717. Expose app/am/queue's node-label-expression to RM web UI / CLI / REST-API. (Naganarasimha G R via wangda)
2015-09-15 11:40:50 -07:00
Junping Du
73e3a49eb0
YARN-313. Add Admin API for supporting node resource configuration in command line. (Contributed by Inigo Goiri, Kenji Kikushima and Junping Du)
2015-09-15 07:56:47 -07:00
Jian He
5468baa80a
YARN-3635. Refactored current queue mapping implementation in CapacityScheduler to use a generic PlacementManager framework. Contributed by Wangda Tan
2015-09-15 15:39:20 +08:00
Wangda Tan
e2a0270217
YARN-4151. Fix findbugs errors in hadoop-yarn-server-common module. (Meng Ding via wangda)
2015-09-14 16:00:43 -07:00
Jian He
e1b1d7e4ae
YARN-4126. RM should not issue delegation tokens in unsecure mode. Contributed by Bibin A Chundatt
2015-09-14 14:09:19 +08:00
Karthik Kambatla
332b520a48
YARN-3697. FairScheduler: ContinuousSchedulingThread can fail to shutdown. (Zhihai Xu via kasha)
2015-09-13 18:07:43 -07:00
Karthik Kambatla
81df7b586a
YARN-2005. Blacklisting support for scheduling AMs. (Anubhav Dhoot via kasha)
2015-09-13 17:03:15 -07:00
Steve Loughran
7269906254
HADOOP-12087. [JDK8] Fix javadoc errors caused by incorrect or illegal tags. (Akira AJISAKA via stevel).
2015-09-13 14:25:26 +01:00
Robert Kanter
ea4bb2749f
YARN-4145. Make RMHATestBase abstract so its not run when running all tests under that namespace (adhoot via rkanter)
2015-09-11 11:46:10 -07:00
Robert Kanter
b84fb41bb6
YARN-4115. Reduce loglevel of ContainerManagementProtocolProxy to Debug (adhoot via rkanter)
2015-09-11 11:46:10 -07:00
Varun Vasudev
486d5cb803
YARN-4136. LinuxContainerExecutor loses info when forwarding ResourceHandlerException. Contributed by Bibin A Chundatt.
2015-09-11 14:37:48 +05:30
Wangda Tan
77666105b4
YARN-4106. NodeLabels for NM in distributed mode is not updated even after clusterNodelabel addition in RM. (Bibin A Chundatt via wangda)
2015-09-10 09:30:09 -07:00
Robert Kanter
6dd6ca442a
YARN-4086. Allow Aggregated Log readers to handle HAR files (rkanter)
2015-09-09 18:03:04 -07:00
Zhihai Xu
16b9037dc1
YARN-4096. App local logs are leaked if log aggregation fails to initialize for the app. Contributed by Jason Lowe.
2015-09-08 12:29:54 -07:00
Varun Vasudev
435f935ba7
YARN-4121. Fix typos in capacity scheduler documentation. Contributed by Kai Sasaki.
2015-09-08 12:33:43 +05:30
Jian He
6f72f1e600
YARN-2884. Added a proxy service in NM to proxy the the communication between AM and RM. Contributed by Kishore Chaliparambil
2015-09-08 09:35:46 +08:00
Xuan
9b78e6e33d
YARN-4087. Followup fixes after YARN-2019 regarding RM behavior when
...
state-store error occurs. Contributed by Jian He
2015-09-07 17:45:47 -07:00
Varun Vasudev
1dbd8e34a7
YARN-3591. Resource localization on a bad disk causes subsequent containers failure. Contributed by Lavkesh Lahngir.
2015-09-07 11:32:12 +05:30
Wangda Tan
bcc85e3bab
YARN-4024. YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat. (Hong Zhiguo via wangda)
2015-09-04 15:13:53 -07:00
Jason Lowe
6eaca2e363
YARN-4105. Capacity Scheduler headroom for DRF is wrong. Contributed by Chang Li
2015-09-04 15:30:53 +00:00
Varun Vasudev
40d222e862
YARN-4103. RM WebServices missing scheme for appattempts logLinks. Contributed by Jonathan Eagles.
2015-09-04 14:31:51 +05:30
Varun Vasudev
b469ac531a
YARN-3970. Add REST api support for Application Priority. Contributed by Naganarasimha G R.
2015-09-03 16:40:10 +05:30
Jian He
09c64ba1ba
YARN-4101. RM should print alert messages if Zookeeper and Resourcemanager gets connection issue. Contributed by Xuan Gong
2015-09-02 17:45:23 -07:00
Rohith Sharma K S
7d6687fe76
YARN-3893. Both RM in active state when Admin#transitionToActive failure from refeshAll() (Bibin A Chundatt via rohithsharmaks)
2015-09-02 15:22:48 +05:30
Rohith Sharma K S
095ab9ab5f
YARN-4073. Removed unused ApplicationACLsManager in ContainerManagerImpl constructor. (Naganarasimha G R via rohithsharmaks)
2015-09-02 14:13:33 +05:30
Andrew Wang
0eb9b19325
HADOOP-12369. Point hadoop-project/pom.xml java.security.krb5.conf within target folder.
2015-09-01 10:57:32 -07:00
Tsuyoshi Ozawa
faa38e1aa4
YARN-2801. Add documentation for node labels feature. Contributed by Wangda Tan and Naganarasimha G R.
2015-09-01 17:54:49 +09:00
Varun Vasudev
bf669b6d9f
YARN-4082. Container shouldn't be killed when node's label updated. Contributed by Wangda Tan.
2015-09-01 14:19:11 +05:30
Jian He
a3fd2ccc86
YARN-4092. Fixed UI redirection to print useful messages when both RMs are in standby mode. Contributed by Xuan Gong
2015-08-31 17:33:24 -07:00
Junping Du
beb65c9465
YARN-1556. NPE getting application report with a null appId. Contributed by Weiwei Yang.
2015-08-28 05:57:34 -07:00
Jian He
a9c8ea71aa
YARN-3250. Support admin cli interface in for Application Priority. Contributed by Rohith Sharma K S
2015-08-27 13:25:53 -07:00
Andrew Wang
90fe7bcc3b
HADOOP-12362. Set hadoop.tmp.dir and hadoop.log.dir in pom. Contributed by Charlie Helin.
2015-08-27 10:17:00 -07:00
Jian He
57c7ae1aff
YARN-4014. Support user cli interface in for Application Priority. Contributed by Rohith Sharma K S
2015-08-24 20:36:44 -07:00
Rohith Sharma K S
feaf034994
YARN-3896. RMNode transitioned from RUNNING to REBOOTED because its response id has not been reset synchronously. (Jun Gong via rohithsharmaks)
2015-08-24 11:25:07 +05:30
Xuan
b71c6006f5
YARN-221. Addendum patch to compilation issue which is caused by missing
...
AllContainerLogAggregationPolicy. Contributed by Xuan Gong
2015-08-23 16:46:30 -07:00
Xuan
37e1c3d82a
YARN-221. NM should provide a way for AM to tell it not to aggregate
...
logs. Contributed by Ming Ma
2015-08-22 16:25:24 -07:00
Rohith Sharma K S
22de7c1dca
YARN-3986. getTransferredContainers in AbstractYarnScheduler should be present in YarnScheduler interface
2015-08-21 10:51:11 +05:30
Wangda Tan
fc07464d1a
YARN-2923. Support configuration based NodeLabelsProvider Service in Distributed Node Label Configuration Setup. (Naganarasimha G R)
2015-08-20 11:51:03 -07:00
Xuan
22dc5fc209
YARN-4028. AppBlock page key update and diagnostics value null on
...
recovery. Contributed by Bibin A Chundatt
2015-08-18 22:53:03 -07:00
Zhihai Xu
14215c8ef8
YARN-4057. If ContainersMonitor is not enabled, only print related log info one time. Contributed by Jun Gong.
2015-08-18 11:36:02 -07:00
Zhihai Xu
3a76a010b8
YARN-3857: Memory leak in ResourceManager with SIMPLE mode. Contributed by mujunchao.
2015-08-18 10:36:40 -07:00
Karthik Kambatla
13604bd5f1
YARN-4055. Report node resource utilization in heartbeat. (Inigo Goiri via kasha)
2015-08-16 15:08:53 -07:00
Karthik Kambatla
def12933b3
YARN-3534. Collect memory/cpu usage on the node. (Inigo Goiri via kasha)
2015-08-16 06:24:16 -07:00
Jian He
0a030546e2
YARN-3987. Send AM container completed msg to NM once AM finishes. Contributed by sandflee
2015-08-13 16:22:53 -07:00
Jian He
7a445fcfab
YARN-4047. ClientRMService getApplications has high scheduler lock contention. Contributed by Jason Lowe
2015-08-13 16:02:57 -07:00
Jian He
38aed1a94e
YARN-4005. Completed container whose app is finished is possibly not removed from NMStateStore. Contributed by Jun Gong
2015-08-13 14:46:08 -07:00
Robert Kanter
dc2340c60e
YARN-4031. Add JvmPauseMonitor to ApplicationHistoryServer and WebAppProxyServer (djp via rkanter)
2015-08-12 15:47:47 -07:00
Jian He
e5003be907
YARN-4026. Refactored ContainerAllocator to accept a list of priorites rather than a single priority. Contributed by Wangda Tan
2015-08-12 15:07:50 -07:00
rohithsharmaks
1c12adb71f
YARN-4023. Publish Application Priority to TimelineServer. (Sunil G via rohithsharmaks)
2015-08-12 14:45:41 +05:30
Xuan
3ae716fa69
YARN-3999. RM hangs on draing events. Contributed by Jian He
2015-08-11 18:25:11 -07:00
Jian He
fa1d84ae27
YARN-3887. Support changing Application priority during runtime. Contributed by Sunil G
2015-08-10 20:51:54 -07:00
Wangda Tan
cf9d3c9256
YARN-3873. PendingApplications in LeafQueue should also use OrderingPolicy. (Sunil G via wangda)
2015-08-10 14:54:55 -07:00
Wangda Tan
4bc42d76e7
YARN-3966. Fix excessive loggings in CapacityScheduler. (Jian He via wangda)
2015-08-07 09:46:57 -07:00
Rohith Sharma K S
b6265d39c5
YARN-3948. Display Application Priority in RM Web UI.(Sunil G via rohithsharmaks)
2015-08-07 10:43:41 +05:30
Carlo Curino
8572a5a14b
YARN-3974. Refactor the reservation system test cases to use parameterized base test. (subru via curino)
2015-08-02 01:55:31 -07:00
Junping Du
cfee02b3bd
YARN-4019. Add JvmPauseMonitor to ResourceManager and NodeManager. Contributed by Robert Kanter.
2015-08-06 06:49:45 -07:00
Arun Suresh
154c9d2e42
YARN-3961. Expose pending, running and reserved containers of a queue in REST api and yarn top (adhoot via asuresh)
2015-08-05 23:14:14 -07:00
rohithsharmaks
df9e7280db
YARN-3992. TestApplicationPriority.testApplicationPriorityAllocation fails intermittently. (Contributed by Sunil G)
2015-08-06 10:43:37 +05:30
Jian He
ba2313d614
YARN-3983. Refactored CapacityScheduleri#FiCaSchedulerApp to easier extend container allocation logic. Contributed by Wangda Tan
2015-08-05 13:47:40 -07:00
Arun Suresh
f271d37735
YARN-3736. Add RMStateStore apis to store and load accepted reservations for failover (adhoot via asuresh)
2015-08-05 12:57:12 -07:00
Xuan
c3364ca8e7
YARN-4004. container-executor should print output of docker logs if the
...
docker container exits with non-0 exit status. Contributed by Varun
Vasudev
2015-08-03 18:10:11 -07:00
Xuan
0306d902f5
YARN-3543. ApplicationReport should be able to tell whether the
...
Application is AM managed or not. Contributed by Rohith Sharma K S
2015-08-03 15:46:00 -07:00
Jason Lowe
469cfcd695
YARN-3965. Add startup timestamp to nodemanager UI. Contributed by Hong Zhiguo
2015-08-03 15:53:32 +00:00
Jonathan Eagles
3cd02b9522
YARN-3978. Configurably turn off the saving of container info in Generic AHS (Eric Payne via jeagles)
2015-08-03 10:38:05 -05:00
Allen Wittenauer
666cafca8d
HADOOP-12249. pull argument parsing into a function (aw)
2015-07-31 14:32:21 -07:00
Jason Lowe
32e490b6c0
YARN-3990. AsyncDispatcher may overloaded with RMAppNodeUpdateEvent when Node is connected/disconnected. Contributed by Bibin A Chundatt
2015-07-31 17:37:24 +00:00
Zhihai Xu
ab80e27703
YARN-433. When RM is catching up with node updates then it should not expire acquired containers. Contributed by Xuan Gong
2015-07-30 21:57:11 -07:00
Wangda Tan
91b42e7d6e
YARN-3971. Skip RMNodeLabelsManager#checkRemoveFromClusterNodeLabelsOfQueue on nodelabel recovery. (Bibin A Chundatt via wangda)
2015-07-30 10:00:31 -07:00
Wangda Tan
8acb30b016
YARN-3963. AddNodeLabel on duplicate label addition shows success. (Bibin A Chundatt via wangda)
2015-07-30 09:42:55 -07:00
rohithsharmaks
c020b62cf8
YARN-3919. NPEs' while stopping service after exception during CommonNodeLabelsManager#start. (varun saxena via rohithsharmaks)
2015-07-29 23:30:47 +05:30
Karthik Kambatla
5205a330b3
YARN-2768. Avoid cloning Resource in FSAppAttempt#updateDemand. (Hong Zhiguo via kasha)
2015-07-29 09:42:32 -07:00
Jason Lowe
2b2bd92146
YARN-3950. Add unique SHELL_ID environment variable to DistributedShell. Contributed by Robert Kanter
2015-07-29 15:16:40 +00:00
Xuan
f170934215
YARN-3982. container-executor parsing of container-executor.cfg broken
...
in trunk and branch-2. Contributed by Varun Vasudev
2015-07-27 23:45:58 -07:00
Jian He
3572ebd738
YARN-3846. RM Web UI queue filter is not working for sub queue. Contributed by Mohammad Shahid Khan
2015-07-27 17:12:05 -07:00
Varun Vasudev
3e6fce91a4
YARN-3853. Add docker container runtime support to LinuxContainterExecutor. Contributed by Sidharta Seethana.
2015-07-27 11:57:40 -07:00
Varun Vasudev
f36835ff9b
YARN-3852. Add docker container support to container-executor. Contributed by Abin Shahab.
2015-07-27 10:14:51 -07:00
Akira Ajisaka
42d4e0ae99
YARN-3958. TestYarnConfigurationFields should be moved to hadoop-yarn-api module. Contributed by Varun Saxena.
2015-07-27 11:43:25 +09:00
ccurino
156f24ead0
YARN-3656. LowCost: A Cost-Based Placement Agent for YARN Reservations. (Jonathan Yaniv and Ishai Menache via curino)
2015-07-25 07:39:47 -07:00
Wangda Tan
a3bd7b4a59
YARN-3973. Recent changes to application priority management break reservation system from YARN-1051 (Carlo Curino via wangda)
2015-07-24 16:44:18 -07:00
Jason Lowe
ff9c13e0a7
YARN-3925. ContainerLogsUtils#getContainerLogFile fails to read container log files from full disks. Contributed by zhihai xu
2015-07-24 22:14:39 +00:00
Jian He
83fe34ac08
YARN-3026. Move application-specific container allocation logic from LeafQueue to FiCaSchedulerApp. Contributed by Wangda Tan
2015-07-24 14:00:25 -07:00
Karthik Kambatla
d19d187753
YARN-3957. FairScheduler NPE In FairSchedulerQueueInfo causing scheduler page to return 500. (Anubhav Dhoot via kasha)
2015-07-24 11:44:37 -07:00
Xuan
fbd6063269
YARN-3967. Fetch the application report from the AHS if the RM does not
...
know about it. Contributed by Mit Desai
2015-07-24 10:15:54 -07:00
carlo curino
0fcb4a8cf2
YARN-3969. Allow jobs to be submitted to reservation that is active but does not have any allocations. (subru via curino)
2015-07-23 19:33:59 -07:00
Rohith Sharma K S
e202efaf93
YARN-3845. Scheduler page does not render RGBA color combinations in IE11. (Contributed by Mohammad Shahid Khan)
2015-07-24 12:43:06 +05:30
Robert Kanter
1d3026e7b3
YARN-3900. Protobuf layout of yarn_security_token causes errors in other protos that include it (adhoot via rkanter)
2015-07-23 14:46:54 -07:00
Wangda Tan
3bba180051
YARN-3941. Proportional Preemption policy should try to avoid sending duplicate PREEMPT_CONTAINER event to scheduler. (Sunil G via wangda)
2015-07-23 10:07:57 -07:00
Junping Du
ee98d6354b
YARN-2019. Retrospect on decision of making RM crashed if any exception throw in ZKRMStateStore. Contributed by Jian He.
2015-07-22 17:52:35 -07:00
Wangda Tan
06e5dd2c84
YARN-3956. Fix TestNodeManagerHardwareUtils fails on Mac (Varun Vasudev via wangda)
2015-07-22 12:01:41 -07:00
rohithsharmaks
8376ea3297
YARN-3954. Fix TestYarnConfigurationFields#testCompareConfigurationClassAgainstXml. (varun saxena via rohithsharmaks)
2015-07-23 00:28:24 +05:30
Wangda Tan
76ec26de80
YARN-3932. SchedulerApplicationAttempt#getResourceUsageReport and UserInfo should based on total-used-resources. (Bibin A Chundatt via wangda)
2015-07-22 11:54:02 -07:00
Jian He
393fe71771
YARN-3878. AsyncDispatcher can hang while stopping if it is configured for draining events on stop. Contributed by Varun Saxena
2015-07-21 15:05:41 -07:00
Allen Wittenauer
3b7ffc4f3f
YARN-3261. rewrite resourcemanager restart doc to remove roadmap bits (Gururaj Shetty via aw)
2015-07-21 10:00:34 -07:00
Wangda Tan
c39ca541f4
YARN-2003. Support for Application priority : Changes in RM and Capacity Scheduler. (Sunil G via wangda)
2015-07-21 09:57:23 -07:00
Allen Wittenauer
da2d1ac4bc
YARN-3915. scmadmin help message correction (Bibin A Chundatt via aw)
2015-07-21 09:44:45 -07:00
Colin Patrick Mccabe
419c51d233
YARN-3844. Make hadoop-yarn-project Native code -Wall-clean (Alan Burlison via Colin P. McCabe)
2015-07-17 11:38:59 -07:00
Jonathan Eagles
7faae0e6fe
YARN-3905. Application History Server UI NPEs when accessing apps run after RM restart (Eric Payne via jeagles)
2015-07-17 11:02:11 -05:00
Arun Suresh
9b272ccae7
YARN-3535. Scheduler must re-request container resources when RMContainer transitions from ALLOCATED to KILLED (rohithsharma and peng.zhang via asuresh)
2015-07-17 04:31:34 -07:00
Allen Wittenauer
ee36f4f9b8
HADOOP-10979. Auto-entries in hadoop_usage (aw)
2015-07-16 16:58:11 -07:00
Wangda Tan
3540d5fe4b
YARN-3885. ProportionalCapacityPreemptionPolicy doesn't preempt if queue is more than 2 level. (Ajith S via wangda)
2015-07-16 16:13:32 -07:00
Wangda Tan
fa2b63ed16
YARN-3930. FileSystemNodeLabelsStore should make sure edit log file closed when exception is thrown. (Dian Fu via wangda)
2015-07-16 16:06:20 -07:00
Tsuyoshi Ozawa
1ba2986dee
YARN-3805. Update the documentation of Disk Checker based on YARN-90. Contributed by Masatake Iwasaki.
2015-07-16 17:52:38 +09:00
Tsuyoshi Ozawa
f02dd146f5
YARN-3174. Consolidate the NodeManager and NodeManagerRestart documentation into one. Contributed by Masatake Iwasaki.
2015-07-16 15:22:30 +09:00
Tsuyoshi Ozawa
edcaae44c1
YARN-3170. YARN architecture document needs updating. Contirubted by Brahma Reddy Battula.
2015-07-15 15:42:41 +09:00
Arun Suresh
ac94ba3e18
YARN-3453. Ensure preemption logic in FairScheduler uses DominantResourceCalculator in DRF queues to prevent unnecessary thrashing. (asuresh)
2015-07-14 00:23:55 -07:00
Chris Douglas
a431ed9075
HADOOP-12211. Collect disk usage on the node. Contributed by Robert Grandl
2015-07-13 15:36:11 -07:00
Jian He
2466460d4c
Revert "YARN-3878. AsyncDispatcher can hang while stopping if it is configured for draining events on stop. (Varun Saxena via kasha)"
...
This reverts commit aa067c6aa4
.
2015-07-13 14:30:35 -07:00
Akira Ajisaka
19295b36d9
YARN-3381. Fix typo InvalidStateTransitonException. Contributed by Brahma Reddy Battula.
2015-07-13 17:52:13 +09:00
Wangda Tan
5ed1fead6b
YARN-3894. RM startup should fail for wrong CS xml NodeLabel capacity configuration. (Bibin A Chundatt via wangda)
2015-07-12 21:52:11 -07:00
Akira Ajisaka
d6675606dc
YARN-3069. Document missing properties in yarn-default.xml. Contributed by Ray Chiang.
2015-07-13 12:57:01 +09:00
Gera Shegalov
d7319dee37
YARN-3917. getResourceCalculatorPlugin for the default should intercept all exceptions. (gera)
2015-07-11 22:29:36 -07:00
Wangda Tan
1df39c1efc
YARN-3849. Too much of preemption activity causing continuos killing of containers across queues. (Sunil G via wangda)
2015-07-11 10:26:46 -07:00
Zhijie Shen
1ea36299a4
YARN-3116. RM notifies NM whether a container is an AM container or normal task container. Contributed by Giovanni Matteo Fumarola.
2015-07-10 18:58:10 -07:00
Ming Ma
08244264c0
YARN-3445. Cache runningApps in RMNode for getting running apps on given NodeId. (Junping Du via mingma)
2015-07-10 08:30:10 -07:00
Xuan
5214876792
YARN-3888. ApplicationMaster link is broken in RM WebUI when appstate is
...
NEW. Contributed by Bibin A Chundatt
2015-07-09 21:37:33 -07:00
Chris Douglas
1a0752d85a
HADOOP-12210. Collect network usage on the node. Contributed by Robert Grandl
2015-07-09 17:48:43 -07:00
carlo curino
0e602fa3a1
YARN-3800. Reduce storage footprint for ReservationAllocation. Contributed by Anubhav Dhoot.
2015-07-09 16:51:59 -07:00
Karthik Kambatla
ac6048372a
HADOOP-12180. Move ResourceCalculatorPlugin from YARN to Common. (Chris Douglas via kasha)
2015-07-09 09:56:40 -07:00
Karthik Kambatla
aa067c6aa4
YARN-3878. AsyncDispatcher can hang while stopping if it is configured for draining events on stop. (Varun Saxena via kasha)
2015-07-09 09:48:29 -07:00
Karthik Kambatla
527c40e4d6
YARN-1012. Report NM aggregated container resource utilization in heartbeat. (Inigo Goiri via kasha)
2015-07-09 09:35:14 -07:00
Varun Vasudev
63d0365088
YARN-2194. Addendum patch to fix failing unit test in TestPrivilegedOperationExecutor. Contributed by Sidharta Seethana.
2015-07-09 11:51:59 +05:30
Akira Ajisaka
d6325745e2
YARN-3690. [JDK8] 'mvn site' fails. Contributed by Brahma Reddy Battula.
2015-07-08 15:42:31 +09:00
Jian He
c9dd2cada0
YARN-3892. Fixed NPE on RMStateStore#serviceStop when CapacityScheduler#serviceInit fails. Contributed by Bibin A Chundatt
2015-07-07 14:16:21 -07:00
Varun Vasudev
c40bdb56a7
YARN-2194. Fix bug causing CGroups functionality to fail on RHEL7. Contributed by Wei Yan.
2015-07-07 16:59:29 +05:30
Devaraj K
af63427c6d
YARN-3837. javadocs of TimelineAuthenticationFilterInitializer give wrong
...
prefix for auth options. Contributed by Bibin A Chundatt.
2015-07-07 12:06:30 +05:30
Xuan
688617d6d7
YARN-3882. AggregatedLogFormat should close aclScanner and ownerScanner
...
after create them. Contributed by zhihai xu
2015-07-04 21:51:58 -07:00
Devaraj K
37d7395773
YARN-3875. FSSchedulerNode#reserveResource() doesn't print Application Id
...
properly in log. Contributed by Bibin A Chundatt.
2015-07-02 10:20:31 +05:30
Wangda Tan
0e4b06690f
YARN-3508. Prevent processing preemption events on the main RM dispatcher. (Varun Saxena via wangda)
2015-07-01 17:32:22 -07:00
Jason Lowe
b5cdf78e8e
YARN-3793. Several NPEs when deleting local files on NM recovery. Contributed by Varun Saxena
2015-07-01 21:13:32 +00:00
Devaraj K
80a68d6056
YARN-3830. AbstractYarnScheduler.createReleaseCache may try to clean a
...
null attempt. Contributed by nijel.
2015-07-01 19:03:44 +05:30
Devaraj K
7405c59799
YARN-3823. Fix mismatch in default values for
...
yarn.scheduler.maximum-allocation-vcores property. Contributed by Ray
Chiang.
2015-07-01 11:11:26 +05:30
Colin Patrick Mccabe
d0cc0380b5
YARN-3827. Migrate YARN native build to new CMake framework (Alan Burlison via Colin P. McCabe)
2015-06-30 16:24:19 -07:00
Gera Shegalov
6f2a41e37d
YARN-3768. ArrayIndexOutOfBoundsException with empty environment variables. (Zhihai Xu via gera)
2015-06-30 14:59:33 -07:00
Jian He
4672315e2d
YARN-3770. SerializedException should also handle java.lang.Error on de-serialization. Contributed by Lavkesh Lahngir
2015-06-29 14:31:49 -07:00
Jian He
62e583c7dc
YARN-3695. ServerProxy (NMProxy, etc.) shouldn't retry forever for non network exception. Contributed by Raju Bairishetti
2015-06-29 13:37:32 -07:00
Junping Du
a95d39f9d0
YARN-3860. rmadmin -transitionToActive should check the state of non-target node. (Contributed by Masatake Iwasaki)
2015-06-28 22:26:47 -07:00
Devaraj K
b543d1a390
YARN-3859. LeafQueue doesn't print user properly for application add.
...
Contributed by Varun Saxena.
2015-06-28 10:04:50 +05:30
Xuan
fe6c1bd73a
YARN-2871. TestRMRestart#testRMRestartGetApplicationList sometime fails
...
in trunk. Contributed by zhihai xu
2015-06-26 19:43:59 -07:00
Jason Lowe
40b256949a
YARN-3850. NM fails to read files from full disks which can lead to container logs being lost and other issues. Contributed by Varun Saxena
2015-06-26 15:47:07 +00:00
Devaraj K
b381f88c71
YARN-3745. SerializedException should also try to instantiate internal
...
exception with the default constructor. Contributed by Lavkesh Lahngir.
2015-06-25 17:38:11 +05:30
Devaraj K
57f1a01eda
YARN-3826. Race condition in ResourceTrackerService leads to wrong
...
diagnostics messages. Contributed by Chengbing Liu.
2015-06-25 16:13:59 +05:30
Jonathan Eagles
4c659ddbf7
YARN-3360. Add JMX metrics to TimelineDataManager (Jason Lowe via jeagles)
2015-06-24 16:16:52 -05:00
rohithsharmaks
dd4b387d96
YARN-3790. usedResource from rootQueue metrics may get stale data for FS scheduler after recovering the container (Zhihai Xu via rohithsharmaks)
2015-06-24 23:00:14 +05:30
Jason Lowe
8d58512d6e
YARN-3832. Resource Localization fails on a cluster due to existing cache directories. Contributed by Brahma Reddy Battula
2015-06-24 16:37:39 +00:00
Jason Lowe
2a20dd9b61
YARN-3809. Failed to launch new attempts because ApplicationMasterLauncher's threads all hang. Contributed by Jun Gong
2015-06-24 16:23:48 +00:00
Robert Kanter
99271b7621
YARN-3835. hadoop-yarn-server-resourcemanager test package bundles core-site.xml, yarn-site.xml (vamsee via rkanter)
2015-06-22 18:02:27 -07:00
Karthik Kambatla
5ebf2817e5
YARN-3842. NMProxy should retry on NMNotYetReadyException. (Robert Kanter via kasha)
2015-06-22 17:47:47 -07:00
Xuan
6c7a9d502a
YARN-3834. Scrub debug logging of tokens during resource localization. Contributed by Chris Nauroth
2015-06-21 17:13:44 -07:00
Gera Shegalov
63d40d5286
MAPREDUCE-6316. Task Attempt List entries should link to the task overview. (Siqi Li via gera)
2015-06-20 11:38:21 -07:00
Xuan
5b5bb8dcdc
YARN-3802. Two RMNodes for the same NodeId are used in RM sometimes
...
after NM is reconnected. Contributed by zhihai xu
2015-06-18 14:37:49 -07:00
Devaraj K
2ad668748e
YARN-3824. Fix two minor nits in member variable properties of
...
YarnConfiguration. Contributed by Ray Chiang.
2015-06-18 16:44:08 +05:30
Xuan
a826d432f9
YARN-3804. Both RM are on standBy state when kerberos user not in yarn.admin.acl. Contributed by Varun Saxena
2015-06-17 16:23:27 -07:00
Devaraj K
ebb9a82519
YARN-3148. Allow CORS related headers to passthrough in
...
WebAppProxyServlet. Contributed by Varun Saxena.
2015-06-17 15:56:18 +05:30
Devaraj K
318d2cde7c
YARN-3617. Fix WindowsResourceCalculatorPlugin.getCpuFrequency() returning
...
always -1. Contributed by J.Andreina.
2015-06-17 13:54:09 +05:30
Xuan
e27d5a13b0
YARN-3714. AM proxy filter can not get RM webapp address from
...
yarn.resourcemanager.hostname.rm-id. Contributed by Masatake Iwasaki
2015-06-16 14:06:16 -07:00
Devaraj K
b039e69bb0
YARN-3789. Improve logs for LeafQueue#activateApplications(). Contributed
...
by Bibin A Chundatt.
2015-06-16 14:03:22 +05:30
Tsuyoshi Ozawa
e8c514373f
YARN-3711. Documentation of ResourceManager HA should explain configurations about listen addresses. Contributed by Masatake Iwasaki.
2015-06-16 10:12:38 +09:00
Devaraj K
d8dcfa98e3
YARN-3794. TestRMEmbeddedElector fails because of ambiguous LOG reference.
...
Contributed by Chengbing Liu.
2015-06-12 13:42:49 +05:30
Xuan
5583f88bf7
YARN-3785. Support for Resource as an argument during submitApp call in
...
MockRM test class. Contributed by Sunil G
2015-06-10 21:40:48 -07:00
Zhijie Shen
8d0ef31632
YARN-3787. Allowed generic history service to load a number of applications whose started time is within the given range. Contributed by Xuan Gong.
2015-06-08 23:14:58 -07:00
cnauroth
a531b058ae
YARN-3786. Document yarn class path options. Contributed by Brahma Reddy Battula.
2015-06-08 16:18:36 -07:00
Xuan
2b2465dfac
YARN-3778. Fix Yarn resourcemanger CLI usage. Contributed by Brahma Reddy Battula
2015-06-08 15:43:03 -07:00
Jian He
960b8f19ca
YARN-2716. Refactor ZKRMStateStore retry code with Apache Curator. Contributed by Karthik Kambatla
2015-06-08 14:50:58 -07:00
Devaraj K
126321eded
YARN-3747. TestLocalDirsHandlerService should delete the created test
...
directory logDir2. Contributed by David Moore.
2015-06-08 15:32:13 +05:30
Devaraj K
c7ee6c151c
YARN-3780. Should use equals when compare Resource in
...
RMNodeImpl#ReconnectNodeTransition. Contributed by zhihai xu.
2015-06-08 11:54:55 +05:30
Karthik Kambatla
bd69ea408f
YARN-3655. FairScheduler: potential livelock due to maxAMShare limitation and container reservation. (Zhihai Xu via kasha)
2015-06-07 11:37:52 -07:00
Xuan
3e000a919f
YARN-1462. AHS API and other AHS changes to handle tags for completed MR jobs. Contributed by Xuan Gong
2015-06-05 12:48:52 -07:00
Karthik Kambatla
75885852cc
YARN-3259. FairScheduler: Trigger fairShare updates on node events. (Anubhav Dhoot via kasha)
2015-06-05 09:39:41 -07:00