tgraves
|
189a63a719
|
YARN-3434. Interaction between reservations and userlimit can result in significant ULF violation
|
2015-04-23 14:39:25 +00:00 |
Steve Loughran
|
d9bcf99aef
|
YARN-2605. [RM HA] Rest api endpoints doing redirect incorrectly. (Xuan Gong via stevel)
|
2015-04-23 09:22:48 +01:00 |
Junping Du
|
fad9d7e85b
|
New parameter of CLI for decommissioning node gracefully in RMAdmin CLI. Contributed by Devaraj K
|
2015-04-22 10:07:20 -07:00 |
Jian He
|
bdd90110e6
|
YARN-3494. Expose AM resource limit and usage in CS QueueMetrics. Contributed by Rohith Sharmaks
|
2015-04-21 20:06:20 -07:00 |
Wangda Tan
|
e71d0d87d9
|
YARN-3410. YARN admin should be able to remove individual application records from RMStateStore. (Rohith Sharmaks via wangda)
|
2015-04-21 17:51:22 -07:00 |
Tsuyoshi Ozawa
|
105afd5477
|
YARN-3495. Confusing log generated by FairScheduler. Contributed by Brahma Reddy Battula.
|
2015-04-22 05:47:59 +09:00 |
|
Wangda Tan
|
44872b76fc
|
YARN-3463. Integrate OrderingPolicy Framework with CapacityScheduler. (Craig Welch via wangda)
|
2015-04-20 17:12:32 -07:00 |
|
Jian He
|
497c86b485
|
YARN-3136. Fixed a synchronization problem of AbstractYarnScheduler#getTransferredContainers. Contributed by Sunil G
|
2015-04-18 12:46:37 -07:00 |
|
Wangda Tan
|
f47a5763ac
|
YARN-3487. CapacityScheduler scheduler lock obtained unnecessarily when calling getQueue (Jason Lowe via wangda)
|
2015-04-17 17:22:27 -07:00 |
|
Wangda Tan
|
f65eeb412d
|
YARN-3493. RM fails to come up with error "Failed to load/recover state" when mem settings are changed. (Jian He via wangda)
|
2015-04-17 17:11:22 -07:00 |
|
Jian He
|
6779467ab6
|
YARN-3451. Display attempt start time and elapsed time on the web UI. Contributed by Rohith Sharmaks
|
2015-04-17 15:55:34 -07:00 |
|
Jian He
|
d573f09fb9
|
YARN-2696. Queue sorting in CapacityScheduler should consider node label. Contributed by Wangda Tan
|
2015-04-17 13:36:59 -07:00 |
|
Junping Du
|
1db355a875
|
YARN-1402. Update related Web UI and CLI with exposing client API to check log aggregation status. Contributed by Xuan Gong.
|
2015-04-17 13:18:59 -07:00 |
|
Jian He
|
bb6dde68f1
|
YARN-3021. YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp. Contributed by Yongjun Zhang
|
2015-04-16 19:43:37 -07:00 |
Akira Ajisaka
|
1fa8075794
|
MAPREDUCE-6300. Task list sort by task id broken. Contributed by Siqi Li.
|
2015-04-16 10:04:09 -05:00 |
|
Jian He
|
1b89a3e173
|
YARN-3354. Add node label expression in ContainerTokenIdentifier to support RM recovery. Contributed by Wangda Tan
|
2015-04-15 13:57:06 -07:00 |
|
Tsuyoshi Ozawa
|
e48cedc663
|
YARN-3326. Support RESTful API for getLabelsToNodes. Contributed by Naganarasimha G R.
|
2015-04-15 14:03:55 -05:00 |
|
Wangda Tan
|
5004e75332
|
YARN-3318. Create Initial OrderingPolicy Framework and FifoOrderingPolicy. (Craig Welch via wangda)
|
2015-04-15 09:56:32 -07:00 |
|
Jian He
|
0fefda645b
|
YARN-3361. CapacityScheduler side changes to support non-exclusive node labels. Contributed by Wangda Tan
|
2015-04-14 11:45:58 -07:00 |
|
Jian He
|
b46ee1e7a3
|
YARN-3266. RMContext#inactiveNodes should have NodeId as map key. Contributed by Chengbing Liu
|
2015-04-14 10:54:22 -07:00 |
|
Jian He
|
a1afbc48b5
|
YARN-3472. Fixed possible leak in DelegationTokenRenewer#allTokens. Contributed by Rohith Sharmaks
|
2015-04-13 14:07:17 -07:00 |
|
Jian He
|
944a16579f
|
YARN-3382. Some of UserMetricsInfo metrics are incorrectly set to root queue metrics. Contributed by Rohit Agarwal
|
2015-04-13 10:53:34 -07:00 |
Karthik Kambatla
|
e516706b89
|
YARN-3469. ZKRMStateStore: Avoid setting watches that are not required. (Jun Hong via kasha)
|
2015-04-10 11:20:34 -07:00 |
|
Jian He
|
577d755e4b
|
YARN-3348. Add a 'yarn top' tool to help understand cluster usage. Contributed by Varun Vasudev
|
2015-04-10 09:57:17 -07:00 |
|
Junping Du
|
92431c9617
|
YARN-1376. NM need to notify the log aggregation status to RM through Node heartbeat. Contributed by Xuan Gong.
|
2015-04-10 08:56:18 -07:00 |
Xuan
|
afa5d4715a
|
YARN-3293. Track and display capacity scheduler health metrics in web
UI. Contributed by Varun Vasudev
|
2015-04-09 23:38:04 -07:00 |
Vinod Kumar Vavilapalli
|
9c5911294e
|
YARN-3055. Fixed ResourceManager's DelegationTokenRenewer to not stop token renewal of applications part of a bigger workflow. Contributed by Daryn Sharp.
|
2015-04-09 13:08:53 -07:00 |
|
Wangda Tan
|
1885141e90
|
YARN-3466. Fix RM nodes web page to sort by node HTTP-address, #containers and node-label column. (Jason Lowe via wangda)
|
2015-04-09 10:35:12 -07:00 |
|
Xuan
|
d27e9241e8
|
YARN-3294. Allow dumping of Capacity Scheduler debug logs via web UI for
a fixed time period. Contributed by Varun Vasudev
|
2015-04-07 09:52:36 -07:00 |
Robert Kanter
|
99b08a748e
|
YARN-2429. TestAMRMTokens.testTokenExpiry fails Intermittently with error message:Invalid AMRMToken (zxu via rkanter)
|
2015-04-06 14:11:20 -07:00 |
|
Tsuyoshi Ozawa
|
53959e69f7
|
TestFairScheduler.testContinuousScheduling fails Intermittently. Contributed by Zhihai Xu.
|
2015-04-06 20:19:13 +09:00 |
|
Xuan
|
96d72118f5
|
YARN-3435. AM container to be allocated Appattempt AM container shown as
null. Contributed by Bibin A Chundatt
|
2015-04-05 00:40:57 -07:00 |
|
Wangda Tan
|
bad070fe15
|
YARN-2901. Add errors and warning metrics page to RM, NM web UI. (Varun Vasudev via wangda)
|
2015-04-02 17:23:20 -07:00 |
Sandy Ryza
|
6a6a59db7f
|
YARN-3415. Non-AM containers can be counted towards amResourceUsage of a fairscheduler queue (Zhihai Xu via Sandy Ryza)
|
2015-04-02 13:56:08 -07:00 |
Zhijie Shen
|
8366a36ad3
|
YARN-3430. Made headroom data available on app attempt page of RM WebUI. Contributed by Xuan Gong.
|
2015-04-01 13:47:54 -07:00 |
|
Xuan
|
4728bdfa15
|
YARN-3248. Display count of nodes blacklisted by apps in the web UI.
Contributed by Varun Vasudev
|
2015-04-01 04:19:18 -07:00 |
|
Karthik Kambatla
|
79f7f2aabf
|
YARN-3412. RM tests should use MockRM where possible. (kasha)
|
2015-03-31 09:14:15 -07:00 |
|
Tsuyoshi Ozawa
|
b5a22e9838
|
YARN-3258. FairScheduler: Need to add more logging to investigate allocations. Contributed by Anubhav Dhoot.
|
2015-03-31 17:42:44 +09:00 |
|
Wangda Tan
|
2a945d24f7
|
YARN-2495. Allow admin specify labels from each NM (Distributed configuration for node label). (Naganarasimha G R via wangda)
|
2015-03-30 12:05:21 -07:00 |
|
Wangda Tan
|
97a7277a2d
|
YARN-3383. AdminService should use warn instead of info to log exception when operation fails. (Li Lu via wangda)
|
2015-03-24 10:38:54 -07:00 |
|
Karthik Kambatla
|
972f1f1ab9
|
YARN-2868. FairScheduler: Metric for latency to allocate first container for an application. (Ray Chiang via kasha)
|
2015-03-23 14:07:05 -07:00 |
|
Karthik Kambatla
|
2bc097cd14
|
YARN-3241. FairScheduler handles invalid queue names inconsistently. (Zhihai Xu via kasha)
|
2015-03-23 13:22:03 -07:00 |
cnauroth
|
6ca1f12024
|
YARN-3336. FileSystem memory leak in DelegationTokenRenewer.
|
2015-03-23 10:45:50 -07:00 |
|
Jian He
|
e1feb4ea1a
|
YARN-3345. Add non-exclusive node label API. Contributed by Wangda Tan
|
2015-03-20 19:04:38 -07:00 |
|
Jian He
|
586348e4cb
|
YARN-3356. Capacity Scheduler FiCaSchedulerApp should use ResourceUsage to track used-resources-by-label. Contributed by Wangda Tan
|
2015-03-20 13:54:01 -07:00 |
|
Wangda Tan
|
6bc7710ec7
|
YARN-3369. Missing NullPointer check in AppSchedulingInfo causes RM to die. (Brahma Reddy Battula via wangda)
|
2015-03-20 10:42:05 -07:00 |
|
Jian He
|
4e886eb9cb
|
YARN-3379. Fixed missing data in localityTable and ResourceRequests table in RM WebUI. Contributed by Xuan Gong
|
2015-03-19 22:27:21 -07:00 |
Devaraj K
|
93d0f4acc8
|
YARN-3357. Move TestFifoScheduler to FIFO package. Contributed by Rohith
Sharmaks.
|
2015-03-19 12:16:52 +05:30 |
|
Jian He
|
658097d6da
|
YARN-3273. Improve scheduler UI to facilitate scheduling analysis and debugging. Contributed Rohith Sharmaks
|
2015-03-17 21:30:23 -07:00 |
|
Tsuyoshi Ozawa
|
3bc72cc16d
|
YARN-3205. FileSystemRMStateStore should disable FileSystem Cache to avoid get a Filesystem with an old configuration. Contributed by Zhihai Xu.
|
2015-03-18 11:53:19 +09:00 |
|
Jian He
|
968425e9f7
|
YARN-3305. Normalize AM resource request on app submission. Contributed by Rohith Sharmaks
|
2015-03-17 13:49:59 -07:00 |
|
Karthik Kambatla
|
32b4330456
|
Revert "YARN-3181. FairScheduler: Fix up outdated findbugs issues. (kasha)"
This reverts commit c2b185def8.
|
2015-03-17 12:31:15 -07:00 |
|
Jian He
|
487374b7fe
|
YARN-3243. CapacityScheduler should pass headroom from parent to children to make sure ParentQueue obey its capacity limits. Contributed by Wangda Tan.
|
2015-03-17 10:24:23 -07:00 |
|
Devaraj K
|
7179f94f9d
|
YARN-3197. Confusing log generated by CapacityScheduler. Contributed by
Varun Saxena.
|
2015-03-17 15:57:57 +05:30 |
|
Tsuyoshi Ozawa
|
7522a643fa
|
YARN-3349. Treat all exceptions as failure in TestFSRMStateStore#testFSRMStateStoreClientRetry. Contributed by Zhihai Xu.
|
2015-03-17 08:09:55 +09:00 |
|
Tsuyoshi Ozawa
|
3da9a97cfb
|
YARN-1453. [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments. Contributed by Akira AJISAKA, Andrew Purtell, and Allen Wittenauer.
|
2015-03-16 23:19:05 +09:00 |
|
Vinod Kumar Vavilapalli
|
863079bb87
|
YARN-3154. Added additional APIs in LogAggregationContext to avoid aggregating running logs of application when rolling is enabled. Contributed by Xuan Gong.
|
2015-03-12 13:32:29 -07:00 |
|
Zhijie Shen
|
85f6d67fa7
|
YARN-1884. Added nodeHttpAddress into ContainerReport and fixed the link to NM web page. Contributed by Xuan Gong.
|
2015-03-11 19:35:19 -07:00 |
Allen Wittenauer
|
a5cf985bf5
|
YARN-2280. Resource manager web service fields are not accessible (Krisztian Horvath via aw)
|
2015-03-10 16:32:20 -07:00 |
|
Jian He
|
c3003eba6f
|
YARN-3300. Outstanding_resource_requests table should not be shown in AHS. Contributed by Xuan Gong
|
2015-03-09 20:46:48 -07:00 |
Jason Lowe
|
27e8ea820f
|
YARN-3275. CapacityScheduler: Preemption happening on non-preemptable queues. Contributed by Eric Payne
|
2015-03-06 22:37:26 +00:00 |
|
Jian He
|
95bfd087dc
|
YARN-1809. Synchronize RM and TimeLineServer Web-UIs. Contributed by Zhijie Shen and Xuan Gong
|
2015-03-05 21:20:09 -08:00 |
|
Tsuyoshi Ozawa
|
1b67209612
|
YARN-3249. Add a 'kill application' button to Resource Manager's Web UI. Contributed by Ryu Kobayashi.
|
2015-03-05 19:55:56 +09:00 |
|
Karthik Kambatla
|
8d88691d16
|
YARN-3242. Asynchrony in ZK-close can lead to ZKRMStateStore watcher receiving events for old client. (Zhihai Xu via kasha)
|
2015-03-04 19:49:05 -08:00 |
|
Karthik Kambatla
|
22426a1c9f
|
YARN-3231. FairScheduler: Changing queueMaxRunningApps interferes with pending jobs. (Siqi Li via kasha)
|
2015-03-04 18:06:58 -08:00 |
|
Jian He
|
b2f1ec312e
|
YARN-3222. Fixed NPE on RMNodeImpl#ReconnectNodeTransition when a node is reconnected with a different port. Contributed by Rohith Sharmaks
|
2015-03-03 16:28:28 -08:00 |
|
Wangda Tan
|
e17e5ba9d7
|
YARN-3272. Surface container locality info in RM web UI (Jian He via wangda)
|
2015-03-03 11:49:01 -08:00 |
|
Tsuyoshi Ozawa
|
d1c6accb6f
|
HADOOP-11602. Fix toUpperCase/toLowerCase to use Locale.ENGLISH. (ozawa)
|
2015-03-03 14:17:52 +09:00 |
|
Vinod Kumar Vavilapalli
|
14dd647c55
|
YARN-3265. Fixed a deadlock in CapacityScheduler by always passing a queue's available resource-limit from the parent queue. Contributed by Wangda Tan.
|
2015-03-02 17:52:47 -08:00 |
|
Jian He
|
5d0bae550f
|
YARN-3281. Added RMStateStore to StateMachine visualization list. Contributed by Chengbing Liu
|
2015-03-02 14:39:49 -08:00 |
|
Wangda Tan
|
edcecedc1c
|
YARN-3262. Surface application outstanding resource requests table in RM web UI. (Jian He via wangda)
|
2015-02-27 16:13:32 -08:00 |
|
Tsuyoshi Ozawa
|
01a1621930
|
YARN-2820. Retry in FileSystemRMStateStore when FS's operations fail due to IOException. Contributed by Zhihai Xu.
|
2015-02-28 00:56:44 +09:00 |
Konstantin V Shvachko
|
8ca0d957c4
|
YARN-3255. RM, NM, JobHistoryServer, and WebAppProxyServer's main() should support generic options. Contributed by Konstantin Shvachko.
|
2015-02-26 17:12:19 -08:00 |
|
Devaraj K
|
0d4296f0e0
|
YARN-3256. TestClientToAMTokens#testClientTokenRace is not running against
all Schedulers even when using ParameterizedSchedulerTestBase. Contributed
by Anubhav Dhoot.
|
2015-02-26 15:45:41 +05:30 |
|
Tsuyoshi Ozawa
|
6cbd9f1113
|
YARN-3247. TestQueueMappings should use CapacityScheduler explicitly. Contributed by Zhihai Xu.
|
2015-02-25 10:38:11 +09:00 |
|
Tsuyoshi Ozawa
|
9cedad11d8
|
Revert "HADOOP-11602. Fix toUpperCase/toLowerCase to use Locale.ENGLISH. (ozawa)"
This reverts commit 946456c6d8.
Conflicts:
hadoop-common-project/hadoop-common/CHANGES.txt
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/QuotaByStorageTypeEntry.java
|
2015-02-25 00:32:04 +09:00 |
|
Xuan
|
fe7a302473
|
YARN-2797. TestWorkPreservingRMRestart should use
ParametrizedSchedulerTestBase. Contributed by Karthik Kambatla
|
2015-02-21 19:17:29 -08:00 |
|
Wangda Tan
|
ce5bf927c3
|
YARN-3230. Clarify application states on the web UI. (Jian He via wangda)
|
2015-02-20 10:39:28 -08:00 |
|
Jason Lowe
|
a64dd3d24b
|
YARN-3194. RM should handle NMContainerStatuses sent by NM while registering if NM is Reconnected node. Contributed by Rohith
|
2015-02-20 15:10:10 +00:00 |
|
Jian He
|
c0d9b93953
|
YARN-933. Fixed InvalidStateTransitonException at FINAL_SAVING state in RMApp. Contributed by Rohith Sharmaks
|
2015-02-19 15:42:39 -08:00 |
|
Wangda Tan
|
d49ae725d5
|
YARN-3076. Add API/Implementation to YarnClient to retrieve label-to-node mapping (Varun Saxena via wangda)
|
2015-02-19 11:00:57 -08:00 |
|
Tsuyoshi Ozawa
|
946456c6d8
|
HADOOP-11602. Fix toUpperCase/toLowerCase to use Locale.ENGLISH. (ozawa)
|
2015-02-19 13:06:53 +09:00 |
|
Tsuyoshi Ozawa
|
b8a14efdf5
|
YARN-1615. Fix typos in delay scheduler's description. Contributed by Akira Ajisaka.
|
2015-02-19 10:24:07 +09:00 |
|
Jian He
|
1c03376300
|
YARN-1514. Utility to benchmark ZKRMStateStore#loadState for RM HA. Contributed by Tsuyoshi OZAWA
|
2015-02-18 16:06:55 -08:00 |
|
Jian He
|
f5da5566d9
|
YARN-3132. RMNodeLabelsManager should remove node from node-to-label mapping when node becomes deactivated. Contributed by Wangda Tan
|
2015-02-18 11:51:51 -08:00 |
|
Tsuyoshi Ozawa
|
556386a070
|
YARN-1299. Improve a log message in AppSchedulingInfo by adding application id. Contributed by Ashutosh Jindal and Devaraj K.
|
2015-02-17 01:53:31 +09:00 |
|
Tsuyoshi Ozawa
|
3f32357c36
|
Revert "YARN-1299. Improve a log message in AppSchedulingInfo by adding application id. Contributed by Ashutosh Jindal and devaraj."
This reverts commit 9aae81c934.
|
2015-02-17 01:52:22 +09:00 |
|
Tsuyoshi Ozawa
|
9aae81c934
|
YARN-1299. Improve a log message in AppSchedulingInfo by adding application id. Contributed by Ashutosh Jindal and devaraj.
|
2015-02-17 01:48:22 +09:00 |
|
Tsuyoshi Ozawa
|
110cf6b9a3
|
YARN-3182. Cleanup switch statement in ApplicationMasterLauncher#handle(). Contributed by Ray Chiang.
|
2015-02-13 14:21:21 +09:00 |
|
Xuan
|
99f6bd4f7a
|
YARN-3158. Correct log messages in ResourceTrackerService. Contributed
by Varun Saxena
|
2015-02-12 16:42:15 -08:00 |
|
Jian He
|
18297e0972
|
YARN-3104. Fixed RM to not generate new AMRM tokens on every heartbeat between rolling and activation. Contributed by Jason Lowe
|
2015-02-12 16:02:45 -08:00 |
|
Jian He
|
18a594257e
|
YARN-3124. Fixed CS LeafQueue/ParentQueue to use QueueCapacities to track capacities-by-label. Contributed by Wangda Tan
|
2015-02-12 14:58:09 -08:00 |
|
Karthik Kambatla
|
c2b185def8
|
YARN-3181. FairScheduler: Fix up outdated findbugs issues. (kasha)
|
2015-02-12 13:44:47 -08:00 |
|
Xuan
|
65c69e296e
|
YARN-3151. On Failover tracking url wrong in application cli for KILLED
application. Contributed by Rohith
|
2015-02-11 21:19:48 -08:00 |
|
Junping Du
|
c541a374d8
|
YARN-3160. Fix non-atomic operation on nodeUpdateQueue in RMNodeImpl. (Contributed by Chengbing Liu)
|
2015-02-11 03:44:31 -08:00 |
|
Zhijie Shen
|
d5855c0e46
|
YARN-2246. Made the proxy tracking URL always be http(s)://proxy addr:port/proxy/<appId> to avoid duplicate sections. Contributed by Devaraj K.
|
2015-02-10 15:24:01 -08:00 |
|
Zhijie Shen
|
23bf6c7207
|
YARN-3100. Made YARN authorization pluggable. Contributed by Jian He.
|
2015-02-09 20:34:56 -08:00 |
|
Jian He
|
0af6a99a3f
|
YARN-3094. Reset timer for liveness monitors after RM recovery. Contributed by Jun Gong
|
2015-02-09 13:47:08 -08:00 |
|
Karthik Kambatla
|
7e42088abf
|
YARN-2990. FairScheduler's delay-scheduling always waits for node-local and rack-local delays, even for off-rack-only requests. (kasha)
|
2015-02-08 22:48:10 -08:00 |
|
Jason Lowe
|
da2fb2bc46
|
YARN-3143. RM Apps REST API can return NPE or entries missing id and other fields. Contributed by Jason Lowe
|
2015-02-06 21:47:32 +00:00 |