Vinod Kumar Vavilapalli
|
2f82ae042a
|
Moving YARN-3351, YARN-3382, YARN-3472, MAPREDUCE-6238 to the 2.7.1 CHANGES.txt
sections given the recent merge into branch-2.7.
|
2015-04-24 17:18:46 -07:00 |
Jian He
|
d497f6ea2b
|
YARN-2498. Respect labels in preemption policy of capacity scheduler for inter-queue preemption. Contributed by Wangda Tan
|
2015-04-24 17:03:13 -07:00 |
Tsuyoshi Ozawa
|
4a3dabd94f
|
YARN-3406. Display count of running containers in the RM's Web UI. Contributed by Ryu Kobayashi.
|
2015-04-25 07:17:11 +09:00 |
Jason Lowe
|
78fe6e57c7
|
Fix commit version for YARN-3537
|
2015-04-24 22:07:53 +00:00 |
|
Jason Lowe
|
5e093f0d40
|
YARN-3537. NPE when NodeManager.serviceInit fails and stopRecoveryStore invoked. Contributed by Brahma Reddy Battula
|
2015-04-24 22:02:53 +00:00 |
Akira Ajisaka
|
5ce3a77f3c
|
YARN-3444. Fix typo capabililty. Contributed by Gabor Liptak.
|
2015-04-25 06:08:16 +09:00 |
|
Jian He
|
d03dcb9635
|
YARN-3387. Previous AM's container completed status couldn't pass to current AM if AM and RM restarted during the same time. Contributed by Sandflee
|
2015-04-24 12:13:29 -07:00 |
Xuan
|
eee9facbba
|
YARN-3511. Add errors and warnings page to ATS. Contributed by Varun Vasudev
|
2015-04-24 09:41:59 -07:00 |
|
Xuan
|
0b3f8957a8
|
YARN-3516. killing ContainerLocalizer action doesn't take effect when
private localizer receives FETCH_FAILURE status. Contributed by zhihai
xu
|
2015-04-23 16:40:40 -07:00 |
|
Jian He
|
aa4a192feb
|
YARN-3522. Fixed DistributedShell to instantiate TimeLineClient as the correct user. Contributed by Zhijie Shen
|
2015-04-23 11:07:26 -07:00 |
Wangda Tan
|
395205444e
|
YARN-3319. Implement a FairOrderingPolicy. (Craig Welch via wangda)
|
2015-04-23 10:47:15 -07:00 |
tgraves
|
189a63a719
|
YARN-3434. Interaction between reservations and userlimit can result in significant ULF violation
|
2015-04-23 14:39:25 +00:00 |
Steve Loughran
|
d9bcf99aef
|
YARN-2605. [RM HA] Rest api endpoints doing redirect incorrectly. (Xuan Gong via stevel)
|
2015-04-23 09:22:48 +01:00 |
|
Vinod Kumar Vavilapalli
|
a100be685c
|
YARN-3366. Enhanced NodeManager to support classifying/shaping outgoing network bandwidth traffic originating from YARN containers Contributed by Sidharta Seethana.
|
2015-04-22 17:26:13 -07:00 |
Junping Du
|
fad9d7e85b
|
New parameter of CLI for decommissioning node gracefully in RMAdmin CLI. Contributed by Devaraj K
|
2015-04-22 10:07:20 -07:00 |
|
Jian He
|
674c7ef649
|
YARN-3503. Expose disk utilization percentage and bad local and log dir counts in NM metrics. Contributed by Varun Vasudev
|
2015-04-21 20:57:02 -07:00 |
|
Jian He
|
bdd90110e6
|
YARN-3494. Expose AM resource limit and usage in CS QueueMetrics. Contributed by Rohith Sharmaks
|
2015-04-21 20:06:20 -07:00 |
|
Wangda Tan
|
e71d0d87d9
|
YARN-3410. YARN admin should be able to remove individual application records from RMStateStore. (Rohith Sharmaks via wangda)
|
2015-04-21 17:51:22 -07:00 |
|
Tsuyoshi Ozawa
|
105afd5477
|
YARN-3495. Confusing log generated by FairScheduler. Contributed by Brahma Reddy Battula.
|
2015-04-22 05:47:59 +09:00 |
|
Vinod Kumar Vavilapalli
|
d52de61544
|
Set the release date for 2.7.0
|
2015-04-20 20:16:58 -07:00 |
|
Wangda Tan
|
44872b76fc
|
YARN-3463. Integrate OrderingPolicy Framework with CapacityScheduler. (Craig Welch via wangda)
|
2015-04-20 17:12:32 -07:00 |
|
Jian He
|
f967fd2f21
|
YARN-3497. ContainerManagementProtocolProxy modifies IPC timeout conf without making a copy. Contributed by Jason Lowe
|
2015-04-20 10:38:27 -07:00 |
|
Jian He
|
497c86b485
|
YARN-3136. Fixed a synchronization problem of AbstractYarnScheduler#getTransferredContainers. Contributed by Sunil G
|
2015-04-18 12:46:37 -07:00 |
|
Wangda Tan
|
f47a5763ac
|
YARN-3487. CapacityScheduler scheduler lock obtained unnecessarily when calling getQueue (Jason Lowe via wangda)
|
2015-04-17 17:22:27 -07:00 |
|
Wangda Tan
|
f65eeb412d
|
YARN-3493. RM fails to come up with error "Failed to load/recover state" when mem settings are changed. (Jian He via wangda)
|
2015-04-17 17:11:22 -07:00 |
|
Jian He
|
6779467ab6
|
YARN-3451. Display attempt start time and elapsed time on the web UI. Contributed by Rohith Sharmaks
|
2015-04-17 15:55:34 -07:00 |
|
Jian He
|
d573f09fb9
|
YARN-2696. Queue sorting in CapacityScheduler should consider node label. Contributed by Wangda Tan
|
2015-04-17 13:36:59 -07:00 |
|
Junping Du
|
1db355a875
|
YARN-1402. Update related Web UI and CLI with exposing client API to check log aggregation status. Contributed by Xuan Gong.
|
2015-04-17 13:18:59 -07:00 |
|
Jian He
|
bb6dde68f1
|
YARN-3021. YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp. Contributed by Yongjun Zhang
|
2015-04-16 19:43:37 -07:00 |
|
Jian He
|
1b89a3e173
|
YARN-3354. Add node label expression in ContainerTokenIdentifier to support RM recovery. Contributed by Wangda Tan
|
2015-04-15 13:57:06 -07:00 |
|
Jian He
|
b2e6cf607f
|
YARN-3404. Display queue name on application page. Contributed by Ryu Kobayashi
|
2015-04-15 13:52:50 -07:00 |
|
Tsuyoshi Ozawa
|
e48cedc663
|
YARN-3326. Support RESTful API for getLabelsToNodes. Contributed by Naganarasimha G R.
|
2015-04-15 14:03:55 -05:00 |
|
Wangda Tan
|
5004e75332
|
YARN-3318. Create Initial OrderingPolicy Framework and FifoOrderingPolicy. (Craig Welch via wangda)
|
2015-04-15 09:56:32 -07:00 |
|
Tsuyoshi Ozawa
|
05007b45e5
|
YARN-3436. Fix URIs in documantion of YARN web service REST APIs. Contributed by Bibin A Chundatt.
|
2015-04-14 14:13:55 -05:00 |
|
Jian He
|
0fefda645b
|
YARN-3361. CapacityScheduler side changes to support non-exclusive node labels. Contributed by Wangda Tan
|
2015-04-14 11:45:58 -07:00 |
|
Jian He
|
b46ee1e7a3
|
YARN-3266. RMContext#inactiveNodes should have NodeId as map key. Contributed by Chengbing Liu
|
2015-04-14 10:54:22 -07:00 |
|
Junping Du
|
838b06ac87
|
YARN-3443. Create a 'ResourceHandler' subsystem to ease addition of support for new resource types on the NM. Contributed by Sidharta Seethana.
|
2015-04-13 18:35:56 -07:00 |
|
Junping Du
|
a77d628339
|
YARN-3347. Improve YARN log command to get AMContainer logs as well as running containers logs. Contributed by Xuan Gong.
|
2015-04-13 17:29:06 -07:00 |
|
Jian He
|
7b4671490a
|
YARN-3394. Enrich WebApplication proxy documentation. Contributed by Naganarasimha G R
|
2015-04-13 17:05:38 -07:00 |
|
Jian He
|
a1afbc48b5
|
YARN-3472. Fixed possible leak in DelegationTokenRenewer#allTokens. Contributed by Rohith Sharmaks
|
2015-04-13 14:07:17 -07:00 |
Karthik Kambatla
|
5cda6fffd3
|
Fix up author name to Jun Gong in CHANGES.txt for YARN-3469
|
2015-04-13 13:52:28 -07:00 |
|
Jian He
|
944a16579f
|
YARN-3382. Some of UserMetricsInfo metrics are incorrectly set to root queue metrics. Contributed by Rohit Agarwal
|
2015-04-13 10:53:34 -07:00 |
|
Karthik Kambatla
|
e516706b89
|
YARN-3469. ZKRMStateStore: Avoid setting watches that are not required. (Jun Hong via kasha)
|
2015-04-10 11:20:34 -07:00 |
|
Jian He
|
577d755e4b
|
YARN-3348. Add a 'yarn top' tool to help understand cluster usage. Contributed by Varun Vasudev
|
2015-04-10 09:57:17 -07:00 |
|
Junping Du
|
92431c9617
|
YARN-1376. NM need to notify the log aggregation status to RM through Node heartbeat. Contributed by Xuan Gong.
|
2015-04-10 08:56:18 -07:00 |
|
Xuan
|
afa5d4715a
|
YARN-3293. Track and display capacity scheduler health metrics in web
UI. Contributed by Varun Vasudev
|
2015-04-09 23:38:04 -07:00 |
|
Vinod Kumar Vavilapalli
|
623fd46c1e
|
Adding release 2.7.1 to CHANGES.txt
|
2015-04-09 13:54:20 -07:00 |
|
Vinod Kumar Vavilapalli
|
9c5911294e
|
YARN-3055. Fixed ResourceManager's DelegationTokenRenewer to not stop token renewal of applications part of a bigger workflow. Contributed by Daryn Sharp.
|
2015-04-09 13:08:53 -07:00 |
|
Wangda Tan
|
1885141e90
|
YARN-3466. Fix RM nodes web page to sort by node HTTP-address, #containers and node-label column. (Jason Lowe via wangda)
|
2015-04-09 10:35:12 -07:00 |
|
Karthik Kambatla
|
6495940eae
|
YARN-3465. Use LinkedHashMap to preserve order of resource requests. (Zhihai Xu via kasha)
|
2015-04-09 00:07:49 -07:00 |
Hitesh Shah
|
265ed1fe80
|
YARN-2890. MiniYarnCluster should turn on timeline service if configured to do so. Contributed by Mit Desai.
|
2015-04-08 14:13:10 -07:00 |
|
Wangda Tan
|
7af086a515
|
YARN-3459. Fix failiure of TestLog4jWarningErrorMetricsAppender. (Varun Vasudev via wangda)
|
2015-04-08 10:57:48 -07:00 |
|
Tsuyoshi Ozawa
|
dd852f5b8c
|
YARN-3457. NPE when NodeManager.serviceInit fails and stopRecoveryStore called. Contributed by Bibin A Chundatt.
|
2015-04-08 15:56:18 +09:00 |
Robert Kanter
|
5b8a3ae366
|
YARN-3429. Fix incorrect CHANGES.txt
|
2015-04-07 16:15:42 -07:00 |
|
Xuan
|
d27e9241e8
|
YARN-3294. Allow dumping of Capacity Scheduler debug logs via web UI for
a fixed time period. Contributed by Varun Vasudev
|
2015-04-07 09:52:36 -07:00 |
|
Xuan
|
19a4feaf6f
|
YARN-3110. Few issues in ApplicationHistory web ui. Contributed by Naganarasimha G R
|
2015-04-07 08:22:39 -07:00 |
Zhijie Shen
|
3fb5abfc87
|
Move YARN-3273 from 2.8 to 2.7.
|
2015-04-06 14:14:53 -07:00 |
|
Robert Kanter
|
99b08a748e
|
YARN-2429. TestAMRMTokens.testTokenExpiry fails Intermittently with error message:Invalid AMRMToken (zxu via rkanter)
|
2015-04-06 14:11:20 -07:00 |
|
Tsuyoshi Ozawa
|
53959e69f7
|
TestFairScheduler.testContinuousScheduling fails Intermittently. Contributed by Zhihai Xu.
|
2015-04-06 20:19:13 +09:00 |
|
Xuan
|
96d72118f5
|
YARN-3435. AM container to be allocated Appattempt AM container shown as
null. Contributed by Bibin A Chundatt
|
2015-04-05 00:40:57 -07:00 |
|
Wangda Tan
|
bad070fe15
|
YARN-2901. Add errors and warning metrics page to RM, NM web UI. (Varun Vasudev via wangda)
|
2015-04-02 17:23:20 -07:00 |
|
Vinod Kumar Vavilapalli
|
b21c72777a
|
YARN-3365. Enhanced NodeManager to support using the 'tc' tool via container-executor for outbound network traffic control. Contributed by Sidharta Seethana.
|
2015-04-02 16:53:59 -07:00 |
Sandy Ryza
|
6a6a59db7f
|
YARN-3415. Non-AM containers can be counted towards amResourceUsage of a fairscheduler queue (Zhihai Xu via Sandy Ryza)
|
2015-04-02 13:56:08 -07:00 |
|
Zhijie Shen
|
8366a36ad3
|
YARN-3430. Made headroom data available on app attempt page of RM WebUI. Contributed by Xuan Gong.
|
2015-04-01 13:47:54 -07:00 |
|
Wangda Tan
|
492239424a
|
YARN-3425. NPE from RMNodeLabelsManager.serviceStop when NodeLabelsManager.serviceInit failed. (Bibin A Chundatt via wangda)
|
2015-04-01 10:14:48 -07:00 |
|
Xuan
|
2e79f1c212
|
YARN-3248. Correct fix version from branch-2.7 to branch-2.8 in the change log.
|
2015-04-01 04:32:11 -07:00 |
|
Xuan
|
4728bdfa15
|
YARN-3248. Display count of nodes blacklisted by apps in the web UI.
Contributed by Varun Vasudev
|
2015-04-01 04:19:18 -07:00 |
|
Tsuyoshi Ozawa
|
c69ba81497
|
YARN-3424. Change logs for ContainerMonitorImpl's resourse monitoring from info to debug. Contributed by Anubhav Dhoot.
|
2015-04-01 17:44:25 +09:00 |
|
Karthik Kambatla
|
2daa478a64
|
YARN-3428. Debug log resources to be localized for a container. (kasha)
|
2015-03-31 17:34:47 -07:00 |
|
Karthik Kambatla
|
79f7f2aabf
|
YARN-3412. RM tests should use MockRM where possible. (kasha)
|
2015-03-31 09:14:15 -07:00 |
|
Tsuyoshi Ozawa
|
b5a22e9838
|
YARN-3258. FairScheduler: Need to add more logging to investigate allocations. Contributed by Anubhav Dhoot.
|
2015-03-31 17:42:44 +09:00 |
|
Wangda Tan
|
2a945d24f7
|
YARN-2495. Allow admin specify labels from each NM (Distributed configuration for node label). (Naganarasimha G R via wangda)
|
2015-03-30 12:05:21 -07:00 |
|
Vinod Kumar Vavilapalli
|
c358368f51
|
YARN-3304. Cleaning up ResourceCalculatorProcessTree APIs for public use and removing inconsistencies in the default values. Contributed by Junping Du and Karthik Kambatla.
|
2015-03-30 10:09:40 -07:00 |
Ravi Prakash
|
e0ccea33c9
|
YARN-3288. Document and fix indentation in the DockerContainerExecutor code
|
2015-03-28 08:00:41 -07:00 |
|
Robert Kanter
|
87130bf6b2
|
YARN-3400. [JDK 8] Build Failure due to unreported exceptions in RPCUtil (rkanter)
|
2015-03-26 11:00:20 -07:00 |
|
Karthik Kambatla
|
c906a1de72
|
YARN-3397. yarn rmadmin should skip -failover. (J.Andreina via kasha)
|
2015-03-25 07:42:27 -07:00 |
|
Xuan
|
e556198e71
|
YARN-2213. Change proxy-user cookie log in AmIpFilter to DEBUG.
Contributed by Varun Saxena
|
2015-03-25 04:49:43 -07:00 |
|
Wangda Tan
|
97a7277a2d
|
YARN-3383. AdminService should use warn instead of info to log exception when operation fails. (Li Lu via wangda)
|
2015-03-24 10:38:54 -07:00 |
Harsh J
|
fbceb3b418
|
YARN-1880. Cleanup TestApplicationClientProtocolOnHA. Contributed by ozawa.
|
2015-03-24 11:57:58 +05:30 |
|
Xuan
|
9fae455e26
|
YARN-3393. Getting application(s) goes wrong when app finishes before
starting the attempt. Contributed by Zhijie Shen
|
2015-03-23 20:33:16 -07:00 |
|
Karthik Kambatla
|
972f1f1ab9
|
YARN-2868. FairScheduler: Metric for latency to allocate first container for an application. (Ray Chiang via kasha)
|
2015-03-23 14:07:05 -07:00 |
|
Karthik Kambatla
|
2bc097cd14
|
YARN-3241. FairScheduler handles invalid queue names inconsistently. (Zhihai Xu via kasha)
|
2015-03-23 13:22:03 -07:00 |
cnauroth
|
6ca1f12024
|
YARN-3336. FileSystem memory leak in DelegationTokenRenewer.
|
2015-03-23 10:45:50 -07:00 |
|
Tsuyoshi Ozawa
|
82eda771e0
|
YARN-3384. TestLogAggregationService.verifyContainerLogs fails after YARN-2777. Contributed by Naganarasimha G R.
|
2015-03-24 00:25:30 +09:00 |
|
Jian He
|
e1feb4ea1a
|
YARN-3345. Add non-exclusive node label API. Contributed by Wangda Tan
|
2015-03-20 19:04:38 -07:00 |
|
Junping Du
|
7f1e2f9969
|
YARN-3350. YARN RackResolver spams logs with messages at info level. Contributed by Wilfred Spiegelenburg
|
2015-03-20 18:21:33 -07:00 |
|
Jian He
|
586348e4cb
|
YARN-3356. Capacity Scheduler FiCaSchedulerApp should use ResourceUsage to track used-resources-by-label. Contributed by Wangda Tan
|
2015-03-20 13:54:01 -07:00 |
|
Junping Du
|
d81109e588
|
YARN-3269. Yarn.nodemanager.remote-app-log-dir could not be configured to fully qualified path. Contributed by Xuan Gong
|
2015-03-20 13:41:22 -07:00 |
|
Wangda Tan
|
6bc7710ec7
|
YARN-3369. Missing NullPointer check in AppSchedulingInfo causes RM to die. (Brahma Reddy Battula via wangda)
|
2015-03-20 10:42:05 -07:00 |
|
Xuan
|
1a4b528691
|
YARN-2777. Mark the end of individual log in aggregated log. Contributed
by Varun Saxena
|
2015-03-20 10:24:13 -07:00 |
|
Jian He
|
4e886eb9cb
|
YARN-3379. Fixed missing data in localityTable and ResourceRequests table in RM WebUI. Contributed by Xuan Gong
|
2015-03-19 22:27:21 -07:00 |
Devaraj K
|
93d0f4acc8
|
YARN-3357. Move TestFifoScheduler to FIFO package. Contributed by Rohith
Sharmaks.
|
2015-03-19 12:16:52 +05:30 |
|
Karthik Kambatla
|
20b49224eb
|
YARN-3351. AppMaster tracking URL is broken in HA. (Anubhav Dhoot via kasha)
|
2015-03-18 16:30:33 -07:00 |
|
Jian He
|
658097d6da
|
YARN-3273. Improve scheduler UI to facilitate scheduling analysis and debugging. Contributed Rohith Sharmaks
|
2015-03-17 21:30:23 -07:00 |
|
Tsuyoshi Ozawa
|
3bc72cc16d
|
YARN-3205. FileSystemRMStateStore should disable FileSystem Cache to avoid get a Filesystem with an old configuration. Contributed by Zhihai Xu.
|
2015-03-18 11:53:19 +09:00 |
|
Jian He
|
968425e9f7
|
YARN-3305. Normalize AM resource request on app submission. Contributed by Rohith Sharmaks
|
2015-03-17 13:49:59 -07:00 |
|
Karthik Kambatla
|
32b4330456
|
Revert "YARN-3181. FairScheduler: Fix up outdated findbugs issues. (kasha)"
This reverts commit c2b185def8.
|
2015-03-17 12:31:15 -07:00 |
|
Jian He
|
487374b7fe
|
YARN-3243. CapacityScheduler should pass headroom from parent to children to make sure ParentQueue obey its capacity limits. Contributed by Wangda Tan.
|
2015-03-17 10:24:23 -07:00 |
|
Devaraj K
|
7179f94f9d
|
YARN-3197. Confusing log generated by CapacityScheduler. Contributed by
Varun Saxena.
|
2015-03-17 15:57:57 +05:30 |
|
Ravi Prakash
|
56085203c4
|
YARN-3339. TestDockerContainerExecutor should pull a single image and not the entire centos repository. (Ravindra Kumar Naik via raviprak)
|
2015-03-16 16:17:58 -07:00 |