4b149a1e77
YARN-4457. Cleanup unchecked types for EventHandler (templedf via rkanter)
2016-12-09 17:28:25 -08:00
b0aace21b1
YARN-5982. Simplify opportunistic container parameters and metrics. (Konstantinos Karanasos via asuresh)
2016-12-09 16:41:25 -08:00
7d8e440eee
Revert "HADOOP-13852 hadoop build to allow hadoop version property to be explicitly set. Contriibuted by Steve Loughran"
...
This reverts commit c265515725
2016-12-09 12:49:27 +09:00
c265515725
HADOOP-13852 hadoop build to allow hadoop version property to be explicitly set. Contriibuted by Steve Loughran
2016-12-08 17:57:15 +00:00
74d0066d33
YARN-5970. Validate application update timeout request parameters. Contributed by Rohith Sharma K S.
2016-12-08 15:53:56 +05:30
72fe546841
YARN-5963. Spelling errors in logging and exceptions for node manager, client, web-proxy, common, and app history code (gsohn via rkanter)
2016-12-07 15:07:25 -08:00
ab923a53fc
YARN-5965. Retrospect ApplicationReport#getApplicationTimeouts. Contributed by Rohith Sharma K S
2016-12-08 00:27:25 +05:30
43ebff2e35
YARN-5559. Analyse 2.8.0/3.0.0 jdiff reports and fix any issues. Contributed by Akira Ajisaka & Wangda Tan
2016-12-05 11:39:34 -08:00
f304ccae3c
YARN-5915. ATS 1.5 FileSystemTimelineWriter causes flush() to be called after every event write. Contributed by Atul Sikaria
2016-12-02 16:54:15 +00:00
c87b3a448a
MAPREDUCE-6787. Allow job_conf.xml to be downloadable on the job overview page in JHS (haibochen via rkanter)
2016-12-01 17:29:38 -08:00
b3befc021b
YARN-4997. Update fair scheduler to use pluggable auth provider (Contributed by Tao Jie via Daniel Templeton)
2016-11-30 09:50:33 -08:00
25f9872be6
YARN-5774. MR Job stuck in ACCEPTED status without any progress in Fair Scheduler
...
if set yarn.scheduler.minimum-allocation-mb to 0. (Contributed by Yufei Gu via Daniel Templeton)
2016-11-29 09:40:49 -08:00
209e805430
HADOOP-13506. Redundant groupid warning in child projects. Contributed by Kai Sasaki.
2016-11-28 14:34:57 +09:00
eb0a483ed0
YARN-4206. Add Application timeouts in Application report and CLI. Contributed by Rohith Sharma K S.
2016-11-24 18:18:42 +05:30
10468529a9
YARN-4752. Improved preemption in FairScheduler. (kasha)
...
Contains:
YARN-5605. Preempt containers (all on one node) to meet the requirement of starved applications
YARN-5821. Drop left-over preemption-related code and clean up method visibilities in the Schedulable hierarchy
YARN-5783. Verify identification of starved applications.
YARN-5819. Verify fairshare and minshare preemption
YARN-5885. Cleanup YARN-4752 branch for merge
Change-Id: Iee0962377d019dd64dc69a020725d2eaf360858c
2016-11-23 19:48:59 -10:00
3541ed8068
YARN-4330. MiniYARNCluster is showing multiple Failed to instantiate default resource calculator warning messages. Contributed by Varun Saxena
2016-11-23 14:12:23 +05:30
4667564162
YARN-5911. DrainDispatcher does not drain all events on stop even if setDrainEventsOnStop is true. Contributed by Varun Saxena.
2016-11-23 08:49:48 +05:30
6f8074298d
YARN-5713. Update jackson from 1.9.13 to 2.x in hadoop-yarn.
2016-11-22 10:20:31 +09:00
d65603517e
YARN-5375. invoke MockRM#drainEvents implicitly in MockRM methods to reduce test failures. Contributed by sandflee.
2016-11-16 15:14:00 +05:30
5af572b644
HADOOP-13427. Eliminate needless uses of FileSystem#{exists(), isFile(), isDirectory()}. Contributed by Steve Loughran and Mingliang Liu
2016-11-15 10:57:00 -08:00
3219b7b4ac
YARN-4597. Introduce ContainerScheduler and a SCHEDULED state to NodeManager container lifecycle. (asuresh)
2016-11-15 07:56:25 -08:00
ede1a473f5
YARN-5552. Add Builder methods for common yarn API records. (Tao Jie via wangda)
2016-11-11 13:34:56 -08:00
93eeb13164
YARN-4218. Metric for resource*time that was preempted. Contributed by Chang Li.
2016-11-10 22:35:12 +00:00
bcc15c6290
YARN-5611. Provide an API to update lifetime of an application. Contributed by Rohith Sharma K S
2016-11-09 16:08:05 -08:00
280357c29f
YARN-5833. Addendum patch to include missing changes to yarn-default.xml
2016-11-09 07:15:11 -08:00
e1c6ef2efa
HADOOP-13789. Hadoop Common includes generated test protos in both jar and test-jar. Contributed by Sean Busbey.
2016-11-08 16:33:55 -08:00
3f93ac0733
YARN-5356. NodeManager should communicate physical resource capability to ResourceManager. Contributed by Inigo Goiri
2016-11-08 22:01:26 +00:00
c00b5d1e51
YARN-5804. New UI2 is not able to launch with jetty 9 upgrade post HADOOP-10075. (Sunil G via wangda)
...
(cherry picked from commit ddebaa6b7ae1031899139d153d57df5387d60542)
2016-11-06 13:13:31 -08:00
3de0da2a76
YARN-5698. [YARN-3368] Launch new YARN UI under hadoop web app port. (Sunil G via wangda)
2016-11-06 13:13:31 -08:00
c85cc3b56e
YARN-4515. [YARN-3368] Support hosting web UI framework inside YARN RM. (Sunil G via wangda)
...
YARN-5000. [YARN-3368] App attempt page is not loading when timeline server is not started (Sunil G via wangda)
YARN-5038. [YARN-3368] Application and Container pages shows wrong values when RM is stopped. (Sunil G via wangda)
2016-11-06 13:13:31 -08:00
07ab89e8bb
YARN-5809. AsyncDispatcher possibly invokes multiple shutdown threads when handling exception (Jian He via Varun Saxena)
2016-11-01 04:37:03 +05:30
773c60bd7b
YARN-5800. Delete LinuxContainerExecutor comment from yarn-default.xml (Contributed by Jan Hentschel via Daniel Templeton)
2016-10-31 14:47:48 -07:00
3de130252d
YARN-5794. Fix the asflicense warnings. Contributed by Yiqun Lin
2016-10-28 12:37:37 +05:30
5877f20f9c
HADOOP-10075. Update jetty dependency to version 9 (rkanter)
2016-10-27 16:09:00 -07:00
221582c4ab
YARN-4668. Reuse objectMapper instance in Yarn. (Yiqun Lin via gtcarrera9)
2016-10-27 15:20:17 -07:00
dd4ed6a587
YARN-4388. Cleanup mapreduce.job.hdfs-servers from yarn-default.xml (Junping Du via Varun Saxena)
2016-10-28 02:22:25 +05:30
de6faae97c
YARN-5388. Deprecate and remove DockerContainerExecutor. (Daniel Templeton via kasha)
2016-10-25 13:35:47 -07:00
c88c1dc50c
YARN-5777. TestLogsCLI#testFetchApplictionLogsAsAnotherUser fails. Contributed by Akira Ajisaka.
2016-10-25 12:15:09 -07:00
0a166b1347
YARN-5711. Propogate exceptions back to client when using hedging RM failover provider.
2016-10-24 18:59:51 -07:00
23d7d53a41
YARN-5679. TestAHSWebServices is failing (ajisakaa via rkanter)
2016-10-21 13:31:03 -07:00
b733a6f862
YARN-5718. TimelineClient (and other places in YARN) shouldn't over-write HDFS client retry settings which could cause unexpected behavior. Contributed by Junping Du.
2016-10-18 11:06:47 -07:00
6378845f9e
YARN-4464. Lower the default max applications stored in the RM and store. (Daniel Templeton via kasha)
2016-10-11 21:42:08 -07:00
ecb51b857a
YARN-5551. Ignore file backed pages from memory computation when smaps is enabled. Contributed by Rajesh Balamohan
2016-10-11 15:12:43 +00:00
d65b957776
YARN-5702. Refactor TestPBImplRecords for reuse in other YARN modules. Contributed by Subru Krishnan
2016-10-05 12:16:49 -07:00
736d33cddd
YARN-4767. Network issues can cause persistent RM UI outage. (Daniel Templeton via kasha)
2016-10-03 14:35:57 -07:00
6e130c308c
YARN-4855. Should check if node exists when replace nodelabels. Contributeed by Tao Jie
2016-10-03 02:02:26 -04:00
3a3697deab
YARN-5384. Expose priority in ReservationSystem submission APIs. (Sean Po via Subru).
2016-09-30 19:41:43 -07:00
2ae5a3a5bf
YARN-4205. Add a service for monitoring application life time out. Contributed by Rohith Sharma K S
2016-09-29 22:00:31 +08:00
9b0fd01d2e
YARN-5599. Publish AM launch command to ATS (Rohith Sharma K S via Varun Saxena)
2016-09-28 16:10:10 +05:30
bc2656f09f
YARN-5662. Provide an option to enable ContainerMonitor. Contributed by Jian He.
2016-09-28 15:18:18 +05:30
4815d024c5
YARN-5609. Expose upgrade and restart API in ContainerManagementProtocol. Contributed by Arun Suresh
2016-09-26 08:46:54 -07:00
2f163cd5cf
Revert "YARN-5609. Expose upgrade and restart API in ContainerManagementProtocol. Contributed by Arun Suresh"
...
This reverts commit fe644bafe7
2016-09-26 08:36:59 -07:00
fe644bafe7
YARN-5609. Expose upgrade and restart API in ContainerManagementProtocol. Contributed by Arun Suresh
2016-09-26 22:41:16 +08:00
b8a2d7b8fc
YARN-5539. TimelineClient failed to retry on java.net.SocketTimeoutException: Read timed out (Junping Du via Varun Saxena)
2016-09-23 13:27:31 +05:30
3293a7d92d
Revert "TimelineClient failed to retry on java.net.SocketTimeoutException: Read timed out"
...
This reverts commit 2e6ee95716
2016-09-23 13:25:46 +05:30
2e6ee95716
TimelineClient failed to retry on java.net.SocketTimeoutException: Read timed out
2016-09-23 13:23:54 +05:30
d0372dc613
YARN-3692. Allow REST API to set a user generated message when killing an application. Contributed by Rohith Sharma K S
2016-09-23 06:30:49 +05:30
5ffd4b7c1e
YARN-4973. YarnWebParams next.fresh.interval should be next.refresh.interval (templedf via rkanter)
2016-09-22 16:45:34 -07:00
5a58bfee30
YARN-4591. YARN Web UIs should provide a robots.txt. (Sidharta Seethana via wangda)
2016-09-20 17:20:50 -07:00
4174b9756c
YARN-5642. Typos in 9 log messages. Contributed by Mehran Hassani
2016-09-17 10:35:39 +05:30
ade7c2bc9c
YARN-4232. TopCLI console support for HA mode. Contributed by Bibin A Chundatt
2016-09-17 09:52:39 +05:30
378f624a39
YARN-5549. AMLauncher#createAMContainerLaunchContext() should not log the command to be launched indiscriminately. (Daniel Templeton via rchiang)
2016-09-02 11:14:35 -07:00
d6d9cff21b
YARN-5221. Expose UpdateResourceRequest API to allow AM to request for change in container properties. (asuresh)
2016-08-30 15:52:29 -07:00
b930dc3ec0
YARN-5327. API changes required to support recurring reservations in the YARN ReservationSystem. (Sangeetha Abdu Jyothi via Subru).
2016-08-26 16:58:47 -07:00
9ef632f3b0
YARN-5557. Add localize API to the ContainerManagementProtocol. Contributed by Jian He.
2016-08-26 09:04:44 -07:00
bfb4d95059
YARN-5430. Return container's ip and host from NM ContainerStatus call. Contributed by Jian He.
2016-08-26 16:30:18 +05:30
0da69c324d
YARN-4676. Automatic and Asynchronous Decommissioning Nodes Status Tracking. Contributed by Diniel Zhi.
...
(cherry picked from commit d464483bf7
2016-08-18 07:27:23 -07:00
913a895136
YARN=5526. DrainDispacher#serviceStop blocked if setDrainEventsOnStop invoked (sandflee via Varun Saxena)
2016-08-18 11:38:13 +05:30
b427ce12bc
YARN-5475. Fix test failure of TestAggregatedLogFormat#testReadAcontainerLogs1 (Jun Gong via Varun Saxena)
2016-08-16 20:24:53 +05:30
aea3e65749
YARN-5137. Make DiskChecker pluggable in NodeManager. (Yufei Gu via rchiang)
2016-08-10 19:23:29 -07:00
82c9e06101
YARN-5457. Refactor DistributedScheduling framework to pull out common functionality. (asuresh)
2016-08-09 00:42:29 -07:00
e605d47df0
YARN-5470. Differentiate exactly match with regex in yarn log CLI. Contributed by Xuan Gong.
2016-08-05 10:55:29 -07:00
e5766b1dbe
YARN-5113. Refactoring and other clean-up for distributed scheduling. (Konstantinos Karanasos via asuresh)
2016-07-31 11:48:25 -07:00
7086fc72ee
YARN-5436. Race in AsyncDispatcher can cause random test failures in Tez (probably YARN also). (Zhiyuan Yang via gtcarrera9)
2016-07-28 16:50:57 -07:00
a1890c32c5
YARN-5438. TimelineClientImpl leaking FileSystem Instances causing Long running services like HiverServer2 daemon going OOM. Contributed by Rohith Sharma K S
2016-07-28 21:47:13 +00:00
7f3c306e2e
YARN-5432. Lock already held by another process while LevelDB cache store creation for dag. Contributed by Li Lu.
2016-07-28 06:35:24 -07:00
d2cbfd7de3
YARN-5441. Fixing minor Scheduler test case failures
2016-07-27 18:21:58 -07:00
54fe17a607
HADOOP-9427. Use JUnit assumptions to skip platform-specific tests. Contributed by Gergely Novák.
2016-07-27 19:41:09 +09:00
2d8d183b19
YARN-5351. ResourceRequest should take ExecutionType into account during comparison. (Konstantinos Karanasos via asuresh)
2016-07-26 19:08:30 -07:00
9ccf935b2c
YARN-5309. Fix SSLFactory truststore reloader thread leak in TimelineClientImpl. Contributed by Weiwei Yang.
2016-07-20 12:48:32 +05:30
dc2f4b6ac8
YARN-5213. Fix a bug in LogCLIHelpers which cause TestLogsCLI#testFetchApplictionLogs fails intermittently. Contributed by Xuan Gong.
2016-07-19 07:17:58 -07:00
da456ffd62
Preparing for 3.0.0-alpha2 development
2016-07-15 19:04:17 -07:00
7e5355c14e
YARN-5339. Passing file to -out for YARN log CLI doesnt give warning or error code. Contributed by Xuan Gong.
2016-07-15 09:23:11 -07:00
eb47163234
YARN-5200. Enhanced "yarn logs" to be able to get a list of containers whose logs are aggregated via a "show_container_log_info" option. Contributed by Xuan Gong.
2016-07-13 10:54:15 -07:00
bf6f4a3b98
YARN-4366. Fix Lint Warnings in YARN Common (templedf via rkanter)
2016-07-12 15:12:25 -07:00
819224dcf9
YARN-5270. Solve miscellaneous issues caused by YARN-4844. Contributed by Wangda Tan
2016-07-11 22:36:20 -07:00
6cf6ab7b78
Made a number of miscellaneous fixes for javac, javadoc, and checstyle warnings.
2016-07-10 08:46:05 -07:00
1ff6833bba
YARN-5243. fix several rebase and other miscellaneous issues before merge. (Sangjin Lee via Varun Saxena)
2016-07-10 08:46:03 -07:00
0a9b085f05
YARN-5189. Make HBaseTimeline[Reader|Writer]Impl default and move FileSystemTimeline*Impl. (Joep Rottinghuis and Sangjin Lee via gtcarrera9)
2016-07-10 08:46:01 -07:00
c2055a97d5
YARN-3150. Documenting the timeline service v2. (Sangjin Lee and Vrushali C via gtcarrera9)
2016-07-10 08:45:57 -07:00
39cce4e629
YARN-3816. [Aggregation] App-level aggregation and accumulation for YARN system metrics (Li Lu via sjlee)
2016-07-10 08:45:56 -07:00
a3cf40e532
YARN-3461. Consolidate flow name/version/run defaults. (Sangjin Lee via Varun Saxena)
2016-07-10 08:45:55 -07:00
84c35ac6c4
YARN-4711. NM is going down with NPE's due to single thread processing of events by Timeline client (Naganarasimha G R via sjlee)
2016-07-10 08:45:55 -07:00
9bdd455dce
YARN-4062. Add the flush and compaction functionality via coprocessors and scanners for flow run table (Vrushali C via sjlee)
2016-07-10 08:45:54 -07:00
0d02ab8729
YARN-3367. Replace starting a separate thread for post entity with event loop in TimelineClient (Naganarasimha G R via sjlee)
2016-07-10 08:45:53 -07:00
960af7d471
YARN-4409. Fix javadoc and checkstyle issues in timelineservice code (Varun Saxena via sjlee)
2016-07-10 08:45:53 -07:00
6934b05c71
YARN-4238. createdTime and modifiedTime is not reported while publishing entities to ATSv2. (Varun Saxena via Naganarasimha G R)
2016-07-10 08:45:52 -07:00
f5380d850e
YARN-4622. TestDistributedShell fails for v2 test cases after modifications for 1.5. (Naganarasimha G R via Varun Saxena)
2016-07-10 08:45:51 -07:00
34f02f07d5
Rebase to latest trunk
2016-07-10 08:45:51 -07:00
cc16683cef
YARN-3995. Some of the NM events are not getting published due race condition when AM container finishes in NM (Naganarasimha G R via sjlee)
2016-07-10 08:45:50 -07:00
8ef546c1ee
YARN-4445. Unify the term flowId and flowName in timeline v2 codebase.
...
Contributed by Zhan Zhang.
2016-07-10 08:45:49 -07:00
2e2dbf59d1
YARN-4392. ApplicationCreatedEvent event time resets after RM
...
restart/failover. Contributed by Naganarasimha G R and Xuan Gong
(cherry picked from commit 4546c7582b
2016-07-10 08:45:49 -07:00
b7d484aead
YARN-4450. TestTimelineAuthenticationFilter and
...
TestYarnConfigurationFields fail. Contributed by Sangjin Lee.
2016-07-10 08:45:49 -07:00
89e5c44f9e
YARN-4356. Ensure the timeline service v.2 is disabled cleanly and has no
...
impact when it's turned off. Contributed by Sangjin Lee.
2016-07-10 08:45:48 -07:00
cf4666bb8c
YARN-3623. Add a config to indicate the Timeline Service version. Contributed by Xuan Gong.
...
(cherry picked from commit f910e4f639
2016-07-10 08:45:48 -07:00
10fa6da7d8
YARN-4074. [timeline reader] implement support for querying for flows and flow runs (sjlee via vrushali)
2016-07-10 08:45:44 -07:00
8603736ef2
YARN-3949. Ensure timely flush of timeline writes. Contributed by Sangjin Lee.
...
(cherry picked from commit 967bef7e0396d857913caa2574afb103a5f0b81b)
2016-07-10 08:45:39 -07:00
57d8dc2fb7
YARN-3836. add equals and hashCode to TimelineEntity and other classes in the data model (Li Lu via sjlee)
...
(cherry picked from commit 2d4a8f4563c06339717ca9410b2794754603fba3)
2016-07-10 08:45:39 -07:00
e27642abf4
YARN-3047. [Data Serving] Set up ATS reader with basic request serving structure and lifecycle (Varun Saxena via sjlee)
...
(cherry picked from commit 4c5f88fb0f04b7919738d07598b0f006a9ff91f2)
2016-07-10 08:45:39 -07:00
22e7ae5771
YARN-3792. Test case failures in TestDistributedShell and some issue fixes related to ATSV2 (Naganarasimha G R via sjlee)
...
(cherry picked from commit 84f37f1c7eefec6d139cbf091c50d6c06f734323)
2016-07-10 08:45:38 -07:00
42d7864b84
YARN-3276. Code cleanup for timeline service API records. Contributed by Junping Du.
...
(cherry picked from commit d88f30ba5359f59fb71b93a55e1c1d9a1c0dff8e)
2016-07-10 08:45:37 -07:00
fc8485d893
YARN-3551. Consolidate data model change according to the backend implementation (Zhijie Shen via sale)
...
(cherry picked from commit 557a3950bddc837469244835f5577899080115d8)
2016-07-10 08:45:35 -07:00
2bdefbc4a0
YARN-3431. Sub resources of timeline entity needs to be passed to a separate endpoint. Contributed By Zhijie Shen.
...
(cherry picked from commit fa5cc75245a6dba549620a8b26c7b4a8aed9838e)
2016-07-10 08:45:34 -07:00
47f35a30bb
YARN-3391. Clearly define flow ID/ flow run / flow version in API and storage. Contributed by Zhijie Shen
...
(cherry picked from commit 68c6232f8423e55b4d152ef3d1d66aeb2d6a555e)
2016-07-10 08:45:33 -07:00
5712b8f9fd
YARN-3334. NM uses timeline client to publish container metrics to new timeline service. Contributed by Junping Du.
2016-07-10 08:45:33 -07:00
d67c9bdb4d
YARN-3040. Make putEntities operation be aware of the app's context. Contributed by Zhijie Shen
2016-07-10 08:45:32 -07:00
5e3d9a477b
YARN-3034. Implement RM starting its timeline collector. Contributed by Naganarasimha G R
2016-07-10 08:45:32 -07:00
2188a07e5b
YARN-3333. Rename TimelineAggregator etc. to TimelineCollector. Contributed by Sangjin Lee
2016-07-10 08:45:31 -07:00
9b56364080
YARN-3039. Implemented the app-level timeline aggregator discovery service. Contributed by Junping Du.
2016-07-10 08:45:31 -07:00
309592b9e5
YARN-3240. Added ".keep" file which was missed before.
...
(cherry picked from commit 6b4dc96414b3f15537670c67a0dccd048862f4f4)
2016-07-10 08:45:29 -07:00
4f0c7eaff3
YARN-3240. Implement client API to put generic entities. Contributed by Zhijie Shen
...
(cherry picked from commit 4487da249f448d5c67b712cd0aa723e764eed77d)
2016-07-10 08:45:29 -07:00
c77f86bf63
YARN-3041. Added the overall data model of timeline service next gen. Contributed by Zhijie Shen.
...
(cherry picked from commit fdff5d2625c129c20c44f90a0517b28cee1522bd)
2016-07-10 08:45:29 -07:00
8a9d293dd6
YARN-5233. Support for specifying a path for ATS plugin jars. Contributed by Li Lu
2016-07-06 16:44:46 -07:00
04f6ebb66a
YARN-5294. Pass remote ip address down to YarnAuthorizationProvider. (Jian He via wangda)
2016-07-06 10:36:48 -07:00
6ab5aa1c1f
YARN-5266. Wrong exit code while trying to get app logs using regex via CLI. Contributed by Xuan Gong
2016-06-22 21:48:49 -07:00
99e5dd68d0
YARN-5171. Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node. (Inigo Goiri via asuresh)
2016-06-22 19:04:54 -07:00
5d58858bb6
HADOOP-9613. [JDK8] Update jersey version to latest 1.x release.
2016-06-21 08:05:32 +09:00
d0162f2040
YARN-5246. NMWebAppFilter web redirects drop query parameters. Contributed by Varun Vasudev.
2016-06-19 17:44:54 -07:00
c35fa4a0e5
YARN-5251. Yarn CLI to obtain App logs for last 'n' bytes fails. Contributed by Xuan Gong.
2016-06-17 08:24:24 -07:00
5dfc38ff57
YARN-5237. Fix missing log files issue in rolling log aggregation. Contributed by Xuan Gong.
2016-06-15 16:17:54 -07:00
25064fb2fb
YARN-5223. Container line in yarn logs output for a live application should include the hostname for the container. Contributed by Xuan Gong.
2016-06-15 12:42:44 +05:30
c77a1095dc
YARN-1942. Deprecate toString/fromString methods from ConverterUtils and move them to records classes like ContainerId/ApplicationId, etc. (wangda)
2016-06-14 15:06:38 -07:00
eec835ec17
YARN-4887. Add allocation request ID to AM-RM protocol for identifying resource-requests explicitly. (Subru Krishnan via wangda)
2016-06-13 21:57:33 -07:00
5143277958
YARN-5124. Modify AMRMClient to set the ExecutionType in the ResourceRequest. (asuresh)
2016-06-12 09:42:38 -07:00
03fc6b1bb0
YARN-3426. Add jdiff support to YARN. (vinodkv via wangda)
2016-06-10 09:51:09 -07:00
9378d9428f
YARN-5191. Renamed the newly added “download=true” option for getting logs via NMWebServices and AHSWebServices to be a better "format" option. (Xuan Gong via vinodkv)
2016-06-09 12:30:58 -07:00
1500a0a300
YARN-4308. ContainersAggregated CPU resource utilization reports negative usage in first few heartbeats. Contributed by Sunil G
2016-06-09 05:41:09 +05:30
620325e816
YARN-4837. User facing aspects of 'AM blacklisting' feature need fixing. (vinodkv via wangda)
2016-06-07 15:06:42 -07:00
4a1cedc010
MAPREDUCE-5044. Have AM trigger jstack on task attempts that timeout before killing them. (Eric Payne and Gera Shegalov via mingma)
2016-06-06 14:30:51 -07:00
dc26601d8f
YARN-5180. Allow ResourceRequest to specify an enforceExecutionType flag. (asuresh)
2016-06-02 09:01:02 -07:00
0bc05e40fa
YARN-5088. Improve "yarn log" command-line to read the last K bytes for the log files. Contributed by Xuan Gong
2016-06-01 13:44:21 -07:00
86fb58b7dc
YARN-4007. Add support for different network setups when launching the docker container. Contributed by Sidharta Seethana.
2016-05-29 21:32:51 +05:30
42f90ab885
YARN-4844. Add getMemorySize/getVirtualCoresSize to o.a.h.y.api.records.Resource. Contributed by Wangda Tan.
2016-05-29 21:24:16 +05:30
aa975bc781
YARN-5127. Expose ExecutionType in Container api record. (Hitesh Sharma via asuresh)
2016-05-27 14:06:32 -07:00
bde819abbb
YARN-5089. Improve "yarn log" command-line "logFiles" option to support
...
regex. Contributed by Xuan Gong
2016-05-26 23:49:20 -07:00
0a544f8a3e
YARN-5005. TestRMWebServices#testDumpingSchedulerLogs fails randomly. Contributed by Bibin A Chundatt.
2016-05-27 10:44:35 +05:30
5b41b288d0
YARN-5162. Fix Exceptions thrown during in registerAM call when Distributed Scheduling is Enabled (Hitesh Sharma via asuresh)
2016-05-26 14:56:37 -07:00
013532a95e
YARN-4957. Add getNewReservation in ApplicationClientProtocol (Sean Po via curino)
2016-05-25 16:55:49 -07:00
77d5ce9069
YARN-3344. Fix warning - procfs stat file is not in the expected format. (Ravindra Kumar Naik and Akira Ajisaka via kasha)
2016-05-25 10:50:54 -07:00
e07519b8db
YARN-4766. NM should not aggregate logs older than the retention policy (haibochen via rkanter)
2016-05-25 10:25:44 -07:00
b4078bd17b
YARN-3971. Skip RMNodeLabelsManager#checkRemoveFromClusterNodeLabelsOfQueue on nodelabel recovery. (addendum patch). Contributed by Bibin A chundatt
2016-05-24 08:06:53 +08:00
0287c49107
YARN-5016. Add support for a minimum retry interval for container retries. Contributed by Jun Gong.
2016-05-20 12:28:14 +05:30
22fcd819f0
YARN-5076. YARN web interfaces lack XFS protection. Contributed by Jonathan Maron.
...
(cherry picked from commit 2703ec6871
2016-05-19 14:15:21 -07:00
ef1757790d
YARN-4913. Yarn logs should take a -out option to write to a directory. Contributed by Xuan Gong.
2016-05-18 22:44:33 +05:30
3c5c57af28
HADOOP-13142. Change project version from 3.0.0 to 3.0.0-alpha1.
2016-05-12 18:27:28 -07:00
ca5613af91
Revert "Update project version to 3.0.0-alpha1-SNAPSHOT."
...
This reverts commit 6b53802cba
2016-05-12 15:32:45 -07:00
6b53802cba
Update project version to 3.0.0-alpha1-SNAPSHOT.
2016-05-12 11:05:05 -07:00
87f5e35133
YARN-4842. Fixed "yarn logs" command to guess (and thus not require) the appOwner argument when viewing another user's logs. Contributed by Ram Venkatesh and Xuan Gong.
2016-05-09 22:41:18 -07:00
d0da13229c
YARN-4311. Removing nodes from include and exclude lists will not remove them from decommissioned nodes list. Contributed by Kuhu Shukla
2016-05-05 14:07:54 +00:00
9e37fe3b7a
YARN-4905. Improved "yarn logs" command-line to optionally show log metadata also. Contributed by Xuan Gong.
2016-05-04 14:16:03 -07:00
c6b4839168
YARN-4834. ProcfsBasedProcessTree doesn't track daemonized processes. Contributed by Nathan Roberts
2016-05-03 17:27:28 +00:00
0f25a1bb52
YARN-3998. Add support in the NodeManager to re-launch containers. Contributed by Jun Gong.
2016-04-29 16:09:07 +05:30
4a8508501b
YARN-5009. NMLeveldbStateStoreService database can grow substantially leading to longer recovery times. Contributed by Jason Lowe
2016-04-28 21:54:11 -07:00
dd80042c42
YARN-5008. LeveldbRMStateStore database can grow substantially leading to long recovery times. Contributed by Jason Lowe
2016-04-28 21:27:25 -07:00
66b07d8374
YARN-4966. Improve yarn logs to fetch container logs without specifying nodeId. Contributed by Xuan Gong.
2016-04-27 15:56:36 +05:30
341888a0aa
YARN-4412. Create ClusterMonitor to compute ordered list of preferred NMs for OPPORTUNITIC containers. (asuresh)
2016-04-26 20:12:12 -07:00
c282a08f38
YARN-2885. Create AMRMProxy request interceptor and ContainerAllocator to distribute OPPORTUNISTIC containers to appropriate Nodes (asuresh)
...
(cherry picked from commit 2bf025278a318b0452fdc9ece4427b4c42124e39)
2016-04-24 22:38:33 -07:00
b2a654c5ee
YARN-4335. Allow ResourceRequests to specify ExecutionType of a request ask (kkaranasos via asuresh)
...
(cherry picked from commit 8ffabfdf4f
2016-04-22 23:20:54 -07:00
95a5046607
YARN-4976. Missing NullPointer check in ContainerLaunchContextPBImpl. Contributed by Giovanni Matteo Fumarola
2016-04-21 10:45:38 -07:00
c8172f5f14
YARN-2883. Queuing of container requests in the NM. (Konstantinos Karanasos and Arun Suresh via kasha)
2016-04-20 09:55:50 -07:00
477003730e
Fixed TimelineClient to retry SocketTimeoutException too. Contributed by Xuan Gong.
2016-04-18 11:47:06 -07:00
e6c0742012
YARN-4965. Distributed shell AM failed due to ClientHandlerException thrown by jersey. Contributed by Junping Du
2016-04-16 19:39:18 -07:00
fdbafbc9e5
YARN-4909. Fix intermittent failures of TestRMWebServices And TestRMWithCSRFFilter. Contributed by Bibin A Chundatt
2016-04-15 23:37:05 +05:30
4ee7f0a3e7
YARN-4897. dataTables_wrapper change min height. Contributed by Bibin A Chundatt.
2016-04-12 10:25:56 +05:30
2a5da97f81
Revert "YARN-4311. Removing nodes from include and exclude lists will not remove them from decommissioned nodes list. Contributed by Kuhu Shukla"
...
This reverts commit 1cbcd4a491
2016-04-11 15:51:01 +00:00
1ff27f9d12
YARN-4630. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta.
2016-04-11 14:55:03 +09:00
07920acc16
YARN-4562. YARN WebApp ignores the configuration passed to it for keystore settings. Contributed by Sergey Shelukhin.
2016-04-11 09:39:57 +05:30
1cbcd4a491
YARN-4311. Removing nodes from include and exclude lists will not remove them from decommissioned nodes list. Contributed by Kuhu Shukla
2016-04-05 13:40:19 +00:00
5092c94195
YARN-4746. yarn web services should convert parse failures of appId, appAttemptId and containerId to 400. Contributed by Bibin A Chundatt
2016-04-04 16:25:03 +05:30
81d04cae41
YARN-4657. Javadoc comment is broken for Resources.multiplyByAndAddTo(). (Daniel Templeton via kasha)
2016-04-01 16:20:00 -07:00
5686caa9fc
Missing file for YARN-4895.
2016-04-01 15:58:13 -07:00
3488c4f2c9
Revert "YARN-4857. Add missing default configuration regarding preemption of CapacityScheduler. Contributed by Kai Sasaki."
...
This reverts commit 0064cba169
2016-04-01 12:20:40 +05:30
6d67420dbc
YARN-4183. Clarify the behavior of timeline service config properties (Naganarasimha G R via sjlee)
2016-03-31 10:49:03 -07:00
0064cba169
YARN-4857. Add missing default configuration regarding preemption of CapacityScheduler. Contributed by Kai Sasaki.
2016-03-31 14:05:49 +05:30
e8fc81f9c8
YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. Contributed by Xuan Gong
2016-03-25 20:15:49 +00:00
af1d125f9c
YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. Contributed by Xuan Gong.
2016-03-23 08:57:16 -07:00
7fae4c68e6
YARN-4732. *ProcessTree classes have too many whitespace issues
2016-03-20 10:47:38 -07:00
a888b5bc53
Revert "YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. (Xuan Gong via gtcarrera9)"
...
This reverts commit 3a0b695441
2016-03-15 22:10:39 -07:00
5176a69868
YARN-4817. Change Log Level to DEBUG for putDomain call in ATS 1.5. (Xuan Gong via gtcarrera9)
2016-03-15 11:47:39 -07:00
3a0b695441
YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. (Xuan Gong via gtcarrera9)
2016-03-15 11:40:54 -07:00
eba66a64d2
YARN-4816. Fix incompatible change in SystemClock.
2016-03-14 20:14:33 -07:00
f291d82cd4
YARN-4545. Allow YARN distributed shell to use ATS v1.5 APIs. Li Lu via junping_du
2016-03-14 08:28:38 -07:00
d49cfb3504
YARN-4696. Improving EntityGroupFSTimelineStore on exception handling, test setup, and concurrency. (Steve Loughran via gtcarrera9)
2016-03-10 10:51:55 -08:00
e51a8c1056
YARN-4737. Add CSRF filter support in YARN. Contributed by Jonathan Maron.
2016-03-07 15:26:44 +05:30
d7fdec1e6b
YARN-4579. Allow DefaultContainerExecutor container log directory permissions to be configurable (rchiang via rkanter)
2016-02-25 16:36:38 -08:00
c4d4df8de0
YARN-4701. When task logs are not available, port 8041 is referenced instead of port 8042 (haibochen via rkanter)
2016-02-25 12:48:02 -08:00
954dd57043
YARN-4697. NM aggregation thread pool is not bound by limits (haibochen via rkanter)
2016-02-24 15:00:24 -08:00
9e0f7b8b69
YARN-4680. TimerTasks leak in ATS V1.5 Writer. (Xuan Gong via
...
gtcarrera9)
2016-02-24 13:43:09 -08:00
553b591ba0
YARN-4722. AsyncDispatcher logs redundant event queue sizes (Jason Lowe via sjlee)
2016-02-24 09:29:41 -08:00
140cb5d745
YARN-4709. NMWebServices produces incorrect JSON for containers. Contributed by Varun Saxena.
2016-02-23 12:29:25 +05:30
a2fdfff02d
HADOOP-12668. Support excluding weak Ciphers in HttpServer2 through ssl-server.conf. Contributed by Vijay Singh.
...
Change-Id: Ie46a5427d29188935427f67e55203c19fcd83335
2016-02-22 14:13:54 -08:00
23f937e3b7
YARN-2575. Create separate ACLs for Reservation create/update/delete/list ops (Sean Po via asuresh)
2016-02-11 10:47:43 -08:00
fa00d3e205
YARN-4655. Log uncaught exceptions/errors in various thread pools in YARN. Contributed by Sidharta Seethana.
2016-02-11 12:06:42 +05:30
308d63f382
YARN-4307. Display blacklisted nodes for AM container in the RM web UI. Contributed by Naganarasimha G R.
2016-02-04 13:32:54 +05:30
db144eb1c5
YARN-4100. Add Documentation for Distributed and Delegated-Centralized
...
Node Labels feature. Contributed by Naganarasimha G R.
2016-02-02 12:06:51 +05:30
9875325d5c
YARN-4340. Add list API to reservation system. (Sean Po via wangda)
2016-02-02 10:17:33 +08:00
9fab22b366
YARN-4219. New levelDB cache storage for timeline v1.5. Contributed by
...
Li Lu
2016-01-28 14:24:22 -08:00
618bfd6ac2
YARN-4496. Improve HA ResourceManager Failover detection on the client.
...
Contributed by Jian He
2016-01-22 18:20:38 -08:00
89d1fd5dac
HADOOP-12356. Fix computing CPU usage statistics on Windows. (Inigo Goiri via wangda)
2016-01-19 21:27:38 +08:00
d40859fab1
YARN-4526. Make SystemClock singleton so AppSchedulingInfo could use it. (kasha)
2016-01-18 10:58:14 +01:00
02f597c5db
YARN-4265. Provide new timeline plugin storage to support fine-grained entity caching. Contributed by Li Lu and Jason Lowe
2016-01-17 17:37:40 -08:00
f7736f464f
YARN-4389. Allow application to enable or disable am blacklisting. (Sunil G via rohithsharmaks)
2016-01-15 21:38:26 +05:30
c0537bcd2c
YARN-4571. Make app id/name available to the yarn authorizer provider for better auditing. (Jian He via wangda)
2016-01-13 13:18:31 +08:00
13de8359a1
YARN-4414. Nodemanager connection errors are retried at multiple levels. Contributed by Chang Li
2016-01-12 15:56:15 +00:00
56b9500bbd
HADOOP-12584. Disable browsing the static directory in HttpServer2. Contributed by Robert Kanter.
2016-01-12 13:34:18 +09:00
fb00794368
YARN-2882. Add an OPPORTUNISTIC ExecutionType. (Konstantinos Karanasos and Inigo Goiri via kasha)
2015-12-26 20:22:16 -08:00
2c17b81569
YARN-2934. Improve handling of container's stderr. (Naganarasimha G R via gera)
2015-12-24 23:48:05 -08:00
bb5df272b9
YARN-4400. AsyncDispatcher.waitForDrained should be final. Contributed by Daniel Templeton.
2015-12-23 08:55:12 -08:00
882f2f0464
YARN-4234. New put APIs in TimelineClient for ats v1.5. Contributed by Xuan Gong.
2015-12-23 05:26:51 -08:00
114b590955
YARN-3458. CPU resource monitoring in Windows. Contributed by Inigo Goiri.
2015-12-21 16:59:09 -08:00
bc038b382c
YARN-4454. NM to nodelabel mapping going wrong after RM restart. (Bibin A Chundatt via wangda)
2015-12-21 11:30:13 -08:00
85c2466048
YARN-4164. Changed updateApplicationPriority API to return the updated application priority. Contributed by Rohith Sharma K S
2015-12-18 14:13:48 -08:00
7faa406f27
YARN-4225. Add preemption status to yarn queue -status for capacity scheduler. (Eric Payne via wangda)
2015-12-16 13:19:40 -08:00
79c41b1d83
YARN-4293. ResourceUtilization should be a part of yarn node CLI. (Sunil G via wangda)
2015-12-16 13:18:19 -08:00
1cb3299b48
YARN-4403. (AM/NM/Container)LivelinessMonitor should use monotonic time when calculating period. Contributed by Junping Du
2015-12-14 13:51:23 -08:00
dfcbbddb09
YARN-4309. Add container launch related debug information to container logs when a container fails. (Varun Vasudev via wangda)
2015-12-14 11:13:22 -08:00
21daa6c68a
YARN-3623-Addendum: Improve the description for Timeline Service Version configuration in yarn-default.xml
2015-12-10 10:56:12 -08:00
f910e4f639
YARN-3623. Add a config to indicate the Timeline Service version. Contributed by Xuan Gong.
2015-12-10 02:53:47 -08:00
01a641bc44
YARN-3456. Improve handling of incomplete TimelineEntities. (Varun Saxena via rohithsharmaks)
2015-12-07 15:16:56 +05:30
e84d6ca2df
Add missing file for YARN-4419
2015-12-03 19:07:28 -08:00
755dda8dd8
YARN-4405. Support node label store in non-appendable file system. Contributed by Wangda Tan
2015-12-03 17:45:31 -08:00
9f77ccad73
YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999). Contributed by Mohammad Shahid Khan and Varun Saxena
2015-12-03 12:48:50 -08:00
6b9a5beb2b
YARN-4398. Remove unnecessary synchronization in RMStateStore. Contributed by Ning Ding
2015-12-02 11:07:18 -08:00
f5acf94eca
YARN-4365. FileSystemNodeLabelStore should check for root dir existence on startup. Contributed by Kuhu Shukla
2015-11-24 23:47:10 +00:00
4ac6799d4a
YARN-4132. Separate configs for nodemanager to resourcemanager connection timeout and retries. Contributed by Chang Li
2015-11-24 22:35:37 +00:00
8c0133f3d4
YARN-4298. Fix findbugs warnings in hadoop-yarn-common. Contributed by Sunil G.
2015-11-24 18:40:33 +09:00
fcd7888029
Revert "YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan"
...
This reverts commit 8fbea531d7
2015-11-16 20:18:44 -08:00
23d0db551c
YARN-4241. Fix typo of property name in yarn-default.xml. Contributed by Anthony Rojas.
2015-11-11 16:13:08 +09:00
8fbea531d7
YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan
2015-11-09 10:43:45 -08:00
c41699965e
YARN-4288. Fixed RMProxy to retry on IOException from local host. Contributed by Junping Du
2015-10-29 00:00:48 -07:00
6f606214e7
YARN-4169. Fix racing condition of TestNodeStatusUpdaterForLabels. (Naganarasimha G R via wangda)
2015-10-26 16:36:34 -07:00
3cc73773eb
YARN-4285. Display resource usage as percentage of queue and cluster in the RM UI (Varun Vasudev via wangda)
2015-10-26 13:07:39 -07:00
5acdde4744
YARN-2729. Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup. (Naganarasimha G R via rohithsharmaks)
2015-10-26 15:42:42 +05:30
f8adeb712d
YARN-4009. CORS support for ResourceManager REST API. ( Varun Vasudev via jeagles)
2015-10-23 10:34:08 -05:00
0fce5f9a49
YARN-4243. Add retry on establishing Zookeeper conenction in EmbeddedElectorService#serviceInit. Contributed by Xuan Gong.
2015-10-22 13:41:09 -07:00
25f8f801d1
YARN-2513. Host framework UIs in YARN for use with the ATS (jeagles)
2015-10-21 15:38:08 -05:00
e39ae0e676
YARN-4262. Allow whitelisted users to run privileged docker containers. Contributed by Sidharta Seethana.
2015-10-19 20:19:22 +05:30
f9da5cdb2b
YARN-4170. AM need to be notified with priority in AllocateResponse. Contributed by Sunil G
2015-10-16 15:26:27 -07:00
63020c54c1
YARN-4258. Add support for controlling capabilities for docker containers. Contributed by Sidharta Seethana.
2015-10-15 13:41:20 +05:30
dfa7848463
HADOOP-12478. Shell.getWinUtilsPath() has been renamed Shell.getWinutilsPath(). (stevel)
2015-10-14 20:25:47 +01:00
c59af2fdf8
HADOOP-10775. Shell operations to fail with meaningful errors on windows if winutils.exe not found. (stevel)
2015-10-13 21:49:28 +01:00
db93047881
YARN-3964. Support NodeLabelsProvider at Resource Manager side.
...
Contributed by Dian Fu.
2015-10-11 11:21:29 +05:30
a0bca2b5ad
YARN-261. Ability to fail AM attempts. Contributed by Andrey Klochkov and Rohith Sharma K S
2015-10-09 14:17:38 +00:00
8d226225d0
YARN-3943. Use separate threshold configurations for disk-full detection and disk-not-full detection. Contributed by Zhihai Xu
2015-10-08 22:25:34 +00:00
30ac69c6bd
YARN-4176. Resync NM nodelabels with RM periodically for distributed nodelabels. (Bibin A Chundatt via wangda)
2015-10-05 15:47:21 -07:00
c918f7be5e
HADOOP-12458. Retries is typoed to spell Retires in parts of hadoop-yarn and hadoop-common. Contributed by Neelesh Srinivas Salian.
2015-10-03 18:37:58 +05:30
8f08532bde
YARN-1897. CLI and core support for signal container functionality. Contributed by Ming Ma
2015-10-02 18:50:47 -07:00
fdf02d1f26
YARN-3619. ContainerMetrics unregisters during getMetrics and leads to ConcurrentModificationException. Contributed by Zhihai Xu
2015-10-02 20:20:31 +00:00
89cab1ba5f
YARN-1651. CapacityScheduler side changes to support container resize. Contributed by Wangda Tan
2015-09-23 13:29:38 -07:00
83a18add10
YARN-1449. AM-NM protocol changes to support container resizing. Contributed by Meng Ding & Wangda Tan)
2015-09-23 13:29:36 -07:00
dfe2cb849f
YARN-3866. AM-RM protocol changes to support container resizing. Contributed by Meng Ding
2015-09-23 13:29:36 -07:00
dfd807afab
HADOOP-12428. Fix inconsistency between log-level guards and statements. Contributed by Jagadesh Kiran N and Jackie Chang.
2015-09-22 12:54:29 +09:00
b00392dd9c
YARN-4113. RM should respect retry-interval when uses RetryPolicies.RETRY_FOREVER. (Sunil G via wangda)
2015-09-21 11:04:03 -07:00
bf2f2b4fc4
YARN-3433. Jersey tests failing with Port in Use -again. (Brahma Reddy Battula)
2015-09-16 10:31:02 +01:00
ae5308fe1d
YARN-3717. Expose app/am/queue's node-label-expression to RM web UI / CLI / REST-API. (Naganarasimha G R via wangda)
2015-09-15 11:40:50 -07:00
73e3a49eb0
YARN-313. Add Admin API for supporting node resource configuration in command line. (Contributed by Inigo Goiri, Kenji Kikushima and Junping Du)
2015-09-15 07:56:47 -07:00
332b520a48
YARN-3697. FairScheduler: ContinuousSchedulingThread can fail to shutdown. (Zhihai Xu via kasha)
2015-09-13 18:07:43 -07:00
81df7b586a
YARN-2005. Blacklisting support for scheduling AMs. (Anubhav Dhoot via kasha)
2015-09-13 17:03:15 -07:00
7269906254
HADOOP-12087. [JDK8] Fix javadoc errors caused by incorrect or illegal tags. (Akira AJISAKA via stevel).
2015-09-13 14:25:26 +01:00
6dd6ca442a
YARN-4086. Allow Aggregated Log readers to handle HAR files (rkanter)
2015-09-09 18:03:04 -07:00
6f72f1e600
YARN-2884. Added a proxy service in NM to proxy the the communication between AM and RM. Contributed by Kishore Chaliparambil
2015-09-08 09:35:46 +08:00
9b78e6e33d
YARN-4087. Followup fixes after YARN-2019 regarding RM behavior when
...
state-store error occurs. Contributed by Jian He
2015-09-07 17:45:47 -07:00
bcc85e3bab
YARN-4024. YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat. (Hong Zhiguo via wangda)
2015-09-04 15:13:53 -07:00
a3fd2ccc86
YARN-4092. Fixed UI redirection to print useful messages when both RMs are in standby mode. Contributed by Xuan Gong
2015-08-31 17:33:24 -07:00
a9c8ea71aa
YARN-3250. Support admin cli interface in for Application Priority. Contributed by Rohith Sharma K S
2015-08-27 13:25:53 -07:00
57c7ae1aff
YARN-4014. Support user cli interface in for Application Priority. Contributed by Rohith Sharma K S
2015-08-24 20:36:44 -07:00
b71c6006f5
YARN-221. Addendum patch to compilation issue which is caused by missing
...
AllContainerLogAggregationPolicy. Contributed by Xuan Gong
2015-08-23 16:46:30 -07:00
37e1c3d82a
YARN-221. NM should provide a way for AM to tell it not to aggregate
...
logs. Contributed by Ming Ma
2015-08-22 16:25:24 -07:00
fc07464d1a
YARN-2923. Support configuration based NodeLabelsProvider Service in Distributed Node Label Configuration Setup. (Naganarasimha G R)
2015-08-20 11:51:03 -07:00
def12933b3
YARN-3534. Collect memory/cpu usage on the node. (Inigo Goiri via kasha)
2015-08-16 06:24:16 -07:00
1c12adb71f
YARN-4023. Publish Application Priority to TimelineServer. (Sunil G via rohithsharmaks)
2015-08-12 14:45:41 +05:30
3ae716fa69
YARN-3999. RM hangs on draing events. Contributed by Jian He
2015-08-11 18:25:11 -07:00
b6265d39c5
YARN-3948. Display Application Priority in RM Web UI.(Sunil G via rohithsharmaks)
2015-08-07 10:43:41 +05:30
154c9d2e42
YARN-3961. Expose pending, running and reserved containers of a queue in REST api and yarn top (adhoot via asuresh)
2015-08-05 23:14:14 -07:00
0306d902f5
YARN-3543. ApplicationReport should be able to tell whether the
...
Application is AM managed or not. Contributed by Rohith Sharma K S
2015-08-03 15:46:00 -07:00
8acb30b016
YARN-3963. AddNodeLabel on duplicate label addition shows success. (Bibin A Chundatt via wangda)
2015-07-30 09:42:55 -07:00
c020b62cf8
YARN-3919. NPEs' while stopping service after exception during CommonNodeLabelsManager#start. (varun saxena via rohithsharmaks)
2015-07-29 23:30:47 +05:30
5205a330b3
YARN-2768. Avoid cloning Resource in FSAppAttempt#updateDemand. (Hong Zhiguo via kasha)
2015-07-29 09:42:32 -07:00
42d4e0ae99
YARN-3958. TestYarnConfigurationFields should be moved to hadoop-yarn-api module. Contributed by Varun Saxena.
2015-07-27 11:43:25 +09:00
e202efaf93
YARN-3845. Scheduler page does not render RGBA color combinations in IE11. (Contributed by Mohammad Shahid Khan)
2015-07-24 12:43:06 +05:30
1d3026e7b3
YARN-3900. Protobuf layout of yarn_security_token causes errors in other protos that include it (adhoot via rkanter)
2015-07-23 14:46:54 -07:00
ee98d6354b
YARN-2019. Retrospect on decision of making RM crashed if any exception throw in ZKRMStateStore. Contributed by Jian He.
2015-07-22 17:52:35 -07:00
8376ea3297
YARN-3954. Fix TestYarnConfigurationFields#testCompareConfigurationClassAgainstXml. (varun saxena via rohithsharmaks)
2015-07-23 00:28:24 +05:30
393fe71771
YARN-3878. AsyncDispatcher can hang while stopping if it is configured for draining events on stop. Contributed by Varun Saxena
2015-07-21 15:05:41 -07:00
fa2b63ed16
YARN-3930. FileSystemNodeLabelsStore should make sure edit log file closed when exception is thrown. (Dian Fu via wangda)
2015-07-16 16:06:20 -07:00
a431ed9075
HADOOP-12211. Collect disk usage on the node. Contributed by Robert Grandl
2015-07-13 15:36:11 -07:00
2466460d4c
Revert "YARN-3878. AsyncDispatcher can hang while stopping if it is configured for draining events on stop. (Varun Saxena via kasha)"
...
This reverts commit aa067c6aa4
2015-07-13 14:30:35 -07:00
19295b36d9
YARN-3381. Fix typo InvalidStateTransitonException. Contributed by Brahma Reddy Battula.
2015-07-13 17:52:13 +09:00
d6675606dc
YARN-3069. Document missing properties in yarn-default.xml. Contributed by Ray Chiang.
2015-07-13 12:57:01 +09:00
d7319dee37
YARN-3917. getResourceCalculatorPlugin for the default should intercept all exceptions. (gera)
2015-07-11 22:29:36 -07:00
1ea36299a4
YARN-3116. RM notifies NM whether a container is an AM container or normal task container. Contributed by Giovanni Matteo Fumarola.
2015-07-10 18:58:10 -07:00
1a0752d85a
HADOOP-12210. Collect network usage on the node. Contributed by Robert Grandl
2015-07-09 17:48:43 -07:00
ac6048372a
HADOOP-12180. Move ResourceCalculatorPlugin from YARN to Common. (Chris Douglas via kasha)
2015-07-09 09:56:40 -07:00
aa067c6aa4
YARN-3878. AsyncDispatcher can hang while stopping if it is configured for draining events on stop. (Varun Saxena via kasha)
2015-07-09 09:48:29 -07:00
d6325745e2
YARN-3690. [JDK8] 'mvn site' fails. Contributed by Brahma Reddy Battula.
2015-07-08 15:42:31 +09:00
688617d6d7
YARN-3882. AggregatedLogFormat should close aclScanner and ownerScanner
...
after create them. Contributed by zhihai xu
2015-07-04 21:51:58 -07:00
7405c59799
YARN-3823. Fix mismatch in default values for
...
yarn.scheduler.maximum-allocation-vcores property. Contributed by Ray
Chiang.
2015-07-01 11:11:26 +05:30
6f2a41e37d
YARN-3768. ArrayIndexOutOfBoundsException with empty environment variables. (Zhihai Xu via gera)
2015-06-30 14:59:33 -07:00
4672315e2d
YARN-3770. SerializedException should also handle java.lang.Error on de-serialization. Contributed by Lavkesh Lahngir
2015-06-29 14:31:49 -07:00
62e583c7dc
YARN-3695. ServerProxy (NMProxy, etc.) shouldn't retry forever for non network exception. Contributed by Raju Bairishetti
2015-06-29 13:37:32 -07:00
b381f88c71
YARN-3745. SerializedException should also try to instantiate internal
...
exception with the default constructor. Contributed by Lavkesh Lahngir.
2015-06-25 17:38:11 +05:30
2a20dd9b61
YARN-3809. Failed to launch new attempts because ApplicationMasterLauncher's threads all hang. Contributed by Jun Gong
2015-06-24 16:23:48 +00:00
5ebf2817e5
YARN-3842. NMProxy should retry on NMNotYetReadyException. (Robert Kanter via kasha)
2015-06-22 17:47:47 -07:00
63d40d5286
MAPREDUCE-6316. Task Attempt List entries should link to the task overview. (Siqi Li via gera)
2015-06-20 11:38:21 -07:00
318d2cde7c
YARN-3617. Fix WindowsResourceCalculatorPlugin.getCpuFrequency() returning
...
always -1. Contributed by J.Andreina.
2015-06-17 13:54:09 +05:30
e27d5a13b0
YARN-3714. AM proxy filter can not get RM webapp address from
...
yarn.resourcemanager.hostname.rm-id. Contributed by Masatake Iwasaki
2015-06-16 14:06:16 -07:00
8d0ef31632
YARN-3787. Allowed generic history service to load a number of applications whose started time is within the given range. Contributed by Xuan Gong.
2015-06-08 23:14:58 -07:00
405bbcf68c
Add missing test file of YARN-3733
2015-06-04 13:18:44 -07:00
ebd797c48f
YARN-3733. Fix DominantRC#compare() does not work as expected if cluster resource is empty. (Rohith Sharmaks via wangda)
2015-06-04 10:22:57 -07:00
5766a04428
YARN-3749. We should make a copy of configuration when init
...
MiniYARNCluster with multiple RMs. Contributed by Chun Chen
2015-06-03 17:20:15 -07:00
bc85959edd
Revert "YARN-1462. Made RM write application tags to timeline server and exposed them to users via generic history web UI and REST API. Contributed by Xuan Gong."
...
This reverts commit 4a9ec1a824
2015-06-03 14:15:56 -07:00
5cc3fced95
YARN-3725. App submission via REST API is broken in secure mode due to Timeline DT service address is empty. (Zhijie Shen via wangda)
2015-05-31 16:31:09 -07:00
4a9ec1a824
YARN-1462. Made RM write application tags to timeline server and exposed them to users via generic history web UI and REST API. Contributed by Xuan Gong.
2015-05-30 21:05:36 -07:00
788bfa0359
YARN-3716. Node-label-expression should be included by ResourceRequestPBImpl.toString. (Xianyin Xin via wangda)
2015-05-28 16:34:18 -07:00
7e509f5843
YARN-3722. Merge multiple TestWebAppUtils into
...
o.a.h.yarn.webapp.util.TestWebAppUtils. Contributed by Masatake Iwasaki.
2015-05-28 15:35:06 +05:30
54504133f4
YARN-3700. Made generic history service load a number of latest applications according to the parameter or the configuration. Contributed by Xuan Gong.
2015-05-27 16:52:22 -07:00
ec0a852a37
YARN-3647. RMWebServices api's should use updated api from CommonNodeLabelsManager to get NodeLabel object. (Sunil G via wangda)
2015-05-27 12:51:20 -07:00
cdbd66be11
YARN-3686. CapacityScheduler should trim default_node_label_expression. (Sunil G via wangda)
2015-05-26 15:58:47 -07:00
500a1d9c76
YARN-160. Enhanced NodeManager to automatically obtain cpu/memory values from underlying OS when configured to do so. Contributed by Varun Vasudev.
2015-05-26 11:38:35 -07:00
39077dba2e
YARN-2238. Filtering on UI sticks even if I move away from the page.
...
Contributed by Jian He
2015-05-25 22:39:16 -07:00
55ed6558ba
HADOOP-11743. maven doesn't clean all the site files (Contributed by ramtin)
2015-05-22 16:45:19 +05:30
0305316d69
YARN-3646. Applications are getting stuck some times in case of retry
...
policy forever. Contributed by Raju Bairishetti.
2015-05-21 20:14:44 +05:30
8966d42179
YARN-3609. Load node labels from storage inside RM serviceStart. Contributed by Wangda Tan
2015-05-20 16:30:07 -07:00
563eb1ad2a
YARN-3583. Support of NodeLabel object instead of plain String in YarnClient side. (Sunil G via wangda)
2015-05-19 16:54:38 -07:00
b37da52a1c
YARN-3565. NodeHeartbeatRequest/RegisterNodeManagerRequest should use NodeLabel object instead of String. (Naganarasimha G R via wangda)
2015-05-19 16:34:17 -07:00
76afd28862
YARN-3541. Add version info on timeline service / generic history web UI and REST API. Contributed by Zhijie Shen
2015-05-18 13:17:16 -07:00
15ccd967ee
YARN-3505. Node's Log Aggregation Report with SUCCEED should not cached in RMApps. Contributed by Xuan Gong.
2015-05-14 10:58:12 -07:00
d4f53fc963
YARN-3579. CommonNodeLabelsManager should support NodeLabel instead of string label name when getting node-to-label/label-to-label mappings. (Sunil G via wangda)
2015-05-13 13:29:09 -07:00
341a476812
YARN-2921. Fix MockRM/MockAM#waitForState sleep too long. (Tsuyoshi Ozawa via wangda)
2015-05-13 13:06:07 -07:00
fcd0702c10
YARN-3539. Updated timeline server documentation and marked REST APIs evolving. Contributed by Steve Loughran.
2015-05-12 21:13:22 -07:00
70fb37cd79
YARN-1287. Consolidate MockClocks. (Sebastian Wong and Anubhav Dhoot via kasha)
2015-05-09 14:34:54 -07:00
088156de43
YARN-2331. Distinguish shutdown during supervision vs. shutdown for
...
rolling upgrade. Contributed by Jason Lowe
2015-05-08 15:10:43 -07:00
f0f5e3c075
YARN-20. More information for yarn.resourcemanager.webapp.address in yarn-default.xml (Bartosz Ługowski vai tgraves)
2015-05-08 17:21:32 +00:00
241a72af0d
YARN-2784. Make POM project names consistent. Contributed by Rohith.
2015-05-08 19:23:53 +05:30
9757864fd6
YARN-3554. Default value for maximum nodemanager connect wait time is too high. Contributed by Naganarasimha G R
2015-05-08 13:45:35 +00:00
f26700f287
YARN-3589. RM and AH web UI display DOCTYPE wrongly. Contbituted by Rohith.
2015-05-08 17:13:40 +09:00
918af8efff
YARN-3577. Misspelling of threshold in log4j.properties for tests. Contributed by Brahma Reddy Battula.
2015-05-07 13:33:03 +09:00
b7dd3a4f04
YARN-2123. Progress bars in Web UI always at 100% due to non-US locale.
...
Contributed by Akira AJISAKA
2015-05-05 10:40:16 -07:00
e8d0ee5fc9
YARN-1993. Cross-site scripting vulnerability in TextView.java. Contributed byKenji Kikushima.
2015-05-03 10:51:17 +09:00
57d9a972cb
YARN-2454. Fix compareTo of variable UNBOUNDED in o.a.h.y.util.resource.Resources. Contributed by Xu Yang.
2015-05-02 10:18:44 -07:00
2e215484bd
YARN-3517. RM web ui for dumping scheduler logs should be for admins only (Varun Vasudev via tgraves)
2015-04-29 21:25:42 +00:00
db1b674b50
YARN-2740. Fix NodeLabelsManager to properly handle node label modifications when distributed node label configuration enabled. (Naganarasimha G R via wangda)
2015-04-27 16:24:38 -07:00
f5fe35e297
YARN-3413. Changed Nodelabel attributes (like exclusivity) to be settable only via addToClusterNodeLabels but not changeable at runtime. (Wangda Tan via vinodkv)
2015-04-23 11:19:55 -07:00
aa4a192feb
YARN-3522. Fixed DistributedShell to instantiate TimeLineClient as the correct user. Contributed by Zhijie Shen
2015-04-23 11:07:26 -07:00
fad9d7e85b
New parameter of CLI for decommissioning node gracefully in RMAdmin CLI. Contributed by Devaraj K
2015-04-22 10:07:20 -07:00
6779467ab6
YARN-3451. Display attempt start time and elapsed time on the web UI. Contributed by Rohith Sharmaks
2015-04-17 15:55:34 -07:00
1db355a875
YARN-1402. Update related Web UI and CLI with exposing client API to check log aggregation status. Contributed by Xuan Gong.
2015-04-17 13:18:59 -07:00
1fa8075794
MAPREDUCE-6300. Task list sort by task id broken. Contributed by Siqi Li.
2015-04-16 10:04:09 -05:00
1b89a3e173
YARN-3354. Add node label expression in ContainerTokenIdentifier to support RM recovery. Contributed by Wangda Tan
2015-04-15 13:57:06 -07:00
a77d628339
YARN-3347. Improve YARN log command to get AMContainer logs as well as running containers logs. Contributed by Xuan Gong.
2015-04-13 17:29:06 -07:00
577d755e4b
YARN-3348. Add a 'yarn top' tool to help understand cluster usage. Contributed by Varun Vasudev
2015-04-10 09:57:17 -07:00
7af086a515
YARN-3459. Fix failiure of TestLog4jWarningErrorMetricsAppender. (Varun Vasudev via wangda)
2015-04-08 10:57:48 -07:00
d27e9241e8
YARN-3294. Allow dumping of Capacity Scheduler debug logs via web UI for
...
a fixed time period. Contributed by Varun Vasudev
2015-04-07 09:52:36 -07:00
bad070fe15
YARN-2901. Add errors and warning metrics page to RM, NM web UI. (Varun Vasudev via wangda)
2015-04-02 17:23:20 -07:00
492239424a
YARN-3425. NPE from RMNodeLabelsManager.serviceStop when NodeLabelsManager.serviceInit failed. (Bibin A Chundatt via wangda)
2015-04-01 10:14:48 -07:00
7610925e90
YARN-3304. Addendum patch. Cleaning up ResourceCalculatorProcessTree APIs for public use and removing inconsistencies in the default values. (Junping Du and Karthik Kambatla via vinodkv)
2015-03-31 17:27:46 -07:00
c358368f51
YARN-3304. Cleaning up ResourceCalculatorProcessTree APIs for public use and removing inconsistencies in the default values. Contributed by Junping Du and Karthik Kambatla.
2015-03-30 10:09:40 -07:00
87130bf6b2
YARN-3400. [JDK 8] Build Failure due to unreported exceptions in RPCUtil (rkanter)
2015-03-26 11:00:20 -07:00
e1feb4ea1a
YARN-3345. Add non-exclusive node label API. Contributed by Wangda Tan
2015-03-20 19:04:38 -07:00
7f1e2f9969
YARN-3350. YARN RackResolver spams logs with messages at info level. Contributed by Wilfred Spiegelenburg
2015-03-20 18:21:33 -07:00
d81109e588
YARN-3269. Yarn.nodemanager.remote-app-log-dir could not be configured to fully qualified path. Contributed by Xuan Gong
2015-03-20 13:41:22 -07:00
1a4b528691
YARN-2777. Mark the end of individual log in aggregated log. Contributed
...
by Varun Saxena
2015-03-20 10:24:13 -07:00
20b49224eb
YARN-3351. AppMaster tracking URL is broken in HA. (Anubhav Dhoot via kasha)
2015-03-18 16:30:33 -07:00
3da9a97cfb
YARN-1453. [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments. Contributed by Akira AJISAKA, Andrew Purtell, and Allen Wittenauer.
2015-03-16 23:19:05 +09:00
863079bb87
YARN-3154. Added additional APIs in LogAggregationContext to avoid aggregating running logs of application when rolling is enabled. Contributed by Xuan Gong.
2015-03-12 13:32:29 -07:00
85f6d67fa7
YARN-1884. Added nodeHttpAddress into ContainerReport and fixed the link to NM web page. Contributed by Xuan Gong.
2015-03-11 19:35:19 -07:00
d6e05c5ee2
YARN-3287. Made TimelineClient put methods do as the correct login context. Contributed by Daryn Sharp and Jonathan Eagles.
2015-03-09 13:54:36 -07:00
7ce3c76353
YARN-3296. Mark ResourceCalculatorProcessTree class as Public for configurable resource monitoring. Contributed by Hitesh Shah
2015-03-08 14:47:35 -07:00
27e8ea820f
YARN-3275. CapacityScheduler: Preemption happening on non-preemptable queues. Contributed by Eric Payne
2015-03-06 22:37:26 +00:00
21101c01f2
YARN-2190. Added CPU and memory limit options to the default container executor for Windows containers. Contributed by Chuan Liu
2015-03-06 14:18:11 -08:00
d1abc5d4fc
YARN-3227. Timeline renew delegation token fails when RM user's TGT is
...
expired. Contributed by Zhijie Shen
2015-03-06 13:32:05 -08:00
95bfd087dc
YARN-1809. Synchronize RM and TimeLineServer Web-UIs. Contributed by Zhijie Shen and Xuan Gong
2015-03-05 21:20:09 -08:00
53947f37c7
YARN-3122. Metrics for container's actual CPU usage. (Anubhav Dhoot via kasha)
2015-03-04 17:33:30 -08:00
d1c6accb6f
HADOOP-11602. Fix toUpperCase/toLowerCase to use Locale.ENGLISH. (ozawa)
2015-03-03 14:17:52 +09:00
edcecedc1c
YARN-3262. Surface application outstanding resource requests table in RM web UI. (Jian He via wangda)
2015-02-27 16:13:32 -08:00
01a1621930
YARN-2820. Retry in FileSystemRMStateStore when FS's operations fail due to IOException. Contributed by Zhihai Xu.
2015-02-28 00:56:44 +09:00
9cedad11d8
Revert "HADOOP-11602. Fix toUpperCase/toLowerCase to use Locale.ENGLISH. (ozawa)"
...
This reverts commit 946456c6d8
2015-02-25 00:32:04 +09:00
92d67ace32
YARN-3238. Connection timeouts to nodemanagers are retried at multiple
...
levels. Contributed by Jason Lowe
2015-02-21 16:06:12 -08:00
d49ae725d5
YARN-3076. Add API/Implementation to YarnClient to retrieve label-to-node mapping (Varun Saxena via wangda)
2015-02-19 11:00:57 -08:00
946456c6d8
HADOOP-11602. Fix toUpperCase/toLowerCase to use Locale.ENGLISH. (ozawa)
2015-02-19 13:06:53 +09:00
f5da5566d9
YARN-3132. RMNodeLabelsManager should remove node from node-to-label mapping when node becomes deactivated. Contributed by Wangda Tan
2015-02-18 11:51:51 -08:00
2586915bb3
YARN-3179. Update use of Iterator to Iterable in RMAdminCLI and
...
CommonNodeLabelsManager. Contributed by Ray Chiang
2015-02-12 17:31:45 -08:00
7bc492adab
YARN-3157. Refactor the exception handling in ConverterUtils#to*Id. Contributed by Bibin A Chundatt.
2015-02-12 23:48:43 +09:00
46c7577b98
YARN-1580. Documentation error regarding container-allocation.expiry-interval-ms (Brahma Reddy Battula via junping_du)
2015-02-12 03:38:54 -08:00
4cbaa74f62
Revert "YARN-3157. Refactor the exception handling in ConverterUtils#to*Id. Contributed by Bibin A Chundatt."
...
This reverts commit 95a41bf35d
2015-02-12 18:48:17 +09:00
95a41bf35d
YARN-3157. Refactor the exception handling in ConverterUtils#to*Id. Contributed by Bibin A Chundatt.
2015-02-12 18:41:17 +09:00
b3bcbaf277
YARN-1237. Description for yarn.nodemanager.aux-services in yarn-default.xml is misleading. Contributed by Brahma Reddy Battula.
2015-02-12 15:17:51 +09:00
c3da2db48f
YARN-2683. [YARN-913] registry config options: document and move to core-default. (stevel)
2015-02-11 14:26:37 +00:00
23bf6c7207
YARN-3100. Made YARN authorization pluggable. Contributed by Jian He.
2015-02-09 20:34:56 -08:00
00a748d24a
YARN-3155. Refactor the exception handling code for TimelineClientImpl's retryOn method (Li Lu via wangda)
2015-02-09 17:20:34 -08:00
af08425893
YARN-2971. RM uses conf instead of token service address to renew timeline delegation tokens (jeagles)
2015-02-09 17:56:05 -06:00
0af6a99a3f
YARN-3094. Reset timer for liveness monitors after RM recovery. Contributed by Jun Gong
2015-02-09 13:47:08 -08:00
6f10434a5a
YARN-3144. Configuration for making delegation token failures to timeline server not-fatal. Contributed by Jonathan Eagles
2015-02-06 20:55:00 +00:00
c1957fef29
YARN-2694. Ensure only single node label specified in ResourceRequest. Contributed by Wangda Tan
2015-02-06 11:34:20 -08:00
b77ff37686
YARN-3149. Fix typo in message for invalid application id. Contributed
...
by Bibin A Chundatt.
2015-02-05 15:13:57 -08:00
5bd984691b
YARN-3075. NodeLabelsManager implementation to retrieve label to node mapping (Varun Saxena via wangda)
2015-02-03 12:52:42 -08:00
f33c99ba39
YARN-3113. Release audit warning for Sorting icons.psd. Contributed by Steve Loughran.
2015-02-02 12:58:35 -06:00
7acce7d364
YARN-3029. FSDownload.unpack() uses local locale for FS case conversion, may not work everywhere. Contributed by Varun Saxena.
2015-01-30 04:42:05 +09:00
342efa110a
HADOOP-9907. Webapp http://hostname:port/metrics link is not working. (aajisaka)
2015-01-30 02:49:10 +09:00
fd93e5387b
YARN-3028. Better syntax for replaceLabelsOnNode in RMAdmin CLI. Contributed by Rohith Sharmaks
2015-01-27 15:23:45 -08:00
24aa462673
YARN-2800. Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature. Contributed by Wangda Tan.
2015-01-23 20:37:05 +09:00
5712c9f96a
YARN-3078. LogCLIHelpers lacks of a blank space before string 'does not exist'. Contributed by Sam Liu.
2015-01-22 12:25:05 +09:00
f250ad1773
YARN-2731. Fixed RegisterApplicationMasterResponsePBImpl to properly invoke maybeInitBuilder. (Contributed by Carlo Curino)
2015-01-20 14:46:22 -08:00
f92e503800
YARN-3019. Make work-preserving-recovery the default mechanism for RM recovery. (Contributed by Jian He)
2015-01-13 18:20:57 -08:00
f451631915
YARN-2957. Create unit test to automatically compare YarnConfiguration and yarn-default.xml. (rchiang via rkanter)
2015-01-12 12:00:30 -08:00
a260406268
YARN-3014. Replaces labels on a host should update all NM's labels on that host. Contributed by Wangda Tan
2015-01-09 17:49:53 -08:00
2638f4d0f0
YARN-2936. Changed YARNDelegationTokenIdentifier to set proto fields on getProto method. Contributed by Varun Saxena
2015-01-07 16:14:22 -08:00
fe8d2bd741
YARN-2230. Fixed few configs description in yarn-default.xml. Contributed by Vijay Bhat
2015-01-07 10:57:06 -08:00
947578c1c1
YARN-2991. Fixed DrainDispatcher to reuse the draining code path in AsyncDispatcher. Contributed by Rohith Sharmaks.
2015-01-02 11:08:47 -08:00
b7442bf92e
YARN-2493. Added node-labels page on RM web UI. Contributed by Wangda Tan
2014-12-30 16:49:01 -08:00
746ad6e989
Revert "YARN-2492(wrong jira number). Added node-labels page on RM web UI. Contributed by Wangda Tan"
...
This reverts commit 5f57b904f5
2014-12-30 16:48:49 -08:00
5f57b904f5
YARN-2492. Added node-labels page on RM web UI. Contributed by Wangda Tan
2014-12-30 15:38:28 -08:00
b256dd7600
YARN-2988. Graph#save() may leak file descriptors. (Ted Yu via ozawa)
2014-12-25 12:48:24 +09:00
149512a837
YARN-2837. Support TimeLine server to recover delegation token when restarting. Contributed by Zhijie Shen
2014-12-23 18:25:37 -08:00
a696fbb001
YARN-2939. Fix new findbugs warnings in hadoop-yarn-common. (Li Lu via junping_du)
2014-12-22 03:06:37 -08:00
b7f64823e1
YARN-2203. [YARN-1492] Web UI for cache manager. (Chris Trezzo via kasha)
2014-12-17 16:32:21 -08:00
0e37bbc8e3
YARN-2950. Change message to mandate, not suggest JS requirement on UI. Contributed by Dustin Cote.
2014-12-13 07:10:40 +05:30
3681de2039
YARN-2912 Jersey Tests failing with port in use. (varun saxena via stevel)
2014-12-12 17:11:07 +00:00
614b6afea4
YARN-2917. Fixed potential deadlock when system.exit is called in AsyncDispatcher. Contributed by Rohith Sharmaks
2014-12-11 11:17:54 -08:00
78968155d7
YARN-2189. [YARN-1492] Admin service for cache manager. (Chris Trezzo via kasha)
2014-12-04 17:36:32 -08:00
03ab24aa01
MAPREDUCE-5932. Provide an option to use a dedicated reduce-side shuffle log. Contributed by Gera Shegalov
2014-12-03 17:02:14 +00:00
a7fba0bc28
YARN-2765. Added leveldb-based implementation for RMStateStore. Contributed by Jason Lowe
2014-12-01 16:38:25 -08:00
0f9528b99a
YARN-2905. AggregatedLogsBlock page can infinitely loop if the aggregated log file is corrupted. Contributed by Varun Saxena
2014-12-01 22:29:05 +00:00
8f1454cc6d
YARN-2165. Added the sanity check for the numeric configuration values of the timeline service. Contributed by Vasanth kumar RJ.
2014-11-26 12:09:34 -08:00
fe1f2db5ee
YARN-2188. [YARN-1492] Client service for cache manager. (Chris Trezzo and Sangjin Lee via kasha)
2014-11-25 16:21:46 -08:00
c298a9a845
YARN-2375. Allow enabling/disabling timeline server per framework. (Mit Desai via jeagles)
2014-11-20 23:34:35 -06:00
81c9d17af8
YARN-2414. RM web UI: app page will crash if app is failed before any attempt has been created. Contributed by Wangda Tan
2014-11-17 21:15:48 +00:00
f2fe8a800e
YARN-2857. ConcurrentModificationException in ContainerLogAppender. Contributed by Mohammad Kamrul Islam
2014-11-14 20:47:26 +00:00
a04143039e
YARN-2236. [YARN-1492] Shared Cache uploader service on the Node Manager. (Chris Trezzo and Sanjin Lee via kasha)
2014-11-12 09:31:05 -08:00
53f64ee516
YARN-1964. Create Docker analog of the LinuxContainerExecutor in YARN
2014-11-11 21:28:11 -08:00
456b973819
YARN-570. Time strings are formated in different timezone. (Akira Ajisaka and Peng Zhang via kasha)
2014-11-11 13:22:59 -08:00
0fd97f9c19
YARN-2843. Fixed NodeLabelsManager to trim inputs for hosts and labels so as to make them work correctly. Contributed by Wangda Tan.
2014-11-11 12:33:10 -08:00
5c9a51f140
YARN-2841. RMProxy should retry EOFException. Contributed by Jian He
2014-11-10 18:25:01 -08:00
b31b4bf029
Fix broken download of directories
...
(cherry picked from commit 745c9a0124
2014-11-09 19:03:49 -08:00
43cd07b408
YARN-2830. Add backwords compatible ContainerId.newInstance constructor. Contributed by Jonathan Eagles.
2014-11-09 14:57:37 -08:00
9a4e0d343e
YARN-2505. Supported get/add/remove/change labels in RM REST API. Contributed by Craig Welch.
2014-11-07 20:35:46 -08:00
4cfd5bc7c1
YARN-2753. Fixed a bunch of bugs in the NodeLabelsManager classes. Contributed by Zhihai xu.
2014-11-07 14:15:53 -08:00
b76179895d
YARN-2804. Fixed Timeline service to not fill the logs with JAXB bindings exceptions. Contributed by Zhijie Shen.
2014-11-04 18:00:06 -08:00
58e9f24e0f
YARN-2788. Fixed backwards compatiblity issues with log-aggregation feature that were caused when adding log-upload-time via YARN-2703. Contributed by Xuan Gong.
2014-11-03 13:16:29 -08:00
71fbb474f5
YARN-2798. Fixed YarnClient to populate the renewer correctly for Timeline delegation tokens. Contributed by Zhijie Shen.
2014-11-03 12:49:42 -08:00
7bc179f9f5
YARN-2707. Potential null dereference in FSDownload. Contributed by Gera Shegalov
2014-10-31 22:53:04 +00:00
1b4be91866
YARN-2770. Added functionality to renew/cancel TimeLineDelegationToken. Contributed by Zhijie Shen
2014-10-31 13:16:45 -07:00
256697acd5
YARN-2186. [YARN-1492] Node Manager uploader service for cache manager. (Chris Trezzo and Sangjin Lee via kasha)
2014-10-31 13:00:42 -07:00
e0233c16eb
YARN-2698. Moved some node label APIs to be correctly placed in client protocol. Contributed by Wangda Tan.
2014-10-30 22:59:31 -07:00
ec63a3ffbd
YARN-2747. Fixed the test failure of TestAggregatedLogFormat when native I/O is enabled. Contributed by Xuan Gong.
2014-10-28 22:43:40 -07:00
a16d022ca4
YARN-2704. Changed ResourceManager to optionally obtain tokens itself for the sake of localization and log-aggregation for long-running services. Contributed by Jian He.
2014-10-27 15:49:47 -07:00
caecd9fffe
YARN-2734. Skipped sub-folders in the local log dir when aggregating logs. Contributed by Xuan Gong.
2014-10-26 12:57:31 -07:00
0186645505
YARN-2743. Fixed a bug in ResourceManager that was causing RMDelegationToken identifiers to be tampered and thus causing app submission failures in secure mode. Contributed by Jian He.
2014-10-26 11:14:34 -07:00
c51e53d7aa
YARN-2183. [YARN-1492] Cleaner service for cache manager. (Chris Trezzo and Sangjin Lee via kasha)
2014-10-25 10:31:06 -07:00
f44cf99599
YARN-2314. Disable ContainerManagementProtocolProxy cache by default to prevent creating thousands of threads in a large cluster. Contributed by Jason Lowe
2014-10-24 23:05:16 -07:00
5864dd99a4
YARN-1915. Fixed a race condition that client could use the ClientToAMToken to contact with AM before AM actually receives the ClientToAMTokenMasterKey. Contributed by Jason Lowe
2014-10-24 22:47:56 -07:00
683897fd02
YARN-2713. "RM Home" link in NM should point to one of the RMs in an HA setup. (kasha)
2014-10-24 15:00:12 -07:00
f81dc3f995
YARN-2703. Added logUploadedTime into LogValue for better display. Contributed by Xuan Gong.
2014-10-24 14:10:46 -07:00
e31f0a6558
YARN-2724. Skipped uploading a local log file to HDFS if exception is raised when opening it. Contributed by Xuan Gong.
2014-10-24 11:13:44 -07:00
0f3b6900be
YARN-2209. Replaced AM resync/shutdown command with corresponding exceptions and made related MR changes. Contributed by Jian He.
2014-10-23 21:56:03 -07:00
b2942762d7
YARN-2709. Made timeline client getDelegationToken API retry if ConnectException happens. Contributed by Li Lu.
2014-10-21 16:06:39 -07:00
171f2376d2
YARN-2717. Avoided duplicate logging when container logs are not found. Contributed by Xuan Gong.
2014-10-20 22:21:37 -07:00
e90718fa5a
YARN-2582. Fixed Log CLI and Web UI for showing aggregated logs of LRS. Contributed Xuan Gong.
2014-10-20 13:38:59 -07:00
89427419a3
YARN-2673. Made timeline client put APIs retry if ConnectException happens. Contributed by Li Lu.
2014-10-20 12:22:17 -07:00
8256766498
YARN-2504. Enhanced RM Admin CLI to support management of node-labels. Contribyted by Wangda Tan.
2014-10-18 12:07:40 -07:00
39063cd36f
YARN-2676. Enhanced Timeline auth-filter to support proxy users. Contributed by Zhijie Shen.
2014-10-17 22:02:50 -07:00
e9c66e8fd2
YARN-2705. Fixed bugs in ResourceManager node-label manager that were causing test-failures: added a dummy in-memory labels-manager. Contributed by Wangda Tan.
2014-10-17 18:26:12 -07:00
abae63caf9
YARN-2699. Fixed a bug in CommonNodeLabelsManager that caused tests to fail when using ephemeral ports on NodeIDs. Contributed by Wangda Tan.
2014-10-17 08:58:08 -07:00
b3056c266a
YARN-2685. Fixed a bug in CommonNodeLabelsManager that caused wrong resource tracking per label when a host runs multiple node-managers. Contributed by Wangda Tan.
2014-10-15 18:47:26 -07:00
0af1a2b5bc
YARN-2312. Deprecated old ContainerId#getId API and updated MapReduce to use ContainerId#getContainerId instead. Contributed by Tsuyoshi OZAWA
2014-10-15 15:22:07 -07:00
cc93e7e683
YARN-2566. DefaultContainerExecutor should pick a working directory randomly. (Zhihai Xu via kasha)
2014-10-13 16:32:01 -07:00
4aed2d8e91
YARN-2651. Spun off LogRollingInterval from LogAggregationContext. Contributed by Xuan Gong.
2014-10-13 10:54:09 -07:00
db7f165319
YARN-2494. Added NodeLabels Manager internal API and implementation. Contributed by Wangda Tan.
2014-10-10 11:44:21 -07:00
cb81bac002
YARN-2583. Modified AggregatedLogDeletionService to be able to delete rolling aggregated logs. Contributed by Xuan Gong.
2014-10-10 00:11:30 -07:00
e532ed8faa
YARN-2617. Fixed ApplicationSubmissionContext to still set resource for backward compatibility. Contributed by Wangda Tan.
2014-10-09 17:57:50 -07:00
4f426fe223
YARN-2180. [YARN-1492] In-memory backing store for cache manager. (Chris Trezzo via kasha)
2014-10-09 17:16:06 -07:00
596702a025
YARN-2544. Added admin-API objects for using node-labels. Contributed by Wangda Tan.
2014-10-09 15:46:24 -07:00
1d4612f5ad
YARN-2629. Made the distributed shell use the domain-based timeline ACLs. Contributed by Zhijie Shen.
2014-10-09 12:59:47 -07:00
180afa2f86
YARN-2493. Added user-APIs for using node-labels. Contributed by Wangda Tan.
2014-10-09 11:26:26 -07:00
6a326711aa
YARN-913 service registry: YARN-2652 add hadoop-yarn-registry package under hadoop-yarn
2014-10-08 13:02:25 -07:00
ea26cc0b4a
YARN-2615. Changed ClientToAMTokenIdentifier/RM(Timeline)DelegationTokenIdentifier to use protobuf as payload. Contributed by Junping Du
2014-10-06 10:47:43 -07:00
c8212bacb1
YARN-1051. Add a system for creating reservations of cluster capacity.
...
Contributed by Subru Krishnan and Carlo Curino.
2014-10-03 17:09:02 -07:00
5e10a13bb4
YARN-2576. Making test patch pass in branch. Contributed by Subru Krishnan and Carlo Curino.
...
(cherry picked from commit 90ac0be86b
2014-10-03 15:43:13 -07:00
c9266df404
YARN-1708. Public YARN APIs for creating/updating/deleting reservations.
...
(cherry picked from commit 3f2e3b275b
2014-10-03 15:41:39 -07:00
34cdcaad71
YARN-2468. Enhanced NodeManager to support log handling APIs (YARN-2569) for use by long running services. Contributed by Xuan Gong.
2014-10-03 12:15:40 -07:00
eb6ce5e97c
YARN-2562. Changed ContainerId#toString() to be more readable. Contributed by Tsuyoshi OZAWA
2014-10-03 11:04:02 -07:00
1c93025a1b
YARN-2527. Fixed the potential NPE in ApplicationACLsManager and added test cases for it. Contributed by Benoy Antony.
2014-10-02 14:56:13 -07:00
9e40de6af7
YARN-2446. Augmented Timeline service APIs to start taking in domains as a parameter while posting entities and events. Contributed by Zhijie Shen.
2014-10-01 17:52:03 -07:00
0708827a93
YARN-2613. Support retry in NMClient for rolling-upgrades. (Contributed by Jian He)
2014-10-01 16:50:30 -07:00
17d1202c35
YARN-2179. [YARN-1492] Initial cache manager structure and context. (Chris Trezzo via kasha)
2014-09-30 19:01:47 -07:00
feaf139b4f
YARN-2387. Resource Manager crashes with NPE due to lack of synchronization. Contributed by Mit Desai
2014-09-30 22:37:28 +00:00
f7743dd07d
YARN-2610. Hamlet should close table tags. (Ray Chiang via kasha)
2014-09-30 11:46:07 -07:00
5391919b09
YARN-668. Changed NMTokenIdentifier/AMRMTokenIdentifier/ContainerTokenIdentifier to use protobuf object as the payload. Contributed by Junping Du.
2014-09-26 17:48:41 -07:00
c86674a3a4
YARN-2581. Passed LogAggregationContext to NM via ContainerTokenIdentifier. Contributed by Xuan Gong.
2014-09-24 17:50:26 -07:00
d78b452a4f
YARN-2102. Added the concept of a Timeline Domain to handle read/write ACLs on Timeline service event data. Contributed by Zhijie Shen.
2014-09-24 11:27:53 -07:00
5338ac416a
YARN-2569. Added the log handling APIs for the long running services. Contributed by Xuan Gong.
2014-09-23 10:36:57 -07:00
376233cdd4
MAPREDUCE-5279. Made MR headroom calculation honor cpu dimension when YARN scheduler resource type is memory plus cpu. Contributed by Peng Zhang and Varun Vasudev.
2014-09-22 09:28:47 -07:00
aa1052c34b
YARN-2460. Remove obsolete entries from yarn-default.xml (Ray Chiang via aw)
2014-09-19 14:07:38 -07:00
485c96e3cb
YARN-2001. Added a time threshold for RM to wait before starting container allocations after restart/failover. Contributed by Jian He.
2014-09-18 11:03:12 -07:00
a3d9934f91
YARN-1779. Fixed AMRMClient to handle AMRMTokens correctly across ResourceManager work-preserving-restart or failover. Contributed by Jian He.
2014-09-18 10:16:18 -07:00
f4886111aa
YARN-2558. Updated ContainerTokenIdentifier#read/write to use ContainerId#getContainerId. Contributed by Tsuyoshi OZAWA.
2014-09-17 15:13:59 -07:00
9f6891d9ef
YARN-2531. Added a configuration for admins to be able to override app-configs and enforce/not-enforce strict control of per-container cpu usage. Contributed by Varun Vasudev.
2014-09-16 10:14:46 -07:00
14e2639fd0
YARN-611. Added an API to let apps specify an interval beyond which AM failures should be ignored towards counting max-attempts. Contributed by Xuan Gong.
2014-09-13 18:04:05 -07:00
3122daa802
YARN-2229. Changed the integer field of ContainerId to be long type. Contributed by Tsuyoshi OZAWA
2014-09-12 10:33:33 -07:00
6b8b1608e6
YARN-2033. Merging generic-history into the Timeline Store (Contributed by Zhijie Shen)
2014-09-12 10:04:51 +08:00
4be95175cd
YARN-2440. Enabled Nodemanagers to limit the aggregate cpu usage across all containers to a preconfigured limit. Contributed by Varun Vasudev.
2014-09-10 19:22:52 -07:00
83be3ad444
YARN-415. Capture aggregate memory allocation at the app-level for chargeback. Contributed by Eric Payne & Andrey Klochkov
2014-09-10 18:20:54 -07:00
b67d5ba784
YARN-2448. Changed ApplicationMasterProtocol to expose RM-recognized resource types to the AMs. Contributed by Varun Vasudev.
2014-09-10 10:15:47 -07:00
0974f434c4
YARN-2515. Updated ConverterUtils#toContainerId to parse epoch. Contributed by Tsuyoshi OZAWA
2014-09-07 18:29:22 -07:00
cbea1b10ef
YARN-2519. Credential Provider related unit tests failed on Windows. Contributed by Xiaoyu Yao.
2014-09-06 20:05:07 -07:00
5c14bc426b
YARN-1506. Changed RMNode/SchedulerNode to update resource with event notification. Contributed by Junping Du
2014-08-29 23:05:51 -07:00
e2d0ff364a
YARN-2182. Updated ContainerId#toString() to append RM Epoch number. Contributed by Tsuyoshi OZAWA
2014-08-27 10:02:45 -07:00
da4ba50269
HADOOP-10893. isolated classloader on the client side. Contributed by Sangjin Lee
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619604 13f79535-47bb-0310-9956-ffa450edef68
2014-08-21 21:38:16 +00:00
7e75226e68
YARN-2424. LCE should support non-cgroups, non-secure mode (Chris Douglas via aw)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619421 13f79535-47bb-0310-9956-ffa450edef68
2014-08-21 14:57:11 +00:00
55a2b550b5
YARN-2034. Description for yarn.nodemanager.localizer.cache.target-size-mb is incorrect. Contributed by Chen He
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619176 13f79535-47bb-0310-9956-ffa450edef68
2014-08-20 17:38:51 +00:00
e4539e88e3
YARN-2174. Enable HTTPs for the writer REST API of TimelineServer. Contributed by Zhijie Shen
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619160 13f79535-47bb-0310-9956-ffa450edef68
2014-08-20 17:05:07 +00:00
0350ea3c72
YARN-1918. Typo in description and error message for yarn.resourcemanager.cluster-id (Anandha L Ranganathan via aw)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618070 13f79535-47bb-0310-9956-ffa450edef68
2014-08-14 21:53:12 +00:00
0c9b8f2d7f
YARN-2373. Changed WebAppUtils to use Configuration#getPassword for accessing SSL passwords. Contributed by Larry McCay
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617555 13f79535-47bb-0310-9956-ffa450edef68
2014-08-12 18:29:42 +00:00
eeb4acd955
YARN-2212: ApplicationMaster needs to find a way to update the AMRMToken periodically. Contributed by Xuan Gong
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616892 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 21:38:24 +00:00
8437df8ba9
YARN-2008. Fixed CapacityScheduler to calculate headroom based on max available capacity instead of configured max capacity. Contributed by Craig Welch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616580 13f79535-47bb-0310-9956-ffa450edef68
2014-08-07 20:00:04 +00:00
b47f65214c
YARN-2298. Move TimelineClient to yarn-common project (Contributed by Zhijie Shen)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616100 13f79535-47bb-0310-9956-ffa450edef68
2014-08-06 05:48:32 +00:00
1141edc424
YARN-2051. Fix bug in PBimpls and add more unit tests with reflection. (Contributed by Binglin Chang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615025 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 04:16:08 +00:00
e52f67e389
YARN-1994. Expose YARN/MR endpoints on multiple interfaces. Contributed by Craig Welch, Milan Potocnik,and Arpit Agarwal
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614981 13f79535-47bb-0310-9956-ffa450edef68
2014-07-31 20:06:02 +00:00
d6532d3a77
YARN-2247. Made RM web services authenticate users via kerberos and delegation token. Contributed by Varun Vasudev.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613821 13f79535-47bb-0310-9956-ffa450edef68
2014-07-27 17:55:06 +00:00
70dededdc9
YARN-2270. Made TestFSDownload#testDownloadPublicWithStatCache be skipped when there’s no ancestor permissions. Contributed by Akira Ajisaka.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612460 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 04:58:00 +00:00
f1b831ccfb
YARN-2208. AMRMTokenManager need to have a way to roll over AMRMToken. Contributed by Xuan Gong
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611820 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 21:46:29 +00:00
40e1bb9d31
YARN-2264. Fixed a race condition in DrainDispatcher which may cause random test failures. Contributed by Li Lu
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611126 13f79535-47bb-0310-9956-ffa450edef68
2014-07-16 18:25:05 +00:00
a6cd712ca7
YARN-2228. Augmented TimelineServer to load pseudo authentication filter when authentication = simple. Contributed by Zhijie Shen.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610575 13f79535-47bb-0310-9956-ffa450edef68
2014-07-15 04:33:48 +00:00
c0439b732c
YARN-2269. Remove external links from YARN UI. Contributed by Craig Welch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609590 13f79535-47bb-0310-9956-ffa450edef68
2014-07-10 23:31:55 +00:00
50be8561a7
YARN-2088. Fixed a bug in GetApplicationsRequestPBImpl#mergeLocalToBuilder. Contributed by Binglin Chang
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609584 13f79535-47bb-0310-9956-ffa450edef68
2014-07-10 22:36:13 +00:00
4074843fea
YARN-2251. Avoid negative elapsed time in JHS/MRAM web UI and services (Contributed by Zhijie Shen)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607833 13f79535-47bb-0310-9956-ffa450edef68
2014-07-04 11:18:05 +00:00
075ff276ca
YARN-1713. Added get-new-app and submit-app functionality to RM web services. Contributed by Varun Vasudev.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607216 13f79535-47bb-0310-9956-ffa450edef68
2014-07-02 00:23:07 +00:00
f084170a0a
YARN 2163. WebUI: Order of AppId in apps table should be consistent with ApplicationId.compareTo()
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605964 13f79535-47bb-0310-9956-ffa450edef68
2014-06-27 06:43:46 +00:00
e285b98f0f
YARN-2152. Added missing information into ContainerTokenIdentifier so that NodeManagers can report the same to RM when RM restarts. Contributed Jian He.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605205 13f79535-47bb-0310-9956-ffa450edef68
2014-06-24 21:43:22 +00:00
424fd9494f
YARN-1368. Added core functionality of recovering container state into schedulers after ResourceManager Restart so as to preserve running work in the cluster. Contributed by Jian He.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601303 13f79535-47bb-0310-9956-ffa450edef68
2014-06-09 03:09:21 +00:00
790cbbf3e2
YARN-2103. Inconsistency between viaProto flag and initial value of SerializedExceptionProto.Builder (Contributed by Binglin Chang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1599115 13f79535-47bb-0310-9956-ffa450edef68
2014-06-02 08:15:30 +00:00
d599adcc6a
YARN-1868. YARN status web ui does not show correctly in IE 11. Contributed by Chuan Liu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598686 13f79535-47bb-0310-9956-ffa450edef68
2014-05-30 18:07:23 +00:00
75112e97b4
YARN-2010. Document yarn.resourcemanager.zk-auth and its scope. (Robert Kanter via kasha)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598636 13f79535-47bb-0310-9956-ffa450edef68
2014-05-30 15:32:23 +00:00
49a3a0cd0c
YARN-2054. Better defaults for YARN ZK configs for retries and retry-inteval when HA is enabled. (kasha)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598630 13f79535-47bb-0310-9956-ffa450edef68
2014-05-30 15:24:49 +00:00
cd24e955cf
YARN-2112. Fixed yarn-common's pom.xml to include jackson dependencies so that both Timeline Server and client can access them. Contributed by Zhijie Shen.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598373 13f79535-47bb-0310-9956-ffa450edef68
2014-05-29 19:06:36 +00:00
001078e067
YARN-2107. Refactored timeline classes into o.a.h.y.s.timeline package. Contributed by Vinod Kumar Vavilapalli.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598094 13f79535-47bb-0310-9956-ffa450edef68
2014-05-28 18:09:04 +00:00
af8b09af75
YARN-1936. Added security support for the Timeline Client. Contributed by Zhijie Shen.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597153 13f79535-47bb-0310-9956-ffa450edef68
2014-05-23 18:47:57 +00:00
b867b69556
YARN-2049. Added delegation-token support for the Timeline Server. Contributed by Zhijie Shen.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597130 13f79535-47bb-0310-9956-ffa450edef68
2014-05-23 17:09:47 +00:00
fdb5870d49
YARN-1938. Added kerberos login for the Timeline Server. Contributed by Zhijie Shen.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596710 13f79535-47bb-0310-9956-ffa450edef68
2014-05-21 23:20:08 +00:00
64ec743e6c
YARN-2050. Fix LogCLIHelpers to create the correct FileContext. Contributed by Ming Ma
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596310 13f79535-47bb-0310-9956-ffa450edef68
2014-05-20 16:19:55 +00:00
461ded8bd4
YARN-2066. Wrong field is referenced in GetApplicationsRequestPBImpl#mergeLocalToBuilder (Contributed by Hong Zhiguo)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595413 13f79535-47bb-0310-9956-ffa450edef68
2014-05-17 01:43:15 +00:00
b0e80d1a47
MAPREDUCE-5814. fat jar with *-default.xml may fail when mapreduce.job.classloader=true. Contributed by Gera Shegalov
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594326 13f79535-47bb-0310-9956-ffa450edef68
2014-05-13 18:55:05 +00:00
4f6493bcf9
YARN-2016. Fix a bug in GetApplicationsRequestPBImpl to add the missed fields to proto. Contributed by Junping Du
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594085 13f79535-47bb-0310-9956-ffa450edef68
2014-05-12 20:45:21 +00:00
58c81d56e9
YARN-1962. Changed Timeline Service client configuration to be off by default given the non-readiness of the feature yet. Contributed by Mohammad Kamrul Islam.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593750 13f79535-47bb-0310-9956-ffa450edef68
2014-05-11 00:15:12 +00:00
0c437e90b8
YARN-1701. Improved default paths of the timeline store and the generic history store. Contributed by Tsuyoshi Ozawa.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593481 13f79535-47bb-0310-9956-ffa450edef68
2014-05-09 04:23:27 +00:00
d777cb8996
HADOOP-10563. Remove the dependency of jsp in trunk. Contributed by Haohui Mai.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592069 13f79535-47bb-0310-9956-ffa450edef68
2014-05-02 22:26:02 +00:00
faffedeb24
YARN-483. Improve documentation on log aggregation in yarn-default.xml (Akira Ajisaka via Sandy Ryza)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1590150 13f79535-47bb-0310-9956-ffa450edef68
2014-04-25 21:14:03 +00:00
d667df4ed0
YARN-1932. Javascript injection on the job status page. Contributed by Mit Desai
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1588572 13f79535-47bb-0310-9956-ffa450edef68
2014-04-18 21:41:37 +00:00
36ed8c74ea
YARN-1870. FileInputStream is not closed in ProcfsBasedProcessTree#constructProcessSMAPInfo. (Fengdong Yu via junping_du)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1588324 13f79535-47bb-0310-9956-ffa450edef68
2014-04-17 18:05:43 +00:00
ad9edb02b9
YARN-1931. Private API change in YARN-1824 in 2.4 broke compatibility with previous releases (Sandy Ryza via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1588281 13f79535-47bb-0310-9956-ffa450edef68
2014-04-17 15:23:22 +00:00
cde7b17566
YARN-1914. Fixed resource-download on NodeManagers to skip permission verification of public cache files in Windows+local file-system environment. Contribued by Varun Vasudev.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586434 13f79535-47bb-0310-9956-ffa450edef68
2014-04-10 19:28:31 +00:00
b8f250a99d
HADOOP-10104. Update jackson to 1.9.13 (Akira Ajisaka via stevel)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1585932 13f79535-47bb-0310-9956-ffa450edef68
2014-04-09 11:11:20 +00:00
245012a9d9
YARN-1757. NM Recovery. Auxiliary service support. (Jason Lowe via kasha)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1585783 13f79535-47bb-0310-9956-ffa450edef68
2014-04-08 17:15:58 +00:00
4eacde67f8
YARN-1905. TestProcfsBasedProcessTree must only run on Linux. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1585376 13f79535-47bb-0310-9956-ffa450edef68
2014-04-07 03:04:09 +00:00
dce1d20383
YARN-1452. Added documentation about the configuration and usage of generic application history and the timeline data service. Contributed by Zhijie Shen.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581656 13f79535-47bb-0310-9956-ffa450edef68
2014-03-26 02:52:58 +00:00
09f383254c
YARN-1850. Introduced the ability to optionally disable sending out timeline-events in the TimelineClient. Contributed by Zhijie Shen.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581189 13f79535-47bb-0310-9956-ffa450edef68
2014-03-25 02:22:39 +00:00
2d89dcb121
YARN-1670. aggregated log writer can write more log data then it says is the log length (Mit Desai via jeagles)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1580957 13f79535-47bb-0310-9956-ffa450edef68
2014-03-24 18:11:48 +00:00
06579878df
YARN-1775. Enhanced ProcfsBasedProcessTree to optionally add the ability to use smaps for obtaining used memory information. Contributed by Rajesh Balamohan.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1580087 13f79535-47bb-0310-9956-ffa450edef68
2014-03-22 00:01:59 +00:00
2826a35469
YARN-1670. Fixed a bug in log-aggregation that can cause the writer to write more log-data than the log-length that it records. Contributed by Mit Desai.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1580005 13f79535-47bb-0310-9956-ffa450edef68
2014-03-21 18:35:54 +00:00
4224e61340
YARN-1811. Fixed AMFilters in YARN to correctly accept requests from either web-app proxy or the RMs when HA is enabled. Contributed by Robert Kanter.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579877 13f79535-47bb-0310-9956-ffa450edef68
2014-03-21 04:20:46 +00:00
81a456e638
YARN-1591. Fixed AsyncDispatcher to handle interrupts on shutdown in a sane manner and thus fix failure of TestResourceTrackerService. Contributed by Tsuyoshi Ozawa.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1578628 13f79535-47bb-0310-9956-ffa450edef68
2014-03-17 22:17:43 +00:00
8314674947
YARN-1685. Fixed few bugs related to handling of containers' log-URLs on ResourceManager and history-service. Contributed by Zhijie Shen.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1578602 13f79535-47bb-0310-9956-ffa450edef68
2014-03-17 21:36:21 +00:00
7944eab64a
YARN-1136. Replace junit.framework.Assert with org.junit.Assert (Chen He via jeagles)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1578539 13f79535-47bb-0310-9956-ffa450edef68
2014-03-17 20:03:35 +00:00
1190f19ddd
YARN-1845. Elapsed time for failed tasks that never started is wrong (Rushabh S Shah via jeagles)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1578459 13f79535-47bb-0310-9956-ffa450edef68
2014-03-17 16:53:17 +00:00
f8e439105c
YARN-1845. Elapsed time for failed tasks that never started is wrong (Rushabh S Shah via jeagles)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1578457 13f79535-47bb-0310-9956-ffa450edef68
2014-03-17 16:50:56 +00:00
96e0ca2d27
YARN-1824. Improved NodeManager and clients to be able to handle cross platform application submissions. Contributed by Jian He.
...
MAPREDUCE-4052. Improved MapReduce clients to use NodeManagers' ability to handle cross platform application submissions. Contributed by Jian He.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1578135 13f79535-47bb-0310-9956-ffa450edef68
2014-03-16 18:32:05 +00:00
b3ea4aebff
YARN-1717. Enabled periodically discarding old data in LeveldbTimelineStore. Contributed by Billie Rinaldi.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577693 13f79535-47bb-0310-9956-ffa450edef68
2014-03-14 20:35:00 +00:00
d9cdcb9474
YARN-1658. Modified web-app framework to let standby RMs redirect web-service calls to the active RM. Contributed by Cindy Li.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577408 13f79535-47bb-0310-9956-ffa450edef68
2014-03-14 02:39:59 +00:00
53790d3300
YARN-1771. Reduce the number of NameNode operations during localization of
...
public resources using a cache. Contributed by Sangjin Lee
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577391 13f79535-47bb-0310-9956-ffa450edef68
2014-03-14 00:30:35 +00:00
6af044bb75
YARN-1389. Made ApplicationClientProtocol and ApplicationHistoryProtocol expose analogous getApplication(s)/Attempt(s)/Container(s) APIs. Contributed by Mayank Bansal.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577052 13f79535-47bb-0310-9956-ffa450edef68
2014-03-13 07:42:29 +00:00
0b1304d098
YARN-1781. Modified NodeManagers to allow admins to specify max disk utilization for local disks so as to be able to offline full disks. Contributed by Varun Vasudev.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575463 13f79535-47bb-0310-9956-ffa450edef68
2014-03-08 00:52:06 +00:00
9b15c5b11a
YARN-1525. Web UI should redirect to active RM when HA is enabled. (Cindy Li via kasha)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575166 13f79535-47bb-0310-9956-ffa450edef68
2014-03-07 04:34:16 +00:00
ad61eec072
HADOOP-10386. Log proxy hostname in various exceptions being thrown in a HA setup. Contributed by Haohui Mai.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1574716 13f79535-47bb-0310-9956-ffa450edef68
2014-03-05 23:09:47 +00:00
88245b6a41
YARN-986. Changed client side to be able to figure out the right RM Delegation token for the right ResourceManager when HA is enabled. Contributed by Karthik Kambatla.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1574190 13f79535-47bb-0310-9956-ffa450edef68
2014-03-04 20:39:06 +00:00
a60434368c
YARN-1758. Fixed ResourceManager to not mandate the presence of site specific configuration files and thus fix failures in downstream tests. Contributed by Xuan Gong.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1573695 13f79535-47bb-0310-9956-ffa450edef68
2014-03-03 19:41:52 +00:00
94b29b3348
MAPREDUCE-5770. Fixed MapReduce ApplicationMaster to correctly redirect to the YARN's web-app proxy with the correct scheme prefix. Contributed by Jian He.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1572711 13f79535-47bb-0310-9956-ffa450edef68
2014-02-27 19:23:55 +00:00
0fbc7fe816
YARN-1588. Enhanced RM and the scheduling protocol to also send NMTokens of transferred containers from previous app-attempts to new AMs after YARN-1490. Contributed by Jian He.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1572230 13f79535-47bb-0310-9956-ffa450edef68
2014-02-26 20:20:07 +00:00
e167e585e9
YARN-1749. Updated application-history related configs to reflect the latest reality and to be consistently named. Contributed by Zhijie Shen.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1570948 13f79535-47bb-0310-9956-ffa450edef68
2014-02-23 02:04:58 +00:00
84425fb435
YARN-1687. Renamed user-facing records for the timeline-service to be simply named after 'timeline' instead of 'apptimeline'. Contributed by Zhijie Shen.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1570922 13f79535-47bb-0310-9956-ffa450edef68
2014-02-22 20:55:06 +00:00
9da9f7d4d8
YARN-1666. Modified RM HA handling of include/exclude node-lists to be available across RM failover by making using of a remote configuration-provider. Contributed by Xuan Gong.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1569856 13f79535-47bb-0310-9956-ffa450edef68
2014-02-19 17:52:57 +00:00
990cffdcfa
YARN-1553. Modified YARN and MR to stop using HttpConfig.isSecure() and
...
instead rely on the http policy framework. And also fix some bugs related
to https handling in YARN web-apps. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1568501 13f79535-47bb-0310-9956-ffa450edef68
2014-02-14 20:01:02 +00:00
3587b6774c
YARN-1706. Created an utility method to dump timeline records to JSON strings. Contributed by Zhijie Shen.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1566982 13f79535-47bb-0310-9956-ffa450edef68
2014-02-11 04:39:37 +00:00
1fa6ab249b
YARN-1459. Changed ResourceManager to depend its service initialization on the configuration-provider mechanism during startup too. Contributed by Xuan Gong.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1566791 13f79535-47bb-0310-9956-ffa450edef68
2014-02-10 22:50:15 +00:00
23b2e43f5d
YARN-1635. Implemented a Leveldb based ApplicationTimelineStore. Contributed by Billie Rinaldi.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1565868 13f79535-47bb-0310-9956-ffa450edef68
2014-02-08 02:15:46 +00:00
8b2336fcef
YARN-1660. Simplified the RM HA configuration to accept and be able to simply depend just on
...
configuration properties of the form yarn.resourcemanager.hostname.RMID and use the default
ports for all service addresses. Contributed by Xuan Gong.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1565523 13f79535-47bb-0310-9956-ffa450edef68
2014-02-07 03:18:39 +00:00
30294a2196
YARN-1665. Simplify the configuration of RM HA by having better default values. Contributed by Xuan Gong.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1565517 13f79535-47bb-0310-9956-ffa450edef68
2014-02-07 02:39:32 +00:00
484faadffe
YARN-1636. Augmented Application-history server's web-services to also expose new APIs for retrieving and storing timeline information. Contributed by Zhijie Shen.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1564829 13f79535-47bb-0310-9956-ffa450edef68
2014-02-05 17:02:26 +00:00
ebe0c17a95
YARN-1461. Added tags for YARN applications and changed RM to handle them. Contributed by Karthik Kambatla.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1564633 13f79535-47bb-0310-9956-ffa450edef68
2014-02-05 04:55:00 +00:00
39ecc46ff6
YARN-1285. Changed the default value of yarn.acl.enable in yarn-default.xml to be consistent with what exists (false) in the code and documentation. Contributed by Kenji Kikushima.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1564190 13f79535-47bb-0310-9956-ffa450edef68
2014-02-04 04:21:40 +00:00
eac066b13f
YARN-1659. Defined the ApplicationTimelineStore store as an abstraction for implementing different storage impls for storing timeline information. Contributed by Billie Rinaldi.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1564037 13f79535-47bb-0310-9956-ffa450edef68
2014-02-03 20:07:01 +00:00
Robert Kanter
Arun Suresh
Akira Ajisaka
Steve Loughran
Sunil G
Jian He
Jason Lowe
Daniel Templeton
Naganarasimha
Rohith Sharma K S
Mingliang Liu
Wangda Tan
Eric Payne
Andrew Wang
Varun Saxena
Li Lu
Karthik Kambatla
Xiao Chen
Subru Krishnan
Xuan
Chris Douglas
Varun Vasudev
Ray Chiang
Subru Krishnan
Junping Du
Vinod Kumar Vavilapalli
Sangjin Lee
Naganarasimha
Vrushali
Zhijie Shen
Tsuyoshi Ozawa
Ming Ma
Carlo Curino
Karthik Kambatla
Siddharth Seth
Zhe Zhang
Devaraj K
Gera Shegalov
cnauroth
Jonathan Eagles
Harsh J
Vinayakumar B
Thomas Graves
Jonathan Eagles
Kihwal Lee
Ravi Prakash
Arun C. Murthy
subru
Allen Wittenauer
Jian He
Haohui Mai
Sanford Ryza
Jonathan Turner Eagles