9ccf935b2c
YARN-5309. Fix SSLFactory truststore reloader thread leak in TimelineClientImpl. Contributed by Weiwei Yang.
2016-07-20 12:48:32 +05:30
dc2f4b6ac8
YARN-5213. Fix a bug in LogCLIHelpers which cause TestLogsCLI#testFetchApplictionLogs fails intermittently. Contributed by Xuan Gong.
2016-07-19 07:17:58 -07:00
da456ffd62
Preparing for 3.0.0-alpha2 development
2016-07-15 19:04:17 -07:00
7e5355c14e
YARN-5339. Passing file to -out for YARN log CLI doesnt give warning or error code. Contributed by Xuan Gong.
2016-07-15 09:23:11 -07:00
eb47163234
YARN-5200. Enhanced "yarn logs" to be able to get a list of containers whose logs are aggregated via a "show_container_log_info" option. Contributed by Xuan Gong.
2016-07-13 10:54:15 -07:00
bf6f4a3b98
YARN-4366. Fix Lint Warnings in YARN Common (templedf via rkanter)
2016-07-12 15:12:25 -07:00
819224dcf9
YARN-5270. Solve miscellaneous issues caused by YARN-4844. Contributed by Wangda Tan
2016-07-11 22:36:20 -07:00
6cf6ab7b78
Made a number of miscellaneous fixes for javac, javadoc, and checstyle warnings.
2016-07-10 08:46:05 -07:00
1ff6833bba
YARN-5243. fix several rebase and other miscellaneous issues before merge. (Sangjin Lee via Varun Saxena)
2016-07-10 08:46:03 -07:00
0a9b085f05
YARN-5189. Make HBaseTimeline[Reader|Writer]Impl default and move FileSystemTimeline*Impl. (Joep Rottinghuis and Sangjin Lee via gtcarrera9)
2016-07-10 08:46:01 -07:00
c2055a97d5
YARN-3150. Documenting the timeline service v2. (Sangjin Lee and Vrushali C via gtcarrera9)
2016-07-10 08:45:57 -07:00
39cce4e629
YARN-3816. [Aggregation] App-level aggregation and accumulation for YARN system metrics (Li Lu via sjlee)
2016-07-10 08:45:56 -07:00
a3cf40e532
YARN-3461. Consolidate flow name/version/run defaults. (Sangjin Lee via Varun Saxena)
2016-07-10 08:45:55 -07:00
84c35ac6c4
YARN-4711. NM is going down with NPE's due to single thread processing of events by Timeline client (Naganarasimha G R via sjlee)
2016-07-10 08:45:55 -07:00
9bdd455dce
YARN-4062. Add the flush and compaction functionality via coprocessors and scanners for flow run table (Vrushali C via sjlee)
2016-07-10 08:45:54 -07:00
0d02ab8729
YARN-3367. Replace starting a separate thread for post entity with event loop in TimelineClient (Naganarasimha G R via sjlee)
2016-07-10 08:45:53 -07:00
960af7d471
YARN-4409. Fix javadoc and checkstyle issues in timelineservice code (Varun Saxena via sjlee)
2016-07-10 08:45:53 -07:00
6934b05c71
YARN-4238. createdTime and modifiedTime is not reported while publishing entities to ATSv2. (Varun Saxena via Naganarasimha G R)
2016-07-10 08:45:52 -07:00
f5380d850e
YARN-4622. TestDistributedShell fails for v2 test cases after modifications for 1.5. (Naganarasimha G R via Varun Saxena)
2016-07-10 08:45:51 -07:00
34f02f07d5
Rebase to latest trunk
2016-07-10 08:45:51 -07:00
cc16683cef
YARN-3995. Some of the NM events are not getting published due race condition when AM container finishes in NM (Naganarasimha G R via sjlee)
2016-07-10 08:45:50 -07:00
8ef546c1ee
YARN-4445. Unify the term flowId and flowName in timeline v2 codebase.
...
Contributed by Zhan Zhang.
2016-07-10 08:45:49 -07:00
2e2dbf59d1
YARN-4392. ApplicationCreatedEvent event time resets after RM
...
restart/failover. Contributed by Naganarasimha G R and Xuan Gong
(cherry picked from commit 4546c7582b
2016-07-10 08:45:49 -07:00
b7d484aead
YARN-4450. TestTimelineAuthenticationFilter and
...
TestYarnConfigurationFields fail. Contributed by Sangjin Lee.
2016-07-10 08:45:49 -07:00
89e5c44f9e
YARN-4356. Ensure the timeline service v.2 is disabled cleanly and has no
...
impact when it's turned off. Contributed by Sangjin Lee.
2016-07-10 08:45:48 -07:00
cf4666bb8c
YARN-3623. Add a config to indicate the Timeline Service version. Contributed by Xuan Gong.
...
(cherry picked from commit f910e4f639
2016-07-10 08:45:48 -07:00
10fa6da7d8
YARN-4074. [timeline reader] implement support for querying for flows and flow runs (sjlee via vrushali)
2016-07-10 08:45:44 -07:00
8603736ef2
YARN-3949. Ensure timely flush of timeline writes. Contributed by Sangjin Lee.
...
(cherry picked from commit 967bef7e0396d857913caa2574afb103a5f0b81b)
2016-07-10 08:45:39 -07:00
57d8dc2fb7
YARN-3836. add equals and hashCode to TimelineEntity and other classes in the data model (Li Lu via sjlee)
...
(cherry picked from commit 2d4a8f4563c06339717ca9410b2794754603fba3)
2016-07-10 08:45:39 -07:00
e27642abf4
YARN-3047. [Data Serving] Set up ATS reader with basic request serving structure and lifecycle (Varun Saxena via sjlee)
...
(cherry picked from commit 4c5f88fb0f04b7919738d07598b0f006a9ff91f2)
2016-07-10 08:45:39 -07:00
22e7ae5771
YARN-3792. Test case failures in TestDistributedShell and some issue fixes related to ATSV2 (Naganarasimha G R via sjlee)
...
(cherry picked from commit 84f37f1c7eefec6d139cbf091c50d6c06f734323)
2016-07-10 08:45:38 -07:00
42d7864b84
YARN-3276. Code cleanup for timeline service API records. Contributed by Junping Du.
...
(cherry picked from commit d88f30ba5359f59fb71b93a55e1c1d9a1c0dff8e)
2016-07-10 08:45:37 -07:00
fc8485d893
YARN-3551. Consolidate data model change according to the backend implementation (Zhijie Shen via sale)
...
(cherry picked from commit 557a3950bddc837469244835f5577899080115d8)
2016-07-10 08:45:35 -07:00
2bdefbc4a0
YARN-3431. Sub resources of timeline entity needs to be passed to a separate endpoint. Contributed By Zhijie Shen.
...
(cherry picked from commit fa5cc75245a6dba549620a8b26c7b4a8aed9838e)
2016-07-10 08:45:34 -07:00
47f35a30bb
YARN-3391. Clearly define flow ID/ flow run / flow version in API and storage. Contributed by Zhijie Shen
...
(cherry picked from commit 68c6232f8423e55b4d152ef3d1d66aeb2d6a555e)
2016-07-10 08:45:33 -07:00
5712b8f9fd
YARN-3334. NM uses timeline client to publish container metrics to new timeline service. Contributed by Junping Du.
2016-07-10 08:45:33 -07:00
d67c9bdb4d
YARN-3040. Make putEntities operation be aware of the app's context. Contributed by Zhijie Shen
2016-07-10 08:45:32 -07:00
5e3d9a477b
YARN-3034. Implement RM starting its timeline collector. Contributed by Naganarasimha G R
2016-07-10 08:45:32 -07:00
2188a07e5b
YARN-3333. Rename TimelineAggregator etc. to TimelineCollector. Contributed by Sangjin Lee
2016-07-10 08:45:31 -07:00
9b56364080
YARN-3039. Implemented the app-level timeline aggregator discovery service. Contributed by Junping Du.
2016-07-10 08:45:31 -07:00
309592b9e5
YARN-3240. Added ".keep" file which was missed before.
...
(cherry picked from commit 6b4dc96414b3f15537670c67a0dccd048862f4f4)
2016-07-10 08:45:29 -07:00
4f0c7eaff3
YARN-3240. Implement client API to put generic entities. Contributed by Zhijie Shen
...
(cherry picked from commit 4487da249f448d5c67b712cd0aa723e764eed77d)
2016-07-10 08:45:29 -07:00
c77f86bf63
YARN-3041. Added the overall data model of timeline service next gen. Contributed by Zhijie Shen.
...
(cherry picked from commit fdff5d2625c129c20c44f90a0517b28cee1522bd)
2016-07-10 08:45:29 -07:00
8a9d293dd6
YARN-5233. Support for specifying a path for ATS plugin jars. Contributed by Li Lu
2016-07-06 16:44:46 -07:00
04f6ebb66a
YARN-5294. Pass remote ip address down to YarnAuthorizationProvider. (Jian He via wangda)
2016-07-06 10:36:48 -07:00
6ab5aa1c1f
YARN-5266. Wrong exit code while trying to get app logs using regex via CLI. Contributed by Xuan Gong
2016-06-22 21:48:49 -07:00
99e5dd68d0
YARN-5171. Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node. (Inigo Goiri via asuresh)
2016-06-22 19:04:54 -07:00
5d58858bb6
HADOOP-9613. [JDK8] Update jersey version to latest 1.x release.
2016-06-21 08:05:32 +09:00
d0162f2040
YARN-5246. NMWebAppFilter web redirects drop query parameters. Contributed by Varun Vasudev.
2016-06-19 17:44:54 -07:00
c35fa4a0e5
YARN-5251. Yarn CLI to obtain App logs for last 'n' bytes fails. Contributed by Xuan Gong.
2016-06-17 08:24:24 -07:00
5dfc38ff57
YARN-5237. Fix missing log files issue in rolling log aggregation. Contributed by Xuan Gong.
2016-06-15 16:17:54 -07:00
25064fb2fb
YARN-5223. Container line in yarn logs output for a live application should include the hostname for the container. Contributed by Xuan Gong.
2016-06-15 12:42:44 +05:30
c77a1095dc
YARN-1942. Deprecate toString/fromString methods from ConverterUtils and move them to records classes like ContainerId/ApplicationId, etc. (wangda)
2016-06-14 15:06:38 -07:00
eec835ec17
YARN-4887. Add allocation request ID to AM-RM protocol for identifying resource-requests explicitly. (Subru Krishnan via wangda)
2016-06-13 21:57:33 -07:00
5143277958
YARN-5124. Modify AMRMClient to set the ExecutionType in the ResourceRequest. (asuresh)
2016-06-12 09:42:38 -07:00
03fc6b1bb0
YARN-3426. Add jdiff support to YARN. (vinodkv via wangda)
2016-06-10 09:51:09 -07:00
9378d9428f
YARN-5191. Renamed the newly added “download=true” option for getting logs via NMWebServices and AHSWebServices to be a better "format" option. (Xuan Gong via vinodkv)
2016-06-09 12:30:58 -07:00
1500a0a300
YARN-4308. ContainersAggregated CPU resource utilization reports negative usage in first few heartbeats. Contributed by Sunil G
2016-06-09 05:41:09 +05:30
620325e816
YARN-4837. User facing aspects of 'AM blacklisting' feature need fixing. (vinodkv via wangda)
2016-06-07 15:06:42 -07:00
4a1cedc010
MAPREDUCE-5044. Have AM trigger jstack on task attempts that timeout before killing them. (Eric Payne and Gera Shegalov via mingma)
2016-06-06 14:30:51 -07:00
dc26601d8f
YARN-5180. Allow ResourceRequest to specify an enforceExecutionType flag. (asuresh)
2016-06-02 09:01:02 -07:00
0bc05e40fa
YARN-5088. Improve "yarn log" command-line to read the last K bytes for the log files. Contributed by Xuan Gong
2016-06-01 13:44:21 -07:00
86fb58b7dc
YARN-4007. Add support for different network setups when launching the docker container. Contributed by Sidharta Seethana.
2016-05-29 21:32:51 +05:30
42f90ab885
YARN-4844. Add getMemorySize/getVirtualCoresSize to o.a.h.y.api.records.Resource. Contributed by Wangda Tan.
2016-05-29 21:24:16 +05:30
aa975bc781
YARN-5127. Expose ExecutionType in Container api record. (Hitesh Sharma via asuresh)
2016-05-27 14:06:32 -07:00
bde819abbb
YARN-5089. Improve "yarn log" command-line "logFiles" option to support
...
regex. Contributed by Xuan Gong
2016-05-26 23:49:20 -07:00
0a544f8a3e
YARN-5005. TestRMWebServices#testDumpingSchedulerLogs fails randomly. Contributed by Bibin A Chundatt.
2016-05-27 10:44:35 +05:30
5b41b288d0
YARN-5162. Fix Exceptions thrown during in registerAM call when Distributed Scheduling is Enabled (Hitesh Sharma via asuresh)
2016-05-26 14:56:37 -07:00
013532a95e
YARN-4957. Add getNewReservation in ApplicationClientProtocol (Sean Po via curino)
2016-05-25 16:55:49 -07:00
77d5ce9069
YARN-3344. Fix warning - procfs stat file is not in the expected format. (Ravindra Kumar Naik and Akira Ajisaka via kasha)
2016-05-25 10:50:54 -07:00
e07519b8db
YARN-4766. NM should not aggregate logs older than the retention policy (haibochen via rkanter)
2016-05-25 10:25:44 -07:00
b4078bd17b
YARN-3971. Skip RMNodeLabelsManager#checkRemoveFromClusterNodeLabelsOfQueue on nodelabel recovery. (addendum patch). Contributed by Bibin A chundatt
2016-05-24 08:06:53 +08:00
0287c49107
YARN-5016. Add support for a minimum retry interval for container retries. Contributed by Jun Gong.
2016-05-20 12:28:14 +05:30
22fcd819f0
YARN-5076. YARN web interfaces lack XFS protection. Contributed by Jonathan Maron.
...
(cherry picked from commit 2703ec6871
2016-05-19 14:15:21 -07:00
ef1757790d
YARN-4913. Yarn logs should take a -out option to write to a directory. Contributed by Xuan Gong.
2016-05-18 22:44:33 +05:30
3c5c57af28
HADOOP-13142. Change project version from 3.0.0 to 3.0.0-alpha1.
2016-05-12 18:27:28 -07:00
ca5613af91
Revert "Update project version to 3.0.0-alpha1-SNAPSHOT."
...
This reverts commit 6b53802cba
2016-05-12 15:32:45 -07:00
6b53802cba
Update project version to 3.0.0-alpha1-SNAPSHOT.
2016-05-12 11:05:05 -07:00
87f5e35133
YARN-4842. Fixed "yarn logs" command to guess (and thus not require) the appOwner argument when viewing another user's logs. Contributed by Ram Venkatesh and Xuan Gong.
2016-05-09 22:41:18 -07:00
d0da13229c
YARN-4311. Removing nodes from include and exclude lists will not remove them from decommissioned nodes list. Contributed by Kuhu Shukla
2016-05-05 14:07:54 +00:00
9e37fe3b7a
YARN-4905. Improved "yarn logs" command-line to optionally show log metadata also. Contributed by Xuan Gong.
2016-05-04 14:16:03 -07:00
c6b4839168
YARN-4834. ProcfsBasedProcessTree doesn't track daemonized processes. Contributed by Nathan Roberts
2016-05-03 17:27:28 +00:00
0f25a1bb52
YARN-3998. Add support in the NodeManager to re-launch containers. Contributed by Jun Gong.
2016-04-29 16:09:07 +05:30
4a8508501b
YARN-5009. NMLeveldbStateStoreService database can grow substantially leading to longer recovery times. Contributed by Jason Lowe
2016-04-28 21:54:11 -07:00
dd80042c42
YARN-5008. LeveldbRMStateStore database can grow substantially leading to long recovery times. Contributed by Jason Lowe
2016-04-28 21:27:25 -07:00
66b07d8374
YARN-4966. Improve yarn logs to fetch container logs without specifying nodeId. Contributed by Xuan Gong.
2016-04-27 15:56:36 +05:30
341888a0aa
YARN-4412. Create ClusterMonitor to compute ordered list of preferred NMs for OPPORTUNITIC containers. (asuresh)
2016-04-26 20:12:12 -07:00
c282a08f38
YARN-2885. Create AMRMProxy request interceptor and ContainerAllocator to distribute OPPORTUNISTIC containers to appropriate Nodes (asuresh)
...
(cherry picked from commit 2bf025278a318b0452fdc9ece4427b4c42124e39)
2016-04-24 22:38:33 -07:00
b2a654c5ee
YARN-4335. Allow ResourceRequests to specify ExecutionType of a request ask (kkaranasos via asuresh)
...
(cherry picked from commit 8ffabfdf4f
2016-04-22 23:20:54 -07:00
95a5046607
YARN-4976. Missing NullPointer check in ContainerLaunchContextPBImpl. Contributed by Giovanni Matteo Fumarola
2016-04-21 10:45:38 -07:00
c8172f5f14
YARN-2883. Queuing of container requests in the NM. (Konstantinos Karanasos and Arun Suresh via kasha)
2016-04-20 09:55:50 -07:00
477003730e
Fixed TimelineClient to retry SocketTimeoutException too. Contributed by Xuan Gong.
2016-04-18 11:47:06 -07:00
e6c0742012
YARN-4965. Distributed shell AM failed due to ClientHandlerException thrown by jersey. Contributed by Junping Du
2016-04-16 19:39:18 -07:00
fdbafbc9e5
YARN-4909. Fix intermittent failures of TestRMWebServices And TestRMWithCSRFFilter. Contributed by Bibin A Chundatt
2016-04-15 23:37:05 +05:30
4ee7f0a3e7
YARN-4897. dataTables_wrapper change min height. Contributed by Bibin A Chundatt.
2016-04-12 10:25:56 +05:30
2a5da97f81
Revert "YARN-4311. Removing nodes from include and exclude lists will not remove them from decommissioned nodes list. Contributed by Kuhu Shukla"
...
This reverts commit 1cbcd4a491
2016-04-11 15:51:01 +00:00
1ff27f9d12
YARN-4630. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta.
2016-04-11 14:55:03 +09:00
07920acc16
YARN-4562. YARN WebApp ignores the configuration passed to it for keystore settings. Contributed by Sergey Shelukhin.
2016-04-11 09:39:57 +05:30
1cbcd4a491
YARN-4311. Removing nodes from include and exclude lists will not remove them from decommissioned nodes list. Contributed by Kuhu Shukla
2016-04-05 13:40:19 +00:00
5092c94195
YARN-4746. yarn web services should convert parse failures of appId, appAttemptId and containerId to 400. Contributed by Bibin A Chundatt
2016-04-04 16:25:03 +05:30
81d04cae41
YARN-4657. Javadoc comment is broken for Resources.multiplyByAndAddTo(). (Daniel Templeton via kasha)
2016-04-01 16:20:00 -07:00
5686caa9fc
Missing file for YARN-4895.
2016-04-01 15:58:13 -07:00
3488c4f2c9
Revert "YARN-4857. Add missing default configuration regarding preemption of CapacityScheduler. Contributed by Kai Sasaki."
...
This reverts commit 0064cba169
2016-04-01 12:20:40 +05:30
6d67420dbc
YARN-4183. Clarify the behavior of timeline service config properties (Naganarasimha G R via sjlee)
2016-03-31 10:49:03 -07:00
0064cba169
YARN-4857. Add missing default configuration regarding preemption of CapacityScheduler. Contributed by Kai Sasaki.
2016-03-31 14:05:49 +05:30
e8fc81f9c8
YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. Contributed by Xuan Gong
2016-03-25 20:15:49 +00:00
af1d125f9c
YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. Contributed by Xuan Gong.
2016-03-23 08:57:16 -07:00
7fae4c68e6
YARN-4732. *ProcessTree classes have too many whitespace issues
2016-03-20 10:47:38 -07:00
a888b5bc53
Revert "YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. (Xuan Gong via gtcarrera9)"
...
This reverts commit 3a0b695441
2016-03-15 22:10:39 -07:00
5176a69868
YARN-4817. Change Log Level to DEBUG for putDomain call in ATS 1.5. (Xuan Gong via gtcarrera9)
2016-03-15 11:47:39 -07:00
3a0b695441
YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. (Xuan Gong via gtcarrera9)
2016-03-15 11:40:54 -07:00
eba66a64d2
YARN-4816. Fix incompatible change in SystemClock.
2016-03-14 20:14:33 -07:00
f291d82cd4
YARN-4545. Allow YARN distributed shell to use ATS v1.5 APIs. Li Lu via junping_du
2016-03-14 08:28:38 -07:00
d49cfb3504
YARN-4696. Improving EntityGroupFSTimelineStore on exception handling, test setup, and concurrency. (Steve Loughran via gtcarrera9)
2016-03-10 10:51:55 -08:00
e51a8c1056
YARN-4737. Add CSRF filter support in YARN. Contributed by Jonathan Maron.
2016-03-07 15:26:44 +05:30
d7fdec1e6b
YARN-4579. Allow DefaultContainerExecutor container log directory permissions to be configurable (rchiang via rkanter)
2016-02-25 16:36:38 -08:00
c4d4df8de0
YARN-4701. When task logs are not available, port 8041 is referenced instead of port 8042 (haibochen via rkanter)
2016-02-25 12:48:02 -08:00
954dd57043
YARN-4697. NM aggregation thread pool is not bound by limits (haibochen via rkanter)
2016-02-24 15:00:24 -08:00
9e0f7b8b69
YARN-4680. TimerTasks leak in ATS V1.5 Writer. (Xuan Gong via
...
gtcarrera9)
2016-02-24 13:43:09 -08:00
553b591ba0
YARN-4722. AsyncDispatcher logs redundant event queue sizes (Jason Lowe via sjlee)
2016-02-24 09:29:41 -08:00
140cb5d745
YARN-4709. NMWebServices produces incorrect JSON for containers. Contributed by Varun Saxena.
2016-02-23 12:29:25 +05:30
a2fdfff02d
HADOOP-12668. Support excluding weak Ciphers in HttpServer2 through ssl-server.conf. Contributed by Vijay Singh.
...
Change-Id: Ie46a5427d29188935427f67e55203c19fcd83335
2016-02-22 14:13:54 -08:00
23f937e3b7
YARN-2575. Create separate ACLs for Reservation create/update/delete/list ops (Sean Po via asuresh)
2016-02-11 10:47:43 -08:00
fa00d3e205
YARN-4655. Log uncaught exceptions/errors in various thread pools in YARN. Contributed by Sidharta Seethana.
2016-02-11 12:06:42 +05:30
308d63f382
YARN-4307. Display blacklisted nodes for AM container in the RM web UI. Contributed by Naganarasimha G R.
2016-02-04 13:32:54 +05:30
db144eb1c5
YARN-4100. Add Documentation for Distributed and Delegated-Centralized
...
Node Labels feature. Contributed by Naganarasimha G R.
2016-02-02 12:06:51 +05:30
9875325d5c
YARN-4340. Add list API to reservation system. (Sean Po via wangda)
2016-02-02 10:17:33 +08:00
9fab22b366
YARN-4219. New levelDB cache storage for timeline v1.5. Contributed by
...
Li Lu
2016-01-28 14:24:22 -08:00
618bfd6ac2
YARN-4496. Improve HA ResourceManager Failover detection on the client.
...
Contributed by Jian He
2016-01-22 18:20:38 -08:00
89d1fd5dac
HADOOP-12356. Fix computing CPU usage statistics on Windows. (Inigo Goiri via wangda)
2016-01-19 21:27:38 +08:00
d40859fab1
YARN-4526. Make SystemClock singleton so AppSchedulingInfo could use it. (kasha)
2016-01-18 10:58:14 +01:00
02f597c5db
YARN-4265. Provide new timeline plugin storage to support fine-grained entity caching. Contributed by Li Lu and Jason Lowe
2016-01-17 17:37:40 -08:00
f7736f464f
YARN-4389. Allow application to enable or disable am blacklisting. (Sunil G via rohithsharmaks)
2016-01-15 21:38:26 +05:30
c0537bcd2c
YARN-4571. Make app id/name available to the yarn authorizer provider for better auditing. (Jian He via wangda)
2016-01-13 13:18:31 +08:00
13de8359a1
YARN-4414. Nodemanager connection errors are retried at multiple levels. Contributed by Chang Li
2016-01-12 15:56:15 +00:00
56b9500bbd
HADOOP-12584. Disable browsing the static directory in HttpServer2. Contributed by Robert Kanter.
2016-01-12 13:34:18 +09:00
fb00794368
YARN-2882. Add an OPPORTUNISTIC ExecutionType. (Konstantinos Karanasos and Inigo Goiri via kasha)
2015-12-26 20:22:16 -08:00
2c17b81569
YARN-2934. Improve handling of container's stderr. (Naganarasimha G R via gera)
2015-12-24 23:48:05 -08:00
bb5df272b9
YARN-4400. AsyncDispatcher.waitForDrained should be final. Contributed by Daniel Templeton.
2015-12-23 08:55:12 -08:00
882f2f0464
YARN-4234. New put APIs in TimelineClient for ats v1.5. Contributed by Xuan Gong.
2015-12-23 05:26:51 -08:00
114b590955
YARN-3458. CPU resource monitoring in Windows. Contributed by Inigo Goiri.
2015-12-21 16:59:09 -08:00
bc038b382c
YARN-4454. NM to nodelabel mapping going wrong after RM restart. (Bibin A Chundatt via wangda)
2015-12-21 11:30:13 -08:00
85c2466048
YARN-4164. Changed updateApplicationPriority API to return the updated application priority. Contributed by Rohith Sharma K S
2015-12-18 14:13:48 -08:00
7faa406f27
YARN-4225. Add preemption status to yarn queue -status for capacity scheduler. (Eric Payne via wangda)
2015-12-16 13:19:40 -08:00
79c41b1d83
YARN-4293. ResourceUtilization should be a part of yarn node CLI. (Sunil G via wangda)
2015-12-16 13:18:19 -08:00
1cb3299b48
YARN-4403. (AM/NM/Container)LivelinessMonitor should use monotonic time when calculating period. Contributed by Junping Du
2015-12-14 13:51:23 -08:00
dfcbbddb09
YARN-4309. Add container launch related debug information to container logs when a container fails. (Varun Vasudev via wangda)
2015-12-14 11:13:22 -08:00
21daa6c68a
YARN-3623-Addendum: Improve the description for Timeline Service Version configuration in yarn-default.xml
2015-12-10 10:56:12 -08:00
f910e4f639
YARN-3623. Add a config to indicate the Timeline Service version. Contributed by Xuan Gong.
2015-12-10 02:53:47 -08:00
01a641bc44
YARN-3456. Improve handling of incomplete TimelineEntities. (Varun Saxena via rohithsharmaks)
2015-12-07 15:16:56 +05:30
e84d6ca2df
Add missing file for YARN-4419
2015-12-03 19:07:28 -08:00
755dda8dd8
YARN-4405. Support node label store in non-appendable file system. Contributed by Wangda Tan
2015-12-03 17:45:31 -08:00
9f77ccad73
YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999). Contributed by Mohammad Shahid Khan and Varun Saxena
2015-12-03 12:48:50 -08:00
6b9a5beb2b
YARN-4398. Remove unnecessary synchronization in RMStateStore. Contributed by Ning Ding
2015-12-02 11:07:18 -08:00
f5acf94eca
YARN-4365. FileSystemNodeLabelStore should check for root dir existence on startup. Contributed by Kuhu Shukla
2015-11-24 23:47:10 +00:00
4ac6799d4a
YARN-4132. Separate configs for nodemanager to resourcemanager connection timeout and retries. Contributed by Chang Li
2015-11-24 22:35:37 +00:00
8c0133f3d4
YARN-4298. Fix findbugs warnings in hadoop-yarn-common. Contributed by Sunil G.
2015-11-24 18:40:33 +09:00
fcd7888029
Revert "YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan"
...
This reverts commit 8fbea531d7
2015-11-16 20:18:44 -08:00
23d0db551c
YARN-4241. Fix typo of property name in yarn-default.xml. Contributed by Anthony Rojas.
2015-11-11 16:13:08 +09:00
8fbea531d7
YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan
2015-11-09 10:43:45 -08:00
c41699965e
YARN-4288. Fixed RMProxy to retry on IOException from local host. Contributed by Junping Du
2015-10-29 00:00:48 -07:00
6f606214e7
YARN-4169. Fix racing condition of TestNodeStatusUpdaterForLabels. (Naganarasimha G R via wangda)
2015-10-26 16:36:34 -07:00
3cc73773eb
YARN-4285. Display resource usage as percentage of queue and cluster in the RM UI (Varun Vasudev via wangda)
2015-10-26 13:07:39 -07:00
5acdde4744
YARN-2729. Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup. (Naganarasimha G R via rohithsharmaks)
2015-10-26 15:42:42 +05:30
f8adeb712d
YARN-4009. CORS support for ResourceManager REST API. ( Varun Vasudev via jeagles)
2015-10-23 10:34:08 -05:00
0fce5f9a49
YARN-4243. Add retry on establishing Zookeeper conenction in EmbeddedElectorService#serviceInit. Contributed by Xuan Gong.
2015-10-22 13:41:09 -07:00
25f8f801d1
YARN-2513. Host framework UIs in YARN for use with the ATS (jeagles)
2015-10-21 15:38:08 -05:00
e39ae0e676
YARN-4262. Allow whitelisted users to run privileged docker containers. Contributed by Sidharta Seethana.
2015-10-19 20:19:22 +05:30
f9da5cdb2b
YARN-4170. AM need to be notified with priority in AllocateResponse. Contributed by Sunil G
2015-10-16 15:26:27 -07:00
63020c54c1
YARN-4258. Add support for controlling capabilities for docker containers. Contributed by Sidharta Seethana.
2015-10-15 13:41:20 +05:30
dfa7848463
HADOOP-12478. Shell.getWinUtilsPath() has been renamed Shell.getWinutilsPath(). (stevel)
2015-10-14 20:25:47 +01:00
c59af2fdf8
HADOOP-10775. Shell operations to fail with meaningful errors on windows if winutils.exe not found. (stevel)
2015-10-13 21:49:28 +01:00
db93047881
YARN-3964. Support NodeLabelsProvider at Resource Manager side.
...
Contributed by Dian Fu.
2015-10-11 11:21:29 +05:30
a0bca2b5ad
YARN-261. Ability to fail AM attempts. Contributed by Andrey Klochkov and Rohith Sharma K S
2015-10-09 14:17:38 +00:00
8d226225d0
YARN-3943. Use separate threshold configurations for disk-full detection and disk-not-full detection. Contributed by Zhihai Xu
2015-10-08 22:25:34 +00:00
30ac69c6bd
YARN-4176. Resync NM nodelabels with RM periodically for distributed nodelabels. (Bibin A Chundatt via wangda)
2015-10-05 15:47:21 -07:00
c918f7be5e
HADOOP-12458. Retries is typoed to spell Retires in parts of hadoop-yarn and hadoop-common. Contributed by Neelesh Srinivas Salian.
2015-10-03 18:37:58 +05:30
8f08532bde
YARN-1897. CLI and core support for signal container functionality. Contributed by Ming Ma
2015-10-02 18:50:47 -07:00
fdf02d1f26
YARN-3619. ContainerMetrics unregisters during getMetrics and leads to ConcurrentModificationException. Contributed by Zhihai Xu
2015-10-02 20:20:31 +00:00
89cab1ba5f
YARN-1651. CapacityScheduler side changes to support container resize. Contributed by Wangda Tan
2015-09-23 13:29:38 -07:00
83a18add10
YARN-1449. AM-NM protocol changes to support container resizing. Contributed by Meng Ding & Wangda Tan)
2015-09-23 13:29:36 -07:00
dfe2cb849f
YARN-3866. AM-RM protocol changes to support container resizing. Contributed by Meng Ding
2015-09-23 13:29:36 -07:00
dfd807afab
HADOOP-12428. Fix inconsistency between log-level guards and statements. Contributed by Jagadesh Kiran N and Jackie Chang.
2015-09-22 12:54:29 +09:00
b00392dd9c
YARN-4113. RM should respect retry-interval when uses RetryPolicies.RETRY_FOREVER. (Sunil G via wangda)
2015-09-21 11:04:03 -07:00
bf2f2b4fc4
YARN-3433. Jersey tests failing with Port in Use -again. (Brahma Reddy Battula)
2015-09-16 10:31:02 +01:00
ae5308fe1d
YARN-3717. Expose app/am/queue's node-label-expression to RM web UI / CLI / REST-API. (Naganarasimha G R via wangda)
2015-09-15 11:40:50 -07:00
73e3a49eb0
YARN-313. Add Admin API for supporting node resource configuration in command line. (Contributed by Inigo Goiri, Kenji Kikushima and Junping Du)
2015-09-15 07:56:47 -07:00
332b520a48
YARN-3697. FairScheduler: ContinuousSchedulingThread can fail to shutdown. (Zhihai Xu via kasha)
2015-09-13 18:07:43 -07:00
81df7b586a
YARN-2005. Blacklisting support for scheduling AMs. (Anubhav Dhoot via kasha)
2015-09-13 17:03:15 -07:00
7269906254
HADOOP-12087. [JDK8] Fix javadoc errors caused by incorrect or illegal tags. (Akira AJISAKA via stevel).
2015-09-13 14:25:26 +01:00
6dd6ca442a
YARN-4086. Allow Aggregated Log readers to handle HAR files (rkanter)
2015-09-09 18:03:04 -07:00
6f72f1e600
YARN-2884. Added a proxy service in NM to proxy the the communication between AM and RM. Contributed by Kishore Chaliparambil
2015-09-08 09:35:46 +08:00
9b78e6e33d
YARN-4087. Followup fixes after YARN-2019 regarding RM behavior when
...
state-store error occurs. Contributed by Jian He
2015-09-07 17:45:47 -07:00
bcc85e3bab
YARN-4024. YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat. (Hong Zhiguo via wangda)
2015-09-04 15:13:53 -07:00
a3fd2ccc86
YARN-4092. Fixed UI redirection to print useful messages when both RMs are in standby mode. Contributed by Xuan Gong
2015-08-31 17:33:24 -07:00
a9c8ea71aa
YARN-3250. Support admin cli interface in for Application Priority. Contributed by Rohith Sharma K S
2015-08-27 13:25:53 -07:00
57c7ae1aff
YARN-4014. Support user cli interface in for Application Priority. Contributed by Rohith Sharma K S
2015-08-24 20:36:44 -07:00
b71c6006f5
YARN-221. Addendum patch to compilation issue which is caused by missing
...
AllContainerLogAggregationPolicy. Contributed by Xuan Gong
2015-08-23 16:46:30 -07:00
37e1c3d82a
YARN-221. NM should provide a way for AM to tell it not to aggregate
...
logs. Contributed by Ming Ma
2015-08-22 16:25:24 -07:00
fc07464d1a
YARN-2923. Support configuration based NodeLabelsProvider Service in Distributed Node Label Configuration Setup. (Naganarasimha G R)
2015-08-20 11:51:03 -07:00
def12933b3
YARN-3534. Collect memory/cpu usage on the node. (Inigo Goiri via kasha)
2015-08-16 06:24:16 -07:00
1c12adb71f
YARN-4023. Publish Application Priority to TimelineServer. (Sunil G via rohithsharmaks)
2015-08-12 14:45:41 +05:30
3ae716fa69
YARN-3999. RM hangs on draing events. Contributed by Jian He
2015-08-11 18:25:11 -07:00
b6265d39c5
YARN-3948. Display Application Priority in RM Web UI.(Sunil G via rohithsharmaks)
2015-08-07 10:43:41 +05:30
154c9d2e42
YARN-3961. Expose pending, running and reserved containers of a queue in REST api and yarn top (adhoot via asuresh)
2015-08-05 23:14:14 -07:00
0306d902f5
YARN-3543. ApplicationReport should be able to tell whether the
...
Application is AM managed or not. Contributed by Rohith Sharma K S
2015-08-03 15:46:00 -07:00
8acb30b016
YARN-3963. AddNodeLabel on duplicate label addition shows success. (Bibin A Chundatt via wangda)
2015-07-30 09:42:55 -07:00
c020b62cf8
YARN-3919. NPEs' while stopping service after exception during CommonNodeLabelsManager#start. (varun saxena via rohithsharmaks)
2015-07-29 23:30:47 +05:30
5205a330b3
YARN-2768. Avoid cloning Resource in FSAppAttempt#updateDemand. (Hong Zhiguo via kasha)
2015-07-29 09:42:32 -07:00
42d4e0ae99
YARN-3958. TestYarnConfigurationFields should be moved to hadoop-yarn-api module. Contributed by Varun Saxena.
2015-07-27 11:43:25 +09:00
e202efaf93
YARN-3845. Scheduler page does not render RGBA color combinations in IE11. (Contributed by Mohammad Shahid Khan)
2015-07-24 12:43:06 +05:30
1d3026e7b3
YARN-3900. Protobuf layout of yarn_security_token causes errors in other protos that include it (adhoot via rkanter)
2015-07-23 14:46:54 -07:00
ee98d6354b
YARN-2019. Retrospect on decision of making RM crashed if any exception throw in ZKRMStateStore. Contributed by Jian He.
2015-07-22 17:52:35 -07:00
8376ea3297
YARN-3954. Fix TestYarnConfigurationFields#testCompareConfigurationClassAgainstXml. (varun saxena via rohithsharmaks)
2015-07-23 00:28:24 +05:30
393fe71771
YARN-3878. AsyncDispatcher can hang while stopping if it is configured for draining events on stop. Contributed by Varun Saxena
2015-07-21 15:05:41 -07:00
fa2b63ed16
YARN-3930. FileSystemNodeLabelsStore should make sure edit log file closed when exception is thrown. (Dian Fu via wangda)
2015-07-16 16:06:20 -07:00
a431ed9075
HADOOP-12211. Collect disk usage on the node. Contributed by Robert Grandl
2015-07-13 15:36:11 -07:00
2466460d4c
Revert "YARN-3878. AsyncDispatcher can hang while stopping if it is configured for draining events on stop. (Varun Saxena via kasha)"
...
This reverts commit aa067c6aa4
2015-07-13 14:30:35 -07:00
19295b36d9
YARN-3381. Fix typo InvalidStateTransitonException. Contributed by Brahma Reddy Battula.
2015-07-13 17:52:13 +09:00
d6675606dc
YARN-3069. Document missing properties in yarn-default.xml. Contributed by Ray Chiang.
2015-07-13 12:57:01 +09:00
d7319dee37
YARN-3917. getResourceCalculatorPlugin for the default should intercept all exceptions. (gera)
2015-07-11 22:29:36 -07:00
1ea36299a4
YARN-3116. RM notifies NM whether a container is an AM container or normal task container. Contributed by Giovanni Matteo Fumarola.
2015-07-10 18:58:10 -07:00
1a0752d85a
HADOOP-12210. Collect network usage on the node. Contributed by Robert Grandl
2015-07-09 17:48:43 -07:00
ac6048372a
HADOOP-12180. Move ResourceCalculatorPlugin from YARN to Common. (Chris Douglas via kasha)
2015-07-09 09:56:40 -07:00
aa067c6aa4
YARN-3878. AsyncDispatcher can hang while stopping if it is configured for draining events on stop. (Varun Saxena via kasha)
2015-07-09 09:48:29 -07:00
d6325745e2
YARN-3690. [JDK8] 'mvn site' fails. Contributed by Brahma Reddy Battula.
2015-07-08 15:42:31 +09:00
688617d6d7
YARN-3882. AggregatedLogFormat should close aclScanner and ownerScanner
...
after create them. Contributed by zhihai xu
2015-07-04 21:51:58 -07:00
7405c59799
YARN-3823. Fix mismatch in default values for
...
yarn.scheduler.maximum-allocation-vcores property. Contributed by Ray
Chiang.
2015-07-01 11:11:26 +05:30
6f2a41e37d
YARN-3768. ArrayIndexOutOfBoundsException with empty environment variables. (Zhihai Xu via gera)
2015-06-30 14:59:33 -07:00
4672315e2d
YARN-3770. SerializedException should also handle java.lang.Error on de-serialization. Contributed by Lavkesh Lahngir
2015-06-29 14:31:49 -07:00
62e583c7dc
YARN-3695. ServerProxy (NMProxy, etc.) shouldn't retry forever for non network exception. Contributed by Raju Bairishetti
2015-06-29 13:37:32 -07:00
b381f88c71
YARN-3745. SerializedException should also try to instantiate internal
...
exception with the default constructor. Contributed by Lavkesh Lahngir.
2015-06-25 17:38:11 +05:30
2a20dd9b61
YARN-3809. Failed to launch new attempts because ApplicationMasterLauncher's threads all hang. Contributed by Jun Gong
2015-06-24 16:23:48 +00:00
5ebf2817e5
YARN-3842. NMProxy should retry on NMNotYetReadyException. (Robert Kanter via kasha)
2015-06-22 17:47:47 -07:00
63d40d5286
MAPREDUCE-6316. Task Attempt List entries should link to the task overview. (Siqi Li via gera)
2015-06-20 11:38:21 -07:00
318d2cde7c
YARN-3617. Fix WindowsResourceCalculatorPlugin.getCpuFrequency() returning
...
always -1. Contributed by J.Andreina.
2015-06-17 13:54:09 +05:30
e27d5a13b0
YARN-3714. AM proxy filter can not get RM webapp address from
...
yarn.resourcemanager.hostname.rm-id. Contributed by Masatake Iwasaki
2015-06-16 14:06:16 -07:00
8d0ef31632
YARN-3787. Allowed generic history service to load a number of applications whose started time is within the given range. Contributed by Xuan Gong.
2015-06-08 23:14:58 -07:00
405bbcf68c
Add missing test file of YARN-3733
2015-06-04 13:18:44 -07:00
ebd797c48f
YARN-3733. Fix DominantRC#compare() does not work as expected if cluster resource is empty. (Rohith Sharmaks via wangda)
2015-06-04 10:22:57 -07:00
5766a04428
YARN-3749. We should make a copy of configuration when init
...
MiniYARNCluster with multiple RMs. Contributed by Chun Chen
2015-06-03 17:20:15 -07:00
bc85959edd
Revert "YARN-1462. Made RM write application tags to timeline server and exposed them to users via generic history web UI and REST API. Contributed by Xuan Gong."
...
This reverts commit 4a9ec1a824
2015-06-03 14:15:56 -07:00
5cc3fced95
YARN-3725. App submission via REST API is broken in secure mode due to Timeline DT service address is empty. (Zhijie Shen via wangda)
2015-05-31 16:31:09 -07:00
4a9ec1a824
YARN-1462. Made RM write application tags to timeline server and exposed them to users via generic history web UI and REST API. Contributed by Xuan Gong.
2015-05-30 21:05:36 -07:00
788bfa0359
YARN-3716. Node-label-expression should be included by ResourceRequestPBImpl.toString. (Xianyin Xin via wangda)
2015-05-28 16:34:18 -07:00
7e509f5843
YARN-3722. Merge multiple TestWebAppUtils into
...
o.a.h.yarn.webapp.util.TestWebAppUtils. Contributed by Masatake Iwasaki.
2015-05-28 15:35:06 +05:30
54504133f4
YARN-3700. Made generic history service load a number of latest applications according to the parameter or the configuration. Contributed by Xuan Gong.
2015-05-27 16:52:22 -07:00
ec0a852a37
YARN-3647. RMWebServices api's should use updated api from CommonNodeLabelsManager to get NodeLabel object. (Sunil G via wangda)
2015-05-27 12:51:20 -07:00
cdbd66be11
YARN-3686. CapacityScheduler should trim default_node_label_expression. (Sunil G via wangda)
2015-05-26 15:58:47 -07:00
500a1d9c76
YARN-160. Enhanced NodeManager to automatically obtain cpu/memory values from underlying OS when configured to do so. Contributed by Varun Vasudev.
2015-05-26 11:38:35 -07:00
Varun Vasudev
Junping Du
Andrew Wang
Vinod Kumar Vavilapalli
Robert Kanter
Jian He
Sangjin Lee
Varun Saxena
Li Lu
Naganarasimha
Xuan
Vrushali
Zhijie Shen
Wangda Tan
Arun Suresh
Tsuyoshi Ozawa
Naganarasimha
Ming Ma
Rohith Sharma K S
Carlo Curino
Karthik Kambatla
Jason Lowe
Chris Douglas
Akira Ajisaka
Karthik Kambatla
Siddharth Seth
Zhe Zhang
Devaraj K
Gera Shegalov
cnauroth
Jonathan Eagles
Steve Loughran
Harsh J