Devaraj K
3b9698ecac
YARN-3824. Fix two minor nits in member variable properties of
...
YarnConfiguration. Contributed by Ray Chiang.
(cherry picked from commit 2ad668748e
)
2015-06-18 16:46:33 +05:30
Jian He
a24ead8c6d
YARN-2716. Refactor ZKRMStateStore retry code with Apache Curator. Contributed by Karthik Kambatla
...
(cherry picked from commit 960b8f19ca
)
2015-06-08 14:51:25 -07:00
Xuan
4d385b48f0
YARN-1462. AHS API and other AHS changes to handle tags for completed MR jobs. Contributed by Xuan Gong
...
(cherry picked from commit 3e000a919f
)
2015-06-05 12:49:51 -07:00
Junping Du
d8c7ee1b53
YARN-41. The RM should handle the graceful shutdown of the NM. Contributed by Devaraj K.
...
(cherry picked from commit d7e7f6aa03
)
2015-06-04 05:00:32 -07:00
Xuan
3f0573b059
YARN-3749. We should make a copy of configuration when init
...
MiniYARNCluster with multiple RMs. Contributed by Chun Chen
(cherry picked from commit 5766a04428
)
2015-06-03 17:21:48 -07:00
Zhijie Shen
2fcd3fe6ba
Revert "YARN-1462. Made RM write application tags to timeline server and exposed them to users via generic history web UI and REST API. Contributed by Xuan Gong."
...
This reverts commit 4e2ed34d20
.
2015-06-03 14:16:51 -07:00
Zhijie Shen
4e2ed34d20
YARN-1462. Made RM write application tags to timeline server and exposed them to users via generic history web UI and REST API. Contributed by Xuan Gong.
...
(cherry picked from commit a9f986bc5a41ab74171da1076d10e83c5adc284f)
2015-05-30 21:06:32 -07:00
Zhijie Shen
68cddb894a
YARN-3740. Fixed the typo in the configuration name: APPLICATION_HISTORY_PREFIX_MAX_APPS. Contributed by Xuan Gong.
...
(cherry picked from commit eb6bf91eea
)
2015-05-29 18:18:47 -07:00
Vinod Kumar Vavilapalli
148412bb30
Fixed more FilesSystemRMStateStore issues. Contributed by Vinod Kumar Vavilapalli.
...
(cherry picked from commit 9acd24fec4
)
2015-05-28 15:27:01 -07:00
Zhijie Shen
839f81a632
YARN-3700. Made generic history service load a number of latest applications according to the parameter or the configuration. Contributed by Xuan Gong.
...
(cherry picked from commit 54504133f4
)
2015-05-27 16:53:47 -07:00
cnauroth
6ed8989a6f
YARN-3626. On Windows localized resources are not moved to the front of the classpath when they should be. Contributed by Craig Welch.
...
(cherry picked from commit 7bc33b63c78c6ee9a04c0c1511ef16e63f7f3074)
2015-05-27 14:21:15 -07:00
Vinod Kumar Vavilapalli
a67cb4826b
YARN-160. Enhanced NodeManager to automatically obtain cpu/memory values from underlying OS when configured to do so. Contributed by Varun Vasudev.
...
(cherry picked from commit 500a1d9c76
)
2015-05-26 11:39:40 -07:00
Wangda Tan
b5ba6979b7
YARN-3583. Support of NodeLabel object instead of plain String in YarnClient side. (Sunil G via wangda)
...
(cherry picked from commit 563eb1ad2a
)
(cherry picked from commit b0d22b0c606fad6b4ab5443c0aed07c829b46726)
2015-05-19 17:37:24 -07:00
Wangda Tan
7b97f049ee
YARN-3565. NodeHeartbeatRequest/RegisterNodeManagerRequest should use NodeLabel object instead of String. (Naganarasimha G R via wangda)
...
(cherry picked from commit b37da52a1c
)
2015-05-19 16:35:23 -07:00
Xuan
3ceb2ffe54
YARN-3541. Add version info on timeline service / generic history web UI and REST API. Contributed by Zhijie Shen
...
(cherry picked from commit 76afd28862
)
2015-05-18 13:19:01 -07:00
Junping Du
bc13c7d84b
YARN-3505. Node's Log Aggregation Report with SUCCEED should not cached in RMApps. Contributed by Xuan Gong.
...
(cherry picked from commit 15ccd967ee
)
2015-05-14 10:59:48 -07:00
Xuan
487d9b0f3f
YARN-3626. On Windows localized resources are not moved to the front of the classpath when they should be. Contributed by Craig Welch
...
(cherry picked from commit 0f95921447
)
2015-05-13 13:12:04 -07:00
Zhijie Shen
6043224458
YARN-3539. Updated timeline server documentation and marked REST APIs evolving. Contributed by Steve Loughran.
...
(cherry picked from commit fcd0702c10
)
2015-05-12 21:13:47 -07:00
Xuan
acb342b77c
YARN-1912. ResourceLocalizer started without any jvm memory control.
...
Contributed by Masatake Iwasaki
(cherry picked from commit 6471d18bc7
)
2015-05-08 20:02:23 -07:00
Xuan
8d07116266
YARN-2331. Distinguish shutdown during supervision vs. shutdown for
...
rolling upgrade. Contributed by Jason Lowe
(cherry picked from commit 088156de43
)
2015-05-08 15:11:55 -07:00
Devaraj K
bf8be56292
YARN-2784. Make POM project names consistent. Contributed by Rohith.
2015-05-08 19:26:11 +05:30
Jason Lowe
bcb863b156
YARN-3554. Default value for maximum nodemanager connect wait time is too high. Contributed by Naganarasimha G R
...
(cherry picked from commit 9757864fd6
)
2015-05-08 13:47:48 +00:00
Zhijie Shen
bb035ff087
YARN-3448. Added a rolling time-to-live LevelDB timeline store implementation. Contributed by Jonathan Eagles.
...
(cherry picked from commit daf3e4ef8b
)
2015-05-07 10:10:13 -07:00
Junping Du
684a5a6aeb
YARN-3523. Cleanup ResourceManagerAdministrationProtocol interface audience. Contributed by Naganarasimha G R
...
(cherry picked from commit 8e991f4b1d
)
2015-05-07 05:40:13 -07:00
Vinod Kumar Vavilapalli
90f6e8c90f
YARN-2619. Added NodeManager support for disk io isolation through cgroups. Contributed by Varun Vasudev and Wei Yan.
...
(cherry picked from commit 1b3b9e5c31
)
2015-04-30 21:43:22 -07:00
Wangda Tan
8ee632caa7
YARN-2740. Fix NodeLabelsManager to properly handle node label modifications when distributed node label configuration enabled. (Naganarasimha G R via wangda)
...
(cherry picked from commit db1b674b50
)
2015-04-27 16:42:36 -07:00
Vinod Kumar Vavilapalli
0ec6e7e7f5
YARN-3413. Changed Nodelabel attributes (like exclusivity) to be settable only via addToClusterNodeLabels but not changeable at runtime. (Wangda Tan via vinodkv)
...
(cherry picked from commit f5fe35e297
)
2015-04-23 11:25:30 -07:00
Vinod Kumar Vavilapalli
04783b0402
YARN-3366. Enhanced NodeManager to support classifying/shaping outgoing network bandwidth traffic originating from YARN containers Contributed by Sidharta Seethana.
...
(cherry picked from commit a100be685c
)
2015-04-22 17:36:55 -07:00
Junping Du
8de6045842
New parameter of CLI for decommissioning node gracefully in RMAdmin CLI. Contributed by Devaraj K
...
(cherry picked from commit fad9d7e85b
)
2015-04-22 10:08:16 -07:00
Jian He
9827da95bc
YARN-3451. Display attempt start time and elapsed time on the web UI. Contributed by Rohith Sharmaks
...
(cherry picked from commit 6779467ab6
)
2015-04-17 15:57:36 -07:00
Junping Du
b244701fad
YARN-1402. Update related Web UI and CLI with exposing client API to check log aggregation status. Contributed by Xuan Gong.
...
(cherry picked from commit 1db355a875
)
2015-04-17 13:20:27 -07:00
Jian He
d3daf9665c
YARN-3348. Add a 'yarn top' tool to help understand cluster usage. Contributed by Varun Vasudev
2015-04-10 10:40:31 -07:00
Junping Du
0891de0712
YARN-1376. NM need to notify the log aggregation status to RM through Node heartbeat. Contributed by Xuan Gong.
...
(cherry picked from commit 92431c9617
)
2015-04-10 08:58:07 -07:00
Wangda Tan
cba4ed1678
YARN-2495. Allow admin specify labels from each NM (Distributed configuration for node label). (Naganarasimha G R via wangda)
...
(cherry picked from commit 2a945d24f7
)
2015-03-30 12:05:54 -07:00
Jian He
9c494cedaf
YARN-3345. Add non-exclusive node label API. Contributed by Wangda Tan
...
(cherry picked from commit e1feb4ea1a
)
2015-03-20 19:05:14 -07:00
Harsh J
2684b0b440
MAPREDUCE-4414. Add main methods to JobConf and YarnConfiguration, for debug purposes. Contributed by Plamen Jeliazkov.
...
(cherry picked from commit 571f75b468a4412be2178466cb5d3888b05cd076)
2015-03-17 01:02:21 +05:30
Tsuyoshi Ozawa
d6e3ef2506
YARN-1453. [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments. Contributed by Akira AJISAKA, Andrew Purtell, and Allen Wittenauer.
...
(cherry picked from commit 3da9a97cfb
)
2015-03-16 23:20:17 +09:00
Vinod Kumar Vavilapalli
53aa3a4d1f
YARN-3154. Added additional APIs in LogAggregationContext to avoid aggregating running logs of application when rolling is enabled. Contributed by Xuan Gong.
...
(cherry picked from commit 863079bb87
)
2015-03-12 13:33:42 -07:00
Zhijie Shen
426535007b
YARN-1884. Added nodeHttpAddress into ContainerReport and fixed the link to NM web page. Contributed by Xuan Gong.
...
(cherry picked from commit 85f6d67fa7
)
2015-03-11 19:39:46 -07:00
Vinod Kumar Vavilapalli
d9416317a9
Preparing for 2.8.0 development. Changing SNAPSHOT version to be 2.8 on branch-2.
2015-03-08 20:32:51 -07:00
Jian He
6cef2c16de
YARN-2190. Added CPU and memory limit options to the default container executor for Windows containers. Contributed by Chuan Liu
...
(cherry picked from commit 21101c01f2
)
2015-03-06 14:18:56 -08:00
Jian He
a5f3fb4dc1
YARN-1809. Synchronize RM and TimeLineServer Web-UIs. Contributed by Zhijie Shen and Xuan Gong
...
(cherry picked from commit 95bfd087dc
)
2015-03-05 21:27:03 -08:00
Tsuyoshi Ozawa
6660c2f83b
YARN-3249. Add a 'kill application' button to Resource Manager's Web UI. Contributed by Ryu Kobayashi.
...
(cherry picked from commit 1b67209612
)
2015-03-05 19:56:59 +09:00
Wangda Tan
19a8e48230
YARN-3270. Fix node label expression not getting set in ApplicationSubmissionContext (Rohit Agarwal via wangda)
...
(cherry picked from commit abac6eb9d5
)
2015-03-02 17:24:55 -08:00
Tsuyoshi Ozawa
79f73f4613
YARN-2820. Retry in FileSystemRMStateStore when FS's operations fail due to IOException. Contributed by Zhihai Xu.
...
(cherry picked from commit 01a1621930
)
2015-02-28 00:57:01 +09:00
Wangda Tan
cd5eb9c1de
YARN-3076. Add API/Implementation to YarnClient to retrieve label-to-node mapping (Varun Saxena via wangda)
...
(cherry picked from commit d49ae725d5
)
2015-02-19 11:01:47 -08:00
Tsuyoshi Ozawa
dc14f2772f
YARN-3157. Refactor the exception handling in ConverterUtils#to*Id. Contributed by Bibin A Chundatt.
...
(cherry picked from commit 7bc492adab
)
2015-02-12 23:49:27 +09:00
Jason Lowe
ca11ffa5de
YARN-2809. Implement workaround for linux kernel panic when removing cgroup. Contributed by Nathan Roberts
...
(cherry picked from commit 3f5431a22f
)
2015-02-10 17:28:18 +00:00
Zhijie Shen
24d4d933f7
YARN-3100. Made YARN authorization pluggable. Contributed by Jian He.
...
(cherry picked from commit 23bf6c7207
)
2015-02-09 20:37:58 -08:00
Jason Lowe
9361fc8f70
YARN-3144. Configuration for making delegation token failures to timeline server not-fatal. Contributed by Jonathan Eagles
...
(cherry picked from commit 6f10434a5a
)
2015-02-06 20:55:56 +00:00
Jian He
3ddafaa7c8
YARN-2694. Ensure only single node label specified in ResourceRequest. Contributed by Wangda Tan
...
(cherry picked from commit c1957fef29
)
2015-02-06 11:34:56 -08:00
Tsuyoshi Ozawa
04ad500fac
YARN-3086. Make NodeManager memory configurable in MiniYARNCluster. Contributed by Robert Metzger.
...
(cherry picked from commit f56da3ce04
)
2015-01-28 00:16:07 +09:00
Tsuyoshi Ozawa
25f2cf8a4e
YARN-2800. Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature. Contributed by Wangda Tan.
...
(cherry picked from commit 24aa462673
)
2015-01-23 20:37:26 +09:00
Karthik Kambatla
4d8fa9615f
YARN-2984. Metrics for container's actual memory usage. (kasha)
...
(cherry picked from commit 84198564ba
)
2015-01-17 06:26:47 +05:30
Jian He
ed5a0d0aa8
YARN-2861. Fixed Timeline DT secret manager to not reuse RM's configs. Contributed by Zhijie Shen
...
(cherry picked from commit 9e33116d1d
)
2015-01-15 11:08:19 -08:00
Junping Du
0119e717ae
YARN-3019. Make work-preserving-recovery the default mechanism for RM recovery. (Contributed by Jian He)
...
(cherry picked from commit f92e503800
)
2015-01-13 18:23:32 -08:00
Jian He
e3a54b1b8b
YARN-2837. Support TimeLine server to recover delegation token when restarting. Contributed by Zhijie Shen
...
(cherry picked from commit 149512a837
)
2014-12-23 18:26:37 -08:00
Karthik Kambatla
d0d42c4e32
YARN-2203. [YARN-1492] Web UI for cache manager. (Chris Trezzo via kasha)
...
(cherry picked from commit b7f64823e1
)
2014-12-17 16:34:33 -08:00
Karthik Kambatla
d02cb9c512
YARN-2927. [YARN-1492] InMemorySCMStore properties are inconsistent. (Ray Chiang via kasha)
...
(cherry picked from commit 120e1decd7
)
2014-12-07 22:28:57 -08:00
Robert Kanter
2ebd1bc654
YARN-2461. Fix PROCFS_USE_SMAPS_BASED_RSS_ENABLED property in YarnConfiguration. (rchiang via rkanter)
...
(cherry picked from commit 3c72f54ef5
)
2014-12-05 12:10:20 -08:00
Karthik Kambatla
aadd0c392b
YARN-2189. [YARN-1492] Admin service for cache manager. (Chris Trezzo via kasha)
...
(cherry picked from commit 78968155d7
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/bin/yarn
2014-12-04 19:48:18 -08:00
Jian He
d208c90148
YARN-2765. Added leveldb-based implementation for RMStateStore. Contributed by Jason Lowe
...
(cherry picked from commit a7fba0bc28
)
2014-12-01 16:45:17 -08:00
Karthik Kambatla
3d4536af82
YARN-2188. [YARN-1492] Client service for cache manager. (Chris Trezzo and Sangjin Lee via kasha)
...
(cherry picked from commit 834b3b98e7ecc4bfe93c7dd1a9e928e9653cf138)
2014-11-25 16:22:14 -08:00
Vinod Kumar Vavilapalli
d35bcf2074
Revert "YARN-2603. ApplicationConstants missing HADOOP_MAPRED_HOME (Ray Chiang via aw)"
...
This reverts commit b0a9cd37ab
.
Conflicts:
hadoop-yarn-project/CHANGES.txt
(cherry picked from commit 4ae9780e6a
)
2014-11-13 13:21:46 -08:00
Allen Wittenauer
a6de8f2e30
YARN-2603. ApplicationConstants missing HADOOP_MAPRED_HOME (Ray Chiang via aw)
2014-11-12 17:04:24 -08:00
Karthik Kambatla
ff1b13ded5
YARN-2236. [YARN-1492] Shared Cache uploader service on the Node Manager. (Chris Trezzo and Sanjin Lee via kasha)
...
(cherry picked from commit a04143039e
)
2014-11-12 09:31:30 -08:00
Ravi Prakash
d863f54f57
YARN-1964. Create Docker analog of the LinuxContainerExecutor in YARN
2014-11-11 21:29:27 -08:00
Arun C. Murthy
adfb830a2b
Preparing to release hadoop-2.6.0: Set version in branch-2 to 2.7.0-SNAPSHOT.
2014-11-09 19:19:02 -08:00
Arun C. Murthy
175d222bfc
YARN-2830. Add backwords compatible ContainerId.newInstance constructor. Contributed by Jonathan Eagles.
...
(cherry picked from commit 43cd07b408
)
2014-11-09 15:03:59 -08:00
Vinod Kumar Vavilapalli
56ab333161
YARN-2804. Fixed Timeline service to not fill the logs with JAXB bindings exceptions. Contributed by Zhijie Shen.
...
(cherry picked from commit b76179895d
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2014-11-04 18:03:17 -08:00
Haohui Mai
aa09c4c342
HADOOP-10563. Remove the dependency of jsp in trunk. Contributed by Haohui Mai.
2014-11-04 14:52:51 -08:00
Vinod Kumar Vavilapalli
6d4a04a033
YARN-2789. Re-instated the NodeReport.newInstance private unstable API modified in YARN-2698 so that tests in YARN frameworks don't break. Contributed by Wangda Tan.
...
(cherry picked from commit 6ce32f593b
)
2014-10-31 15:33:41 -07:00
Karthik Kambatla
268af259b5
YARN-2186. [YARN-1492] Node Manager uploader service for cache manager. (Chris Trezzo and Sangjin Lee via kasha)
...
(cherry picked from commit 256697acd5
)
2014-10-31 13:01:25 -07:00
Vinod Kumar Vavilapalli
9b879d713a
YARN-2778. Moved node-lables' reports to the yarn nodes CLI from the admin CLI. Contributed by Wangda Tan.
...
(cherry picked from commit b6c1188b85
)
2014-10-31 10:19:14 -07:00
Vinod Kumar Vavilapalli
0ba8d8c19c
YARN-2698. Moved some node label APIs to be correctly placed in client protocol. Contributed by Wangda Tan.
...
(cherry picked from commit e0233c16eb
)
2014-10-30 23:02:06 -07:00
Vinod Kumar Vavilapalli
0ad33e1483
YARN-2704. Changed ResourceManager to optionally obtain tokens itself for the sake of localization and log-aggregation for long-running services. Contributed by Jian He.
...
(cherry picked from commit a16d022ca4
)
2014-10-27 15:50:51 -07:00
Karthik Kambatla
acc6f622e0
YARN-2183. [YARN-1492] Cleaner service for cache manager. (Chris Trezzo and Sangjin Lee via kasha)
...
(cherry picked from commit c51e53d7aa
)
2014-10-25 11:50:06 -07:00
Jian He
9bd149978d
YARN-2314. Disable ContainerManagementProtocolProxy cache by default to prevent creating thousands of threads in a large cluster. Contributed by Jason Lowe
...
(cherry picked from commit f44cf99599
)
2014-10-24 23:06:00 -07:00
Zhijie Shen
3b03ea6b50
YARN-2209. Replaced AM resync/shutdown command with corresponding exceptions and made related MR changes. Contributed by Jian He.
...
(cherry picked from commit 0f3b6900be
)
2014-10-23 22:03:30 -07:00
Vinod Kumar Vavilapalli
77dc9afe86
YARN-2715. Fixed ResourceManager to respect common configurations for proxy users/groups beyond just the YARN level config. Contributed by Zhijie Shen.
...
(cherry picked from commit c0e034336c
)
2014-10-21 20:10:45 -07:00
Zhijie Shen
42ceed8f20
YARN-2673. Made timeline client put APIs retry if ConnectException happens. Contributed by Li Lu.
...
(cherry picked from commit 89427419a3
)
2014-10-20 12:23:10 -07:00
Vinod Kumar Vavilapalli
9915d52185
YARN-2504. Enhanced RM Admin CLI to support management of node-labels. Contribyted by Wangda Tan.
...
(cherry picked from commit 8256766498
)
2014-10-18 12:08:28 -07:00
Vinod Kumar Vavilapalli
1c52b6551b
YARN-2705. Fixed bugs in ResourceManager node-label manager that were causing test-failures: added a dummy in-memory labels-manager. Contributed by Wangda Tan.
...
(cherry picked from commit e9c66e8fd2
)
2014-10-17 18:27:04 -07:00
Jian He
78a57087bf
YARN-1879. Marked Idempotent/AtMostOnce annotations to ApplicationMasterProtocol for RM fail over. Contributed by Tsuyoshi OZAWA
...
(cherry picked from commit c3de2412eb
)
2014-10-17 16:36:15 -07:00
Jian He
f93d2ea27e
YARN-2312. Deprecated old ContainerId#getId API and updated MapReduce to use ContainerId#getContainerId instead. Contributed by Tsuyoshi OZAWA
2014-10-15 15:28:26 -07:00
Karthik Kambatla
88455173e8
YARN-2566. DefaultContainerExecutor should pick a working directory randomly. (Zhihai Xu via kasha)
...
(cherry picked from commit cc93e7e683
)
2014-10-13 16:32:42 -07:00
Jason Lowe
6b5741d423
YARN-2377. Localization exception stack traces are not passed as diagnostic info. Contributed by Gera Shegalov
...
(cherry picked from commit a56ea01002
)
2014-10-13 18:32:38 +00:00
Zhijie Shen
e51ae64761
YARN-2651. Spun off LogRollingInterval from LogAggregationContext. Contributed by Xuan Gong.
...
(cherry picked from commit 4aed2d8e91
)
2014-10-13 10:55:09 -07:00
Vinod Kumar Vavilapalli
8ef83a9480
YARN-2494. Added NodeLabels Manager internal API and implementation. Contributed by Wangda Tan.
...
(cherry picked from commit db7f165319
)
2014-10-10 11:45:15 -07:00
Zhijie Shen
ad47a27dbf
YARN-2617. Fixed ApplicationSubmissionContext to still set resource for backward compatibility. Contributed by Wangda Tan.
...
(cherry picked from commit e532ed8faa
)
2014-10-09 18:00:01 -07:00
Karthik Kambatla
7e20187f91
YARN-2180. [YARN-1492] In-memory backing store for cache manager. (Chris Trezzo via kasha)
...
(cherry picked from commit 4f426fe223
)
2014-10-09 17:16:45 -07:00
Vinod Kumar Vavilapalli
d3125f3de5
YARN-2544. Added admin-API objects for using node-labels. Contributed by Wangda Tan.
...
(cherry picked from commit 596702a025
)
2014-10-09 15:47:20 -07:00
Vinod Kumar Vavilapalli
b42cd54d7a
YARN-2493. Added user-APIs for using node-labels. Contributed by Wangda Tan.
...
(cherry picked from commit 180afa2f86
)
2014-10-09 11:27:17 -07:00
Chris Douglas
4ba102bdc3
YARN-1051. Add a system for creating reservations of cluster capacity.
...
Contributed by Subru Krishnan and Carlo Curino.
(cherry picked from commit c8212bacb1
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2014-10-06 10:30:53 -07:00
subru
ae0f16ccc8
YARN-2576. Making test patch pass in branch. Contributed by Subru Krishnan and Carlo Curino.
...
(cherry picked from commit 90ac0be86b
)
(cherry picked from commit 5e10a13bb4
)
2014-10-06 10:21:06 -07:00
subru
cbfbdf60d6
YARN-2080. Integrating reservation system with ResourceManager and client-RM protocol. Contributed by Subru Krishnan and Carlo Curino.
...
(cherry picked from commit 8baeaead85
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/RMAppImpl.java
(cherry picked from commit 6261f7cc69
)
2014-10-06 10:21:06 -07:00
subru
3a167056d1
YARN-1708. Public YARN APIs for creating/updating/deleting reservations.
...
(cherry picked from commit 3f2e3b275b
)
(cherry picked from commit c9266df404
)
2014-10-06 10:21:05 -07:00
Jian He
1c58ab9206
YARN-2562. Changed ContainerId#toString() to be more readable. Contributed by Tsuyoshi OZAWA
...
(cherry picked from commit eb6ce5e97c
)
2014-10-03 11:04:46 -07:00
Vinod Kumar Vavilapalli
34dd2d1d1c
YARN-2446. Augmented Timeline service APIs to start taking in domains as a parameter while posting entities and events. Contributed by Zhijie Shen.
...
(cherry picked from commit 9e40de6af7
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2014-10-01 17:54:12 -07:00
Vinod Kumar Vavilapalli
3326fba382
YARN-1972. Added a secure container-executor for Windows. Contributed by Remus Rusanu.
...
commit ba7f31c2ee
is the corresponding trunk commit, this is a slightly different patch for branch-2.
2014-10-01 17:07:21 -07:00
junping_du
625456746c
YARN-2613. Support retry in NMClient for rolling-upgrades. (Contributed by Jian He)
2014-10-01 17:08:55 -07:00
Karthik Kambatla
b616c69835
YARN-2179. [YARN-1492] Initial cache manager structure and context. (Chris Trezzo via kasha)
...
(cherry picked from commit 17d1202c35
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/bin/yarn
2014-09-30 19:05:10 -07:00
Vinod Kumar Vavilapalli
5d251d99d6
YARN-2102. Added the concept of a Timeline Domain to handle read/write ACLs on Timeline service event data. Contributed by Zhijie Shen.
...
(cherry picked from commit d78b452a4f
)
2014-09-24 11:29:01 -07:00
Zhijie Shen
19cfe2f800
YARN-2569. Added the log handling APIs for the long running services. Contributed by Xuan Gong.
...
(cherry picked from commit 5338ac416a
)
2014-09-23 10:38:27 -07:00
Vinod Kumar Vavilapalli
d24ef142b7
YARN-2001. Added a time threshold for RM to wait before starting container allocations after restart/failover. Contributed by Jian He.
...
(cherry picked from commit 485c96e3cb
)
2014-09-18 11:04:27 -07:00
Vinod Kumar Vavilapalli
9d34dc87e1
YARN-2531. Added a configuration for admins to be able to override app-configs and enforce/not-enforce strict control of per-container cpu usage. Contributed by Varun Vasudev.
...
(cherry picked from commit 9f6891d9ef
)
2014-09-16 10:15:37 -07:00
Jian He
1c3f837835
YARN-2529. Generic history service RPC interface doesn't work when service authorization is enabled. Contributed by Zhijie Shen
...
(cherry picked from commit 88e329fdfb
)
2014-09-15 13:15:07 -07:00
Vinod Kumar Vavilapalli
5cdb24d4b1
YARN-611. Added an API to let apps specify an interval beyond which AM failures should be ignored towards counting max-attempts. Contributed by Xuan Gong.
...
(cherry picked from commit 14e2639fd0
)
2014-09-13 18:05:02 -07:00
Jian He
f21a5236e5
YARN-2229. Changed the integer field of ContainerId to be long type. Contributed by Tsuyoshi OZAWA
...
(cherry picked from commit 3122daa802
)
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/preemption/CheckpointAMPreemptionPolicy.java
2014-09-12 10:45:42 -07:00
junping_du
efa9ab3638
YARN-2033. Merging generic-history into the Timeline Store (Contributed by Zhijie Shen)
...
(cherry picked from commit 6b8b1608e6
)
2014-09-12 10:08:06 +08:00
Vinod Kumar Vavilapalli
a2a61eec6d
YARN-2440. Enabled Nodemanagers to limit the aggregate cpu usage across all containers to a preconfigured limit. Contributed by Varun Vasudev.
...
(cherry picked from commit 4be95175cd
)
2014-09-10 19:24:14 -07:00
Jian He
ceae7be6b2
YARN-415. Capture aggregate memory allocation at the app-level for chargeback. Contributed by Eric Payne & Andrey Klochkov
...
(cherry picked from commit 83be3ad444
)
2014-09-10 18:22:07 -07:00
Vinod Kumar Vavilapalli
b4b59ef749
YARN-2448. Changed ApplicationMasterProtocol to expose RM-recognized resource types to the AMs. Contributed by Varun Vasudev.
...
(cherry picked from commit b67d5ba784
)
2014-09-10 10:17:30 -07:00
Jian He
c17810a84c
YARN-2515. Updated ConverterUtils#toContainerId to parse epoch. Contributed by Tsuyoshi OZAWA
...
(cherry picked from commit 0974f434c4
)
2014-09-07 18:31:07 -07:00
Jonathan Eagles
7e76039278
YARN-2509. Enable Cross Origin Filter for timeline server only and not all Yarn servers (Mit Desai via jeagles)
...
(cherry picked from commit 91d45f0f01
)
2014-09-04 11:54:43 -05:00
Jian He
38853c97c2
YARN-1506. Changed RMNode/SchedulerNode to update resource with event notification. Contributed by Junping Du
...
(cherry picked from commit 5c14bc426b
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2014-08-29 23:39:58 -07:00
Jian
518ba11843
YARN-2406. Move RM recovery related proto to yarn_server_resourcemanager_recovery.proto. Contributed by Tsuyoshi OZAWA
...
(cherry picked from commit 7b3e27ab73
)
2014-08-28 21:54:25 -07:00
Jian He
5c63482aaa
YARN-2182. Updated ContainerId#toString() to append RM Epoch number. Contributed by Tsuyoshi OZAWA
...
(cherry-picked from commit e2d0ff364a
)
2014-08-27 10:11:24 -07:00
Allen Wittenauer
5d965f2f3c
YARN-2424. LCE should support non-cgroups, non-secure mode (Chris Douglas via aw)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1619424 13f79535-47bb-0310-9956-ffa450edef68
2014-08-21 14:57:53 +00:00
Jason Darrell Lowe
8991c7d1b2
svn merge -c 1619176 FIXES: YARN-2034. Description for yarn.nodemanager.localizer.cache.target-size-mb is incorrect. Contributed by Chen He
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1619178 13f79535-47bb-0310-9956-ffa450edef68
2014-08-20 17:40:55 +00:00
Allen Wittenauer
b07e476da7
YARN-1918. Typo in description and error message for yarn.resourcemanager.cluster-id (Anandha L Ranganathan via aw)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1618072 13f79535-47bb-0310-9956-ffa450edef68
2014-08-14 21:54:02 +00:00
Xuan Gong
4365c4530b
YARN-2212 ApplicationMaster needs to find a way to update the AMRMToken periodically. Contributed by Xuan Gong
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1616891 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 21:37:35 +00:00
Junping Du
75349f2d83
Merge r1615025 from trunk: YARN-2051. Fix bug in PBimpls and add more unit tests with reflection. (Contributed by Binglin Chang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1615027 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 04:25:49 +00:00
Xuan Gong
ecc257e384
YARN-1994. Expose YARN/MR endpoints on multiple interfaces. Contributed by Craig Welch, Milan Potocnik and Arpit Agarwal
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1615010 13f79535-47bb-0310-9956-ffa450edef68
2014-07-31 21:29:01 +00:00
Zhijie Shen
f52092be46
YARN-2347. Consolidated RMStateVersion and NMDBSchemaVersion into Version in yarn-server-common. Contributed by Junping Du.
...
svn merge --ignore-ancestry -c 1614838 ../../trunk/
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1614839 13f79535-47bb-0310-9956-ffa450edef68
2014-07-31 09:31:22 +00:00
Zhijie Shen
b41896f0a2
YARN-2247. Made RM web services authenticate users via kerberos and delegation token. Contributed by Varun Vasudev.
...
svn merge --ignore-ancestry -c 1613821 ../../trunk/
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1613822 13f79535-47bb-0310-9956-ffa450edef68
2014-07-27 17:57:44 +00:00
Karthik Kambatla
9133e3142c
Preparing for 2.6.0 development. Updated versions.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1607541 13f79535-47bb-0310-9956-ffa450edef68
2014-07-03 06:11:57 +00:00
Vinod Kumar Vavilapalli
8f1f458729
YARN-1713. Added get-new-app and submit-app functionality to RM web services. Contributed by Varun Vasudev.
...
svn merge --ignore-ancestry -c 1607216 ../../trunk/
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1607217 13f79535-47bb-0310-9956-ffa450edef68
2014-07-02 00:23:49 +00:00
Jian He
a385b77df7
Merge r1606557 from trunk. YARN-2052. Embedded an epoch number in container id to ensure the uniqueness of container id after RM restarts. Contributed by Tsuyoshi OZAWA
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1606558 13f79535-47bb-0310-9956-ffa450edef68
2014-06-29 18:26:08 +00:00
Jian He
63940d6e13
Merge r1605263 from trunk. YARN-1365. Changed ApplicationMasterService to allow an app to re-register after RM restart. Contributed by Anubhav Dhoot
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1605264 13f79535-47bb-0310-9956-ffa450edef68
2014-06-25 04:45:50 +00:00
Vinod Kumar Vavilapalli
a2e2c8ad97
YARN-2152. Added missing information into ContainerTokenIdentifier so that NodeManagers can report the same to RM when RM restarts. Contributed Jian He.
...
svn merge --ignore-ancestry -c 1605205 ../../trunk/
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1605206 13f79535-47bb-0310-9956-ffa450edef68
2014-06-24 21:44:00 +00:00
Vinod Kumar Vavilapalli
c8dfed19ba
YARN-2074. Changed ResourceManager to not count AM preemptions towards app failures. Contributed by Jian He.
...
svn merge --ignore-ancestry -c 1605106 ../../trunk/
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1605107 13f79535-47bb-0310-9956-ffa450edef68
2014-06-24 15:16:36 +00:00
Devarajulu K
7741cc62b4
YARN-2195. Clean a piece of code in ResourceRequest. Contributed by Wei Yan.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1605085 13f79535-47bb-0310-9956-ffa450edef68
2014-06-24 13:58:14 +00:00
Bikas Saha
dc5ee5ff7c
Merge 1601762 from trunk to branch-2 for YARN-2091. Add more values to ContainerExitStatus and pass it from NM to RM and then to app masters (Tsuyoshi OZAWA via bikas)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1601763 13f79535-47bb-0310-9956-ffa450edef68
2014-06-10 20:13:23 +00:00
Karthik Kambatla
d4d1ccc992
YARN-1424. RMAppAttemptImpl should return the DummyApplicationResourceUsageReport for all invalid accesses. (Ray Chiang via kasha)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1601745 13f79535-47bb-0310-9956-ffa450edef68
2014-06-10 19:06:32 +00:00
Vinod Kumar Vavilapalli
319e422733
YARN-1368. Added core functionality of recovering container state into schedulers after ResourceManager Restart so as to preserve running work in the cluster. Contributed by Jian He.
...
svn merge --ignore-ancestry -c 1601303 ../../trunk/
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1601304 13f79535-47bb-0310-9956-ffa450edef68
2014-06-09 03:10:06 +00:00
Karthik Kambatla
33439defa1
YARN-2119. DEFAULT_PROXY_ADDRESS should use DEFAULT_PROXY_PORT. (Anubhav Dhoot via kasha)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1600487 13f79535-47bb-0310-9956-ffa450edef68
2014-06-04 20:18:49 +00:00
Karthik Kambatla
4c4ebe2353
YARN-2054. Better defaults for YARN ZK configs for retries and retry-inteval when HA is enabled. (kasha)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1598632 13f79535-47bb-0310-9956-ffa450edef68
2014-05-30 15:25:27 +00:00
Vinod Kumar Vavilapalli
0296d3fff1
YARN-1937. Added owner-only ACLs support for Timeline Client and server. Contributed by Zhijie Shen.
...
svn merge --ignore-ancestry -c 1597186 ../../trunk/
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1597188 13f79535-47bb-0310-9956-ffa450edef68
2014-05-23 21:20:07 +00:00
Vinod Kumar Vavilapalli
18457f8ed0
YARN-2049. Added delegation-token support for the Timeline Server. Contributed by Zhijie Shen.
...
svn merge --ignore-ancestry -c 1597130 ../../trunk/
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1597131 13f79535-47bb-0310-9956-ffa450edef68
2014-05-23 17:10:22 +00:00
Vinod Kumar Vavilapalli
e3fae25785
YARN-1938. Added kerberos login for the Timeline Server. Contributed by Zhijie Shen.
...
svn merge --ignore-ancestry -c 1596710 ../../trunk/
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1596711 13f79535-47bb-0310-9956-ffa450edef68
2014-05-21 23:20:40 +00:00
Vinod Kumar Vavilapalli
a098b692f4
YARN-1962. Changed Timeline Service client configuration to be off by default given the non-readiness of the feature yet. Contributed by Mohammad Kamrul Islam.
...
svn merge --ignore-ancestry -c 1593750 ../../trunk/
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1593751 13f79535-47bb-0310-9956-ffa450edef68
2014-05-11 00:15:48 +00:00
Karthik Kambatla
a2cdf208dd
YARN-1757. NM Recovery. Auxiliary service support. (Jason Lowe via kasha)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1585784 13f79535-47bb-0310-9956-ffa450edef68
2014-04-08 17:17:59 +00:00
Jian He
39871241a0
Merge r1583203 from trunk. YARN-1893. Mark AtMostOnce annotation to ApplicationMasterProtocol#allocate. Contributed by Xuan Gong
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1583205 13f79535-47bb-0310-9956-ffa450edef68
2014-03-30 21:38:27 +00:00
Jian He
859f27040d
Merge r1581678 from trunk. YARN-1521. Mark Idempotent/AtMostOnce annotations to the APIs in ApplicationClientProtcol, ResourceManagerAdministrationProtocol and ResourceTrackerProtocol so that they work in HA scenario. Contributed by Xuan Gong
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1581679 13f79535-47bb-0310-9956-ffa450edef68
2014-03-26 03:48:46 +00:00
Vinod Kumar Vavilapalli
45d6277ec2
YARN-1850. Introduced the ability to optionally disable sending out timeline-events in the TimelineClient. Contributed by Zhijie Shen.
...
svn merge --ignore-ancestry -c 1581189 ../../trunk/
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1581190 13f79535-47bb-0310-9956-ffa450edef68
2014-03-25 02:23:08 +00:00
Vinod Kumar Vavilapalli
08a194fb55
YARN-1775. Enhanced ProcfsBasedProcessTree to optionally add the ability to use smaps for obtaining used memory information. Contributed by Rajesh Balamohan.
...
svn merge --ignore-ancestry -c 1580087 ../../trunk/
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1580088 13f79535-47bb-0310-9956-ffa450edef68
2014-03-22 00:02:26 +00:00
Vinod Kumar Vavilapalli
e1bda693dd
YARN-1811. Fixed AMFilters in YARN to correctly accept requests from either web-app proxy or the RMs when HA is enabled. Contributed by Robert Kanter.
...
svn merge --ignore-ancestry -c 1579877 ../../trunk/
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1579878 13f79535-47bb-0310-9956-ffa450edef68
2014-03-21 04:21:14 +00:00
Vinod Kumar Vavilapalli
6aae750762
YARN-1685. Fixed few bugs related to handling of containers' log-URLs on ResourceManager and history-service. Contributed by Zhijie Shen.
...
svn merge --ignore-ancestry -c 1578602 ../../trunk/
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1578603 13f79535-47bb-0310-9956-ffa450edef68
2014-03-17 21:36:51 +00:00
Vinod Kumar Vavilapalli
d470c7b71a
YARN-1824. Improved NodeManager and clients to be able to handle cross platform application submissions. Contributed by Jian He.
...
MAPREDUCE-4052. Improved MapReduce clients to use NodeManagers' ability to handle cross platform application submissions. Contributed by Jian He.
svn merge --ignore-ancestry -c 1578135 ../../trunk/ with a couple of minor edits for working in branch-2.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1578139 13f79535-47bb-0310-9956-ffa450edef68
2014-03-16 19:13:16 +00:00