Subru Krishnan
ed31091361
YARN-6128. Add support for AMRMProxy HA. (Botong Huang via Subru).
2017-11-20 14:21:58 -08:00
Jason Lowe
6ad6882343
YARN-7286. Add support for docker to have no capabilities. Contributed by Eric Badger
...
(cherry picked from commit b7dee1f060
)
2017-11-02 09:50:55 -05:00
Junping Du
d1f8854a1b
YARN-7400. Incorrect log preview displayed in jobhistory server ui. Contributed by Xuan Gong.
...
(cherry picked from commit d57dba9942
)
2017-11-01 14:50:44 -07:00
Arun Suresh
71a55bebfb
Preparing for 2.10.0 development
2017-10-31 12:51:14 -07:00
Subru Krishnan
a0dceec586
YARN-5516. Add REST API for supporting recurring reservations. (Sean Po via Subru).
...
(cherry picked from commit 25932da6d1
)
2017-10-26 20:16:01 -07:00
Robert Kanter
7c26ae506a
YARN-7262. Add a hierarchy into the ZKRMStateStore for delegation token znodes to prevent jute buffer overflow (rkanter)
...
(cherry picked from commit b1de78619f
)
2017-10-26 17:51:05 -07:00
Yufei Gu
378fa3ac7d
YARN-7261. Add debug message for better download latency monitoring. (Yufei Gu)
...
(cherry picked from commit 0799fde35e
)
2017-10-20 11:49:34 -07:00
vrushali
28c54989d6
Ensuring right apis are called as per jetty version in branch2 (trunk has different jetty)
2017-10-19 22:18:17 -07:00
Wangda Tan
017ac560f0
YARN-7338. Support same origin policy for cross site scripting prevention. (Sunil G via wangda)
2017-10-19 21:48:11 -07:00
Wangda Tan
c0c124c2bf
YARN-5698. [YARN-3368] Launch new YARN UI under hadoop web app port. (Sunil G via wangda)
2017-10-18 02:06:47 +05:30
Wangda Tan
bb606e3d4b
YARN-4515. [YARN-3368] Support hosting web UI framework inside YARN RM. (Sunil G via wangda)
...
YARN-5000. [YARN-3368] App attempt page is not loading when timeline server is not started (Sunil G via wangda)
YARN-5038. [YARN-3368] Application and Container pages shows wrong values when RM is stopped. (Sunil G via wangda)
2017-10-18 02:06:46 +05:30
Varun Saxena
56e0873e22
Fix javac, javadoc and checkstyle issues before branch-2 merge.
2017-10-17 23:36:41 +05:30
Junping Du
b3201b2dab
YARN-6534. ResourceManager failed due to TimelineClient try to init SSLFactory even https is not enabled. Contributed by Rohith Sharma K S.
...
(cherry picked from commit 09e36ff59c05b8bd54d346d1103de0a7300875c6)
(cherry picked from commit 94607214ce
)
2017-10-17 23:36:40 +05:30
Jian He
cbd5e89b24
MAPREDUCE-6838. [ATSv2 Security] Add timeline delegation token received in allocate response to UGI. Contributed by Varun Saxena
...
(cherry picked from commit c6ce422a3423305ac665f80f039f61294adaa32c)
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMContainerAllocator.java
2017-10-17 23:36:40 +05:30
Rohith Sharma K S
5d9b4bd3e8
YARN-7041. Nodemanager NPE running jobs with security off. Contributed by Varun Saxena.
...
(cherry picked from commit e976bf10bb0d42e4d971358554ea736ddcdafd19)
2017-10-17 23:36:39 +05:30
Rohith Sharma K S
5a7c272e0a
YARN-6130. [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM. Contributed by Varun Saxena.
2017-10-17 23:36:39 +05:30
Varun Saxena
cb5d601b2e
Addendum for YARN-5648.
2017-10-17 23:36:39 +05:30
Jian He
8e4e5abbe6
YARN-5648. [ATSv2 Security] Client side changes for authentication. Contributed by Varun Saxena
...
(cherry picked from commit 3829100cf75e733b2b3a4e8c6806a3696f4ae658)
2017-10-17 23:36:39 +05:30
Varun Saxena
debe526f08
YARN-6342. Make TimelineV2Client's drain timeout after stop configurable (Haibo Chen via Varun Saxena)
...
(cherry picked from commit 7c2bc444b3
)
2017-10-17 23:36:37 +05:30
Varun Saxena
59d96e247e
YARN-6069. CORS support in timeline v2 (Rohith Sharma K S via Varun Saxena)
...
(cherry picked from commit ab192fd58358faff6880f3e0e867d7bdd4bb043a)
2017-10-17 23:36:36 +05:30
Sangjin Lee
bb100d35fd
YARN-4675. Reorganize TimelineClient and TimelineClientImpl into separate classes for ATSv1.x and ATSv2. Contributed by Naganarasimha G R.
...
(cherry picked from commit 73235ab30361b41293846189f3c5fef321ae7cac)
2017-10-17 23:36:36 +05:30
Sangjin Lee
5cb5b87c9a
YARN-6094. Update the coprocessor to be a dynamically loaded one. Contributed by Vrushali C.
...
(cherry picked from commit 0327a79d79a4d56d9c7cb6889886afd2272b07d3)
2017-10-17 23:36:36 +05:30
Sangjin Lee
4182f892e0
YARN-5265. Make HBase configuration for the timeline service configurable. Contributed by Joep Rottinghuis.
...
(cherry picked from commit dc7d9bac79fc303f66e97c10379d680e0c11caa4)
2017-10-17 23:36:34 +05:30
Varun Saxena
d19726ec37
YARN-3649. Allow configurable prefix for hbase table names like prod, exp, test etc (Vrushali C via Varun Saxena)
2017-10-17 23:36:34 +05:30
Sangjin Lee
e212e562ec
YARN-5355. Backported YARN-2928 into our branch-2 feature branch.
2017-10-17 23:36:33 +05:30
Junping Du
3d2ef54450
YARN-7124. LogAggregationTFileController deletes/renames while file is open. Contributed by Jason Lowe.
...
(cherry picked from commit 1fcbe7cf5f
)
2017-10-16 14:29:02 -07:00
Yufei Gu
f2350f5120
YARN-7270. Fix unsafe casting from long to int for class Resource and its sub-classes. (Yufei)
...
(cherry picked from commit 7a27c2c367
)
(cherry picked from commit dbf6c48af9
)
2017-10-13 13:10:20 -07:00
Jonathan Hung
06c8938ab0
YARN-7251. Misc changes to YARN-5734
2017-10-09 11:12:08 -07:00
Wangda Tan
887b366d5f
YARN-6840. Implement zookeeper based store for scheduler configuration updates. (Jonathan Hung via wangda)
...
Change-Id: I9debea674fe8c7e4109d4ca136965a1ea4c48bcc
2017-10-09 11:12:07 -07:00
Xuan
cd58f5da5a
YARN-5947: Create LeveldbConfigurationStore class using Leveldb as backing store. Contributed by Jonathan Hung
2017-10-09 11:12:07 -07:00
Xuan
16b27573ef
YARN-5953 addendum: Move QueueConfigInfo and SchedConfUpdateInfo to package org.apache.hadoop.yarn.webapp.dao
2017-10-09 11:12:07 -07:00
Xuan
96f4cf7cde
YARN-5953:Create CLI for changing YARN configurations. (Jonathan Hung via xgong)
2017-10-09 11:12:07 -07:00
Wangda Tan
a47823ca98
YARN-5949. Add pluggable configuration ACL policy interface and implementation. (Jonathan Hung via wangda)
...
Change-Id: Ib98e82ff753bede21fcab2e6ca9ec1e7a5a2008f
2017-10-09 11:12:07 -07:00
Jonathan Hung
072527b31a
YARN-5948. Implement MutableConfigurationManager for handling storage into configuration store
2017-10-09 11:12:07 -07:00
Naganarasimha
5cb3bd3b06
YARN-7285. ContainerExecutor always launches with priorities due to yarn-default property. Contributed by Jason Lowe.
...
(cherry picked from commit d0046bb5c6
)
2017-10-06 00:09:46 +05:30
Wangda Tan
8beae14a07
YARN-7259. Add size-based rolling policy to LogAggregationIndexedFileController. (xgong via wangda)
...
Change-Id: Ifaf82c0aee6b73b9b6ebf103aa72e131e3942f31
(cherry picked from commit 280080fad0
)
2017-10-02 15:36:11 -07:00
Wangda Tan
5fa5ba7f4d
YARN-6509. Add a size threshold beyond which yarn logs will require a force option. (Xuan Gong via wangda)
...
Change-Id: I755fe903337d4ff9ec35dae5b9cce638794e1d0f
(cherry picked from commit ec2ae3060a
)
(cherry picked from commit d58d75ca50
)
2017-09-29 16:53:16 -07:00
Jason Lowe
c0bfb385a8
YARN-7260. yarn.router.pipeline.cache-max-size is missing in yarn-default.xml. Contributed by Jason Lowe
2017-09-29 09:53:05 -05:00
Jason Lowe
913a64e4c9
YARN-7248. NM returns new SCHEDULED container status to older clients. Contributed by Arun Suresh
...
(cherry picked from commit 85d81ae58e
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/container/ContainerImpl.java
2017-09-28 14:25:01 -05:00
Xuan
c143708acf
YARN-7257. AggregatedLogsBlock reports a bad 'end' value as a bad
...
'start' value. Contributed by Jason Lowe
(cherry picked from commit 28c4957fcc
)
(cherry picked from commit 81e7872793
)
2017-09-27 16:04:06 -07:00
Rohith Sharma K S
c570ddaa66
YARN-7157. Add admin configuration to filter per-user's apps in secure cluster. Contributed by Sunil G.
2017-09-27 11:49:59 +05:30
Carlo Curino
bfd967d338
YARN-5412. Create a proxy chain for ResourceManager REST API in the Router. (Contributed by Giovanni Matteo Fumarola via curino)
...
(cherry picked from commit b6240b92ab
)
(cherry picked from commit acda6b96a4
)
2017-09-21 17:13:28 -07:00
Subru Krishnan
169037cbb4
YARN-3659. Federation: routing client invocations transparently to multiple RMs. (Giovanni Matteo Fumarola via Subru).
...
(cherry picked from commit 52daa6d971
)
(cherry picked from commit 43a97174fe
)
2017-09-21 16:55:33 -07:00
Subru Krishnan
9476d86ce8
YARN-5531. UnmanagedAM pool manager for federating application across clusters. (Botong Huang via Subru).
...
(cherry picked from commit 73bb2102ce
)
(cherry picked from commit 859aa1f9d6
)
2017-09-21 16:47:43 -07:00
Subru Krishnan
7f00f938f2
YARN-5413. Create a proxy chain for ResourceManager Admin API in the Router. (Giovanni Matteo Fumarola via Subru).
...
(cherry picked from commit 67846a5519
)
(cherry picked from commit 7444406d6d
)
2017-09-21 16:47:14 -07:00
Subru Krishnan
dc0a2e6c59
YARN-5411. Create a proxy chain for ApplicationClientProtocol in the Router. (Giovanni Matteo Fumarola via Subru).
...
(cherry picked from commit 4846069061
)
(cherry picked from commit 80e1904000
)
2017-09-21 16:43:08 -07:00
Subru Krishnan
61c07e4f3f
YARN-6247. Share a single instance of SubClusterResolver instead of instantiating one per AM. (Botong Huang via Subru)
...
(cherry picked from commit 51aeb2ce0c
)
(cherry picked from commit 86b2bec56e
)
2017-09-21 16:25:09 -07:00
Jian He
615c912b61
YARN-3673. Create a FailoverProxy for Federation services. Contributed by Subru Krishnan
...
(cherry picked from commit 3307564a5f
)
(cherry picked from commit bdfad4523f
)
2017-09-21 16:13:06 -07:00
Jian He
fb3f9b48fb
YARN-3674. Create Facade for Federation State and Policy Store. Contributed by Subru Krishnan
...
(cherry picked from commit 5e976cd2b9
)
(cherry picked from commit 5c84382397
)
2017-09-21 16:12:34 -07:00
Subru Krishnan
31d92378ba
YARN-5390. Federation Subcluster Resolver. Contributed by Ellen Hui.
...
(cherry picked from commit d3dc461a93
)
(cherry picked from commit d19b677301
)
2017-09-21 16:00:36 -07:00