Subru Krishnan
ed31091361
YARN-6128. Add support for AMRMProxy HA. (Botong Huang via Subru).
2017-11-20 14:21:58 -08:00
Varun Vasudev
9cf9627e20
YARN-7430. Enable user re-mapping for Docker containers by default. Contributed by Eric Yang.
...
(cherry picked from commit 5f0b238a11
)
2017-11-17 12:05:35 +05:30
Arun Suresh
71a55bebfb
Preparing for 2.10.0 development
2017-10-31 12:51:14 -07:00
Jason Lowe
9093ad6168
YARN-7244. ShuffleHandler is not aware of disks that are added. Contributed by Kuhu Shukla
...
(cherry picked from commit 665bb147aa
)
2017-10-27 17:09:29 -05:00
Subru Krishnan
a0dceec586
YARN-5516. Add REST API for supporting recurring reservations. (Sean Po via Subru).
...
(cherry picked from commit 25932da6d1
)
2017-10-26 20:16:01 -07:00
Robert Kanter
7c26ae506a
YARN-7262. Add a hierarchy into the ZKRMStateStore for delegation token znodes to prevent jute buffer overflow (rkanter)
...
(cherry picked from commit b1de78619f
)
2017-10-26 17:51:05 -07:00
Wangda Tan
c0c124c2bf
YARN-5698. [YARN-3368] Launch new YARN UI under hadoop web app port. (Sunil G via wangda)
2017-10-18 02:06:47 +05:30
Wangda Tan
bb606e3d4b
YARN-4515. [YARN-3368] Support hosting web UI framework inside YARN RM. (Sunil G via wangda)
...
YARN-5000. [YARN-3368] App attempt page is not loading when timeline server is not started (Sunil G via wangda)
YARN-5038. [YARN-3368] Application and Container pages shows wrong values when RM is stopped. (Sunil G via wangda)
2017-10-18 02:06:46 +05:30
Varun Saxena
56e0873e22
Fix javac, javadoc and checkstyle issues before branch-2 merge.
2017-10-17 23:36:41 +05:30
Rohith Sharma K S
138d6fc083
YARN-7140. CollectorInfo should have Public visibility. Contributed by Varun Saxena.
...
(cherry picked from commit 4a83170be4
)
2017-10-17 23:36:40 +05:30
Haibo Chen
0f51f15097
YARN-6323. Rolling upgrade/config change is broken on timeline v2. (Vrushali C via Haibo Chen)
2017-10-17 23:36:40 +05:30
Jian He
cbd5e89b24
MAPREDUCE-6838. [ATSv2 Security] Add timeline delegation token received in allocate response to UGI. Contributed by Varun Saxena
...
(cherry picked from commit c6ce422a3423305ac665f80f039f61294adaa32c)
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMContainerAllocator.java
2017-10-17 23:36:40 +05:30
Rohith Sharma K S
4e1af68ae1
YARN-7038. [Atsv2 Security] CollectorNodemanagerProtocol RPC interface doesn't work when service authorization is enabled. Contributed by Varun Saxena.
...
(cherry picked from commit 387dd3da87759860dd18bd8aa95c60d962b1e6a9)
2017-10-17 23:36:39 +05:30
Jason Lowe
db2f7dd9bd
YARN-6820. Restrict read access to timelineservice v2 data. Contributed by Vrushali C
2017-10-17 23:36:39 +05:30
Rohith Sharma K S
5a7c272e0a
YARN-6130. [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM. Contributed by Varun Saxena.
2017-10-17 23:36:39 +05:30
Varun Saxena
debe526f08
YARN-6342. Make TimelineV2Client's drain timeout after stop configurable (Haibo Chen via Varun Saxena)
...
(cherry picked from commit 7c2bc444b3
)
2017-10-17 23:36:37 +05:30
Sangjin Lee
5cb5b87c9a
YARN-6094. Update the coprocessor to be a dynamically loaded one. Contributed by Vrushali C.
...
(cherry picked from commit 0327a79d79a4d56d9c7cb6889886afd2272b07d3)
2017-10-17 23:36:36 +05:30
Varun Saxena
d12920b10e
YARN-6074. FlowRunEntity does not deserialize long values correctly (Rohith Sharma K S via Varun Saxena)
...
(cherry picked from commit db490eccce
)
2017-10-17 23:36:36 +05:30
Varun Saxena
1e5e4a52f7
YARN-5585. [Atsv2] Reader side changes for entity prefix and support for pagination via additional filters (Rohith Sharma K S via Varun Saxena)
...
(cherry picked from commit 9a2f288a6a9e30376b7fd99bf8824184a34a54c9)
2017-10-17 23:36:35 +05:30
Sangjin Lee
54705f549f
YARN-5922. Remove direct references of HBaseTimelineWriter/Reader in core ATS classes. Contributed by Haibo Chen.
...
(cherry picked from commit a5a55a54ab
)
(cherry picked from commit 17c4ab7ebb51088caf36fafedae8c256481eeed5)
2017-10-17 23:36:35 +05:30
Sangjin Lee
4182f892e0
YARN-5265. Make HBase configuration for the timeline service configurable. Contributed by Joep Rottinghuis.
...
(cherry picked from commit dc7d9bac79fc303f66e97c10379d680e0c11caa4)
2017-10-17 23:36:34 +05:30
Sangjin Lee
ebf2f90528
YARN-5715. Introduce entity prefix for return and sort order. Contributed by Rohith Sharma K S.
...
(cherry picked from commit f37288c7e0127b564645e978c7aab2a186fa6be6)
2017-10-17 23:36:34 +05:30
Varun Saxena
d19726ec37
YARN-3649. Allow configurable prefix for hbase table names like prod, exp, test etc (Vrushali C via Varun Saxena)
2017-10-17 23:36:34 +05:30
Li Lu
6a517d714e
YARN-5229. Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImpl. (Vrushali C via gtcarrera9)
...
(cherry picked from commit 5d7ad396dbf84ffb0bacb3372d149828dfb4b4ca)
2017-10-17 23:36:34 +05:30
Sangjin Lee
e212e562ec
YARN-5355. Backported YARN-2928 into our branch-2 feature branch.
2017-10-17 23:36:33 +05:30
Yufei Gu
f2350f5120
YARN-7270. Fix unsafe casting from long to int for class Resource and its sub-classes. (Yufei)
...
(cherry picked from commit 7a27c2c367
)
(cherry picked from commit dbf6c48af9
)
2017-10-13 13:10:20 -07:00
Jonathan Hung
06c8938ab0
YARN-7251. Misc changes to YARN-5734
2017-10-09 11:12:08 -07:00
Wangda Tan
887b366d5f
YARN-6840. Implement zookeeper based store for scheduler configuration updates. (Jonathan Hung via wangda)
...
Change-Id: I9debea674fe8c7e4109d4ca136965a1ea4c48bcc
2017-10-09 11:12:07 -07:00
Xuan
cd58f5da5a
YARN-5947: Create LeveldbConfigurationStore class using Leveldb as backing store. Contributed by Jonathan Hung
2017-10-09 11:12:07 -07:00
Wangda Tan
a47823ca98
YARN-5949. Add pluggable configuration ACL policy interface and implementation. (Jonathan Hung via wangda)
...
Change-Id: Ib98e82ff753bede21fcab2e6ca9ec1e7a5a2008f
2017-10-09 11:12:07 -07:00
Jonathan Hung
072527b31a
YARN-5948. Implement MutableConfigurationManager for handling storage into configuration store
2017-10-09 11:12:07 -07:00
Arun Suresh
cb91bb3c96
YARN-7258. Add Node and Rack Hints to Opportunistic Scheduler. (Kartheek Muthyala via asuresh).
...
(cherry picked from commit b733348dde
)
2017-10-05 15:22:20 -07:00
Subru Krishnan
7836a6b59a
YARN-2037. Add work preserving restart support for Unmanaged AMs. (Botong Huang via Subru)
2017-10-04 16:29:08 -07:00
Jason Lowe
913a64e4c9
YARN-7248. NM returns new SCHEDULED container status to older clients. Contributed by Arun Suresh
...
(cherry picked from commit 85d81ae58e
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/container/ContainerImpl.java
2017-09-28 14:25:01 -05:00
Rohith Sharma K S
c570ddaa66
YARN-7157. Add admin configuration to filter per-user's apps in secure cluster. Contributed by Sunil G.
2017-09-27 11:49:59 +05:30
Carlo Curino
88b32edb8f
YARN-7010. Federation: routing REST invocations transparently to multiple RMs (part 2 - getApps). (Contributed by Giovanni Matteo Fumarola via curino)
...
(cherry picked from commit cc8893edc0
)
2017-09-21 18:09:44 -07:00
Subru Krishnan
261f769d79
YARN-6900. ZooKeeper based implementation of the FederationStateStore. (Íñigo Goiri via Subru).
...
(cherry picked from commit de462da04e
)
2017-09-21 18:09:23 -07:00
Carlo Curino
8220b19af7
YARN-6896. Federation: routing REST invocations transparently to multiple RMs (part 1 - basic execution). (Contributed by Giovanni Matteo Fumarola via curino)
...
(cherry picked from commit cc59b5fb26
)
2017-09-21 18:09:07 -07:00
Carlo Curino
bfd967d338
YARN-5412. Create a proxy chain for ResourceManager REST API in the Router. (Contributed by Giovanni Matteo Fumarola via curino)
...
(cherry picked from commit b6240b92ab
)
(cherry picked from commit acda6b96a4
)
2017-09-21 17:13:28 -07:00
Subru Krishnan
049f7c84a1
YARN-6866. Minor clean-up and fixes in anticipation of YARN-2915 merge with trunk. (Botong Huang via Subru).
...
(cherry picked from commit 40453879ec
)
(cherry picked from commit 86f05c3312
)
2017-09-21 16:55:43 -07:00
Subru Krishnan
169037cbb4
YARN-3659. Federation: routing client invocations transparently to multiple RMs. (Giovanni Matteo Fumarola via Subru).
...
(cherry picked from commit 52daa6d971
)
(cherry picked from commit 43a97174fe
)
2017-09-21 16:55:33 -07:00
Subru Krishnan
7f00f938f2
YARN-5413. Create a proxy chain for ResourceManager Admin API in the Router. (Giovanni Matteo Fumarola via Subru).
...
(cherry picked from commit 67846a5519
)
(cherry picked from commit 7444406d6d
)
2017-09-21 16:47:14 -07:00
Subru Krishnan
dc0a2e6c59
YARN-5411. Create a proxy chain for ApplicationClientProtocol in the Router. (Giovanni Matteo Fumarola via Subru).
...
(cherry picked from commit 4846069061
)
(cherry picked from commit 80e1904000
)
2017-09-21 16:43:08 -07:00
Carlo Curino
3c5dfa0fe5
YARN-3663. Federation State and Policy Store (DBMS implementation). (Giovanni Matteo Fumarola via curino).
...
(cherry picked from commit be99c1fe2e
)
(cherry picked from commit 5272af8c7e
)
2017-09-21 16:33:31 -07:00
Subru Krishnan
61c07e4f3f
YARN-6247. Share a single instance of SubClusterResolver instead of instantiating one per AM. (Botong Huang via Subru)
...
(cherry picked from commit 51aeb2ce0c
)
(cherry picked from commit 86b2bec56e
)
2017-09-21 16:25:09 -07:00
Subru Krishnan
d32ffa9e5e
YARN-5676. Add a HashBasedRouterPolicy, and small policies and test refactoring. (Carlo Curino via Subru).
...
(cherry picked from commit 575137f41c
)
(cherry picked from commit 4128c9522d
)
2017-09-21 16:23:45 -07:00
Subru Krishnan
d87d2b546e
YARN-5634. Simplify initialization/use of RouterPolicy via a RouterPolicyFacade. (Carlo Curino via Subru).
...
(cherry picked from commit d7672ce2bd
)
(cherry picked from commit 083a05bc14
)
2017-09-21 16:23:44 -07:00
Jian He
aac8755125
YARN-5601. Make the RM epoch base value configurable. Contributed by Subru Krishnan
...
(cherry picked from commit 9ca2aba9cc
)
(cherry picked from commit 2797507d51
)
2017-09-21 16:23:40 -07:00
Jian He
ea2ecdb796
YARN-3671. Integrate Federation services with ResourceManager. Contributed by Subru Krishnan
...
(cherry picked from commit 8573c286e2
)
(cherry picked from commit 94a24567d6
)
2017-09-21 16:23:33 -07:00
Jian He
615c912b61
YARN-3673. Create a FailoverProxy for Federation services. Contributed by Subru Krishnan
...
(cherry picked from commit 3307564a5f
)
(cherry picked from commit bdfad4523f
)
2017-09-21 16:13:06 -07:00