Commit Graph

16568 Commits

Author SHA1 Message Date
Rohith Sharma K S 6e698f4228 YARN-6130. [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM. Contributed by Varun Saxena. 2017-08-30 01:18:44 +05:30
Varun Saxena 99781dabff YARN-6734. Ensure sub-application user is extracted & sent to timeline service (Rohith Sharma K S via Varun Saxena) 2017-08-30 01:18:44 +05:30
Rohith Sharma K S afb151456d YARN-6888. Refactor AppLevelTimelineCollector such that RM does not have aggregator threads created. Contributed by Vrushali C. 2017-08-30 01:18:44 +05:30
Rohith Sharma K S 952dd49f18 YARN-6733. Add table for storing sub-application entities. Contributed by Vrushali C. 2017-08-30 01:18:44 +05:30
Vrushali C 986f1e4f3c YARN-6850 Ensure that supplemented timestamp is stored only for flow run metrics (Contributed by Varun Saxena via Vrushali C) 2017-08-30 01:18:44 +05:30
Rohith Sharma K S f5bb5edbfb YARN-4455. Support fetching metrics by time range. Contributed by Varun Saxena. 2017-08-30 01:18:44 +05:30
Rohith Sharma K S 343e4cfad2 YARN-6801. NPE in RM while setting collectors map in NodeHeartbeatResponse. Contributed by Vrushali C. 2017-08-30 01:18:44 +05:30
Jian He 1eeb2a123b YARN-5648. [ATSv2 Security] Client side changes for authentication. Contributed by Varun Saxena 2017-08-30 01:18:43 +05:30
Jian He 4387014771 YARN-6638. [ATSv2 Security] Timeline reader side changes for loading auth filters and principals. Contributed by Varun Saxena 2017-08-30 01:18:43 +05:30
Jian He 5d3ef2fbc6 YARN-5647. [ATSv2 Security] Collector side changes for loading auth filters and principals. Contributed by Varun Saxena 2017-08-30 01:18:43 +05:30
vrushali d329a01e53 YARN-6316 Provide help information and documentation for TimelineSchemaCreator (Contributed by Haibo Chen via Vrushali C) 2017-08-30 01:18:43 +05:30
Varun Saxena f39bd3a0cd YARN-6658. Remove columnFor() methods of Columns in HBaseTimeline backend (Haibo Chen via Varun Saxena) 2017-08-30 01:18:43 +05:30
Haibo Chen 9239c5f757 YARN-6555. Store application flow context in NM state store for work-preserving restart. (Rohith Sharma K S via Haibo Chen)
(cherry picked from commit 47474fffac)
2017-08-30 01:18:43 +05:30
Varun Saxena a9c0bb319a YARN-6146. Add Builder methods for TimelineEntityFilters (Haibo Chen via Varun Saxena) 2017-08-30 01:18:43 +05:30
Varun Saxena 583250ee45 YARN-6318. timeline service schema creator fails if executed from a remote machine (Sangjin Lee via Varun Saxena) 2017-08-30 01:18:43 +05:30
Varun Saxena 16c1bffbea YARN-6237. Move UID constant to TimelineReaderUtils (Rohith Sharma K S via Varun Saxena) 2017-08-30 01:18:43 +05:30
Varun Saxena 0b076bc509 YARN-6256. Add FROM_ID info key for timeline entities in reader response (Rohith Sharma K S via Varun Saxena) 2017-08-30 01:18:43 +05:30
Varun Saxena f9a18eac12 YARN-6027. Support fromid(offset) filter for /flows API (Rohith Sharma K S via Varun Saxena) 2017-08-30 01:18:43 +05:30
Sangjin Lee 600ca8e6ac YARN-6253. FlowAcitivityColumnPrefix.store(byte[] rowKey, ...) drops timestamp. Contributed by Haibo Chen. 2017-08-30 01:18:43 +05:30
Varun Saxena 77a3c926e4 YARN-6069. CORS support in timeline v2 (Rohith Sharma K S via Varun Saxena) 2017-08-30 01:18:43 +05:30
Sangjin Lee 2d5434fd82 YARN-4675. Reorganize TimelineClient and TimelineClientImpl into separate classes for ATSv1.x and ATSv2. Contributed by Naganarasimha G R. 2017-08-30 01:18:43 +05:30
Sangjin Lee 0ec7eb90ea YARN-5928. Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers. Contributed by Haibo Chen. 2017-08-30 01:18:42 +05:30
Sangjin Lee 101454c9c1 YARN-6094. Update the coprocessor to be a dynamically loaded one. Contributed by Vrushali C. 2017-08-30 01:18:42 +05:30
Varun Saxena 7b56ad6ff0 Addendum for YARN-6064. Support fromId for flowRuns and flow/flowRun apps REST API's 2017-08-30 01:18:42 +05:30
Varun Saxena 83e357860c YARN-6064. Support fromId for flowRuns and flow/flowRun apps REST API's (Rohith Sharma K S via Varun Saxena) 2017-08-30 01:18:42 +05:30
Varun Saxena 1bc9b6a823 YARN-5378. Accommodate app-id->cluster mapping (Sangjin Lee via Varun Saxena) 2017-08-30 01:18:42 +05:30
Sangjin Lee bb37b5da0d YARN-5980. Update documentation for single node hbase deploy. Contributed by Vrushali C. 2017-08-30 01:18:42 +05:30
Varun Saxena 2d42d0fea4 YARN-5585. [Atsv2] Reader side changes for entity prefix and support for pagination via additional filters (Rohith Sharma K S via Varun Saxena) 2017-08-30 01:18:42 +05:30
Sangjin Lee ef7e48072c YARN-5925. Extract hbase-backend-exclusive utility methods from TimelineStorageUtil. Contributed by Haibo Chen. 2017-08-30 01:18:42 +05:30
Sangjin Lee 4aa6f0059c MAPREDUCE-6818. Remove direct reference to TimelineClientImpl. Contributed by Li Lu. 2017-08-30 01:18:42 +05:30
Sangjin Lee 6f64182c9d YARN-5922. Remove direct references of HBaseTimelineWriter/Reader in core ATS classes. Contributed by Haibo Chen.
(cherry picked from commit a5a55a54ab)
2017-08-30 01:18:42 +05:30
Sangjin Lee 27b8a3fc75 YARN-5739. Provide timeline reader API to list available timeline entity types for one application. Contributed by Li Lu. 2017-08-30 01:18:42 +05:30
Sangjin Lee c3d6c7494f YARN-5792. Adopt the id prefix for YARN, MR, and DS entities. Contributed by Varun Saxena. 2017-08-30 01:18:42 +05:30
Varun Saxena 25d5b02897 YARN-3359. Addendum for Recover collector list when RM fails over (Li Lu via Varun Saxena) 2017-08-30 01:18:42 +05:30
Varun Saxena 4daf363dca YARN-3359. Recover collector list when RM fails over (Li Lu via Varun Saxena) 2017-08-30 01:18:41 +05:30
Sangjin Lee f7eb6c5c72 YARN-5265. Make HBase configuration for the timeline service configurable. Contributed by Joep Rottinghuis. 2017-08-30 01:18:41 +05:30
Sangjin Lee 4b2a5964bd YARN-5715. Introduce entity prefix for return and sort order. Contributed by Rohith Sharma K S. 2017-08-30 01:18:41 +05:30
Varun Saxena a2b195ee8d YARN-3649. Allow configurable prefix for hbase table names like prod, exp, test etc (Vrushali C via Varun Saxena) 2017-08-30 01:18:41 +05:30
Sangjin Lee 7da18ade28 YARN-5638. Introduce a collector timestamp to uniquely identify collectors creation order in collector discovery. Contributed by Li Lu. 2017-08-30 01:18:41 +05:30
Li Lu 90e85c9897 YARN-5229. Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImpl. (Vrushali C via gtcarrera9) 2017-08-30 01:18:41 +05:30
Sangjin Lee b1682d57ec YARN-5156. YARN_CONTAINER_FINISHED of YARN_CONTAINERs will always have running state (Vrushali C via sjlee) 2017-08-30 01:18:41 +05:30
Manoj Govindassamy 63fc1b0b6d HDFS-11912. Snapshot functionality test along with randomized file IO operations. (George Huang via Manoj Govindassamy) 2017-08-29 11:27:47 -07:00
Steve Loughran 9374f38820
HADOOP-14583. wasb throws an exception if you try to create a file and there's no parent directory
Contributed by Esfandiar Manii and Thomas Marquardt.
2017-08-29 19:03:44 +01:00
Steve Loughran 021974f4cb
HADOOP-14802. Add support for using container saskeys for all accesses.
Contributed by Sivaguru Sankaridurg
2017-08-29 19:02:43 +01:00
Jason Lowe 1f6dc4ee9a YARN-5816. TestDelegationTokenRenewer#testCancelWithMultipleAppSubmissions is still flakey. Contributed by Robert Kanter 2017-08-29 09:52:24 -05:00
Akira Ajisaka 33afa94af1
HADOOP-14671. Upgrade to Apache Yetus 0.5.0. 2017-08-29 13:36:22 +02:00
Sunil G 7ddc7aa26e YARN-6386. Show decommissioning nodes in new YARN UI. Contributed by Elek Marton. 2017-08-29 16:51:14 +05:30
Junping Du 312b1fd9da YARN-7076. yarn application -list -appTypes is not working. Contributed by Jian He. 2017-08-28 18:26:51 -07:00
Arpit Agarwal a1e3f84afe HDFS-12293. DataNode should log file name on disk error. Contributed by Ajay Kumar. 2017-08-28 15:49:59 -07:00
Wangda Tan 51881a863c YARN-7112. TestAMRMProxy is failing with invalid request. (Jason Lowe via wangda)
Change-Id: I432f4523921666ac218fcf9936f826a0d8d635e0
2017-08-28 11:37:35 -07:00