Commit Graph

16581 Commits

Author SHA1 Message Date
Varun Saxena e52f26e5cf YARN-6905. Addendum to fix TestTimelineReaderWebServicesHBaseStorage due to missing FastNumberFormat 2017-08-30 01:18:45 +05:30
Varun Saxena 92b14f3bd6 MAPREDUCE-6838. Addendum to fix code comment 2017-08-30 01:18:45 +05:30
Jian He 3fe0a6fd6e MAPREDUCE-6838. [ATSv2 Security] Add timeline delegation token received in allocate response to UGI. Contributed by Varun Saxena 2017-08-30 01:18:45 +05:30
Vrushali C e9f2c26540 YARN-6047 Documentation updates for TimelineService v2 (Contributed by Rohith Sharma) 2017-08-30 01:18:45 +05:30
Haibo Chen 709ed0533a YARN-6323. Rolling upgrade/config change is broken on timeline v2. (Vrushali C via Haibo Chen) 2017-08-30 01:18:45 +05:30
Varun Saxena 393b745d25 YARN-6861. Reader API for sub application entities (Rohith Sharma K S via Varun Saxena) 2017-08-30 01:18:45 +05:30
Jian He f7f4ad98da YARN-6134. [ATSv2 Security] Regenerate delegation token for app just before token expires if app collector is active. Contributed by Varun Saxena 2017-08-30 01:18:44 +05:30
Rohith Sharma K S 352307073d YARN-7041. Nodemanager NPE running jobs with security off. Contributed by Varun Saxena. 2017-08-30 01:18:44 +05:30
Rohith Sharma K S a3cb780300 YARN-7038. [Atsv2 Security] CollectorNodemanagerProtocol RPC interface doesn't work when service authorization is enabled. Contributed by Varun Saxena. 2017-08-30 01:18:44 +05:30
Jian He a8265accdc YARN-7006. [ATSv2 Security] Changes for authentication for CollectorNodemanagerProtocol. Contributed by Varun Saxena 2017-08-30 01:18:44 +05:30
Jason Lowe 835787f8c1 YARN-6820. Restrict read access to timelineservice v2 data. Contributed by Vrushali C 2017-08-30 01:18:44 +05:30
Varun Saxena 7ddaf6198e YARN-6874. Supplement timestamp for min start/max end time columns in flow run table to avoid overwrite (Vrushali C via Varun Saxena) 2017-08-30 01:18:44 +05:30
Rohith Sharma K S 166b1236a8 YARN-6133. [ATSv2 Security] Renew delegation token for app automatically if an app collector is active. Contributed by Varun Saxena. 2017-08-30 01:18:44 +05:30
Rohith Sharma K S 6e698f4228 YARN-6130. [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM. Contributed by Varun Saxena. 2017-08-30 01:18:44 +05:30
Varun Saxena 99781dabff YARN-6734. Ensure sub-application user is extracted & sent to timeline service (Rohith Sharma K S via Varun Saxena) 2017-08-30 01:18:44 +05:30
Rohith Sharma K S afb151456d YARN-6888. Refactor AppLevelTimelineCollector such that RM does not have aggregator threads created. Contributed by Vrushali C. 2017-08-30 01:18:44 +05:30
Rohith Sharma K S 952dd49f18 YARN-6733. Add table for storing sub-application entities. Contributed by Vrushali C. 2017-08-30 01:18:44 +05:30
Vrushali C 986f1e4f3c YARN-6850 Ensure that supplemented timestamp is stored only for flow run metrics (Contributed by Varun Saxena via Vrushali C) 2017-08-30 01:18:44 +05:30
Rohith Sharma K S f5bb5edbfb YARN-4455. Support fetching metrics by time range. Contributed by Varun Saxena. 2017-08-30 01:18:44 +05:30
Rohith Sharma K S 343e4cfad2 YARN-6801. NPE in RM while setting collectors map in NodeHeartbeatResponse. Contributed by Vrushali C. 2017-08-30 01:18:44 +05:30
Jian He 1eeb2a123b YARN-5648. [ATSv2 Security] Client side changes for authentication. Contributed by Varun Saxena 2017-08-30 01:18:43 +05:30
Jian He 4387014771 YARN-6638. [ATSv2 Security] Timeline reader side changes for loading auth filters and principals. Contributed by Varun Saxena 2017-08-30 01:18:43 +05:30
Jian He 5d3ef2fbc6 YARN-5647. [ATSv2 Security] Collector side changes for loading auth filters and principals. Contributed by Varun Saxena 2017-08-30 01:18:43 +05:30
vrushali d329a01e53 YARN-6316 Provide help information and documentation for TimelineSchemaCreator (Contributed by Haibo Chen via Vrushali C) 2017-08-30 01:18:43 +05:30
Varun Saxena f39bd3a0cd YARN-6658. Remove columnFor() methods of Columns in HBaseTimeline backend (Haibo Chen via Varun Saxena) 2017-08-30 01:18:43 +05:30
Haibo Chen 9239c5f757 YARN-6555. Store application flow context in NM state store for work-preserving restart. (Rohith Sharma K S via Haibo Chen)
(cherry picked from commit 47474fffac)
2017-08-30 01:18:43 +05:30
Varun Saxena a9c0bb319a YARN-6146. Add Builder methods for TimelineEntityFilters (Haibo Chen via Varun Saxena) 2017-08-30 01:18:43 +05:30
Varun Saxena 583250ee45 YARN-6318. timeline service schema creator fails if executed from a remote machine (Sangjin Lee via Varun Saxena) 2017-08-30 01:18:43 +05:30
Varun Saxena 16c1bffbea YARN-6237. Move UID constant to TimelineReaderUtils (Rohith Sharma K S via Varun Saxena) 2017-08-30 01:18:43 +05:30
Varun Saxena 0b076bc509 YARN-6256. Add FROM_ID info key for timeline entities in reader response (Rohith Sharma K S via Varun Saxena) 2017-08-30 01:18:43 +05:30
Varun Saxena f9a18eac12 YARN-6027. Support fromid(offset) filter for /flows API (Rohith Sharma K S via Varun Saxena) 2017-08-30 01:18:43 +05:30
Sangjin Lee 600ca8e6ac YARN-6253. FlowAcitivityColumnPrefix.store(byte[] rowKey, ...) drops timestamp. Contributed by Haibo Chen. 2017-08-30 01:18:43 +05:30
Varun Saxena 77a3c926e4 YARN-6069. CORS support in timeline v2 (Rohith Sharma K S via Varun Saxena) 2017-08-30 01:18:43 +05:30
Sangjin Lee 2d5434fd82 YARN-4675. Reorganize TimelineClient and TimelineClientImpl into separate classes for ATSv1.x and ATSv2. Contributed by Naganarasimha G R. 2017-08-30 01:18:43 +05:30
Sangjin Lee 0ec7eb90ea YARN-5928. Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers. Contributed by Haibo Chen. 2017-08-30 01:18:42 +05:30
Sangjin Lee 101454c9c1 YARN-6094. Update the coprocessor to be a dynamically loaded one. Contributed by Vrushali C. 2017-08-30 01:18:42 +05:30
Varun Saxena 7b56ad6ff0 Addendum for YARN-6064. Support fromId for flowRuns and flow/flowRun apps REST API's 2017-08-30 01:18:42 +05:30
Varun Saxena 83e357860c YARN-6064. Support fromId for flowRuns and flow/flowRun apps REST API's (Rohith Sharma K S via Varun Saxena) 2017-08-30 01:18:42 +05:30
Varun Saxena 1bc9b6a823 YARN-5378. Accommodate app-id->cluster mapping (Sangjin Lee via Varun Saxena) 2017-08-30 01:18:42 +05:30
Sangjin Lee bb37b5da0d YARN-5980. Update documentation for single node hbase deploy. Contributed by Vrushali C. 2017-08-30 01:18:42 +05:30
Varun Saxena 2d42d0fea4 YARN-5585. [Atsv2] Reader side changes for entity prefix and support for pagination via additional filters (Rohith Sharma K S via Varun Saxena) 2017-08-30 01:18:42 +05:30
Sangjin Lee ef7e48072c YARN-5925. Extract hbase-backend-exclusive utility methods from TimelineStorageUtil. Contributed by Haibo Chen. 2017-08-30 01:18:42 +05:30
Sangjin Lee 4aa6f0059c MAPREDUCE-6818. Remove direct reference to TimelineClientImpl. Contributed by Li Lu. 2017-08-30 01:18:42 +05:30
Sangjin Lee 6f64182c9d YARN-5922. Remove direct references of HBaseTimelineWriter/Reader in core ATS classes. Contributed by Haibo Chen.
(cherry picked from commit a5a55a54ab)
2017-08-30 01:18:42 +05:30
Sangjin Lee 27b8a3fc75 YARN-5739. Provide timeline reader API to list available timeline entity types for one application. Contributed by Li Lu. 2017-08-30 01:18:42 +05:30
Sangjin Lee c3d6c7494f YARN-5792. Adopt the id prefix for YARN, MR, and DS entities. Contributed by Varun Saxena. 2017-08-30 01:18:42 +05:30
Varun Saxena 25d5b02897 YARN-3359. Addendum for Recover collector list when RM fails over (Li Lu via Varun Saxena) 2017-08-30 01:18:42 +05:30
Varun Saxena 4daf363dca YARN-3359. Recover collector list when RM fails over (Li Lu via Varun Saxena) 2017-08-30 01:18:41 +05:30
Sangjin Lee f7eb6c5c72 YARN-5265. Make HBase configuration for the timeline service configurable. Contributed by Joep Rottinghuis. 2017-08-30 01:18:41 +05:30
Sangjin Lee 4b2a5964bd YARN-5715. Introduce entity prefix for return and sort order. Contributed by Rohith Sharma K S. 2017-08-30 01:18:41 +05:30