Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
13,935 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

13935 Commits

Author SHA1 Message Date
Varun Saxena 4a3a4aaf7e YARN-6159. Documentation changes for TimelineV2Client (Naganarasimha G R via Varun Saxena) 
(cherry picked from commit 6ba61d20d3)
 2017-10-17 23:36:36 +05:30
Varun Saxena 74e43bf287 YARN-6170. TimelineReaderServer should wait to join with HttpServer2 (Sangjin Lee via Varun Saxena) 
(cherry picked from commit 649deb72fb)
 2017-10-17 23:36:36 +05:30
Sangjin Lee bb100d35fd YARN-4675. Reorganize TimelineClient and TimelineClientImpl into separate classes for ATSv1.x and ATSv2. Contributed by Naganarasimha G R. 
(cherry picked from commit 73235ab30361b41293846189f3c5fef321ae7cac)
 2017-10-17 23:36:36 +05:30
Sangjin Lee a16a684fbb YARN-5928. Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers. Contributed by Haibo Chen. 
(cherry picked from commit b92089c0e8ab1b87b8b5b55b1e3d4367ae5d847a)
 2017-10-17 23:36:36 +05:30
Sangjin Lee 5cb5b87c9a YARN-6094. Update the coprocessor to be a dynamically loaded one. Contributed by Vrushali C. 
(cherry picked from commit 0327a79d79a4d56d9c7cb6889886afd2272b07d3)
 2017-10-17 23:36:36 +05:30
Varun Saxena 8c81f7fc08 Addendum for YARN-6064. Support fromId for flowRuns and flow/flowRun apps REST API's 
(cherry picked from commit c9246f619104bff44dd453a4ffe70104d37fd781)
 2017-10-17 23:36:36 +05:30
Varun Saxena aa09001a33 YARN-6064. Support fromId for flowRuns and flow/flowRun apps REST API's (Rohith Sharma K S via Varun Saxena) 
(cherry picked from commit 4b1ba4ea314147f8a06cc4f446c1d9336de89fc1)
 2017-10-17 23:36:36 +05:30
Varun Saxena 3429517a00 YARN-5378. Accommodate app-id->cluster mapping (Sangjin Lee via Varun Saxena) 
(cherry picked from commit 6baea680ba6e5df6f254ced086d6defa64fb99f0)
 2017-10-17 23:36:36 +05:30
Sangjin Lee 5b3ef55f5f YARN-5980. Update documentation for single node hbase deploy. Contributed by Vrushali C. 
(cherry picked from commit e1bdba77888723b435a235a96c8659029afd25d5)
 2017-10-17 23:36:36 +05:30
Varun Saxena d12920b10e YARN-6074. FlowRunEntity does not deserialize long values correctly (Rohith Sharma K S via Varun Saxena) 
(cherry picked from commit db490eccce)
 2017-10-17 23:36:36 +05:30
Varun Saxena 1e5e4a52f7 YARN-5585. [Atsv2] Reader side changes for entity prefix and support for pagination via additional filters (Rohith Sharma K S via Varun Saxena) 
(cherry picked from commit 9a2f288a6a9e30376b7fd99bf8824184a34a54c9)
 2017-10-17 23:36:35 +05:30
Naganarasimha d3ef478955 YARN-6026. A couple of spelling errors in the docs. Contributed by Grant Sohn. 2017-10-17 23:36:35 +05:30
Sangjin Lee 6aa7510681 YARN-5976. Update hbase version to 1.2. Contributed by Vrushali C. 
(cherry picked from commit f945008d1cf5730bdebeae501ed0e42477ad219e)
 2017-10-17 23:36:35 +05:30
Sangjin Lee 3394cb25d2 YARN-5925. Extract hbase-backend-exclusive utility methods from TimelineStorageUtil. Contributed by Haibo Chen. 
(cherry picked from commit 8288030cb4aa3b5a9425cc0a3f6df03a3eae1dfb)
 2017-10-17 23:36:35 +05:30
Sangjin Lee c8a8e680bd MAPREDUCE-6818. Remove direct reference to TimelineClientImpl. Contributed by Li Lu. 
(cherry picked from commit 6217b87f4a056cf704cef2e073b386b7803415de)
 2017-10-17 23:36:35 +05:30
Sangjin Lee 54705f549f YARN-5922. Remove direct references of HBaseTimelineWriter/Reader in core ATS classes. Contributed by Haibo Chen. 
(cherry picked from commit a5a55a54ab)
(cherry picked from commit 17c4ab7ebb51088caf36fafedae8c256481eeed5)
 2017-10-17 23:36:35 +05:30
Naganarasimha a5371f6b6e YARN-5572. HBaseTimelineWriterImpl appears to reference a bad property name. Contributed by Varun Saxena. 
(cherry picked from commit c06114d6a3)
 2017-10-17 23:36:35 +05:30
Sangjin Lee d6d73e3c99 YARN-5433. Audit dependencies for Category-X. Contributed by Sangjin Lee. 
(cherry picked from commit f511cc89b6)
 2017-10-17 23:36:35 +05:30
Sangjin Lee 4f595889e7 YARN-5739. Provide timeline reader API to list available timeline entity types for one application. Contributed by Li Lu. 
(cherry picked from commit 3b2e80881eaeaa82667496d706496765ed7e29f5)
 2017-10-17 23:36:35 +05:30
Vrushali Channapattan 2fa2c3169e YARN-4765 Split TestHBaseTimelineStorage into multiple test classes (Varun Saxena via Vrushali C) 
(cherry picked from commit 513dcf6817dd76fde8096ff04cd888d7c908461d)
(cherry picked from commit 022bf783aa)
 2017-10-17 23:36:35 +05:30
Sangjin Lee b8cfb4fcb3 YARN-5792. Adopt the id prefix for YARN, MR, and DS entities. Contributed by Varun Saxena. 
(cherry picked from commit f734977b27a514ce0561638c0a6a17b1ef093026)
 2017-10-17 23:36:35 +05:30
Varun Saxena 684c2d149f YARN-3359. Addendum for Recover collector list when RM fails over (Li Lu via Varun Saxena) 
(cherry picked from commit 25b19178dd53bc0d57ca5fd64d3464af7b59e588)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeManager.java
 2017-10-17 23:36:35 +05:30
Varun Saxena 484b1d2ec1 YARN-5599. Publish AM launch command to ATS (Rohith Sharma K S via Varun Saxena) 2017-10-17 23:36:34 +05:30
Varun Saxena 6562a354a9 YARN-3359. Recover collector list when RM fails over (Li Lu via Varun Saxena) 
(cherry picked from commit 1c8a57550b)
 2017-10-17 23:36:34 +05:30
Sangjin Lee 4182f892e0 YARN-5265. Make HBase configuration for the timeline service configurable. Contributed by Joep Rottinghuis. 
(cherry picked from commit dc7d9bac79fc303f66e97c10379d680e0c11caa4)
 2017-10-17 23:36:34 +05:30
Sangjin Lee ebf2f90528 YARN-5715. Introduce entity prefix for return and sort order. Contributed by Rohith Sharma K S. 
(cherry picked from commit f37288c7e0127b564645e978c7aab2a186fa6be6)
 2017-10-17 23:36:34 +05:30
Varun Saxena d19726ec37 YARN-3649. Allow configurable prefix for hbase table names like prod, exp, test etc (Vrushali C via Varun Saxena) 2017-10-17 23:36:34 +05:30
Varun Saxena 1d7fc52578 YARN-5747. Application timeline metric aggregation in timeline v2 will lose last round aggregation when an application finishes (Li Lu via Varun Saxena) 2017-10-17 23:36:34 +05:30
Sangjin Lee 3344f0ace5 YARN-5561. [Atsv2] : Support for ability to retrieve apps/app-attempt/containers and entities via REST. Contributed by Rohith Sharma K S. 
(cherry picked from commit e9c4616b5e)
 2017-10-17 23:36:34 +05:30
Varun Saxena c3db98aa10 YARN-5743. [Atsv2] Publish queue name and RMAppMetrics to ATS (Rohith Sharma K S via Varun Saxena) 2017-10-17 23:36:34 +05:30
Sangjin Lee 853a5da041 YARN-5699. Retrospect yarn entity fields which are publishing in events info fields. Contributed by Rohith Sharma K S. 
(cherry picked from commit 787d5942003a5441ba455a79fa08da28f60d5777)
 2017-10-17 23:36:34 +05:30
Sangjin Lee 4675f22e6a YARN-5638. Introduce a collector timestamp to uniquely identify collectors creation order in collector discovery. Contributed by Li Lu. 
(cherry picked from commit 0c1863144649ea265da65ce25158707cc3a3fb4a)
 2017-10-17 23:36:34 +05:30
Li Lu 6a517d714e YARN-5229. Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImpl. (Vrushali C via gtcarrera9) 
(cherry picked from commit 5d7ad396dbf84ffb0bacb3372d149828dfb4b4ca)
 2017-10-17 23:36:34 +05:30
Sangjin Lee 51102019f5 YARN-5156. YARN_CONTAINER_FINISHED of YARN_CONTAINERs will always have running state (Vrushali C via sjlee) 
(cherry picked from commit d0a62d8adf86f7cb2481940d212788cc5f327367)
 2017-10-17 23:36:34 +05:30
Sangjin Lee 4f6ba3187b YARN-5379. TestHBaseTimelineStorage. testWriteApplicationToHBase() fails intermittently (Vrushali C via sjlee) 
(cherry picked from commit e549a9af31)
 2017-10-17 23:36:34 +05:30
Naganarasimha 22f5046acb YARN-5364. timelineservice modules have indirect dependencies on mapreduce artifacts. Contributed by Sangjin Lee 
(cherry picked from commit af8f480c24)
 2017-10-17 23:36:34 +05:30
Varun Saxena 057a4728ff YARN-5359. FileSystemTimelineReader/Writer uses unix-specific default storage path (Sangjin Lee via Varun Saxena) 
(cherry picked from commit 56142171b9)
 2017-10-17 23:36:33 +05:30
Varun Saxena 0820df611d MAPREDUCE-6731. TestMRTimelineEventHandling#testMRNewTimelineServiceEventHandling fails randomly for concurrent tests. (Sangjin Lee via Varun Saxena). 
(cherry picked from commit d14e729a55)
 2017-10-17 23:36:33 +05:30
Varun Saxena 16942ea115 YARN-5354. TestDistributedShell.checkTimelineV2 fails randomly for concurrent tests. (Sangjin Lee via Varun Saxena). 
(cherry picked from commit a3ac1c1943)
 2017-10-17 23:36:33 +05:30
Sangjin Lee e212e562ec YARN-5355. Backported YARN-2928 into our branch-2 feature branch. 2017-10-17 23:36:33 +05:30
Xiao Chen a103b323e6 Revert "HADOOP-14948. Document missing config key hadoop.treat.subject.external. Contributed by Ajay Kumar." 
This reverts commit 1452ba139e.
 2017-10-17 10:11:38 -07:00
Robert Kanter 8a1ed84c77 HADOOP-14938. Configuration.updatingResource map should be initialized lazily (misha@cloudera.com via rkanter) 2017-10-16 16:51:28 -07:00
Wei-Chiu Chuang 1452ba139e HADOOP-14948. Document missing config key hadoop.treat.subject.external. Contributed by Ajay Kumar. 
(cherry picked from commit e906108fc9)
 2017-10-16 16:44:35 -07:00
Nathan Roberts b876a9314e YARN-7333. container-executor fails to remove entries from a directory that is not writable or executable. Contributed by Jason Lowe. 
(cherry picked from commit 8620140a6a3ec0117675ede06d92d830da3da551)
 2017-10-16 16:44:34 -05:00
Junping Du 3d2ef54450 YARN-7124. LogAggregationTFileController deletes/renames while file is open. Contributed by Jason Lowe. 
(cherry picked from commit 1fcbe7cf5f)
 2017-10-16 14:29:02 -07:00
Xiao Chen 0bddcf10ef HADOOP-14949. TestKMS#testACLs fails intermittently. 
(cherry picked from commit 152317d40ece8abfa76fb5bd29f04878c1b0d3d8)

Conflicts:
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java
 2017-10-16 14:20:05 -07:00
Arun Suresh 53cd33cc4a YARN-7275. NM Statestore cleanup for Container updates. (Kartheek Muthyala via asuresh) 
(cherry picked from commit a50be1b8f4)
 2017-10-16 13:27:08 -07:00
Wei-Chiu Chuang a596c6f5eb HDFS-12485. expunge may fail to remove trash from encryption zone. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 8dbc8909c9)
 2017-10-16 12:59:41 -07:00
Xiao Chen b2f27641dd HDFS-12642. Log block and datanode details in BlockRecoveryWorker. 
(cherry picked from commit 971b3ca1acc15d9a1f8e774291813dafd16ef704)
 2017-10-16 10:34:24 -07:00
Xiao Chen d82edb49c7 HDFS-12603. Enable async edit logging by default. Contributed by Andrew Wang. 
(cherry picked from commit d0311dfc5fe92a0e0f3fb8ae92e412edce609740)
 2017-10-16 09:51:27 -07:00