Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
16,923 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

16923 Commits

Author SHA1 Message Date
Akira Ajisaka c71d137960
MAPREDUCE-6966. DistSum should use Time.monotonicNow for measuring durations. Contributed by Chetna Chaudhari. 2017-09-22 15:07:59 +09:00
Akira Ajisaka 53be075241
MAPREDUCE-6947. Moving logging APIs over to slf4j in hadoop-mapreduce-examples. Contributed by Gergely Novák. 2017-09-22 13:27:59 +09:00
Tsz-Wo Nicholas Sze 3baae4322e HDFS-12507. StripedBlockUtil.java:694: warning - Tag @link: reference not found: StripingCell. Contributed by Mukul Kumar Singh 2017-09-22 10:37:04 +08:00
Jason Lowe bfd1a72ba8 YARN-4266. Allow users to enter containers as UID:GID pair instead of by username. Contributed by luhuichun, Zhankun Tang, and Eric Badger. 2017-09-21 17:41:34 -05:00
Junping Du e5e1851d80 YARN-7034. DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor. Contributed by Miklos Szegedi. 2017-09-21 14:01:16 -07:00
Yufei Gu a92ef030a2 YARN-7045. Remove FSLeafQueue#addAppSchedulable. (Contributed by Sen Zhao via Yufei Gu) 2017-09-21 12:31:07 -07:00
Wangda Tan 263e2c692a YARN-6991. "Kill application" button does not show error if other user tries to kill the application for secure cluster. (Suma Shivaprasad via wangda) 
Change-Id: I7e7894b24609709f89064ee5882f055dbb09080b
 2017-09-21 12:00:53 -07:00
Arpit Agarwal b9e423fa8d HDFS-12496. Make QuorumJournalManager timeout properties configurable. Contributed by Ajay Kumar. 2017-09-21 08:44:43 -07:00
Jason Lowe b9db0afa1e MAPREDUCE-6964. BaileyBorweinPlouffe should use Time.monotonicNow for measuring durations. Contributed by Chetna Chaudhari 2017-09-21 09:37:19 -05:00
Kihwal Lee 6bf921a5c3 HDFS-12371. BlockVerificationFailures and BlocksVerified show up as 0 in Datanode JMX. Contributed by Hanisha Koneru. 2017-09-21 08:42:50 -05:00
Jason Lowe 10d7493587 YARN-6968. Hardcoded absolute pathname in DockerLinuxContainerRuntime. Contributed by Eric Badger 2017-09-21 08:38:08 -05:00
Akira Ajisaka 50849ec9eb
HDFS-12526. FSDirectory should use Time.monotonicNow for durations. Contributed by Bharat Viswanadham. 2017-09-21 19:27:48 +09:00
Sangjin Lee 8b336632ac YARN-6771. Use classloader inside configuration class to make new 
classes. Contributed by Jongyoul Lee.
 2017-09-20 22:22:43 -07:00
Akira Ajisaka 53047f934e
Revert "MAPREDUCE-6947. Moving logging APIs over to slf4j in hadoop-mapreduce-examples. Contributed by Gergery Novák." 
This reverts commit 2018538fdb.
 2017-09-21 11:16:05 +09:00
Andrew Wang a12f09ba3c HDFS-12447. Rename AddECPolicyResponse to AddErasureCodingPolicyResponse. Contributed by SammiChen. 2017-09-20 11:51:17 -07:00
Ming Ma ce943eb17a HDFS-11035. Better documentation for maintenace mode and upgrade domain. 2017-09-20 09:36:33 -07:00
Ming Ma 230b85d586 HDFS-12473. Change hosts JSON file format. 2017-09-20 09:03:59 -07:00
Akira Ajisaka 7e58b2478c
HADOOP-7308. Remove unused TaskLogAppender configurations from log4j.properties. Contributed by Todd Lipcon and J.Andreina. 2017-09-20 21:07:49 +09:00
Yufei Gu a9019e1fb7 YARN-6499. Remove the doc about Schedulable#redistributeShare(). (Contributed by Chetna Chaudhari via Yufei Gu) 2017-09-19 18:28:31 -07:00
Junping Du 647b7527a9 YARN-7186. Fix finicky TestContainerManager tests. Contributed by Arun Suresh. 2017-09-19 18:31:15 -07:00
Andrew Wang 12d9d7bc50 HDFS-12437. Fix test setup in TestLeaseRecoveryStriped. 2017-09-19 16:42:20 -07:00
Andrew Wang 51edaacd09 HDFS-12445. Correct spellings of choosen to chosen. Contributed by hu xiaodong. 2017-09-19 13:48:23 -07:00
Andrew Wang 59830ca772 HDFS-12444. Reduce runtime of TestWriteReadStripedFile. Contributed by Huafeng Wang and Andrew Wang. 2017-09-19 13:44:42 -07:00
Lei Xu 7bbeacb75e HDFS-12449. TestReconstructStripedFile.testNNSendsErasureCodingTasks randomly cannot finish in 60s. (SammiChen via lei) 2017-09-19 11:50:01 -07:00
Brahma Reddy Battula fda1221c55 HDFS-11799. Introduce a config to allow setting up write pipeline with fewer nodes than replication factor. Contributed by Brahma Reddy Battula 2017-09-19 11:25:45 +05:30
Brahma Reddy Battula 31b58406ac HDFS-12480. TestNameNodeMetrics#testTransactionAndCheckpointMetrics Fails in trunk. Contributed by Hanisha Koneru 2017-09-19 10:37:07 +05:30
Eric Payne 595d478408 MAPREDUCE-6960. Shuffle Handler prints disk error stack traces for every read failure. 2017-09-19 10:35:15 -05:00
Jason Lowe 3a20debdde MAPREDUCE-6958. Shuffle audit logger should log size of shuffle transfer. Contributed by Jason Lowe 2017-09-19 09:13:17 -05:00
Jason Lowe ea845ba58c Revert "MAPREDUCE-6958. Shuffle audit logger should log size of shuffle transfer. Contributed by Jason Lowe" 
This reverts commit b3d61304f2.
 2017-09-19 08:45:05 -05:00
Steve Loughran aa6e8d2dff
Revert "HADOOP-14771. hadoop-client does not include hadoop-yarn-client. (Ajay Kumar via Haibo Chen)" 
HADOOP-14879 Build failure due to failing hadoop-client-check-invariants
This reverts commit 1ee25278c8.
 2017-09-19 11:53:11 +01:00
Kai Zheng dba7a7dd9d HDFS-12479. Some misuses of lock in DFSStripedOutputStream. Contributed by Huafeng Wang 2017-09-19 17:45:41 +08:00
Akira Ajisaka 2018538fdb
MAPREDUCE-6947. Moving logging APIs over to slf4j in hadoop-mapreduce-examples. Contributed by Gergery Novák. 2017-09-19 11:05:54 +09:00
Arun Suresh 56ef5279c1 YARN-7203. Add container ExecutionType into ContainerReport. (Botong Huang via asuresh) 2017-09-18 15:49:31 -07:00
Andrew Wang 3cf3540f19 HADOOP-14835. mvn site build throws SAX errors. Contributed by Andrew Wang and Sean Mackrory. 2017-09-18 15:13:42 -07:00
Jason Lowe b3d61304f2 MAPREDUCE-6958. Shuffle audit logger should log size of shuffle transfer. Contributed by Jason Lowe 2017-09-18 17:04:43 -05:00
Haibo Chen 1ee25278c8 HADOOP-14771. hadoop-client does not include hadoop-yarn-client. (Ajay Kumar via Haibo Chen) 2017-09-18 14:25:35 -07:00
Xuan 7c732924a8 YARN-6570. No logs were found for running application, running 
container. Contributed by Junping Du
 2017-09-18 14:04:05 -07:00
Arun Suresh 29dd55153e YARN-7199. Fix TestAMRMClientContainerRequest.testOpportunisticAndGuaranteedRequests. (Botong Huang via asuresh) 2017-09-18 11:26:44 -07:00
Robert Kanter 0adc0471d0 MAPREDUCE-6954. Disable erasure coding for files that are uploaded to the MR staging area (pbacsko via rkanter) 2017-09-18 10:40:06 -07:00
Robert Kanter 5f496683fb Revert "YARN-7162. Remove XML excludes file format (rkanter)" - wrong commit message 
This reverts commit 3a8d57a0a2.
 2017-09-18 10:32:08 -07:00
Arpit Agarwal a2dcba1853 HDFS-12470. DiskBalancer: Some tests create plan files under system directory. Contributed by Hanisha Koneru. 2017-09-18 09:53:24 -07:00
Jason Lowe a4f9c7c924 YARN-7192. Add a pluggable StateMachine Listener that is notified of NM Container State changes. Contributed by Arun Suresh 2017-09-18 10:16:09 -05:00
Kai Zheng 0f9af246e8 HDFS-12460. Make addErasureCodingPolicy an idempotent operation. Contributed by Sammi Chen 2017-09-18 18:07:12 +08:00
Wangda Tan e81596d06d YARN-7172. ResourceCalculator.fitsIn() should not take a cluster resource parameter. (Sen Zhao via wangda) 
Change-Id: Icc3670c9381ce7591ca69ec12da5aa52d3612d34
 2017-09-17 21:20:43 -07:00
Arpit Agarwal 8d7cc22ac2 HDFS-12472. Add JUNIT timeout to TestBlockStatsMXBean. Contributed by Bharat Viswanadham. 2017-09-16 10:09:27 -07:00
Daniel Templeton 7618fa9194 HADOOP-13714. Tighten up our compatibility guidelines for Hadoop 3 2017-09-16 09:20:33 +02:00
Wangda Tan 38c14ef8d8 YARN-7149. Cross-queue preemption sometimes starves an underserved queue. (Eric Payne via wangda) 
Change-Id: Ib269991dbebce160378e8372ee6d24849c4a5ed6
(cherry picked from commit 3dfa937a1fadfc62947755872515f549b3b15e6a)
 2017-09-15 21:29:39 -07:00
Wangda Tan 958e8c0e25 YARN-6977. Node information is not provided for non am containers in RM logs. (Suma Shivaprasad via wangda) 
Change-Id: I0c44d09a560446dee2ba68c2b9ae69fce0ec1d3e
(cherry picked from commit 8a42e922fad613f3cf1cc6cb0f3fa72546a9cc56)
 2017-09-15 21:29:31 -07:00
Andrew Wang ef8cd5dc56 HDFS-10701. TestDFSStripedOutputStreamWithFailure#testBlockTokenExpired occasionally fails. Contributed by SammiChen. 2017-09-15 16:20:36 -07:00
Junping Du 1a84c24b0c YARN-7174. Add retry logic in LogsCLI when fetch running application logs. Contributed by Xuan Gong. 2017-09-15 15:33:24 -07:00