Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
16,880 Commits 326 Branches 371 Tags
Commit Graph

16880 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Daniel Templeton
7b49de5e30 YARN-6622. Document Docker work as experimental (Contributed by Varun Vasudev) 
(cherry picked from commit 6651cbcc72d92caf86b744fa76fba513b36b12c7)
 2017-09-28 10:16:45 -07:00
Wei-Chiu Chuang
2ab2a9438f HDFS-12458. TestReencryptionWithKMS fails regularly. Contributed by Xiao Chen. 
(cherry picked from commit 7c34ceaf4fa28e2ecabd6626860bb1c7418e4b8d)
 2017-09-28 05:11:49 -07:00
Xuan
81e7872793 YARN-7257. AggregatedLogsBlock reports a bad 'end' value as a bad 
'start' value. Contributed by Jason Lowe

(cherry picked from commit 28c4957fccebe2d7e63ec9fe9af58313b4f21d4f)
 2017-09-27 15:47:45 -07:00
Chris Trezzo
ad7ed9d044 YARN-7253. Shared Cache Manager daemon command listed as admin subcmd in yarn script. 
(cherry picked from commit c87db8d154ab2501e786b4f1669b205759ece5c3)
 2017-09-27 11:36:42 -07:00
Akira Ajisaka
e5629ee713
HADOOP-14822. hadoop-project/pom.xml is executable. Contributed by Ajay Kumar. 
(cherry picked from commit dd378775df5bd79e23c12120535404c4ca0fb386)
 2017-09-27 14:26:46 +09:00
Yiqun Lin
91e866ee6e HDFS-12495. TestPendingInvalidateBlock#testPendingDeleteUnknownBlocks fails intermittently. Contributed by Eric Badger. 
(cherry picked from commit e9b790db9de7c3fbe451bcdc3fd928a27a0d8b4e)
 2017-09-27 10:53:33 +08:00
Daryn Sharp
61dc4bcd61 [HDFS-12386] Add fsserver defaults call to WebhdfsFileSystem. (Rushabh Shah via daryn) 2017-09-26 15:27:32 -05:00
Jason Lowe
bf03363d83 MAPREDUCE-6968. Staging directory erasure coding config property has a typo. Contributed by Jason Lowe 
(cherry picked from commit 9df05005ac258441eeceec25ecef7b28f9f50a02)
 2017-09-26 14:53:47 -05:00
Jason Lowe
8526bfa19d Revert "YARN-6570. No logs were found for running application, running" 
This reverts commit e91447ccc9ff438dd300e2564c251b2c4b0f369a.
 2017-09-26 10:41:44 -05:00
Rohith Sharma K S
52571d9fa3 YARN-65. Reduce RM app memory footprint once app has completed. Contributed by Manikandan R. 
(cherry picked from commit 06e5a7b5cf141420d3a411088b87acba72e68cad)
 2017-09-26 14:46:47 +05:30
Akira Ajisaka
739d3ef809
HADOOP-14893. WritableRpcEngine should use Time.monotonicNow. Contributed by Chetna Chaudhari. 
(cherry picked from commit d08b8c801a908b4242e7b21a54f3b1e4072f1eae)
 2017-09-26 16:46:46 +09:00
Aaron Fabbri
f3dbcd6a89
HADOOP-14890 Move up to AWS SDK 1.11.199. Contributed by Steve Loughran. 2017-09-25 17:19:46 -07:00
Aaron Fabbri
60b966cb45
HADOOP-14220 Enhance S3GuardTool with bucket-info and set-capacity commands, tests. Contributed by Steve Loughran 2017-09-25 16:01:15 -07:00
Ray Chiang
da6ed36edb HADOOP-14903. Add json-smart explicitly to pom.xml. (rchiang) 
(cherry picked from commit cde804b91f2fed514935d186d89ea7cbbf2701f3)
 2017-09-25 15:32:15 -07:00
Jason Lowe
bfad0ca3b0 HADOOP-14881. LoadGenerator should use Time.monotonicNow() to measure durations. Contributed by Bharat Viswanadham 
(cherry picked from commit ac05a51bbb2a3fad4e85f9334a3408571967900a)
 2017-09-25 15:38:24 -05:00
Akira Ajisaka
149d3ad6ba
YARN-7153. Remove duplicated code in AMRMClientAsyncImpl.java. Contributed by Sen Zhao. 
(cherry picked from commit e928ee583c5a1367e24eab34057f8d8496891452)
 2017-09-26 02:04:23 +09:00
Akira Ajisaka
366ce11ac0
HADOOP-14892. MetricsSystemImpl should use Time.monotonicNow for measuring durations. Contributed by Chetna Chaudhari. 
(cherry picked from commit 3a10367a17b99e2c3035ec54048f94f334d93227)
 2017-09-26 01:47:59 +09:00
Akira Ajisaka
51b3a38064
HDFS-12304. Remove unused parameter from FsDatasetImpl#addVolume. Contributed by Chen Liang. 
(cherry picked from commit 02e2a9b1152b0e144fcf43bec2fce26d8a6c6dbc)
 2017-09-26 01:26:13 +09:00
Daniel Templeton
dca2fb5ac5 HADOOP-14897. Loosen compatibility guidelines for native dependencies 
(cherry picked from commit 0807470808156af13e0992285cac070052d86c26)
 2017-09-25 16:15:56 +02:00
Daniel Templeton
972250923f HADOOP-13714. Tighten up our compatibility guidelines for Hadoop 3 
(cherry picked from commit 7618fa9194b40454405f11a25bec4e2d79506912)
 2017-09-23 00:05:25 +02:00
Andrew Wang
0704a5b5cb Revert "HADOOP-14655. Update httpcore version to 4.4.6. (rchiang)" 
This reverts commit 0b69a22f8688ae98e3c506b0bd1d26f97ccb391e.
 2017-09-22 14:43:58 -07:00
Junping Du
b58cc16171 YARN-7118. AHS REST API can return NullPointerException. Contributed by Billie Rinaldi. 
(cherry picked from commit 4002bf0a9e7e3619a3bdcff071f0369cbf2873ad)
 2017-09-22 14:00:40 -07:00
Jason Lowe
0eb0298027 MAPREDUCE-6967. gridmix/SleepReducer should use Time.monotonicNow for measuring durations. Contributed by Chetna Chaudhari 
(cherry picked from commit b133dc5700b66318ac6d80e463b049723c511f37)
 2017-09-22 15:30:20 -05:00
Jason Lowe
5eb1f9f7b3 MAPREDUCE-6965. QuasiMonteCarlo should use Time.monotonicNow for measuring durations. Contributed by Chetna Chaudhari 
(cherry picked from commit 908d8e914ef55aca69cb8e725e62bda29d1073cc)
 2017-09-22 09:36:29 -05:00
Akira Ajisaka
cbb3294e2d
MAPREDUCE-6966. DistSum should use Time.monotonicNow for measuring durations. Contributed by Chetna Chaudhari. 
(cherry picked from commit c71d13796039815350d3c73c51f9fe48531af0fa)
 2017-09-22 15:10:01 +09:00
Akira Ajisaka
0af3aec502
MAPREDUCE-6947. Moving logging APIs over to slf4j in hadoop-mapreduce-examples. Contributed by Gergely Novák. 
(cherry picked from commit 53be075241f1ba92bfe47e89c2dfc3f0664e2578)
 2017-09-22 13:30:22 +09:00
Lei Xu
98612bb2d0 HDFS-12523. Thread pools in ErasureCodingWorker do not shutdown. (Huafeng Wang via Lei) 
(cherry picked from commit 8680131e4b38f0b876173cbee838fcdb91cb52b6)
 2017-09-21 16:12:10 -07:00
Jason Lowe
a294bfd80e YARN-4266. Allow users to enter containers as UID:GID pair instead of by username. Contributed by luhuichun, Zhankun Tang, and Eric Badger. 
(cherry picked from commit bfd1a72ba8fbb06da73fede2a85e0b544d6ab43f)
 2017-09-21 17:43:51 -05:00
Junping Du
9e3313f8a1 YARN-7034. DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor. Contributed by Miklos Szegedi. 
(cherry picked from commit e5e1851d803bf8d8b96fec1b5c0058014e9329d0)
 2017-09-21 14:06:45 -07:00
Wangda Tan
4dbf7a501a YARN-6991. "Kill application" button does not show error if other user tries to kill the application for secure cluster. (Suma Shivaprasad via wangda) 
Change-Id: I7e7894b24609709f89064ee5882f055dbb09080b
(cherry picked from commit 263e2c692a4b0013766cd1f6b6d7ed674b2b1040)
 2017-09-21 12:27:18 -07:00
Jason Lowe
6c07077837 MAPREDUCE-6964. BaileyBorweinPlouffe should use Time.monotonicNow for measuring durations. Contributed by Chetna Chaudhari 
(cherry picked from commit b9db0afa1e65d0343ad4e5760c36e042a3e704b0)
 2017-09-21 09:39:01 -05:00
Kihwal Lee
9bd1f364a7 HDFS-12371. BlockVerificationFailures and BlocksVerified show up as 0 in Datanode JMX. Contributed by Hanisha Koneru. 
(cherry picked from commit 6bf921a5c3152a307b5c0903056d73ce07775a08)
 2017-09-21 08:48:37 -05:00
Jason Lowe
1e55972273 YARN-6968. Hardcoded absolute pathname in DockerLinuxContainerRuntime. Contributed by Eric Badger 
(cherry picked from commit 10d7493587643b52cee5fde87eca9ef99c422a70)
 2017-09-21 08:44:16 -05:00
Akira Ajisaka
b6551f7daf
HDFS-12526. FSDirectory should use Time.monotonicNow for durations. Contributed by Bharat Viswanadham. 
(cherry picked from commit 50849ec9eb9bad90586a95d2b2380ee6e8724d6b)
 2017-09-21 19:28:28 +09:00
Sangjin Lee
f919bcadb7 YARN-6771. Use classloader inside configuration class to make new 
classes. Contributed by Jongyoul Lee.

(cherry picked from commit 8b336632acad10e45d029596c5e3196e1857d891)
 2017-09-20 22:54:30 -07:00
Steve Loughran
4767d1bb1f Revert "HADOOP-14771. hadoop-client does not include hadoop-yarn-client. (Ajay Kumar via Haibo Chen)" 
HADOOP-14879 Build failure due to failing hadoop-client-check-invariants
This reverts commit 1ee25278c891e95ba2ab142e5b78aebd752ea163.

(cherry picked from commit aa6e8d2dff533c3d0c86776567c860548723c21c)
 2017-09-20 21:49:34 -07:00
Akira Ajisaka
835717210a
Revert "MAPREDUCE-6947. Moving logging APIs over to slf4j in hadoop-mapreduce-examples. Contributed by Gergery Novák." 
This reverts commit 9c90400c9677c25f3e11ee4366da093bfa6c89fe.
 2017-09-21 11:17:35 +09:00
Andrew Wang
1792093bae HDFS-12447. Rename AddECPolicyResponse to AddErasureCodingPolicyResponse. Contributed by SammiChen. 
(cherry picked from commit a12f09ba3c4a3aa4c4558090c5e1b7bcaebe3b94)
 2017-09-20 11:51:21 -07:00
Ming Ma
0006ee681a HDFS-11035. Better documentation for maintenace mode and upgrade domain. 
(cherry picked from commit ce943eb17a4218d8ac1f5293c6726122371d8442)
 2017-09-20 09:38:15 -07:00
Ming Ma
816933722a HDFS-12473. Change hosts JSON file format. 
(cherry picked from commit 230b85d5865b7e08fb7aaeab45295b5b966011ef)
 2017-09-20 09:05:56 -07:00
Akira Ajisaka
5c158f2f51
HADOOP-7308. Remove unused TaskLogAppender configurations from log4j.properties. Contributed by Todd Lipcon and J.Andreina. 
(cherry picked from commit 7e58b2478ce10f54b9b9a647f22a69dd528a81e6)
 2017-09-20 21:08:35 +09:00
Junping Du
974605c025 YARN-7186. Fix finicky TestContainerManager tests. Contributed by Arun Suresh. 
(cherry picked from commit 647b7527a9cdf4717e7dcbbb660e5812b67a17f1)
 2017-09-19 18:31:54 -07:00
Andrew Wang
f4082bbb23 HDFS-12437. Fix test setup in TestLeaseRecoveryStriped. 
(cherry picked from commit 12d9d7bc509bca82b8f40301e3dc5ca764be45eb)
 2017-09-19 16:42:23 -07:00
Andrew Wang
5c8331c230 HDFS-12445. Correct spellings of choosen to chosen. Contributed by hu xiaodong. 
(cherry picked from commit 51edaacd09d86419f99ca96545a1393db1f43f73)
 2017-09-19 13:48:25 -07:00
Andrew Wang
fdfbeb0243 HDFS-12444. Reduce runtime of TestWriteReadStripedFile. Contributed by Huafeng Wang and Andrew Wang. 
(cherry picked from commit 59830ca772dfb5dcc8b3e5281ca482dea5a5fa3e)
 2017-09-19 13:44:53 -07:00
Lei Xu
7d9ca2e21b HDFS-12449. TestReconstructStripedFile.testNNSendsErasureCodingTasks randomly cannot finish in 60s. (SammiChen via lei) 2017-09-19 11:51:44 -07:00
Brahma Reddy Battula
1ce365e91e HDFS-11799. Introduce a config to allow setting up write pipeline with fewer nodes than replication factor. Contributed by Brahma Reddy Battula 
(cherry picked from commit fda1221c55101d97ac62e1ee4e3ddf9a915d5363)
 2017-09-19 11:27:41 +05:30
Brahma Reddy Battula
6ee79d573a HDFS-12480. TestNameNodeMetrics#testTransactionAndCheckpointMetrics Fails in trunk. Contributed by Hanisha Koneru 
(cherry picked from commit 31b58406ac369716ef1665b7d60a3409117bdf9d)
 2017-09-19 10:46:01 +05:30
Eric Payne
839d5b124d MAPREDUCE-6960. Shuffle Handler prints disk error stack traces for every read failure. 
(cherry picked from commit 595d478408104bdfe1f08efd79930e18862fafbb)
 2017-09-19 10:40:41 -05:00
Jason Lowe
731a622627 MAPREDUCE-6958. Shuffle audit logger should log size of shuffle transfer. Contributed by Jason Lowe 
(cherry picked from commit 3a20debddeac69596ceb5b36f8413529ea8570e6)
 2017-09-19 09:14:12 -05:00