Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,432 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

12432 Commits

Author SHA1 Message Date
Junping Du ae7ff3da09 Set jdiff stable version to 2.8.2. 
(cherry picked from commit 06b56f6493)
(cherry picked from commit 4b75ebb68e)
 2017-10-26 23:26:07 -07:00
Junping Du 13b042b576 Add CHANGES.md and RELEASENOTES for 2.8.2 release. 
(cherry picked from commit 3793d2b9cf)
 2017-10-26 23:25:49 -07:00
Zhe Zhang 239dadbd46 Revert "HDFS-12502. nntop should support a category based on FilesInGetListingOps." 
This reverts commit f1ff21e00c.
 2017-10-24 15:04:37 -07:00
Eric Payne 6b0dba318d YARN-4163: Audit getQueueInfo and getApplications calls. Contributed by Chang Li. 2017-10-23 17:37:50 -05:00
Naganarasimha 5ee67c1202 HADOOP-14966. Handle JDK-8071638 for hadoop-common. Contributed by Bibin A Chundatt. 
(cherry picked from commit 6b8122458e)
 2017-10-23 23:48:43 +05:30
Wei-Chiu Chuang a83f87e170 HDFS-12619. Do not catch and throw unchecked exceptions if IBRs fail to process. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 4ab0c8f96a)
(cherry picked from commit ce93a2b84b)
 2017-10-19 06:19:11 -07:00
Wei-Chiu Chuang 3b47f6bdfd HADOOP-14880. [KMS] Document&test missing KMS client side configs. Contributed by Gabor Bota. 
(cherry picked from commit 97c70c7ac6)

Conflicts:
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java
(cherry picked from commit 21b9e4fb979ecbc8f254b76f6ed86e6ef63d74f3)
 2017-10-19 06:05:53 -07:00
Zhe Zhang f1ff21e00c HDFS-12502. nntop should support a category based on FilesInGetListingOps. 
(cherry picked from commit 60bfee270e)
(cherry picked from commit aecf6c50d3)
(cherry picked from commit 87f4407396)
 2017-10-19 00:09:33 -07:00
Junping Du 4935334b0f HADOOP-14958. Fix source-level compatibility after HADOOP-11252. Contributed by Junping Du. 
(cherry picked from commit b016f08f67)
(cherry picked from commit 9433f9eb09)
(cherry picked from commit e7e2b8158d)
 2017-10-18 15:11:21 -07:00
Junping Du 4ea3ae36cb YARN-7230. Document DockerContainerRuntime for branch-2.8 with proper scope and claim as an experimental feature. Contributed by Shane Kumpf. 2017-10-18 14:12:37 -07:00
Arpit Agarwal dcdb3f250c HDFS-12420. Add an option to disallow 'namenode format -force'. Contributed by Ajay Kumar. 
(cherry picked from commit b6942cbe9b)
(cherry picked from commit 5897095d53)
(cherry picked from commit 0aa1b62b39)
 2017-10-17 23:46:14 -07:00
Xiao Chen a1d29717a2 Revert "HADOOP-14948. Document missing config key hadoop.treat.subject.external. Contributed by Ajay Kumar." 
This reverts commit 19db2837cb.
 2017-10-17 10:11:45 -07:00
Wei-Chiu Chuang 19db2837cb HADOOP-14948. Document missing config key hadoop.treat.subject.external. Contributed by Ajay Kumar. 
(cherry picked from commit e906108fc9)
(cherry picked from commit 1452ba139e)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
 2017-10-16 16:46:31 -07:00
Nathan Roberts 602a884d55 YARN-7333. container-executor fails to remove entries from a directory that is not writable or executable. Contributed by Jason Lowe. 
(cherry picked from commit 8620140a6a3ec0117675ede06d92d830da3da551)
 2017-10-16 16:45:17 -05:00
Wei-Chiu Chuang 843b8b7b96 HDFS-12485. expunge may fail to remove trash from encryption zone. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 8dbc8909c9)
(cherry picked from commit a596c6f5eb)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java
 2017-10-16 13:04:36 -07:00
Xiao Chen 6a55d0e671 HDFS-12642. Log block and datanode details in BlockRecoveryWorker. 
(cherry picked from commit 971b3ca1acc15d9a1f8e774291813dafd16ef704)
 2017-10-16 10:34:31 -07:00
Xiao Chen db726c4483 HDFS-12603. Enable async edit logging by default. Contributed by Andrew Wang. 
(cherry picked from commit d0311dfc5fe92a0e0f3fb8ae92e412edce609740)
(cherry picked from commit f6e768104b0e9a087584c25e28bf8cd29802c719)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
 2017-10-16 09:51:34 -07:00
Xiao Chen 27badf6df9 HDFS-12659. Update TestDeadDatanode#testNonDFSUsedONDeadNodeReReg to increase heartbeat recheck interval. Contributed by Ajay Kumar. 
(cherry picked from commit 11a7729c1474aa379a62c0440c8c1a11be261a75)
 2017-10-15 19:28:45 -07:00
Jason Lowe b41c5e41bc YARN-7246. Fix the default docker binary path. Contributed by Shane Kumpf 2017-10-13 15:32:35 -05:00
Jason Lowe ce76ed675e YARN-7325. Remove unused container variable in DockerLinuxContainerRuntime. Contributed by Shane Kumpf 2017-10-13 14:54:06 -05:00
Jason Lowe 5c4f269b26 YARN-6930. Admins should be able to explicitly enable specific LinuxContainerRuntime in the NodeManager. Contributed by Shane Kumpf 2017-10-11 09:57:49 -05:00
Jason Lowe 108c2394c3 HADOOP-14912. FairCallQueue may defer servicing calls. Contributed by Daryn Sharp 
(cherry picked from commit 1123f8f0b6)
 2017-10-10 14:51:19 -05:00
Sunil G b41a702751 YARN-7245. Max AM Resource column in Active Users Info section of Capacity Scheduler UI page should be updated per-user. Contributed by Eric Payne. 
(cherry picked from commit 8137254a1f)
 2017-10-09 14:58:42 +05:30
Xiao Chen 99b7ced3bf HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah. 
(cherry picked from commit 212342d6db14673f8f5652a5209e1c4fcc0f0ede)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/key/kms/LoadBalancingKMSClientProvider.java
 2017-10-05 19:47:26 -07:00
Naganarasimha d4cd8ccb5d YARN-7285. ContainerExecutor always launches with priorities due to yarn-default property. Contributed by Jason Lowe. 
(cherry picked from commit d0046bb5c6)
 2017-10-06 00:31:24 +05:30
Sidharta S 935ef1c24e YARN-7226. Whitelisted variables do not support delayed variable expansion. Contributed by Jason Lowe 2017-10-03 18:44:36 -07:00
Jason Lowe 3629c95c51 YARN-5444. Fix failing unit tests in TestLinuxContainerExecutorWithMocks. Contributed by Yufei Gu. 
(cherry picked from commit 95694b70cd)
 2017-10-03 14:44:04 -05:00
Eric Payne 4540cbb3a0 YARN-7084. TestSchedulingMonitor#testRMStarts fails sporadically. Contributed by Jason Lowe. 
(cherry picked from commit 7f6118f918)
 2017-09-29 10:56:56 -05:00
Jason Lowe 949525b81a HADOOP-14902. LoadGenerator#genFile write close timing is incorrectly calculated. Contributed by Hanisha Koneru 
(cherry picked from commit 6f789fe057)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/loadGenerator/LoadGenerator.java
 2017-09-28 16:45:02 -05:00
Jason Lowe ba5656d5e0 HADOOP-14881. LoadGenerator should use Time.monotonicNow() to measure durations. Contributed by Bharat Viswanadham 
(cherry picked from commit ac05a51bbb)
 2017-09-28 16:27:08 -05:00
Yiqun Lin fb5de93c46 HDFS-12495. TestPendingInvalidateBlock#testPendingDeleteUnknownBlocks fails intermittently. Contributed by Eric Badger. 
(cherry picked from commit e9b790db9d)
 2017-09-27 10:51:00 +08:00
Daryn Sharp 438291787a [HDFS-12386] Add fsserver defaults call to WebhdfsFileSystem. (Rushabh Shah via daryn) 2017-09-26 15:25:12 -05:00
Jason Lowe 86e092029d HADOOP-14891. Remove references to Guava Objects.toStringHelper. Contributed by Jonathan Eagles 
(cherry picked from commit 0aac5af6e1)
 2017-09-26 10:13:24 -05:00
Eric Payne f794adde3b YARN-7249. Fix CapacityScheduler NPE issue when a container preempted while the node is being removed. Contributed by Wangda Tan. 2017-09-26 09:07:04 -05:00
Akira Ajisaka 75aed26511
HADOOP-14893. WritableRpcEngine should use Time.monotonicNow. Contributed by Chetna Chaudhari. 
(cherry picked from commit d08b8c801a)
(cherry picked from commit b017af2391)
 2017-09-26 16:48:28 +09:00
Akira Ajisaka ea7e655897
HADOOP-14892. MetricsSystemImpl should use Time.monotonicNow for measuring durations. Contributed by Chetna Chaudhari. 
(cherry picked from commit 3a10367a17)
(cherry picked from commit 6004fb4676)
 2017-09-26 01:48:54 +09:00
Jason Lowe 44b51b0047 Revert "YARN-6570. No logs were found for running application, running" 
This reverts commit e103acc8f4.
 2017-09-25 11:13:50 -05:00
Anu Engineer 3ecc1431fc
HDFS-12531. Fix conflict in the javadoc of UnderReplicatedBlocks.java in branch-2. Contributed by Bharat Viswanadham. 
(cherry picked from commit de5744c903)
 2017-09-25 13:12:27 +09:00
Xuan e103acc8f4 YARN-6570. No logs were found for running application, running 
container. (Contributed by Junping Du)
 2017-09-22 14:48:12 -07:00
Sunil G 1132f48253 YARN-7116. CapacityScheduler Web UI: Queue's AM usage is always show on per-user's AM usage. Contributed by Wangda Tan. 
(cherry picked from commit f9e0cc8cdc)
 2017-09-22 11:52:30 -05:00
Akira Ajisaka dade7396a2
MAPREDUCE-6966. DistSum should use Time.monotonicNow for measuring durations. Contributed by Chetna Chaudhari. 
(cherry picked from commit c71d137960)
(cherry picked from commit d80e2f2eae)
 2017-09-22 15:10:42 +09:00
Junping Du 1b3503e4b9 YARN-7034. DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor. Contributed by Miklos Szegedi. 2017-09-21 14:18:50 -07:00
Jason Lowe b0b10fc94a YARN-5195. RM intermittently crashed with NPE while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler. Contributed by sandflee and Jonathan Hung 2017-09-21 15:17:03 -05:00
Kihwal Lee c0bb242360 HDFS-12371. BlockVerificationFailures and BlocksVerified show up as 0 in Datanode JMX. Contributed by Hanisha Koneru. 
(cherry picked from commit 6bf921a5c3)
 2017-09-21 09:00:26 -05:00
Akira Ajisaka 4ac3fc10c2
HDFS-12526. FSDirectory should use Time.monotonicNow for durations. Contributed by Bharat Viswanadham. 
(cherry picked from commit 50849ec9eb)
(cherry picked from commit 3527327f34)
 2017-09-21 19:29:18 +09:00
Sangjin Lee 6d6758f751 YARN-6771. Use classloader inside configuration class to make new 
classes. Contributed by Jongyoul Lee.

(cherry picked from commit 8b336632ac)
 2017-09-20 22:50:55 -07:00
Ming Ma c54310a638 HDFS-12473. Change hosts JSON file format. 2017-09-20 09:21:32 -07:00
Brahma Reddy Battula a81167e2ec HDFS-11799. Introduce a config to allow setting up write pipeline with fewer nodes than replication factor. Contributed by Brahma Reddy Battula 
(cherry picked from commit fda1221c55)
 2017-09-19 11:34:52 +05:30
Eric Payne 67ada5d485 MAPREDUCE-6960. Shuffle Handler prints disk error stack traces for every read failure. 
(cherry picked from commit 595d478408)
 2017-09-19 11:00:20 -05:00
Jason Lowe 03a380daec MAPREDUCE-6958. Shuffle audit logger should log size of shuffle transfer. Contributed by Jason Lowe 2017-09-19 10:27:04 -05:00