Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,445 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

12445 Commits

Author SHA1 Message Date
Sunil G 370e08cb0b YARN-7469. Capacity Scheduler Intra-queue preemption: User can starve if newest app is exactly at user limit. Contributed by Eric Payne. 
(cherry picked from commit 61ace174cd)
(cherry picked from commit b53d244b79)
 2017-12-04 16:25:47 -08:00
Akira Ajisaka 10c51d9ca8
HADOOP-15047. Python is required for -Preleasedoc but not documented in branch-2.8. Contributed by Bharat Viswanadham. 
(cherry picked from commit a9f0536ced)
 2017-11-22 11:14:30 +09:00
Jason Lowe 27e2c58acd YARN-7361. Improve the docker container runtime documentation. Contributed by Shane Kumpf 
(cherry picked from commit fac72eef23)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/DockerContainers.md

(cherry picked from commit d262815564)
 2017-11-15 12:40:38 -06:00
Junping Du 9e6ac0509f Set version to 2.8.3 to start release work. 2017-11-13 16:52:10 -08:00
Arun Suresh b3df744fb6 Fixing Job History Server Configuration parsing. (Jason Lowe via asuresh) 2017-11-09 15:25:59 -08:00
John Zhuge 90c1fac6e3 HDFS-12318. Fix IOException condition for openInfo in DFSInputStream. Contributed by legend. 
(cherry picked from commit 3123895db0)
 2017-11-09 09:22:30 -08:00
Naganarasimha 01912d18d5 MAPREDUCE-6975. Logging task counters. Contributed by Prabhu Joseph. 
(cherry picked from commit 61bbdc511e)
 2017-11-06 14:09:07 +05:30
Eric Payne 85130d80fe YARN-7370: Preemption properties should be refreshable. Contrubted by Gergely Novák. 
(cherry picked from commit e6ec02001f)
 2017-11-02 13:38:36 -05:00
Jason Lowe 2dec52da20 HADOOP-14919. BZip2 drops records when reading data in splits. Contributed by Jason Lowe 
(cherry picked from commit 2fae63aa60)
 2017-10-31 09:35:32 -05:00
Junping Du d80e37ec94 HADOOP-14990. Clean up jdiff xml files added for 2.8.2 release. 
(cherry picked from commit a8083aaa6f)
 2017-10-30 15:17:55 -07:00
Jason Lowe 9d3ea2c0ed YARN-7244. ShuffleHandler is not aware of disks that are added. Contributed by Kuhu Shukla 2017-10-30 16:08:14 -05:00
Arpit Agarwal 2d4629f386 HDFS-9914. Fix configurable WebhDFS connect/read timeout. Contributed by Xiaoyu Yao. 2017-10-27 07:45:27 -07:00
Junping Du 5ce84db79f Add several jdiff xml files for 2.8.2 release. 
(cherry picked from commit a25b5aa0cf)
(cherry picked from commit 1f2a2ba2be)
 2017-10-26 23:26:21 -07:00
Junping Du ae7ff3da09 Set jdiff stable version to 2.8.2. 
(cherry picked from commit 06b56f6493)
(cherry picked from commit 4b75ebb68e)
 2017-10-26 23:26:07 -07:00
Junping Du 13b042b576 Add CHANGES.md and RELEASENOTES for 2.8.2 release. 
(cherry picked from commit 3793d2b9cf)
 2017-10-26 23:25:49 -07:00
Zhe Zhang 239dadbd46 Revert "HDFS-12502. nntop should support a category based on FilesInGetListingOps." 
This reverts commit f1ff21e00c.
 2017-10-24 15:04:37 -07:00
Eric Payne 6b0dba318d YARN-4163: Audit getQueueInfo and getApplications calls. Contributed by Chang Li. 2017-10-23 17:37:50 -05:00
Naganarasimha 5ee67c1202 HADOOP-14966. Handle JDK-8071638 for hadoop-common. Contributed by Bibin A Chundatt. 
(cherry picked from commit 6b8122458e)
 2017-10-23 23:48:43 +05:30
Wei-Chiu Chuang a83f87e170 HDFS-12619. Do not catch and throw unchecked exceptions if IBRs fail to process. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 4ab0c8f96a)
(cherry picked from commit ce93a2b84b)
 2017-10-19 06:19:11 -07:00
Wei-Chiu Chuang 3b47f6bdfd HADOOP-14880. [KMS] Document&test missing KMS client side configs. Contributed by Gabor Bota. 
(cherry picked from commit 97c70c7ac6)

Conflicts:
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java
(cherry picked from commit 21b9e4fb979ecbc8f254b76f6ed86e6ef63d74f3)
 2017-10-19 06:05:53 -07:00
Zhe Zhang f1ff21e00c HDFS-12502. nntop should support a category based on FilesInGetListingOps. 
(cherry picked from commit 60bfee270e)
(cherry picked from commit aecf6c50d3)
(cherry picked from commit 87f4407396)
 2017-10-19 00:09:33 -07:00
Junping Du 4935334b0f HADOOP-14958. Fix source-level compatibility after HADOOP-11252. Contributed by Junping Du. 
(cherry picked from commit b016f08f67)
(cherry picked from commit 9433f9eb09)
(cherry picked from commit e7e2b8158d)
 2017-10-18 15:11:21 -07:00
Junping Du 4ea3ae36cb YARN-7230. Document DockerContainerRuntime for branch-2.8 with proper scope and claim as an experimental feature. Contributed by Shane Kumpf. 2017-10-18 14:12:37 -07:00
Arpit Agarwal dcdb3f250c HDFS-12420. Add an option to disallow 'namenode format -force'. Contributed by Ajay Kumar. 
(cherry picked from commit b6942cbe9b)
(cherry picked from commit 5897095d53)
(cherry picked from commit 0aa1b62b39)
 2017-10-17 23:46:14 -07:00
Xiao Chen a1d29717a2 Revert "HADOOP-14948. Document missing config key hadoop.treat.subject.external. Contributed by Ajay Kumar." 
This reverts commit 19db2837cb.
 2017-10-17 10:11:45 -07:00
Wei-Chiu Chuang 19db2837cb HADOOP-14948. Document missing config key hadoop.treat.subject.external. Contributed by Ajay Kumar. 
(cherry picked from commit e906108fc9)
(cherry picked from commit 1452ba139e)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
 2017-10-16 16:46:31 -07:00
Nathan Roberts 602a884d55 YARN-7333. container-executor fails to remove entries from a directory that is not writable or executable. Contributed by Jason Lowe. 
(cherry picked from commit 8620140a6a3ec0117675ede06d92d830da3da551)
 2017-10-16 16:45:17 -05:00
Wei-Chiu Chuang 843b8b7b96 HDFS-12485. expunge may fail to remove trash from encryption zone. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 8dbc8909c9)
(cherry picked from commit a596c6f5eb)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java
 2017-10-16 13:04:36 -07:00
Xiao Chen 6a55d0e671 HDFS-12642. Log block and datanode details in BlockRecoveryWorker. 
(cherry picked from commit 971b3ca1acc15d9a1f8e774291813dafd16ef704)
 2017-10-16 10:34:31 -07:00
Xiao Chen db726c4483 HDFS-12603. Enable async edit logging by default. Contributed by Andrew Wang. 
(cherry picked from commit d0311dfc5fe92a0e0f3fb8ae92e412edce609740)
(cherry picked from commit f6e768104b0e9a087584c25e28bf8cd29802c719)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
 2017-10-16 09:51:34 -07:00
Xiao Chen 27badf6df9 HDFS-12659. Update TestDeadDatanode#testNonDFSUsedONDeadNodeReReg to increase heartbeat recheck interval. Contributed by Ajay Kumar. 
(cherry picked from commit 11a7729c1474aa379a62c0440c8c1a11be261a75)
 2017-10-15 19:28:45 -07:00
Jason Lowe b41c5e41bc YARN-7246. Fix the default docker binary path. Contributed by Shane Kumpf 2017-10-13 15:32:35 -05:00
Jason Lowe ce76ed675e YARN-7325. Remove unused container variable in DockerLinuxContainerRuntime. Contributed by Shane Kumpf 2017-10-13 14:54:06 -05:00
Jason Lowe 5c4f269b26 YARN-6930. Admins should be able to explicitly enable specific LinuxContainerRuntime in the NodeManager. Contributed by Shane Kumpf 2017-10-11 09:57:49 -05:00
Jason Lowe 108c2394c3 HADOOP-14912. FairCallQueue may defer servicing calls. Contributed by Daryn Sharp 
(cherry picked from commit 1123f8f0b6)
 2017-10-10 14:51:19 -05:00
Sunil G b41a702751 YARN-7245. Max AM Resource column in Active Users Info section of Capacity Scheduler UI page should be updated per-user. Contributed by Eric Payne. 
(cherry picked from commit 8137254a1f)
 2017-10-09 14:58:42 +05:30
Xiao Chen 99b7ced3bf HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah. 
(cherry picked from commit 212342d6db14673f8f5652a5209e1c4fcc0f0ede)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/key/kms/LoadBalancingKMSClientProvider.java
 2017-10-05 19:47:26 -07:00
Naganarasimha d4cd8ccb5d YARN-7285. ContainerExecutor always launches with priorities due to yarn-default property. Contributed by Jason Lowe. 
(cherry picked from commit d0046bb5c6)
 2017-10-06 00:31:24 +05:30
Sidharta S 935ef1c24e YARN-7226. Whitelisted variables do not support delayed variable expansion. Contributed by Jason Lowe 2017-10-03 18:44:36 -07:00
Jason Lowe 3629c95c51 YARN-5444. Fix failing unit tests in TestLinuxContainerExecutorWithMocks. Contributed by Yufei Gu. 
(cherry picked from commit 95694b70cd)
 2017-10-03 14:44:04 -05:00
Eric Payne 4540cbb3a0 YARN-7084. TestSchedulingMonitor#testRMStarts fails sporadically. Contributed by Jason Lowe. 
(cherry picked from commit 7f6118f918)
 2017-09-29 10:56:56 -05:00
Jason Lowe 949525b81a HADOOP-14902. LoadGenerator#genFile write close timing is incorrectly calculated. Contributed by Hanisha Koneru 
(cherry picked from commit 6f789fe057)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/loadGenerator/LoadGenerator.java
 2017-09-28 16:45:02 -05:00
Jason Lowe ba5656d5e0 HADOOP-14881. LoadGenerator should use Time.monotonicNow() to measure durations. Contributed by Bharat Viswanadham 
(cherry picked from commit ac05a51bbb)
 2017-09-28 16:27:08 -05:00
Yiqun Lin fb5de93c46 HDFS-12495. TestPendingInvalidateBlock#testPendingDeleteUnknownBlocks fails intermittently. Contributed by Eric Badger. 
(cherry picked from commit e9b790db9d)
 2017-09-27 10:51:00 +08:00
Daryn Sharp 438291787a [HDFS-12386] Add fsserver defaults call to WebhdfsFileSystem. (Rushabh Shah via daryn) 2017-09-26 15:25:12 -05:00
Jason Lowe 86e092029d HADOOP-14891. Remove references to Guava Objects.toStringHelper. Contributed by Jonathan Eagles 
(cherry picked from commit 0aac5af6e1)
 2017-09-26 10:13:24 -05:00
Eric Payne f794adde3b YARN-7249. Fix CapacityScheduler NPE issue when a container preempted while the node is being removed. Contributed by Wangda Tan. 2017-09-26 09:07:04 -05:00
Akira Ajisaka 75aed26511
HADOOP-14893. WritableRpcEngine should use Time.monotonicNow. Contributed by Chetna Chaudhari. 
(cherry picked from commit d08b8c801a)
(cherry picked from commit b017af2391)
 2017-09-26 16:48:28 +09:00
Akira Ajisaka ea7e655897
HADOOP-14892. MetricsSystemImpl should use Time.monotonicNow for measuring durations. Contributed by Chetna Chaudhari. 
(cherry picked from commit 3a10367a17)
(cherry picked from commit 6004fb4676)
 2017-09-26 01:48:54 +09:00
Jason Lowe 44b51b0047 Revert "YARN-6570. No logs were found for running application, running" 
This reverts commit e103acc8f4.
 2017-09-25 11:13:50 -05:00