Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,034 Commits 326 Branches 371 Tags
Commit Graph

17034 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Manoj Govindassamy
166c75a0eb HDFS-12544. SnapshotDiff - support diff generation on any snapshot root descendant directory. 
(cherry picked from commit 075dd45a24398dcdcddd60da995f0dc152eee321)
 2017-10-31 12:50:54 -07:00
Manoj Govindassamy
1375c7205f HDFS-12573. Divide the total blocks metrics into replicated and erasure coded. Contributed by Takanobu Asanuma. 
(cherry picked from commit 78af6cdc5359404139665d81447f28d26b7bb43b)
 2017-10-31 12:50:21 -07:00
Manoj Govindassamy
014184127e HDFS-12614. FSPermissionChecker#getINodeAttrs() throws NPE when INodeAttributesProvider configured. 
(cherry picked from commit b406d8e3755d24ce72c443fd893a5672fd56babc)
 2017-10-31 12:49:41 -07:00
Wei-Chiu Chuang
579612c9d2 HDFS-12619. Do not catch and throw unchecked exceptions if IBRs fail to process. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 4ab0c8f96a41c573cc1f1e71c18871d243f952b9)
 2017-10-31 12:49:08 -07:00
Akira Ajisaka
143dbf8497 HDFS-12622. Fix enumerate in HDFSErasureCoding.md. Contributed by Yiqun Lin. 
(cherry picked from commit dc63a6a52b7fdf076ab83a774b0378f77c1c0cd3)
 2017-10-31 12:48:29 -07:00
Subru Krishnan
0d9503d6b5 YARN-6413. FileSystem based Yarn Registry implementation. (Ellen Hui via Subru). 
(cherry picked from commit ed24da3dd73c137b44235e525112056ace6d3843)
 2017-10-31 12:08:32 -07:00
Andrew Wang
ae08fe518b Revert "HDFS-12499. dfs.namenode.shared.edits.dir property is currently namenode specific key. Contributed by Bharat Viswanadham." 
This reverts commit f09725537e4aef28c3e192a7aacad206900aa7b5.
 2017-10-31 10:46:19 -07:00
Inigo Goiri
e259030066 HDFS-12699. TestMountTable fails with Java 7. Contributed by Inigo Goiri. 
(cherry picked from commit 982bd2a5bff4c490a5d62f2e4fd0d3755305349c)
 2017-10-31 10:23:06 -07:00
Arpit Agarwal
f09725537e HDFS-12499. dfs.namenode.shared.edits.dir property is currently namenode specific key. Contributed by Bharat Viswanadham. 2017-10-31 10:08:05 -07:00
Chris Douglas
1ce0eb7d23 HDFS-7878. API - expose a unique file identifier. 
(cherry picked from commit d015e0bbd5416943cb4875274e67b7077c00e54b)
 2017-10-31 09:46:39 -07:00
Jason Lowe
75605766fd HADOOP-14919. BZip2 drops records when reading data in splits. Contributed by Jason Lowe 
(cherry picked from commit 2fae63aa60c43b62bd908a9499562fe528603185)
 2017-10-31 09:32:02 -05:00
Akira Ajisaka
da6ab7727c
YARN-7379. Moving logging APIs over to slf4j in hadoop-yarn-client. Contributed by Yeliang Cang. 
(cherry picked from commit c02d2ba50db8a355ea03081c3984b2ea0c375a3f)
 2017-10-31 17:11:18 +09:00
Akira Ajisaka
6bbfa158d7
YARN-7407. Moving logging APIs over to slf4j in hadoop-yarn-applications. Contributed by Yeliang Cang. 
(cherry picked from commit 785f1b0d11a3bf0af9851c080ff0acc34539f17b)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/Client.java
 2017-10-31 16:45:12 +09:00
Junping Du
b9a4bf0c46 HADOOP-14990. Clean up jdiff xml files added for 2.8.2 release. 
(cherry picked from commit a8083aaa6f4bcc7287f2b65018a946a840123c50)
 2017-10-30 15:28:58 -07:00
Chris Douglas
85be67ebe4 HADOOP-14992. Upgrade Avro patch version. Contributed by Bharat Viswanadham 
(cherry picked from commit e4878a59b3a380e323bb4627a69266bbf2524b36)
 2017-10-30 09:49:34 -07:00
Yufei Gu
d9f027adbc YARN-6747. TestFSAppStarvation.testPreemptionEnable fails intermittently. (Contributed by Miklos Szegedi) 
(cherry picked from commit d4811c8cfae02f42a7aae1f775e87b6726caa3c9)
 2017-10-29 16:48:07 -07:00
Arun Suresh
6b4319cc50 YARN-7299. Fix TestDistributedScheduler. (asuresh) 
(cherry picked from commit 9c5c68745ed18883ce8bdbdca379025b23f17f60)
 2017-10-27 23:15:37 -07:00
Arun Suresh
b30eb17c75 YARN-7178. Add documentation for Container Update API. (asuresh) 
(cherry picked from commit 24f8c5cce3adb88e5af84b3e48c4c447ac91e6d3)
 2017-10-27 22:58:34 -07:00
Chris Douglas
77ad73501c HADOOP-14991. Add missing figures to Resource Estimator tool. Contributed by Rui Li 
(cherry picked from commit 139cc752d21c30bf4d1ca263bb4b0717c48b2c0a)
 2017-10-27 22:00:44 -07:00
Chris Douglas
1660a638f0 HADOOP-14986. Enforce JDK limitations. 
(cherry picked from commit b50def36970e0afa65bd3fd3f40d8c4f81119200)
 2017-10-27 21:39:27 -07:00
Chris Douglas
34512b2d7a HDFS-12582. Replace HdfsFileStatus constructor with a builder pattern. Contributed by Bharat Viswanadham 
(cherry picked from commit d55a84951abe87a31c17bd4b84cd309ed202e540)
 2017-10-27 15:36:18 -07:00
Jason Lowe
00345eed50 YARN-7244. ShuffleHandler is not aware of disks that are added. Contributed by Kuhu Shukla 
(cherry picked from commit 665bb147aa3fc198e53335931562dd69f9f0e345)
 2017-10-27 17:00:31 -05:00
Rohith Sharma K S
d9b636f2f4 YARN-7289. Application lifetime does not work with FairScheduler. Contributed by Miklos Szegedi. 
(cherry picked from commit 5c799ecf09617f634c41bba26d341b2ad45ee852)
 2017-10-27 23:14:55 +05:30
Sunil G
e084d43550 YARN-7375. Possible NPE in RMWebapp when HA is enabled and the active RM fails. Contributed by Chandni Singh. 
(cherry picked from commit 792388e1c0ebaeb01db194412e30c08c0144b77c)
 2017-10-27 20:54:58 +05:30
Arpit Agarwal
2510fc1801 HDFS-9914. Fix configurable WebhDFS connect/read timeout. Contributed by Xiaoyu Yao. 2017-10-27 07:49:18 -07:00
Junping Du
ce10c1ef05 Add several jdiff xml files for 2.8.2 release. 
(cherry picked from commit a25b5aa0cf5189247fa38e7b0a188d568eba1b6c)
 2017-10-26 23:18:50 -07:00
Junping Du
3760f9cfb3 Set jdiff stable version to 2.8.2. 
(cherry picked from commit 06b56f649376020cde382bde25f90dc0547c4277)
 2017-10-26 23:18:37 -07:00
Junping Du
f36b2c6990 Update CHANGES.md and RELEASENOTES for 2.8.2 release. 
(cherry picked from commit 1ad863e22046c3c6a3e22a82cec52264b922888d)
 2017-10-26 23:18:23 -07:00
Robert Kanter
aa65f6c1ad YARN-7262. Add a hierarchy into the ZKRMStateStore for delegation token znodes to prevent jute buffer overflow (rkanter) 
(cherry picked from commit b1de78619f3e5e25d6f9d5eaf41925f22d212fb9)
 2017-10-26 17:47:51 -07:00
Robert Kanter
cd9078df68 YARN-7320. Duplicate LiteralByteStrings in SystemCredentialsForAppsProto.credentialsForApp_ Addendum (misha@cloudera.com via rkanter) 
(cherry picked from commit 088ffee7165d0e2e4fb9af7fb8f33626b0ed8ed3)
 2017-10-26 15:55:23 -07:00
Subru Krishnan
9665971a65 YARN-5516. Add REST API for supporting recurring reservations. (Sean Po via Subru). 
(cherry picked from commit 25932da6d1ee56299c8f9911576a42792c435407)
 2017-10-26 12:11:08 -07:00
Robert Kanter
d92dddaf7c YARN-7358. TestZKConfigurationStore and TestLeveldbConfigurationStore should explicitly set capacity scheduler (haibochen via rkanter) 
(cherry picked from commit 2da654e34a436aae266c1fbdec5c1067da8d854e)
 2017-10-26 10:45:23 -07:00
Subru Krishnan
82c9b3bbb5 HADOOP-14840. Tool to estimate resource requirements of an application pipeline based on prior executions. (Rui Li via Subru). 
(cherry picked from commit 625039ef20e6011ab360131d70582a6e4bf2ec1d)
 2017-10-25 16:01:13 -07:00
Subru Krishnan
926b188871 YARN-4827. Document configuration of ReservationSystem for FairScheduler. (Yufei Gu via Subru). 
(cherry picked from commit 3fae675383489129b3ca3c66683a1215d0c6edf0)
 2017-10-25 15:08:19 -07:00
Xiao Chen
e18d2c548b HADOOP-14957. ReconfigurationTaskStatus is exposing guava Optional in its public api. Contributed by Haibo Chen, Xiao Chen. 
(cherry picked from commit e3f25f361720b544b464c5e4fbeb4f31e6c53c67)
 2017-10-25 14:11:38 -07:00
Akira Ajisaka
20ca6773f1 HADOOP-14977. Xenial dockerfile needs ant in main build for findbugs 
Signed-off-by: Allen Wittenauer <aw@apache.org>
 2017-10-25 08:10:26 -07:00
Akira Ajisaka
ed93af8965
HADOOP-14979. Upgrade maven-dependency-plugin to 3.0.2. Contributed by liyunzhang. 
(cherry picked from commit 54b72acd7731f358c4b35e81f46e2bea850deeca)
 2017-10-25 23:42:02 +09:00
Akira Ajisaka
79ea3e8ea7
HADOOP-14030. PreCommit TestKDiag failure. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 4c970088afefe5395c18c6715c7b27e6c0358c96)
 2017-10-25 17:18:49 +09:00
Zhe Zhang
f3409e71d9 Revert "HDFS-12502. nntop should support a category based on FilesInGetListingOps." 
This reverts commit aecf6c50d351e7aed2008a682677a1edb104585d.
 2017-10-24 15:06:01 -07:00
Varun Saxena
5be228e43b HADOOP-9657. NetUtils.wrapException to have special handling for 0.0.0.0 addresses and :0 ports. Contributed by Varun Saxena. 
(cherry picked from commit 67e7673750e731f5ecfa84e82b84b7fc7ee0b233)
 2017-10-25 03:22:18 +05:30
Eric Yang
107afed848 YARN-7353. Improved volume mount check for directories and unit test compatibility on RHEL7. Contributed by Eric Badger. 2017-10-24 16:59:17 -04:00
Yufei Gu
6e953eb6a3 YARN-7045. Remove FSLeafQueue#addAppSchedulable. (Contributed by Sen Zhao via Yufei Gu) 
(cherry picked from commit a92ef030a2707182e90acee644e47c8ef7e1fd8d)
 2017-10-24 13:52:02 -07:00
Robert Kanter
c5eeb2e4ce YARN-7385. TestFairScheduler#testUpdateDemand and TestFSLeafQueue#testUpdateDemand are failing with NPE (yufeigu via rkanter) 
(cherry picked from commit 03af442e7608db2f8e6eb85a15aa0ba42781edab)
 2017-10-24 13:40:06 -07:00
Carlo Curino
8b200ab395 YARN-7339. LocalityMulticastAMRMProxyPolicy should handle cancel request properly. (Botong Huang via curino) 
(cherry picked from commit 1c5c2b5dde6f2cffc587ca8f79a18828e1b1faf9)
 2017-10-24 10:53:08 -07:00
Robert Kanter
4bae02a97d YARN-7382. NoSuchElementException in FairScheduler after failover causes RM crash (rkanter) 
(cherry picked from commit 025c6565725c1819566377632753e8b9055617a6)
 2017-10-24 10:25:43 -07:00
Yiqun Lin
1e7ea66044 HDFS-12695. Add a link to HDFS router federation document in site.xml. Contributed by Yiqun Lin. 
(cherry picked from commit b90750cfb8887fecbd83caff3800455b4f911339)
 2017-10-24 10:48:19 +08:00
Robert Kanter
61aba4f0c1 YARN-7320. Duplicate LiteralByteStrings in SystemCredentialsForAppsProto.credentialsForApp_ (misha@cloudera.com via rkanter) 
(cherry picked from commit 5da295a34e39b507e8291073782e0576cd06896a)
 2017-10-23 18:02:11 -07:00
Wei-Chiu Chuang
b8a2fd37dc HDFS-12249. dfsadmin -metaSave to output maintenance mode blocks. Contributed by Wellington Chevreuil. 
(cherry picked from commit 0f2a69127aa40b7dccdf74ff63e2205a10ae8998)
 2017-10-23 15:24:54 -07:00
Daniel Templeton
9da9023371 YARN-7357. Several methods in TestZKRMStateStore.TestZKRMStateStoreTester.TestZKRMStateStoreInternal should have @Override annotations 
(Contributed by Sen Zhao via Daniel Templeton)

(cherry picked from commit 0553f5a012e14c8ceb40a16161440384f9f3a9a8)
 2017-10-23 13:51:39 -07:00
Naganarasimha
faf23e6298 HADOOP-14966. Handle JDK-8071638 for hadoop-common. Contributed by Bibin A Chundatt. 
(cherry picked from commit 6b8122458ede9ececb138bed99d368580e5439a1)
 2017-10-23 23:43:57 +05:30