Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,706 Commits 326 Branches 371 Tags
Commit Graph

14706 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jason Lowe
a253925862 Revert "YARN-7581. HBase filters are not constructed correctly in ATSv2. Contributed by Habio Chen." 
This reverts commit a01091e90c18575e75eb1ecc3e1e2feea5146d20.
 2018-03-21 17:36:24 -05:00
Inigo Goiri
8bbd560805 HDFS-13250. Addendum to fix branch-2 compilation. RBF: Router to manage requests across multiple subclusters. Contributed by Inigo Goiri. 2018-03-21 11:38:17 -07:00
Yiqun Lin
0b6d5a0731 HDFS-13250. RBF: Router to manage requests across multiple subclusters. Contributed by Inigo Goiri. 
(cherry picked from commit 2caba999bbb9d6e3ec56024a0a9d3d56a229edcf)
 2018-03-21 11:42:21 +08:00
Rohith Sharma K S
a01091e90c YARN-7581. HBase filters are not constructed correctly in ATSv2. Contributed by Habio Chen. 
(cherry picked from commit 29acea5000337a7f529bb1810a2af2b0af4d5f1d)
 2018-03-21 08:30:03 +05:30
Yiqun Lin
fb77ac6243 HDFS-13307. RBF: Improve the use of setQuota command. Contributed by liuhongtong. 
(cherry picked from commit 69fe4407ebd885fed69d9cf7f4dd17d3ba1acb60)
 2018-03-21 10:55:43 +08:00
Inigo Goiri
d6df90f7b5 HDFS-13268. TestWebHdfsFileContextMainOperations fails on Windows. Contributed by Xiao Liang. 
(cherry picked from commit fe224ff972a299a74c16a6a20ddd85ea16486b1e)
 2018-03-20 11:21:44 -07:00
weiy
4aa34324b2 HDFS-13215. RBF: Move Router to its own module. 2018-03-19 23:23:16 -07:00
Inigo Goiri
30d9a5db29 HDFS-13296. GenericTestUtils generates paths with drive letter in Windows and fail webhdfs related test cases. Contributed by Xiao Liang. 
(cherry picked from commit e65ff1c8be48ef4f04ed96f96ac4caef4974944d)
 2018-03-19 17:21:55 -07:00
Sammi Chen
2285afb32e HADOOP-15262. AliyunOSS: move files under a directory in parallel when rename a directory. Contributed by Jinhu Wu. 
(cherry picked from commit d67a5e2dec5c60d96b0c216182891cdfd7832ac5)
 2018-03-19 15:09:23 +08:00
Yufei Gu
204674f414 YARN-8039. Clean up log dir configuration in TestLinuxContainerExecutorWithMocks.testStartLocalizer. Contributed by Miklos Szegedi. 
(cherry picked from commit 49c747ab187d0650143205ba57ca19607ec4c6bd)
 2018-03-16 16:34:14 -07:00
Inigo Goiri
f278494a5f HDFS-12886. Ignore minReplication for block recovery. Contributed by Lukas Majercak. 2018-03-16 14:59:01 -07:00
Inigo Goiri
5e917a1501 Revert "HDFS-12886. Ignore minReplication for block recovery. Contributed by Lukas Majercak." 
This reverts commit 972c322301fcbabdabe86e7427c8097347d40efa.
 2018-03-16 14:26:09 -07:00
Inigo Goiri
972c322301 HDFS-12886. Ignore minReplication for block recovery. Contributed by Lukas Majercak. 
(cherry picked from commit 08ff1586d5d3e39f546200f9e696f62ea4cf000d)
 2018-03-16 10:31:02 -07:00
Inigo Goiri
4615c0bba2 HDFS-13224. RBF: Resolvers to support mount points across multiple subclusters. Contributed by Inigo Goiri. 
(cherry picked from commit e71bc00a471422ddb26dd54e706f09f0fe09925c)
 2018-03-16 09:15:23 -07:00
Inigo Goiri
3a5f50fa6e Revert "HDFS-13224. RBF: Resolvers to support mount points across multiple subclusters. Contributed by Inigo Goiri." 
This reverts commit ccf07fdafd74d5d5782deaed9839a4122e463d4b.
 2018-03-16 09:12:30 -07:00
Inigo Goiri
b1b10007a4 HDFS-12919. RBF: Support erasure coding methods in RouterRpcServer. Contributed by Inigo Goiri. 2018-03-15 11:30:52 -07:00
Inigo Goiri
ccf07fdafd HDFS-13224. RBF: Resolvers to support mount points across multiple subclusters. Contributed by Inigo Goiri. 
(cherry picked from commit e71bc00a471422ddb26dd54e706f09f0fe09925c)
 2018-03-15 10:51:04 -07:00
Yiqun Lin
3fad968624 HDFS-13261. Fix incorrect null value check. Contributed by Jianfei Jiang. 2018-03-15 11:12:25 +08:00
Inigo Goiri
299b40ff8b HDFS-13198. RBF: RouterHeartbeatService throws out CachedStateStore related exceptions when starting router. Contributed by Wei Yan. 
(cherry picked from commit 41fc7f80beb32f4a1fac73faf7c9116ad5ee3420)
 2018-03-14 13:16:32 -07:00
Yiqun Lin
b3d56cb835 HDFS-12773. RBF: Improve State Store FS implementation. Contributed by Inigo Goiri. 
(cherry picked from commit 76be6cbf6c33f866794f27ca2560ca7c7b2fa0e7)
 2018-03-14 11:25:08 +08:00
Inigo Goiri
36451f2d54 HADOOP-15308. TestConfiguration fails on Windows because of paths. Contributed by Xiao Liang. 
(cherry picked from commit 427fd027a353f665846f43dfd73faf7561fedc07)
 2018-03-13 20:06:07 -07:00
Chris Douglas
340cd5f1b1 HADOOP-14696. parallel tests don't work for Windows. Contributed by Allen Wittenauer 
(cherry picked from commit 45d1b0fdcc04a86be91a9b72073cdc30bec04d3b)
(cherry picked from commit 09940b1eb3b7ed764149f4a993c1857e9c6ad938)
(cherry picked from commit a03c8ea61f6e30a9d462571ace23858b6e0fd1c9)
 2018-03-12 20:08:46 -07:00
Yiqun Lin
38c21ec651 HDFS-13226. RBF: Throw the exception if mount table entry validated failed. Contributed by maobaolong. 
(cherry picked from commit 19292bc264cada5117ec76063d36cc88159afdf4)
 2018-03-13 11:06:53 +08:00
Yiqun Lin
5edbd1a258 HDFS-13253. RBF: Quota management incorrect parent-child relationship judgement. Contributed by Yiqun Lin. 
(cherry picked from commit 7fab787de72756863a91c2358da5c611afdb80e9)
 2018-03-13 10:33:12 +08:00
Akira Ajisaka
b0c80f1c81
HDFS-12156. TestFSImage fails without -Pnative 
(cherry picked from commit 319defafc105c0d0b69b83828b578d9c453036f5)
 2018-03-13 11:29:44 +09:00
Yiqun Lin
2ca6cf3170 HDFS-10803. TestBalancerWithMultipleNameNodes#testBalancing2OutOf3Blockpools fails intermittently due to no free space available. Contributed by Yiqun Lin. 
(cherry picked from commit 4afd50b10650a72162c40cf86dea44676013f262)
 2018-03-13 10:18:23 +08:00
Inigo Goiri
7fded36e4c HDFS-13241. RBF: TestRouterSafemode failed if the port 8888 is in use. Contributed by maobaolong. 
(cherry picked from commit 91c82c90f05ea75fe59c6ffad3dc3fcac1429e9e)
 2018-03-12 17:30:45 -07:00
Inigo Goiri
737dca1959 HDFS-11399. Many tests fails in Windows due to injecting disk failures. Contributed by Yiqun Lin. 2018-03-12 12:54:42 -07:00
Anu Engineer
88c749a903 HDFS-10618. TestPendingReconstruction#testPendingAndInvalidate is flaky due to race condition. Contributed by Eric Badger. 2018-03-12 12:14:21 -07:00
Inigo Goiri
457895d50f Revert "HDFS-11399. Many tests fails in Windows due to injecting disk failures. Contributed by Yiqun Lin." 
This reverts commit ab0f12708452f22d3780a30b354f7f8a24366500.
 2018-03-12 11:44:06 -07:00
Inigo Goiri
ab0f127084 HDFS-11399. Many tests fails in Windows due to injecting disk failures. Contributed by Yiqun Lin. 
(cherry picked from commit ac627f561f0946e98a650850fb507536cbd2f2c4)
 2018-03-12 10:04:51 -07:00
Yiqun Lin
3a34924896 HDFS-13240. RBF: Update some inaccurate document descriptions. Contributed by Yiqun Lin. 
(cherry picked from commit 4743d4a2c70a213a41804a24c776e6db00e1b90d)
 2018-03-10 11:33:44 +08:00
Inigo Goiri
0dadcf9ea3 HDFS-13232. RBF: ConnectionPool should return first usable connection. Contributed by Ekanth S. 
(cherry picked from commit 8133cd5305d7913453abb2d48da12f672c0ce334)
 2018-03-09 18:28:59 -08:00
Inigo Goiri
4b6b07690e HDFS-13212. RBF: Fix router location cache issue. Contributed by Weiwei Wu. 
(cherry picked from commit afe1a3ccd56a12fec900360a8a2855c080728e65)
 2018-03-09 17:21:10 -08:00
Jason Lowe
121daaf474 MAPREDUCE-6930. mapreduce.map.cpu.vcores and mapreduce.reduce.cpu.vcores are both present twice in mapred-default.xml. Contributed by Sen Zhao 
(cherry picked from commit 32fa3a63e0e7d8bfb3d3b9b3c500ecb3a4874ecf)
 2018-03-09 10:45:47 -06:00
Yiqun Lin
aa748c6bca HDFS-13233. RBF: MountTableResolver doesn't return the correct mount point of the given path. Contributed by wangzhiyuan. 
(cherry picked from commit 122805b43acff2b094bd984fa76dbc8d2e110edd)
 2018-03-09 15:51:56 +08:00
Kihwal Lee
0aa52d4085 HDFS-12614. FSPermissionChecker#getINodeAttrs() throws NPE when INodeAttributesProvider configured. Contributed by Manoj Govindassamy. 2018-03-08 14:22:17 -06:00
Inigo Goiri
95f34ce462 HDFS-13232. RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns. Contributed by Chao Sun. 
(cherry picked from commit 0c2b969e0161a068bf9ae013c4b95508dfb90a8a)
(cherry picked from commit 44abf77d9b371b0d06569bd4881356ac157b490e)
 2018-03-08 10:24:41 -08:00
Rohith Sharma K S
207daabbcc YARN-8003. Backport the code structure changes in YARN-7346 to branch-2. Contributed by Haibo Chen. 2018-03-07 13:25:28 +05:30
Yiqun Lin
a5d9691b54 HDFS-13214. RBF: Complete document of Router configuration. Contributed by Yiqun Lin. 
(cherry picked from commit 58ea2d7a65ccd8b7775021bae1d24b9e5561e67b)
 2018-03-07 15:51:42 +08:00
Xiaoyu Yao
313fdb9968 HDFS-13109. Support fully qualified hdfs path in EZ commands. Contributed by Hanisha Koneru. 
(cherry picked from commit edf9445708ffb7a9e59cb933e049b540f99add1e)
 2018-03-06 20:01:51 -08:00
Xiaoyu Yao
4f3c4e4514 HDFS-13120. Snapshot diff could be corrupted after concat. Contributed by Xiaoyu Yao. 
(cherry picked from commit 8faf0b50d435039f69ea35f592856ca04d378809)
 2018-03-06 18:49:13 -08:00
Allen Wittenauer
dbd69cb2ce
HADOOP-15279. increase maven heap size recommendations 
Signed-off-by: Jason Lowe <jlowe@apache.org>
Signed-off-by: Chris Douglas <cdouglas@apache.org>
(cherry picked from commit d4cc50f62279dc4d607cd05c16de480a76f05880)
 2018-03-06 13:58:31 -08:00
Sen Zhao
bda2a9c2a0
YARN-7736. Fix itemization in YARN federation document 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 245751ffdc4229715a0c031f57f20748ed16d8a6)
 2018-03-05 11:55:16 -08:00
Xiao Chen
0882725c88 HDFS-13040. Kerberized inotify client fails despite kinit properly. Contributed by Istvan Fajth, Wei-Chiu Chuang, Xiao Chen. 2018-03-05 09:44:42 -08:00
Steve Loughran
c245050538 HADOOP-15090. Add ADL troubleshooting doc. 
Contributed by Steve Loughran; backport to branch-2 by Masatake Iwasaki.
 2018-03-05 12:46:19 +00:00
Ajay Kumar
d5d38918d7
HADOOP-15286. Remove unused imports from TestKMSWithZK.java 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 3dc30bc24e50343efe1f514b923d27a0786d3ac1)
 2018-03-04 07:20:40 -08:00
Akira Ajisaka
8ad3ec6aab
HADOOP-15283. Upgrade from findbugs 3.0.1 to spotbugs 3.1.2 in branch-2 to fix docker image build. 2018-03-04 07:01:19 -08:00
Gergely Novák
278676508f
MAPREDUCE-7023. TestHadoopArchiveLogs.testCheckFilesAndSeedApps fails on rerun 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit e99a1e77671fa0e74a652bc2221bbe01d1a579d3)
 2018-03-02 16:22:20 -08:00
Jason Lowe
0a3a878428 YARN-7511. NPE in ContainerLocalizer when localization failed for running container. Contributed by Tao Yang 
(cherry picked from commit 83798f15f8602ef580a7885876de114b2425da89)
 2018-03-02 10:08:32 -06:00