Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,066 Commits 326 Branches 371 Tags
Commit Graph

18066 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Wei-Chiu Chuang
762126fac8 HADOOP-15312. Undocumented KeyProvider configuration keys. Contributed by LiXin Ge. 
(cherry picked from commit 3fe41c65d84843f817a4f9ef8999dbf862db6674)
(cherry picked from commit 1176a128d632925749db0a81a719fd8141c3cbb6)
 2018-03-29 09:45:51 -07:00
Inigo Goiri
2a5fad183e HDFS-13352. RBF: Add xsl stylesheet for hdfs-rbf-default.xml. Contributed by Takanobu Asanuma. 
(cherry picked from commit 4cef01147f98451de8acaa90f42a4d4cd4d0af45)
(cherry picked from commit c1fc87dcce6cabca61cfc509a76cb4a093dfd722)
 2018-03-29 09:45:36 -07:00
Jitendra Pandey
7155ef28f9 HADOOP-14067. VersionInfo should load version-info.properties from its own classloader. Contributed by Thejas M Nair. 
(cherry picked from commit 91b98ad03a430e0b84d78ad7170d56f016a90d2f)
 2018-03-29 09:45:29 -07:00
Haibo Chen
7580c529a1 YARN-7794. SLSRunner is not loading timeline service jars, causing failure. (Yufei Gu via Haibo Chen) 
(cherry picked from commit fcea5a4d798a517443afd0b441883ccc4e9136ba)
(cherry picked from commit e00e08365e02e77a1d9ae3cc16e65ddb543b5b20)
 2018-03-29 09:45:22 -07:00
Wangda Tan
3c826d379d YARN-8072. RM log is getting flooded with MemoryPlacementConstraintManager info logs. (Zian Chen via wangda) 
Change-Id: I2567f4669ad868e13c4301fe44c4bde85bb92c37
(cherry picked from commit 24bc5e0e4d919fddae983fc13d4ba4e4e5cb9533)
(cherry picked from commit dc99611878e99175b027b8baf2dec3150e175401)
 2018-03-29 09:45:16 -07:00
Wangda Tan
b600608b2d YARN-8068. Application Priority field causes NPE in app timeline publish when Hadoop 2.7 based clients to 2.8+ (Sunil G via wangda) 
Change-Id: I7910bd1064a1b4dbbe2084080c060822ea6f3b48
(cherry picked from commit 9eef19b2ad78b8464da252d0e23c08675898b9d8)
(cherry picked from commit 62b95373329c64b90d266019f98f423f3c635351)
 2018-03-29 09:45:09 -07:00
Wangda Tan
0b7eed5e34 YARN-8062. yarn rmadmin -getGroups returns group from which the user has been removed. (Sunil G via wangda) 
Change-Id: I80ed63846502bf7751b890b6c6c6a7c0679e2b4a
(cherry picked from commit 5d381570f83022b411a8740d58486a7f68ab2af6)
(cherry picked from commit 54da6a0d78c7832d647831b73030a1f75db932a9)
 2018-03-29 09:45:03 -07:00
Inigo Goiri
aa66e7cc27 HDFS-13204. RBF: Optimize name service safe mode icon. Contributed by liuhongtong. 
(cherry picked from commit 947b2829844f2b4ce42f72b7e3ee27d7c4a27df2)
(cherry picked from commit 0dc16559ee62f4f1691fae017d18358fe15c24cd)
 2018-03-29 09:44:57 -07:00
Yiqun Lin
8890bba13a HDFS-13291. RBF: Implement available space based OrderResolver. Contributed by Yiqun Lin. 
(cherry picked from commit cfc3a1c8f06fba4f4bd5ffe8bb2a6944d066948e)
(cherry picked from commit 1e01ddfe4f0075f5185ea6f3fc083b39c62a7d2a)
 2018-03-29 09:44:50 -07:00
Wangda Tan
5f5f5a6eb1 YARN-8070. Yarn Service API site doc broken due to unwanted character in YarnServiceAPI.md (Gour Saha via wangda) 
Change-Id: I22428b2f128d16e79ebbdeaf32869566963d0c6f
(cherry picked from commit 24f75e097a67ae90d2ff382bb2f2559caa02f32f)
(cherry picked from commit c98dd3bf18f6551f5be912ed36264a21cf8d42d9)
 2018-03-29 09:44:42 -07:00
weiy
640b03e068 HDFS-12512. RBF: Add WebHDFS. 
(cherry picked from commit 6e31a090842f8aeedb331b653b075499f8df6c60)
(cherry picked from commit d17aa8d0528a499e594aec4cb3e74651283f3479)
 2018-03-29 09:41:52 -07:00
Rohith Sharma K S
4ecb50a8ab YARN-7986. ATSv2 REST API queries do not return results for uppercase application tags. Contributed by Charan Hebri. 
(cherry picked from commit 75fc05f369929db768b767d79351bca8c13ad9ba)
(cherry picked from commit 91791a8abdf3d46278ee7c15eeb3dddc43918742)
 2018-03-29 09:41:36 -07:00
Sunil G
c30b026997 YARN-8063. DistributedShellTimelinePlugin wrongly check for entityId instead of entityType. Contributed by Rohith Sharma K S. 
(cherry picked from commit 22c5ddb7c4fb48d5bf5a7456d0b1b27d48c2a485)
(cherry picked from commit e10e6c90129f5d2f1ecdbaf18a43c529574505f4)
 2018-03-29 09:41:20 -07:00
Inigo Goiri
a9515dae7d HDFS-12792. RBF: Test Router-based federation using HDFSContract. Contributed by Inigo Goiri. 
(cherry picked from commit e196d158a275bfdcfaf372e0f5bcbbc8bbe24106)
(cherry picked from commit 59ab86311cd02ef37d08291a4ca63db92bf24521)
 2018-03-29 09:41:09 -07:00
Arpit Agarwal
a30a863c7f HADOOP-15334. Upgrade Maven surefire plugin. Contributed by Arpit Agarwal. 
(cherry picked from commit d82e846fa43a441af86355d95a5464c7ebcd5c15)
 2018-03-29 09:40:05 -07:00
Kihwal Lee
c05dd318bf HDFS-13195. DataNode conf page cannot display the current value after reconfig. Contributed by maobaolong. 
(cherry picked from commit 66461ed98b0b2f630b682bff927dbd74c251c26e)
(cherry picked from commit c245eceddad8883103df30bbff9a285798f29fdf)
 2018-03-29 09:39:57 -07:00
Inigo Goiri
05b9f0f5b7 HDFS-13318. RBF: Fix FindBugs in hadoop-hdfs-rbf. Contributed by Ekanth S. 
(cherry picked from commit 3d0ee8b80438bfbdf7e5af853b9044a63bd1352c)
(cherry picked from commit 485348a337cd1923ab51784784f560f82c11af26)
 2018-03-29 09:39:46 -07:00
Konstantin V Shvachko
3018aa64ae HDFS-12884. BlockUnderConstructionFeature.truncateBlock should be of type BlockInfo. Contributed by chencan. 
(cherry picked from commit 8d898ab25f1c2032a07c9bbd96ba3d0c4eb5be87)
(cherry picked from commit 21db4e9efe9ff634c905aa32667d9dbb203b3699)
 2018-03-29 09:39:11 -07:00
Jason Lowe
dc075b727a YARN-8054. Improve robustness of the LocalDirsHandlerService MonitoringTimerTask thread. Contributed by Jonathan Eagles 
(cherry picked from commit 5aa7052e319c3273243dda9993fb6c2d776eb7cc)
(cherry picked from commit 5d4b2c31a19b2ce7d94a9ca12ed6a1def428bb83)
 2018-03-29 09:38:50 -07:00
Yiqun Lin
d7d35fd4f0 HDFS-13250. RBF: Router to manage requests across multiple subclusters. Contributed by Inigo Goiri. 
(cherry picked from commit 2caba999bbb9d6e3ec56024a0a9d3d56a229edcf)
(cherry picked from commit 0db4b587c604300ffb44677f7cf81ae3faa430d3)
 2018-03-29 09:38:42 -07:00
Yiqun Lin
94b826d2c7 HDFS-13307. RBF: Improve the use of setQuota command. Contributed by liuhongtong. 
(cherry picked from commit 69fe4407ebd885fed69d9cf7f4dd17d3ba1acb60)
(cherry picked from commit 131546002da0dc6d8d511a62599df071279ef347)
 2018-03-29 09:37:47 -07:00
Sunil G
8443bb2ffb YARN-8085. ResourceProfilesManager should be set in RMActiveServiceContext. Contributed by Tao Yang. 
(cherry picked from commit 7a59d60e0c50e8264e07f6b1dadaeedba676c8c2)
 2018-03-29 21:43:34 +05:30
Lei Xu
704d43603b Update 3.0.1 jdiff file and jdiff stable api version 2018-03-23 11:58:14 -07:00
Lei Xu
b6a10e2b2b Update releasenotes and changelogs for 3.0.1 release 2018-03-23 11:57:45 -07:00
Wangda Tan
b72856287c Updated index.md.vm for 3.1.0 release 
Change-Id: Idc5ab7167562b8bc99d32c27af4744e45fa7473e
release-3.1.0-RC0 		2018-03-21 16:53:43 -07:00
Rohith Sharma K S
4d020c49a9 YARN-7581. HBase filters are not constructed correctly in ATSv2. Contributed by Habio Chen. 
(cherry picked from commit 29acea5000337a7f529bb1810a2af2b0af4d5f1d)
(cherry picked from commit bbfe36d6865a568d0e709e651a3f48ab9644794b)
 2018-03-21 16:49:47 -07:00
Haibo Chen
dfcafa84ac YARN-8053. Add hadoop-distcp in exclusion in hbase-server dependencies for timelineservice-hbase packages. (Rohith Sharma K S via Haibo Chen) 
(cherry picked from commit 3ff6977d3e29cff455a71f668bec8ed35fb90774)
 2018-03-21 16:41:10 -07:00
Wangda Tan
0972780c47 Preparing for 3.1.0 release 
Change-Id: I9865da5d4c9437248e136b1161e0868567ab014d
 2018-03-20 11:34:03 -07:00
Inigo Goiri
9b96e7522b HDFS-13268. TestWebHdfsFileContextMainOperations fails on Windows. Contributed by Xiao Liang. 
(cherry picked from commit fe224ff972a299a74c16a6a20ddd85ea16486b1e)
 2018-03-20 11:20:37 -07:00
weiy
c804b28462 HDFS-13215. RBF: Move Router to its own module. 2018-03-19 23:05:33 -07:00
Sammi Chen
5acc13f340 HADOOP-15262. AliyunOSS: move files under a directory in parallel when rename a directory. Contributed by Jinhu Wu. 
(cherry picked from commit d67a5e2dec5c60d96b0c216182891cdfd7832ac5)
(cherry picked from commit 2285afb32e71622b3dab5051247a1d099cfcbe85)
(cherry picked from commit 322520eb76cdcef25190495ccf98b3ca39907f58)
(cherry picked from commit 7985c5fdc9fe26e7771a86a5004bf90fcbd8af71)
 2018-03-20 14:03:17 +08:00
Inigo Goiri
7eb0bdbd32 HDFS-13296. GenericTestUtils generates paths with drive letter in Windows and fail webhdfs related test cases. Contributed by Xiao Liang. 
(cherry picked from commit e65ff1c8be48ef4f04ed96f96ac4caef4974944d)
 2018-03-19 17:20:36 -07:00
Jason Lowe
a4f0dbcb44 YARN-8027. Setting hostname of docker container breaks for --net=host in docker 1.13. Contributed by Jim Brennan 
(cherry picked from commit f480367af68e06ed17b8018092c9987a13bb9f63)
 2018-03-19 17:44:06 -05:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
0bd99621c5 Preparing for 3.1.0 development 2018-03-19 15:16:54 -07:00
Yufei Gu
49c747ab18 YARN-8039. Clean up log dir configuration in TestLinuxContainerExecutorWithMocks.testStartLocalizer. Contributed by Miklos Szegedi. 2018-03-16 16:25:33 -07:00
Inigo Goiri
08ff1586d5 HDFS-12886. Ignore minReplication for block recovery. Contributed by Lukas Majercak. 2018-03-16 10:29:19 -07:00
Weiwei Yang
154cfb2b62 YARN-7636. Re-reservation count may overflow when cluster resource exhausted for a long time. contributed by Tao Yang. 2018-03-16 18:57:31 +08:00
Xiao Chen
21c6661461 HADOOP-15234. Throw meaningful message on null when initializing KMSWebApp. Contributed by fang zhenyi. 2018-03-15 20:17:16 -07:00
Wangda Tan
4bf622043f YARN-7952. RM should be able to recover log aggregation status after restart/fail-over. (Xuan Gong via wangda) 
Change-Id: I725c9afe64831eda0aa6b0bebdbc79d2dd165707
 2018-03-15 13:26:45 -07:00
Wangda Tan
f47659fb97 MAPREDUCE-7047. Make HAR tool support IndexedLogAggregtionController. (Xuan Gong via wangda) 
Change-Id: Ice5ae1c706f2476361997dcbb29f2c33c77d4f0c
 2018-03-15 13:26:01 -07:00
Steve Loughran
1976e0066e HADOOP-15209. DistCp to eliminate needless deletion of files under already-deleted directories. 
Contributed by Steve Loughran.
 2018-03-15 18:05:14 +00:00
Xiaoyu Yao
78b05fde6c HDFS-13280. WebHDFS: Fix NPE in get snasphottable directory list call. Contributed by Lokesh Jain. 2018-03-15 11:02:27 -07:00
Inigo Goiri
e71bc00a47 HDFS-13224. RBF: Resolvers to support mount points across multiple subclusters. Contributed by Inigo Goiri. 2018-03-15 10:32:30 -07:00
Xiaoyu Yao
da777a5498 HDFS-13251. Avoid using hard coded datanode data dirs in unit tests(addendum). Contributed by Ajay Kumar. 2018-03-15 10:18:44 -07:00
Inigo Goiri
6de135169e HDFS-12723. TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently. Contributed by Ajay Kumar. 2018-03-15 10:14:35 -07:00
fang zhenyi
5e013d50d1
HADOOP-15305. Replace FileUtils.writeStringToFile(File, String) with (File, String, Charset) to fix deprecation warnings. 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2018-03-15 16:12:07 +09:00
Xiao Chen
5ff22d4c3a HDFS-13246. FileInputStream redundant closes in readReplicasFromCache. Contributed by liaoyuxiangqin. 2018-03-14 21:59:51 -07:00
Yiqun Lin
3a0f4bc0d5 HDFS-13261. Fix incorrect null value check. Contributed by Jianfei Jiang. 2018-03-15 11:06:04 +08:00
Aaron Fabbri
e840b4adf4
HADOOP-15278 log s3a at info. Contributed by Steve Loughran. 2018-03-14 15:47:56 -07:00
Wangda Tan
252c2b4d52 Revert "HADOOP-13707. If kerberos is enabled while HTTP SPNEGO is not configured, some links cannot be accessed. Contributed by Yuanbo Liu" 
Change-Id: I946a466a43d56c73bb0135384e73cb8513595461
(cherry picked from commit 80ee5248b2dda1cb8d122d4f362f2f8cf02b9467)
 2018-03-14 13:36:53 -07:00