Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,217 Commits 326 Branches 371 Tags
Commit Graph

4737 Commits

Author SHA1 Message Date
Andrew Wang
832c2f52f8 HADOOP-13688. Stop bundling HTML source code in javadoc JARs. 
(cherry picked from commit 72a2ae6452e615c66d10829da38737896814e02b)
 2017-04-06 13:14:59 -07:00
Arpit Agarwal
75e60b6bb7 HDFS-11131. TestThrottledAsyncChecker#testCancellation is flaky. 2017-04-05 17:54:27 -07:00
Xiaobing Zhou
9f20532ef5 HDFS-11628. Clarify the behavior of HDFS Mover in documentation. Contributed by Xiaobing Zhou. 2017-04-05 15:33:19 -07:00
Andrew Wang
e154893d3b HDFS-11538. Move ClientProtocol HA proxies into hadoop-hdfs-client. Contributed by Huafeng Wang. 2017-04-05 12:52:34 -07:00
Hanisha Koneru
4cdda4ba87 HDFS-11545. Propagate DataNode's slow disks info to the NameNode via Heartbeat. Contributed by Hanisha Koneru. 2017-04-05 07:35:09 -07:00
Akira Ajisaka
88e1799034
HDFS-9651. Add missing robots.txt files. 
(cherry picked from commit 8cb73255274bd46ea8aedbb28f25fa13b38723ad)
 2017-04-05 12:48:12 +09:00
Akira Ajisaka
a563fa8ee9
HDFS-9651. All web UIs should include a robots.txt file. Contributed by Lars Francke. 
(cherry picked from commit 09e6caec3dbba257f11fe7246d4c25ee8fc95d8b)
 2017-04-05 12:46:09 +09:00
Hanisha Koneru
fbe86471cf HDFS-11551. Support Timeout when checking single disk. Contributed by Hanisha Koneru. 2017-04-04 10:49:44 -07:00
Wei-Chiu Chuang
4f1f16f1a6 HDFS-11515. -du throws ConcurrentModificationException. Contributed by Istvan Fajth, Wei-Chiu Chuang. 
(cherry picked from commit bc7aff7cec07bbc3fed63a00c8f1584c34670998)
 2017-04-03 07:36:08 -07:00
Mingliang Liu
9e7f8cbf9a HDFS-11592. Closing a file has a wasteful preconditions in NameNode. Contributed by Eric Badger 
(cherry picked from commit e5f0622a6f40706d360d45200c8f259c79046438)
 2017-03-30 15:44:44 -07:00
Daniel Templeton
e00ad6fca5 HDFS-11571. Typo in DataStorage exception message (Contributed by Anna Budai via Daniel Templeton) 
(cherry picked from commit 15e3873dc3d46016344887570e5d4aa8d20ca264)
 2017-03-29 10:57:52 -07:00
Andrew Wang
82b4a9c3d0 HDFS-9705. Refine the behaviour of getFileChecksum when length = 0. Contributed by SammiChen and Kai Zheng. 2017-03-28 21:40:53 -07:00
Masatake Iwasaki
b7b9d74521 HDFS-11486. Client close() should not fail fast if the last block is being decommissioned. Contributed by Wei-Chiu Chuang and Yiqun Lin. 
(cherry picked from commit 64ea62c1ccc05d9b0a0030beafa60ddd31c38952)
 2017-03-28 09:19:42 +09:00
Andrew Wang
10deafee82 HDFS-11170. Add builder-based create API to FileSystem. Contributed by SammiChen and Wei Zhou. 2017-03-27 14:35:03 -07:00
Junping Du
2fefa1fa2e Add HDFS jdiff for 2.8.0 release. 
(cherry picked from commit d174c06b01e1f743d3111b9b760a9824d8106b86)
 2017-03-25 14:33:06 -07:00
Hanisha Koneru
a79ad2d122 HDFS-11570. Unit test for NameNodeStatusMXBean. Contributed by Hanisha Koneru. 2017-03-24 14:44:33 -07:00
Xiaobing Zhou
757d9ebcc5 HDFS-11534. Add counters for number of blocks in pending IBR. Contributed by Xiaobing Zhou. 2017-03-24 14:40:00 -07:00
Wei-Chiu Chuang
14414705f7 HDFS-10506. OIV's ReverseXML processor cannot reconstruct some snapshot details. Contributed by Akira Ajisaka. 2017-03-24 08:43:14 -07:00
Zhe Zhang
f98f4bb6ca HADOOP-9631. ViewFs should use underlying FileSystem's server side defaults. Contributed by Lohit Vijayarenu and Erik Krogen. 
(cherry picked from commit 59d69257a888347f0fb9c51bb000afc986b64f98)
 2017-03-22 22:32:07 -07:00
John Zhuge
74fbdd557a HDFS-11561. HttpFS doc errors. Contributed by Yuanbo Liu. 
(cherry picked from commit ed2d03f2a5318a88d0eced8476127f303eb1d1d9)
 2017-03-22 22:16:34 -07:00
Chris Douglas
69f34e812e HDFS-6648. Order of namenodes in ConfiguredFailoverProxyProvider is undefined. Contributed by Inigo Goiri 
(cherry picked from commit b104f3a282ab8e15314446e71189eb3a3b5dd9a6)
 2017-03-20 17:16:15 -07:00
Arpit Agarwal
5d7197b2e6 HDFS-11547. Add logs for slow BlockReceiver while writing data to disk. Contributed by Xiaobing Zhou. 2017-03-17 19:03:41 -07:00
Arpit Agarwal
2b4b85e06f HDFS-11517. Include missed change in previous commit. 2017-03-17 16:12:53 -07:00
Hanisha Koneru
dbd673d516 HDFS-11517. Expose slow disks via DataNode JMX. Contributed by Hanisha Koneru 2017-03-17 15:50:00 -07:00
Andrew Wang
7cc88eca43 HDFS-11516. Admin command line should print message to stderr in failure case. Contributed by Kai Sasaki. 
(cherry picked from commit 92ea6d74ecd84b86771e285902dd2a80bccbe3ea)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/cli/util/ErasureCodingCliCmdExecutor.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/resources/testErasureCodingConf.xml
 2017-03-17 11:34:43 -07:00
Xiaobing Zhou
dbdd97d057 HDFS-10394. move declaration of okhttp version from hdfs-client to hadoop-project POM. Contributed by Xiaobing Zhou. 2017-03-16 18:13:55 -07:00
Kihwal Lee
a264d98017 HDFS-10601. Improve log message to include hostname when the NameNode is in safemode. Contributed by Kuhu Shukla. 
(cherry picked from commit ba62b50ebacd33b55eafc9db55a2fe5b4c80207a)
 2017-03-16 11:02:48 -05:00
Yiqun Lin
c0e061b410 HDFS-11420. Edit file should not be processed by the same type processor in OfflineEditsViewer. Contributed by Yiqun Lin. 2017-03-15 22:37:25 +08:00
Yiqun Lin
f731013c88 HDFS-11526. Fix confusing block recovery message. Contributed by Yiqun Lin. 2017-03-14 17:52:31 +08:00
Jing Zhao
e03d8ff488 HDFS-11395. RequestHedgingProxyProvider#RequestHedgingInvocationHandler hides the Exception thrown from NameNode. Contributed by Nandakumar. 
(cherry picked from commit 55796a0946f80a35055701a34379e374399009c5)
 2017-03-13 14:26:44 -07:00
Yiqun Lin
7a65601dd9 HDFS-11512. Increase timeout on TestShortCircuitLocalRead#testSkipWithVerifyChecksum. Contributed by Eric Badger. 
(cherry picked from commit 79924266f8f68e5e7c873e6b12e3b3acfcd708da)
 2017-03-13 18:24:50 +08:00
Lei Xu
ee1d3105c2 HDFS-11340. DataNode reconfigure for disks doesn't remove the failed volumes. (Manoj Govindassamy via lei) 2017-03-10 14:37:58 -08:00
Arpit Agarwal
5cdcda34a2 HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru. 2017-03-09 14:34:10 -08:00
Arpit Agarwal
b6c4776911 HDFS-11461. DataNode Disk Outlier Detection. Contributed by Hanisha Koneru. 2017-03-09 12:59:48 -08:00
Masatake Iwasaki
60be2e5d8a HDFS-11499. Decommissioning stuck because of failing recovery. Contributed by Lukas Majercak and Manoj Govindassamy. 
(cherry picked from commit 385d2cb777a0272ac20c62336c944fad295d5d12)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
 2017-03-09 23:37:04 +09:00
Arpit Agarwal
8dc8ecbb91 HDFS-10838. Last full block report received time for each DN should be easily discoverable. Contributed by Surendra Singh Lilhore. 2017-03-06 16:40:00 -08:00
Andrew Wang
6e75c1e2f0 HDFS-11498. Make RestCsrfPreventionHandler and WebHdfsHandler compatible with Netty 4.0. 
(cherry picked from commit 5e74196ede9bfc20eb6d6fe3aa6a0e5c47a40fdd)
 2017-03-06 15:04:29 -08:00
Yiqun Lin
5b49a96328 HDFS-8741. Proper error msg to be printed when invalid operation type is given to WebHDFS operations. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit 3536ce031ca780d6de83cf67779f571a0142ccc8)
 2017-03-06 19:05:43 +08:00
Yiqun Lin
2288857e3b HDFS-11494. Log message when DN is not selected for block replication. Contributed by Yiqun Lin. 2017-03-04 13:41:49 +08:00
Jing Zhao
30b43a2d4e HDFS-11476. Fix NPE in FsDatasetImpl#checkAndUpdate. Contributed by Xiaobing Zhou. 
(cherry picked from commit ac5ae0065a127ac150a887fa6c6f3cffd86ef733)
 2017-03-03 13:35:13 -08:00
Andrew Wang
d737a26c5a Revert "HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru." 
This reverts commit 5e760f8dc4bc007bd839f33fe4a99fa603755149.
 2017-03-02 16:21:32 -08:00
Arpit Agarwal
5e760f8dc4 HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru. 2017-03-02 15:38:32 -08:00
Ming Ma
8ce4863103 HDFS-11412. Maintenance minimum replication config value allowable range should be [0, DefaultReplication]. (Manoj Govindassamy via mingma) 2017-03-02 11:06:48 -08:00
John Zhuge
cacaa299cf HDFS-11418. HttpFS should support old SSL clients. Contributed by John Zhuge. 
Change-Id: I05b1228f7f168e9b5904365ba9e81be3f29dce74
 2017-03-01 19:45:25 -08:00
Brahma Reddy Battula
a545ee4d7f HDFS-11432. Federation : Support fully qualified path for Quota/Snapshot/cacheadmin/cryptoadmin commands. Contributed by Brahma Reddy Battula. 
(cherry picked from commit dcd03df9f9e0080d7e179060ffc8148336c31b3e)
 2017-03-01 10:47:47 +05:30
Zhe Zhang
5fb785e154 HDFS-11466. Change dfs.namenode.write-lock-reporting-threshold-ms default from 1000ms to 5000ms. Contributed by Andrew Wang. 
(cherry picked from commit d269b488a71a158d3ddcbdea96992abe29725c69)
 2017-02-28 09:02:59 -08:00
Wei-Chiu Chuang
f3cdf29af4 HDFS-8498. Blocks can be committed with wrong size. Contributed by Jing Zhao. 2017-02-25 21:13:51 -08:00
Arpit Agarwal
98af813098 HDFS-11462. Fix occasional BindException in TestNameNodeMetricsLogger. 2017-02-24 19:53:45 -08:00
Yiqun Lin
31f9ef2203 HDFS-11433. Document missing usages of OfflineEditsViewer processors. Contributed by Yiqun Lin. 
(cherry picked from commit 4a58870a0427ecdf4c5c895088b96a0b4d1c0c19)
 2017-02-25 10:03:02 +08:00
Arpit Agarwal
fa86ec99a1 HDFS-11295. Check storage remaining instead of node remaining in BlockPlacementPolicyDefault.chooseReplicaToDelete(). Contributed by Marton Elek. 2017-02-24 15:44:19 -08:00