Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,908 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

4473 Commits

Author SHA1 Message Date
Junping Du 2fefa1fa2e Add HDFS jdiff for 2.8.0 release. 
(cherry picked from commit d174c06b01)
 2017-03-25 14:33:06 -07:00
Hanisha Koneru a79ad2d122 HDFS-11570. Unit test for NameNodeStatusMXBean. Contributed by Hanisha Koneru. 2017-03-24 14:44:33 -07:00
Xiaobing Zhou 757d9ebcc5 HDFS-11534. Add counters for number of blocks in pending IBR. Contributed by Xiaobing Zhou. 2017-03-24 14:40:00 -07:00
Wei-Chiu Chuang 14414705f7 HDFS-10506. OIV's ReverseXML processor cannot reconstruct some snapshot details. Contributed by Akira Ajisaka. 2017-03-24 08:43:14 -07:00
Zhe Zhang f98f4bb6ca HADOOP-9631. ViewFs should use underlying FileSystem's server side defaults. Contributed by Lohit Vijayarenu and Erik Krogen. 
(cherry picked from commit 59d69257a8)
 2017-03-22 22:32:07 -07:00
John Zhuge 74fbdd557a HDFS-11561. HttpFS doc errors. Contributed by Yuanbo Liu. 
(cherry picked from commit ed2d03f2a5)
 2017-03-22 22:16:34 -07:00
Chris Douglas 69f34e812e HDFS-6648. Order of namenodes in ConfiguredFailoverProxyProvider is undefined. Contributed by Inigo Goiri 
(cherry picked from commit b104f3a282)
 2017-03-20 17:16:15 -07:00
Arpit Agarwal 5d7197b2e6 HDFS-11547. Add logs for slow BlockReceiver while writing data to disk. Contributed by Xiaobing Zhou. 2017-03-17 19:03:41 -07:00
Arpit Agarwal 2b4b85e06f HDFS-11517. Include missed change in previous commit. 2017-03-17 16:12:53 -07:00
Hanisha Koneru dbd673d516 HDFS-11517. Expose slow disks via DataNode JMX. Contributed by Hanisha Koneru 2017-03-17 15:50:00 -07:00
Andrew Wang 7cc88eca43 HDFS-11516. Admin command line should print message to stderr in failure case. Contributed by Kai Sasaki. 
(cherry picked from commit 92ea6d74ec)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/cli/util/ErasureCodingCliCmdExecutor.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/resources/testErasureCodingConf.xml
 2017-03-17 11:34:43 -07:00
Xiaobing Zhou dbdd97d057 HDFS-10394. move declaration of okhttp version from hdfs-client to hadoop-project POM. Contributed by Xiaobing Zhou. 2017-03-16 18:13:55 -07:00
Kihwal Lee a264d98017 HDFS-10601. Improve log message to include hostname when the NameNode is in safemode. Contributed by Kuhu Shukla. 
(cherry picked from commit ba62b50eba)
 2017-03-16 11:02:48 -05:00
Yiqun Lin c0e061b410 HDFS-11420. Edit file should not be processed by the same type processor in OfflineEditsViewer. Contributed by Yiqun Lin. 2017-03-15 22:37:25 +08:00
Yiqun Lin f731013c88 HDFS-11526. Fix confusing block recovery message. Contributed by Yiqun Lin. 2017-03-14 17:52:31 +08:00
Jing Zhao e03d8ff488 HDFS-11395. RequestHedgingProxyProvider#RequestHedgingInvocationHandler hides the Exception thrown from NameNode. Contributed by Nandakumar. 
(cherry picked from commit 55796a0946)
 2017-03-13 14:26:44 -07:00
Yiqun Lin 7a65601dd9 HDFS-11512. Increase timeout on TestShortCircuitLocalRead#testSkipWithVerifyChecksum. Contributed by Eric Badger. 
(cherry picked from commit 79924266f8)
 2017-03-13 18:24:50 +08:00
Lei Xu ee1d3105c2 HDFS-11340. DataNode reconfigure for disks doesn't remove the failed volumes. (Manoj Govindassamy via lei) 2017-03-10 14:37:58 -08:00
Arpit Agarwal 5cdcda34a2 HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru. 2017-03-09 14:34:10 -08:00
Arpit Agarwal b6c4776911 HDFS-11461. DataNode Disk Outlier Detection. Contributed by Hanisha Koneru. 2017-03-09 12:59:48 -08:00
Masatake Iwasaki 60be2e5d8a HDFS-11499. Decommissioning stuck because of failing recovery. Contributed by Lukas Majercak and Manoj Govindassamy. 
(cherry picked from commit 385d2cb777)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
 2017-03-09 23:37:04 +09:00
Arpit Agarwal 8dc8ecbb91 HDFS-10838. Last full block report received time for each DN should be easily discoverable. Contributed by Surendra Singh Lilhore. 2017-03-06 16:40:00 -08:00
Andrew Wang 6e75c1e2f0 HDFS-11498. Make RestCsrfPreventionHandler and WebHdfsHandler compatible with Netty 4.0. 
(cherry picked from commit 5e74196ede)
 2017-03-06 15:04:29 -08:00
Yiqun Lin 5b49a96328 HDFS-8741. Proper error msg to be printed when invalid operation type is given to WebHDFS operations. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit 3536ce031c)
 2017-03-06 19:05:43 +08:00
Yiqun Lin 2288857e3b HDFS-11494. Log message when DN is not selected for block replication. Contributed by Yiqun Lin. 2017-03-04 13:41:49 +08:00
Jing Zhao 30b43a2d4e HDFS-11476. Fix NPE in FsDatasetImpl#checkAndUpdate. Contributed by Xiaobing Zhou. 
(cherry picked from commit ac5ae0065a)
 2017-03-03 13:35:13 -08:00
Andrew Wang d737a26c5a Revert "HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru." 
This reverts commit 5e760f8dc4.
 2017-03-02 16:21:32 -08:00
Arpit Agarwal 5e760f8dc4 HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru. 2017-03-02 15:38:32 -08:00
Ming Ma 8ce4863103 HDFS-11412. Maintenance minimum replication config value allowable range should be [0, DefaultReplication]. (Manoj Govindassamy via mingma) 2017-03-02 11:06:48 -08:00
John Zhuge cacaa299cf HDFS-11418. HttpFS should support old SSL clients. Contributed by John Zhuge. 
Change-Id: I05b1228f7f168e9b5904365ba9e81be3f29dce74
 2017-03-01 19:45:25 -08:00
Brahma Reddy Battula a545ee4d7f HDFS-11432. Federation : Support fully qualified path for Quota/Snapshot/cacheadmin/cryptoadmin commands. Contributed by Brahma Reddy Battula. 
(cherry picked from commit dcd03df9f9)
 2017-03-01 10:47:47 +05:30
Zhe Zhang 5fb785e154 HDFS-11466. Change dfs.namenode.write-lock-reporting-threshold-ms default from 1000ms to 5000ms. Contributed by Andrew Wang. 
(cherry picked from commit d269b488a7)
 2017-02-28 09:02:59 -08:00
Wei-Chiu Chuang f3cdf29af4 HDFS-8498. Blocks can be committed with wrong size. Contributed by Jing Zhao. 2017-02-25 21:13:51 -08:00
Arpit Agarwal 98af813098 HDFS-11462. Fix occasional BindException in TestNameNodeMetricsLogger. 2017-02-24 19:53:45 -08:00
Yiqun Lin 31f9ef2203 HDFS-11433. Document missing usages of OfflineEditsViewer processors. Contributed by Yiqun Lin. 
(cherry picked from commit 4a58870a04)
 2017-02-25 10:03:02 +08:00
Arpit Agarwal fa86ec99a1 HDFS-11295. Check storage remaining instead of node remaining in BlockPlacementPolicyDefault.chooseReplicaToDelete(). Contributed by Marton Elek. 2017-02-24 15:44:19 -08:00
Akira Ajisaka bd3c2a2ee9 HDFS-10620. StringBuilder created and appended even if logging is disabled. Contributed by Staffan Friberg. 2017-02-25 04:17:17 +09:00
Andrew Wang 6c5fd82773 HDFS-11438. Fix typo in error message of StoragePolicyAdmin tool. Contributed by Alison Yu. 
(cherry picked from commit d150f061f4)
 2017-02-22 15:16:12 -08:00
Ming Ma 0add328c8c HDFS-11411. Avoid OutOfMemoryError in TestMaintenanceState test runs. (Manoj Govindassamy via mingma) 
(cherry picked from commit cfcd527323)
 2017-02-22 09:42:47 -08:00
Andrew Wang 4428c3da69 HDFS-11406. Remove unused getStartInstance and getFinalizeInstance in FSEditLogOp. Contributed by Alison Yu. 
(cherry picked from commit 8ef7ebbc71)
 2017-02-21 14:54:32 -08:00
Eric Payne 41d31588d1 HDFS-11404. Increase timeout on TestShortCircuitLocalRead.testDeprecatedGetBlockLocalPathInfoRpc. Contributed by Eric Badger 
(cherry picked from commit a07ddef101)
 2017-02-21 12:09:29 -06:00
Vinayakumar B 00ca9f1792 HDFS-11177. 'storagepolicies -getStoragePolicy' command should accept URI based path. (Contributed by Surendra Singh Lilhore) 
(cherry picked from commit 4804050630)
 2017-02-21 18:15:03 +05:30
Xiao Chen 06386b7e78 HDFS-11410. Use the cached instance when edit logging SetAclOp, SetXAttrOp and RemoveXAttrOp. 
(cherry picked from commit 02c549484a)
 2017-02-16 18:08:16 -08:00
Ming Ma 0f8b99fd34 HDFS-11265. Extend visualization for Maintenance Mode under Datanode tab in the NameNode UI. (Marton Elek via mingma) 
(cherry picked from commit a136936d01)
 2017-02-15 20:25:04 -08:00
Mingliang Liu 96be70513a HDFS-11375. Display the volume storage type in datanode UI. Contributed by Surendra Singh Lilhore 
(cherry picked from commit 0741dd3b9a)
 2017-02-15 12:34:43 -08:00
Wei-Chiu Chuang a8531d5d52 HDFS-11333. Print a user friendly error message when plugins are not found. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 859bd159ae)
 2017-02-15 02:59:45 -08:00
Yongjun Zhang eb5500f0e7 HDFS-11391. Numeric usernames do no work with WebHDFS FS write access. (Pierre Villard via Yongjun Zhang) 
(cherry picked from commit 8e53f2b9b0)
 2017-02-14 14:11:45 -08:00
Xiaoyu Yao d72f1c5976 HDFS-11409. DatanodeInfo getNetworkLocation and setNetworkLocation shoud use volatile instead of synchronized. Contributed by Chen Liang. 
(cherry picked from commit aaf2713235)
 2017-02-14 12:55:49 -08:00
Xiao Chen 92dbdbc490 HDFS-11390. Add process name to httpfs process. Contributed by Weiwei Yang. 2017-02-14 09:46:55 -08:00
Wei-Chiu Chuang 8e291e1015 HDFS-11084. Add a regression test for sticky bit support of OIV ReverseXML processor. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 89cadb42111e4ffbd3f4bde8250013bba23eb51e)
 2017-02-14 09:08:37 -08:00