Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,722 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

6932 Commits

Author SHA1 Message Date
Yiqun Lin 6a547856ef HDFS-13863. FsDatasetImpl should log DiskOutOfSpaceException. Contributed by Fei Hui. 
(cherry picked from commit 582cb10ec7)
 2018-08-30 11:24:25 +08:00
Brahma Reddy Battula 3b01279612 HDFS-13854. RBF: The ProcessingAvgTime and ProxyAvgTime should display by JMX with ms unit. Contributed by yanghuafeng. 
(cherry picked from commit 64ad0298d4)
 2018-08-29 08:32:05 +05:30
Wei-Chiu Chuang 72e1e1904b HDFS-13831. Make block increment deletion number configurable. Contributed by Ryan Wu. 2018-08-28 16:36:30 -07:00
Zsolt Venczel 2d1f819979 HDFS-13731. ReencryptionUpdater fails with ConcurrentModificationException during processCheckpoints. Contributed by Zsolt Venczel. 
(cherry picked from commit 3e18b957eb)
 2018-08-28 15:14:57 -07:00
Wei-Chiu Chuang d89a485b25 HDFS-13838. WebHdfsFileSystem.getFileStatus() won't return correct "snapshot enabled" status. Contributed by Siyao Meng. 
(cherry picked from commit 26c2a97c56)
(cherry picked from commit 41732e7b28)
 2018-08-27 16:04:16 -07:00
Konstantin V Shvachko 27abdb390b HDFS-13848. Refactor NameNode failover proxy providers. Contributed by Konstantin Shvachko. 
(cherry picked from commit a4121c71c2)
 2018-08-24 18:51:42 -07:00
Yiqun Lin 4ef3025964 HDFS-13821. RBF: Add dfs.federation.router.mount-table.cache.enable so that users can disable cache. Contributed by Fei Hui. 2018-08-22 13:01:13 +08:00
Wei-Chiu Chuang bd46906bd8 HDFS-10240. Race between close/recoverLease leads to missing block. Contributed by Jinglun, zhouyingchao and Wei-Chiu Chuang. 
(cherry picked from commit 865650052b)
 2018-08-21 15:44:08 -07:00
Yiqun Lin 5e2e68d4bb HDFS-13750. RBF: Router ID in RouterRpcClient is always null. Contributed by Takanobu Asanuma. 
(cherry picked from commit 01ff817814)
 2018-08-20 23:03:19 +08:00
Xiao Chen 185c8f2abc HDFS-13747. Statistic for list_located_status is incremented incorrectly by listStatusIterator. Contributed by Antal Mihalyi. 
(cherry picked from commit c67b0650ea)
 2018-08-16 23:15:58 -07:00
Daniel Templeton 27508086de HDFS-13746. Still occasional "Should be different group" failure in TestRefreshUserMappings#testGroupMappingRefresh 
(Contributed by Siyao Meng via Daniel Templeton)

Change-Id: I9fad1537ace38367a463d9fe67aaa28d3178fc69
(cherry picked from commit 8512e1a91b)
(cherry picked from commit fbedf89377)
 2018-08-16 15:02:18 -07:00
Xiao Chen 5d16301ad9 HDFS-13788. Update EC documentation about rack fault tolerance. Contributed by Kitti Nanasi. 
(cherry picked from commit cede33997f)
 2018-08-14 11:59:05 -07:00
Wei-Chiu Chuang 6f2a46578f HDFS-13758. DatanodeManager should throw exception if it has BlockRecoveryCommand but the block is not under construction. Contributed by chencan. 
(cherry picked from commit 61a9b4f58b)
(cherry picked from commit 7a115e8de4)
 2018-08-14 11:52:55 -07:00
Wei-Chiu Chuang d502abe947 HDFS-13738. fsck -list-corruptfileblocks has infinite loop if user is not privileged. Contributed by Yuen-Kuei Hsueh. 
(cherry picked from commit 4023eeba05)
(cherry picked from commit 74d4fd975a)
 2018-08-13 17:37:36 -07:00
Wei-Chiu Chuang 4b606eb9fd HDFS-13813. Exit NameNode if dangling child inode is detected when saving FsImage. Contributed by Siyao Meng. 
(cherry picked from commit 23854443ef)
(cherry picked from commit b38649c59a)
 2018-08-13 16:14:01 -07:00
Vinayakumar B eecfbaff3b HDFS-13786. EC: Display erasure coding policy for sub-directories is not working. Contributed by Ayush Saxena. 
(cherry picked from commit 2b0f977241)
 2018-08-13 13:58:37 -07:00
Chen Liang 2d985b6c81 HDFS-13735. Make QJM HTTP URL connection timeout configurable. Contributed by Chao Sun. 2018-08-13 12:47:17 -07:00
Chao Sun 07054c5994 Remove super user privilege requirement for NameNode.getServiceStatus. Contributed by Chao Sun. 
(cherry picked from commit a2a8c48699)
 2018-08-10 16:12:05 -07:00
Wangda Tan 8b4392769c Make 3.1.1 awared by other branches 
(cherry picked from commit 49c687608b)
(cherry picked from commit 781620a44d)
 2018-08-08 13:07:09 -07:00
Xiao Chen 8e5081569f HDFS-13728. Disk Balancer should not fail if volume usage is greater than capacity. Contributed by Stephen O'Donnell. 
(cherry picked from commit 6677717c68)
 2018-08-07 22:05:59 -07:00
Brahma Reddy Battula abc32c863e HDFS-12716. 'dfs.datanode.failed.volumes.tolerated' to support minimum number of volumes to be available. Contributed by Ranith Sardar and usharani 
(cherry picked from commit 3108d27edd)
 2018-07-30 16:08:49 +05:30
Arpit Agarwal eb40d4fab4 HDFS-13765. Fix javadoc for FSDirMkdirOp#createParentDirectories. Contributed by Lokesh Jain. 2018-07-27 10:14:11 -07:00
Anu Engineer faaf72dcb3 HDFS-13727. Log full stack trace if DiskBalancer exits with an unhandled exception. 
Contributed by Gabor Bota.

(cherry picked from commit 64e739e344)
 2018-07-27 09:35:02 -07:00
Wei-Chiu Chuang 0af04ad89f HDFS-11060. make DEFAULT_MAX_CORRUPT_FILEBLOCKS_RETURNED configurable. Contributed by Lantao Jin. 
(cherry picked from commit e95c5e9f62)
(cherry picked from commit 964f3454d1)
 2018-07-25 11:05:36 -07:00
Daniel Templeton 3210b3d8aa HDFS-13448. HDFS Block Placement - Ignore Locality for First Block Replica 
(Contributed by BELUGA BEHR via Daniel Templeton)

Change-Id: I965d1cfa642ad24296038b83e3d5c9983545267d
(cherry picked from commit 849c45db18)
(cherry picked from commit 00c476abd8)
 2018-07-24 16:13:30 -07:00
Yiqun Lin 097ae7fdc8 HDFS-13743. RBF: Router throws NullPointerException due to the invalid initialization of MountTableResolver. Contributed by Takanobu Asanuma. 
(cherry picked from commit 7b25fb949b)
 2018-07-20 17:32:27 +08:00
Yiqun Lin 34afb9f946 HDFS-13733. RBF: Add Web UI configurations and descriptions to RBF document. Contributed by Takanobu Asanuma. 
(cherry picked from commit 1af87df242)
 2018-07-17 10:48:36 +08:00
Konstantin V Shvachko 475c282939 Fix potential FSImage corruption. Contributed by Ekanth Sethuramalingam & Arpit Agarwal. 
(cherry picked from commit 0a1e922f3d)
 2018-07-16 18:33:36 -07:00
Wei-Chiu Chuang 0d2b983dc2 HDFS-13524. Occasional "All datanodes are bad" error in TestLargeBlock#testLargeBlockSize. Contributed by Siyao Meng. 
(cherry picked from commit 88b2794244)
(cherry picked from commit ac9155d6cb)
 2018-07-16 10:53:30 -07:00
Inigo Goiri 3d47ef1d31 HDFS-13475. RBF: Admin cannot enforce Router enter SafeMode. Contributed by Chao Sun. 
(cherry picked from commit 359ea4e181)
 2018-07-16 09:47:22 -07:00
Xiao Chen 883df537d6 HDFS-12837. Intermittent failure in TestReencryptionWithKMS. 
(cherry picked from commit b37074be5a)
 2018-07-11 21:03:53 -07:00
Akira Ajisaka 4d5473c89d
HDFS-13729. Fix broken links to RBF documentation. Contributed by Gabor Bota. 
(cherry picked from commit 418cc7f3ae)
 2018-07-11 14:48:12 -04:00
Wei-Chiu Chuang 74aa4be92d HDFS-13723. Occasional "Should be different group" error in TestRefreshUserMappings#testGroupMappingRefresh. Contributed by Siyao Meng. 
(cherry picked from commit 162228e8db)
(cherry picked from commit f9fa3cb157)
 2018-07-11 10:04:38 -07:00
Yiqun Lin 241f7bb7ad HDFS-13726. RBF: Fix RBF configuration links. Contributed by Takanobu Asanuma. 
(cherry picked from commit 2ae13d41dc)
 2018-07-11 22:19:32 +08:00
Andrew Wang 0e57e81b0c HDFS-13719. Docs around dfs.image.transfer.timeout are misleading. Contributed by Kitti Nansi. 
(cherry picked from commit eecb5baaaa)
 2018-07-09 15:17:48 +02:00
Wei-Chiu Chuang 68290606ea HDFS-13121. NPE when request file descriptors when SC read. Contributed by Zsolt Venczel. 
(cherry picked from commit 0247cb6318)
(cherry picked from commit f5f4d0b7e7)
 2018-07-06 15:01:35 -07:00
Andrew Wang 896b51578f HDFS-13712. BlockReaderRemote.read() logging improvement. Contributed by Gergo Repas. 
(cherry picked from commit 344f324710)
 2018-07-03 11:08:05 +02:00
Inigo Goiri 98f2444a7d HDFS-13714. Fix TestNameNodePrunesMissingStorages test failures on Windows. Contributed by Lukas Majercak. 
(cherry picked from commit 7296b644f7)
 2018-07-02 16:37:36 -07:00
Wei-Chiu Chuang 563d56be62 HDFS-13635. Incorrect message when block is not found. Contributed by Gabor Bota. 
(cherry picked from commit fef20a446f)
(cherry picked from commit 2ce892fcf5)
 2018-07-02 09:44:16 -07:00
Andrew Wang d34260f122 HDFS-13702. Remove HTrace hooks from DFSClient to reduce CPU usage. Contributed by Todd Lipcon. 
(cherry picked from commit 5d748bd056)
 2018-07-02 12:11:14 +02:00
Andrew Wang 7cd769b31c HDFS-13703. Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks are hit. Contributed by Todd Lipcon. 
(cherry picked from commit 6ba9974108)
 2018-07-02 12:02:27 +02:00
Yiqun Lin db1f37a711 HDFS-13692. StorageInfoDefragmenter floods log when compacting StorageInfo TreeSet. Contributed by Bharat Viswanadham. 
(cherry picked from commit 30728aced4)
 2018-06-22 10:55:09 +08:00
Xiao Chen aca66f6155 HDFS-13682. Cannot create encryption zone after KMS auth token expires. 
(cherry picked from commit 32f867a6a9)
 2018-06-20 15:59:45 -07:00
Surendra Singh Lilhore 5667582bc4 HDFS-12857. StoragePolicyAdmin should support schema based path. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit 30941d99c9)
 2018-06-19 10:09:05 -07:00
Inigo Goiri 11d3db2dba HDFS-13681. Fix TestStartup.testNNFailToStartOnReadOnlyNNDir test failure on Windows. Contributed by Xiao Liang. 
(cherry picked from commit 8762e9cf10)
 2018-06-15 16:50:20 -07:00
Inigo Goiri 69abd1fc5c HDFS-13686. Add overall metrics for FSNamesystemLock. Contributed by Lukas Majercak. 
(cherry picked from commit d31a3ce767)
 2018-06-15 16:00:16 -07:00
Wei-Chiu Chuang 73badce597 HDFS-13174. hdfs mover -p /path times out after 20 min. Contributed by Istvan Fajth. 
(cherry picked from commit c966a3837a)
(cherry picked from commit 975d4b3d60)
 2018-06-15 13:38:11 -07:00
Inigo Goiri fe1926a50f HDFS-13676. TestEditLogRace fails on Windows. Contributed by Zuoming Zhang. 
(cherry picked from commit eebeb6033f)
 2018-06-15 13:08:47 -07:00
Inigo Goiri 94e0b9839f HDFS-13673. TestNameNodeMetrics fails on Windows. Contributed by Zuoming Zhang. 
(cherry picked from commit 43d994e4a6)
 2018-06-15 10:34:33 -07:00
Inigo Goiri a3c0c03899 HDFS-13563. TestDFSAdminWithHA times out on Windows. Contributed by Lukas Majercak. 
(cherry picked from commit 8d4926f38b)
 2018-06-14 09:59:50 -07:00