Yiqun Lin
|
1d776f22f9
|
HDFS-13435. RBF: Improve the error loggings for printing the stack trace.
(cherry picked from commit c4d3636c21)
|
2018-04-17 11:25:14 +08:00 |
Arpit Agarwal
|
43a2af5569
|
HDFS-13439. Add test case for read block operation when it is moved. Contributed by Ajay Kumar.
|
2018-04-16 14:18:41 -07:00 |
Xiao Chen
|
805e33b62c
|
HDFS-13056. Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts. Contributed by Dennis Huo.
|
2018-04-16 11:58:10 -07:00 |
Wei-Chiu Chuang
|
ca8bb322be
|
HDFS-13330. ShortCircuitCache#fetchOrCreate never retries. Contributed by Gabor Bota.
(cherry picked from commit e66e287efe)
|
2018-04-13 12:18:49 -07:00 |
|
Wei-Chiu Chuang
|
696d786063
|
HDFS-11900. Hedged reads thread pool creation not synchronized. Contributed by John Zhuge.
|
2018-04-13 10:16:23 -07:00 |
Xiaoyu Yao
|
867135af28
|
HDFS-11043. TestWebHdfsTimeouts fails. Contributed by Xiaoyu Yao and Chao Sun.
|
2018-04-13 10:14:47 -07:00 |
Yongjun Zhang
|
56acbe476b
|
HDFS-13315. Add a test for the issue reported in HDFS-11481 which is fixed by HDFS-10997. Contributed by Yongjun Zhang.
|
2018-04-13 10:14:24 -07:00 |
Chris Douglas
|
ffc39ec3ab
|
HADOOP-14667. Flexible Visual Studio support. Contributed by Allen Wittenauer
|
2018-04-13 10:11:35 -07:00 |
Bharat Viswanadham
|
8df8cad019
|
HDFS-13438. Fix javadoc in FsVolumeList#removeVolume. Contributed by Shashikant Banerjee.
(cherry picked from commit fa8b88ab2b)
|
2018-04-13 09:05:24 -07:00 |
|
Yiqun Lin
|
16763d8229
|
HDFS-13418. NetworkTopology should be configurable when enable DFSNetworkTopology. Contributed by Tao Jie.
(cherry picked from commit 0725953efe)
|
2018-04-13 17:57:15 +08:00 |
Akira Ajisaka
|
5531c31f16
|
HDFS-13436. Fix javadoc of package-info.java
(cherry picked from commit 9b0b9f2af2)
|
2018-04-13 13:24:42 +09:00 |
Inigo Goiri
|
671e407ced
|
Revert "HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun."
This reverts commit 8c9dab978e.
|
2018-04-12 08:43:12 -07:00 |
|
Akira Ajisaka
|
5f4762d950
|
HDFS-7101. Potential null dereference in DFSck#doWork(). Contributed by skrho and Ted Yu.
(cherry picked from commit 113af12cfb)
|
2018-04-12 17:48:14 +09:00 |
|
Akira Ajisaka
|
2d82a21b84
|
HDFS-13427. Fix the section titles of transparent encryption document.
(cherry picked from commit c7cd362afd)
|
2018-04-12 10:46:14 +09:00 |
|
Inigo Goiri
|
3c1cd08f04
|
HDFS-13386. RBF: Wrong date information in list file(-ls) result. Contributed by Dibyendu Karmakar.
(cherry picked from commit 18de6f2042)
|
2018-04-11 12:03:40 -07:00 |
|
Inigo Goiri
|
d032112e6b
|
HDFS-13428. RBF: Remove LinkedList From StateStoreFileImpl.java. Contributed by BELUGA BEHR.
(cherry picked from commit 6a881cd842fb4eab596a386b39670ea03536891a)
|
2018-04-11 10:41:13 -07:00 |
Wei Yan
|
32efc77799
|
HDFS-13045. RBF: Improve error message returned from subcluster. Contributed by Inigo Goiri.
(cherry picked from commit 0c93d43f3d)
|
2018-04-11 08:38:52 -07:00 |
Rakesh Radhakrishnan
|
3414bf6dbb
|
HDFS-13328. Abstract ReencryptionHandler recursive logic in separate class. Contributed by Surendra Singh Lilhore.
(cherry picked from commit f89594f0b8)
|
2018-04-10 23:40:26 +05:30 |
Weiwei Yang
|
b104de3f64
|
HDFS-13420. License header is displayed in ArchivalStorage/MemoryStorage html pages. Contributed by Akira Ajisaka.
|
2018-04-10 22:13:08 +08:00 |
|
Yiqun Lin
|
5eb32396d7
|
HDFS-13384. RBF: Improve timeout RPC call mechanism. Contributed by Inigo Goiri.
(cherry picked from commit e87be8a2a4)
|
2018-04-10 15:36:48 +08:00 |
|
Yiqun Lin
|
9a86cb0494
|
HDFS-13410. RBF: Support federation with no subclusters. Contributed by Inigo Goiri.
(cherry picked from commit a92200f4a6)
|
2018-04-10 14:31:59 +08:00 |
Wangda Tan
|
25bf1d3ac6
|
Updated branch-3.1 to track 3.1.1
Change-Id: Idd55c79921b8acacc8a8a3258450e476f3abb706
|
2018-04-09 10:58:50 -07:00 |
|
Inigo Goiri
|
1c9038bae5
|
HDFS-13380. RBF: mv/rm fail after the directory exceeded the quota limit. Contributed by Yiqun Lin.
(cherry picked from commit e9b9f48dad)
|
2018-04-09 10:09:55 -07:00 |
|
Inigo Goiri
|
8c9dab978e
|
HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun.
(cherry picked from commit ac32b3576d)
|
2018-04-09 09:17:35 -07:00 |
|
Yiqun Lin
|
ac5703207d
|
HDFS-13402. RBF: Fix java doc for StateStoreFileSystemImpl. Contributed by Yiran Wu.
(cherry picked from commit 5700556cd6)
|
2018-04-08 12:03:35 +08:00 |
|
Wangda Tan
|
a336561e2b
|
Added CHANGES/RELEASES/Jdiff for 3.1.0 release
Change-Id: Ied5067a996151c04d15cad46c46ac98b60c37b39
(cherry picked from commit 2d96570452a72569befdf9cfe9b90c9fa2e0e261)
|
2018-04-05 15:52:02 -07:00 |
|
Wei Yan
|
89efe30f65
|
HDFS-13353. RBF: TestRouterWebHDFSContractCreate failed. Contributed by Takanobu Asanuma.
(cherry picked from commit 3121e8c293)
|
2018-04-05 13:13:16 -07:00 |
Lei Xu
|
2543a9dd77
|
HDFS-13350. Negative legacy block ID will confuse Erasure Coding to be considered as striped block. (Contributed by Lei (Eddy) Xu).
(cherry picked from commit 1cbf23df145af01692b8aaa438642b64e330cd05)
|
2018-04-05 10:01:05 -07:00 |
|
Yiqun Lin
|
b89dc00302
|
HDFS-13364. RBF: Support NamenodeProtocol in the Router. Contributed by Inigo Goiri.
(cherry picked from commit 2be64eb201)
|
2018-04-03 15:23:39 +08:00 |
|
Xiao Chen
|
dcb2176c5d
|
HADOOP-15317. Improve NetworkTopology chooseRandom's loop.
(cherry picked from commit 57374c4737)
|
2018-04-02 22:48:54 -07:00 |
|
Inigo Goiri
|
3c9983547c
|
HDFS-13289. RBF: TestConnectionManager#testCleanup() test case need correction. Contributed by Dibyendu Karmakar.
(cherry picked from commit dc8e343201)
|
2018-03-31 09:46:44 -07:00 |
Konstantin V Shvachko
|
4ce45a8ec7
|
HADOOP-15253. Should update maxQueueSize when refresh call queue. Contributed by Tao Jie.
(cherry picked from commit acfd764fcc)
|
2018-03-30 18:57:18 -07:00 |
|
Xiao Chen
|
2960592c6f
|
HDFS-13087. Snapshotted encryption zone information should be immutable. Contributed by LiXin Ge.
(cherry picked from commit 2c6cfad5a3)
|
2018-03-29 16:07:01 -07:00 |
|
Arpit Agarwal
|
d54e19a913
|
HDFS-13314. NameNode should optionally exit if it detects FsImage corruption. Contributed by Arpit Agarwal.
|
2018-03-28 12:49:14 -07:00 |
|
Yiqun Lin
|
99766992e6
|
HDFS-13347. RBF: Cache datanode reports. Contributed by Inigo Goiri.
(cherry picked from commit a71656c1c1)
|
2018-03-28 11:04:36 +08:00 |
|
Inigo Goiri
|
c1fc87dcce
|
HDFS-13352. RBF: Add xsl stylesheet for hdfs-rbf-default.xml. Contributed by Takanobu Asanuma.
(cherry picked from commit 4cef01147f)
|
2018-03-27 10:32:07 -07:00 |
|
Inigo Goiri
|
0dc16559ee
|
HDFS-13204. RBF: Optimize name service safe mode icon. Contributed by liuhongtong.
(cherry picked from commit 947b282984)
|
2018-03-26 09:43:28 -07:00 |
|
Yiqun Lin
|
1e01ddfe4f
|
HDFS-13291. RBF: Implement available space based OrderResolver. Contributed by Yiqun Lin.
(cherry picked from commit cfc3a1c8f0)
|
2018-03-26 18:36:22 +08:00 |
Lei Xu
|
4859cd7cc9
|
Update 3.0.1 jdiff file and jdiff stable api version
|
2018-03-23 11:53:30 -07:00 |
|
weiy
|
d17aa8d052
|
HDFS-12512. RBF: Add WebHDFS.
(cherry picked from commit 6e31a09084)
|
2018-03-23 08:40:04 -07:00 |
|
Inigo Goiri
|
59ab86311c
|
HDFS-12792. RBF: Test Router-based federation using HDFSContract. Contributed by Inigo Goiri.
(cherry picked from commit e196d158a2)
|
2018-03-22 13:33:24 -07:00 |
Kihwal Lee
|
c245ecedda
|
HDFS-13195. DataNode conf page cannot display the current value after reconfig. Contributed by maobaolong.
(cherry picked from commit 66461ed98b)
|
2018-03-22 12:28:34 -05:00 |
|
Inigo Goiri
|
485348a337
|
HDFS-13318. RBF: Fix FindBugs in hadoop-hdfs-rbf. Contributed by Ekanth S.
(cherry picked from commit 3d0ee8b804)
|
2018-03-22 09:22:16 -07:00 |
|
Konstantin V Shvachko
|
21db4e9efe
|
HDFS-12884. BlockUnderConstructionFeature.truncateBlock should be of type BlockInfo. Contributed by chencan.
(cherry picked from commit 8d898ab25f)
|
2018-03-21 16:51:33 -07:00 |
|
Yiqun Lin
|
0db4b587c6
|
HDFS-13250. RBF: Router to manage requests across multiple subclusters. Contributed by Inigo Goiri.
(cherry picked from commit 2caba999bb)
|
2018-03-21 11:40:02 +08:00 |
|
Yiqun Lin
|
131546002d
|
HDFS-13307. RBF: Improve the use of setQuota command. Contributed by liuhongtong.
(cherry picked from commit 69fe4407eb)
|
2018-03-21 10:53:24 +08:00 |
|
weiy
|
c804b28462
|
HDFS-13215. RBF: Move Router to its own module.
|
2018-03-19 23:05:33 -07:00 |
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
|
0bd99621c5
|
Preparing for 3.1.0 development
|
2018-03-19 15:16:54 -07:00 |
|
Inigo Goiri
|
08ff1586d5
|
HDFS-12886. Ignore minReplication for block recovery. Contributed by Lukas Majercak.
|
2018-03-16 10:29:19 -07:00 |
|
Xiaoyu Yao
|
78b05fde6c
|
HDFS-13280. WebHDFS: Fix NPE in get snasphottable directory list call. Contributed by Lokesh Jain.
|
2018-03-15 11:02:27 -07:00 |
|
Inigo Goiri
|
e71bc00a47
|
HDFS-13224. RBF: Resolvers to support mount points across multiple subclusters. Contributed by Inigo Goiri.
|
2018-03-15 10:32:30 -07:00 |
|
Xiaoyu Yao
|
da777a5498
|
HDFS-13251. Avoid using hard coded datanode data dirs in unit tests(addendum). Contributed by Ajay Kumar.
|
2018-03-15 10:18:44 -07:00 |
|
Inigo Goiri
|
6de135169e
|
HDFS-12723. TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently. Contributed by Ajay Kumar.
|
2018-03-15 10:14:35 -07:00 |
fang zhenyi
|
5e013d50d1
|
HADOOP-15305. Replace FileUtils.writeStringToFile(File, String) with (File, String, Charset) to fix deprecation warnings.
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2018-03-15 16:12:07 +09:00 |
|
Xiao Chen
|
5ff22d4c3a
|
HDFS-13246. FileInputStream redundant closes in readReplicasFromCache. Contributed by liaoyuxiangqin.
|
2018-03-14 21:59:51 -07:00 |
|
Yiqun Lin
|
3a0f4bc0d5
|
HDFS-13261. Fix incorrect null value check. Contributed by Jianfei Jiang.
|
2018-03-15 11:06:04 +08:00 |
|
Inigo Goiri
|
41fc7f80be
|
HDFS-13198. RBF: RouterHeartbeatService throws out CachedStateStore related exceptions when starting router. Contributed by Wei Yan.
|
2018-03-14 13:14:36 -07:00 |
|
Xiaoyu Yao
|
f83716b7f2
|
HDFS-13251. Avoid using hard coded datanode data dirs in unit tests. Contributed by Ajay Kumar.
|
2018-03-14 11:26:58 -07:00 |
|
Xiaoyu Yao
|
0be0f1ce1d
|
HDFS-13275. Adding log for BlockPoolManager#refreshNamenodes failures. Contributed by Ajay Kumar.
|
2018-03-14 10:38:00 -07:00 |
|
Arpit Agarwal
|
4c57fb0cd9
|
HDFS-13257. Code cleanup: INode never throws QuotaExceededException. Contributed by Tsz Wo Nicholas Sze.
|
2018-03-14 09:42:48 -07:00 |
|
Xiaoyu Yao
|
a34d83d2fd
|
HDFS-13249. Document webhdfs support for getting snapshottable directory list. Contributed by Lokesh Jain.
|
2018-03-14 09:14:26 -07:00 |
Sammi Chen
|
ad1b988a82
|
HDFS-11600. Refactor TestDFSStripedOutputStreamWithFailure test classes. Contributed by Sammi Chen.
|
2018-03-14 14:39:53 +08:00 |
|
Yiqun Lin
|
76be6cbf6c
|
HDFS-12773. RBF: Improve State Store FS implementation. Contributed by Inigo Goiri.
|
2018-03-14 11:20:59 +08:00 |
|
Arpit Agarwal
|
9714fc1dd4
|
HDFS-336. dfsadmin -report should report number of blocks from datanode. Contributed by Bharat Viswanadham.
|
2018-03-13 16:39:17 -07:00 |
|
Arpit Agarwal
|
39537b7c84
|
HDFS-13235. DiskBalancer: Update Documentation to add newly added options. Contributed by Bharat Viswanadham.
|
2018-03-13 16:35:51 -07:00 |
|
Xiao Chen
|
8211a3d469
|
HDFS-12505. Extend TestFileStatusWithECPolicy with a random EC policy. Contributed by Takanobu Asanuma.
|
2018-03-13 10:48:45 -07:00 |
|
Xiao Chen
|
f82d38dcb3
|
Revert "HDFS-12505. Extend TestFileStatusWithECPolicy with a random EC policy. Contributed by Takanobu Asanuma."
This reverts commit 84c1095586.
|
2018-03-13 10:36:16 -07:00 |
|
Xiao Chen
|
3b8dbc2cb7
|
HDFS-12587. Use Parameterized tests in TestBlockInfoStriped and TestLowRedundancyBlockQueues to test all EC policies. Contributed by Takanobu Asanuma.
|
2018-03-13 10:14:05 -07:00 |
|
Xiao Chen
|
d6931c30c5
|
HDFS-13239. Fix non-empty dir warning message when setting default EC policy. Contributed by Bharat Viswanadham.
|
2018-03-13 10:07:26 -07:00 |
|
Xiao Chen
|
84c1095586
|
HDFS-12505. Extend TestFileStatusWithECPolicy with a random EC policy. Contributed by Takanobu Asanuma.
|
2018-03-13 09:58:03 -07:00 |
|
Chris Douglas
|
b2b9ce5859
|
HDFS-13271. WebHDFS: Add constructor in SnapshottableDirectoryStatus with HdfsFileStatus as argument. Contributed by Lokesh Jain
|
2018-03-13 09:43:22 -07:00 |
|
Xiaoyu Yao
|
0355ec20eb
|
HDFS-13141. WebHDFS: Add support for getting snasphottable directory list. Contributed by Lokesh Jain.
|
2018-03-12 20:41:37 -07:00 |
|
Chris Douglas
|
45d1b0fdcc
|
HADOOP-14696. parallel tests don't work for Windows. Contributed by Allen Wittenauer
|
2018-03-12 20:05:39 -07:00 |
|
Yiqun Lin
|
19292bc264
|
HDFS-13226. RBF: Throw the exception if mount table entry validated failed. Contributed by maobaolong.
|
2018-03-13 11:03:31 +08:00 |
|
Yiqun Lin
|
7fab787de7
|
HDFS-13253. RBF: Quota management incorrect parent-child relationship judgement. Contributed by Yiqun Lin.
|
2018-03-13 10:30:20 +08:00 |
|
Akira Ajisaka
|
319defafc1
|
HDFS-12156. TestFSImage fails without -Pnative
|
2018-03-13 11:26:56 +09:00 |
|
Yiqun Lin
|
4afd50b106
|
HDFS-10803. TestBalancerWithMultipleNameNodes#testBalancing2OutOf3Blockpools fails intermittently due to no free space available. Contributed by Yiqun Lin.
|
2018-03-13 10:15:51 +08:00 |
|
Inigo Goiri
|
91c82c90f0
|
HDFS-13241. RBF: TestRouterSafemode failed if the port 8888 is in use. Contributed by maobaolong.
|
2018-03-12 17:28:15 -07:00 |
|
Chris Douglas
|
39a5fbae47
|
HDFS-12677. Extend TestReconstructStripedFile with a random EC policy. Contributed by Takanobu Asanuma
|
2018-03-12 14:29:44 -07:00 |
|
Chris Douglas
|
ddb67ca707
|
HADOOP-14742. Document multi-URI replication Inode for ViewFS. Contributed by Gera Shegalov
|
2018-03-12 13:43:27 -07:00 |
Anu Engineer
|
cceb68ffea
|
HDFS-10618. TestPendingReconstruction#testPendingAndInvalidate is flaky due to race condition. Contributed by Eric Badger.
|
2018-03-12 12:07:22 -07:00 |
|
Inigo Goiri
|
ac627f561f
|
HDFS-11399. Many tests fails in Windows due to injecting disk failures. Contributed by Yiqun Lin.
|
2018-03-12 09:58:56 -07:00 |
|
Yiqun Lin
|
4743d4a2c7
|
HDFS-13240. RBF: Update some inaccurate document descriptions. Contributed by Yiqun Lin.
|
2018-03-10 11:28:55 +08:00 |
|
Inigo Goiri
|
8133cd5305
|
HDFS-13232. RBF: ConnectionPool should return first usable connection. Contributed by Ekanth S.
|
2018-03-09 18:25:05 -08:00 |
|
Inigo Goiri
|
afe1a3ccd5
|
HDFS-13212. RBF: Fix router location cache issue. Contributed by Weiwei Wu.
|
2018-03-09 17:18:51 -08:00 |
Tsz-Wo Nicholas Sze
|
ba0da2785d
|
HDFS-13252. Code refactoring: Remove Diff.ListType.
|
2018-03-09 15:50:26 -08:00 |
Hanisha Koneru
|
4eeff62f69
|
HDFS-13244. Add stack, conf, metrics links to utilities dropdown in NN webUI. Contributed by Bharat Viswanadham.
|
2018-03-09 15:27:17 -08:00 |
Lokesh Jain
|
7b0dc31020
|
HDFS-13190. Document WebHDFS support for snapshot diff
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
Signed-off-by: Xiaoyu Yao <xyao@apache.org>
|
2018-03-09 15:06:15 -08:00 |
|
Hanisha Koneru
|
9a082fbe6e
|
HDFS-11394. Support for getting erasure coding policy through WebHDFS#FileStatus.
|
2018-03-09 13:20:32 -08:00 |
|
Yiqun Lin
|
122805b43a
|
HDFS-13233. RBF: MountTableResolver doesn't return the correct mount point of the given path. Contributed by wangzhiyuan.
|
2018-03-09 15:42:57 +08:00 |
|
Inigo Goiri
|
0c2b969e01
|
HDFS-13232. RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns. Contributed by Chao Sun.
|
2018-03-08 09:32:05 -08:00 |
|
Hanisha Koneru
|
19ae4429f9
|
HDFS-13225. StripeReader#checkMissingBlocks() 's IOException info is incomplete. Contributed by lufei.
|
2018-03-07 14:17:10 -08:00 |
Sean Mackrory
|
46d29e3d7e
|
HDFS-13176. WebHdfs file path gets truncated when having semicolon (;) inside. Contributed by Zsolt Venczel.
|
2018-03-07 13:33:41 -07:00 |
|
Tsz-Wo Nicholas Sze
|
88fba00caa
|
HDFS-13222. Update getBlocks method to take minBlockSize in RPC calls. Contributed by Bharat Viswanadham
|
2018-03-07 11:27:53 -08:00 |
|
Yiqun Lin
|
58ea2d7a65
|
HDFS-13214. RBF: Complete document of Router configuration. Contributed by Yiqun Lin.
|
2018-03-07 15:26:38 +08:00 |
|
Xiaoyu Yao
|
edf9445708
|
HDFS-13109. Support fully qualified hdfs path in EZ commands. Contributed by Hanisha Koneru.
|
2018-03-06 16:44:20 -08:00 |
|
Tsz-Wo Nicholas Sze
|
346caa2095
|
HDFS-13227. Add a method to calculate cumulative diff over multiple snapshots in DirectoryDiffList. Contributed by Shashikant Banerjee
|
2018-03-06 13:35:03 -08:00 |
|
Tsz-Wo Nicholas Sze
|
871d0d39fa
|
HDFS-13223. Reduce DiffListBySkipList memory usage. Contributed by Shashikant Banerjee
|
2018-03-06 12:23:03 -08:00 |
|
Xiao Chen
|
9276ef0665
|
HDFS-13170. Port webhdfs unmaskedpermission parameter to HTTPFS. Contributed by Stephen O'Donnell.
|
2018-03-06 09:57:35 -08:00 |
|
Inigo Goiri
|
7060725662
|
HDFS-13188. Disk Balancer: Support multiple block pools during block move. Contributed by Bharat Viswanadham.
|
2018-03-06 09:09:32 -08:00 |