Erik Krogen
|
a856eea78a
|
HDFS-13898. [SBN read] Throw retriable exception for getBlockLocations when ObserverNameNode is in safemode. Contributed by Chao Sun.
|
2019-06-28 14:22:12 -07:00 |
Erik Krogen
|
556b7a840b
|
HDFS-13749. [SBN read] Use getServiceStatus to discover observer namenodes. Contributed by Chao Sun.
|
2019-06-28 14:22:12 -07:00 |
Konstantin V Shvachko
|
0de06c010a
|
HDFS-13778. [SBN read] TestStateAlignmentContextWithHA should use real ObserverReadProxyProvider instead of AlignmentContextProxyProvider. Contributed by Konstantin Shvachko and Plamen Jeliazkov.
|
2019-06-28 14:22:12 -07:00 |
Chen Liang
|
4c4ca86286
|
HDFS-13880. Add mechanism to allow certain RPC calls to bypass sync. Contributed by Chen Liang.
|
2019-06-28 14:22:11 -07:00 |
Erik Krogen
|
afeaeadd4f
|
HDFS-13779. [SBN read] Implement proper failover and observer failure handling logic for for ObserverReadProxyProvider. Contributed by Erik Krogen.
|
2019-06-28 14:22:11 -07:00 |
Konstantin V Shvachko
|
0c9d846c60
|
HDFS-13851. Remove AlignmentContext from AbstractNNFailoverProxyProvider. Contributed by Konstantin Shvachko.
|
2019-06-28 14:22:10 -07:00 |
Chen Liang
|
e2337bfc57
|
HDFS-13767. Add msync server implementation. Contributed by Chen Liang.
|
2019-06-28 14:22:10 -07:00 |
Chao Sun
|
6fe755f0c7
|
HDFS-13789. Reduce logging frequency of QuorumJournalManager#selectInputStreams. Contributed by Erik Krogen.
|
2019-06-28 14:22:09 -07:00 |
Erik Krogen
|
e3f3fb1c18
|
HDFS-13688. [SBN read] Introduce msync API call. Contributed by Chen Liang.
|
2019-06-28 14:22:09 -07:00 |
Erik Krogen
|
ea402854aa
|
HDFS-13610. [SBN read] Edit Tail Fast Path Part 4: Cleanup. Integration test, documentation, remove unnecessary dummy sync, minors fixups. Contributed by Erik Krogen.
|
2019-06-28 14:22:09 -07:00 |
Chao Sun
|
a97f00e1c6
|
HDFS-12976. [SBN read] Introduce ObserverReadProxyProvider. Contributed by Chao Sun.
|
2019-06-28 14:22:08 -07:00 |
Konstantin V Shvachko
|
1f5852fb12
|
HDFS-13706. [SBN read] Rename client context to ClientGSIContext. Contributed by Konstantin Shvachko.
|
2019-06-28 14:22:08 -07:00 |
Erik Krogen
|
ac3eeeeb3c
|
HDFS-13609. [SBN read] Edit Tail Fast Path Part 3: NameNode-side changes to support tailing edits via RPC. Contributed by Erik Krogen.
|
2019-06-28 14:22:07 -07:00 |
Erik Krogen
|
b13110a6f0
|
HDFS-13608. [SBN read] Edit Tail Fast Path Part 2: Add ability for JournalNode to serve edits via RPC. Contributed by Erik Krogen.
|
2019-06-28 14:22:07 -07:00 |
Erik Krogen
|
174c41c68f
|
HDFS-13607. [SBN read] Edit Tail Fast Path Part 1: Enhance JournalNode with an in-memory cache of recent edit transactions. Contributed by Erik Krogen.
|
2019-06-28 14:22:07 -07:00 |
Plamen Jeliazkov
|
a3521c53fe
|
HDFS-13399. [SBN read] Make Client field AlignmentContext non-static. Contributed by Plamen Jeliazkov.
|
2019-06-28 14:22:03 -07:00 |
Erik Krogen
|
49d7bb6a92
|
HDFS-13286. [SBN read] Add haadmin commands to transition between standby and observer. Contributed by Chao Sun.
|
2019-06-28 14:20:01 -07:00 |
Erik Krogen
|
c0ca2bb853
|
HDFS-13331. [SBN read] Add lastSeenStateId to RpcRequestHeader. Contributed by Plamen Jeliazkov.
|
2019-06-28 14:20:01 -07:00 |
Plamen Jeliazkov
|
1eeca2d9fb
|
HDFS-12977. [SBN read] Add stateId to RPC headers. Contributed by Plamen Jeliazkov.
|
2019-06-28 14:20:00 -07:00 |
Chao Sun
|
3932ac4ef7
|
HDFS-12975. [SBN read] Changes to the NameNode to support reads from standby. Contributed by Chao Sun.
|
2019-06-28 14:20:00 -07:00 |
Anu Engineer
|
e7fce2104f
|
HDFS-14598. Findbugs warning caused by HDFS-12487.
Contributed by He Xiaoqiao.
(cherry picked from commit 041e7a7dee )
|
2019-06-24 21:19:50 -07:00 |
Inigo Goiri
|
9637124535
|
HDFS-14247. Repeat adding node description into network topology. Contributed by HuangTao.
(cherry picked from commit 80b77deb42 )
|
2019-06-24 21:16:46 -07:00 |
Wei-Chiu Chuang
|
d5ecca1d4c
|
HDFS-14074. DataNode runs async disk checks maybe throws NullPointerException, and DataNode failed to register to NameSpace. Contributed by guangyi lu.
(cherry picked from commit 645d67bc4f )
|
2019-06-21 18:27:38 -07:00 |
Wei-Chiu Chuang
|
845d7611ba
|
HDFS-12487. FsDatasetSpi.isValidBlock() lacks null pointer check inside and neither do the callers. Contributed by liumi.
(cherry picked from commit 1524e2e6c5 )
|
2019-06-21 18:18:08 -07:00 |
Wei-Chiu Chuang
|
a5d76a4965
|
HDFS-14303. check block directory logic not correct when there is only meta file, print no meaning warn log. Contributed by qiang Liu.
|
2019-06-20 20:54:16 -07:00 |
Lokesh Jain
|
461c624cc0
|
HDFS-13893. DiskBalancer: no validations for Disk balancer commands. Contributed by Lokesh Jain.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 272b96d243 )
|
2019-06-20 20:23:31 -07:00 |
Takanobu Asanuma
|
6dffad028e
|
HDFS-12564. Add the documents of swebhdfs configurations on the client side. Contributed by Takanobu Asanuma.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 98d2065643 )
|
2019-06-20 20:17:45 -07:00 |
Wei-Chiu Chuang
|
7e9b9e2a2e
|
Revert "HDFS-13287. TestINodeFile#testGetBlockType results in NPE when run alone. Contributed by Virajith Jalaparti."
This reverts commit 36dc0810bf .
|
2019-06-19 06:55:08 -07:00 |
Virajith Jalaparti
|
36dc0810bf
|
HDFS-13287. TestINodeFile#testGetBlockType results in NPE when run alone. Contributed by Virajith Jalaparti.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 333633d9935acd5787ee8688bc9d2d7b7c058def)
|
2019-06-18 22:16:56 -07:00 |
Zsolt Venczel
|
7c00756aff
|
HDFS-14101. Random failure of testListCorruptFilesCorruptedBlock. Contributed by Zsolt Venczel, Nikhil Navadia.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Co-authored-by: Nikhil Navadia <nikhil.navadiya@cloudera.com>
|
2019-06-18 14:37:16 -07:00 |
Elek, Marton
|
1a99f97945
|
HDFS-14078. Admin helper fails to prettify NullPointerExceptions. Contributed by Elek, Marton.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit cc229be9ebb1b3737c9f5fcb29788b51fa584e47)
|
2019-06-18 12:00:36 -07:00 |
Wei-Chiu Chuang
|
223a582eb8
|
HDFS-14010. Pass correct DF usage to ReservedSpaceCalculator builder. Contributed by Virajith Jalaparti.
(cherry picked from commit 1cc1530b4e874391a17ec81e24cb55dfbbabd36a)
|
2019-06-18 00:34:38 -07:00 |
Weiwei Yang
|
f36cdc4d7f
|
HDFS-12770. Add doc about how to disable client socket cache. Contributed by Weiwei Yang.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 6ec57fe6a45df0e9216bbbba85b5bf61da1bf2ca)
|
2019-06-17 21:46:58 -07:00 |
Santosh Marella
|
1ee18ebd26
|
HDFS-12914. Block report leases cause missing blocks until next report. Contributed by Santosh Marella, He Xiaoqiao.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Co-authored-by: He Xiaoqiao <hexiaoqiao@apache.org>
|
2019-06-17 16:26:39 -07:00 |
Wei-Chiu Chuang
|
412fbf12cb
|
Revert "HDFS-12914. Block report leases cause missing blocks until next report. Contributed by Santosh Marella, He Xiaoqiao."
This reverts commit fe46d1c79f .
|
2019-06-17 16:25:49 -07:00 |
Wei-Chiu Chuang
|
0eb42e1e05
|
HDFS-14465. When the Block expected replications is larger than the number of DataNodes, entering maintenance will never exit. Contributed by Yicong Cai.
(cherry picked from commit 7db922c6474cb29e0e9bad320fcda4769366340a)
|
2019-06-17 15:18:00 -07:00 |
Santosh Marella
|
fe46d1c79f
|
HDFS-12914. Block report leases cause missing blocks until next report. Contributed by Santosh Marella, He Xiaoqiao.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Co-authored-by: He Xiaoqiao <hexiaoqiao@apache.org>
|
2019-06-14 15:15:58 -07:00 |
Inigo Goiri
|
335aebb9c4
|
HDFS-14560. Allow block replication parameters to be refreshable. Contributed by Stephen O'Donnell.
(cherry picked from commit 4f455290b1 )
|
2019-06-13 18:27:26 -07:00 |
Sean Mackrory
|
e0b3cbd221
|
HADOOP-16213. Update guava to 27.0-jre. Contributed by Gabor Bota.
|
2019-06-13 07:53:40 -06:00 |
Stephen O'Donnell
|
71159f9540
|
HDFS-13231. Extend visualization for Decommissioning, Maintenance Mode under Datanode tab in the NameNode UI. Contributed by Stephen O'Donnell.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 50de0874d0 )
|
2019-06-12 10:31:03 -07:00 |
He Xiaoqiao
|
d7560c866e
|
HDFS-14553. Make queue size of BlockReportProcessingThread configurable. Contributed by He Xiaoqiao.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit bd46bdf9f9 )
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
|
2019-06-10 17:26:42 -07:00 |
Hanisha Koneru
|
210480a23c
|
HDFS-10659. Namenode crashes after Journalnode re-installation in an HA cluster due to missing paxos directory. Contributed by star, Hanisha Koneru.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 7217494f40 )
|
2019-06-10 13:46:53 -07:00 |
Kihwal Lee
|
056bb773ce
|
HDFS-14521. Suppress setReplication logging. Contributed by Kihwal Lee
(cherry picked from commit 9122b9b649 )
|
2019-05-30 17:30:48 -05:00 |
Ayush Saxena
|
2cd7577a5a
|
HDFS-14512. ONE_SSD policy will be violated while write data with DistributedFileSystem.create(....favoredNodes). Contributed by Ayush Saxena.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit c1caab40f2 )
|
2019-05-29 20:58:11 -07:00 |
Takanobu Asanuma
|
a9a3450560
|
HADOOP-16331. Fix ASF License check in pom.xml. Contributed by Akira Ajisaka.
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
|
2019-05-29 17:34:16 +09:00 |
Akira Ajisaka
|
855dc997d6
|
HADOOP-16323. https everywhere in Maven settings.
|
2019-05-27 15:27:33 +09:00 |
Erik Krogen
|
c26cf22d6b
|
HDFS-14500. NameNode StartupProgress should not allow new steps in an already-completed phase. Contributed by Erik Krogen.
(cherry-picked from 55e0c134f0 )
|
2019-05-24 13:18:49 -07:00 |
Konstantin V Shvachko
|
9836bac35c
|
HDFS-14502. keepResults option in NNThroughputBenchmark should call saveNamespace(). Contributed by Konstantin V Shvachko.
|
2019-05-24 12:49:06 -07:00 |
Siyao Meng
|
a4f425d3ae
|
HDFS-14507. Document -blockingDecommission option for hdfs dfsadmin -listOpenFiles
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
(cherry picked from commit 9dff6eff81 )
|
2019-05-22 13:24:58 +09:00 |
Siyao Meng
|
bba8971897
|
HDFS-14463. Add Log Level link under NameNode and DataNode Web UI Utilities dropdown. Contributed by Siyao Meng.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 7cb46f035a )
|
2019-05-01 16:49:45 -07:00 |