Erik Krogen
|
2fe15053ab
|
HDFS-14279. [SBN read] Fix race condition in ObserverReadProxyProvider. Contributed by Erik Krogen.
|
2019-08-09 15:49:58 -07:00 |
Erik Krogen
|
c377540704
|
HDFS-14435. [SBN Read] Enable ObserverReadProxyProvider to gracefully handle StandbyException when fetching HAServiceState. Contributed by Erik Krogen.
|
2019-08-09 15:49:58 -07:00 |
Erik Krogen
|
5190fd64be
|
HDFS-14211. [SBN Read]. Add a configurable flag to enable always-msync mode to ObserverReadProxyProvider. Contributed by Erik Krogen.
|
2019-08-09 15:49:58 -07:00 |
Erik Krogen
|
c055e7812c
|
HDFS-14272. [SBN read] Make ObserverReadProxyProvider initialize its state ID against the active NN on startup. Contributed by Erik Krogen.
|
2019-08-09 15:49:58 -07:00 |
Erik Krogen
|
3b2b97a6e6
|
HDFS-14317. Ensure checkpoints are created when in-progress edit log tailing is enabled with a period shorter than the log roll period. Contributed by Ekanth Sethuramalingam.
(cherry-picked from commit 1bc282e0b3 )
(cherry-picked from commit 6d076dd5e8 )
|
2019-08-09 15:49:58 -07:00 |
Erik Krogen
|
a0327f58cb
|
HDFS-14250. [SBN read]. msync should always direct to active NameNode to get latest stateID. Contributed by Chao Sun.
|
2019-08-09 15:49:58 -07:00 |
Chen Liang
|
b247a8b0de
|
[SBN read] Addendum: Misc fix to be Java 7 compatible
|
2019-08-09 15:49:58 -07:00 |
Konstantin V Shvachko
|
3804b8e7be
|
HDFS-14170. [SBN read] Fix checkstyle warnings related to SBN reads. Contributed by Konstantin V Shvachko.
|
2019-08-09 15:49:57 -07:00 |
Chao Sun
|
8cf1c0b91b
|
HDFS-14154. [SBN read] Document dfs.ha.tail-edits.period in user guide. Contributed by Chao Sun.
|
2019-08-09 15:49:57 -07:00 |
Konstantin V Shvachko
|
3ec2ff756d
|
HDFS-14160. [SBN read] ObserverReadInvocationHandler should implement RpcInvocationHandler. Contributed by Konstantin V Shvachko.
|
2019-08-09 15:49:57 -07:00 |
Chao Sun
|
41e85ccf44
|
HDFS-14149. [SBN read] Fix annotations on new interfaces/classes for SBN reads. Contributed by Chao Sun.
|
2019-08-09 15:49:57 -07:00 |
Chao Sun
|
705e1c8d96
|
HDFS-14116. [SBN read] Fix class cast error in NNThroughputBenchmark with ObserverReadProxyProvider. Contributed by Chao Sun.
|
2019-08-09 15:49:57 -07:00 |
Erik Krogen
|
7b1a3b5619
|
HDFS-14146. [SBN read] Handle exceptions from and prevent handler threads from blocking within internalQueueCall. Contributed by Chao Sun.
|
2019-08-09 15:49:57 -07:00 |
Chen Liang
|
49bdc53b66
|
HDFS-14138. [SBN read] Description errors in the comparison logic of transaction ID. Contributed by xiangheng.
|
2019-08-09 15:49:57 -07:00 |
Erik Krogen
|
a86d955aa7
|
HDFS-13873. [SBN read] ObserverNode should reject read requests when it is too far behind. Contributed by Konstantin Shvachko.
|
2019-08-09 15:49:57 -07:00 |
Chen Liang
|
68da1e48f9
|
HDFS-14142. Move ipfailover config key out of HdfsClientConfigKeys. Contributed by Chen Liang.
|
2019-08-09 15:49:57 -07:00 |
Erik Krogen
|
0705e83bdb
|
HDFS-14131. [SBN read] Create user guide for Consistent Reads from Observer feature. Contributed by Chao Sun.
|
2019-08-09 15:49:57 -07:00 |
Chen Liang
|
3c73819a63
|
HDFS-14120. [SBN read] ORFPP should also clone DT for the virtual IP. Contributed by Chen Liang.
|
2019-08-09 15:49:57 -07:00 |
Konstantin V Shvachko
|
3518767ce7
|
HDFS-14094. [SBN read] Fix the order of logging arguments in ObserverReadProxyProvider. Contributed by Ayush Saxena.
|
2019-08-09 15:49:57 -07:00 |
Chao Sun
|
52d066a9d3
|
HDFS-14067. [SBN read] Allow manual failover between standby and observer. Contributed by Chao Sun.
|
2019-08-09 15:49:57 -07:00 |
Chen Liang
|
c6267bb5ba
|
HDFS-14017. [SBN read] ObserverReadProxyProviderWithIPFailover should work with HA configuration. Contributed by Chen Liang.
|
2019-08-09 15:49:57 -07:00 |
Chen Liang
|
17fac44040
|
HDFS-14035. NN status discovery does not leverage delegation token. Contributed by Chen Liang.
|
2019-08-09 15:49:57 -07:00 |
Chao Sun
|
697207c487
|
HDFS-14016. [SBN read] ObserverReadProxyProvider should enable observer read by default. Contributed by Chen Liang.
|
2019-08-09 15:49:57 -07:00 |
Chao Sun
|
40d5cc15b2
|
HDFS-13924. [SBN read] Handle BlockMissingException when reading from observer. Contributed by Chao Sun.
|
2019-08-09 15:49:57 -07:00 |
Konstantin V Shvachko
|
37dfd294e2
|
HDFS-13925. Unit Test for transitioning between different states. Contributed by Sherwood Zheng.
|
2019-08-09 15:49:57 -07:00 |
Konstantin V Shvachko
|
63cf9801e8
|
HDFS-13523. Support observer nodes in MiniDFSCluster. Contributed by Konstantin Shvachko.
|
2019-08-09 15:49:57 -07:00 |
Konstantin V Shvachko
|
ae559db6fd
|
HDFS-13961. [SBN read] TestObserverNode refactoring. Contributed by Konstantin Shvachko.
|
2019-08-09 15:49:57 -07:00 |
Chen Liang
|
b4fc93d90b
|
HDFS-13791. Limit logging frequency of edit tail related statements. Contributed by Erik Krogen.
|
2019-08-09 15:49:56 -07:00 |
Erik Krogen
|
7146e67893
|
HDFS-13898. [SBN read] Throw retriable exception for getBlockLocations when ObserverNameNode is in safemode. Contributed by Chao Sun.
|
2019-08-09 15:49:56 -07:00 |
Erik Krogen
|
a7d551efd5
|
HDFS-13749. [SBN read] Use getServiceStatus to discover observer namenodes. Contributed by Chao Sun.
|
2019-08-09 15:49:56 -07:00 |
Konstantin V Shvachko
|
7eacf5f8f1
|
HDFS-13778. [SBN read] TestStateAlignmentContextWithHA should use real ObserverReadProxyProvider instead of AlignmentContextProxyProvider. Contributed by Konstantin Shvachko and Plamen Jeliazkov. Also fix a number of java7 incompatibilities from previous SbN read commits.
|
2019-08-09 15:49:56 -07:00 |
Chen Liang
|
bf9d8ba66b
|
HDFS-13880. Add mechanism to allow certain RPC calls to bypass sync. Contributed by Chen Liang.
|
2019-08-09 15:49:56 -07:00 |
Erik Krogen
|
7ccb2a48ff
|
HDFS-13779. [SBN read] Implement proper failover and observer failure handling logic for for ObserverReadProxyProvider. Contributed by Erik Krogen.
Also add a missing change from HDFS-13610
|
2019-08-09 15:49:56 -07:00 |
Konstantin V Shvachko
|
c09665d14a
|
HDFS-13782. ObserverReadProxyProvider should work with IPFailoverProxyProvider. Contributed by Konstantin Shvachko.
|
2019-08-09 15:49:56 -07:00 |
Konstantin V Shvachko
|
fcafa72958
|
HDFS-13851. Remove AlignmentContext from AbstractNNFailoverProxyProvider. Contributed by Konstantin Shvachko.
|
2019-08-09 15:49:56 -07:00 |
Chen Liang
|
9f90bcadf2
|
HDFS-13767. Add msync server implementation. Contributed by Chen Liang.
|
2019-08-09 15:49:56 -07:00 |
Chao Sun
|
f531301e7e
|
HDFS-13789. Reduce logging frequency of QuorumJournalManager#selectInputStreams. Contributed by Erik Krogen.
|
2019-08-09 15:49:56 -07:00 |
Erik Krogen
|
33d8aae555
|
HDFS-13688. [SBN read] Introduce msync API call. Contributed by Chen Liang.
Also fix a issue in IPCLoggerChannel
|
2019-08-09 15:49:56 -07:00 |
Erik Krogen
|
ea6d36763b
|
HDFS-13610. [SBN read] Edit Tail Fast Path Part 4: Cleanup. Integration test, documentation, remove unnecessary dummy sync, minors fixups. Contributed by Erik Krogen.
|
2019-08-09 15:49:55 -07:00 |
Plamen Jeliazkov
|
9803d8db4c
|
HDFS-13665. [SBN read] Move RPC response serialization into Server.doResponse(). Contributed by Plamen Jeliazkov.
|
2019-08-09 15:49:55 -07:00 |
Chao Sun
|
04eefe245a
|
HDFS-12976. [SBN read] Introduce ObserverReadProxyProvider. Contributed by Chao Sun.
|
2019-08-09 15:49:55 -07:00 |
Konstantin V Shvachko
|
272a198175
|
HDFS-13706. [SBN read] Rename client context to ClientGSIContext. Contributed by Konstantin Shvachko.
|
2019-08-09 15:49:55 -07:00 |
Erik Krogen
|
85f81fe458
|
HDFS-13609. [SBN read] Edit Tail Fast Path Part 3: NameNode-side changes to support tailing edits via RPC. Contributed by Erik Krogen.
HDFS-10519. Add a configuration option to enable in-progress edit log tailing. Contributed by Jiayi Zhou.
|
2019-08-09 15:49:55 -07:00 |
Erik Krogen
|
88d65af8a1
|
HDFS-13608. [SBN read] Edit Tail Fast Path Part 2: Add ability for JournalNode to serve edits via RPC. Contributed by Erik Krogen.
|
2019-08-09 15:49:55 -07:00 |
Erik Krogen
|
befe41074c
|
HDFS-13607. [SBN read] Edit Tail Fast Path Part 1: Enhance JournalNode with an in-memory cache of recent edit transactions. Contributed by Erik Krogen.
|
2019-08-09 15:49:55 -07:00 |
Plamen Jeliazkov
|
3ed8d45660
|
HDFS-13399. [SBN read] Make Client field AlignmentContext non-static. Contributed by Plamen Jeliazkov.
|
2019-08-09 15:49:55 -07:00 |
Erik Krogen
|
c450e69551
|
HDFS-13578. [SBN read] Add ReadOnly annotation to methods in ClientProtocol. Contributed by Chao Sun.
|
2019-08-09 15:49:55 -07:00 |
Erik Krogen
|
d5da529acf
|
HDFS-13286. [SBN read] Add haadmin commands to transition between standby and observer. Contributed by Chao Sun.
|
2019-08-09 15:49:55 -07:00 |
Erik Krogen
|
d0c85f83da
|
HDFS-13331. [SBN read] Add lastSeenStateId to RpcRequestHeader. Contributed by Plamen Jeliazkov.
|
2019-08-09 15:49:55 -07:00 |
Plamen Jeliazkov
|
dd70e6d364
|
HDFS-12977. [SBN read] Add stateId to RPC headers. Contributed by Plamen Jeliazkov.
|
2019-08-09 15:49:55 -07:00 |