Wei-Chiu Chuang
|
e9a005dfcf
|
HDFS-14171. Performance improvement in Tailing EditLog. Contributed by Kenneth Yang.
|
2018-12-28 10:34:18 -08:00 |
Konstantin V Shvachko
|
bd2a59e508
|
HDFS-14170. [SBN read] Fix checkstyle warnings related to SBN reads. Contributed by Konstantin V Shvachko.
|
2018-12-24 09:39:20 -08:00 |
Chao Sun
|
c546b12e45
|
HDFS-14154. [SBN read] Document dfs.ha.tail-edits.period in user guide. Contributed by Chao Sun.
|
2018-12-24 09:34:01 -08:00 |
|
Konstantin V Shvachko
|
c9d7737431
|
HDFS-14160. [SBN read] ObserverReadInvocationHandler should implement RpcInvocationHandler. Contributed by Konstantin V Shvachko.
|
2018-12-24 09:34:01 -08:00 |
|
Chao Sun
|
fa8550337d
|
HDFS-14149. [SBN read] Fix annotations on new interfaces/classes for SBN reads. Contributed by Chao Sun.
|
2018-12-24 09:34:01 -08:00 |
|
Chao Sun
|
c3efc299fe
|
HDFS-14116. [SBN read] Fix class cast error in NNThroughputBenchmark with ObserverReadProxyProvider. Contributed by Chao Sun.
|
2018-12-24 09:34:01 -08:00 |
Erik Krogen
|
ef3e1929dd
|
HDFS-14146. [SBN read] Handle exceptions from and prevent handler threads from blocking within internalQueueCall. Contributed by Chao Sun.
|
2018-12-24 09:34:01 -08:00 |
|
Erik Krogen
|
b73fb70f97
|
HDFS-13873. [SBN read] ObserverNode should reject read requests when it is too far behind. Contributed by Konstantin Shvachko.
|
2018-12-24 09:34:01 -08:00 |
Chen Liang
|
b8ad6c85a5
|
HDFS-14142. Move ipfailover config key out of HdfsClientConfigKeys. Contributed by Chen Liang.
|
2018-12-24 09:34:01 -08:00 |
|
Erik Krogen
|
2904aa3808
|
HDFS-14131. [SBN read] Create user guide for Consistent Reads from Observer feature. Contributed by Chao Sun.
|
2018-12-24 09:34:01 -08:00 |
|
Chen Liang
|
71cf66e29b
|
HDFS-14120. [SBN read] ORFPP should also clone DT for the virtual IP. Contributed by Chen Liang.
|
2018-12-24 09:34:01 -08:00 |
|
Konstantin V Shvachko
|
3bb92a1d9a
|
HDFS-14094. [SBN read] Fix the order of logging arguments in ObserverReadProxyProvider. Contributed by Ayush Saxena.
|
2018-12-24 09:34:01 -08:00 |
|
Chao Sun
|
cbc2f932eb
|
HDFS-14067. [SBN read] Allow manual failover between standby and observer. Contributed by Chao Sun.
|
2018-12-24 09:34:01 -08:00 |
|
Chen Liang
|
a3aab48df0
|
HDFS-14017. [SBN read] ObserverReadProxyProviderWithIPFailover should work with HA configuration. Contributed by Chen Liang.
|
2018-12-24 09:34:01 -08:00 |
|
Chen Liang
|
652b257478
|
HDFS-14035. NN status discovery does not leverage delegation token. Contributed by Chen Liang.
|
2018-12-24 09:34:01 -08:00 |
|
Chao Sun
|
1a9ba9616a
|
HDFS-14016. [SBN read] ObserverReadProxyProvider should enable observer read by default. Contributed by Chen Liang.
|
2018-12-24 09:34:01 -08:00 |
|
Chao Sun
|
8c49135078
|
HDFS-13924. [SBN read] Handle BlockMissingException when reading from observer. Contributed by Chao Sun.
|
2018-12-24 09:34:01 -08:00 |
|
Konstantin V Shvachko
|
b6f20c36c2
|
HDFS-13925. Unit Test for transitioning between different states. Contributed by Sherwood Zheng.
|
2018-12-24 09:34:00 -08:00 |
|
Konstantin V Shvachko
|
1c4265d7bc
|
HDFS-13523. Support observer nodes in MiniDFSCluster. Contributed by Konstantin Shvachko.
|
2018-12-24 09:34:00 -08:00 |
|
Konstantin V Shvachko
|
b5b9b77707
|
HDFS-13961. [SBN read] TestObserverNode refactoring. Contributed by Konstantin Shvachko.
|
2018-12-24 09:34:00 -08:00 |
|
Chen Liang
|
a65bb97f5d
|
HDFS-13791. Limit logging frequency of edit tail related statements. Contributed by Erik Krogen.
|
2018-12-24 09:34:00 -08:00 |
|
Erik Krogen
|
b74a7dbf88
|
HDFS-13898. [SBN read] Throw retriable exception for getBlockLocations when ObserverNameNode is in safemode. Contributed by Chao Sun.
|
2018-12-24 09:34:00 -08:00 |
|
Erik Krogen
|
25b63e8da8
|
HDFS-13749. [SBN read] Use getServiceStatus to discover observer namenodes. Contributed by Chao Sun.
|
2018-12-24 09:34:00 -08:00 |
|
Konstantin V Shvachko
|
28820fb6b1
|
HDFS-13778. [SBN read] TestStateAlignmentContextWithHA should use real ObserverReadProxyProvider instead of AlignmentContextProxyProvider. Contributed by Konstantin Shvachko and Plamen Jeliazkov.
|
2018-12-24 09:34:00 -08:00 |
|
Chen Liang
|
d2e85b0b6d
|
HDFS-13880. Add mechanism to allow certain RPC calls to bypass sync. Contributed by Chen Liang.
|
2018-12-24 09:34:00 -08:00 |
|
Erik Krogen
|
aa42fb0db7
|
HDFS-13779. [SBN read] Implement proper failover and observer failure handling logic for for ObserverReadProxyProvider. Contributed by Erik Krogen.
|
2018-12-24 09:34:00 -08:00 |
|
Konstantin V Shvachko
|
f9fc01cd7f
|
HDFS-13782. ObserverReadProxyProvider should work with IPFailoverProxyProvider. Contributed by Konstantin Shvachko.
|
2018-12-24 09:34:00 -08:00 |
|
Konstantin V Shvachko
|
25d8e39b5c
|
HDFS-13851. Remove AlignmentContext from AbstractNNFailoverProxyProvider. Contributed by Konstantin Shvachko.
|
2018-12-24 09:34:00 -08:00 |
|
Chen Liang
|
66ec3a67e8
|
HDFS-13767. Add msync server implementation. Contributed by Chen Liang.
|
2018-12-24 09:34:00 -08:00 |
|
Chao Sun
|
4c9baba066
|
HDFS-13789. Reduce logging frequency of QuorumJournalManager#selectInputStreams. Contributed by Erik Krogen.
|
2018-12-24 09:34:00 -08:00 |
|
Erik Krogen
|
eae0a5d54a
|
HDFS-13688. [SBN read] Introduce msync API call. Contributed by Chen Liang.
|
2018-12-24 09:34:00 -08:00 |
|
Erik Krogen
|
1e22f2bfbb
|
HDFS-13610. [SBN read] Edit Tail Fast Path Part 4: Cleanup. Integration test, documentation, remove unnecessary dummy sync, minors fixups. Contributed by Erik Krogen.
|
2018-12-24 09:34:00 -08:00 |
|
Chao Sun
|
64b7cf59bd
|
HDFS-12976. [SBN read] Introduce ObserverReadProxyProvider. Contributed by Chao Sun.
|
2018-12-24 09:33:59 -08:00 |
|
Konstantin V Shvachko
|
0105d7f597
|
HDFS-13706. [SBN read] Rename client context to ClientGSIContext. Contributed by Konstantin Shvachko.
|
2018-12-24 09:33:59 -08:00 |
|
Erik Krogen
|
00e99c6594
|
HDFS-13609. [SBN read] Edit Tail Fast Path Part 3: NameNode-side changes to support tailing edits via RPC. Contributed by Erik Krogen.
|
2018-12-24 09:33:59 -08:00 |
|
Erik Krogen
|
151c8ddbe4
|
HDFS-13608. [SBN read] Edit Tail Fast Path Part 2: Add ability for JournalNode to serve edits via RPC. Contributed by Erik Krogen.
|
2018-12-24 09:33:59 -08:00 |
|
Erik Krogen
|
c81ac2ff02
|
HDFS-13607. [SBN read] Edit Tail Fast Path Part 1: Enhance JournalNode with an in-memory cache of recent edit transactions. Contributed by Erik Krogen.
|
2018-12-24 09:33:59 -08:00 |
Plamen Jeliazkov
|
e880660a20
|
HDFS-13399. [SBN read] Make Client field AlignmentContext non-static. Contributed by Plamen Jeliazkov.
|
2018-12-24 09:33:59 -08:00 |
|
Erik Krogen
|
a109f2b32f
|
HDFS-13578. [SBN read] Add ReadOnly annotation to methods in ClientProtocol. Contributed by Chao Sun.
|
2018-12-24 09:33:59 -08:00 |
|
Erik Krogen
|
091ad974cd
|
HDFS-13286. [SBN read] Add haadmin commands to transition between standby and observer. Contributed by Chao Sun.
|
2018-12-24 09:33:59 -08:00 |
|
Erik Krogen
|
9bf0696c73
|
HDFS-13331. [SBN read] Add lastSeenStateId to RpcRequestHeader. Contributed by Plamen Jeliazkov.
|
2018-12-24 09:33:59 -08:00 |
|
Plamen Jeliazkov
|
c9d73437e8
|
HDFS-12977. [SBN read] Add stateId to RPC headers. Contributed by Plamen Jeliazkov.
|
2018-12-24 09:33:59 -08:00 |
|
Chao Sun
|
3a78e5ffd8
|
HDFS-12975. [SBN read] Changes to the NameNode to support reads from standby. Contributed by Chao Sun.
|
2018-12-24 09:33:59 -08:00 |
Surendra Singh Lilhore
|
686fcd4db3
|
HDFS-14046. In-Maintenance ICON is missing in datanode info page. Contributed by Ranith Sardar.
|
2018-12-24 11:02:36 +05:30 |
|
Surendra Singh Lilhore
|
d944d5ec46
|
HDFS-14165. In NameNode UI under DataNode tab ,the Capacity column is Non-Aligned. Contributed by Shubham Dewan.
|
2018-12-23 15:06:12 +05:30 |
Yiqun Lin
|
feb2664ac4
|
HDFS-13946. Log longest FSN write/read lock held stack trace.
|
2018-12-22 23:09:59 +08:00 |
|
Surendra Singh Lilhore
|
788e7473a4
|
HDFS-14096. [SPS] : Add Support for Storage Policy Satisfier in ViewFs. Contributed by Ayush Saxena.
|
2018-12-17 11:24:57 +05:30 |
Giovanni Matteo Fumarola
|
00d5e631b5
|
HDFS-14006. Refactor name node to allow different token verification implementations. Contributed by CR Hota.
|
2018-12-14 11:10:54 -08:00 |
|
Giovanni Matteo Fumarola
|
f858f18554
|
HDFS-14088. RequestHedgingProxyProvider can throw NullPointerException when failover due to no lock on currentUsedProxy. Contributed by Yuxuan Wang.
|
2018-12-14 11:04:36 -08:00 |
|
Giovanni Matteo Fumarola
|
cb3382f667
|
HDFS-14145. TestBlockStorageMovementAttemptedItems#testNoBlockMovementAttemptFinishedReportAdded fails sporadically in Trunk. Contributed by Ayush Saxena.
|
2018-12-14 10:59:02 -08:00 |
Zsolt Venczel
|
aa12859890
|
HDFS-14121. Log message about the old hosts file format is misleading
(Contributed by Zsolt Venczel via Daniel Templeton)
Change-Id: I7ff548f6c82e0aeb08a7a50ca7c2c827db8726bb
|
2018-12-14 13:54:57 +01:00 |
Akira Ajisaka
|
ca379e1c43
|
HDFS-13970. Use MultiMap for CacheManager Directives to simplify the code. Contributed by BELUGA BEHR.
|
2018-12-14 14:36:26 +09:00 |
Daniel Templeton
|
4aa0609fb0
|
HDFS-13985. Clearer error message for ReplicaNotFoundException
(Contributed by Adam Antal via Daniel Templeton)
Change-Id: I68ae7a5bedecbc204c161fc3b3ce8878fe5d493d
|
2018-12-13 16:21:45 +01:00 |
|
Giovanni Matteo Fumarola
|
561b61cfb1
|
HDFS-14144. TestPred fails in Trunk. Contributed by Ayush Saxena.
|
2018-12-12 11:16:16 -08:00 |
|
Giovanni Matteo Fumarola
|
60af851e59
|
HDFS-14137. TestMaintenanceState fails with ArrayIndexOutOfBound Exception. Contributed by Ayush Saxena.
|
2018-12-11 11:22:32 -08:00 |
Vinayakumar B
|
39dc7345b8
|
HDFS-14124. EC : Support EC Commands (set/get/unset EcPolicy) via WebHdfs. Contributed by Ayush Saxena.
|
2018-12-11 17:59:04 +05:30 |
Sean Mackrory
|
80e59e7876
|
HDFS-14101. Fixing underflow error in test. Contributed by Zsolt Venczel.
|
2018-12-10 14:03:08 -07:00 |
Inigo Goiri
|
8fc0d04517
|
HDFS-14001. [PROVIDED Storage] bootstrapStandby should manage the InMemoryAliasMap. Contributed by Virajith Jalaparti.
|
2018-12-07 18:30:36 -08:00 |
|
Vinayakumar B
|
c03024a530
|
HDFS-14113. EC : Add Configuration to restrict UserDefined Policies. Contributed by Ayush Saxena.
|
2018-12-06 18:20:28 +05:30 |
|
Giovanni Matteo Fumarola
|
69489ff2d1
|
HDFS-14119. Improve GreedyPlanner Parameter Logging. Contributed by Beluga Behr.
|
2018-12-03 12:55:52 -08:00 |
Adam Antal
|
fb10803dfa
|
HDFS-13818. Extend OIV to detect FSImage corruption. Contributed by Adam Antal.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2018-12-03 10:34:39 -08:00 |
Kitti Nanasi
|
dd5e7c6b72
|
HDFS-12946. Add a tool to check rack configuration against EC policies. Contributed by Kitti Nanasi.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2018-12-03 10:01:09 -08:00 |
|
Surendra Singh Lilhore
|
042c8ef593
|
HDFS-14075. Terminate the namenode when failed to start log segment. Contributed by Ayush Saxena.
|
2018-12-02 12:31:08 +05:30 |
|
Giovanni Matteo Fumarola
|
99e201dfe2
|
HDFS-14105. Replace TreeSet in NamenodeFsck with HashSet. Contributed by Beluga Behr.
|
2018-11-30 11:07:11 -08:00 |
|
Giovanni Matteo Fumarola
|
b09cfad432
|
HDFS-14106. Refactor NamenodeFsck#copyBlock. Contributed by Beluga Behr.
|
2018-11-30 10:47:59 -08:00 |
|
Yiqun Lin
|
0e36e935d9
|
HDFS-13870. WebHDFS: Document ALLOWSNAPSHOT and DISALLOWSNAPSHOT API doc. Contributed by Siyao Meng.
|
2018-11-30 11:31:34 +08:00 |
Tsz Wo Nicholas Sze
|
0081b02e35
|
HDFS-14112. Avoid recursive call to external authorizer for getContentSummary.
|
2018-11-29 13:55:21 -08:00 |
Brahma Reddy Battula
|
f534736867
|
HDFS-14095. EC: Track Erasure Coding commands in DFS statistics. Contributed by Ayush Saxena.
|
2018-11-30 00:18:27 +05:30 |
Ewan Higgs
|
c1d24f8483
|
HDFS-13713. Add specification of Multipart Upload API to FS specification, with contract tests.
Contributed by Ewan Higgs and Steve Loughran.
|
2018-11-29 15:12:17 +00:00 |
|
Giovanni Matteo Fumarola
|
300f560fcc
|
HDFS-14102. Performance improvement in BlockPlacementPolicyDefault. Contributed by Beluga Behr.
|
2018-11-28 11:33:22 -08:00 |
|
Giovanni Matteo Fumarola
|
4ca3a6b21a
|
HDFS-14108. Performance improvement in BlockManager Data Structures. Contributed by Beluga Behr.
|
2018-11-28 11:25:47 -08:00 |
|
Vinayakumar B
|
b098281454
|
HDFS-13816. dfs.getQuotaUsage() throws NPE on non-existent dir instead of FileNotFoundException. Contributed by Vinayakumar B.
|
2018-11-26 18:22:32 +05:30 |
|
Brahma Reddy Battula
|
892b33e054
|
HDFS-14064. WEBHDFS: Support Enable/Disable EC Policy. Contributed by Ayush Saxena.
|
2018-11-22 00:13:56 +05:30 |
|
Akira Ajisaka
|
1a00b4e325
|
Add 2.9.2 release notes and changes documents.
|
2018-11-20 14:25:18 +09:00 |
|
Daniel Templeton
|
e56d9f2618
|
HDFS-14015. Improve error handling in hdfsThreadDestructor in native thread local storage
Change-Id: Ida1e888c9231b9e46081338e3a206d8f6faabd36
|
2018-11-16 16:24:40 -08:00 |
Weiwei Yang
|
ad5256e44d
|
HDFS-14063. Support noredirect param for CREATE/APPEND/OPEN/GETFILECHECKSUM in HttpFS. Contributed by Íñigo Goiri.
|
2018-11-17 01:12:22 +08:00 |
|
Vinayakumar B
|
68d5dfdc78
|
HDFS-14056. Fix error messages in HDFS-12716. Contributed by Ayush Saxena.
|
2018-11-16 18:05:10 +05:30 |
|
Vinayakumar B
|
8571507efa
|
HDFS-13963. NN UI is broken with IE11. Contributed by Ayush Saxena.
|
2018-11-16 17:26:36 +05:30 |
Arpit Agarwal
|
1e15c7e855
|
HADOOP-15936. [JDK 11] MiniDFSClusterManager & MiniHadoopClusterManager compilation fails due to the usage of '_' as identifier. Contributed by Zsolt Venczel.
|
2018-11-15 12:42:31 -08:00 |
|
Inigo Goiri
|
460a94a10f
|
HDFS-14045. Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN. Contributed by Jiandan Yang.
|
2018-11-15 10:58:57 -08:00 |
|
Inigo Goiri
|
993c2140cc
|
HDFS-14054. TestLeaseRecovery2: testHardLeaseRecoveryAfterNameNodeRestart2 and testHardLeaseRecoveryWithRenameAfterNameNodeRestart are flaky. Contributed by Zsolt Venczel.
|
2018-11-15 09:29:14 -08:00 |
Xiao Chen
|
9da6054ca4
|
Revert "HDFS-13732. ECAdmin should print the policy name when an EC policy is set. Contributed by Zsolt Venczel."
This reverts commit 7dc79a8b5b.
|
2018-11-13 12:44:25 -08:00 |
|
Brahma Reddy Battula
|
e7b63baca1
|
HDFS-14070. Refactor NameNodeWebHdfsMethods to allow better extensibility. Contributed by CR Hota
|
2018-11-13 12:45:44 +05:30 |
|
Arpit Agarwal
|
b6d4e19f34
|
HDFS-14065. Failed Storage Locations shows nothing in the Datanode Volume Failures. Contributed by Ayush Saxena.
|
2018-11-12 15:31:42 -08:00 |
|
Kitti Nanasi
|
8d99648c20
|
HDFS-14039. ec -listPolicies doesn't show correct state for the default policy when the default is not RS(6,3). Contributed by Kitti Nanasi.
Signed-off-by: Xiao Chen <xiao@apache.org>
|
2018-11-08 10:01:19 -08:00 |
Jason Lowe
|
0b6625a973
|
MAPREDUCE-7148. Fast fail jobs when exceeds dfs quota limitation. Contributed by Wang Yan
|
2018-11-07 08:20:49 -06:00 |
|
Inigo Goiri
|
887244de4a
|
HDFS-14048. DFSOutputStream close() throws exception on subsequent call after DataNode restart. Contributed by Erik Krogen.
|
2018-11-06 11:18:15 -08:00 |
|
Inigo Goiri
|
f0ce072934
|
HDFS-14051. Refactor NameNodeHttpServer#initWebHdfs to specify local keytab. Contributed by CR Hota.
|
2018-11-06 10:05:58 -08:00 |
|
Daniel Templeton
|
349168c4b3
|
HDFS-14047. [libhdfs++] Fix hdfsGetLastExceptionRootCause bug in test_libhdfs_threaded.c
(Contributed by Antoli Shein via Daniel Templeton)
Change-Id: Ia5546fd5f8270f285c373b9023a9bd9835059845
|
2018-11-06 09:22:27 -08:00 |
|
Akira Ajisaka
|
6430c9890a
|
HADOOP-15904. [JDK 11] Javadoc build failed due to bad use of '>' in hadoop-hdfs.
|
2018-11-06 18:42:38 +09:00 |
|
Xiao Chen
|
ffc9c50e07
|
HDFS-14053. Provide ability for NN to re-replicate based on topology changes. Contributed by Hrishikesh Gadre.
|
2018-11-05 21:38:39 -08:00 |
|
Inigo Goiri
|
f3296501e0
|
HDFS-14043. Tolerate corrupted seen_txid file. Contributed by Lukas Majercak.
|
2018-11-05 16:48:37 -08:00 |
|
Giovanni Matteo Fumarola
|
f3f5e7ad00
|
HDFS-14042. Fix NPE when PROVIDED storage is missing. Contributed by Virajith Jalaparti.
|
2018-11-05 11:02:31 -08:00 |
|
Yiqun Lin
|
4e3df75eb7
|
HDFS-14049. TestHttpFSServerWebServer fails on Windows because of missing winutils.exe. Contributed by Inigo Goiri.
|
2018-11-04 09:15:53 +08:00 |
Siyao Meng
|
8fe85af63b
|
HDFS-13996. Make HttpFS' ACLs RegEx configurable. Contributed by Siyao Meng.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2018-11-01 17:36:50 -07:00 |
Pranay Singh
|
d98b881e9a
|
HDFS-14008. NN should log snapshotdiff report. Contributed by Pranay Singh.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2018-11-01 17:26:00 -07:00 |
Sunil G
|
9c438abe52
|
HDFS-14033. [libhdfs++] Disable libhdfs++ build on systems that do not support thread_local. Contributed by Anatoli Shein.
|
2018-10-31 12:32:49 +05:30 |
|
Akira Ajisaka
|
fac9f91b29
|
HDFS-13942. [JDK10] Fix javadoc errors in hadoop-hdfs module. Contributed by Dinesh Chitlangia.
|
2018-10-31 14:43:58 +09:00 |
|
Xiao Chen
|
db7e636824
|
HDFS-14027. DFSStripedOutputStream should implement both hsync methods.
|
2018-10-29 19:06:15 -07:00 |
|
Wei-Chiu Chuang
|
63e7134df6
|
Revert "HADOOP-15864. Job submitter / executor fail when SBN domain name can not resolved. Contributed by He Xiaoqiao."
This reverts commit fb2b72e6fc.
|
2018-10-28 17:04:59 -07:00 |