stack
|
e880347d53
|
Revert "HADOOP-16598. Backport "HADOOP-16558 [COMMON+HDFS] use protobuf-maven-plugin to generate protobuf classes" to all active branches"
Wrong patch applied; missed jdk7 handling
This reverts commit a36dbe6f35 .
|
2019-11-01 09:21:33 -07:00 |
Duo Zhang
|
a36dbe6f35
|
HADOOP-16598. Backport "HADOOP-16558 [COMMON+HDFS] use protobuf-maven-plugin to generate protobuf classes" to all active branches
Signed-off-by: stack <stack@apache.org>
|
2019-10-30 22:33:51 -07:00 |
Jonathan Hung
|
915b795358
|
Make upstream aware of 2.10.0 release
(cherry picked from commit 7663db59c097c82eeed2df7a91168a4d7123c96b)
(cherry picked from commit 5d2ffcc7aa )
(cherry picked from commit 4d274f60bc )
|
2019-10-30 21:01:40 -07:00 |
Wei-Chiu Chuang
|
a805d80ebe
|
HDFS-13901. INode access time is ignored because of race between open and rename. Contributed by Jinglun.
|
2019-10-22 16:43:25 -07:00 |
Kihwal Lee
|
b634bd225b
|
HDFS-12749. DN may not send block report to NN after NN restart. Contributed by Xiaoqiao He.
(cherry picked from commit c4e27ef773 )
|
2019-10-21 16:36:42 -05:00 |
Jonathan Hung
|
108127238b
|
Preparing for 2.11.0 development
|
2019-10-15 10:01:45 -07:00 |
Chen Liang
|
6566402a1b
|
HDFS-14509. DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x. Contributed by Yuxuan Wang and Konstantin Shvachko.
|
2019-10-10 13:29:30 -07:00 |
Erik Krogen
|
200c52f78b
|
HDFS-14245. [SBN read] Enable ObserverReadProxyProvider to work with non-ClientProtocol proxy types. Contributed by Erik Krogen.
(cherry picked from 5847e00143 )
(cherry picked from 6630c9b75d )
(cherry picked from 9fdb849e03 )
|
2019-10-10 09:09:50 -07:00 |
Erik Krogen
|
8337d1a489
|
HDFS-14162. [SBN read] Allow Balancer to work with Observer node. Add a new ProxyCombiner allowing for multiple related protocols to be combined. Allow AlignmentContext to be passed in NameNodeProxyFactory. Contributed by Erik Krogen.
|
2019-10-10 09:07:18 -07:00 |
Ayush Saxena
|
ca777db3ca
|
HDFS-14655. [SBN Read] Namenode crashes if one of The JN is down. Contributed by Ayush Saxena.
|
2019-10-08 13:30:30 +05:30 |
Shweta Yakkali
|
56e2ad2dce
|
HDFS-14262. [SBN read] Make Log.WARN message in GlobalStateIdContext more informative. Contributed by Shweta Yakkali.
|
2019-10-03 16:43:27 -07:00 |
Ayush Saxena
|
a3b9b955be
|
HDFS-14660. [SBN Read] ObserverNameNode should throw StandbyException for requests not from ObserverProxyProvider. Contributed by Chao Sun.
|
2019-10-03 16:36:50 -07:00 |
Shweta Yakkali
|
c87b1f6f5b
|
HDFS-14494. Move Server logging of StatedId inside receiveRequestState(). Contributed by Shweta Yakkali.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2019-10-03 16:25:31 -07:00 |
Chen Liang
|
72b37e8833
|
HDFS-12979. StandbyNode should upload FsImage to ObserverNode after checkpointing. Contributed by Chen Liang.
|
2019-10-03 12:23:25 -07:00 |
Chen Liang
|
ed8f1ae602
|
HDFS-14858. [SBN read] Allow configurably enable/disable AlignmentContext on NameNode. Contributed by Chen Liang.
|
2019-10-02 16:51:59 -07:00 |
Konstantin V Shvachko
|
dc2b838a8e
|
HDFS-14305. Fix serial number calculation in BlockTokenSecretManager to avoid token key ID overlap between NameNodes. Contributed by Konstantin V Shvachko.
|
2019-09-30 18:04:16 -07:00 |
Masatake Iwasaki
|
9482da7053
|
HADOOP-16544. update io.netty in branch-2.
Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>
|
2019-10-01 05:24:32 +09:00 |
Ayush Saxena
|
66e60942e9
|
HDFS-14853. Addendum: NPE in DFSNetworkTopology#chooseRandomWithStorageType() when the excludedNode is not present. Contributed by Ranith Sardar.
|
2019-09-28 09:14:50 +05:30 |
Ayush Saxena
|
40becd37d0
|
HDFS-14853. NPE in DFSNetworkTopology#chooseRandomWithStorageType() when the excludedNode is not present. Contributed by Ranith Sardar.
|
2019-09-28 08:30:55 +05:30 |
Chen Liang
|
dc72b2e65a
|
HDFS-14822. [SBN read] Revisit GlobalStateIdContext locking when getting server state id. Contributed by Chen Liang.
|
2019-09-18 17:22:49 -07:00 |
Kihwal Lee
|
d4038e7a39
|
HDFS-13959. TestUpgradeDomainBlockPlacementPolicy is flaky. Contributed by Ayush Saxena.
(cherry picked from commit 1851d06eb3 )
|
2019-09-18 16:51:21 -05:00 |
He Xiaoqiao
|
6fe8261fa0
|
HDFS-14771. Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index). Contributed by He Xiaoqiao and Stephen O'Donnel.
Reviewed-by: Stephen O'Donnell <sodonnell@cloudera.com>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2019-09-17 09:34:54 -07:00 |
Ayush Saxena
|
b9e832bf73
|
HDFS-14303. Addendum: check block directory logic not correct when there is only meta file, print no meaning warn log. Contributed by qiang Liu.
|
2019-09-14 10:30:46 +05:30 |
Xiaoyu Yao
|
c44e53e7a3
|
HDFS-14633. The StorageType quota and consume in QuotaFeature is not handled for rename. Contributed by Jinglun.
(cherry picked from commit 62d71fbac3789c7d484bc76ced9ec7fa6ff94de1)
|
2019-09-05 16:24:17 -07:00 |
Xiaoyu Yao
|
1c9255aebf
|
Revert "HDFS-14633. The StorageType quota and consume in QuotaFeature is not handled for rename. Contributed by Jinglun."
This reverts commit a524608d1e .
|
2019-09-05 16:22:15 -07:00 |
Ayush Saxena
|
ad250a8cbb
|
HDFS-14276. [SBN read] Reduce tailing overhead. Contributed by Wei-Chiu Chuang
|
2019-09-05 22:05:47 +05:30 |
Chen Liang
|
1ff68d0e47
|
HDFS-14611. Move handshake secret field from Token to BlockAccessToken. Contributed by Chen Liang
|
2019-09-03 17:18:41 -07:00 |
Chen Liang
|
163cb4d5ae
|
HDFS-13699. Add DFSClient sending handshake token to DataNode, and allow DataNode overwrite downstream QOP. Contributed by Chen Liang.
|
2019-09-03 17:11:29 -07:00 |
Chen Liang
|
e63619a6dd
|
HDFS-13617. Allow wrapping NN QOP into token in encrypted message. Contributed by Chen Liang
|
2019-09-03 17:11:29 -07:00 |
Chen Liang
|
a06e35a197
|
HDFS-13566. Add configurable additional RPC listener to NameNode. Contributed by Chen Liang.
|
2019-09-03 17:11:28 -07:00 |
Xiaoyu Yao
|
a524608d1e
|
HDFS-14633. The StorageType quota and consume in QuotaFeature is not handled for rename. Contributed by Jinglun.
(cherry picked from commit 62d71fbac3789c7d484bc76ced9ec7fa6ff94de1)
|
2019-09-03 08:27:23 -07:00 |
Chen Liang
|
f05d87b32e
|
HDFS-14726. Fix JN incompatibility issue in branch-2 due to backport of HDFS-10519. Contributed by Chen Liang.
|
2019-08-30 15:55:35 -07:00 |
Chen Liang
|
e786147096
|
HDFS-13977. NameNode can kill itself if it tries to send too many txns to a QJM simultaneously. Contributed by Erik Krogen.
|
2019-08-26 14:32:27 -07:00 |
Wei-Chiu Chuang
|
69b80f1ee8
|
Revert "HDFS-14476. lock too long when fix inconsistent blocks between disk and in-memory. Contributed by Sean Chow."
This reverts commit 8755de108d .
|
2019-08-21 09:04:07 -07:00 |
Wei-Chiu Chuang
|
bdab03cf71
|
HDFS-14311. Multi-threading conflict at layoutVersion when loading block pool storage. Contributed by Yicong Cai.
|
2019-08-20 10:38:52 -07:00 |
Shashikant Banerjee
|
ab7509efe7
|
HDFS-13101. Yet another fsimage corruption related to snapshot. Contributed by Shashikant Banerjee.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2019-08-18 19:01:12 -07:00 |
Wei-Chiu Chuang
|
8755de108d
|
HDFS-14476. lock too long when fix inconsistent blocks between disk and in-memory. Contributed by Sean Chow.
|
2019-08-18 17:51:44 -07:00 |
He Xiaoqiao
|
b020c5ccfd
|
HDFS-14725. Backport HDFS-12914 to branch-2 (Block report leases cause missing blocks until next report). Contributed by He Xiaoqiao.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2019-08-16 17:53:45 -07:00 |
Masatake Iwasaki
|
670de354b3
|
HDFS-14423. Percent (%) and plus (+) characters no longer work in WebHDFS.
Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>
(cherry picked from commit da0006fe04 )
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java
(cherry picked from commit d7ca016d63 )
Conflicts:
hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/web/resources/NamenodeWebHdfsMethods.java
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsUrl.java
|
2019-08-14 12:35:14 +09:00 |
Christopher Gregorian
|
99cd181a78
|
HADOOP-16459. Backport of HADOOP-16266. Add more fine-grained processing time metrics to the RPC layer. Contributed by Christopher Gregorian.
This commit also includes the follow-on commit 827a84778a .
(cherry-picked from f96a2df38d )
(cherry-picked from d4492bdd9e )
(cherry-picked from 7b8f08f59e )
(cherry picked from ec00431eaa )
|
2019-08-13 14:28:18 -07:00 |
Erik Krogen
|
719214ff30
|
HDFS-14370. Add exponential backoff to the edit log tailer to avoid spinning on empty edit tail requests. Contributed by Erik Krogen.
(cherry picked from 827dbb11e2 )
(cherry picked from 016aa13940 )
(cherry picked from f6ce2f4a50 )
(cherry picked from 5657e45fb2 )
|
2019-08-13 08:30:33 -07:00 |
Chen Liang
|
885b7f4c98
|
Fix JDK7 compatibility in branch-2.
|
2019-08-12 17:42:01 -07:00 |
Chen Liang
|
0d153dcb8c
|
HDFS-13898 Addendum: add a missing test helper method
|
2019-08-12 10:31:37 -07:00 |
Wei-Chiu Chuang
|
585b6de637
|
Revert "HDFS-12914. Block report leases cause missing blocks until next report. Contributed by Santosh Marella, He Xiaoqiao."
This reverts commit 567e1178d8 .
|
2019-08-09 18:29:00 -07:00 |
Chen Liang
|
097710131a
|
[SBN read] Addendum: Misc fix of issues, javadoc, whitespace unused backported fields etc
|
2019-08-09 15:49:58 -07:00 |
Wei-Chiu Chuang
|
12dc7ff566
|
HDFS-12836. startTxId could be greater than endTxId when tailing in-progress edit log. Contributed by Chao Sun.
|
2019-08-09 15:49:58 -07:00 |
Wei-Chiu Chuang
|
9599c91518
|
HDFS-14537. Journaled Edits Cache is not cleared when formatting the JN. Contributed by Ranith Sardar.
|
2019-08-09 15:49:58 -07:00 |
Erik Krogen
|
c377540704
|
HDFS-14435. [SBN Read] Enable ObserverReadProxyProvider to gracefully handle StandbyException when fetching HAServiceState. Contributed by Erik Krogen.
|
2019-08-09 15:49:58 -07:00 |
Erik Krogen
|
5190fd64be
|
HDFS-14211. [SBN Read]. Add a configurable flag to enable always-msync mode to ObserverReadProxyProvider. Contributed by Erik Krogen.
|
2019-08-09 15:49:58 -07:00 |
Erik Krogen
|
c055e7812c
|
HDFS-14272. [SBN read] Make ObserverReadProxyProvider initialize its state ID against the active NN on startup. Contributed by Erik Krogen.
|
2019-08-09 15:49:58 -07:00 |