Vinayakumar B
|
c41791671c
|
HDFS-14113. EC : Add Configuration to restrict UserDefined Policies. Contributed by Ayush Saxena.
(cherry picked from commit c03024a530 )
|
2019-10-03 17:15:38 -07:00 |
Vinayakumar B
|
1a7cb7aba1
|
HDFS-14124. EC : Support EC Commands (set/get/unset EcPolicy) via WebHdfs. Contributed by Ayush Saxena.
(cherry picked from commit 39dc7345b8 )
(cherry picked from commit abe14d32d4 )
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/WebHDFS.md
|
2019-10-03 16:59:00 -07:00 |
Shweta Yakkali
|
e68ccca2d7
|
HDFS-14262. [SBN read] Make Log.WARN message in GlobalStateIdContext more informative. Contributed by Shweta Yakkali.
|
2019-10-03 16:22:00 -07:00 |
Ayush Saxena
|
7ca418c2c0
|
HDFS-14660. [SBN Read] ObserverNameNode should throw StandbyException for requests not from ObserverProxyProvider. Contributed by Chao Sun.
|
2019-10-03 16:22:00 -07:00 |
Shweta Yakkali
|
8ee3a8768d
|
HDFS-14494. Move Server logging of StatedId inside receiveRequestState(). Contributed by Shweta Yakkali.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2019-10-03 16:22:00 -07:00 |
Brahma Reddy Battula
|
ddea9d68a0
|
HDFS-14064. WEBHDFS: Support Enable/Disable EC Policy. Contributed by Ayush Saxena.
(cherry picked from commit 15d8f592b51d08a658e88c6a7a7596e0edf5793b)
(cherry picked from commit 7e10dd03b5 )
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFS.java
|
2019-10-03 16:16:23 -07:00 |
Kitti Nanasi
|
aeb3ae1c4c
|
HDFS-14187. Make warning message more clear when there are not enough data nodes for EC write. Contributed by Kitti Nanasi.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 0ab7fc9200 )
|
2019-10-03 15:59:41 -07:00 |
Ayush Saxena
|
12f2d121ca
|
HDFS-14849. Erasure Coding: the internal block is replicated many times when datanode is decommissioning. Contributed by HuangTao.
(cherry picked from commit c4c8d5fd0e )
(cherry picked from commit 9a9edfa87e )
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlockManager.java
|
2019-10-03 15:54:39 -07:00 |
Giovanni Matteo Fumarola
|
76c30e4f3c
|
HADOOP-16625: Backport HADOOP-14624 to branch-3.1.
(cherry picked from commit 79c97f6a0b )
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestSaveNamespace.java
|
2019-10-03 15:45:23 -07:00 |
Inigo Goiri
|
0160e2c97f
|
HDFS-14527. Stop all DataNodes may result in NN terminate. Contributed by He Xiaoqiao.
(cherry picked from commit 944adc61b1 )
(cherry picked from commit 6148acebc3 )
|
2019-10-03 15:44:56 -07:00 |
Surendra Singh Lilhore
|
ef9439679d
|
HDFS-14754. Erasure Coding : The number of Under-Replicated Blocks never reduced. Contributed by hemanthboyina.
(cherry picked from commit 4852a90e4b )
|
2019-10-03 23:57:32 +05:30 |
Chen Liang
|
40c772a750
|
HDFS-12979. [SBN read] StandbyNode should upload FsImage to ObserverNode after checkpointing. Contributed by Chen Liang.
|
2019-10-02 21:17:29 -07:00 |
Surendra Singh Lilhore
|
7f882570d7
|
HDFS-14216. NullPointerException happens in NamenodeWebHdfs. Contributed by lujie.
(cherry picked from commit 92b53c40f0 )
(cherry picked from commit 2e939515df )
|
2019-10-02 19:50:45 -07:00 |
LeonGao91
|
a989779f2d
|
HDFS-14678. Allow triggerBlockReport to a specific namenode. (#1252). Contributed by Leon Gao.
(cherry picked from commit 9a1d8cfaf5 )
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestTriggerBlockReport.java
(cherry picked from commit 55e40227d1d20bf88448e213937f6e3166452dc9)
|
2019-10-02 17:35:25 -07:00 |
Chen Liang
|
460ef89210
|
HDFS-14858. [SBN read] Allow configurably enable/disable AlignmentContext on NameNode. Contributed by Chen Liang.
|
2019-10-02 16:40:01 -07:00 |
paulward24
|
ab7ecd6a0f
|
HDFS-14618. Incorrect synchronization of ArrayList field (ArrayList is thread-unsafe). Contributed by Paul Ward.
(cherry picked from commit d203045c30 )
|
2019-10-02 15:07:34 -07:00 |
paulward24
|
d95dd33ea1
|
HDFS-14610. HashMap is not thread safe. Field storageMap is typically synchronized by storageMap. However, in one place, field storageMap is not protected with synchronized. (#1015)
(cherry picked from commit d8bac50e12 )
(cherry picked from commit 76a9135947 )
|
2019-10-02 14:31:23 -07:00 |
Ayush Saxena
|
122b02e288
|
HDFS-14808. EC: Improper size values for corrupt ec block in LOG. Contributed by Ayush Saxena.
(cherry picked from commit 66400c1cbb )
(cherry picked from commit 2bb4ac18ec )
|
2019-10-02 13:49:20 -07:00 |
Surendra Singh Lilhore
|
f0bdab02e7
|
HDFS-14699. Erasure Coding: Storage not considered in live replica when replication streams hard limit reached to threshold. Contributed by Zhao Yi Ming.
(cherry picked from commit d1c303a497 )
(cherry picked from commit eb1ddcd04c )
|
2019-10-02 13:41:23 -07:00 |
Inigo Goiri
|
f1fe3abac9
|
HADOOP-16161. NetworkTopology#getWeightUsingNetworkLocation return unexpected result. Contributed by He Xiaoqiao.
(cherry picked from commit 389e640f0c )
|
2019-10-01 17:33:08 -07:00 |
Yiqun Lin
|
3aea2bcf12
|
HDFS-14313. Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du. Contributed by Lisheng Sun.
(cherry picked from commit a5bb1e8ee8 )
Conflicts:
hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
(cherry picked from commit c74027d9d3 )
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/BlockPoolSlice.java
|
2019-10-01 17:16:55 -07:00 |
Inigo Goiri
|
2a3eb04996
|
HDFS-14192. Track missing DFS operations in Statistics and StorageStatistics. Contributed by Ayush Saxena.
(cherry picked from commit f048512bb8 )
(cherry picked from commit e59ced9c60a7007551ee8a9f83ce8e266e4dbae1)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java
|
2019-10-01 16:56:29 -07:00 |
Inigo Goiri
|
528dc8199b
|
HDFS-14460. DFSUtil#getNamenodeWebAddr should return HTTPS address based on policy configured. Contributed by CR Hota.
(cherry picked from commit 865c328930 )
|
2019-10-01 09:53:31 -07:00 |
Inigo Goiri
|
23eed7b201
|
HDFS-14202. dfs.disk.balancer.max.disk.throughputInMBperSec property is not working as per set value. Contributed by Ranith Sardar.
(cherry picked from commit 0e79a86582 )
(cherry picked from commit fc8a7a9e5b )
|
2019-10-01 09:35:14 -07:00 |
Inigo Goiri
|
7a915a0ba3
|
HDFS-14418. Remove redundant super user priveledge checks from namenode. Contributed by Ayush Saxena.
(cherry picked from commit be6c8014e6 )
(cherry picked from commit 06b2eceb76 )
|
2019-10-01 09:24:21 -07:00 |
Konstantin V Shvachko
|
8fc4e406ad
|
HDFS-14305. Fix serial number calculation in BlockTokenSecretManager to avoid token key ID overlap between NameNodes. Contributed by Konstantin V Shvachko.
|
2019-09-30 17:24:15 -07:00 |
Konstantin V Shvachko
|
bece1a1f70
|
Revert "HDFS-14305. Fix serial number calculation in BlockTokenSecretManager to avoid token key ID overlap between NameNodes. Contributed by He Xiaoqiao."
This reverts commit 0feba4396f .
|
2019-09-30 17:24:15 -07:00 |
Surendra Singh Lilhore
|
1030ac85bb
|
HDFS-14235. Handle ArrayIndexOutOfBoundsException in DataNodeDiskMetrics#slowDiskDetectionDaemon. Contributed by Ranith Sardar.
(cherry picked from commit 41e18feda3 )
(cherry picked from commit b93b127956 )
|
2019-09-30 16:47:08 -07:00 |
Ayush Saxena
|
8cc702ad38
|
HDFS-14853. NPE in DFSNetworkTopology#chooseRandomWithStorageType() when the excludedNode is not present. Contributed by Ranith Sardar.
|
2019-09-28 08:30:26 +05:30 |
Zhankun Tang
|
670d0657b4
|
Make upstream aware of 3.1.3 release.
|
2019-09-27 16:58:36 +08:00 |
Chen Liang
|
3d7730266a
|
HDFS-14785. [SBN read] Change client logging to be less aggressive. Contributed by Chen Liang.
|
2019-09-26 15:59:08 -07:00 |
Ayush Saxena
|
5c058549b7
|
HDFS-14655. [SBN Read] Namenode crashes if one of The JN is down. Contributed by Ayush Saxena.
|
2019-09-25 01:22:11 +05:30 |
Chen Liang
|
d25b3339ed
|
HDFS-14822. [SBN read] Revisit GlobalStateIdContext locking when getting server state id. Contributed by Chen Liang.
|
2019-09-18 17:20:05 -07:00 |
Kihwal Lee
|
2661c32c06
|
HDFS-13959. TestUpgradeDomainBlockPlacementPolicy is flaky. Contributed by Ayush Saxena.
(cherry picked from commit 1851d06eb3 )
|
2019-09-18 16:45:29 -05:00 |
Wei-Chiu Chuang
|
0fcbeed49a
|
HDFS-14836. FileIoProvider should not increase FileIoErrors metric in datanode volume metric. Contributed by Aiphago.
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
(cherry picked from commit 5dd859a8a0 )
(cherry picked from commit b906f53b0d )
|
2019-09-18 09:36:55 -07:00 |
Anu Engineer
|
eb5c4ce432
|
HDFS-14759. HDFS cat logs an info message.
Contributed by Eric Badger.
(cherry picked from commit 8aaf5e1a14 )
|
2019-09-14 01:35:12 +09:00 |
Ayush Saxena
|
cab81f7f5f
|
HDFS-14303. Addendum: check block directory logic not correct when there is only meta file, print no meaning warn log. Contributed by qiang Liu.
|
2019-09-14 10:20:49 +05:30 |
Takanobu Asanuma
|
8d5460a045
|
HDFS-14838. RBF: Display RPC (instead of HTTP) Port Number in RBF web UI. Contributed by Xieming Li
(cherry picked from commit c255333e20 )
|
2019-09-11 17:11:13 +09:00 |
Xiaoyu Yao
|
ed253c4412
|
HDFS-14633. The StorageType quota and consume in QuotaFeature is not handled for rename. Contributed by Jinglun.
(cherry picked from commit 62d71fbac3789c7d484bc76ced9ec7fa6ff94de1)
|
2019-09-05 16:52:09 -07:00 |
Xiaoyu Yao
|
fbdfb36fdf
|
Revert "HDFS-14633. The StorageType quota and consume in QuotaFeature is not handled for rename. Contributed by Jinglun."
This reverts commit 29e6a97faa .
|
2019-09-05 16:52:09 -07:00 |
Zhankun Tang
|
ef79d98788
|
Preparing for 3.1.4 development
|
2019-09-04 16:11:36 +08:00 |
Xiaoyu Yao
|
29e6a97faa
|
HDFS-14633. The StorageType quota and consume in QuotaFeature is not handled for rename. Contributed by Jinglun.
(cherry picked from commit 62d71fbac3789c7d484bc76ced9ec7fa6ff94de1)
|
2019-09-03 08:58:59 -07:00 |
Stephen O'Donnell
|
63b18d764a
|
HDFS-14706. Checksums are not checked if block meta file is less than 7 bytes. Contributed by Stephen O'Donnell.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 915cbc91c0 )
(cherry picked from commit 2c7f49743fba587e32398c81412db9eac426cf98)
|
2019-09-02 09:58:48 -07:00 |
Wei-Chiu Chuang
|
8ffaef78da
|
Revert "HDFS-14706. Checksums are not checked if block meta file is less than 7 bytes. Contributed by Stephen O'Donnell."
This reverts commit d42b48d4d0 .
|
2019-09-02 09:58:32 -07:00 |
Istvan Fajth
|
e3c01e174c
|
HDFS-8178. QJM doesn't move aside stale inprogress edits files. Contributed by Istvan Fajth.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2019-08-30 13:13:48 -07:00 |
Ayush Saxena
|
e44693953d
|
HDFS-12212. Options.Rename.To_TRASH is considered even when Options.Rename.NONE is specified. Contributed by Vinayakumar B.
|
2019-08-30 08:59:52 +05:30 |
leosunli
|
0011136e66
|
Make DataNodePeerMetrics#minOutlierDetectionSamples configurable (#1314). Contributed by Lisheng Sun.
Signed-off-by: sunlisheng <sunlisheng@xiaomi.com>
(cherry picked from commit 915271245b )
(cherry picked from commit b516d2ea7b )
|
2019-08-29 18:46:25 -07:00 |
Stephen O'Donnell
|
d42b48d4d0
|
HDFS-14706. Checksums are not checked if block meta file is less than 7 bytes. Contributed by Stephen O'Donnell.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 7bebad61d9 )
(cherry picked from commit 9c0d6e1657 )
|
2019-08-29 18:26:14 -07:00 |
Jonathan Hung
|
79364a9c53
|
HDFS-14779. Fix logging error in TestEditLog#testMultiStreamsLoadEditWithConfMaxTxns
(cherry picked from commit 8ab7020e64 )
(cherry picked from commit d255efa5f8 )
|
2019-08-27 10:31:21 -07:00 |
Chen Liang
|
d2bb764ffa
|
HDFS-14674. [SBN read] Got an unexpected txid when tail editlog. Contributed by wangzhaohui.
|
2019-08-23 12:29:23 -07:00 |
Erik Krogen
|
9dc921f5e5
|
HDFS-13977. Override shouldForceSync in QuorumOutputStream to allow for proper auto-sync behavior. Contributed by Erik Krogen.
(cherry picked from d699022fce )
(cherry picked from 2408c2491f )
|
2019-08-23 11:48:51 -07:00 |
Chen Liang
|
0839cf1d4e
|
HDFS-14611. Move handshake secret field from Token to BlockAccessToken. Contributed by Chen Liang.
|
2019-08-23 10:11:22 -07:00 |
Chen Liang
|
ef9b0a1d9a
|
HDFS-13699. Add DFSClient sending handshake token to DataNode, and allow DataNode overwrite downstream QOP. Contributed by Chen Liang.
|
2019-08-23 10:11:22 -07:00 |
Chen Liang
|
3135cc35e3
|
HDFS-13617. Allow wrapping NN QOP into token in encrypted message. Contributed by Chen Liang
|
2019-08-23 10:11:22 -07:00 |
Chen Liang
|
3835a6c4e8
|
HDFS-13566. Add configurable additional RPC listener to NameNode. Contributed by Chen Liang.
|
2019-08-23 10:11:22 -07:00 |
Akira Ajisaka
|
83f67cca60
|
HDFS-14396. Failed to load image from FSImageFile when downgrade from 3.x to 2.x. Contributed by Fei Hui.
(cherry picked from commit bd7baea5a5 )
|
2019-08-23 15:29:25 +09:00 |
Akira Ajisaka
|
b40aa71cf0
|
HDFS-13596. NN restart fails after RollingUpgrade from 2.x to 3.x. Contributed by Fei Hui.
(cherry picked from commit abc8fde4ca )
|
2019-08-23 15:08:34 +09:00 |
Xiao Chen
|
a5690b29a7
|
HDFS-13642. Creating a file with block size smaller than EC policy's cell size should fail.
(cherry picked from commit cf4108313d )
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSStripedOutputStream.java
|
2019-08-23 15:03:57 +09:00 |
Ayush Saxena
|
900384cf57
|
HDFS-14276. [SBN read] Reduce tailing overhead. Contributed by Wei-Chiu Chuang.
|
2019-08-22 22:54:50 +05:30 |
Wei-Chiu Chuang
|
2ce0914176
|
Revert "HDFS-14476. lock too long when fix inconsistent blocks between disk and in-memory. Contributed by Sean Chow."
This reverts commit e978c6c9ed .
|
2019-08-21 09:00:59 -07:00 |
Surendra Singh Lilhore
|
c2aeeb01fa
|
HDFS-14582. Failed to start DN with ArithmeticException when NULL checksum used. Contributed by Surendra Singh Lilhore.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit f95988113da3f06f6d975f99f1ee51d88a793537)
(cherry picked from commit 03c62c7989 )
|
2019-08-21 09:00:52 -07:00 |
Siyao Meng
|
e0a5fee7f5
|
HDFS-14665. HttpFS: LISTSTATUS response is missing HDFS-specific fields (#1291) Contributed by Siyao Meng.
|
2019-08-20 10:49:51 -07:00 |
Wei-Chiu Chuang
|
7a1f508f58
|
HDFS-14311. Multi-threading conflict at layoutVersion when loading block pool storage. Contributed by Yicong Cai.
(cherry picked from commit fbe87eddbc30fe5191c008b496fb83e51ef4ee4a)
(cherry picked from commit f78dcbaae5535e3e05c9f29986b8963ba262baa9)
|
2019-08-20 10:36:55 -07:00 |
Wei-Chiu Chuang
|
d8c60f829f
|
HDFS-13201. Fix prompt message in testPolicyAndStateCantBeNull. Contributed by chencan.
(cherry picked from commit aa6995fde2 )
(cherry picked from commit b004d305e9 )
|
2019-08-20 10:34:25 -07:00 |
Wei-Chiu Chuang
|
fc062b6fef
|
HDFS-13709. Report bad block to NN when transfer block encounter EIO exception. Contributed by Chen Zhang.
(cherry picked from commit 360a96f342 )
(cherry picked from commit 6d93886231 )
|
2019-08-19 13:11:21 -07:00 |
HUAN-PING SU
|
18f98491e7
|
HDFS-14746. Trivial test code update after HDFS-14687. Contributed by kevin su.
Reviewed-by: Surendra Singh Lilhore <surendralilhore@apache.org>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit abae6ff2a2 )
(cherry picked from commit abda503040 )
|
2019-08-19 11:15:48 -07:00 |
Wei-Chiu Chuang
|
e978c6c9ed
|
HDFS-14476. lock too long when fix inconsistent blocks between disk and in-memory. Contributed by Sean Chow.
(cherry picked from commit 8b802d6b44 )
|
2019-08-19 08:39:00 -07:00 |
Surendra Singh Lilhore
|
92c3a581ec
|
HDFS-14687. Standby Namenode never come out of safemode when EC files are being written. Contributed by Surendra Singh Lilhore.
Reviewed-by: Siyao Meng <smeng@cloudera.com>
Reviewed-by: Wei-Chiu CHuang <weichiu@apache.org>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit b8db5b9a98 )
(cherry picked from commit 6b01effd01 )
|
2019-08-18 18:17:50 -07:00 |
Shashikant Banerjee
|
d18b720c70
|
HDFS-13101. Yet another fsimage corruption related to snapshot. Contributed by Shashikant Banerjee.
(cherry picked from commit 0a85af959c )
(cherry picked from commit e89413da88 )
|
2019-08-17 03:07:03 -07:00 |
Siyao Meng
|
224643a58c
|
HDFS-14595. HDFS-11848 breaks API compatibility. Contributed by Siyao Meng.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit 3c0382f1b9 )
(cherry picked from commit 136a97a74dbc12f05b88d0abda101690e7c727d9)
|
2019-08-14 07:40:48 -07:00 |
Wei-Chiu Chuang
|
6966b76230
|
HDFS-14491. More Clarity on Namenode UI Around Blocks and Replicas. Contributed by Siyao Meng.
(cherry picked from commit 6a43d0fbd49b3ff1ce75a2334b51a98ae476e473)
(cherry picked from commit 4784165bb24228d13f4e738e0093ab0dade0bff1)
|
2019-08-13 17:15:10 -07:00 |
Masatake Iwasaki
|
e66ad19395
|
HDFS-14423. Percent (%) and plus (+) characters no longer work in WebHDFS.
Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>
(cherry picked from commit da0006fe04 )
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java
(cherry picked from commit d7ca016d63 )
|
2019-08-14 09:07:00 +09:00 |
Siyao Meng
|
b040eb91c7
|
HDFS-14148. HDFS OIV ReverseXML SnapshotSection parser throws exception when there are more than one snapshottable directory (#1274) Contributed by Siyao Meng.
(cherry picked from commit c92b49876a )
(cherry picked from commit c5f433b11f )
|
2019-08-12 17:30:32 -07:00 |
Yiqun Lin
|
f2007818fc
|
HDFS-13359. DataXceiver hung due to the lock in FsDatasetImpl#getBlockInputStream. Contributed by Yiqun Lin.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 8a77a224c7 )
(cherry picked from commit a7bc09c596 )
|
2019-08-09 18:41:18 -07:00 |
Wei-Chiu Chuang
|
0aa847e158
|
HDFS-14693. NameNode should log a warning when EditLog IPC logger's pending size exceeds limit. Contributed by Xudong Cao.
(cherry picked from commit 6ad9a11494 )
(cherry picked from commit 2f2fa3dad6 )
|
2019-08-08 13:51:23 -07:00 |
Stephen O'Donnell
|
163fb887a6
|
HDFS-14459. ClosedChannelException silently ignored in FsVolumeList.addBlockPool(). Contributed by Stephen O'Donnell.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit b0799148cf )
(cherry picked from commit a00a327594 )
|
2019-08-08 13:37:22 -07:00 |
Chao Sun
|
90447baeb0
|
HDFS-14034. Support getQuotaUsage API in WebHDFS. Contributed by Chao Sun.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from 3ae775d740 )
(cherry picked from d38b617baa )
|
2019-08-08 10:42:27 -07:00 |
Erik Krogen
|
f6ce2f4a50
|
HDFS-14370. Add exponential backoff to the edit log tailer to avoid spinning on empty edit tail requests. Contributed by Erik Krogen.
(cherry picked from 827dbb11e2 )
(cherry picked from 016aa13940 )
|
2019-08-07 09:33:36 -07:00 |
Lokesh Jain
|
d06fca0104
|
HDFS-14692. Upload button should not encode complete url. Contributed by Lokesh Jain.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 954ff36360 )
(cherry picked from commit f6fe18a282 )
|
2019-08-06 15:31:15 -07:00 |
Stephen O'Donnell
|
99af4ce0ac
|
HDFS-14557. JournalNode error: Can't scan a pre-transactional edit log. Contributed by Stephen O'Donnell.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2019-08-06 13:53:01 -07:00 |
Erik Krogen
|
69e3ac5cbb
|
HDFS-14697. Backport of HDFS-14513. FSImage which is saving should be clean while NameNode shutdown. Contributed by He Xiaoqiao.
(cherry picked from ee1547a807 )
|
2019-08-06 09:49:23 -07:00 |
Wei-Chiu Chuang
|
a7a348446d
|
Revert "HDFS-14557. JournalNode error: Can't scan a pre-transactional edit log. Contributed by Stephen O'Donnell."
This reverts commit 45ba41570b .
|
2019-08-06 08:57:00 -07:00 |
Stephen O'Donnell
|
45ba41570b
|
HDFS-14557. JournalNode error: Can't scan a pre-transactional edit log. Contributed by Stephen O'Donnell.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 35e0a01d7b )
(cherry picked from commit 8414e6354b )
|
2019-08-06 07:58:23 -07:00 |
Erik Krogen
|
da548cf263
|
HDFS-14462 Ensure WebHDFS client throws the correct exception during writes. Contributed by Simbarashe Dzinamarira.
(cherry picked from e7a0b8aa83 )
(cherry picked from ba4ca7d996cafa1b1786249cae2b207f0eaa1070)
|
2019-08-02 11:51:22 -07:00 |
Wei-Chiu Chuang
|
68d618acd2
|
HDFS-14685. DefaultAuditLogger doesn't print CallerContext. Contributed by xuzq.
(cherry picked from commit 6757fc1a1d40ffc771bb685886b0d4a16315eca5)
(cherry picked from commit e1659fe009 )
|
2019-08-02 10:52:05 -07:00 |
Wei-Chiu Chuang
|
d66ee4bf61
|
HDFS-14631.The DirectoryScanner doesn't fix the wrongly placed replica. Contributed by Jinglun.
(cherry picked from commit 32607dbd98 )
(cherry picked from commit 5c1f91fd97 )
|
2019-08-01 15:49:14 -07:00 |
Christopher Gregorian
|
7b8f08f59e
|
HADOOP-16459. Backport of HADOOP-16266. Add more fine-grained processing time metrics to the RPC layer. Contributed by Christopher Gregorian.
This commit also includes the follow-on commit 827a84778a .
(cherry-picked from f96a2df38d )
(cherry-picked from d4492bdd9e )
|
2019-07-30 14:45:00 -07:00 |
Wei-Chiu Chuang
|
608e7044a5
|
HDFS-14429. Block remain in COMMITTED but not COMPLETE caused by Decommission. Contributed by Yicong Cai.
(cherry picked from commit 8053085388 )
(cherry picked from commit d28e624958 )
|
2019-07-29 14:33:08 -07:00 |
Yiqun Lin
|
2e1afa9a86
|
HDFS-14632. Reduce useless #getNumLiveDataNodes call in SafeModeMonitor. Contributed by He Xiaoqiao.
(cherry picked from commit 993dc8726b )
(cherry picked from commit 69f1c8d77b )
|
2019-07-29 06:50:41 -07:00 |
Inigo Goiri
|
fe40fbbd4d
|
HDFS-12703. Exceptions are fatal to decommissioning monitor. Contributed by He Xiaoqiao.
(cherry picked from commit 3d396786cf6eaab49c1c9b8b2a4652c2e440b9e3)
(cherry picked from commit 950aa74d5f )
|
2019-07-26 15:56:44 -07:00 |
Erik Krogen
|
42f10712a5
|
Revert "HDFS-14135. TestWebHdfsTimeouts Fails intermittently in trunk. Contributed by Ayush Saxena."
This reverts commit bf4a2258ce .
|
2019-07-26 11:36:59 -07:00 |
Masatake Iwasaki
|
bf4a2258ce
|
HDFS-14135. TestWebHdfsTimeouts Fails intermittently in trunk. Contributed by Ayush Saxena.
Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>
(cherry picked from commit 6b8107ad97 )
|
2019-07-26 09:49:42 +09:00 |
Chen Liang
|
2a1451aa0e
|
HDFS-13791. Amend fix LOG string format.
|
2019-07-12 12:58:08 -07:00 |
Wei-Chiu Chuang
|
3ba7826d41
|
HDFS-14537. Journaled Edits Cache is not cleared when formatting the JN. Contributed by Ranith Sardar.
|
2019-07-12 12:26:23 -07:00 |
Erik Krogen
|
cc22373606
|
HDFS-14435. [SBN Read] Enable ObserverReadProxyProvider to gracefully handle StandbyException when fetching HAServiceState. Contributed by Erik Krogen.
|
2019-07-12 12:25:19 -07:00 |
Erik Krogen
|
769b5a802b
|
HDFS-14211. [SBN Read]. Add a configurable flag to enable always-msync mode to ObserverReadProxyProvider. Contributed by Erik Krogen.
|
2019-07-12 12:24:44 -07:00 |
Erik Krogen
|
35200b3671
|
HDFS-14272. [SBN read] Make ObserverReadProxyProvider initialize its state ID against the active NN on startup. Contributed by Erik Krogen.
|
2019-07-12 12:24:44 -07:00 |
Erik Krogen
|
98684fb821
|
HDFS-14279. [SBN read] Fix race condition in ObserverReadProxyProvider. Contributed by Erik Krogen.
|
2019-07-12 12:24:43 -07:00 |
Erik Krogen
|
ee0416b456
|
HDFS-14250. [SBN read]. msync should always direct to active NameNode to get latest stateID. Contributed by Chao Sun.
|
2019-07-12 12:24:43 -07:00 |
Konstantin V Shvachko
|
321e26ced1
|
HDFS-14170. [SBN read] Fix checkstyle warnings related to SBN reads. Contributed by Konstantin V Shvachko.
|
2019-07-12 12:24:43 -07:00 |