Konstantin V Shvachko
|
1ad1c800a4
|
HDFS-13851. Remove AlignmentContext from AbstractNNFailoverProxyProvider. Contributed by Konstantin Shvachko.
|
2019-07-12 11:50:02 -07:00 |
Chen Liang
|
ee9977cc69
|
HDFS-13767. Add msync server implementation. Contributed by Chen Liang.
|
2019-07-12 11:50:01 -07:00 |
Chao Sun
|
d96ddb3b87
|
HDFS-13789. Reduce logging frequency of QuorumJournalManager#selectInputStreams. Contributed by Erik Krogen.
|
2019-07-12 11:50:01 -07:00 |
Erik Krogen
|
849a6c6f0d
|
HDFS-13688. [SBN read] Introduce msync API call. Contributed by Chen Liang.
|
2019-07-12 11:49:58 -07:00 |
Erik Krogen
|
ac2e79330c
|
HDFS-13610. [SBN read] Edit Tail Fast Path Part 4: Cleanup. Integration test, documentation, remove unnecessary dummy sync, minors fixups. Contributed by Erik Krogen.
|
2019-07-12 11:05:50 -07:00 |
Chao Sun
|
9840dae72f
|
HDFS-12976. [SBN read] Introduce ObserverReadProxyProvider. Contributed by Chao Sun.
|
2019-07-12 11:05:07 -07:00 |
Konstantin V Shvachko
|
405f6b6fbf
|
HDFS-13706. [SBN read] Rename client context to ClientGSIContext. Contributed by Konstantin Shvachko.
|
2019-07-12 11:05:07 -07:00 |
Erik Krogen
|
8e551708d8
|
HDFS-13609. [SBN read] Edit Tail Fast Path Part 3: NameNode-side changes to support tailing edits via RPC. Contributed by Erik Krogen.
|
2019-07-12 11:05:04 -07:00 |
Erik Krogen
|
abb8614dcf
|
HDFS-13608. [SBN read] Edit Tail Fast Path Part 2: Add ability for JournalNode to serve edits via RPC. Contributed by Erik Krogen.
|
2019-07-12 11:04:24 -07:00 |
Erik Krogen
|
c40ddf9b5b
|
HDFS-13607. [SBN read] Edit Tail Fast Path Part 1: Enhance JournalNode with an in-memory cache of recent edit transactions. Contributed by Erik Krogen.
|
2019-07-12 11:03:32 -07:00 |
Plamen Jeliazkov
|
7d0c3ba700
|
HDFS-13399. [SBN read] Make Client field AlignmentContext non-static. Contributed by Plamen Jeliazkov.
|
2019-07-12 11:03:31 -07:00 |
Erik Krogen
|
18e545f0be
|
HDFS-13578. [SBN read] Add ReadOnly annotation to methods in ClientProtocol. Contributed by Chao Sun.
|
2019-07-12 11:03:31 -07:00 |
Erik Krogen
|
07a6510e6a
|
HDFS-13286. [SBN read] Add haadmin commands to transition between standby and observer. Contributed by Chao Sun.
|
2019-07-12 11:03:31 -07:00 |
Erik Krogen
|
b999e96c9a
|
HDFS-13331. [SBN read] Add lastSeenStateId to RpcRequestHeader. Contributed by Plamen Jeliazkov.
|
2019-07-12 11:03:30 -07:00 |
Plamen Jeliazkov
|
21a886a4ef
|
HDFS-12977. [SBN read] Add stateId to RPC headers. Contributed by Plamen Jeliazkov.
|
2019-07-12 11:03:27 -07:00 |
Chao Sun
|
4cf63905d0
|
HDFS-12975. [SBN read] Changes to the NameNode to support reads from standby. Contributed by Chao Sun.
|
2019-07-12 10:58:43 -07:00 |
Masatake Iwasaki
|
c6ac7f511c
|
HDFS-14466. Add a regression test for HDFS-14323.
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 00dd843a1a )
|
2019-07-12 10:14:49 +09:00 |
Weiwei Yang
|
9c3806cf1b
|
HDFS-12748. NameNode memory leak when accessing webhdfs GETHOMEDIRECTORY. Contributed by Weiwei Yang.
|
2019-07-11 09:46:27 +08:00 |
Erik Krogen
|
a59553b5e6
|
HDFS-14547. Improve memory efficiency of quotas when storage type quotas are not set. Contributed by Jinglun.
(cherry-picked from 4632708148 )
(cherry-picked from 491dc7cc9d )
|
2019-07-08 15:20:29 -07:00 |
leosunli
|
7c7907f756
|
HDFS-13694. Making md5 computing being in parallel with image loading.
(cherry picked from commit 9c90729486 )
|
2019-07-07 20:02:51 -07:00 |
Masatake Iwasaki
|
02ae1d6071
|
HDFS-14629. Property value Hard Coded in DNConf.java. Contributed by hemanthboyina.
(cherry picked from commit 1c254a8ec7 )
|
2019-07-04 23:54:18 +09:00 |
Anu Engineer
|
1bae5c7024
|
HDFS-14598. Findbugs warning caused by HDFS-12487.
Contributed by He Xiaoqiao.
(cherry picked from commit 041e7a7dee )
(cherry picked from commit e7fce2104f )
|
2019-06-24 21:20:00 -07:00 |
Inigo Goiri
|
90b88db35d
|
HDFS-14247. Repeat adding node description into network topology. Contributed by HuangTao.
(cherry picked from commit 80b77deb42 )
(cherry picked from commit 9637124535 )
|
2019-06-24 21:17:04 -07:00 |
Inigo Goiri
|
aaf74ea5d7
|
HDFS-14541. When evictableMmapped or evictable size is zero, do not throw NoSuchElementException.
(cherry picked from commit 0966407ad6 )
|
2019-06-24 19:03:26 -07:00 |
Santosh Marella
|
026cc2647d
|
HDFS-12914. Block report leases cause missing blocks until next report. Contributed by Santosh Marella, He Xiaoqiao.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Co-authored-by: He Xiaoqiao <hexiaoqiao@apache.org>
|
2019-06-23 20:27:01 -07:00 |
Wei-Chiu Chuang
|
529d0955f5
|
HDFS-14074. DataNode runs async disk checks maybe throws NullPointerException, and DataNode failed to register to NameSpace. Contributed by guangyi lu.
(cherry picked from commit 645d67bc4f )
(cherry picked from commit d5ecca1d4c )
|
2019-06-21 18:27:50 -07:00 |
Wei-Chiu Chuang
|
4507c2f3a5
|
HDFS-12487. FsDatasetSpi.isValidBlock() lacks null pointer check inside and neither do the callers. Contributed by liumi.
(cherry picked from commit 1524e2e6c5 )
(cherry picked from commit 845d7611ba )
|
2019-06-21 18:18:36 -07:00 |
Wei-Chiu Chuang
|
f33bcbb687
|
HDFS-14303. check block directory logic not correct when there is only meta file, print no meaning warn log. Contributed by qiang Liu.
(cherry picked from commit a5d76a4965 )
|
2019-06-20 20:54:43 -07:00 |
Takanobu Asanuma
|
2f6f42bc7b
|
HDFS-12564. Add the documents of swebhdfs configurations on the client side. Contributed by Takanobu Asanuma.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 98d2065643 )
|
2019-06-20 20:18:00 -07:00 |
Wei-Chiu Chuang
|
58c1920472
|
Revert "HDFS-13287. TestINodeFile#testGetBlockType results in NPE when run alone. Contributed by Virajith Jalaparti."
This reverts commit 49587e4df3 .
|
2019-06-19 06:55:25 -07:00 |
Virajith Jalaparti
|
49587e4df3
|
HDFS-13287. TestINodeFile#testGetBlockType results in NPE when run alone. Contributed by Virajith Jalaparti.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 333633d9935acd5787ee8688bc9d2d7b7c058def)
(cherry picked from commit 36dc0810bf )
|
2019-06-18 22:17:08 -07:00 |
Zsolt Venczel
|
4ea3b04bf3
|
HDFS-14101. Random failure of testListCorruptFilesCorruptedBlock. Contributed by Zsolt Venczel, Nikhil Navadia.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Co-authored-by: Nikhil Navadia <nikhil.navadiya@cloudera.com>
(cherry picked from commit 7c00756aff )
|
2019-06-18 14:38:05 -07:00 |
Elek, Marton
|
293f8bbd84
|
HDFS-14078. Admin helper fails to prettify NullPointerExceptions. Contributed by Elek, Marton.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit cc229be9ebb1b3737c9f5fcb29788b51fa584e47)
(cherry picked from commit 1a99f97945 )
|
2019-06-18 12:00:48 -07:00 |
Wei-Chiu Chuang
|
29c4aded34
|
HDFS-14010. Pass correct DF usage to ReservedSpaceCalculator builder. Contributed by Virajith Jalaparti.
(cherry picked from commit 1cc1530b4e874391a17ec81e24cb55dfbbabd36a)
(cherry picked from commit 223a582eb8 )
|
2019-06-18 00:34:55 -07:00 |
Wei-Chiu Chuang
|
4362fcb629
|
HDFS-14340. Lower the log level when can't get postOpAttr. Contributed by Anuhan Torgonshar.
(cherry picked from commit 098c325a78 )
(cherry picked from commit f5428d4062c0a5e98461ea3b8420dc68555681f9)
|
2019-06-17 22:48:07 -07:00 |
Weiwei Yang
|
3bdb661f35
|
HDFS-12770. Add doc about how to disable client socket cache. Contributed by Weiwei Yang.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 6ec57fe6a45df0e9216bbbba85b5bf61da1bf2ca)
(cherry picked from commit f36cdc4d7f )
|
2019-06-17 21:47:07 -07:00 |
Wei-Chiu Chuang
|
fc8983a5b8
|
HDFS-13730. BlockReaderRemote.sendReadResult throws NPE. Contributed by Yuanbo Liu.
(cherry picked from commit 62ad9885ea )
(cherry picked from commit 45543ffd6a )
|
2019-06-17 20:20:08 -07:00 |
Akira Ajisaka
|
3d1d8623a1
|
HDFS-11950. Disable libhdfs zerocopy test on Mac. Contributed by Akira Ajisaka.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit a95e87d827 )
(cherry picked from commit f68099aa13 )
|
2019-06-17 17:04:07 -07:00 |
Wei-Chiu Chuang
|
b3e0430c3b
|
HDFS-14465. When the Block expected replications is larger than the number of DataNodes, entering maintenance will never exit. Contributed by Yicong Cai.
(cherry picked from commit 7db922c6474cb29e0e9bad320fcda4769366340a)
(cherry picked from commit 0eb42e1e05 )
|
2019-06-17 15:18:39 -07:00 |
huzheng
|
b082628e5a
|
HDFS-14535. The default 8KB buffer in requestFileDescriptors#BufferedOutputStream is causing lots of heap allocation in HBase when using short-circut read
(cherry picked from commit ea3b0a1844 )
(cherry picked from commit 9b61ecfcbe )
|
2019-06-17 07:21:07 -07:00 |
Inigo Goiri
|
76a66998fe
|
HDFS-14560. Allow block replication parameters to be refreshable. Contributed by Stephen O'Donnell.
|
2019-06-13 18:28:38 -07:00 |
Sean Mackrory
|
fee1e67453
|
HADOOP-16213. Update guava to 27.0-jre. Contributed by Gabor Bota.
|
2019-06-13 07:38:43 -06:00 |
Stephen O'Donnell
|
a9b8310584
|
HDFS-13231. Extend visualization for Decommissioning, Maintenance Mode under Datanode tab in the NameNode UI. Contributed by Stephen O'Donnell.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 50de0874d0 )
(cherry picked from commit 71159f9540 )
|
2019-06-12 10:31:21 -07:00 |
He Xiaoqiao
|
03ec4c4c7c
|
HDFS-14553. Make queue size of BlockReportProcessingThread configurable. Contributed by He Xiaoqiao.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit bd46bdf9f9 )
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
(cherry picked from commit d7560c866e )
|
2019-06-10 17:27:48 -07:00 |
Hanisha Koneru
|
dd795edcc7
|
HDFS-10659. Namenode crashes after Journalnode re-installation in an HA cluster due to missing paxos directory. Contributed by star, Hanisha Koneru.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 7217494f40 )
(cherry picked from commit 210480a23c )
|
2019-06-10 13:47:17 -07:00 |
Kihwal Lee
|
a935258e8c
|
HDFS-14521. Suppress setReplication logging. Contributed by Kihwal Lee
(cherry picked from commit 9122b9b649 )
|
2019-05-30 17:31:30 -05:00 |
Ayush Saxena
|
90cc5ddd49
|
HDFS-14512. ONE_SSD policy will be violated while write data with DistributedFileSystem.create(....favoredNodes). Contributed by Ayush Saxena.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit c1caab40f2 )
(cherry picked from commit 2cd7577a5a )
|
2019-05-29 20:58:34 -07:00 |
Takanobu Asanuma
|
8098ddaf40
|
HADOOP-16331. Fix ASF License check in pom.xml. Contributed by Akira Ajisaka.
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
|
2019-05-29 17:39:49 +09:00 |
Akira Ajisaka
|
f8bd5deec1
|
HADOOP-16323. https everywhere in Maven settings.
|
2019-05-27 15:28:21 +09:00 |
Erik Krogen
|
9295e95174
|
HDFS-14500. NameNode StartupProgress should not allow new steps in an already-completed phase. Contributed by Erik Krogen.
(cherry-picked from 55e0c134f0 )
(cherry-picked from c26cf22d6b )
|
2019-05-24 13:19:39 -07:00 |
Konstantin V Shvachko
|
799ca572f7
|
HDFS-14502. keepResults option in NNThroughputBenchmark should call saveNamespace(). Contributed by Konstantin V Shvachko.
|
2019-05-24 12:35:32 -07:00 |
Siyao Meng
|
9196c84c9f
|
HDFS-14507. Document -blockingDecommission option for hdfs dfsadmin -listOpenFiles
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
(cherry picked from commit 9dff6eff81 )
|
2019-05-22 13:25:42 +09:00 |
Srinivasu Majeti
|
e599e3b546
|
HDFS-14323. Distcp fails in Hadoop 3.x when 2.x source webhdfs url has special characters in hdfs file path. Contributed by Srinivasu Majeti.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 3e5e5b028a )
(cherry picked from commit 85f3664bb8 )
|
2019-05-17 19:22:03 +02:00 |
Siyao Meng
|
86fb5e1c8e
|
HDFS-14463. Add Log Level link under NameNode and DataNode Web UI Utilities dropdown. Contributed by Siyao Meng.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 7cb46f035a )
(cherry picked from commit 0550aa32f1a4b1809c234f8ed785db08b2e33d13)
|
2019-05-01 16:49:36 -07:00 |
Arpit Agarwal
|
7b51edbab9
|
HDFS-13677. Dynamic refresh Disk configuration results in overwriting VolumeMap. Contributed by xuzq.
(cherry picked from commit 4b4200f1f8 )
|
2019-04-29 14:54:11 -07:00 |
Puleya7
|
546ed4937c
|
HDFS-14432. dfs.datanode.shared.file.descriptor.paths duplicated in hdfs-default.xml
Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>
(cherry picked from commit 13907d8479 )
|
2019-04-17 21:57:06 +09:00 |
Akira Ajisaka
|
a70076b3a5
|
HDFS-14407. Fix misuse of SLF4j logging API in DatasetVolumeChecker#checkAllVolumes. Contributed by Wanqiang Ji.
(cherry picked from commit 67020f0950 )
|
2019-04-05 12:31:14 +09:00 |
Stephen O'Donnell
|
d9899015eb
|
HDFS-14389. getAclStatus returns incorrect permissions and owner when an iNodeAttributeProvider is configured. Contributed by Stephen O'Donnell.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit c528e427aa6745434672b1c1850738795ad1d6d2)
(cherry picked from commit 388f445dde )
|
2019-04-04 04:06:33 -07:00 |
Wei-Chiu Chuang
|
084fb9de22
|
HDFS-10477. Stop decommission a rack of DataNodes caused NameNode fail over to standby. Contributed by yunjiong zhao and Wei-Chiu Chuang.
(cherry picked from commit be488b6070 )
(cherry picked from commit c8703dda07 )
|
2019-04-03 12:41:07 -07:00 |
Gabor Bota
|
f01d592f3b
|
HADOOP-16220. Add findbugs ignores for unjustified issues during update to guava to 27.0-jre in hadoop-project
This closes #665
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 53a86e2b8e )
|
2019-04-01 13:52:44 +09:00 |
Takanobu Asanuma
|
1fc74178eb
|
HDFS-14037. Fix SSLFactory truststore reloader thread leak in URLConnectionFactory.
(cherry picked from commit 55fb3c32fb )
|
2019-03-27 03:29:42 +09:00 |
Inigo Goiri
|
80732146c6
|
HDFS-14366. Improve HDFS append performance. Contributed by Chao Sun.
(cherry picked from commit ff06ef0631 )
|
2019-03-15 13:58:39 -07:00 |
Erik Krogen
|
cb76fc5618
|
HDFS-14346. Add better time precision to Configuration#getTimeDuration, allowing return unit and default unit to be specified independently. Contributed by Chao Sun.
(cherry picked from commit 66357574ae )
(cherry picked from commit fec7c5f3eb )
|
2019-03-13 13:20:51 -07:00 |
Shweta Yakkali
|
a324db2cce
|
HDFS-14081. hdfs dfsadmin -metasave metasave_test results NPE. Contributed by Shweta Yakkali.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 1bea785020 )
(cherry picked from commit 1ceefa726e )
|
2019-03-12 16:06:16 -07:00 |
Stephen O'Donnell
|
327e57ae6e
|
HDFS-14333. Datanode fails to start if any disk has errors during Namenode registration. Contributed by Stephen O'Donnell.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 34b14061b3 )
(cherry picked from commit a21e2e4dbc )
|
2019-03-12 10:19:37 -07:00 |
Erik Krogen
|
b0b8000240
|
HDFS-14317. Ensure checkpoints are created when in-progress edit log tailing is enabled with a period shorter than the log roll period. Contributed by Ekanth Sethuramalingam.
(cherry-picked from commit 1bc282e0b3 )
(cherry-picked from commit 6d076dd5e8 )
|
2019-03-07 08:43:39 -08:00 |
Wei-Chiu Chuang
|
d951497f57
|
HDFS-14314. fullBlockReportLeaseId should be reset after registering to NN. Contributed by star.
(cherry picked from commit 387dbe587a )
(cherry picked from commit e58ccca3ce )
|
2019-03-04 10:46:00 -08:00 |
Erik Krogen
|
b7eb9116eb
|
HDFS-14305. Fix serial number calculation in BlockTokenSecretManager to avoid token key ID overlap between NameNodes. Contributed by He Xiaoqiao.
|
2019-03-01 08:12:54 -08:00 |
Surendra Singh Lilhore
|
bd9e2826fe
|
HDFS-14263. Remove unnecessary block file exists check from FsDatasetImpl#getBlockInputStream(). Contributed by Surendra Singh Lilhore
(cherry picked from commit 29b411d5f0 )
|
2019-02-13 23:56:34 +05:30 |
Surendra Singh Lilhore
|
3bcdff8fac
|
HDFS-14274. EC: NPE While Listing EC Policy For A Directory Following Replication Policy. Contributed by Ayush Saxena.
(cherry picked from commit 35d4f32b32 )
|
2019-02-13 23:26:14 +05:30 |
Vinayakumar B
|
1f3e737407
|
HDFS-14266. EC : Fsck -blockId shows null for EC Blocks if One Block Is Not Available. Contributed by Ayush Saxena.
|
2019-02-12 22:35:55 +05:30 |
Surendra Singh Lilhore
|
1f4be45ef6
|
HDFS-14140. JournalNodeSyncer authentication is failing in secure cluster. Contributed by Surendra Singh Lilhore.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 4be87353e3 )
(cherry picked from commit 2501fcd26b )
|
2019-02-07 16:53:12 -08:00 |
Kitti Nanasi
|
c25b641cec
|
HDFS-14231. DataXceiver#run() should not log exceptions caused by InvalidToken exception as an error. Contributed by Kitti Nanasi.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 49ddd8a6ed )
(cherry picked from commit 38541b2375 )
|
2019-02-05 15:15:31 -08:00 |
Wangda Tan
|
a1e09b4c0c
|
Make upstream aware of 3.1.2 release
Change-Id: I397bc6ef75498726df4763bd07a8bf8fe1c38365
(cherry picked from commit 308f3168fa )
(cherry picked from commit 649da5af04 )
|
2019-02-05 14:09:33 -08:00 |
Masatake Iwasaki
|
dd3e7fc0c2
|
HDFS-12729. Document special paths in HDFS. Contributed by Masatake Iwasaki.
(cherry picked from commit dc5af4c6b7 )
|
2019-01-29 02:29:39 +09:00 |
Dinesh Chitlangia
|
b63941516f
|
HDFS-14228. Incorrect getSnapshottableDirListing() javadoc. Contributed by Dinesh Chitlangia.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 45caeee6cf )
(cherry picked from commit eb77e60163 )
|
2019-01-25 07:38:11 -08:00 |
Takanobu Asanuma
|
38e4bed224
|
HDFS-14218. EC: Ls -e throw NPE when directory ec policy is disabled. Contributed by Ayush Saxena.
(cherry picked from commit 7d6792e5d2 )
|
2019-01-23 10:05:39 +09:00 |
Arpit Agarwal
|
f5bfeac62e
|
HDFS-14221. Replace Guava Optional with Java Optional. Contributed by Arpit Agarwal.
(cherry picked from commit 1ff658b2ef )
|
2019-01-21 20:48:05 -08:00 |
Arpit Agarwal
|
78b45977b1
|
HDFS-14222. Make ThrottledAsyncChecker constructor public. Contributed by Arpit Agarwal.
(cherry picked from commit 6f0756fc0e )
|
2019-01-21 20:47:02 -08:00 |
Weiwei Yang
|
cf520b7d64
|
HDFS-14207. ZKFC should catch exception when ha configuration missing. Contributed by Fei Hui.
(cherry picked from commit de34fc148c )
|
2019-01-22 12:17:33 +08:00 |
Surendra Singh Lilhore
|
6c846cfbf2
|
HDFS-14198. Upload and Create button doesn't get enabled after getting reset. Contributed by Ayush Saxena.
(cherry picked from commit 9aeaaa0479 )
|
2019-01-11 14:59:17 +05:30 |
Wangda Tan
|
31ea2f7806
|
Preparing for 3.1.3 development
Change-Id: I3c3d3ee47dc4fef239127b4452ff14676fa26e3d
|
2019-01-07 10:04:58 -08:00 |
Wei-Chiu Chuang
|
f24684ca9c
|
HDFS-14171. Performance improvement in Tailing EditLog. Contributed by Kenneth Yang.
(cherry picked from commit e9a005dfcf )
(cherry picked from commit c48640ffbd )
|
2018-12-28 10:39:14 -08:00 |
Surendra Singh Lilhore
|
de2b04a74b
|
HDFS-14046. In-Maintenance ICON is missing in datanode info page. Contributed by Ranith Sardar.
(cherry picked from commit 686fcd4db3 )
|
2018-12-24 11:11:21 +05:30 |
Brahma Reddy Battula
|
0b83c95ff4
|
HDFS-14095. EC: Track Erasure Coding commands in DFS statistics. Contributed by Ayush Saxena.
(cherry picked from commit f534736867 )
|
2018-11-30 00:27:37 +05:30 |
Vinayakumar B
|
0254100074
|
HDFS-13816. dfs.getQuotaUsage() throws NPE on non-existent dir instead of FileNotFoundException. Contributed by Vinayakumar B.
(cherry picked from commit b098281454 )
|
2018-11-26 18:22:58 +05:30 |
Vinayakumar B
|
e5e4dc42a3
|
HDFS-14056. Fix error messages in HDFS-12716. Contributed by Ayush Saxena.
(cherry picked from commit 886b935630bf2d46f4c6773de013c093d2e44c38)
|
2018-11-16 18:01:54 +05:30 |
Vinayakumar B
|
53b6290949
|
HDFS-13963. NN UI is broken with IE11. Contributed by Ayush Saxena.
(cherry picked from commit 8571507efa )
|
2018-11-16 17:31:25 +05:30 |
Xiao Chen
|
8ab6aa1b42
|
Revert "HDFS-13732. ECAdmin should print the policy name when an EC policy is set. Contributed by Zsolt Venczel."
This reverts commit 0424715207 .
|
2018-11-13 12:46:03 -08:00 |
Brahma Reddy Battula
|
d72c134889
|
HDFS-14070. Refactor NameNodeWebHdfsMethods to allow better extensibility. Contributed by CR Hota
(cherry picked from commit e7b63baca1 )
|
2018-11-13 13:11:39 +05:30 |
Arpit Agarwal
|
b6ef824e76
|
HDFS-14065. Failed Storage Locations shows nothing in the Datanode Volume Failures. Contributed by Ayush Saxena.
(cherry picked from commit b6d4e19f34 )
|
2018-11-12 15:32:05 -08:00 |
Kitti Nanasi
|
01b8197893
|
HDFS-14039. ec -listPolicies doesn't show correct state for the default policy when the default is not RS(6,3). Contributed by Kitti Nanasi.
Signed-off-by: Xiao Chen <xiao@apache.org>
(cherry picked from commit 8d99648c20 )
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ErasureCodingPolicyManager.java
|
2018-11-08 10:08:34 -08:00 |
Inigo Goiri
|
f65324aa47
|
HDFS-14048. DFSOutputStream close() throws exception on subsequent call after DataNode restart. Contributed by Erik Krogen.
(cherry picked from commit 887244de4a )
|
2018-11-06 11:20:33 -08:00 |
Inigo Goiri
|
9bf4f3d614
|
HDFS-14043. Tolerate corrupted seen_txid file. Contributed by Lukas Majercak.
(cherry picked from commit f3296501e0 )
|
2018-11-05 16:52:43 -08:00 |
Giovanni Matteo Fumarola
|
a1321d020a
|
HDFS-14042. Fix NPE when PROVIDED storage is missing. Contributed by Virajith Jalaparti.
|
2018-11-05 11:39:15 -08:00 |
Akira Ajisaka
|
dd70b1f538
|
Addendum: Fix potential FSImage corruption. Contributed by Xiao Chen.
|
2018-10-31 17:02:15 +09:00 |
Xiao Chen
|
399645ebc1
|
HDFS-14027. DFSStripedOutputStream should implement both hsync methods.
(cherry picked from commit db7e636824 )
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSStripedOutputStream.java
|
2018-10-29 19:13:51 -07:00 |
Wei-Chiu Chuang
|
35e09fe594
|
Revert "HADOOP-15864. Job submitter / executor fail when SBN domain name can not resolved. Contributed by He Xiaoqiao."
This reverts commit ef9f8ca13d .
|
2018-10-28 17:06:40 -07:00 |
Anu Engineer
|
4a1be70099
|
HDFS-14028. HDFS OIV temporary dir deletes folder.
Contributed by Adam Antal.
(cherry picked from commit 4f10d7e23f )
|
2018-10-26 16:51:52 -07:00 |
Arpit Agarwal
|
8b4f9b3e2c
|
HDFS-14029. Sleep in TestLazyPersistFiles should be put into a loop. Contributed by Adam Antal.
(cherry picked from commit 9b899f1ebd )
|
2018-10-25 15:14:48 -07:00 |
Wei-Chiu Chuang
|
ef9f8ca13d
|
HADOOP-15864. Job submitter / executor fail when SBN domain name can not resolved. Contributed by He Xiaoqiao.
(cherry picked from commit fb2b72e6fc )
(cherry picked from commit fd02c501c0 )
|
2018-10-25 09:37:31 -07:00 |
Inigo Goiri
|
4b1f2ecd4c
|
HDFS-14003. Fix findbugs warning in trunk for FSImageFormatPBINode. Contributed by Yiqun Lin.
(cherry picked from commit 0e56c883cd )
|
2018-10-24 16:14:14 -07:00 |
Xiao Chen
|
96cedb87b9
|
Fix potential FSImage corruption. Contributed by Daryn Sharp and Vinayakumar B.
(cherry picked from commit f1996ccbaee734d423caa9d47a571cfff98ef42c)
|
2018-10-24 16:10:25 -07:00 |
Inigo Goiri
|
2e43966b56
|
HDFS-14021. TestReconstructStripedBlocksWithRackAwareness#testReconstructForNotEnoughRacks fails intermittently. Contributed by Xiao Chen.
(cherry picked from commit c1874046e2 )
|
2018-10-24 09:38:40 -07:00 |
Arpit Agarwal
|
8548864ccb
|
HDFS-13941. make storageId in BlockPoolTokenSecretManager.checkAccess optional. Contributed by Ajay Kumar.
(cherry picked from commit c58811c77d )
|
2018-10-22 14:44:58 -07:00 |
Giovanni Matteo Fumarola
|
92c6bde6be
|
HDFS-14005. RBF: Web UI update to bootstrap-3.3.7. Contributed by Inigo Goiri.
|
2018-10-18 14:28:19 -07:00 |
Inigo Goiri
|
16e1ab4c99
|
HDFS-14000. RBF: Documentation should reflect right scripts for v3.0 and above. Contributed by CR Hota.
(cherry picked from commit 7347fa2df3 )
|
2018-10-17 16:42:32 -07:00 |
Xiao Chen
|
d1749fbaae
|
HADOOP-14445. Addendum: Use DelegationTokenIssuer to create KMS delegation tokens that can authenticate to all KMS instances.
(cherry picked from commit b6fc72a025 )
|
2018-10-15 11:00:30 -07:00 |
Xiao Chen
|
6a1ce74fb1
|
HADOOP-14445. Use DelegationTokenIssuer to create KMS delegation tokens that can authenticate to all KMS instances.
Contributed by Daryn Sharp, Xiao Chen, Rushabh S Shah.
(cherry picked from commit 5ec86b445c )
(cherry picked from commit e93e401f492c7fc112da3d0c63b3b186c1b196ec)
Conflicts:
hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/key/kms/KMSClientProvider.java
|
2018-10-12 12:08:26 -07:00 |
Inigo Goiri
|
6342a7cb98
|
HDFS-13802. RBF: Remove FSCK from Router Web UI. Contributed by Fei Hui.
(cherry picked from commit f63ee083db )
|
2018-10-12 10:11:24 -07:00 |
Vinayakumar B
|
bed2f407a9
|
HDFS-13945. TestDataNodeVolumeFailure is Flaky. Contributed by Ayush Saxena.
(cherry picked from commit 6e0e6daaf3 )
|
2018-10-12 17:36:03 +05:30 |
Hrishikesh Gadre
|
323b76bccf
|
HDFS-13926. ThreadLocal aggregations for FileSystem.Statistics are incorrect with striped reads.
Contributed by Xiao Chen, Hrishikesh Gadre.
Signed-off-by: Xiao Chen <xiao@apache.org>
|
2018-10-09 19:54:34 -07:00 |
Todd Lipcon
|
89d4481020
|
HADOOP-15550. Avoid static initialization of ObjectMappers
(cherry picked from commit 7a3c6e9c3c )
|
2018-10-09 13:50:00 -05:00 |
Yiqun Lin
|
665036c5f7
|
HDFS-13962. Add null check for add-replica pool to avoid lock acquiring. Contributed by Surendra Singh Lilhore.
(cherry picked from commit 1043795f7f )
|
2018-10-09 10:36:45 +08:00 |
Inigo Goiri
|
9bbf494c7f
|
HDFS-13964. RBF: TestRouterWebHDFSContractAppend fails with No Active Namenode under nameservice. Contributed by Ayush Saxena.
(cherry picked from commit 3bfff0f79e )
|
2018-10-06 10:41:49 -07:00 |
Yiqun Lin
|
dd70adf318
|
HDFS-13957. Fix incorrect option used in description of InMemoryAliasMap.
(cherry picked from commit 619e490333 )
|
2018-10-05 10:08:28 +08:00 |
Yiqun Lin
|
65af98b58a
|
HDFS-13768. Adding replicas to volume map makes DataNode start slowly. Contributed by Surendra Singh Lilhore.
(cherry picked from commit 5689355783 )
|
2018-10-02 09:46:23 +08:00 |
Brahma Reddy Battula
|
02f8b5da47
|
HDFS-13840. RBW Blocks which are having less GS should be added to Corrupt. Contributed by Brahma Reddy Battula
(cherry picked from commit e0ff8e2c10 )
|
2018-09-26 23:51:59 +05:30 |
Brahma Reddy Battula
|
97b75f47fd
|
HDFS-13790. RBF: Move ClientProtocol APIs to its own module Contributed by Chao Sun.
|
2018-09-26 22:40:48 +05:30 |
Chen Liang
|
b4069343bb
|
HADOOP-15726. Create utility to limit frequency of log statements. Contributed by Erik Krogen.
|
2018-09-19 14:28:35 -07:00 |
Arpit Agarwal
|
58f339e491
|
HADOOP-15772. Remove the 'Path ... should be specified as a URI' warnings on startup. Contributed by Ayush Saxena.
(cherry picked from commit 2eb597b151 )
|
2018-09-19 13:49:06 -07:00 |
Inigo Goiri
|
2f7222a27b
|
HADOOP-15684. triggerActiveLogRoll stuck on dead name node, when ConnectTimeoutException happens. Contributed by Rong Tang.
(cherry picked from commit 7f9a89e1b54a9712af50ffef70bed7cfb91ed34e)
|
2018-09-19 12:59:16 -07:00 |
Inigo Goiri
|
e1af3c9bb7
|
HDFS-13908. TestDataNodeMultipleRegistrations is flaky. Contributed by Ayush Saxena.
(cherry picked from commit 56e0d635e0 )
|
2018-09-19 09:31:18 -07:00 |
Wei-Chiu Chuang
|
7442b7941d
|
HDFS-13868. WebHDFS: GETSNAPSHOTDIFF API NPE when param "snapshotname" is given but "oldsnapshotname" is not. Contributed by Pranay Singh.
(cherry picked from commit 28ceb34a72 )
|
2018-09-19 03:12:55 -07:00 |
Wei-Chiu Chuang
|
595ce94570
|
HDFS-13886. HttpFSFileSystem.getFileStatus() doesn't return "snapshot enabled" bit. Contributed by Siyao Meng.
(cherry picked from commit 44857476fa )
|
2018-09-18 15:40:10 -07:00 |
Mingliang Liu
|
bff2230591
|
HDFS-11719. Arrays.fill() wrong index in BlockSender.readChecksum() exception handling. Contributed by Tao Zhang
|
2018-09-18 10:40:16 -07:00 |
Inigo Goiri
|
508fd55c79
|
HDFS-13844. Fix the fmt_bytes function in the dfs-dust.js. Contributed by yanghuafeng.
(cherry picked from commit a9c1c55cafc0338bb35d2991f217d4157463f1d3)
|
2018-09-17 14:38:08 -07:00 |
Wei-Chiu Chuang
|
829399a9f3
|
HDFS-13838. WebHdfsFileSystem.getFileStatus() won't return correct "snapshot enabled" status. Contributed by Siyao Meng.
(cherry picked from commit a1de8cbac5 )
|
2018-09-14 05:24:24 +08:00 |
Inigo Goiri
|
2f7d226589
|
HDFS-13914. Fix DN UI logs link broken when https is enabled after HDFS-13902. Contributed by Jianfei Jiang.
(cherry picked from commit e1b242a984 )
|
2018-09-13 09:17:37 -07:00 |
Brahma Reddy Battula
|
74c00641f9
|
HDFS-13902. Add JMX, conf and stacks menus to the datanode page. Contributed by fengchuang.
(cherry picked from commit b2432d254c )
|
2018-09-12 06:34:35 +05:30 |
Xiao Chen
|
2dd27c999b
|
HDFS-13051. Fix dead lock during async editlog rolling if edit queue is full. Contributed by Daryn Sharp.
(cherry picked from commit 8e54da1511 )
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestEditLogRace.java
|
2018-09-10 22:44:48 -07:00 |
Brahma Reddy Battula
|
77dd456461
|
HDFS-13237. [Documentation] RBF: Mount points across multiple subclusters. Contributed Íñigo Goiri
(cherry picked from commit 96892c469b )
|
2018-09-11 10:13:35 +05:30 |
Vinayakumar B
|
b8eaeca7e6
|
HDFS-13895. EC: Fix Intermittent Failure in TestDFSStripedOutputStreamWithFailureWithRandomECPolicy. Contributed by Ayush Saxena.
(cherry picked from commit eef3bafae8 )
|
2018-09-10 09:24:08 +05:30 |
Brahma Reddy Battula
|
cbcdaefa37
|
HDFS-13862. RBF: Router logs are not capturing few of the dfsrouteradmin commands. Contributed by Ayush Saxena
(cherry picked from commit 8944407d93 )
|
2018-09-09 23:21:45 +05:30 |
Inigo Goiri
|
a400ed3aab
|
HDFS-13836. RBF: Handle mount table znode with null value. Contributed by yanghuafeng.
(cherry picked from commit 527288ef89 )
|
2018-09-06 16:48:44 -07:00 |
Wei-Chiu Chuang
|
d1ea7df43d
|
HADOOP-15696. KMS performance regression due to too many open file descriptors after Jetty migration. Contributed by Wei-Chiu Chuang.
(cherry picked from commit e780556ae9 )
Conflicts:
hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/http/TestHttpServer.java
|
2018-09-05 10:17:58 -07:00 |
Yiqun Lin
|
c898757f55
|
HDFS-13815. RBF: Add check to order command. Contributed by Ranith Sardar.
(cherry picked from commit 9315db5f5d )
|
2018-09-05 23:35:30 +08:00 |
Hrishikesh Gadre
|
fde3b5ac22
|
HDFS-13812. Fix the inconsistent default refresh interval on Caching documentation. Contributed by Hrishikesh Gadre.
Signed-off-by: Xiao Chen <xiao@apache.org>
(cherry picked from commit 6ccb809c2d )
|
2018-09-04 21:54:43 -07:00 |
Inigo Goiri
|
a26565960a
|
HDFS-13857. RBF: Choose to enable the default nameservice to read/write files. Contributed by yanghuafeng.
(cherry picked from commit 54f2044595 )
|
2018-09-04 12:17:49 -07:00 |
Vinayakumar B
|
9cf35d99b9
|
HDFS-13774. EC: 'hdfs ec -getPolicy' is not retrieving policy details when the special REPLICATION policy set on the directory. Contributed by Ayush Saxena.
(cherry picked from commit 3801436e49 )
|
2018-09-03 14:39:11 +05:30 |
Vinayakumar B
|
6776db5aec
|
HDFS-13867. RBF: Add validation for max arguments for Router admin ls, clrQuota, setQuota, rm and nameservice commands. Contributed by Ayush Saxena.
(cherry picked from commit 780df9034f )
|
2018-09-03 14:29:28 +05:30 |
Wei-Chiu Chuang
|
9f0cd2ade2
|
Revert "HDFS-13838. WebHdfsFileSystem.getFileStatus() won't return correct "snapshot enabled" status. Contributed by Siyao Meng."
This reverts commit 41732e7b28 .
|
2018-08-30 11:58:42 -07:00 |
Vinayakumar B
|
65977e5d81
|
HDFS-13027. Handle possible NPEs due to deleted blocks in race condition. Contributed by Vinayakumar B.
|
2018-08-30 22:14:47 +05:30 |
Yiqun Lin
|
8a3be0d5a4
|
HDFS-13863. FsDatasetImpl should log DiskOutOfSpaceException. Contributed by Fei Hui.
(cherry picked from commit 582cb10ec7 )
|
2018-08-30 11:22:57 +08:00 |
Yiqun Lin
|
b9b2b97e9d
|
HDFS-13634. RBF: Configurable value in xml for async connection request queue size. Contributed by CR Hota.
(cherry picked from commit a0ebb6b39f )
|
2018-08-29 16:18:15 +08:00 |
Brahma Reddy Battula
|
c01c240f6f
|
HDFS-13854. RBF: The ProcessingAvgTime and ProxyAvgTime should display by JMX with ms unit. Contributed by yanghuafeng.
(cherry picked from commit 64ad0298d4 )
|
2018-08-29 08:31:19 +05:30 |
Zsolt Venczel
|
5cbb9b1ca9
|
HDFS-13731. ReencryptionUpdater fails with ConcurrentModificationException during processCheckpoints. Contributed by Zsolt Venczel.
(cherry picked from commit 3e18b957eb )
|
2018-08-28 15:14:13 -07:00 |
Brahma Reddy Battula
|
450ba6790d
|
HDFS-13861. RBF: Illegal Router Admin command leads to printing usage for all commands. Contributed by Ayush Saxena.
(cherry picked from commit cb9d371ae2 )
|
2018-08-29 00:31:16 +05:30 |
Yiqun Lin
|
2cbc3c7d43
|
HDFS-13831. Make block increment deletion number configurable. Contributed by Ryan Wu.
(cherry picked from commit b9b964d253 )
|
2018-08-28 09:36:02 -07:00 |
Vinayakumar B
|
9265d1a61a
|
HDFS-13858. RBF: Add check to have single valid argument to safemode command. Contributed by Ayush Saxena.
(cherry picked from commit 75691ad600 )
|
2018-08-28 09:21:42 +05:30 |