Konstantin V Shvachko
|
25d8e39b5c
|
HDFS-13851. Remove AlignmentContext from AbstractNNFailoverProxyProvider. Contributed by Konstantin Shvachko.
|
2018-12-24 09:34:00 -08:00 |
Chen Liang
|
66ec3a67e8
|
HDFS-13767. Add msync server implementation. Contributed by Chen Liang.
|
2018-12-24 09:34:00 -08:00 |
Chao Sun
|
4c9baba066
|
HDFS-13789. Reduce logging frequency of QuorumJournalManager#selectInputStreams. Contributed by Erik Krogen.
|
2018-12-24 09:34:00 -08:00 |
Erik Krogen
|
eae0a5d54a
|
HDFS-13688. [SBN read] Introduce msync API call. Contributed by Chen Liang.
|
2018-12-24 09:34:00 -08:00 |
|
Erik Krogen
|
1e22f2bfbb
|
HDFS-13610. [SBN read] Edit Tail Fast Path Part 4: Cleanup. Integration test, documentation, remove unnecessary dummy sync, minors fixups. Contributed by Erik Krogen.
|
2018-12-24 09:34:00 -08:00 |
|
Chao Sun
|
64b7cf59bd
|
HDFS-12976. [SBN read] Introduce ObserverReadProxyProvider. Contributed by Chao Sun.
|
2018-12-24 09:33:59 -08:00 |
|
Konstantin V Shvachko
|
0105d7f597
|
HDFS-13706. [SBN read] Rename client context to ClientGSIContext. Contributed by Konstantin Shvachko.
|
2018-12-24 09:33:59 -08:00 |
|
Erik Krogen
|
00e99c6594
|
HDFS-13609. [SBN read] Edit Tail Fast Path Part 3: NameNode-side changes to support tailing edits via RPC. Contributed by Erik Krogen.
|
2018-12-24 09:33:59 -08:00 |
|
Erik Krogen
|
151c8ddbe4
|
HDFS-13608. [SBN read] Edit Tail Fast Path Part 2: Add ability for JournalNode to serve edits via RPC. Contributed by Erik Krogen.
|
2018-12-24 09:33:59 -08:00 |
|
Erik Krogen
|
c81ac2ff02
|
HDFS-13607. [SBN read] Edit Tail Fast Path Part 1: Enhance JournalNode with an in-memory cache of recent edit transactions. Contributed by Erik Krogen.
|
2018-12-24 09:33:59 -08:00 |
Plamen Jeliazkov
|
e880660a20
|
HDFS-13399. [SBN read] Make Client field AlignmentContext non-static. Contributed by Plamen Jeliazkov.
|
2018-12-24 09:33:59 -08:00 |
|
Erik Krogen
|
a109f2b32f
|
HDFS-13578. [SBN read] Add ReadOnly annotation to methods in ClientProtocol. Contributed by Chao Sun.
|
2018-12-24 09:33:59 -08:00 |
|
Erik Krogen
|
091ad974cd
|
HDFS-13286. [SBN read] Add haadmin commands to transition between standby and observer. Contributed by Chao Sun.
|
2018-12-24 09:33:59 -08:00 |
|
Erik Krogen
|
9bf0696c73
|
HDFS-13331. [SBN read] Add lastSeenStateId to RpcRequestHeader. Contributed by Plamen Jeliazkov.
|
2018-12-24 09:33:59 -08:00 |
|
Plamen Jeliazkov
|
c9d73437e8
|
HDFS-12977. [SBN read] Add stateId to RPC headers. Contributed by Plamen Jeliazkov.
|
2018-12-24 09:33:59 -08:00 |
|
Chao Sun
|
3a78e5ffd8
|
HDFS-12975. [SBN read] Changes to the NameNode to support reads from standby. Contributed by Chao Sun.
|
2018-12-24 09:33:59 -08:00 |
Surendra Singh Lilhore
|
686fcd4db3
|
HDFS-14046. In-Maintenance ICON is missing in datanode info page. Contributed by Ranith Sardar.
|
2018-12-24 11:02:36 +05:30 |
|
Surendra Singh Lilhore
|
d944d5ec46
|
HDFS-14165. In NameNode UI under DataNode tab ,the Capacity column is Non-Aligned. Contributed by Shubham Dewan.
|
2018-12-23 15:06:12 +05:30 |
Yiqun Lin
|
feb2664ac4
|
HDFS-13946. Log longest FSN write/read lock held stack trace.
|
2018-12-22 23:09:59 +08:00 |
|
Surendra Singh Lilhore
|
788e7473a4
|
HDFS-14096. [SPS] : Add Support for Storage Policy Satisfier in ViewFs. Contributed by Ayush Saxena.
|
2018-12-17 11:24:57 +05:30 |
Giovanni Matteo Fumarola
|
00d5e631b5
|
HDFS-14006. Refactor name node to allow different token verification implementations. Contributed by CR Hota.
|
2018-12-14 11:10:54 -08:00 |
|
Giovanni Matteo Fumarola
|
f858f18554
|
HDFS-14088. RequestHedgingProxyProvider can throw NullPointerException when failover due to no lock on currentUsedProxy. Contributed by Yuxuan Wang.
|
2018-12-14 11:04:36 -08:00 |
|
Giovanni Matteo Fumarola
|
cb3382f667
|
HDFS-14145. TestBlockStorageMovementAttemptedItems#testNoBlockMovementAttemptFinishedReportAdded fails sporadically in Trunk. Contributed by Ayush Saxena.
|
2018-12-14 10:59:02 -08:00 |
Zsolt Venczel
|
aa12859890
|
HDFS-14121. Log message about the old hosts file format is misleading
(Contributed by Zsolt Venczel via Daniel Templeton)
Change-Id: I7ff548f6c82e0aeb08a7a50ca7c2c827db8726bb
|
2018-12-14 13:54:57 +01:00 |
Akira Ajisaka
|
ca379e1c43
|
HDFS-13970. Use MultiMap for CacheManager Directives to simplify the code. Contributed by BELUGA BEHR.
|
2018-12-14 14:36:26 +09:00 |
Daniel Templeton
|
4aa0609fb0
|
HDFS-13985. Clearer error message for ReplicaNotFoundException
(Contributed by Adam Antal via Daniel Templeton)
Change-Id: I68ae7a5bedecbc204c161fc3b3ce8878fe5d493d
|
2018-12-13 16:21:45 +01:00 |
|
Giovanni Matteo Fumarola
|
561b61cfb1
|
HDFS-14144. TestPred fails in Trunk. Contributed by Ayush Saxena.
|
2018-12-12 11:16:16 -08:00 |
|
Giovanni Matteo Fumarola
|
60af851e59
|
HDFS-14137. TestMaintenanceState fails with ArrayIndexOutOfBound Exception. Contributed by Ayush Saxena.
|
2018-12-11 11:22:32 -08:00 |
Vinayakumar B
|
39dc7345b8
|
HDFS-14124. EC : Support EC Commands (set/get/unset EcPolicy) via WebHdfs. Contributed by Ayush Saxena.
|
2018-12-11 17:59:04 +05:30 |
Sean Mackrory
|
80e59e7876
|
HDFS-14101. Fixing underflow error in test. Contributed by Zsolt Venczel.
|
2018-12-10 14:03:08 -07:00 |
Inigo Goiri
|
8fc0d04517
|
HDFS-14001. [PROVIDED Storage] bootstrapStandby should manage the InMemoryAliasMap. Contributed by Virajith Jalaparti.
|
2018-12-07 18:30:36 -08:00 |
|
Vinayakumar B
|
c03024a530
|
HDFS-14113. EC : Add Configuration to restrict UserDefined Policies. Contributed by Ayush Saxena.
|
2018-12-06 18:20:28 +05:30 |
|
Giovanni Matteo Fumarola
|
69489ff2d1
|
HDFS-14119. Improve GreedyPlanner Parameter Logging. Contributed by Beluga Behr.
|
2018-12-03 12:55:52 -08:00 |
Adam Antal
|
fb10803dfa
|
HDFS-13818. Extend OIV to detect FSImage corruption. Contributed by Adam Antal.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2018-12-03 10:34:39 -08:00 |
Kitti Nanasi
|
dd5e7c6b72
|
HDFS-12946. Add a tool to check rack configuration against EC policies. Contributed by Kitti Nanasi.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2018-12-03 10:01:09 -08:00 |
|
Surendra Singh Lilhore
|
042c8ef593
|
HDFS-14075. Terminate the namenode when failed to start log segment. Contributed by Ayush Saxena.
|
2018-12-02 12:31:08 +05:30 |
|
Giovanni Matteo Fumarola
|
99e201dfe2
|
HDFS-14105. Replace TreeSet in NamenodeFsck with HashSet. Contributed by Beluga Behr.
|
2018-11-30 11:07:11 -08:00 |
|
Giovanni Matteo Fumarola
|
b09cfad432
|
HDFS-14106. Refactor NamenodeFsck#copyBlock. Contributed by Beluga Behr.
|
2018-11-30 10:47:59 -08:00 |
|
Yiqun Lin
|
0e36e935d9
|
HDFS-13870. WebHDFS: Document ALLOWSNAPSHOT and DISALLOWSNAPSHOT API doc. Contributed by Siyao Meng.
|
2018-11-30 11:31:34 +08:00 |
Tsz Wo Nicholas Sze
|
0081b02e35
|
HDFS-14112. Avoid recursive call to external authorizer for getContentSummary.
|
2018-11-29 13:55:21 -08:00 |
Brahma Reddy Battula
|
f534736867
|
HDFS-14095. EC: Track Erasure Coding commands in DFS statistics. Contributed by Ayush Saxena.
|
2018-11-30 00:18:27 +05:30 |
Ewan Higgs
|
c1d24f8483
|
HDFS-13713. Add specification of Multipart Upload API to FS specification, with contract tests.
Contributed by Ewan Higgs and Steve Loughran.
|
2018-11-29 15:12:17 +00:00 |
|
Giovanni Matteo Fumarola
|
300f560fcc
|
HDFS-14102. Performance improvement in BlockPlacementPolicyDefault. Contributed by Beluga Behr.
|
2018-11-28 11:33:22 -08:00 |
|
Giovanni Matteo Fumarola
|
4ca3a6b21a
|
HDFS-14108. Performance improvement in BlockManager Data Structures. Contributed by Beluga Behr.
|
2018-11-28 11:25:47 -08:00 |
|
Vinayakumar B
|
b098281454
|
HDFS-13816. dfs.getQuotaUsage() throws NPE on non-existent dir instead of FileNotFoundException. Contributed by Vinayakumar B.
|
2018-11-26 18:22:32 +05:30 |
|
Brahma Reddy Battula
|
892b33e054
|
HDFS-14064. WEBHDFS: Support Enable/Disable EC Policy. Contributed by Ayush Saxena.
|
2018-11-22 00:13:56 +05:30 |
|
Akira Ajisaka
|
1a00b4e325
|
Add 2.9.2 release notes and changes documents.
|
2018-11-20 14:25:18 +09:00 |
|
Daniel Templeton
|
e56d9f2618
|
HDFS-14015. Improve error handling in hdfsThreadDestructor in native thread local storage
Change-Id: Ida1e888c9231b9e46081338e3a206d8f6faabd36
|
2018-11-16 16:24:40 -08:00 |
Weiwei Yang
|
ad5256e44d
|
HDFS-14063. Support noredirect param for CREATE/APPEND/OPEN/GETFILECHECKSUM in HttpFS. Contributed by Íñigo Goiri.
|
2018-11-17 01:12:22 +08:00 |
|
Vinayakumar B
|
68d5dfdc78
|
HDFS-14056. Fix error messages in HDFS-12716. Contributed by Ayush Saxena.
|
2018-11-16 18:05:10 +05:30 |
|
Vinayakumar B
|
8571507efa
|
HDFS-13963. NN UI is broken with IE11. Contributed by Ayush Saxena.
|
2018-11-16 17:26:36 +05:30 |
Arpit Agarwal
|
1e15c7e855
|
HADOOP-15936. [JDK 11] MiniDFSClusterManager & MiniHadoopClusterManager compilation fails due to the usage of '_' as identifier. Contributed by Zsolt Venczel.
|
2018-11-15 12:42:31 -08:00 |
|
Inigo Goiri
|
460a94a10f
|
HDFS-14045. Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN. Contributed by Jiandan Yang.
|
2018-11-15 10:58:57 -08:00 |
|
Inigo Goiri
|
993c2140cc
|
HDFS-14054. TestLeaseRecovery2: testHardLeaseRecoveryAfterNameNodeRestart2 and testHardLeaseRecoveryWithRenameAfterNameNodeRestart are flaky. Contributed by Zsolt Venczel.
|
2018-11-15 09:29:14 -08:00 |
Xiao Chen
|
9da6054ca4
|
Revert "HDFS-13732. ECAdmin should print the policy name when an EC policy is set. Contributed by Zsolt Venczel."
This reverts commit 7dc79a8b5b.
|
2018-11-13 12:44:25 -08:00 |
|
Brahma Reddy Battula
|
e7b63baca1
|
HDFS-14070. Refactor NameNodeWebHdfsMethods to allow better extensibility. Contributed by CR Hota
|
2018-11-13 12:45:44 +05:30 |
|
Arpit Agarwal
|
b6d4e19f34
|
HDFS-14065. Failed Storage Locations shows nothing in the Datanode Volume Failures. Contributed by Ayush Saxena.
|
2018-11-12 15:31:42 -08:00 |
|
Kitti Nanasi
|
8d99648c20
|
HDFS-14039. ec -listPolicies doesn't show correct state for the default policy when the default is not RS(6,3). Contributed by Kitti Nanasi.
Signed-off-by: Xiao Chen <xiao@apache.org>
|
2018-11-08 10:01:19 -08:00 |
Jason Lowe
|
0b6625a973
|
MAPREDUCE-7148. Fast fail jobs when exceeds dfs quota limitation. Contributed by Wang Yan
|
2018-11-07 08:20:49 -06:00 |
|
Inigo Goiri
|
887244de4a
|
HDFS-14048. DFSOutputStream close() throws exception on subsequent call after DataNode restart. Contributed by Erik Krogen.
|
2018-11-06 11:18:15 -08:00 |
|
Inigo Goiri
|
f0ce072934
|
HDFS-14051. Refactor NameNodeHttpServer#initWebHdfs to specify local keytab. Contributed by CR Hota.
|
2018-11-06 10:05:58 -08:00 |
|
Daniel Templeton
|
349168c4b3
|
HDFS-14047. [libhdfs++] Fix hdfsGetLastExceptionRootCause bug in test_libhdfs_threaded.c
(Contributed by Antoli Shein via Daniel Templeton)
Change-Id: Ia5546fd5f8270f285c373b9023a9bd9835059845
|
2018-11-06 09:22:27 -08:00 |
|
Akira Ajisaka
|
6430c9890a
|
HADOOP-15904. [JDK 11] Javadoc build failed due to bad use of '>' in hadoop-hdfs.
|
2018-11-06 18:42:38 +09:00 |
|
Xiao Chen
|
ffc9c50e07
|
HDFS-14053. Provide ability for NN to re-replicate based on topology changes. Contributed by Hrishikesh Gadre.
|
2018-11-05 21:38:39 -08:00 |
|
Inigo Goiri
|
f3296501e0
|
HDFS-14043. Tolerate corrupted seen_txid file. Contributed by Lukas Majercak.
|
2018-11-05 16:48:37 -08:00 |
|
Giovanni Matteo Fumarola
|
f3f5e7ad00
|
HDFS-14042. Fix NPE when PROVIDED storage is missing. Contributed by Virajith Jalaparti.
|
2018-11-05 11:02:31 -08:00 |
|
Yiqun Lin
|
4e3df75eb7
|
HDFS-14049. TestHttpFSServerWebServer fails on Windows because of missing winutils.exe. Contributed by Inigo Goiri.
|
2018-11-04 09:15:53 +08:00 |
Siyao Meng
|
8fe85af63b
|
HDFS-13996. Make HttpFS' ACLs RegEx configurable. Contributed by Siyao Meng.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2018-11-01 17:36:50 -07:00 |
Pranay Singh
|
d98b881e9a
|
HDFS-14008. NN should log snapshotdiff report. Contributed by Pranay Singh.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2018-11-01 17:26:00 -07:00 |
Sunil G
|
9c438abe52
|
HDFS-14033. [libhdfs++] Disable libhdfs++ build on systems that do not support thread_local. Contributed by Anatoli Shein.
|
2018-10-31 12:32:49 +05:30 |
|
Akira Ajisaka
|
fac9f91b29
|
HDFS-13942. [JDK10] Fix javadoc errors in hadoop-hdfs module. Contributed by Dinesh Chitlangia.
|
2018-10-31 14:43:58 +09:00 |
|
Xiao Chen
|
db7e636824
|
HDFS-14027. DFSStripedOutputStream should implement both hsync methods.
|
2018-10-29 19:06:15 -07:00 |
Wei-Chiu Chuang
|
63e7134df6
|
Revert "HADOOP-15864. Job submitter / executor fail when SBN domain name can not resolved. Contributed by He Xiaoqiao."
This reverts commit fb2b72e6fc.
|
2018-10-28 17:04:59 -07:00 |
Anu Engineer
|
4f10d7e23f
|
HDFS-14028. HDFS OIV temporary dir deletes folder.
Contributed by Adam Antal.
|
2018-10-26 16:41:23 -07:00 |
|
Inigo Goiri
|
1851d06eb3
|
HDFS-13959. TestUpgradeDomainBlockPlacementPolicy is flaky. Contributed by Ayush Saxena.
|
2018-10-26 09:29:12 -07:00 |
|
Arpit Agarwal
|
9b899f1ebd
|
HDFS-14029. Sleep in TestLazyPersistFiles should be put into a loop. Contributed by Adam Antal.
|
2018-10-25 15:14:13 -07:00 |
|
Wei-Chiu Chuang
|
fb2b72e6fc
|
HADOOP-15864. Job submitter / executor fail when SBN domain name can not resolved. Contributed by He Xiaoqiao.
|
2018-10-25 09:33:31 -07:00 |
Ajay Kumar
|
97bd49fc36
|
HDFS-14026. Overload BlockPoolTokenSecretManager.checkAccess to make storageId and storageType optional. Contributed by Arpit Agarwal.
|
2018-10-24 21:55:42 -07:00 |
|
Inigo Goiri
|
936fc3f3c2
|
HDFS-14025. TestPendingReconstruction.testPendingAndInvalidate fails. Contributed by Ayush Saxena.
|
2018-10-24 16:18:43 -07:00 |
|
Inigo Goiri
|
c1874046e2
|
HDFS-14021. TestReconstructStripedBlocksWithRackAwareness#testReconstructForNotEnoughRacks fails intermittently. Contributed by Xiao Chen.
|
2018-10-24 09:20:38 -07:00 |
|
Chen Liang
|
635786a511
|
HDFS-13566. Add configurable additional RPC listener to NameNode. Contributed by Chen Liang.
|
2018-10-23 14:53:45 -07:00 |
|
Inigo Goiri
|
efdfe679d6
|
HDFS-14004. TestLeaseRecovery2#testCloseWhileRecoverLease fails intermittently in trunk. Contributed by Ayush Saxena.
|
2018-10-23 14:28:37 -07:00 |
|
Arpit Agarwal
|
c58811c77d
|
HDFS-13941. make storageId in BlockPoolTokenSecretManager.checkAccess optional. Contributed by Ajay Kumar.
|
2018-10-22 14:44:28 -07:00 |
|
Inigo Goiri
|
f069d38c8d
|
HDFS-13983. TestOfflineImageViewer crashes in windows. Contributed by Vinayakumar B.
|
2018-10-19 17:16:04 -07:00 |
|
Inigo Goiri
|
88cce32551
|
HDFS-9872. HDFS bytes-default configurations should accept multiple size units. Contributed by Yiqun Lin.
|
2018-10-19 10:38:04 -07:00 |
|
Inigo Goiri
|
8b64fbab1a
|
HDFS-13994. Improve DataNode BlockSender waitForMinLength. Contributed by BELUGA BEHR.
|
2018-10-19 10:36:03 -07:00 |
|
Inigo Goiri
|
be1cffb085
|
HDFS-14002. TestLayoutVersion#testNameNodeFeatureMinimumCompatibleLayoutVersions fails. Contributed by Takanobu Asanuma.
|
2018-10-18 15:25:53 -07:00 |
|
Giovanni Matteo Fumarola
|
098d0b86fe
|
HDFS-14005. RBF: Web UI update to bootstrap-3.3.7. Contributed by Inigo Goiri.
|
2018-10-18 14:25:17 -07:00 |
|
Inigo Goiri
|
0e56c883cd
|
HDFS-14003. Fix findbugs warning in trunk for FSImageFormatPBINode. Contributed by Yiqun Lin.
|
2018-10-18 10:53:30 -07:00 |
|
Inigo Goiri
|
1e78dfca40
|
HDFS-13990. Synchronization Issue With HashResolver. Contributed by BELUGA BEHR.
|
2018-10-18 10:05:27 -07:00 |
|
Inigo Goiri
|
7347fa2df3
|
HDFS-14000. RBF: Documentation should reflect right scripts for v3.0 and above. Contributed by CR Hota.
|
2018-10-17 16:40:25 -07:00 |
|
Xiao Chen
|
533138718c
|
HDFS-13662. TestBlockReaderLocal#testStatisticsForErasureCodingRead is flaky
|
2018-10-16 19:33:55 -07:00 |
|
Inigo Goiri
|
f90c64e624
|
HDFS-13993. TestDataNodeVolumeFailure#testTolerateVolumeFailuresAfterAddingMoreVolumes is flaky. Contributed by Ayush Saxena.
|
2018-10-16 11:22:57 -07:00 |
|
Xiao Chen
|
b6fc72a025
|
HADOOP-14445. Addendum: Use DelegationTokenIssuer to create KMS delegation tokens that can authenticate to all KMS instances.
|
2018-10-15 10:51:55 -07:00 |
|
Inigo Goiri
|
ee1c80ea32
|
HDFS-13987. RBF: Review of RandomResolver Class. Contributed by BELUGA BEHR.
|
2018-10-15 09:51:26 -07:00 |
|
Vinayakumar B
|
b60ca37914
|
Fix potential FSImage corruption. Contributed by Daryn Sharp.
|
2018-10-15 15:48:26 +05:30 |
|
Inigo Goiri
|
f63ee083db
|
HDFS-13802. RBF: Remove FSCK from Router Web UI. Contributed by Fei Hui.
|
2018-10-12 10:10:12 -07:00 |
|
Xiao Chen
|
5ec86b445c
|
HADOOP-14445. Use DelegationTokenIssuer to create KMS delegation tokens that can authenticate to all KMS instances.
Contributed by Daryn Sharp, Xiao Chen, Rushabh S Shah.
|
2018-10-12 09:35:52 -07:00 |
|
Vinayakumar B
|
6e0e6daaf3
|
HDFS-13945. TestDataNodeVolumeFailure is Flaky. Contributed by Ayush Saxena.
|
2018-10-12 17:34:10 +05:30 |
|
Vinayakumar B
|
de44e1064f
|
HDFS-13156. HDFS Block Placement Policy - Client Local Rack. Contributed by Ayush Saxena.
|
2018-10-12 17:27:23 +05:30 |
Shweta
|
c0118105b7
|
HDFS-13973. getErasureCodingPolicy should log path in audit event. Contributed by Shweta.
Signed-off-by: Xiao Chen <xiao@apache.org>
|
2018-10-11 20:39:41 -07:00 |
|
Siyao Meng
|
6dcfef79af
|
HDFS-13878. HttpFS: Implement GETSNAPSHOTTABLEDIRECTORYLIST. Contributed by Siyao Meng.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2018-10-11 15:01:50 -07:00 |
|
Inigo Goiri
|
3532aa3886
|
HDFS-13968. BlockReceiver Array-Based Queue. Contributed by BELUGA BEHR.
|
2018-10-11 13:49:39 -07:00 |
Steve Loughran
|
2addebb94f
|
HDFS-13951. HDFS DelegationTokenFetcher can't print non-HDFS tokens in a tokenfile.
Contributed by Steve Loughran.
|
2018-10-11 20:03:56 +01:00 |
Hrishikesh Gadre
|
bf3d591f0c
|
HDFS-13956. iNotify should include information to identify a file as either replicated or erasure coded. Contributed by Hrishikesh Gadre.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2018-10-10 10:23:07 -07:00 |
|
Weiwei Yang
|
3ead525c71
|
HDFS-12459. Fix revert: Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API. Contributed by Weiwei Yang.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2018-10-10 10:11:10 -07:00 |
|
Kitti Nanasi
|
10185d9a77
|
HDFS-13882. Set a maximum delay for retrying locateFollowingBlock. Contributed by Kitti Nanasi.
Signed-off-by: Xiao Chen <xiao@apache.org>
|
2018-10-10 08:55:32 -07:00 |
Nanda kumar
|
b39b802422
|
HDFS-13949. Correct the description of dfs.datanode.disk.check.timeout in hdfs-default.xml. Contributed by Toshihiro Suzuki.
|
2018-10-10 12:29:07 +05:30 |
|
Akira Ajisaka
|
6fa3feb577
|
HADOOP-15832. Upgrade BouncyCastle to 1.60. Contributed by Robert Kanter.
|
2018-10-10 10:16:57 +09:00 |
|
Inigo Goiri
|
605622c87b
|
HDFS-11396. TestNameNodeMetadataConsistency#testGenerationStampInFuture timed out. Contributed by Ayush Saxena.
|
2018-10-09 17:03:21 -07:00 |
|
Inigo Goiri
|
a05bd1288c
|
HDFS-13979. Review StateStoreFileSystemImpl Class. Contributed by BELUGA BEHR.
|
2018-10-09 12:00:21 -07:00 |
|
Yiqun Lin
|
d4626b4d18
|
HDFS-13967. HDFS Router Quota Class Review. Contributed by BELUGA BEHR.
|
2018-10-09 16:11:07 +08:00 |
|
Hrishikesh Gadre
|
08bb6c49a5
|
HDFS-13926. ThreadLocal aggregations for FileSystem.Statistics are incorrect with striped reads.
Contributed by Xiao Chen, Hrishikesh Gadre.
Signed-off-by: Xiao Chen <xiao@apache.org>
|
2018-10-08 20:31:57 -07:00 |
|
Yiqun Lin
|
1043795f7f
|
HDFS-13962. Add null check for add-replica pool to avoid lock acquiring. Contributed by Surendra Singh Lilhore.
|
2018-10-09 10:33:13 +08:00 |
|
Inigo Goiri
|
3bfff0f79e
|
HDFS-13964. RBF: TestRouterWebHDFSContractAppend fails with No Active Namenode under nameservice. Contributed by Ayush Saxena.
|
2018-10-06 10:40:49 -07:00 |
|
Inigo Goiri
|
73c660b43f
|
HDFS-13958. Miscellaneous Improvements for FsVolumeSpi. Contributed by BELUGA BEHR.
|
2018-10-05 09:32:19 -07:00 |
|
Yiqun Lin
|
619e490333
|
HDFS-13957. Fix incorrect option used in description of InMemoryAliasMap.
|
2018-10-05 09:55:08 +08:00 |
|
Adam Antal
|
cc2babc1f7
|
HDFS-13950. ACL documentation update to indicate that ACL entries are capped by 32. Contributed by Adam Antal.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2018-10-04 15:22:44 -07:00 |
|
Siyao Meng
|
396ce0d9f4
|
HDFS-13877. HttpFS: Implement GETSNAPSHOTDIFF. Contributed by Siyao Meng.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2018-10-04 15:17:47 -07:00 |
|
Inigo Goiri
|
1dc0adfac0
|
HDFS-13947. Review of DirectoryScanner Class. Contributed by BELUGA BEHR.
|
2018-10-03 11:19:57 -07:00 |
|
Akira Ajisaka
|
fa7f7078a7
|
HDFS-13944. [JDK10] Fix javadoc errors in hadoop-hdfs-rbf module. Contributed by Inigo Goiri.
|
2018-10-03 12:48:45 +09:00 |
|
Sunil G
|
58fa96b697
|
Changed version in trunk to 3.3.0-SNAPSHOT.
|
2018-10-02 22:41:41 +05:30 |
|
Yiqun Lin
|
5689355783
|
HDFS-13768. Adding replicas to volume map makes DataNode start slowly. Contributed by Surendra Singh Lilhore.
|
2018-10-02 09:43:14 +08:00 |
Takanobu Asanuma
|
f6c5ef9903
|
HDFS-13943. [JDK10] Fix javadoc errors in hadoop-hdfs-client module. Contributed by Akira Ajisaka.
|
2018-10-02 09:49:48 +09:00 |
|
Takanobu Asanuma
|
e2113500df
|
HDFS-8196. Post enabled Erasure Coding Policies on NameNode UI. Contributed by Kitti Nanasi and Kai Sasaki.
|
2018-09-29 00:53:35 +09:00 |
|
Akira Ajisaka
|
284aca8b63
|
HDFS-13938. Add a missing break in BaseTestHttpFSWith. Contributed by Siyao Meng.
|
2018-09-28 15:44:46 +09:00 |
|
Akira Ajisaka
|
f9c0221623
|
HDFS-13932. [JDK 11] Casts to BlockStoragePolicy[] in unit tests raise ClassCastExceptions. Contributed by Andrew Purtell.
|
2018-09-27 11:44:42 +09:00 |
|
Brahma Reddy Battula
|
e0ff8e2c10
|
HDFS-13840. RBW Blocks which are having less GS should be added to Corrupt. Contributed by Brahma Reddy Battula
|
2018-09-26 23:44:16 +05:30 |
|
Inigo Goiri
|
6275b42870
|
HDFS-13927. Addendum: Improve TestDataNodeMultipleRegistrations#testDNWithInvalidStorageWithHA wait. Contributed by Ayush Saxena.
|
2018-09-26 09:50:09 -07:00 |
|
Siyao Meng
|
8de5c923b4
|
HDFS-13876. HttpFS: Implement ALLOWSNAPSHOT, DISALLOWSNAPSHOT. Contributed by Siyao Meng.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2018-09-24 10:40:30 -07:00 |
|
Inigo Goiri
|
4758b4b6da
|
HDFS-13927. Improve TestDataNodeMultipleRegistrations#testDNWithInvalidStorageWithHA wait. Contributed by Ayush Saxena.
|
2018-09-21 15:32:28 -07:00 |
|
Anu Engineer
|
6fc293fece
|
HDFS-13892. Disk Balancer: Make execute command documentation better.
Contributed by Ranith Sardar.
|
2018-09-19 20:48:41 -07:00 |
|
Arpit Agarwal
|
2eb597b151
|
HADOOP-15772. Remove the 'Path ... should be specified as a URI' warnings on startup. Contributed by Ayush Saxena.
|
2018-09-19 13:48:27 -07:00 |
|
Chen Liang
|
a30b4f9e71
|
HADOOP-15726. Create utility to limit frequency of log statements. Contributed by Erik Krogen.
|
2018-09-19 13:22:37 -07:00 |
|
Inigo Goiri
|
090272d7de
|
HADOOP-15684. triggerActiveLogRoll stuck on dead name node, when ConnectTimeoutException happens. Contributed by Rong Tang.
|
2018-09-19 13:00:30 -07:00 |
|
Inigo Goiri
|
56e0d635e0
|
HDFS-13908. TestDataNodeMultipleRegistrations is flaky. Contributed by Ayush Saxena.
|
2018-09-19 09:30:25 -07:00 |
|
Wei-Chiu Chuang
|
28ceb34a72
|
HDFS-13868. WebHDFS: GETSNAPSHOTDIFF API NPE when param "snapshotname" is given but "oldsnapshotname" is not. Contributed by Pranay Singh.
|
2018-09-19 03:12:20 -07:00 |
|
Shweta
|
27978bcb66
|
HDFS-13833. Improve BlockPlacementPolicyDefault's consider load logic. Contributed by Shweta.
Signed-off-by: Xiao Chen <xiao@apache.org>
|
2018-09-18 20:23:50 -07:00 |
|
Wei-Chiu Chuang
|
44857476fa
|
HDFS-13886. HttpFSFileSystem.getFileStatus() doesn't return "snapshot enabled" bit. Contributed by Siyao Meng.
|
2018-09-18 15:33:02 -07:00 |
Mingliang Liu
|
6ff509c32a
|
HDFS-11719. Arrays.fill() wrong index in BlockSender.readChecksum() exception handling. Contributed by Tao Zhang
|
2018-09-18 10:25:28 -07:00 |
|
Inigo Goiri
|
d1541932db
|
HDFS-13844. Fix the fmt_bytes function in the dfs-dust.js. Contributed by yanghuafeng.
|
2018-09-17 14:42:03 -07:00 |
|
Anu Engineer
|
fdf5a3fd63
|
HDFS-13919. Documentation: Improper formatting in Disk Balancer for Settings.
Contributed by Ayush Saxena.
|
2018-09-17 10:08:23 -07:00 |
|
Wei-Chiu Chuang
|
a1de8cbac5
|
HDFS-13838. WebHdfsFileSystem.getFileStatus() won't return correct "snapshot enabled" status. Contributed by Siyao Meng.
|
2018-09-14 05:22:56 +08:00 |
|
Inigo Goiri
|
e1b242a984
|
HDFS-13914. Fix DN UI logs link broken when https is enabled after HDFS-13902. Contributed by Jianfei Jiang.
|
2018-09-13 09:16:58 -07:00 |
|
Daniel Templeton
|
78bd3b1db9
|
HDFS-13846. Safe blocks counter is not decremented correctly if the block is striped
(Contributed by Kitti Nanasi via Daniel Templeton)
Change-Id: Id41747a67dc946fdf0dbde90643bb1ea7e9e0f70
|
2018-09-12 11:18:55 -07:00 |
|
Brahma Reddy Battula
|
b2432d254c
|
HDFS-13902. Add JMX, conf and stacks menus to the datanode page. Contributed by fengchuang.
|
2018-09-12 06:30:57 +05:30 |
|
Xiao Chen
|
8e54da1511
|
HDFS-13051. Fix dead lock during async editlog rolling if edit queue is full. Contributed by Daryn Sharp.
|
2018-09-10 22:34:23 -07:00 |
|
Brahma Reddy Battula
|
96892c469b
|
HDFS-13237. [Documentation] RBF: Mount points across multiple subclusters. Contributed Íñigo Goiri
|
2018-09-11 10:12:34 +05:30 |
|
Yiqun Lin
|
0da49642fc
|
HDFS-13884. Improve the description of the setting dfs.image.compress. Contributed by Ryan Wu.
|
2018-09-10 13:57:36 +08:00 |
|
Vinayakumar B
|
eef3bafae8
|
HDFS-13895. EC: Fix Intermittent Failure in TestDFSStripedOutputStreamWithFailureWithRandomECPolicy. Contributed by Ayush Saxena.
|
2018-09-10 09:22:59 +05:30 |
|
Vinayakumar B
|
30eceec342
|
HDFS-13806. EC: No error message for unsetting EC policy of the directory inherits the erasure coding policy from an ancestor directory. Contributed by Ayush Saxena.
|
2018-09-10 09:10:51 +05:30 |
|
Brahma Reddy Battula
|
8944407d93
|
HDFS-13862. RBF: Router logs are not capturing few of the dfsrouteradmin commands. Contributed by Ayush Saxena
|
2018-09-09 23:20:26 +05:30 |
|
Hrishikesh Gadre
|
335a8139f5
|
HDFS-13820. Add an ability to disable CacheReplicationMonitor. Contributed by Hrishikesh Gadre.
Signed-off-by: Xiao Chen <xiao@apache.org>
|
2018-09-07 14:59:06 -07:00 |
|
Sean Mackrory
|
410dd3faa5
|
HDFS-13744. OIV tool should better handle control characters present in file or directory names. Contributed by Zsolt Venczel.
|
2018-09-07 12:39:33 -06:00 |
|
Inigo Goiri
|
527288ef89
|
HDFS-13836. RBF: Handle mount table znode with null value. Contributed by yanghuafeng.
|
2018-09-06 16:47:54 -07:00 |
|
Giovanni Matteo Fumarola
|
eca1a4bfe9
|
HDFS-13695. Move logging to slf4j in HDFS package. Contributed by Ian Pickering.
|
2018-09-06 14:48:00 -07:00 |
|
Giovanni Matteo Fumarola
|
9af96d4ed4
|
HADOOP-15707. Add IsActiveServlet to be used for Load Balancers. Contributed by Lukas Majercak.
|
2018-09-05 10:50:25 -07:00 |
|
Wei-Chiu Chuang
|
e780556ae9
|
HADOOP-15696. KMS performance regression due to too many open file descriptors after Jetty migration. Contributed by Wei-Chiu Chuang.
|
2018-09-05 09:52:35 -07:00 |
|
Yiqun Lin
|
9315db5f5d
|
HDFS-13815. RBF: Add check to order command. Contributed by Ranith Sardar.
|
2018-09-05 23:33:27 +08:00 |
|
Hrishikesh Gadre
|
6ccb809c2d
|
HDFS-13812. Fix the inconsistent default refresh interval on Caching documentation. Contributed by Hrishikesh Gadre.
Signed-off-by: Xiao Chen <xiao@apache.org>
|
2018-09-04 21:53:42 -07:00 |
|
Inigo Goiri
|
54f2044595
|
HDFS-13857. RBF: Choose to enable the default nameservice to read/write files. Contributed by yanghuafeng.
|
2018-09-04 12:17:17 -07:00 |
|
Kitti Nanasi
|
6e5ffb74dd
|
HDFS-13885. Add debug logs in dfsclient around decrypting EDEK. Contributed by Kitti Nanasi.
Signed-off-by: Xiao Chen <xiao@apache.org>
|
2018-09-03 22:37:37 -07:00 |
|
Vinayakumar B
|
3801436e49
|
HDFS-13774. EC: 'hdfs ec -getPolicy' is not retrieving policy details when the special REPLICATION policy set on the directory. Contributed by Ayush Saxena.
|
2018-09-03 14:37:57 +05:30 |
|
Vinayakumar B
|
780df9034f
|
HDFS-13867. RBF: Add validation for max arguments for Router admin ls, clrQuota, setQuota, rm and nameservice commands. Contributed by Ayush Saxena.
|
2018-09-03 14:28:31 +05:30 |
|
Wei-Chiu Chuang
|
8aa6c4f079
|
Revert "HDFS-13838. WebHdfsFileSystem.getFileStatus() won't return correct "snapshot enabled" status. Contributed by Siyao Meng."
This reverts commit 26c2a97c56.
|
2018-08-30 11:44:20 -07:00 |
|
Vinayakumar B
|
c36d69a7b3
|
HDFS-13027. Handle possible NPEs due to deleted blocks in race condition. Contributed by Vinayakumar B.
(cherry picked from commit 65977e5d81)
|
2018-08-30 22:15:51 +05:30 |
|
Yiqun Lin
|
582cb10ec7
|
HDFS-13863. FsDatasetImpl should log DiskOutOfSpaceException. Contributed by Fei Hui.
|
2018-08-30 11:21:13 +08:00 |
|
Yiqun Lin
|
a0ebb6b39f
|
HDFS-13634. RBF: Configurable value in xml for async connection request queue size. Contributed by CR Hota.
|
2018-08-29 16:15:22 +08:00 |
|
Brahma Reddy Battula
|
64ad0298d4
|
HDFS-13854. RBF: The ProcessingAvgTime and ProxyAvgTime should display by JMX with ms unit. Contributed by yanghuafeng.
|
2018-08-29 08:29:50 +05:30 |
|
Zsolt Venczel
|
3e18b957eb
|
HDFS-13731. ReencryptionUpdater fails with ConcurrentModificationException during processCheckpoints. Contributed by Zsolt Venczel.
|
2018-08-28 15:13:43 -07:00 |
|
Shweta
|
33f42efc94
|
HDFS-13837. Enable debug log for LeaseRenewer in TestDistributedFileSystem. Contributed by Shweta.
|
2018-08-28 13:56:32 -07:00 |
|
Brahma Reddy Battula
|
cb9d371ae2
|
HDFS-13861. RBF: Illegal Router Admin command leads to printing usage for all commands. Contributed by Ayush Saxena.
|
2018-08-29 00:29:05 +05:30 |
|
Vinayakumar B
|
75691ad600
|
HDFS-13858. RBF: Add check to have single valid argument to safemode command. Contributed by Ayush Saxena.
|
2018-08-28 09:21:07 +05:30 |
|
Wei-Chiu Chuang
|
26c2a97c56
|
HDFS-13838. WebHdfsFileSystem.getFileStatus() won't return correct "snapshot enabled" status. Contributed by Siyao Meng.
|
2018-08-27 16:02:35 -07:00 |
Giovanni Matteo Fumarola
|
7b1fa5693e
|
HDFS-13849. Migrate logging to slf4j in hadoop-hdfs-httpfs, hadoop-hdfs-nfs, hadoop-hdfs-rbf, hadoop-hdfs-native-client. Contributed by Ian Pickering.
|
2018-08-27 10:18:05 -07:00 |
|
Yiqun Lin
|
b9b964d253
|
HDFS-13831. Make block increment deletion number configurable. Contributed by Ryan Wu.
|
2018-08-27 14:55:46 +08:00 |
|
Konstantin V Shvachko
|
a4121c71c2
|
HDFS-13848. Refactor NameNode failover proxy providers. Contributed by Konstantin Shvachko.
|
2018-08-24 18:27:30 -07:00 |
|
Surendra Singh Lilhore
|
96c4575d73
|
HDFS-13805. Journal Nodes should allow to format non-empty directories with -force option. Contributed by Surendra Singh Lilhore.
|
2018-08-24 08:14:57 +05:30 |
|
Yiqun Lin
|
81847392ba
|
HDFS-13821. RBF: Add dfs.federation.router.mount-table.cache.enable so that users can disable cache. Contributed by Fei Hui.
|
2018-08-22 11:43:40 +08:00 |
|
Vinayakumar B
|
770d9d9bb6
|
HDFS-13772. Erasure coding: Unnecessary NameNode Logs displaying for Enabling/Disabling Erasure coding policies which are already enabled/disabled. Contributed by Ayush Saxena
|
2018-08-21 09:33:19 +05:30 |
|
Yiqun Lin
|
01ff817814
|
HDFS-13750. RBF: Router ID in RouterRpcClient is always null. Contributed by Takanobu Asanuma.
|
2018-08-20 23:01:59 +08:00 |
|
Brahma Reddy Battula
|
6425ed27ea
|
HDFS-13790. RBF: Move ClientProtocol APIs to its own module. Contributed by Chao Sun.
|
2018-08-20 12:20:29 +05:30 |
|
Giovanni Matteo Fumarola
|
79c97f6a0b
|
HADOOP-14624. Add GenericTestUtils.DelayAnswer that accept slf4j logger API. Contributed by Ian Pickering and Wenxin He.
|
2018-08-17 14:40:00 -07:00 |
|
Jason Lowe
|
a17eed1b87
|
HDFS-13822. speedup libhdfs++ build (enable parallel build). Contributed by Allen Wittenauer and Pradeep Ambati
|
2018-08-17 12:25:36 -05:00 |
Xiaoyu Yao
|
fb5b3dce61
|
Revert "HDFS-13790. RBF: Move ClientProtocol APIs to its own module. Contributed by Chao Sun."
This reverts commit fa121eb66b.
|
2018-08-17 08:01:44 -07:00 |
|
Brahma Reddy Battula
|
fa121eb66b
|
HDFS-13790. RBF: Move ClientProtocol APIs to its own module. Contributed by Chao Sun.
|
2018-08-17 15:22:55 +05:30 |
Márton Elek
|
77b015000a
|
HADOOP-8807. Update README and website to reflect HADOOP-8662. Contributed by Andras Bokor.
|
2018-08-17 11:10:29 +02:00 |
|
Xiao Chen
|
c67b0650ea
|
HDFS-13747. Statistic for list_located_status is incremented incorrectly by listStatusIterator. Contributed by Antal Mihalyi.
|
2018-08-16 23:14:21 -07:00 |
|
Wei-Chiu Chuang
|
1290e3c647
|
HDFS-10240. Race between close/recoverLease leads to missing block. Contributed by Jinglun, zhouyingchao and Wei-Chiu Chuang.
|
2018-08-16 16:29:38 -07:00 |
|
Daniel Templeton
|
8512e1a91b
|
HDFS-13746. Still occasional "Should be different group" failure in TestRefreshUserMappings#testGroupMappingRefresh
(Contributed by Siyao Meng via Daniel Templeton)
Change-Id: I9fad1537ace38367a463d9fe67aaa28d3178fc69
|
2018-08-16 15:00:45 -07:00 |
|
Yiqun Lin
|
6df606f1b4
|
HDFS-13829. Remove redundant condition judgement in DirectoryScanner#scan. Contributed by liaoyuxiangqin.
|
2018-08-16 18:44:18 +08:00 |
|
Xiao Chen
|
7dc79a8b5b
|
HDFS-13732. ECAdmin should print the policy name when an EC policy is set. Contributed by Zsolt Venczel.
|
2018-08-15 13:53:47 -07:00 |
|
Xiao Chen
|
ef02f9b233
|
HDFS-13217. Audit log all EC policy names during addErasureCodingPolicies. Contributed by liaoyuxiangqin.
|
2018-08-15 09:23:05 -07:00 |
|
Akira Ajisaka
|
3e3963b035
|
HADOOP-15552. Move logging APIs over to slf4j in hadoop-tools - Part2. Contributed by Ian Pickering.
|
2018-08-16 00:31:59 +09:00 |
|
Daniel Templeton
|
4a5006b1d0
|
HDFS-13819. TestDirectoryScanner#testDirectoryScannerInFederatedCluster is flaky
Change-Id: I1cea6e67fcec72702ad202775dee3373261ac5cd
|
2018-08-14 17:22:15 -07:00 |
|
Wei-Chiu Chuang
|
363bd16e31
|
HADOOP-14212. Expose SecurityEnabled boolean field in JMX for other services besides NameNode. Contributed by Adam Antal.
|
2018-08-14 17:19:00 -07:00 |
|
Xiao Chen
|
cede33997f
|
HDFS-13788. Update EC documentation about rack fault tolerance. Contributed by Kitti Nanasi.
|
2018-08-14 11:57:22 -07:00 |
|
Wei-Chiu Chuang
|
61a9b4f58b
|
HDFS-13758. DatanodeManager should throw exception if it has BlockRecoveryCommand but the block is not under construction. Contributed by chencan.
|
2018-08-14 11:51:27 -07:00 |
|
Wei-Chiu Chuang
|
4023eeba05
|
HDFS-13738. fsck -list-corruptfileblocks has infinite loop if user is not privileged. Contributed by Yuen-Kuei Hsueh.
|
2018-08-13 17:36:13 -07:00 |
|
Wei-Chiu Chuang
|
23854443ef
|
HDFS-13813. Exit NameNode if dangling child inode is detected when saving FsImage. Contributed by Siyao Meng.
|
2018-08-13 16:12:37 -07:00 |
|
Arpit Agarwal
|
f760a544a7
|
HDFS-13823. NameNode UI : "Utilities -> Browse the file system -> open a file -> Head the file" is not working. Contributed by Nanda kumar.
|
2018-08-13 11:35:19 -07:00 |
drankye
|
475bff6e8e
|
HDFS-13668. FSPermissionChecker may throws AIOOE when check inode permission. Contributed by He Xiaoqiao.
|
2018-08-13 17:32:56 +08:00 |
Uma Maheswara Rao Gangumalla
|
3ac07b720b
|
HDFS-13808: [SPS]: Remove unwanted FSNamesystem #isFileOpenedForWrite() and #getFileInfo() function. Contributed by Rakesh R.
|
2018-08-12 03:06:07 -07:00 |
Uma Maheswara Rao G
|
39ed3a66db
|
HDFS-13076: [SPS]: Cleanup work for HDFS-10285 merge. Contributed by Rakesh R.
|
2018-08-12 03:06:06 -07:00 |
Rakesh Radhakrishnan
|
dfcb331ba3
|
HDFS-13076: [SPS]: Addendum. Resolve conflicts after rebasing branch to trunk. Contributed by Rakesh R.
|
2018-08-12 03:06:06 -07:00 |
|
Rakesh Radhakrishnan
|
db3f227d8a
|
HDFS-13076: [SPS]: Resolve conflicts after rebasing HDFS-10285 branch to trunk. Contributed by Rakesh R.
|
2018-08-12 03:06:06 -07:00 |
|
Uma Maheswara Rao G
|
66e8f9b315
|
HDFS-13381 : [SPS]: Use DFSUtilClient#makePathFromFileId() to prepare satisfier file path. Contributed by Rakesh R.
|
2018-08-12 03:06:06 -07:00 |
|
Rakesh Radhakrishnan
|
2acc50b826
|
HDFS-13165: [SPS]: Collects successfully moved block details via IBR. Contributed by Rakesh R.
|
2018-08-12 03:06:05 -07:00 |
|
Surendra Singh Lilhore
|
75ccc1396b
|
HDFS-13166: [SPS]: Implement caching mechanism to keep LIVE datanodes to minimize costly getLiveDatanodeStorageReport() calls. Contributed by Rakesh R.
|
2018-08-12 03:06:05 -07:00 |
|
Rakesh Radhakrishnan
|
8467ec24fb
|
HDFS-13110: [SPS]: Reduce the number of APIs in NamenodeProtocol used by external satisfier. Contributed by Rakesh R.
|
2018-08-12 03:06:05 -07:00 |
|
Uma Maheswara Rao G
|
4402f3f855
|
HDFS-13097: [SPS]: Fix the branch review comments(Part1). Contributed by Surendra Singh.
|
2018-08-12 03:06:04 -07:00 |
|
Surendra Singh Lilhore
|
d3de4fb2a0
|
HDFS-13077. [SPS]: Fix review comments of external storage policy satisfier. Contributed by Rakesh R.
|
2018-08-12 03:06:04 -07:00 |
|
Rakesh Radhakrishnan
|
5845c36c16
|
HDFS-13050: [SPS]: Create start/stop script to start external SPS process. Contributed by Surendra Singh Lilhore.
|
2018-08-12 03:06:04 -07:00 |
|
Surendra Singh Lilhore
|
99594b48b8
|
HDFS-13075. [SPS]: Provide External Context implementation. Contributed by Uma Maheswara Rao G.
|
2018-08-12 03:06:04 -07:00 |
|
Uma Maheswara Rao G
|
3b83110d5e
|
HDFS-13057: [SPS]: Revisit configurations to make SPS service modes internal/external/none. Contributed by Rakesh R.
|
2018-08-12 03:06:04 -07:00 |
|
Uma Maheswara Rao G
|
b0cb8d9bb4
|
HDFS-13033: [SPS]: Implement a mechanism to do file block movements for external SPS. Contributed by Rakesh R.
|
2018-08-12 03:06:03 -07:00 |
|
Rakesh Radhakrishnan
|
3159b39cf8
|
HDFS-13025. [SPS]: Implement a mechanism to scan the files for external SPS. Contributed by Uma Maheswara Rao G.
|
2018-08-12 03:06:03 -07:00 |
|
Rakesh Radhakrishnan
|
8d4f74e733
|
HDFS-12911. [SPS]: Modularize the SPS code and expose necessary interfaces for external/internal implementations. Contributed by Uma Maheswara Rao G
|
2018-08-12 03:06:03 -07:00 |
|
Surendra Singh Lilhore
|
05d4daf6ba
|
HDFS-12982 : [SPS]: Reduce the locking and cleanup the Namesystem access. Contributed by Rakesh R.
|
2018-08-12 03:06:02 -07:00 |
|
Uma Maheswara Rao G
|
78420719eb
|
HDFS-12955: [SPS]: Move SPS classes to a separate package. Contributed by Rakesh R.
|
2018-08-12 03:06:02 -07:00 |
|
Surendra Singh Lilhore
|
c561cb316e
|
HDFS-12106: [SPS]: Improve storage policy satisfier configurations. Contributed by Surendra Singh Lilhore.
|
2018-08-12 03:06:02 -07:00 |
|
Rakesh Radhakrishnan
|
9b83f94f35
|
HDFS-12790: [SPS]: Rebasing HDFS-10285 branch after HDFS-10467, HDFS-12599 and HDFS-11968 commits. Contributed by Rakesh R.
|
2018-08-12 03:06:02 -07:00 |
|
Rakesh Radhakrishnan
|
68017e3349
|
HDFS-12310: [SPS]: Provide an option to track the status of in progress requests. Contributed by Surendra Singh Lilhore.
|
2018-08-12 03:06:02 -07:00 |
|
Surendra Singh Lilhore
|
5780f0624d
|
HDFS-12556: [SPS] : Block movement analysis should be done in read lock.
|
2018-08-12 03:06:01 -07:00 |
|
Uma Maheswara Rao G
|
00eceed233
|
HDFS-12570: [SPS]: Refactor Co-ordinator datanode logic to track the block storage movements. Contributed by Rakesh R.
|
2018-08-12 03:06:01 -07:00 |
|
Uma Maheswara Rao G
|
bfd3f8bd8a
|
HDFS-12291: [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir. Contributed by Surendra Singh Lilhore.
|
2018-08-12 03:06:01 -07:00 |
|
Uma Maheswara Rao G
|
7ea24fc06c
|
HDFS-12225: [SPS]: Optimize extended attributes for tracking SPS movements. Contributed by Surendra Singh Lilhore.
|
2018-08-12 03:06:01 -07:00 |
|
Uma Maheswara Rao G
|
0e820f16af
|
HDFS-12214: [SPS]: Fix review comments of StoragePolicySatisfier feature. Contributed by Rakesh R.
|
2018-08-12 03:06:01 -07:00 |
|
Uma Maheswara Rao G
|
3b601f2c0e
|
HDFS-12152: [SPS]: Re-arrange StoragePolicySatisfyWorker stopping sequence to improve thread cleanup time. Contributed by Rakesh R.
|
2018-08-12 03:06:00 -07:00 |
|
Uma Maheswara Rao G
|
4bcf61c696
|
HDFS-12141: [SPS]: Fix checkstyle warnings. Contributed by Rakesh R.
|
2018-08-12 03:06:00 -07:00 |
|
Rakesh Radhakrishnan
|
9e82e5a86e
|
HDFS-12146. [SPS]: Fix TestStoragePolicySatisfierWithStripedFile#testSPSWhenFileHasLowRedundancyBlocks. Contributed by Surendra Singh Lilhore.
|
2018-08-12 03:06:00 -07:00 |
|
Rakesh Radhakrishnan
|
68af4e199a
|
HDFS-11874. [SPS]: Document the SPS feature. Contributed by Uma Maheswara Rao G
|
2018-08-12 03:06:00 -07:00 |
|
Uma Maheswara Rao G
|
5eb24ef7e7
|
HDFS-11264: [SPS]: Double checks to ensure that SPS/Mover are not running together. Contributed by Rakesh R.
|
2018-08-12 03:06:00 -07:00 |
|
Uma Maheswara Rao G
|
0b360b16ab
|
HDFS-11965: [SPS]: Should give chance to satisfy the low redundant blocks before removing the xattr. Contributed by Surendra Singh Lilhore.
|
2018-08-12 03:06:00 -07:00 |
|
Uma Maheswara Rao G
|
00cf207192
|
HDFS-11670: [SPS]: Add CLI command for satisfy storage policy operations. Contributed by Surendra Singh Lilhore.
|
2018-08-12 03:05:59 -07:00 |
|
Rakesh Radhakrishnan
|
46f7523eb8
|
HDFS-11966. [SPS] Correct the log in BlockStorageMovementAttemptedItems#blockStorageMovementResultCheck. Contributed by Surendra Singh Lilhore.
|
2018-08-12 03:05:59 -07:00 |
|
Rakesh Radhakrishnan
|
20f9c62336
|
HDFS-11726. [SPS]: StoragePolicySatisfier should not select same storage type as source and destination in same datanode. Surendra Singh Lilhore.
|
2018-08-12 03:05:59 -07:00 |
|
Rakesh Radhakrishnan
|
d638a7dc03
|
HDFS-11762. [SPS]: Empty files should be ignored in StoragePolicySatisfier. Surendra Singh Lilhore.
|
2018-08-12 03:05:59 -07:00 |
|
Uma Maheswara Rao G
|
e53f89ccc3
|
HDFS-11883: [SPS] : Handle NPE in BlockStorageMovementTracker when dropSPSWork() called. Contributed by Surendra Singh Lilhore.
|
2018-08-12 03:05:59 -07:00 |
|
Uma Maheswara Rao G
|
5ce332dc9a
|
HDFS-11695: [SPS]: Namenode failed to start while loading SPS xAttrs from the edits log. Contributed by Surendra Singh Lilhore.
|
2018-08-12 03:05:59 -07:00 |
|
Rakesh Radhakrishnan
|
6fe6c549e8
|
HDFS-11572. [SPS]: SPS should clean Xattrs when no blocks required to satisfy for a file. Contributed by Uma Maheswara Rao G
|
2018-08-12 03:05:58 -07:00 |
|
Uma Maheswara Rao G
|
695a402fca
|
HDFS-11334: [SPS]: NN switch and rescheduling movements can lead to have more than one coordinator for same file blocks. Contributed by Rakesh R.
|
2018-08-12 03:05:58 -07:00 |
|
Uma Maheswara Rao G
|
11a08a7e8f
|
HDFS-11338: [SPS]: Fix timeout issue in unit tests caused by longger NN down time. Contributed by Wei Zhou and Rakesh R
|
2018-08-12 03:05:58 -07:00 |
|
Uma Maheswara Rao G
|
c00be44463
|
HDFS-11336: [SPS]: Remove xAttrs when movements done or SPS disabled. Contributed by Yuanbo Liu.
|
2018-08-12 03:05:58 -07:00 |
|
Rakesh Radhakrishnan
|
9b15f5418d
|
HDFS-11239: [SPS]: Check Mover file ID lease also to determine whether Mover is running. Contributed by Wei Zhou
|
2018-08-12 03:05:57 -07:00 |
|
Rakesh Radhakrishnan
|
e34331c31d
|
HDFS-11243. [SPS]: Add a protocol command from NN to DN for dropping the SPS work and queues. Contributed by Uma Maheswara Rao G
|
2018-08-12 03:05:57 -07:00 |
|
Rakesh Radhakrishnan
|
f8fc96a66e
|
HDFS-11309. [SPS]: chooseTargetTypeInSameNode should pass accurate block size to chooseStorage4Block while choosing target. Contributed by Uma Maheswara Rao G
|
2018-08-12 03:05:57 -07:00 |
|
Rakesh Radhakrishnan
|
681d2804c9
|
HDFS-11186. [SPS]: Daemon thread of SPS should start only in Active NN. Contributed by Wei Zhou
|
2018-08-12 03:05:57 -07:00 |
|
Uma Maheswara Rao G
|
6215e35bb6
|
HDFS-11150: [SPS]: Provide persistence when satisfying storage policy. Contributed by Yuanbo Liu
|
2018-08-12 03:05:57 -07:00 |
|
Uma Maheswara Rao G
|
df2b551e79
|
HDFS-11293: [SPS]: Local DN should be given preference as source node, when target available in same node. Contributed by Yuanbo Liu and Uma Maheswara Rao G
|
2018-08-12 03:05:56 -07:00 |