Wei-Chiu Chuang
|
a1de8cbac5
|
HDFS-13838. WebHdfsFileSystem.getFileStatus() won't return correct "snapshot enabled" status. Contributed by Siyao Meng.
|
2018-09-14 05:22:56 +08:00 |
Vinayakumar B
|
30eceec342
|
HDFS-13806. EC: No error message for unsetting EC policy of the directory inherits the erasure coding policy from an ancestor directory. Contributed by Ayush Saxena.
|
2018-09-10 09:10:51 +05:30 |
Giovanni Matteo Fumarola
|
eca1a4bfe9
|
HDFS-13695. Move logging to slf4j in HDFS package. Contributed by Ian Pickering.
|
2018-09-06 14:48:00 -07:00 |
Kitti Nanasi
|
6e5ffb74dd
|
HDFS-13885. Add debug logs in dfsclient around decrypting EDEK. Contributed by Kitti Nanasi.
Signed-off-by: Xiao Chen <xiao@apache.org>
|
2018-09-03 22:37:37 -07:00 |
|
Wei-Chiu Chuang
|
8aa6c4f079
|
Revert "HDFS-13838. WebHdfsFileSystem.getFileStatus() won't return correct "snapshot enabled" status. Contributed by Siyao Meng."
This reverts commit 26c2a97c56.
|
2018-08-30 11:44:20 -07:00 |
|
Wei-Chiu Chuang
|
26c2a97c56
|
HDFS-13838. WebHdfsFileSystem.getFileStatus() won't return correct "snapshot enabled" status. Contributed by Siyao Meng.
|
2018-08-27 16:02:35 -07:00 |
Konstantin V Shvachko
|
a4121c71c2
|
HDFS-13848. Refactor NameNode failover proxy providers. Contributed by Konstantin Shvachko.
|
2018-08-24 18:27:30 -07:00 |
Xiao Chen
|
c67b0650ea
|
HDFS-13747. Statistic for list_located_status is incremented incorrectly by listStatusIterator. Contributed by Antal Mihalyi.
|
2018-08-16 23:14:21 -07:00 |
Uma Maheswara Rao G
|
39ed3a66db
|
HDFS-13076: [SPS]: Cleanup work for HDFS-10285 merge. Contributed by Rakesh R.
|
2018-08-12 03:06:06 -07:00 |
|
Uma Maheswara Rao G
|
4402f3f855
|
HDFS-13097: [SPS]: Fix the branch review comments(Part1). Contributed by Surendra Singh.
|
2018-08-12 03:06:04 -07:00 |
|
Uma Maheswara Rao G
|
3b83110d5e
|
HDFS-13057: [SPS]: Revisit configurations to make SPS service modes internal/external/none. Contributed by Rakesh R.
|
2018-08-12 03:06:04 -07:00 |
Surendra Singh Lilhore
|
c561cb316e
|
HDFS-12106: [SPS]: Improve storage policy satisfier configurations. Contributed by Surendra Singh Lilhore.
|
2018-08-12 03:06:02 -07:00 |
Rakesh Radhakrishnan
|
68017e3349
|
HDFS-12310: [SPS]: Provide an option to track the status of in progress requests. Contributed by Surendra Singh Lilhore.
|
2018-08-12 03:06:02 -07:00 |
|
Uma Maheswara Rao G
|
6215e35bb6
|
HDFS-11150: [SPS]: Provide persistence when satisfying storage policy. Contributed by Yuanbo Liu
|
2018-08-12 03:05:57 -07:00 |
|
Rakesh Radhakrishnan
|
cd5262aba0
|
HDFS-10885. [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on. Contributed by Wei Zhou
|
2018-08-12 03:05:55 -07:00 |
|
Rakesh Radhakrishnan
|
b67ae6d9d7
|
HDFS-10802. [SPS]: Add satisfyStoragePolicy API in HdfsAdmin. Contributed by Yuanbo Liu
|
2018-08-12 03:05:54 -07:00 |
|
Xiao Chen
|
9499df7b81
|
HDFS-13658. Expose HighestPriorityLowRedundancy blocks statistics. Contributed by Kitti Nanasi.
|
2018-08-08 10:40:20 -07:00 |
Daniel Templeton
|
849c45db18
|
HDFS-13448. HDFS Block Placement - Ignore Locality for First Block Replica
(Contributed by BELUGA BEHR via Daniel Templeton)
Change-Id: I965d1cfa642ad24296038b83e3d5c9983545267d
|
2018-07-24 16:05:27 -07:00 |
|
Wei-Chiu Chuang
|
0247cb6318
|
HDFS-13121. NPE when request file descriptors when SC read. Contributed by Zsolt Venczel.
|
2018-07-06 14:59:49 -07:00 |
Andrew Wang
|
344f324710
|
HDFS-13712. BlockReaderRemote.read() logging improvement. Contributed by Gergo Repas.
|
2018-07-03 11:07:45 +02:00 |
Inigo Goiri
|
1804a31515
|
HDFS-13536. [PROVIDED Storage] HA for InMemoryAliasMap. Contributed by Virajith Jalaparti.
|
2018-07-02 10:48:20 -07:00 |
|
Wei-Chiu Chuang
|
fef20a446f
|
HDFS-13635. Incorrect message when block is not found. Contributed by Gabor Bota.
|
2018-07-02 09:41:15 -07:00 |
|
Andrew Wang
|
5d748bd056
|
HDFS-13702. Remove HTrace hooks from DFSClient to reduce CPU usage. Contributed by Todd Lipcon.
|
2018-07-02 12:11:06 +02:00 |
|
Andrew Wang
|
6ba9974108
|
HDFS-13703. Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks are hit. Contributed by Todd Lipcon.
|
2018-07-02 12:02:19 +02:00 |
Todd Lipcon
|
7a3c6e9c3c
|
HADOOP-15550. Avoid static initialization of ObjectMappers
|
2018-06-25 15:36:45 -07:00 |
Akira Ajisaka
|
fba9d7cd74
|
HDFS-13621. Upgrade commons-lang version to 3.7 in hadoop-hdfs-project. Contributed by Takanobu Asanuma.
|
2018-06-18 10:17:07 -07:00 |
Chris Douglas
|
980031bb04
|
HADOOP-13186. Multipart Uploader API. Contributed by Ewan Higgs
|
2018-06-17 11:54:26 -07:00 |
|
Inigo Goiri
|
2e5cfe6df3
|
HDFS-13653. Make dfs.client.failover.random.order a per nameservice configuration. Contributed by Ekanth Sethuramalingam.
|
2018-06-11 11:20:29 -07:00 |
Arpit Agarwal
|
000a678396
|
HDFS-12670. can't renew HDFS tokens with only the hdfs client jar. Contributed by Arpit Agarwal.
|
2018-06-08 17:57:12 -07:00 |
Chao Sun
|
fba1c42adc
|
HDFS-13664. Refactor ConfiguredFailoverProxyProvider to make inheritance easier. Contributed by Chao Sun.
|
2018-06-08 16:36:42 -07:00 |
|
Xiao Chen
|
774c1f199e
|
HDFS-13511. Provide specialized exception when block length cannot be obtained. Contributed by Gabor Bota.
|
2018-06-05 21:25:08 -07:00 |
|
Xiao Chen
|
ba4011d64f
|
HADOOP-15217. FsUrlConnection does not handle paths with spaces. Contributed by Joseph Fourny and Zsolt Venczel.
|
2018-06-05 21:18:31 -07:00 |
|
Xiao Chen
|
6d5e87aec2
|
HADOOP-15507. Add MapReduce counters about EC bytes read.
|
2018-06-04 21:13:47 -07:00 |
|
Wei-Chiu Chuang
|
c95b9b5c07
|
HDFS-13440. Log HDFS file name when client fails to connect. Contributed by Gabor Bota.
|
2018-05-31 15:20:59 -07:00 |
Sean Mackrory
|
1361030e59
|
HDFS-13582. Improve backward compatibility for HDFS-13176 (WebHdfs file path gets truncated when having semicolon (;) inside). Contributed by Zsolt Venczel.
|
2018-05-31 07:59:21 -06:00 |
|
Andrew Wang
|
c9b63deb53
|
HDFS-13611. Unsafe use of Text as a ConcurrentHashMap key in PBHelperClient.
|
2018-05-24 09:56:23 -07:00 |
Bharat Viswanadham
|
bc6d9d4c79
|
HDFS-13589: Add dfsAdmin command to query if upgrade is finalized. Contributed by Hanisha Koneru
|
2018-05-23 10:15:40 -07:00 |
Sammi Chen
|
34e8b9f9a8
|
HDFS-13540. DFSStripedInputStream should only allocate new buffers when reading. Contributed by Xiao Chen.
|
2018-05-23 19:10:09 +08:00 |
|
Andrew Wang
|
1d2640b613
|
HDFS-13601. Optimize ByteString conversions in PBHelper.
|
2018-05-22 23:55:20 -07:00 |
|
Arpit Agarwal
|
0fc988e6a3
|
HDFS-13512. WebHdfs getFileStatus doesn't return ecPolicy. Contributed by Ajay Kumar.
|
2018-05-16 11:28:39 -07:00 |
|
Xiao Chen
|
960940e0e0
|
HDFS-13539. DFSStripedInputStream NPE when reportCheckSumFailure.
|
2018-05-14 09:28:39 -07:00 |
Ewan Higgs
|
84ecfe3ceb
|
HADOOP-14188. Remove the usage of org.mockito.internal.util.reflection.Whitebox
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2018-04-27 19:21:37 +09:00 |
Lei Xu
|
a8e428b2dc
|
HDFS-13468. Add erasure coding metrics into ReadStatistics. (Contributed by Lei (Eddy) Xu)
|
2018-04-26 13:54:40 -07:00 |
Takanobu Asanuma
|
6f655aed3b
|
HADOOP-15404. Remove multibyte characters in DataNodeUsageReportUtil
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2018-04-26 13:54:40 -07:00 |
Nanda kumar
|
0ec88ea42b
|
HDFS-13301. Ozone: Remove containerPort, ratisPort and ozoneRestPort from DatanodeID and DatanodeIDProto. Contributed by Shashikant Banerjee.
|
2018-04-26 05:36:04 -07:00 |
Anu Engineer
|
4e61bc431e
|
HDFS-13258. Ozone: restructure Hdsl/Ozone code to separated maven subprojects.
Contributed by Elek Marton, Mukul Kumar Singh, Xiaoyu Yao, Ajay Kumar, Anu Engineer, Lokesh Jain, Nanda Kumar.
|
2018-04-26 05:36:04 -07:00 |
|
Anu Engineer
|
5e7164c614
|
HDFS-13137. Ozone: Ozonefs read fails because ChunkGroupInputStream#read does not iterate through all the blocks in the key.
Contributed by Mukul Kumar Singh.
|
2018-04-26 05:36:04 -07:00 |
|
Nanda kumar
|
9a914126a7
|
HDFS-13008. Ozone: Add DN container open/close state to container report. Contributed by Xiaoyu Yao.
|
2018-04-26 05:36:04 -07:00 |
|
Nanda kumar
|
b4a3cf1476
|
HDFS-13070. Ozone: SCM: Support for container replica reconciliation - 1. Contributed by Nanda kumar.
|
2018-04-26 05:36:04 -07:00 |
|
Anu Engineer
|
4c10a849e8
|
HDFS-13078. Ozone: Update Ratis on Ozone to 0.1.1-alpha-8fd74ed-SNAPSHOT.
To fix large chunk reads (>4M) from Datanodes. Contributed by Mukul Kumar Singh.
|
2018-04-26 05:36:04 -07:00 |
Mukul Kumar Singh
|
9272e1021d
|
HDFS-12636. Ozone: OzoneFileSystem: Implement seek functionality for rpc client. Contributed by Lokesh Jain.
|
2018-04-26 05:36:04 -07:00 |
|
Mukul Kumar Singh
|
377b31ffa1
|
HDFS-13022. Block Storage: Kubernetes dynamic persistent volume provisioner. Contributed by Elek, Marton.
|
2018-04-26 05:36:04 -07:00 |
|
Anu Engineer
|
ee5495456e
|
HDFS-13116. Ozone: Refactor Pipeline to have transport and container specific information. Contributed by Mukul Kumar Singh.
|
2018-04-26 05:36:04 -07:00 |
|
Anu Engineer
|
3cf07b43bc
|
HDFS-13127. Fix TestContainerStateManager and TestOzoneConfigurationFields. Contributed by Mukul Kumar Singh.
|
2018-04-26 05:36:04 -07:00 |
|
Anu Engineer
|
443425a5d9
|
HDFS-12522. Ozone: Remove the Priority Queues used in the Container State Manager. Contributed by Anu Engineer.
|
2018-04-26 05:36:04 -07:00 |
Xiaoyu Yao
|
6b03fca37d
|
HDFS-12868. Ozone: Service Discovery API. Contributed by Nanda Kumar.
|
2018-04-26 05:36:04 -07:00 |
|
Mukul Kumar Singh
|
fb09d75379
|
HDFS-13018. Block Storage: make the iscsi target addres configurable for discovery. Contributed by Elek, Marton.
|
2018-04-26 05:36:04 -07:00 |
Tsz-Wo Nicholas Sze
|
ba4d5a52a8
|
HDFS-12986. Ozone: Update ozone to latest ratis snapshot build (0.1.1-alpha-0f7169d-SNAPSHOT). Contributed by Lokesh Jain
|
2018-04-26 05:36:04 -07:00 |
|
Mukul Kumar Singh
|
94c0346f35
|
HDFS-13024. Ozone: ContainerStateMachine should synchronize operations between createContainer and writeChunk. Contributed by Mukul Kumar Singh.
|
2018-04-26 05:36:04 -07:00 |
|
Mukul Kumar Singh
|
28b87af51b
|
HDFS-13013. Fix closeContainer API with the right container state change. Contributed by Xiaoyu Yao.
|
2018-04-26 05:36:04 -07:00 |
|
Mukul Kumar Singh
|
98d62e55c4
|
Revert "HDFS-12794. Ozone: Parallelize ChunkOutputSream Writes to container. Contributed by Shashikant Banerjee."
This reverts commit 6ce5ec6761.
|
2018-04-26 05:36:04 -07:00 |
|
Xiaoyu Yao
|
98eeabbdb3
|
HDFS-12794. Ozone: Parallelize ChunkOutputSream Writes to container. Contributed by Shashikant Banerjee.
|
2018-04-26 05:36:04 -07:00 |
|
Xiaoyu Yao
|
98973cd0c4
|
HDFS-12966. Ozone: owner name should be set properly when the container allocation happens. Contributed by Shashikant Banerjee.
|
2018-04-26 05:36:04 -07:00 |
|
Tsz-Wo Nicholas Sze
|
3965f1ec99
|
HDFS-12853. Ozone: Optimize chunk writes for Ratis by avoiding double writes. Contributed by Mukul Kumar Singh
|
2018-04-26 05:36:04 -07:00 |
|
Anu Engineer
|
5766792cad
|
HDFS-12870. Ozone: Service Discovery: REST endpoint in KSM for getServiceList. Contributed by Nanda kumar.
|
2018-04-26 05:36:04 -07:00 |
|
Anu Engineer
|
5f10c2d8ce
|
HDFS-12980. Ozone: SCM: Restructuring container state transition and event. Contributed by Nanda kumar.
|
2018-04-26 05:36:04 -07:00 |
|
Nanda kumar
|
87b7774488
|
HDFS-12958. Ozone: remove setAllocatedBytes method in ContainerInfo. Contributed by Chen Liang.
|
2018-04-26 05:36:04 -07:00 |
|
Nanda kumar
|
ce19f09bd0
|
HDFS-12908. Ozone: write chunk call fails because of Metrics registry exception. Contributed by Mukul Kumar Singh.
|
2018-04-26 05:36:04 -07:00 |
|
Nanda kumar
|
4b9f66a19e
|
HDFS-12869. Ozone: Service Discovery: RPC endpoint in KSM for getServiceList. Contributed by Nanda kumar.
|
2018-04-26 05:36:04 -07:00 |
|
Anu Engineer
|
966853894f
|
HDFS-12795. Ozone: SCM: Support for Container LifeCycleState PENDING_CLOSE and LifeCycleEvent FULL_CONTAINER. Contributed by Nandakumar.
|
2018-04-26 05:36:04 -07:00 |
|
Anu Engineer
|
26e270b908
|
HDFS-12751. Ozone: SCM: update container allocated size to container db for all the open containers in ContainerStateManager#close. Contributed by Chen Liang.
|
2018-04-26 05:36:04 -07:00 |
|
Anu Engineer
|
fd09c2ce5b
|
HDFS-12890 . Ozone: XceiverClient should have upper bound on async requests. Contributed by Shashikant Banerjee.
|
2018-04-26 05:36:04 -07:00 |
|
Anu Engineer
|
2f3068bc72
|
HDFS-12698. Ozone: Use time units in the Ozone configuration values. Contributed by Elek, Marton.
|
2018-04-26 05:36:04 -07:00 |
|
Xiaoyu Yao
|
8ff98e2af3
|
HDFS-12000. Ozone: Container : Add key versioning support-1. Contributed by Chen Liang.
|
2018-04-26 05:36:04 -07:00 |
|
Xiaoyu Yao
|
c0c87dea9b
|
HDFS-12626. Ozone : delete open key entries that will no longer be closed. Contributed by Chen Liang.
|
2018-04-26 05:36:04 -07:00 |
|
Anu Engineer
|
74362cb503
|
HDFS-12901. Ozone: SCM: Expose StorageContainerManager#getScmId through container protocol. Contributed by Nanda kumar.
|
2018-04-26 05:36:04 -07:00 |
|
Nanda kumar
|
7bba3943f0
|
HDFS-12876. Ozone: moving NodeType from OzoneConsts to Ozone.proto. Contributed by Nanda kumar.
|
2018-04-26 05:36:04 -07:00 |
|
Anu Engineer
|
8023ba50b5
|
HDFS-12807. Ozone: Expose RockDB stats via JMX for Ozone metadata stores. Contributed by Elek, Marton.
|
2018-04-26 05:36:04 -07:00 |
|
Tsz-Wo Nicholas Sze
|
86802a461c
|
HDFS-12851. Ozone: Upgrade to latest ratis build. Contributed by Mukul Kumar Singh
|
2018-04-26 05:36:04 -07:00 |
|
Nanda kumar
|
f9c11d952c
|
HDFS-12740. SCM should support a RPC to share the cluster Id with KSM and DataNodes. Contributed by Shashikant Banerjee.
|
2018-04-26 05:36:04 -07:00 |
|
Anu Engineer
|
4460ac9c57
|
HDFS-12756. Ozone: Add datanodeID to heartbeat responses and container protocol. Contributed by Anu Engineer.
|
2018-04-26 05:36:04 -07:00 |
|
Anu Engineer
|
740a06cdd7
|
HDFS-12719. Ozone: Fix checkstyle, javac, whitespace issues in HDFS-7240 branch. Contributed by Mukul Kumar Singh.
|
2018-04-26 05:36:04 -07:00 |
Chen Liang
|
e395244e95
|
HDFS-12758. Ozone: Correcting assertEquals argument order in test cases. Contributed by Bharat Viswanadham.
|
2018-04-26 05:36:04 -07:00 |
|
Xiaoyu Yao
|
cec96b296f
|
HDFS-12549. Ozone: OzoneClient: Support for REST protocol. Contributed by Nanda Kumar.
|
2018-04-26 05:36:04 -07:00 |
|
Nanda kumar
|
9734f505ea
|
HDFS-12739. Add Support for SCM --init command. Contributed by Shashikant Banerjee.
|
2018-04-26 05:36:04 -07:00 |
|
Xiaoyu Yao
|
709d56fdc9
|
HDFS-12474. Ozone: SCM: Handling container report with key count and container usage. Contributed by Nanda kumar.
|
2018-04-26 05:36:04 -07:00 |
|
Xiaoyu Yao
|
2ec24a7542
|
HDFS-12774. Ozone: OzoneClient: Moving OzoneException from hadoop-hdfs to hadoop-hdfs-client. Contributed by Nanda kumar.
|
2018-04-26 05:36:04 -07:00 |
|
Mukul Kumar Singh
|
7ebe79e879
|
HDFS-12720. Ozone: Ratis options are not passed from KSM Client protobuf helper correctly. Contributed by Mukul Kumar Singh.
|
2018-04-26 05:36:04 -07:00 |
|
Anu Engineer
|
76d34bca62
|
HDFS-12521. Ozone: SCM should read all Container info into memory when booting up. Contributed by Lokesh Jain.
|
2018-04-26 05:36:04 -07:00 |
|
Anu Engineer
|
6291ca1e32
|
HDFS-12663. Ozone: OzoneClient: Remove protobuf classes exposed to clients through OzoneBucket. Contributed by Nandakumar.
|
2018-04-26 05:36:04 -07:00 |
|
Anu Engineer
|
1b56a73a4f
|
HDFS-12680. Ozone: SCM: Lease support for container creation. Contributed by Nandakumar.
|
2018-04-26 05:36:04 -07:00 |
|
Xiaoyu Yao
|
a467017068
|
HDFS-12411. Ozone: Add container usage information to DN container report. Contributed by Xiaoyu Yao.
|
2018-04-26 05:36:04 -07:00 |
|
Nanda kumar
|
9bb516118d
|
HDFS-12490. Ozone: OzoneClient: Add creation/modification time information in OzoneVolume/OzoneBucket/OzoneKey. Contributed by Mukul Kumar Singh.
|
2018-04-26 05:36:04 -07:00 |
|
Mukul Kumar Singh
|
c85d3b2d25
|
HDFS-12593. Ozone: update Ratis to the latest snapshot. Contributed by Tsz Wo Nicholas Sze.
|
2018-04-26 05:36:04 -07:00 |
Yiqun Lin
|
d19b4c8763
|
HDFS-12583. Ozone: Fix swallow exceptions which makes hard to debug failures. Contributed by Yiqun Lin.
|
2018-04-26 05:36:04 -07:00 |
|
Tsz-Wo Nicholas Sze
|
e3b51d9074
|
HDFS-12598. Ozone: Fix 3 node ratis replication in Ozone. Contributed by Mukul Kumar Singh
|
2018-04-26 05:36:04 -07:00 |
|
Nandakumar
|
3504af9411
|
HDFS-12537. Ozone: Reduce key creation overhead in Corona. Contributed by Lokesh Jain.
|
2018-04-26 05:36:04 -07:00 |
|
Nandakumar
|
9630621be7
|
HDFS-12610. Ozone: OzoneClient: RpcClient list calls throw NPE when iterating over empty list. Contributed by Nandakumar.
|
2018-04-26 05:36:04 -07:00 |
|
Nandakumar
|
c3ef381011
|
HDFS-12543. Ozone : allow create key without specifying size. Contributed by Chen Liang.
|
2018-04-26 05:36:04 -07:00 |
|
Anu Engineer
|
c17521b1bd
|
HDFS-12387. Ozone: Support Ratis as a first class replication mechanism. Contributed by Anu Engineer.
|
2018-04-26 05:36:04 -07:00 |