Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,002 Commits 326 Branches 371 Tags
Commit Graph

6719 Commits

Author SHA1 Message Date
Weiwei Yang
b6bc23d406 HDFS-12002. Ozone : SCM cli misc fixes/improvements. Contributed by Chen Liang. 2017-07-01 15:23:22 +08:00
Anu Engineer
f4af0c91c5 HDFS-11955. Ozone: Set proper parameter default values for listBuckets http request. Contributed by Weiwei Yang. 2017-07-01 00:08:30 -07:00
Anu Engineer
2708e6260d HDFS-11773. Ozone: KSM : add listVolumes. Contributed by Weiwei Yang. 2017-06-30 23:44:15 -07:00
Chen Liang
0e0893930c HDFS-12063. Ozone: Ozone shell: Multiple RPC calls for put/get key. Contributed by Yiqun Lin. 2017-06-30 14:36:26 -07:00
Wei-Chiu Chuang
bcba844d11 HDFS-12042. Lazy initialize AbstractINodeDiffList#diffs for snapshots to reduce memory consumption. Contributed by Misha Dmitriev. 2017-06-30 10:28:01 -07:00
Arpit Agarwal
6a9dc5f44b HDFS-12043. Add counters for block re-replication. Contributed by Chen Liang. 2017-06-30 10:20:12 -07:00
Arpit Agarwal
a2f0cbd92f Revert "HDFS-12043. Add counters for block re-replication. Contributed by Chen Liang." 
Accidentally committed the wrong patch version, reverting to fix that.

This reverts commit 900221f95ea9fe1936b4d5f277e6047ee8734eca.
 2017-06-30 10:19:27 -07:00
Andrew Wang
af2773f609 Updating version for 3.0.0-beta1 development 2017-06-29 17:57:40 -07:00
Arpit Agarwal
900221f95e HDFS-12043. Add counters for block re-replication. Contributed by Chen Liang. 2017-06-29 17:15:13 -07:00
Chen Liang
ba647764f3 HDFS-12050. Ozone: StorageHandler: Implementation of close for releasing resources during shutdown. Contributed by Nandakumar. 2017-06-29 14:43:30 -07:00
Andrew Wang
441378e7e4 Revert "HDFS-11696. Fix warnings from Spotbugs in hadoop-hdfs. Contributed by Yiqun Lin." 
This reverts commit 89a8edc0149e3f31a5ade9a0927c4b6332cf6b1a.

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/DFSAdmin.java
 2017-06-29 13:54:16 -07:00
Wei-Chiu Chuang
16c8dbde57 HDFS-11881. NameNode consumes a lot of memory for snapshot diff report generation. Contributed by Manoj Govindassamy. 2017-06-29 06:38:41 -07:00
Wei-Chiu Chuang
e9d8bdfdf5 HADOOP-14297. Update the documentation about the new ec codecs config keys. Contributed by Kai Sasaki. 2017-06-28 13:53:54 -07:00
Lei Xu
d6df0fdbbd Add -E option in 'ls' to list erasure coding policy of each file and directory if applicable. Contributed by luhuichun via lei. 2017-06-28 13:47:23 -07:00
Wei-Chiu Chuang
f99b6d19de HDFS-11870. Add CLI cmd to enable/disable an erasure code policy. Contributed by lufei. 2017-06-28 10:54:25 -07:00
Weiwei Yang
4c683936e7 HDFS-12031. Ozone: Rename OzoneClient to OzoneRestClient. Contributed by Nandakumar. 2017-06-28 23:57:34 +08:00
Akira Ajisaka
07defa4c09
HDFS-12040. TestFsDatasetImpl.testCleanShutdownOfVolume fails. Contributed by hu xiaodong. 2017-06-27 20:49:26 +09:00
Anu Engineer
8641a2c08b HDFS-12045. Add log when Diskbalancer volume is transient storage type. Contributed by steven-wugang. 2017-06-27 00:39:47 -07:00
Weiwei Yang
f98c3523a2 HDFS-12018. Ozone: Misc: Add CBlocks defaults to ozone-defaults.xml. Contributed by Chen Liang. 2017-06-27 12:55:08 +08:00
Weiwei Yang
102dd20b73 HDFS-12028. Ozone: CLI: remove noisy slf4j binding output from hdfs oz command. Contributed by Chen Liang. 2017-06-27 12:35:16 +08:00
Lei Xu
144753e87f HDFS-12033. DatanodeManager picking EC recovery tasks should also consider the number of regular replication tasks. Contributed by Lei (Eddy) Xu. 2017-06-26 15:43:50 -07:00
Andrew Wang
2c367b464c HDFS-11956. Do not require a storage ID or target storage IDs when writing a block. Contributed by Ewan Higgs. 2017-06-26 11:20:07 -07:00
Andrew Wang
06c8ca3bb3 HDFS-12032. Inaccurate comment on DatanodeDescriptor#getNumberOfBlocksToBeErasureCoded. 2017-06-26 10:54:01 -07:00
Anu Engineer
31eafb15bc HDFS-12007. Ozone: Enable HttpServer2 for SCM and KSM. Contributed by Elek, Marton. 2017-06-24 00:44:32 -07:00
Xiaoyu Yao
29c942b225 HDFS-12016. Ozone: SCM: Container metadata are not loaded properly after datanode restart. Contributed by Xiaoyu Yao. 2017-06-23 14:32:05 -07:00
Brahma Reddy Battula
abdea26280 HDFS-12024. Fix typo's in FsDatasetImpl.java. Contributed by Yasen liu. 2017-06-23 22:56:28 +08:00
Anu Engineer
c395bc8faa HDFS-11990. Ozone: Add all configurable entries into ozone-default.xml. Contributed by Yiqun Lin. 2017-06-22 23:04:07 -07:00
Xiao Chen
68dc7c2405 HDFS-12009. Accept human-friendly units in dfsadmin -setBalancerBandwidth and -setQuota. Contributed by Andrew Wang. 2017-06-22 19:57:54 -07:00
Arpit Agarwal
6d116ffad2 HDFS-11789. Maintain Short-Circuit Read Statistics. Contributed by Hanisha Koneru. 2017-06-22 13:35:56 -07:00
Vinayakumar B
8dbd53ef9f HDFS-11067. DFS#listStatusIterator(..) should throw FileNotFoundException if the directory deleted before fetching next batch of entries. Contributed by Vinayakumar B. 2017-06-22 17:37:08 +05:30
Arpit Agarwal
9ae9467f92 HDFS-11998. Enable DFSNetworkTopology as default. Contributed by Chen Liang. 2017-06-21 22:01:41 -07:00
Anu Engineer
c77d7f9047 HDFS-11970. Ozone: TestXceiverClientManager.testFreeByEviction fails occasionally. Contributed by Mukul Kumar Singh. 2017-06-21 18:01:58 -07:00
Zhe Zhang
c22cf00442 Confusion/name conflict between NameNodeActivity#BlockReportNumOps and RpcDetailedActivity#BlockReportNumOps. Contributed by Erik Krogen. 2017-06-21 16:34:19 -07:00
Kai Zheng
5db3f98468 HDFS-11606. Add CLI cmd to remove an erasure code policy. Contributed by Tim Yao 2017-06-21 14:01:55 +08:00
Yiqun Lin
b9a6441e1b HDFS-11963. Ozone: Documentation: Add getting started page (addendum). Contributed by Yiqun Lin. 2017-06-21 10:32:35 +08:00
Yiqun Lin
66552374e1 HDFS-11983. Ozone: Add documentation for metrics in KSMMetrics to OzoneMetrics.md. Contributed by Yiqun Lin. 2017-06-21 10:27:01 +08:00
Akira Ajisaka
1a598479a9
HDFS-11992. Replace commons-logging APIs with slf4j in FsDatasetImpl. Contributed by hu xiaodong. 2017-06-21 11:19:48 +09:00
Anu Engineer
14a94e7a4f HDFS-11999. Ozone: Clarify startup error message of Datanode in case namenode is missing. Contributed by Marton Elek. 2017-06-20 16:37:03 -07:00
Lei Xu
45ff4d38e6 HDFS-11647. Add -E option in hdfs "count" command to show erasure policy summarization. Contributed by luhuichun. 2017-06-20 11:55:09 -07:00
Anu Engineer
185e3ad744 HDFS-11585. Ozone: Support force update a container. Contributed by Yuanbo Liu. 2017-06-20 11:13:12 -07:00
Wei-Chiu Chuang
2b654a493c HDFS-11978. Remove invalid '-usage' command of 'ec' and add missing commands 'addPolicies' 'listCodecs' in doc. Contributed by wenxin he. 2017-06-20 09:36:55 -07:00
Kihwal Lee
8c0769dee4 HDFS-11960. Successfully closed files can stay under-replicated. Contributed by Kihwal Lee. 2017-06-20 09:11:23 -05:00
Brahma Reddy Battula
2e9daa2e27 HADOOP-14533. Size of args cannot be less than zero in TraceAdmin#run as its linkedlist. Contributed by Weisen Han. 2017-06-20 20:44:31 +08:00
Akira Ajisaka
2c769167db
HDFS-11345. Document the configuration key for FSNamesystem lock fairness. Contributed by Erik Krogen. 2017-06-20 16:35:54 +09:00
Anu Engineer
f8110c3e6e HDFS-11963. Ozone: Documentation: Add getting started page. Contributed by Anu Engineer. 2017-06-19 21:29:18 -07:00
Brahma Reddy Battula
099cbb427a HDFS-11890. Handle NPE in BlockRecoveryWorker when DN is getting shoutdown. Contributed by Surendra Singh Lilhore. 2017-06-20 11:03:56 +08:00
Masatake Iwasaki
d954a64730 HDFS-11995. HDFS Architecture documentation incorrectly describes writing to a local temporary file. Contributed by Nandakumar. 2017-06-20 08:07:42 +09:00
Xiaoyu Yao
0f671caf8d HDFS-11782. Ozone: KSM: Add listKey. Contributed by Yiqun Lin. 2017-06-19 15:55:58 -07:00
Lei Xu
73fb75017e HDFS-11916. Extend TestErasureCodingPolicies/TestErasureCodingPolicyWithSnapshot with a random EC policy. Contributed by Takanobu Asanuma. 2017-06-19 10:25:20 -07:00
Lei Xu
6460df21a0 HADOOP-14395. Provide Builder pattern for DistributedFileSystem.append. Contributed by Lei (Eddy) Xu. 2017-06-16 17:24:00 -07:00