Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,161 Commits 326 Branches 371 Tags
3b1c4e4494
Commit Graph

6752 Commits

Author SHA1 Message Date
Xiao Chen
8b2235b367 HDFS-12383. Re-encryption updater should handle canceled tasks better. 2017-09-06 12:14:47 -07:00
Chen Liang
d23e1ed8c4 HDFS-12391. Ozone: TestKSMSQLCli is not working as expected. Contributed by Weiwei Yang. 2017-09-05 11:14:33 -07:00
Anu Engineer
ac5f01c316 Merge branch 'trunk' into HDFS-7240 2017-09-01 12:56:30 -07:00
Andrew Wang
0d419c984f Preparing for 3.1.0 development 2017-09-01 11:53:48 -07:00
Xiao Chen
1b3b9938cf HDFS-12300. Audit-log delegation token related operations. 2017-08-31 23:20:01 -07:00
Mingliang Liu
1fbb662c70 HDFS-12363. Possible NPE in BlockManager$StorageInfoDefragmenter#scanAndCompactStorages. Contributed by Xiao Chen 2017-08-31 22:36:56 -07:00
Anu Engineer
3c8f1c53b2 HDFS-12382. Ozone: SCM: BlockManager creates a new container for each allocateBlock call. Contributed by Nandakumar. 2017-08-31 15:49:29 -07:00
Arpit Agarwal
fd66a243bf HDFS-12356. Unit test for JournalNode sync during Rolling Upgrade. Contributed by Hanisha Koneru. 2017-08-30 10:29:42 -07:00
Rakesh Radhakrishnan
200b11368d HDFS-12258. ec -listPolicies should list all policies in system, no matter it's enabled or disabled. Contributed by Wei Zhou. 2017-08-30 12:58:56 +05:30
Xiao Chen
f3661fd08e HDFS-12336. Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory. Contributed by Wellington Chevreuil. 2017-08-29 21:30:02 -07:00
Yongjun Zhang
cf93d60d3f HDFS-12191. Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done to this file. Contributed by Yongjun Zhang. 2017-08-29 16:57:03 -07:00
Anu Engineer
ea05b4245b HDFS-12333. Ozone: Extend Datanode web interface with SCM information. Contributed by Elek, Marton. 2017-08-29 14:05:28 -07:00
Anu Engineer
6215afcd8c HDFS-12366. Ozone: Refactor KSM metadata class names to avoid confusion. Contributed by Weiwei Yang. 2017-08-29 13:57:51 -07:00
Manoj Govindassamy
63fc1b0b6d HDFS-11912. Snapshot functionality test along with randomized file IO operations. (George Huang via Manoj Govindassamy) 2017-08-29 11:27:47 -07:00
Weiwei Yang
0f60507521 HDFS-12354. Ozone: Shuffle container list for datanode BlockDeletingService. Contributed by Yiqun Lin. 2017-08-29 16:46:17 +08:00
Arpit Agarwal
a1e3f84afe HDFS-12293. DataNode should log file name on disk error. Contributed by Ajay Kumar. 2017-08-28 15:49:59 -07:00
Anu Engineer
b06f4f63e3 HDFS-12361. Ozone: SCM failed to start when a container metadata is empty. Contributed by Weiwei Yang. 2017-08-28 13:20:45 -07:00
Weiwei Yang
76a156ebce HDFS-12282. Ozone: DeleteKey-4: Block delete via HB between SCM and DN. Contributed by Weiwei Yang. 2017-08-28 10:04:46 +08:00
Arpit Agarwal
077a5eed9f HDFS-12358. Handle IOException when transferring edit log to Journal current dir through JN sync. Contributed by Hanisha Koneru. 2017-08-26 22:47:55 -07:00
Brahma Reddy Battula
bb6a3c8330 HDFS-12248. SNN will not upload fsimage on IOE and Interrupted exceptions. (Brahma Reddy Battula) 2017-08-26 13:47:12 +08:00
Manoj Govindassamy
b89ffcff36 HDFS-11986. Dfsadmin should report erasure coding related information separately. 2017-08-25 17:21:56 -07:00
Lei Xu
36bada3032 HDFS-12215. DataNode.transferBlock does not create its daemon in the xceiver thread group. (Lei Xu) 2017-08-25 16:01:14 -07:00
Andrew Wang
f29a0fc288 HDFS-12303. Change default EC cell size to 1MB for better performance. Contributed by Wei Zhou. 2017-08-25 14:14:23 -07:00
Kihwal Lee
8455d70756 HDFS-12299. Race Between update pipeline and DN Re-Registration 2017-08-25 14:49:29 -05:00
Arpit Agarwal
4b2c442d4e HDFS-12319. DirectoryScanner will throw IllegalStateException when Multiple BP's are present. Contributed by Brahma Reddy Battula. 2017-08-25 10:41:52 -07:00
Anu Engineer
1586f20fc5 HDFS-12275. Ozone: Corona: Support for random validation of writes. Contributed by Nandakumar. 2017-08-25 10:09:48 -07:00
Anu Engineer
896414e305 HDFS-12341. Ozone: maven dist compilation fails with "Duplicate classes found" error. Contributed by Mukul Kumar Singh. 2017-08-24 21:03:39 -07:00
Anu Engineer
6564e10d98 HDFS-12280. Ozone: TestOzoneContainer#testCreateOzoneContainer fails. Contributed by Lokesh Jain. 2017-08-24 10:29:38 -07:00
John Zhuge
3123895db0 HDFS-12318. Fix IOException condition for openInfo in DFSInputStream. Contributed by legend. 2017-08-24 00:26:37 -07:00
Weiwei Yang
91ffbaa8b9 HDFS-12283. Ozone: DeleteKey-5: Implement SCM DeletedBlockLog. Contributed by Yuanbo Liu. 2017-08-24 13:46:03 +08:00
Xiao Chen
1000a2af04 HDFS-10899. Add functionality to re-encrypt EDEKs. 2017-08-23 17:06:16 -07:00
Xiaoyu Yao
9c789e883d HDFS-12324. Ozone: TestQueryNode#testStaleNodesCount is failing. Contributed by Xiaoyu Yao. 2017-08-23 13:51:17 -07:00
Xiaoyu Yao
8333602a99 HDFS-11888. Ozone: SCM: use state machine for open containers allocated for key/blocks. Contributed by Xiaoyu Yao. 2017-08-23 12:37:09 -07:00
Anu Engineer
076bd5d64a HDFS-12337. Ozone: Concurrent RocksDB open calls fail because of "No locks available". Contributed by Mukul Kumar Singh. 2017-08-23 10:21:31 -07:00
Weiwei Yang
b1bbd9a030 HDFS-12327. Ozone: support setting timeout in background service. Contributed by Yiqun Lin. 2017-08-23 13:30:02 +08:00
Anu Engineer
d0bd0f6233 Merge branch 'trunk' into HDFS-7240 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/dev-support/findbugsExcludeFile.xml
	hadoop-hdfs-project/hadoop-hdfs/pom.xml
	hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs
	hadoop-project/pom.xml
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/api/impl/TestAMRMClient.java
 2017-08-21 18:57:15 -07:00
John Zhuge
b6bfb2fcb2 HDFS-11738. Hedged pread takes more time when block moved from initial locations. Contributed by Vinayakumar B. 2017-08-21 13:45:30 -07:00
Manoj Govindassamy
913760cb4f HDFS-11988. Verify HDFS Snapshots with open files captured are consistent across truncates and appends to current version file. 2017-08-21 11:08:38 -07:00
Anu Engineer
7d132596da HDFS-12216. Ozone: TestKeys is failing consistently. Contributed by Mukul Kumar Singh. 2017-08-19 00:55:43 -07:00
Anu Engineer
a245c60bb0 HDFS-12159. Ozone: SCM: Add create replication pipeline RPC. Contributed by Anu Engineer. 2017-08-17 19:38:26 -07:00
Manoj Govindassamy
4230872dd6 HDFS-12316. Verify HDFS snapshot deletion doesn't crash the ongoing file writes. 2017-08-17 16:23:48 -07:00
Andrew Wang
b298948897 HDFS-12072. Provide fairness between EC and non-EC recovery tasks. Contributed by Eddy Xu. 2017-08-17 15:26:11 -07:00
Andrew Wang
dd7916d3cd HDFS-12250. Reduce usage of FsPermissionExtension in unit tests. Contributed by Chris Douglas. 2017-08-17 09:35:36 -07:00
Andrew Wang
96b3a6b972 HDFS-11082. Provide replicated EC policy to replicate files. Contributed by SammiChen. 2017-08-16 22:17:06 -07:00
Akira Ajisaka
08aaa4b36f
HDFS-12269. Better to return a Map rather than HashMap in getErasureCodingCodecs. Contributed by Huafeng Wang. 2017-08-17 13:20:27 +09:00
Anu Engineer
8151f26a1f HDFS-12238. Ozone: Add valid trace ID check in sendCommandAsync. Contributed by Ajay Kumar. 2017-08-16 14:24:58 -07:00
Ravi Prakash
f34646d652 HDFS-12301. NN File Browser UI: Navigate to a path when enter is pressed 2017-08-15 15:44:59 -07:00
Chen Liang
63edc5b1e5 HDFS-12290. Block Storage: Change dfs.cblock.jscsi.server.address default bind address to 0.0.0.0. Contributed by Mukul Kumar Singh. 2017-08-15 15:37:17 -07:00
Chen Liang
bfc49a4b2d HDFS-12255. Block Storage: Cblock should generated unique trace ID for the ops. Contributed by Mukul Kumar Singh. 2017-08-15 10:57:11 -07:00
Wei-Chiu Chuang
e3ae3e2644 HDFS-12066. When Namenode is in safemode,may not allowed to remove an user's erasure coding policy. Contributed by lufei. 2017-08-15 07:41:43 -07:00