drankye
|
475bff6e8e
|
HDFS-13668. FSPermissionChecker may throws AIOOE when check inode permission. Contributed by He Xiaoqiao.
|
2018-08-13 17:32:56 +08:00 |
Uma Maheswara Rao Gangumalla
|
3ac07b720b
|
HDFS-13808: [SPS]: Remove unwanted FSNamesystem #isFileOpenedForWrite() and #getFileInfo() function. Contributed by Rakesh R.
|
2018-08-12 03:06:07 -07:00 |
Uma Maheswara Rao G
|
39ed3a66db
|
HDFS-13076: [SPS]: Cleanup work for HDFS-10285 merge. Contributed by Rakesh R.
|
2018-08-12 03:06:06 -07:00 |
Rakesh Radhakrishnan
|
dfcb331ba3
|
HDFS-13076: [SPS]: Addendum. Resolve conflicts after rebasing branch to trunk. Contributed by Rakesh R.
|
2018-08-12 03:06:06 -07:00 |
|
Rakesh Radhakrishnan
|
db3f227d8a
|
HDFS-13076: [SPS]: Resolve conflicts after rebasing HDFS-10285 branch to trunk. Contributed by Rakesh R.
|
2018-08-12 03:06:06 -07:00 |
|
Uma Maheswara Rao G
|
66e8f9b315
|
HDFS-13381 : [SPS]: Use DFSUtilClient#makePathFromFileId() to prepare satisfier file path. Contributed by Rakesh R.
|
2018-08-12 03:06:06 -07:00 |
|
Rakesh Radhakrishnan
|
2acc50b826
|
HDFS-13165: [SPS]: Collects successfully moved block details via IBR. Contributed by Rakesh R.
|
2018-08-12 03:06:05 -07:00 |
Surendra Singh Lilhore
|
75ccc1396b
|
HDFS-13166: [SPS]: Implement caching mechanism to keep LIVE datanodes to minimize costly getLiveDatanodeStorageReport() calls. Contributed by Rakesh R.
|
2018-08-12 03:06:05 -07:00 |
|
Rakesh Radhakrishnan
|
8467ec24fb
|
HDFS-13110: [SPS]: Reduce the number of APIs in NamenodeProtocol used by external satisfier. Contributed by Rakesh R.
|
2018-08-12 03:06:05 -07:00 |
|
Uma Maheswara Rao G
|
4402f3f855
|
HDFS-13097: [SPS]: Fix the branch review comments(Part1). Contributed by Surendra Singh.
|
2018-08-12 03:06:04 -07:00 |
|
Surendra Singh Lilhore
|
d3de4fb2a0
|
HDFS-13077. [SPS]: Fix review comments of external storage policy satisfier. Contributed by Rakesh R.
|
2018-08-12 03:06:04 -07:00 |
|
Rakesh Radhakrishnan
|
5845c36c16
|
HDFS-13050: [SPS]: Create start/stop script to start external SPS process. Contributed by Surendra Singh Lilhore.
|
2018-08-12 03:06:04 -07:00 |
|
Surendra Singh Lilhore
|
99594b48b8
|
HDFS-13075. [SPS]: Provide External Context implementation. Contributed by Uma Maheswara Rao G.
|
2018-08-12 03:06:04 -07:00 |
|
Uma Maheswara Rao G
|
3b83110d5e
|
HDFS-13057: [SPS]: Revisit configurations to make SPS service modes internal/external/none. Contributed by Rakesh R.
|
2018-08-12 03:06:04 -07:00 |
|
Uma Maheswara Rao G
|
b0cb8d9bb4
|
HDFS-13033: [SPS]: Implement a mechanism to do file block movements for external SPS. Contributed by Rakesh R.
|
2018-08-12 03:06:03 -07:00 |
|
Rakesh Radhakrishnan
|
3159b39cf8
|
HDFS-13025. [SPS]: Implement a mechanism to scan the files for external SPS. Contributed by Uma Maheswara Rao G.
|
2018-08-12 03:06:03 -07:00 |
|
Rakesh Radhakrishnan
|
8d4f74e733
|
HDFS-12911. [SPS]: Modularize the SPS code and expose necessary interfaces for external/internal implementations. Contributed by Uma Maheswara Rao G
|
2018-08-12 03:06:03 -07:00 |
|
Surendra Singh Lilhore
|
05d4daf6ba
|
HDFS-12982 : [SPS]: Reduce the locking and cleanup the Namesystem access. Contributed by Rakesh R.
|
2018-08-12 03:06:02 -07:00 |
|
Uma Maheswara Rao G
|
78420719eb
|
HDFS-12955: [SPS]: Move SPS classes to a separate package. Contributed by Rakesh R.
|
2018-08-12 03:06:02 -07:00 |
|
Surendra Singh Lilhore
|
c561cb316e
|
HDFS-12106: [SPS]: Improve storage policy satisfier configurations. Contributed by Surendra Singh Lilhore.
|
2018-08-12 03:06:02 -07:00 |
|
Rakesh Radhakrishnan
|
9b83f94f35
|
HDFS-12790: [SPS]: Rebasing HDFS-10285 branch after HDFS-10467, HDFS-12599 and HDFS-11968 commits. Contributed by Rakesh R.
|
2018-08-12 03:06:02 -07:00 |
|
Rakesh Radhakrishnan
|
68017e3349
|
HDFS-12310: [SPS]: Provide an option to track the status of in progress requests. Contributed by Surendra Singh Lilhore.
|
2018-08-12 03:06:02 -07:00 |
|
Surendra Singh Lilhore
|
5780f0624d
|
HDFS-12556: [SPS] : Block movement analysis should be done in read lock.
|
2018-08-12 03:06:01 -07:00 |
|
Uma Maheswara Rao G
|
00eceed233
|
HDFS-12570: [SPS]: Refactor Co-ordinator datanode logic to track the block storage movements. Contributed by Rakesh R.
|
2018-08-12 03:06:01 -07:00 |
|
Uma Maheswara Rao G
|
bfd3f8bd8a
|
HDFS-12291: [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir. Contributed by Surendra Singh Lilhore.
|
2018-08-12 03:06:01 -07:00 |
|
Uma Maheswara Rao G
|
7ea24fc06c
|
HDFS-12225: [SPS]: Optimize extended attributes for tracking SPS movements. Contributed by Surendra Singh Lilhore.
|
2018-08-12 03:06:01 -07:00 |
|
Uma Maheswara Rao G
|
0e820f16af
|
HDFS-12214: [SPS]: Fix review comments of StoragePolicySatisfier feature. Contributed by Rakesh R.
|
2018-08-12 03:06:01 -07:00 |
|
Uma Maheswara Rao G
|
3b601f2c0e
|
HDFS-12152: [SPS]: Re-arrange StoragePolicySatisfyWorker stopping sequence to improve thread cleanup time. Contributed by Rakesh R.
|
2018-08-12 03:06:00 -07:00 |
|
Uma Maheswara Rao G
|
4bcf61c696
|
HDFS-12141: [SPS]: Fix checkstyle warnings. Contributed by Rakesh R.
|
2018-08-12 03:06:00 -07:00 |
|
Rakesh Radhakrishnan
|
9e82e5a86e
|
HDFS-12146. [SPS]: Fix TestStoragePolicySatisfierWithStripedFile#testSPSWhenFileHasLowRedundancyBlocks. Contributed by Surendra Singh Lilhore.
|
2018-08-12 03:06:00 -07:00 |
|
Rakesh Radhakrishnan
|
68af4e199a
|
HDFS-11874. [SPS]: Document the SPS feature. Contributed by Uma Maheswara Rao G
|
2018-08-12 03:06:00 -07:00 |
|
Uma Maheswara Rao G
|
5eb24ef7e7
|
HDFS-11264: [SPS]: Double checks to ensure that SPS/Mover are not running together. Contributed by Rakesh R.
|
2018-08-12 03:06:00 -07:00 |
|
Uma Maheswara Rao G
|
0b360b16ab
|
HDFS-11965: [SPS]: Should give chance to satisfy the low redundant blocks before removing the xattr. Contributed by Surendra Singh Lilhore.
|
2018-08-12 03:06:00 -07:00 |
|
Uma Maheswara Rao G
|
00cf207192
|
HDFS-11670: [SPS]: Add CLI command for satisfy storage policy operations. Contributed by Surendra Singh Lilhore.
|
2018-08-12 03:05:59 -07:00 |
|
Rakesh Radhakrishnan
|
46f7523eb8
|
HDFS-11966. [SPS] Correct the log in BlockStorageMovementAttemptedItems#blockStorageMovementResultCheck. Contributed by Surendra Singh Lilhore.
|
2018-08-12 03:05:59 -07:00 |
|
Rakesh Radhakrishnan
|
20f9c62336
|
HDFS-11726. [SPS]: StoragePolicySatisfier should not select same storage type as source and destination in same datanode. Surendra Singh Lilhore.
|
2018-08-12 03:05:59 -07:00 |
|
Rakesh Radhakrishnan
|
d638a7dc03
|
HDFS-11762. [SPS]: Empty files should be ignored in StoragePolicySatisfier. Surendra Singh Lilhore.
|
2018-08-12 03:05:59 -07:00 |
|
Uma Maheswara Rao G
|
e53f89ccc3
|
HDFS-11883: [SPS] : Handle NPE in BlockStorageMovementTracker when dropSPSWork() called. Contributed by Surendra Singh Lilhore.
|
2018-08-12 03:05:59 -07:00 |
|
Uma Maheswara Rao G
|
5ce332dc9a
|
HDFS-11695: [SPS]: Namenode failed to start while loading SPS xAttrs from the edits log. Contributed by Surendra Singh Lilhore.
|
2018-08-12 03:05:59 -07:00 |
|
Rakesh Radhakrishnan
|
6fe6c549e8
|
HDFS-11572. [SPS]: SPS should clean Xattrs when no blocks required to satisfy for a file. Contributed by Uma Maheswara Rao G
|
2018-08-12 03:05:58 -07:00 |
|
Uma Maheswara Rao G
|
695a402fca
|
HDFS-11334: [SPS]: NN switch and rescheduling movements can lead to have more than one coordinator for same file blocks. Contributed by Rakesh R.
|
2018-08-12 03:05:58 -07:00 |
|
Uma Maheswara Rao G
|
11a08a7e8f
|
HDFS-11338: [SPS]: Fix timeout issue in unit tests caused by longger NN down time. Contributed by Wei Zhou and Rakesh R
|
2018-08-12 03:05:58 -07:00 |
|
Uma Maheswara Rao G
|
c00be44463
|
HDFS-11336: [SPS]: Remove xAttrs when movements done or SPS disabled. Contributed by Yuanbo Liu.
|
2018-08-12 03:05:58 -07:00 |
|
Rakesh Radhakrishnan
|
9b15f5418d
|
HDFS-11239: [SPS]: Check Mover file ID lease also to determine whether Mover is running. Contributed by Wei Zhou
|
2018-08-12 03:05:57 -07:00 |
|
Rakesh Radhakrishnan
|
e34331c31d
|
HDFS-11243. [SPS]: Add a protocol command from NN to DN for dropping the SPS work and queues. Contributed by Uma Maheswara Rao G
|
2018-08-12 03:05:57 -07:00 |
|
Rakesh Radhakrishnan
|
f8fc96a66e
|
HDFS-11309. [SPS]: chooseTargetTypeInSameNode should pass accurate block size to chooseStorage4Block while choosing target. Contributed by Uma Maheswara Rao G
|
2018-08-12 03:05:57 -07:00 |
|
Rakesh Radhakrishnan
|
681d2804c9
|
HDFS-11186. [SPS]: Daemon thread of SPS should start only in Active NN. Contributed by Wei Zhou
|
2018-08-12 03:05:57 -07:00 |
|
Uma Maheswara Rao G
|
6215e35bb6
|
HDFS-11150: [SPS]: Provide persistence when satisfying storage policy. Contributed by Yuanbo Liu
|
2018-08-12 03:05:57 -07:00 |
|
Uma Maheswara Rao G
|
df2b551e79
|
HDFS-11293: [SPS]: Local DN should be given preference as source node, when target available in same node. Contributed by Yuanbo Liu and Uma Maheswara Rao G
|
2018-08-12 03:05:56 -07:00 |
|
Rakesh Radhakrishnan
|
422f870607
|
HDFS-11289. [SPS]: Make SPS movement monitor timeouts configurable. Contributed by Uma Maheswara Rao G
|
2018-08-12 03:05:56 -07:00 |
|
Uma Maheswara Rao G
|
81ed364b63
|
HDFS-11193 : [SPS]: Erasure coded files should be considered for satisfying storage policy. Contributed by Rakesh R
|
2018-08-12 03:05:56 -07:00 |
|
Uma Maheswara Rao G
|
b7bed9f00a
|
HDFS-11248: [SPS]: Handle partial block location movements. Contributed by Rakesh R
|
2018-08-12 03:05:55 -07:00 |
|
Uma Maheswara Rao G
|
d81611fe55
|
HDFS-11032: [SPS]: Handling of block movement failure at the coordinator datanode. Contributed by Rakesh R
|
2018-08-12 03:05:55 -07:00 |
|
Rakesh Radhakrishnan
|
5179d99b7e
|
HDFS-11123. [SPS] Make storage policy satisfier daemon work on/off dynamically. Contributed by Uma Maheswara Rao G
|
2018-08-12 03:05:55 -07:00 |
|
Rakesh Radhakrishnan
|
cd5262aba0
|
HDFS-10885. [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on. Contributed by Wei Zhou
|
2018-08-12 03:05:55 -07:00 |
|
Rakesh Radhakrishnan
|
b07291e176
|
HDFS-11151. [SPS]: StoragePolicySatisfier should gracefully handle when there is no target node with the required storage type. Contributed by Rakesh R
|
2018-08-12 03:05:54 -07:00 |
|
Rakesh Radhakrishnan
|
b67ae6d9d7
|
HDFS-10802. [SPS]: Add satisfyStoragePolicy API in HdfsAdmin. Contributed by Yuanbo Liu
|
2018-08-12 03:05:54 -07:00 |
|
Uma Maheswara Rao G
|
19b5aee3e4
|
HDFS-11068: [SPS]: Provide unique trackID to track the block movement sends to coordinator. Contributed by Rakesh R
|
2018-08-12 03:05:54 -07:00 |
|
Rakesh Radhakrishnan
|
047526b4c2
|
HDFS-11029. [SPS]:Provide retry mechanism for the blocks which were failed while moving its storage at DNs. Contributed by Uma Maheswara Rao G
|
2018-08-12 03:05:53 -07:00 |
|
Rakesh Radhakrishnan
|
0f2d1ddc2c
|
HDFS-10954. [SPS]: Provide mechanism to send blocks movement result back to NN from coordinator DN. Contributed by Rakesh R
|
2018-08-12 03:05:53 -07:00 |
|
Uma Maheswara Rao G
|
24add8c2f8
|
HDFS-10884: [SPS]: Add block movement tracker to track the completion of block movement future tasks at DN. Contributed by Rakesh R
|
2018-08-12 03:05:53 -07:00 |
|
Rakesh Radhakrishnan
|
e2a15d18bb
|
HDFS-10801. [SPS]: Protocol buffer changes for sending storage movement commands from NN to DN. Contributed by Rakesh R
|
2018-08-12 03:05:53 -07:00 |
|
Uma Maheswara Rao G
|
1438da4944
|
HDFS-10800: [SPS]: Daemon thread in Namenode to find blocks placed in other storage than what the policy specifies. Contributed by Uma Maheswara Rao G
|
2018-08-12 03:05:53 -07:00 |
Kai Zheng
|
5692887395
|
HDFS-10794. [SPS]: Provide storage policy satisfy worker at DN for co-ordinating the block storage movement work. Contributed by Rakesh R
|
2018-08-12 03:05:52 -07:00 |
Chao Sun
|
a2a8c48699
|
Remove super user privilege requirement for NameNode.getServiceStatus. Contributed by Chao Sun.
|
2018-08-10 15:59:39 -07:00 |
Virajith Jalaparti
|
15241c6349
|
HDFS-13795. Fix potential NPE in InMemoryLevelDBAliasMapServer.
|
2018-08-10 09:38:40 -07:00 |
Chen Liang
|
5326a7906d
|
HDFS-13735. Make QJM HTTP URL connection timeout configurable. Contributed by Chao Sun.
|
2018-08-09 10:11:47 -07:00 |
Wangda Tan
|
49c687608b
|
Make 3.1.1 awared by other branches
|
2018-08-08 13:02:12 -07:00 |
Xiao Chen
|
9499df7b81
|
HDFS-13658. Expose HighestPriorityLowRedundancy blocks statistics. Contributed by Kitti Nanasi.
|
2018-08-08 10:40:20 -07:00 |
Márton Elek
|
36c0d742d4
|
HDFS-13447. Fix Typos - Node Not Chosen. Contributed by Beluga Behr.
|
2018-08-08 17:31:55 +02:00 |
Ewan Higgs
|
2ec97abb2e
|
HADOOP-15576. S3A Multipart Uploader to work with S3Guard and encryption Originally contributed by Ewan Higgs with refinements by Steve Loughran.
|
2018-08-08 13:50:23 +02:00 |
Vinayakumar B
|
4203bc738c
|
HDFS-13785. EC: 'removePolicy' is not working for built-in/system Erasure Code policies. Contributed by Ayush Saxena
|
2018-08-08 12:42:20 +05:30 |
|
Xiao Chen
|
6677717c68
|
HDFS-13728. Disk Balancer should not fail if volume usage is greater than capacity. Contributed by Stephen O'Donnell.
|
2018-08-07 22:05:17 -07:00 |
|
Vinayakumar B
|
2b0f977241
|
HDFS-13786. EC: Display erasure coding policy for sub-directories is not working. Contributed by Ayush Saxena.
|
2018-08-08 07:53:17 +05:30 |
|
Xiao Chen
|
0f8cb127cd
|
HDFS-13799. TestEditLogTailer#testTriggersLogRollsForAllStandbyNN fails due to missing synchronization
between rollEditsRpcExecutor and tailerThread shutdown. Contributed by Hrishikesh Gadre.
|
2018-08-07 16:13:41 -07:00 |
|
Virajith Jalaparti
|
b1a59b1644
|
HDFS-13796. Allow verbosity of InMemoryLevelDBAliasMapServer to be configurable.
|
2018-08-07 10:15:28 -07:00 |
Takanobu Asanuma
|
2b18bb4f37
|
HDFS-11610. sun.net.spi.nameservice.NameService has moved to a new location. Contributed by Akira Ajisaka.
|
2018-08-03 23:38:05 +09:00 |
Aaron Fabbri
|
40f9b0c5c1
|
HDFS-13322 fuse dfs - uid persists when switching between ticket caches. Contributed by Istvan Fajth.
|
2018-07-31 18:44:49 -07:00 |
Brahma Reddy Battula
|
3108d27edd
|
HDFS-12716. 'dfs.datanode.failed.volumes.tolerated' to support minimum number of volumes to be available. Contributed by Ranith Sardar and usharani
|
2018-07-30 15:50:04 +05:30 |
Arpit Agarwal
|
1c40bc2836
|
HDFS-13765. Fix javadoc for FSDirMkdirOp#createParentDirectories. Contributed by Lokesh Jain.
|
2018-07-27 10:14:01 -07:00 |
Anu Engineer
|
64e739e344
|
HDFS-13727. Log full stack trace if DiskBalancer exits with an unhandled exception.
Contributed by Gabor Bota.
|
2018-07-27 06:11:56 -07:00 |
|
Xiao Chen
|
be150a17b1
|
HDFS-13622. mkdir should print the parent directory in the error message when parent directories do not exist. Contributed by Shweta.
|
2018-07-26 10:24:32 -07:00 |
Wei-Chiu Chuang
|
e95c5e9f62
|
HDFS-11060. make DEFAULT_MAX_CORRUPT_FILEBLOCKS_RETURNED configurable. Contributed by Lantao Jin.
|
2018-07-25 11:04:18 -07:00 |
|
Xiao Chen
|
26864471c2
|
HDFS-13761. Add toString Method to AclFeature Class. Contributed by Shweta.
|
2018-07-24 21:42:47 -07:00 |
Daniel Templeton
|
849c45db18
|
HDFS-13448. HDFS Block Placement - Ignore Locality for First Block Replica
(Contributed by BELUGA BEHR via Daniel Templeton)
Change-Id: I965d1cfa642ad24296038b83e3d5c9983545267d
|
2018-07-24 16:05:27 -07:00 |
Yiqun Lin
|
17a87977f2
|
HDFS-13583. RBF: Router admin clrQuota is not synchronized with nameservice. Contributed by Dibyendu Karmakar.
|
2018-07-24 11:15:47 +08:00 |
|
Yiqun Lin
|
7b25fb949b
|
HDFS-13743. RBF: Router throws NullPointerException due to the invalid initialization of MountTableResolver. Contributed by Takanobu Asanuma.
|
2018-07-20 17:28:57 +08:00 |
|
Yiqun Lin
|
1af87df242
|
HDFS-13733. RBF: Add Web UI configurations and descriptions to RBF document. Contributed by Takanobu Asanuma.
|
2018-07-17 10:45:08 +08:00 |
Konstantin V Shvachko
|
0a1e922f3d
|
Fix potential FSImage corruption. Contributed by Ekanth Sethuramalingam & Arpit Agarwal.
|
2018-07-16 18:24:18 -07:00 |
|
Wei-Chiu Chuang
|
88b2794244
|
HDFS-13524. Occasional "All datanodes are bad" error in TestLargeBlock#testLargeBlockSize. Contributed by Siyao Meng.
|
2018-07-16 10:51:23 -07:00 |
Inigo Goiri
|
359ea4e181
|
HDFS-13475. RBF: Admin cannot enforce Router enter SafeMode. Contributed by Chao Sun.
|
2018-07-16 09:46:21 -07:00 |
Akira Ajisaka
|
88625f5cd9
|
HADOOP-15531. Use commons-text instead of commons-lang in some classes to fix deprecation warnings. Contributed by Takanobu Asanuma.
|
2018-07-13 11:42:12 -04:00 |
|
Xiao Chen
|
87eeb26e72
|
HDFS-13663. Should throw exception when incorrect block size is set. Contributed by Shweta.
|
2018-07-12 20:24:11 -07:00 |
|
Xiao Chen
|
b37074be5a
|
HDFS-12837. Intermittent failure in TestReencryptionWithKMS.
|
2018-07-11 21:03:19 -07:00 |
|
Akira Ajisaka
|
418cc7f3ae
|
HDFS-13729. Fix broken links to RBF documentation. Contributed by Gabor Bota.
|
2018-07-11 14:46:43 -04:00 |
|
Wei-Chiu Chuang
|
162228e8db
|
HDFS-13723. Occasional "Should be different group" error in TestRefreshUserMappings#testGroupMappingRefresh. Contributed by Siyao Meng.
|
2018-07-11 10:02:08 -07:00 |
|
Yiqun Lin
|
2ae13d41dc
|
HDFS-13726. RBF: Fix RBF configuration links. Contributed by Takanobu Asanuma.
|
2018-07-11 22:11:59 +08:00 |
Allen Wittenauer
|
5d0f01e1fe
|
HDFS-13722. HDFS Native Client Fails Compilation on Ubuntu 18.04 (contributed by Jack Bearden)
|
2018-07-10 12:17:44 -07:00 |
Bharat Viswanadham
|
c275a9a6a0
|
Merge trunk into HDDS-48
|
2018-07-09 12:13:03 -07:00 |
Andrew Wang
|
eecb5baaaa
|
HDFS-13719. Docs around dfs.image.transfer.timeout are misleading. Contributed by Kitti Nansi.
|
2018-07-09 15:17:21 +02:00 |
|
Yiqun Lin
|
43f7fe8aae
|
HDFS-13710. RBF: setQuota and getQuotaUsage should check the dfs.federation.router.quota.enable. Contributed by yanghuafeng.
|
2018-07-09 15:06:07 +08:00 |
|
Xiao Chen
|
936e0df0d3
|
HDFS-13721. NPE in DataNode due to uninitialized DiskBalancer.
|
2018-07-06 21:00:32 -07:00 |
|
Wei-Chiu Chuang
|
0247cb6318
|
HDFS-13121. NPE when request file descriptors when SC read. Contributed by Zsolt Venczel.
|
2018-07-06 14:59:49 -07:00 |
|
Yiqun Lin
|
3b637155a4
|
HDFS-13528. RBF: If a directory exceeds quota limit then quota usage is not refreshed for other mount entries. Contributed by Dibyendu Karmakar.
|
2018-07-04 15:03:24 +08:00 |
|
Andrew Wang
|
344f324710
|
HDFS-13712. BlockReaderRemote.read() logging improvement. Contributed by Gergo Repas.
|
2018-07-03 11:07:45 +02:00 |
|
Bharat Viswanadham
|
59a3038bc3
|
HDFS-13715:diskbalancer does not work if one of the blockpools are empty on a Federated cluster. Contributed by Bharat Viswanadham
|
2018-07-02 21:43:18 -07:00 |
|
Inigo Goiri
|
7296b644f7
|
HDFS-13714. Fix TestNameNodePrunesMissingStorages test failures on Windows. Contributed by Lukas Majercak.
|
2018-07-02 16:36:25 -07:00 |
|
Inigo Goiri
|
1804a31515
|
HDFS-13536. [PROVIDED Storage] HA for InMemoryAliasMap. Contributed by Virajith Jalaparti.
|
2018-07-02 10:48:20 -07:00 |
|
Wei-Chiu Chuang
|
fef20a446f
|
HDFS-13635. Incorrect message when block is not found. Contributed by Gabor Bota.
|
2018-07-02 09:41:15 -07:00 |
|
Andrew Wang
|
5d748bd056
|
HDFS-13702. Remove HTrace hooks from DFSClient to reduce CPU usage. Contributed by Todd Lipcon.
|
2018-07-02 12:11:06 +02:00 |
|
Andrew Wang
|
6ba9974108
|
HDFS-13703. Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks are hit. Contributed by Todd Lipcon.
|
2018-07-02 12:02:19 +02:00 |
|
Inigo Goiri
|
73746c5da7
|
HDFS-13707. [PROVIDED Storage] Fix failing integration tests in ITestProvidedImplementation. Contributed by Virajith Jalaparti.
|
2018-06-29 09:56:13 -07:00 |
|
Bharat Viswanadham
|
c104525168
|
Merge remote-tracking branch 'apache-commit/trunk' into HDDS-48
|
2018-06-28 14:28:23 -07:00 |
|
Akira Ajisaka
|
2b2399d623
|
HADOOP-15495. Upgrade commons-lang version to 3.7 in hadoop-common-project and hadoop-tools. Contributed by Takanobu Asanuma.
|
2018-06-28 14:37:22 +09:00 |
Todd Lipcon
|
7a3c6e9c3c
|
HADOOP-15550. Avoid static initialization of ObjectMappers
|
2018-06-25 15:36:45 -07:00 |
|
Yiqun Lin
|
30728aced4
|
HDFS-13692. StorageInfoDefragmenter floods log when compacting StorageInfo TreeSet. Contributed by Bharat Viswanadham.
|
2018-06-22 10:50:54 +08:00 |
|
Xiao Chen
|
32f867a6a9
|
HDFS-13682. Cannot create encryption zone after KMS auth token expires.
|
2018-06-20 15:58:26 -07:00 |
|
Akira Ajisaka
|
fba9d7cd74
|
HDFS-13621. Upgrade commons-lang version to 3.7 in hadoop-hdfs-project. Contributed by Takanobu Asanuma.
|
2018-06-18 10:17:07 -07:00 |
Chris Douglas
|
980031bb04
|
HADOOP-13186. Multipart Uploader API. Contributed by Ewan Higgs
|
2018-06-17 11:54:26 -07:00 |
|
Inigo Goiri
|
8762e9cf10
|
HDFS-13681. Fix TestStartup.testNNFailToStartOnReadOnlyNNDir test failure on Windows. Contributed by Xiao Liang.
|
2018-06-15 16:49:06 -07:00 |
|
Inigo Goiri
|
d31a3ce767
|
HDFS-13686. Add overall metrics for FSNamesystemLock. Contributed by Lukas Majercak.
|
2018-06-15 15:59:19 -07:00 |
|
Wei-Chiu Chuang
|
c966a3837a
|
HDFS-13174. hdfs mover -p /path times out after 20 min. Contributed by Istvan Fajth.
|
2018-06-15 13:36:46 -07:00 |
|
Inigo Goiri
|
eebeb6033f
|
HDFS-13676. TestEditLogRace fails on Windows. Contributed by Zuoming Zhang.
|
2018-06-15 13:07:54 -07:00 |
|
Inigo Goiri
|
43d994e4a6
|
HDFS-13673. TestNameNodeMetrics fails on Windows. Contributed by Zuoming Zhang.
|
2018-06-15 10:33:28 -07:00 |
Mukul Kumar Singh
|
3e37a9a70b
|
HDFS-13679. Fix Typo in javadoc for ScanInfoPerBlockPool#addAll. Contributed by Shashikant Banerjee.
|
2018-06-15 14:58:20 +05:30 |
|
Inigo Goiri
|
5d7449d2b8
|
HDFS-13675. Speed up TestDFSAdminWithHA. Contributed by Lukas Majercak.
|
2018-06-14 13:43:14 -07:00 |
|
Inigo Goiri
|
8d4926f38b
|
HDFS-13563. TestDFSAdminWithHA times out on Windows. Contributed by Lukas Majercak.
|
2018-06-14 09:58:50 -07:00 |
|
Arpit Agarwal
|
418cff4820
|
Merge remote-tracking branch 'apache-commit/trunk' into HDDS-48
|
2018-06-14 09:38:20 -07:00 |
|
Yiqun Lin
|
8e7548d33b
|
HDFS-13641. Add metrics for edit log tailing. Contributed by Chao Sun.
|
2018-06-13 20:05:55 +08:00 |
Jitendra Pandey
|
f4c7c91123
|
HADOOP-15483. Upgrade jquery to version 3.3.1. Contributed by Lokesh Jain, Mukul Kumar Singh and Sunil Govindan.
|
2018-06-13 00:36:02 -07:00 |
Rohith Sharma K S
|
2df73dace0
|
YARN-8405. RM zk-state-store.parent-path ACLs has been changed since HADOOP-14773. Contributed by Íñigo Goiri.
|
2018-06-12 17:13:09 +05:30 |
Yongjun Zhang
|
7c3dc39083
|
Update CHANGES, RELEASENOTES, and jdiff for 3.0.3 release.
(cherry picked from commit 5a82f10e32)
|
2018-06-11 15:13:18 -07:00 |
|
Inigo Goiri
|
2e5cfe6df3
|
HDFS-13653. Make dfs.client.failover.random.order a per nameservice configuration. Contributed by Ekanth Sethuramalingam.
|
2018-06-11 11:20:29 -07:00 |
|
Bharat Viswanadham
|
ccfb816d39
|
HDFS-13667:Typo: Marking all datandoes as stale. Contributed by Nanda Kumar
|
2018-06-09 16:43:03 -07:00 |
|
Arpit Agarwal
|
000a678396
|
HDFS-12670. can't renew HDFS tokens with only the hdfs client jar. Contributed by Arpit Agarwal.
|
2018-06-08 17:57:12 -07:00 |
|
Chao Sun
|
fba1c42adc
|
HDFS-13664. Refactor ConfiguredFailoverProxyProvider to make inheritance easier. Contributed by Chao Sun.
|
2018-06-08 16:36:42 -07:00 |
|
Xiao Chen
|
cf4108313d
|
HDFS-13642. Creating a file with block size smaller than EC policy's cell size should fail.
|
2018-06-08 15:14:11 -07:00 |
James Clampffer
|
7969cc4667
|
HDFS-13615. libhdfs++ SaslProtocol hanging while accessing invalid lock. Contributed by Mitchell Tracy
|
2018-06-07 16:02:57 -04:00 |
|
James Clampffer
|
b79ae5d93d
|
HDFS-13534. libhdfs++: Fix GCC7 build. Contributed by James Clampffer.
|
2018-06-07 14:16:17 -04:00 |
|
Wei-Chiu Chuang
|
e39b113db0
|
HDFS-13659. Add more test coverage for contentSummary for snapshottable path. Contributed by Wei-Chiu Chuang.
|
2018-06-07 08:30:06 -07:00 |
|
Brahma Reddy Battula
|
9654dd1f47
|
HDFS-12950. [oiv] ls will fail in secure cluster. Contributed by Wei-Chiu Chuang.
|
2018-06-07 10:16:02 +05:30 |
Hanisha Koneru
|
772c95395b
|
HDDS-140. Add DU usage to VolumeInfo.
|
2018-06-06 16:21:21 -07:00 |
|
Xiao Chen
|
774c1f199e
|
HDFS-13511. Provide specialized exception when block length cannot be obtained. Contributed by Gabor Bota.
|
2018-06-05 21:25:08 -07:00 |
|
Xiao Chen
|
ba4011d64f
|
HADOOP-15217. FsUrlConnection does not handle paths with spaces. Contributed by Joseph Fourny and Zsolt Venczel.
|
2018-06-05 21:18:31 -07:00 |
|
Akira Ajisaka
|
0e3c31579d
|
HDFS-13545. "guarded" is misspelled as "gaurded" in FSPermissionChecker.java. Contributed by Jianchao Jia.
|
2018-06-05 17:53:24 +09:00 |
|
Xiao Chen
|
6d5e87aec2
|
HADOOP-15507. Add MapReduce counters about EC bytes read.
|
2018-06-04 21:13:47 -07:00 |
|
Inigo Goiri
|
8d31ddcfeb
|
HDFS-13650. Randomize baseDir for MiniDFSCluster in TestDFSStripedInputStream and TestDFSStripedInputStreamWithRandomECPolicy. Contributed by Anbang Hu.
|
2018-06-04 18:28:11 -07:00 |
|
Inigo Goiri
|
16316b6011
|
HDFS-13649. Randomize baseDir for MiniDFSCluster in TestReconstructStripedFile and TestReconstructStripedFileWithRandomECPolicy. Contributed by Anbang Hu.
|
2018-06-04 18:21:38 -07:00 |
|
Inigo Goiri
|
a28848104f
|
HDFS-13652. Randomize baseDir for MiniDFSCluster in TestBlockScanner. Contributed by Anbang Hu.
|
2018-06-04 18:12:43 -07:00 |
Rushabh Shah
|
e2289c8d14
|
HDFS-13281 Namenode#createFile should be /.reserved/raw/ aware.. Contributed by Rushabh S Shah
|
2018-06-04 09:19:03 -05:00 |
|
Wei-Chiu Chuang
|
bccdfeee0a
|
HDFS-13155. BlockPlacementPolicyDefault.chooseTargetInOrder Not Checking Return Value for NULL. Contributed by Zsolt Venczel.
|
2018-06-04 07:03:05 -07:00 |
|
Xiao Chen
|
9efb4b7db0
|
HDFS-13339. Volume reference can't be released and may lead to deadlock when DataXceiver does a check volume. Contributed by liaoyuxiangqin and Zsolt Venczel.
|
2018-06-03 22:33:34 -07:00 |
|
Inigo Goiri
|
8f83b9abf9
|
HDFS-13648. Fix TestGetConf#testGetJournalNodes on Windows due to a mismatch line separator. Contributed by Giovanni Matteo Fumarola.
|
2018-06-02 20:19:59 -07:00 |
|
Inigo Goiri
|
e308ac88d3
|
HDFS-13651. TestReencryptionHandler fails on Windows. Contributed by Anbang Hu.
|
2018-06-02 20:12:35 -07:00 |
|
Inigo Goiri
|
e11d674049
|
HDFS-13637. RBF: Router fails when threadIndex (in ConnectionPool) wraps around Integer.MIN_VALUE. Contributed by CR Hota.
|
2018-06-01 16:59:04 -07:00 |
|
Chao Sun
|
ff013d2c95
|
HDFS-13602. Add checkOperation(WRITE) checks in FSNamesystem. Contributed by Chao Sun.
|
2018-05-31 17:37:44 -07:00 |
|
Wei-Chiu Chuang
|
3f4a29813b
|
HDFS-13646. DFSAdmin doesn't display specialized help for triggerBlockReport. Contributed by Takanobu Asanuma.
|
2018-05-31 15:26:08 -07:00 |
|
Wei-Chiu Chuang
|
c95b9b5c07
|
HDFS-13440. Log HDFS file name when client fails to connect. Contributed by Gabor Bota.
|
2018-05-31 15:20:59 -07:00 |
|
Konstantin V Shvachko
|
ebe5853a45
|
HDFS-12978. Fine-grained locking while consuming journal stream. Contributed by Konstantin Shvachko.
|
2018-05-31 14:56:32 -07:00 |
|
Inigo Goiri
|
1f324e9661
|
HDFS-13631. TestDFSAdmin#testCheckNumOfBlocksInReportCommand should use a separate MiniDFSCluster path. Contributed by Anbang Hu.
|
2018-05-31 10:12:38 -07:00 |
Sean Mackrory
|
1361030e59
|
HDFS-13582. Improve backward compatibility for HDFS-13176 (WebHdfs file path gets truncated when having semicolon (;) inside). Contributed by Zsolt Venczel.
|
2018-05-31 07:59:21 -06:00 |
|
Inigo Goiri
|
47c31ff16b
|
HDFS-13629. Some tests in TestDiskBalancerCommand fail on Windows due to MiniDFSCluster path conflict and improper path usage. Contributed by Anbang Hu.
|
2018-05-30 10:22:04 -07:00 |
|
Inigo Goiri
|
8197b9b560
|
HDFS-13632. Randomize baseDir for MiniJournalCluster in MiniQJMHACluster for TestDFSAdminWithHA. Contributed by Anbang Hu.
|
2018-05-30 10:13:52 -07:00 |
|
Yiqun Lin
|
b24098bc8f
|
HDFS-13626. Fix incorrect username when deny the setOwner operation. Contributed by Zsolt Venczel.
|
2018-05-30 16:52:21 +08:00 |
|
Inigo Goiri
|
9dbf4f0166
|
HDFS-13591. TestDFSShell#testSetrepLow fails on Windows. Contributed by Anbang Hu.
|
2018-05-28 16:34:02 -07:00 |
|
Inigo Goiri
|
91d7c74e6a
|
HDFS-13627. TestErasureCodingExerciseAPIs fails on Windows. Contributed by Anbang Hu.
|
2018-05-28 10:26:47 -07:00 |
Takanobu Asanuma
|
04757e5864
|
HDFS-13628. Update Archival Storage doc for Provided Storage
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2018-05-28 19:06:34 +09:00 |
|
Inigo Goiri
|
8605a38514
|
HDFS-13620. Randomize the test directory path for TestHDFSFileSystemContract. Contributed by Anbang Hu.
|
2018-05-25 19:43:33 -07:00 |
|
Inigo Goiri
|
13d2528907
|
HDFS-13619. TestAuditLoggerWithCommands fails on Windows. Contributed by Anbang Hu.
|
2018-05-25 13:32:34 -07:00 |
|
Inigo Goiri
|
1e0d4b1c28
|
HDFS-13618. Fix TestDataNodeFaultInjector test failures on Windows. Contributed by Xiao Liang.
|
2018-05-25 09:14:28 -07:00 |
|
Andrew Wang
|
c9b63deb53
|
HDFS-13611. Unsafe use of Text as a ConcurrentHashMap key in PBHelperClient.
|
2018-05-24 09:56:23 -07:00 |
|
Yiqun Lin
|
7a87add4ea
|
HDFS-13598. Reduce unnecessary byte-to-string transform operation in INodesInPath#toString. Contributed by Gabor Bota.
|
2018-05-24 10:57:35 +08:00 |
|
Inigo Goiri
|
cddbbe5f69
|
HDFS-13493. Reduce the HttpServer2 thread count on DataNodes. Contributed by Erik Krogen.
|
2018-05-23 12:12:08 -07:00 |
|
Inigo Goiri
|
c13dea87d9
|
HDFS-13587. TestQuorumJournalManager fails on Windows. Contributed by Anbang Hu.
|
2018-05-23 11:36:03 -07:00 |
|
Bharat Viswanadham
|
bc6d9d4c79
|
HDFS-13589: Add dfsAdmin command to query if upgrade is finalized. Contributed by Hanisha Koneru
|
2018-05-23 10:15:40 -07:00 |
|
Inigo Goiri
|
c0c9b7a8ef
|
HDFS-13588. Fix TestFsDatasetImpl test failures on Windows. Contributed by Xiao Liang.
|
2018-05-23 09:46:35 -07:00 |
Sammi Chen
|
34e8b9f9a8
|
HDFS-13540. DFSStripedInputStream should only allocate new buffers when reading. Contributed by Xiao Chen.
|
2018-05-23 19:10:09 +08:00 |
|
Andrew Wang
|
1d2640b613
|
HDFS-13601. Optimize ByteString conversions in PBHelper.
|
2018-05-22 23:55:20 -07:00 |
|
Inigo Goiri
|
9775ecb235
|
HDFS-13593. TestBlockReaderLocalLegacy#testBlockReaderLocalLegacyWithAppend fails on Windows. Contributed by Anbang Hu.
|
2018-05-18 09:46:02 -07:00 |
|
Inigo Goiri
|
57b893de3d
|
HDFS-13592. TestNameNodePrunesMissingStorages#testNameNodePrunesUnreportedStorages does not shut down cluster properly. Contributed by Anbang Hu.
|
2018-05-18 09:36:58 -07:00 |
|
Yiqun Lin
|
f749517cc7
|
HDFS-13573. Javadoc for BlockPlacementPolicyDefault is inaccurate. Contributed by Zsolt Venczel.
|
2018-05-18 10:43:53 +08:00 |
|
Inigo Goiri
|
53b807a6a8
|
HDFS-13560. Insufficient system resources exist to complete the requested service for some tests on Windows. Contributed by Anbang Hu.
|
2018-05-17 17:03:23 -07:00 |
|
Inigo Goiri
|
a97a2042f2
|
HDFS-13556. TestNestedEncryptionZones does not shut down cluster. Contributed by Anbang Hu.
|
2018-05-17 16:53:23 -07:00 |
|
Inigo Goiri
|
65476458fa
|
HDFS-13554. TestDatanodeRegistration#testForcedRegistration does not shut down cluster. Contributed by Anbang Hu.
|
2018-05-17 14:48:04 -07:00 |
|
Inigo Goiri
|
26f1e22fc9
|
HDFS-13558. TestDatanodeHttpXFrame does not shut down cluster. Contributed by Anbang Hu.
|
2018-05-17 13:35:09 -07:00 |
|
Inigo Goiri
|
c0ec061e28
|
HDFS-13570. TestQuotaByStorageType,TestQuota,TestDFSOutputStream fail on Windows. Contributed by Anbang Hu.
|
2018-05-17 09:21:57 -07:00 |
Kihwal Lee
|
0ce6290de6
|
HDFS-13581. DN UI logs link is broken when https is enabled. Contributed by Shashikant Banerjee.
|
2018-05-17 09:23:24 -05:00 |
|
Inigo Goiri
|
454de3b543
|
HDFS-13559. TestBlockScanner does not close TestContext properly. Contributed by Anbang Hu.
|
2018-05-16 19:23:02 -07:00 |
|
Arpit Agarwal
|
0fc988e6a3
|
HDFS-13512. WebHdfs getFileStatus doesn't return ecPolicy. Contributed by Ajay Kumar.
|
2018-05-16 11:28:39 -07:00 |
|
Inigo Goiri
|
55d5549087
|
HDFS-13550.TestDebugAdmin#testComputeMetaCommand fails on Windows. Contributed by Anbang Hu.
|
2018-05-16 10:08:49 -07:00 |
|
Inigo Goiri
|
6b67161ca3
|
HDFS-13557. TestDFSAdmin#testListOpenFiles fails on Windows. Contributed by Anbang Hu.
|
2018-05-16 09:31:46 -07:00 |
|
Inigo Goiri
|
63480976a0
|
HDFS-13567. TestNameNodeMetrics#testGenerateEDEKTime,TestNameNodeMetrics#testResourceCheck should use a different cluster basedir. Contributed by Anbang Hu.
|
2018-05-15 15:34:54 -07:00 |
|
Inigo Goiri
|
2d6195c0af
|
HDFS-13548. TestResolveHdfsSymlink#testFcResolveAfs fails on Windows. Contributed by Anbang Hu.
|
2018-05-15 11:20:32 -07:00 |
|
Inigo Goiri
|
eaca7980ad
|
HDFS-11700. TestHDFSServerPorts#testBackupNodePorts doesn't pass on Windows. Contributed by Anbang Hu.
|
2018-05-15 10:27:36 -07:00 |
|
Inigo Goiri
|
92ebd466c7
|
HDFS-13551. TestMiniDFSCluster#testClusterSetStorageCapacity does not shut down cluster. Contributed by Anbang Hu.
|
2018-05-15 10:21:42 -07:00 |
|
Hanisha Koneru
|
6beb25ab7e
|
HDFS-13544. Improve logging for JournalNode in federated cluster.
|
2018-05-14 10:12:08 -07:00 |
|
Xiao Chen
|
960940e0e0
|
HDFS-13539. DFSStripedInputStream NPE when reportCheckSumFailure.
|
2018-05-14 09:28:39 -07:00 |
|
Sammi Chen
|
f3f544b004
|
Add 2.9.1 release notes and changes documents
|
2018-05-14 15:14:02 +08:00 |
|
sammichen
|
66c9905b57
|
Revert "Add 2.9.1 release notes and changes documents"
This reverts commit e4dc346d65.
|
2018-05-14 14:38:40 +08:00 |
littlezhou
|
e4dc346d65
|
Add 2.9.1 release notes and changes documents
|
2018-05-14 14:24:01 +08:00 |