Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,493 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

2850 Commits

Author SHA1 Message Date
Andrew Wang b1e059089d HDFS-7979. Initialize block report IDs with a random number. 2015-04-08 21:43:42 -07:00
Haohui Mai cc25823546 HDFS-8089. Move o.a.h.hdfs.web.resources.* to the client jars. Contributed by Haohui Mai. 2015-04-08 16:30:08 -07:00
Andrew Wang 5a540c3d31 HDFS-8025. Addendum fix for HDFS-3087 Decomissioning on NN restart can complete without blocks being replicated. Contributed by Ming Ma. 2015-04-08 16:09:17 -07:00
Haohui Mai 82d56b337d Revert HDFS-7813. 2015-04-08 16:02:45 -07:00
Haohui Mai bd4c99bece Revert HDFS-7808. 2015-04-08 15:59:55 -07:00
Andrew Wang 6af0d74a75 HDFS-7725. Incorrect 'nodes in service' metrics caused all writes to fail. Contributed by Ming Ma. 2015-04-08 15:52:06 -07:00
Andrew Wang a42bb1cd91 HDFS-8076. Code cleanup for DFSInputStream: use offset instead of LocatedBlock when possible. Contributed by Zhe Zhang. 2015-04-08 15:41:48 -07:00
Kihwal Lee 285b31e75e HDFS-8046. Allow better control of getContentSummary. Contributed by Kihwal Lee. 2015-04-08 15:38:29 -05:00
Tsz-Wo Nicholas Sze c931a3c776 HDFS-8079. Move CorruptFileBlockIterator to a new hdfs.client.impl package. 2015-04-08 11:50:52 -07:00
Arpit Agarwal 608c499841 HDFS-8072. Reserved RBW space is not released if client terminates while writing block. (Arpit Agarwal) 2015-04-08 11:38:21 -07:00
Haohui Mai ab04ff9efe HDFS-8080. Separate JSON related routines used by WebHdfsFileSystem to a package local class. Contributed by Haohui Mai. 2015-04-07 21:30:57 -07:00
Vinayakumar B d505c8acd3 HDFS-8073. Split BlockPlacementPolicyDefault.chooseTarget(..) so it can be easily overrided. (Contributed by Walter Su) 2015-04-08 09:56:37 +05:30
Tsz-Wo Nicholas Sze 4be648b55c HDFS-8079. Move dfs.client.retry.* confs from DFSConfigKeys to HdfsClientConfigKeys.Retry. 2015-04-07 19:48:57 -07:00
Yongjun Zhang 66763bb06f HDFS-5215. dfs.datanode.du.reserved is not considered while computing 
available space ( Brahma Reddy Battula via Yongjun Zhang)
 2015-04-07 19:31:58 -07:00
cnauroth 1e72d98c69 HDFS-8038. PBImageDelimitedTextWriter#getEntry output HDFS path in platform-specific format. Contributed by Xiaoyu Yao. 2015-04-07 14:23:01 -07:00
Tsz-Wo Nicholas Sze 571a1ce9d0 HDFS-8049. Add @InterfaceAudience.Private annotation to hdfs client implementation. Contributed by Takuya Fukudome 2015-04-07 13:59:48 -07:00
Konstantin V Shvachko 75c5454860 HDFS-8071. Redundant checkFileProgress() in PART II of getAdditionalBlock(). Contributed by Konstantin Shvachko. 2015-04-06 22:20:44 -07:00
Colin Patrick Mccabe 28bebc81db HDFS-7999. FsDatasetImpl#createTemporary sometimes holds the FSDatasetImpl lock for a very long time (sinago via cmccabe) 2015-04-06 08:56:52 -07:00
Colin Patrick Mccabe ef591b1d6a HDFS-8051. FsVolumeList#addVolume should release volume reference if not put it into BlockScanner. (Lei (Eddy) Xu via Colin P. McCabe) 2015-04-03 16:34:23 -07:00
Colin Patrick Mccabe 023133cef9 HDFS-7996. After swapping a volume, BlockReceiver reports ReplicaNotFoundException (Lei (Eddy) Xu via Colin P. McCabe) 2015-04-03 14:19:46 -07:00
cnauroth db80e42891 HDFS-8039. Fix TestDebugAdmin#testRecoverLease and testVerfiyBlockChecksumCommand on Windows. Contributed by Xiaoyu Yao. 2015-04-03 10:44:02 -07:00
cnauroth dc5596c36a HDFS-8034. Fix TestDFSClientRetries#testDFSClientConfigurationLocateFollowingBlockInitialDelay for Windows. Contributed by Xiaoyu Yao. 2015-04-03 10:10:11 -07:00
Jing Zhao 72f6bd4893 HDFS-7811. Avoid recursive call getStoragePolicyID in INodeFile#computeQuotaUsage. Contributed by Xiaoyu Yao and Jing Zhao. 2015-04-02 21:20:30 -07:00
Tsz-Wo Nicholas Sze 4f412f487c HDFS-7954. TestBalancer#testBalancerWithPinnedBlocks should not be executed on Windows. Contributed by Xiaoyu Yao 2015-04-02 11:11:34 -07:00
Tsz-Wo Nicholas Sze 9ed43f2189 HDFS-7888. Change DFSOutputStream and DataStreamer for convenience of subclassing. Contributed by Li Bo 2015-04-02 10:59:26 -07:00
Vinayakumar B 867d5d2675 HDFS-7916. 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop (Contributed by Vinayakumar B) 2015-04-02 08:12:00 +05:30
Brandon Li 4d14816c26 HDFS-8001 RpcProgramNfs3 : wrong parsing of dfs.blocksize. Contributed by Remi Catherinot 2015-04-01 17:20:24 -07:00
Haohui Mai 6ccf4fbf8a HDFS-8008. Support client-side back off when the datanodes are congested. Contributed by Haohui Mai. 2015-04-01 16:54:46 -07:00
Haohui Mai 75cb1d42ab HDFS-8036. Use snapshot path as source when using snapshot diff report in DistCp. Contributed by Jing Zhao. 2015-04-01 16:50:59 -07:00
Colin Patrick Mccabe 3c7adaaf35 HDFS-7922. ShortCircuitCache#close is not releasing ScheduledThreadPoolExecutors (Rakesh R via Colin P. McCabe) 2015-04-01 16:02:39 -07:00
Colin Patrick Mccabe c94d594a57 HDFS-8026. Trace FSOutputSummer#writeChecksumChunks rather than DFSOutputStream#writeChunk (cmccabe) 2015-04-01 14:10:10 -07:00
Andrew Wang ed72daa5df HDFS-7978. Add LOG.isDebugEnabled() guard for some LOG.debug(..). Contributed by Walter Su. 2015-04-01 12:54:28 -07:00
Haohui Mai 53471d462c HDFS-8009. Signal congestion on the DataNode. Contributed by Haohui Mai. 2015-04-01 10:56:53 -07:00
Akira Ajisaka 18a91fe4df HDFS-6945. BlockManager should remove a block from excessReplicateMap and decrement ExcessBlocks metric when the block is removed. (aajisaka) 2015-04-01 09:07:28 +09:00
Akira Ajisaka 859cab2f22 HDFS-7671. hdfs user guide should point to the common rack awareness doc. Contributed by Kai Sasaki. 2015-04-01 00:26:16 +09:00
yliu 3df61f303a HDFS-7997. The first non-existing xattr should also throw IOException. (zhouyingchao via yliu) 2015-03-31 21:17:44 +08:00
Arpit Agarwal 85dc3c14b2 HDFS-7944. Minor cleanup of BlockPoolManager#getAllNamenodeThreads. (Arpit Agarwal) 2015-03-30 21:24:51 -07:00
Harsh J cce66ba3c9 HDFS-3918. EditLogTailer shouldn't log WARN when other node is in standby mode. Contributed by Todd Lipcon. 2015-03-31 08:04:18 +05:30
Arpit Agarwal 1a495fbb48 HDFS-7645. Rolling upgrade is restoring blocks from trash multiple times (Contributed by Vinayakumar B and Keisuke Ogiwara) 2015-03-30 15:25:16 -07:00
Haohui Mai b80457158d HDFS-7748. Separate ECN flags from the Status in the DataTransferPipelineAck. Contributed by Anu Engineer and Haohui Mai. 2015-03-30 11:59:21 -07:00
Colin Patrick Mccabe 1feb9569f3 HDFS-7261. storageMap is accessed without synchronization in DatanodeDescriptor#updateHeartbeatState() (Brahma Reddy Battula via Colin P. McCabe) 2015-03-30 10:46:21 -07:00
Akira Ajisaka e7ea2a8e8f HDFS-8002. Website refers to /trash directory. Contributd by Brahma Reddy Battula. 2015-03-31 00:27:50 +09:00
Kihwal Lee 04ee18ed48 HDFS-7742. Favoring decommissioning node for replication can cause a block to stay 
underreplicated for long periods. Contributed by Nathan Roberts.
 2015-03-30 10:10:11 -05:00
Harsh J ae3e8c61ff HDFS-4396. Add START_MSG/SHUTDOWN_MSG for ZKFC. Contributed by Liang Xie. 2015-03-30 15:21:18 +05:30
Vinayakumar B 1ed9fb7664 HDFS-7890. Improve information on Top users for metrics in RollingWindowsManager and lower log level (Contributed by J.Andreina) 2015-03-30 10:02:48 +05:30
Akira Ajisaka 232eca944a HDFS-6408. Remove redundant definitions in log4j.properties. Contributed by Abhiraj Butala. 2015-03-30 11:25:35 +09:00
Akira Ajisaka 257c77f895 HDFS-6263. Remove DRFA.MaxBackupIndex config from log4j.properties. Contributed by Abhiraj Butala. 2015-03-30 10:52:15 +09:00
Harsh J 3d9132d434 HDFS-7501. TransactionsSinceLastCheckpoint can be negative on SBNs. Contributed by Gautam Gopalakrishnan. 2015-03-29 00:45:01 +05:30
Arpit Agarwal 89fb0f57ef HDFS-7700. Document quota support for storage types. (Contributed by Xiaoyu Yao) 2015-03-27 19:49:26 -07:00
Arun Suresh e97f8e44af HDFS-8004. Use KeyProviderCryptoExtension#warmUpEncryptedKeys when creating an encryption zone. (awang via asuresh) 2015-03-27 19:23:45 -07:00