6f622672b6
HDFS-7894. Rolling upgrade readiness is not updated in jmx until query command is issued. Contributed by Brahma Reddy Battula.
2015-05-08 09:30:38 -05:00
7b1ea9c481
HDFS-6285. tidy an error log inside BlockReceiver. Contributed by Liang Xie.
2015-05-08 17:22:52 +05:30
c648317a68
HDFS-3384. DataStreamer thread should be closed immediatly when failed to setup a PipelineForAppendOrRecovery (Contributed by Uma Maheswara Rao G)
2015-05-08 17:18:14 +05:30
46509617b6
HDFS-6576. Datanode log is generating at root directory in security mode (Contributed by surendra singh lilhore)
...
Just merging CHANGES.txt changes from branch-2 to keep in sync.
(cherry picked from commit a87ab77fec
2015-05-08 16:44:03 +05:30
e01c1a979c
HDFS-8226. Non-HA rollback compatibility broken (Contributed by J.Andreina)
2015-05-08 15:24:36 +05:30
4c6816faf8
HDFS-8209. Support different number of datanode directories in MiniDFSCluster. (Contributed by surendra singh lilhore)
2015-05-08 15:03:44 +05:30
888e630990
HDFS-8207. Improper log message when blockreport interval compared with initial delay. Contributed by Brahma Reddy Battula and Ashish Singhi.
2015-05-08 18:13:09 +09:00
6232235df3
HDFS-8175. Provide information on snapshotDiff for supporting the comparison between snapshot and current status (Contributed by J.Andreina)
2015-05-08 14:37:50 +05:30
e642eff0e0
HDFS-8187. Remove usage of '-setStoragePolicy' and '-getStoragePolicy' using dfsadmin cmd (as it is not been supported) (Contributed by J.Andreina)
2015-05-08 14:16:30 +05:30
4b00ae5c11
HDFS-8108. Fsck should provide the info on mandatory option to be used along with -blocks ,-locations and -racks. Contributed by J.Andreina.
2015-05-08 14:00:45 +05:30
fd605997ee
HDFS-8222. Remove usage of "dfsadmin -upgradeProgress" from document which is no longer supported. Contributed by J.Andreina.
2015-05-08 16:27:40 +09:00
26da2ddf38
HDFS-7998. HDFS Federation : Command mentioned to add a NN to existing federated cluster is wrong (Contributed by Ajith S)
2015-05-08 12:33:49 +05:30
c5afe444df
HDFS-8349. Remove .xml and documentation references to dfs.webhdfs.enabled. Contributed by Ray Chiang.
2015-05-08 15:57:13 +09:00
e16f4b7f70
HDFS-8332. DFS client API calls should check filesystem closed. Contributed by Rakesh R.
2015-05-08 12:26:47 +05:30
e5e492a963
HDFS-6291. FSImage may be left unclosed in BootstrapStandby#doRun() ( Contributed by Sanghyun Yun)
2015-05-08 11:25:24 +05:30
2ea0f2fc93
HDFS-8174. Update replication count to live rep count in fsck report. Contributed by J.Andreina
2015-05-08 11:01:51 +05:30
66988476d0
HDFS-8067. haadmin prints out stale help messages (Contributed by Ajith S)
2015-05-08 10:45:21 +05:30
c7c26a1e4a
HDFS-8257. Namenode rollingUpgrade option is incorrect in document (Contributed by J.Andreina)
2015-05-08 10:35:25 +05:30
4d9f9e546f
HDFS-8037. CheckAccess in WebHDFS silently accepts malformed FsActions parameters. Contributed by Walter Su.
2015-05-07 15:25:26 -07:00
767b91cd83
HDFS-8321. CacheDirectives and CachePool operations should throw RetriableException in safemode. Contributed by Haohui Mai.
2015-05-07 15:17:11 -07:00
f9427f1760
HDFS-7980. Incremental BlockReport will dramatically slow down namenode startup. Contributed by Walter Su
2015-05-07 11:36:35 -07:00
449e4426a5
HDFS-8325. Misspelling of threshold in log4j.properties for tests. Contributed by Brahma Reddy Battula.
2015-05-07 15:14:20 +09:00
6633a8474d
HDFS-7833. DataNode reconfiguration does not recalculate valid volumes required, based on configured failed volumes tolerated. Contributed by Lei (Eddy) Xu.
2015-05-06 21:11:30 -07:00
c75cfa29cf
HDFS-2484. checkLease should throw FileNotFoundException when file does not exist. Contributed by Rakesh R.
2015-05-06 16:06:04 -07:00
7a26d174af
HDFS-8310. Fix TestCLI.testAll 'help: help for find' on Windows. (Kiran Kumar M R via Xiaoyu Yao)
2015-05-06 10:24:46 -07:00
4da8490b51
HDFS-8314. Move HdfsServerConstants#IO_FILE_BUFFER_SIZE and SMALL_BUFFER_SIZE to the users. Contributed by Li Lu.
2015-05-05 15:41:22 -07:00
0100b15501
HDFS-8219. setStoragePolicy with folder behavior is different after cluster restart. (surendra singh lilhore via Xiaoyu Yao)
2015-05-05 13:41:14 -07:00
ffce9a3413
HDFS-7847. Modify NNThroughputBenchmark to be able to operate on a remote NameNode (Charles Lamb via Colin P. McCabe)
2015-05-05 11:34:58 -07:00
24d3a2d4fd
HDFS-7758. Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead (Lei (Eddy) Xu via Colin P. McCabe)
2015-05-05 11:08:59 -07:00
fcd4cb7516
HDFS-8305: HDFS INotify: the destination field of RenameOp should always end with the file name (cmccabe)
2015-05-05 10:50:09 -07:00
318081ccd7
HDFS-7916. 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop (Contributed by Vinayakumar B)
...
Reverted earlier commit
2015-05-05 11:05:37 +05:30
0d6aa5d609
HDFS-8237. Move all protocol classes used by ClientProtocol to hdfs-client. Contributed by Haohui Mai.
2015-05-04 15:00:29 -07:00
3fe79e1db8
HDFS-7397. Add more detail to the documentation for the conf key "dfs.client.read.shortcircuit.streams.cache.size" (Brahma Reddy Battula via Colin P. McCabe)
2015-05-04 12:50:29 -07:00
c4578760b6
HDFS-8290. WebHDFS calls before namesystem initialization can cause NullPointerException. Contributed by Chris Nauroth.
2015-05-04 11:35:04 -07:00
a319771d1d
HDFS-8309. Skip unit test using DataNodeTestUtils#injectDataDirFailure() on Windows. (xyao)
2015-05-02 22:15:24 -07:00
6ae2a0d048
HDFS-8249. Separate HdfsConstants into the client and the server side class. Contributed by Haohui Mai.
2015-05-02 10:03:23 -07:00
6f541edce0
HDFS-8229. LAZY_PERSIST file gets deleted after NameNode restart. (Contributed by Surendra Singh Lilhore)
2015-05-01 16:42:19 -07:00
d3d019c337
HDFS-8086. Move LeaseRenewer to the hdfs.client.impl package. Contributed by Takanobu
2015-05-01 15:12:18 -07:00
64d30a6186
HDFS-8276. LazyPersistFileScrubber should be disabled if scrubber interval configured zero. (Contributed by Surendra Singh Lilhore)
2015-05-01 14:43:09 -07:00
3393461197
Updating CHANGES.txt - Pulling in HDFS-8091 to branch-2.7 (for 2.7.1)
2015-05-01 11:48:54 -07:00
b82567d455
HDFS-8213. DFSClient should use hdfs.client.htrace HTrace configuration prefix rather than hadoop.htrace (cmccabe)
2015-05-01 11:19:40 -07:00
2d7363b273
HADOOP-11889. Make checkstyle runnable from root project (Gera Shegalov via jeagles)
2015-05-01 13:11:50 -05:00
279958b772
HDFS-7281. Missing block is marked as corrupted block (Ming Ma via Yongjun Zhang)
2015-05-01 08:42:00 -07:00
98a6176628
HDFS-8300. Fix unit test failures and findbugs warning caused by HDFS-8283. Contributed by Jing Zhao.
2015-04-30 19:27:07 -07:00
87e9978235
HDFS-8292. Move conditional in fmt_time from dfs-dust.js to status.html. Contributed by Charles Lamb.
2015-04-30 18:23:13 -07:00
c55d609053
HDFS-8200. Refactor FSDirStatAndListingOp. Contributed by Haohui Mai.
2015-04-30 13:41:46 -07:00
de9404f02f
HDFS-7770. Need document for storage type label of data node storage locations under dfs.data.dir. Contributed by Xiaoyu Yao.
2015-04-30 20:12:32 +09:00
e89fc53a1d
HDFS-5574. Remove buffer copy in BlockReader.skip. Contributed by Binglin Chang.
2015-04-30 19:11:22 +09:00
aa22450442
HDFS-8214. Secondary NN Web UI shows wrong date for Last Checkpoint. Contributed by Charles Lamb.
2015-04-29 17:37:56 -07:00
3dd6395bb2
HDFS-8269. getBlockLocations() does not resolve the .reserved path and generates incorrect edit logs when updating the atime. Contributed by Haohui Mai.
2015-04-29 11:12:45 -07:00
7947e5b53b
HDFS-8283. DataStreamer cleanup and some minor improvement. Contributed by Tsz Wo Nicholas Sze.
2015-04-29 10:41:46 -07:00
439614b0c8
HDFS-8280. Code Cleanup in DFSInputStream. Contributed by Jing Zhao.
2015-04-28 18:11:59 -07:00
c79e7f7d99
HDFS-8273. FSNamesystem#Delete() should not call logSync() when holding the lock. Contributed by Haohui Mai.
2015-04-28 18:05:46 -07:00
5639bf02da
HDFS-8204. Mover/Balancer should not schedule two replicas to the same datanode. Contributed by Walter Su
2015-04-28 13:05:33 -07:00
feb68cb547
HDFS-8232. Missing datanode counters when using Metrics2 sink interface. Contributed by Anu Engineer.
2015-04-27 16:48:13 -07:00
6bae5962cd
HDFS-8205. Fix CHANGES.txt
2015-04-27 12:30:50 -07:00
0d5b0143cc
HDFS-8205. CommandFormat#parse() should not parse option as value of option. (Contributed by Peter Shi and Xiaoyu Yao)
2015-04-27 12:23:34 -07:00
8b69c825e5
HADOOP-11865. Incorrect path mentioned in document for accessing script files (J.Andreina via aw)
2015-04-26 09:55:46 -07:00
22b70e7c5a
Updated CHANGES.TXT for correct version of HDFS-8206
2015-04-25 22:16:06 -07:00
8f3946cd40
HDFS-8206. Fix the typos in hadoop-hdfs-httpfs. (Brahma Reddy Battula via xyao)
2015-04-25 21:41:35 -07:00
a00e001a1a
HDFS-8247. TestDiskspaceQuotaUpdate#testAppendOverTypeQuota is failing. Contributed by Xiaoyu Yao.
2015-04-25 11:37:27 -07:00
f83c55a6be
HDFS-7673. synthetic load generator docs give incorrect/incomplete commands (Brahma Reddy Battula via aw)
2015-04-25 15:05:43 +01:00
dcc5455e07
HDFS-8211. DataNode UUID is always null in the JMX counter. (Contributed by Anu Engineer)
2015-04-24 16:47:48 -07:00
c7d9ad68e3
HDFS-8191. Fix byte to integer casting in SimulatedFSDataset#simulatedByte. Contributed by Zhe Zhang.
2015-04-24 11:54:25 -07:00
cf6c8a1b4e
HDFS-8176. Record from/to snapshots in audit log for snapshot diff report. Contributed by J. Andreina.
2015-04-24 10:23:32 -07:00
91b97c21c9
HDFS-8110. Remove unsupported 'hdfs namenode -rollingUpgrade downgrade' from document. Contributed by J.Andreina.
2015-04-24 20:32:55 +09:00
c8d72907ff
HDFS-8231. StackTrace displayed at client while QuotaByStorageType exceeds (Contributed by J.Andreina and Xiaoyu Yao)
2015-04-24 12:51:04 +05:30
262c1bc339
HDFS-8217. During block recovery for truncate Log new Block Id in case of copy-on-truncate is true. (Contributed by Vinayakumar B)
2015-04-24 12:16:41 +05:30
a8898445dc
HDFS-8070. Pre-HDFS-7915 DFSClient cannot use short circuit on post-HDFS-7915 DataNode (cmccabe)
2015-04-23 19:13:27 -07:00
a0e0a63209
HADOOP-11802. DomainSocketWatcher thread terminates sometimes after there is an I/O error during requestShortCircuitShm (cmccabe)
2015-04-23 19:00:24 -07:00
bcf89ddc7d
HDFS-8052. Move WebHdfsFileSystem into hadoop-hdfs-client. Contributed by Haohui Mai.
2015-04-23 17:33:45 -07:00
ef4e9963b2
HDFS-8215. Refactor NamenodeFsck#check method. Contributed by Takanobu Asanuma
2015-04-23 14:19:33 -07:00
416b84354e
HDFS-8147. StorageGroup in Dispatcher should override equals nad hashCode. Contributed by surendra singh lilhore
2015-04-23 11:55:06 -07:00
26971e52ae
HADOOP-11852. Disable symlinks in trunk.
2015-04-23 11:47:01 -07:00
baf8bc6c48
HDFS-4448. Allow HA NN to start in secure mode with wildcard address configured (atm via asuresh)
2015-04-23 01:44:17 -07:00
12f4df043f
HDFS-8218. Move classes that used by ClientProtocol into hdfs-client. Contributed by Haohui Mai.
2015-04-22 11:33:21 -07:00
6f8003dc7b
HDFS-8185. Separate client related routines in HAUtil into a new class. Contributed by Haohui Mai.
2015-04-21 21:59:47 -07:00
997408eaac
HDFS-8133. Improve readability of deleted block check (Daryn Sharp via Colin P. McCabe)
2015-04-21 11:43:24 -07:00
dfc1c4c303
HDFS-8163. Using monotonicNow for block report scheduling causes test failures on recently restarted systems. (Arpit Agarwal)
2015-04-21 10:58:05 -07:00
8ddbb8dd43
HDFS-7993. Provide each Replica details in fsck (Contributed by J.Andreina)
2015-04-21 15:24:49 +05:30
d52de61544
Set the release date for 2.7.0
2015-04-20 20:16:58 -07:00
ed4137cebf
HDFS-7916. 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop (Contributed by Vinayakumar B)
...
Updated CHANGES.TXT for correct version
2015-04-21 07:59:43 +05:30
c92f6f3605
HDFS-8179. DFSClient#getServerDefaults returns null within 1 hour of system start. (Contributed by Xiaoyu Yao)
2015-04-20 15:42:42 -07:00
c17cd4f7c1
HDFS-8173. NPE thrown at DataNode shutdown when HTTP server was not able to create (Contributed by surendra singh lilhore)
2015-04-20 14:58:04 +05:30
5c97db07fb
HDFS-8169. Move LocatedBlocks and related classes to hdfs-client. Contributed by Haohui Mai.
2015-04-20 00:36:46 -07:00
8511d80804
HDFS-8152. Refactoring of lazy persist storage cases. (Arpit Agarwal)
2015-04-19 16:09:06 -07:00
5459b241c8
HDFS-8043. NPE in MiniDFSCluster teardown. Contributed by Brahma Reddy Battula.
2015-04-19 18:19:36 +09:00
5112477d9e
HDFS-7863. Missing description of some methods and parameters in javadoc of FSDirDeleteOp. Contributed by Brahma Reddy Battula.
2015-04-19 18:06:56 +09:00
76e7264e8d
HDFS-8165. Move GRANDFATHER_GENERATION_STAMP and GRANDFATER_INODE_ID to hdfs-client. Contributed by Haohui Mai.
2015-04-16 22:49:30 -07:00
369ddc67bd
HDFS-8153. Error Message points to wrong parent directory in case of path component name length error. Contributed by Anu Engineer.
2015-04-16 22:13:09 -07:00
9595cc003c
HDFS-7891. A block placement policy with best rack failure tolerance. Contributed by Walter Su
2015-04-16 18:25:53 -07:00
4308910eed
Revert "HDFS-6153. Document "fileId" and "childrenNum" fields in the FileStatus Json schema"
...
This reverts commit eb1d4c39e0
2015-04-16 16:54:01 -05:00
75bbcc8bf3
HDFS-8082. Move dfs.client.read.*, dfs.client.short.circuit.*, dfs.client.mmap.* and dfs.client.hedged.read.* conf from DFSConfigKeys to HdfsClientConfigKeys.
2015-04-16 13:22:31 -07:00
80a2a12423
HDFS-8135. Remove the deprecated FSConstants class. Contributed by Li Lu.
2015-04-16 11:26:05 -07:00
2e8ea780a4
HDFS-8142. DistributedFileSystem encryption zone commands should resolve relative paths. Contributed by Rakesh R.
2015-04-16 07:14:44 -07:00
de0f1700c1
HDFS-8149. The footer of the Web UI "Hadoop, 2014" is old. Contributed by Brahma Reddy Battula.
2015-04-15 15:31:04 -05:00
b172d03595
HDFS-7934. Update RollingUpgrade rollback documentation: should use bootstrapstandby for standby NN. Contributed by J. Andreina.
2015-04-15 13:10:38 -07:00
4c097e473b
HDFS-8151. Always use snapshot path as source when invalid snapshot names are used for diff based distcp. Contributed by Jing Zhao.
2015-04-15 12:37:20 -07:00
9e8309a1b2
HDFS-8144. Split TestLazyPersistFiles into multiple tests. (Arpit Agarwal)
2015-04-15 10:25:04 -07:00
fddd55279d
HDFS-8127. NameNode Failover during HA upgrade can cause DataNode to finalize upgrade. Contributed by Jing Zhao.
2015-04-14 15:05:23 -07:00
fef596df03
HDFS-8055. NullPointerException when topology script is missing. Contributed by Anu Engineer.
2015-04-14 10:19:30 -07:00
d45aa7647b
HDFS-6666. Abort NameNode and DataNode startup if security is enabled but block access token is not enabled. Contributed by Vijay Bhat.
2015-04-14 09:59:01 -07:00
18a3dad44a
HDFS-7701. Support reporting per storage type quota and usage with hadoop/hdfs shell. (Contributed by Peter Shi)
2015-04-13 21:01:15 -07:00
d60e22152a
HDFS-8117. More accurate verification in SimulatedFSDataset: replace DEFAULT_DATABYTE with patterned data. Contributed by Zhe Zhang.
2015-04-13 13:01:10 -07:00
7fc50e2525
HDFS-8083. Move dfs.client.write.* conf from DFSConfigKeys to HdfsClientConfigKeys.Write.
2015-04-13 11:43:35 -07:00
14384f5b51
HDFS-8111. NPE thrown when invalid FSImage filename given for 'hdfs oiv_legacy' cmd ( Contributed by surendra singh lilhore )
2015-04-13 17:16:05 +05:30
f8f5887209
HDFS-7933. fsck should also report decommissioning replicas. Contributed by Xiaoyu Yao.
2015-04-11 13:23:18 -07:00
60da0e49e7
HDFS-8084. Move dfs.client.failover.* confs from DFSConfigKeys to HdfsClientConfigKeys.Failover and fix typos in the dfs.http.client.* configuration keys.
2015-04-10 19:38:43 -07:00
36e4cd3be6
HDFS-8103. Move BlockTokenSecretManager.AccessMode into BlockTokenIdentifier. Contributed by Haohui Mai.
2015-04-10 16:36:45 -07:00
2cc9514ad6
HDFS-8100. Refactor DFSClient.Conf to a standalone class and separates short-circuit related conf to ShortCircuitConf.
2015-04-10 14:48:45 -07:00
7660da95cb
HDFS-7931. DistributedFileSystem should not look for keyProvider in cache if Encryption is disabled (asuresh)
2015-04-10 11:40:25 -07:00
987c9e12e1
HDFS-7939. Two fsimage_rollback_* files are created which are not deleted after rollback. (Contributed by J.Andreina)
2015-04-10 11:12:07 +05:30
0959b67f1a
HDFS-8081. Split getAdditionalBlock() into two methods. Contributed by Konstantin Shvachko
2015-04-09 22:00:20 -07:00
af9d4fede5
HDFS-8102. Separate webhdfs retry configuration keys from DFSConfigKeys. Contributed by Haohui Mai.
2015-04-09 14:36:27 -07:00
623fd46c1e
Adding release 2.7.1 to CHANGES.txt
2015-04-09 13:54:20 -07:00
a813db0b1b
Fix CHANGES.txt for HDFS-8091
2015-04-09 13:51:00 -07:00
922b7ed21d
HDFS-8091: ACLStatus and XAttributes should be presented to INodeAttributesProvider before returning to client (asuresh)
2015-04-09 12:38:33 -07:00
61dc2ea3fe
HDFS-8063: Fix intermittent test failures in TestTracing (Masatake Iwasaki via Colin P. McCabe)
2015-04-09 11:28:02 -07:00
30acb7372a
HDFS-8099. Change "DFSInputStream has been closed already" message to debug log level (Charles Lamb via Colin P. McCabe)
2015-04-09 11:22:39 -07:00
3fe61e0bb0
HDFS-8101. DFSClient use of non-constant DFSConfigKeys pulls in WebHDFS classes at runtime. Contributed by Sean Busbey.
2015-04-09 09:40:08 -07:00
9d8952f97f
HDFS-8096. DatanodeMetrics#blocksReplicated will get incremented early and even for failed transfers (Contributed by Vinayakumar B)
2015-04-09 11:58:00 +05:30
b1e059089d
HDFS-7979. Initialize block report IDs with a random number.
2015-04-08 21:43:42 -07:00
cc25823546
HDFS-8089. Move o.a.h.hdfs.web.resources.* to the client jars. Contributed by Haohui Mai.
2015-04-08 16:30:08 -07:00
5a540c3d31
HDFS-8025. Addendum fix for HDFS-3087 Decomissioning on NN restart can complete without blocks being replicated. Contributed by Ming Ma.
2015-04-08 16:09:17 -07:00
82d56b337d
Revert HDFS-7813.
2015-04-08 16:02:45 -07:00
bd4c99bece
Revert HDFS-7808.
2015-04-08 15:59:55 -07:00
6af0d74a75
HDFS-7725. Incorrect 'nodes in service' metrics caused all writes to fail. Contributed by Ming Ma.
2015-04-08 15:52:06 -07:00
a42bb1cd91
HDFS-8076. Code cleanup for DFSInputStream: use offset instead of LocatedBlock when possible. Contributed by Zhe Zhang.
2015-04-08 15:41:48 -07:00
285b31e75e
HDFS-8046. Allow better control of getContentSummary. Contributed by Kihwal Lee.
2015-04-08 15:38:29 -05:00
c931a3c776
HDFS-8079. Move CorruptFileBlockIterator to a new hdfs.client.impl package.
2015-04-08 11:50:52 -07:00
608c499841
HDFS-8072. Reserved RBW space is not released if client terminates while writing block. (Arpit Agarwal)
2015-04-08 11:38:21 -07:00
ab04ff9efe
HDFS-8080. Separate JSON related routines used by WebHdfsFileSystem to a package local class. Contributed by Haohui Mai.
2015-04-07 21:30:57 -07:00
d505c8acd3
HDFS-8073. Split BlockPlacementPolicyDefault.chooseTarget(..) so it can be easily overrided. (Contributed by Walter Su)
2015-04-08 09:56:37 +05:30
4be648b55c
HDFS-8079. Move dfs.client.retry.* confs from DFSConfigKeys to HdfsClientConfigKeys.Retry.
2015-04-07 19:48:57 -07:00
66763bb06f
HDFS-5215. dfs.datanode.du.reserved is not considered while computing
...
available space ( Brahma Reddy Battula via Yongjun Zhang)
2015-04-07 19:31:58 -07:00
1e72d98c69
HDFS-8038. PBImageDelimitedTextWriter#getEntry output HDFS path in platform-specific format. Contributed by Xiaoyu Yao.
2015-04-07 14:23:01 -07:00
571a1ce9d0
HDFS-8049. Add @InterfaceAudience.Private annotation to hdfs client implementation. Contributed by Takuya Fukudome
2015-04-07 13:59:48 -07:00
75c5454860
HDFS-8071. Redundant checkFileProgress() in PART II of getAdditionalBlock(). Contributed by Konstantin Shvachko.
2015-04-06 22:20:44 -07:00
28bebc81db
HDFS-7999. FsDatasetImpl#createTemporary sometimes holds the FSDatasetImpl lock for a very long time (sinago via cmccabe)
2015-04-06 08:56:52 -07:00
4b3948ea36
HADOOP-11776. Fixed the broken JDiff support in Hadoop 2. Contributed by Li Lu.
2015-04-04 13:52:01 -07:00
5370e7128b
HADOOP-11377. Added Null.java without which jdiff completely flops. Contributed by Tsuyoshi Ozawa.
2015-04-04 13:47:08 -07:00
ef591b1d6a
HDFS-8051. FsVolumeList#addVolume should release volume reference if not put it into BlockScanner. (Lei (Eddy) Xu via Colin P. McCabe)
2015-04-03 16:34:23 -07:00
023133cef9
HDFS-7996. After swapping a volume, BlockReceiver reports ReplicaNotFoundException (Lei (Eddy) Xu via Colin P. McCabe)
2015-04-03 14:19:46 -07:00
db80e42891
HDFS-8039. Fix TestDebugAdmin#testRecoverLease and testVerfiyBlockChecksumCommand on Windows. Contributed by Xiaoyu Yao.
2015-04-03 10:44:02 -07:00
dc5596c36a
HDFS-8034. Fix TestDFSClientRetries#testDFSClientConfigurationLocateFollowingBlockInitialDelay for Windows. Contributed by Xiaoyu Yao.
2015-04-03 10:10:11 -07:00
72f6bd4893
HDFS-7811. Avoid recursive call getStoragePolicyID in INodeFile#computeQuotaUsage. Contributed by Xiaoyu Yao and Jing Zhao.
2015-04-02 21:20:30 -07:00
16b74f978a
HDFS-7893. Update the POM to create a separate hdfs-client jar. Contributed by Haohui Mai.
2015-04-02 15:29:18 -07:00
96649c38f9
HDFS-8035. Move checkBlocksProperlyReplicated() in FSNamesystem to BlockManager. Contributed by Haohui Mai.
2015-04-02 11:36:51 -07:00
4f412f487c
HDFS-7954. TestBalancer#testBalancerWithPinnedBlocks should not be executed on Windows. Contributed by Xiaoyu Yao
2015-04-02 11:11:34 -07:00
9ed43f2189
HDFS-7888. Change DFSOutputStream and DataStreamer for convenience of subclassing. Contributed by Li Bo
2015-04-02 10:59:26 -07:00
867d5d2675
HDFS-7916. 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop (Contributed by Vinayakumar B)
2015-04-02 08:12:00 +05:30
4d14816c26
HDFS-8001 RpcProgramNfs3 : wrong parsing of dfs.blocksize. Contributed by Remi Catherinot
2015-04-01 17:20:24 -07:00
6ccf4fbf8a
HDFS-8008. Support client-side back off when the datanodes are congested. Contributed by Haohui Mai.
2015-04-01 16:54:46 -07:00
75cb1d42ab
HDFS-8036. Use snapshot path as source when using snapshot diff report in DistCp. Contributed by Jing Zhao.
2015-04-01 16:50:59 -07:00
3c7adaaf35
HDFS-7922. ShortCircuitCache#close is not releasing ScheduledThreadPoolExecutors (Rakesh R via Colin P. McCabe)
2015-04-01 16:02:39 -07:00
c94d594a57
HDFS-8026. Trace FSOutputSummer#writeChecksumChunks rather than DFSOutputStream#writeChunk (cmccabe)
2015-04-01 14:10:10 -07:00
ed72daa5df
HDFS-7978. Add LOG.isDebugEnabled() guard for some LOG.debug(..). Contributed by Walter Su.
2015-04-01 12:54:28 -07:00
796fb26871
Add the missing files for HDFS-8009.
2015-04-01 10:58:32 -07:00
53471d462c
HDFS-8009. Signal congestion on the DataNode. Contributed by Haohui Mai.
2015-04-01 10:56:53 -07:00
18a91fe4df
HDFS-6945. BlockManager should remove a block from excessReplicateMap and decrement ExcessBlocks metric when the block is removed. (aajisaka)
2015-04-01 09:07:28 +09:00
859cab2f22
HDFS-7671. hdfs user guide should point to the common rack awareness doc. Contributed by Kai Sasaki.
2015-04-01 00:26:16 +09:00
3df61f303a
HDFS-7997. The first non-existing xattr should also throw IOException. (zhouyingchao via yliu)
2015-03-31 21:17:44 +08:00
85dc3c14b2
HDFS-7944. Minor cleanup of BlockPoolManager#getAllNamenodeThreads. (Arpit Agarwal)
2015-03-30 21:24:51 -07:00
cce66ba3c9
HDFS-3918. EditLogTailer shouldn't log WARN when other node is in standby mode. Contributed by Todd Lipcon.
2015-03-31 08:04:18 +05:30
1a495fbb48
HDFS-7645. Rolling upgrade is restoring blocks from trash multiple times (Contributed by Vinayakumar B and Keisuke Ogiwara)
2015-03-30 15:25:16 -07:00
0967b1d99d
Addendum for HDFS-7748.
2015-03-30 13:11:09 -07:00
b80457158d
HDFS-7748. Separate ECN flags from the Status in the DataTransferPipelineAck. Contributed by Anu Engineer and Haohui Mai.
2015-03-30 11:59:21 -07:00
1feb9569f3
HDFS-7261. storageMap is accessed without synchronization in DatanodeDescriptor#updateHeartbeatState() (Brahma Reddy Battula via Colin P. McCabe)
2015-03-30 10:46:21 -07:00
e7ea2a8e8f
HDFS-8002. Website refers to /trash directory. Contributd by Brahma Reddy Battula.
2015-03-31 00:27:50 +09:00
04ee18ed48
HDFS-7742. Favoring decommissioning node for replication can cause a block to stay
...
underreplicated for long periods. Contributed by Nathan Roberts.
2015-03-30 10:10:11 -05:00
ae3e8c61ff
HDFS-4396. Add START_MSG/SHUTDOWN_MSG for ZKFC. Contributed by Liang Xie.
2015-03-30 15:21:18 +05:30
1ed9fb7664
HDFS-7890. Improve information on Top users for metrics in RollingWindowsManager and lower log level (Contributed by J.Andreina)
2015-03-30 10:02:48 +05:30
232eca944a
HDFS-6408. Remove redundant definitions in log4j.properties. Contributed by Abhiraj Butala.
2015-03-30 11:25:35 +09:00
257c77f895
HDFS-6263. Remove DRFA.MaxBackupIndex config from log4j.properties. Contributed by Abhiraj Butala.
2015-03-30 10:52:15 +09:00
3d9132d434
HDFS-7501. TransactionsSinceLastCheckpoint can be negative on SBNs. Contributed by Gautam Gopalakrishnan.
2015-03-29 00:45:01 +05:30
89fb0f57ef
HDFS-7700. Document quota support for storage types. (Contributed by Xiaoyu Yao)
2015-03-27 19:49:26 -07:00
e97f8e44af
HDFS-8004. Use KeyProviderCryptoExtension#warmUpEncryptedKeys when creating an encryption zone. (awang via asuresh)
2015-03-27 19:23:45 -07:00
60882ab26d
HDFS-7990. IBR delete ack should not be delayed. Contributed by Daryn Sharp.
2015-03-27 09:05:17 -05:00
47782cbf4a
HADOOP-11748. The secrets of auth cookies should not be specified in configuration in clear text. Contributed by Li Lu and Haohui Mai.
2015-03-26 17:35:37 -07:00
61df1b27a7
HDFS-7410. Support CreateFlags with append() to support hsync() for appending streams (Vinayakumar B via Colin P. McCabe)
2015-03-26 13:21:09 -07:00
3d0708bdb0
HDFS-7824. GetContentSummary API and its namenode implementation for Storage Type Quota/Usage. (Contributed by Xiaoyu Yao)
2015-03-26 10:24:11 -07:00
222845632b
HDFS-7963. Fix expected tracing spans in TestTracing. Contributed by Masatake Iwasaki.
2015-03-26 08:44:58 -05:00
4528eb9fb2
HADOOP-11524. hadoop_do_classpath_subcommand throws a shellcheck warning. Contributed by Chris Nauroth.
2015-03-25 22:36:09 -07:00
fc1031af74
HDFS-7928. Scanning blocks from disk during rolling upgrade startup takes a lot of time if disks are busy. Contributed by Rushabh Shah.
2015-03-25 14:42:59 -05:00
97e2aa2551
Move HDFS-6353 to the trunk section in CHANGES.txt
2015-03-25 11:15:44 -07:00
5e21e4ca37
HDFS-6353. Check and make checkpoint before stopping the NameNode. Contributed by Jing Zhao.
2015-03-25 10:38:00 -07:00
80278a5f85
HDFS-7985. WebHDFS should be always enabled. Contributed by Li Lu.
2015-03-24 21:55:56 -07:00
53a28afe29
HDFS-6826. Plugin interface to enable delegation of HDFS authorization assertions. Contributed by Arun Suresh.
2015-03-24 16:02:40 -07:00
e38ef70fbc
HDFS-7713. Implement mkdirs in the HDFS Web UI. Contributed by Ravi Prakash.
2015-03-24 15:48:52 -07:00
a16bfff71b
HDFS-7854. Separate class DataStreamer out of DFSOutputStream. Contributed by Li Bo.
2015-03-24 11:06:13 -07:00
570a83ae80
HDFS-7977. NFS couldn't take percentile intervals. Contributed by Brandon Li
2015-03-24 10:49:16 -07:00
eda02540ce
HDFS-7875. Improve log message when wrong value configured for dfs.datanode.failed.volumes.tolerated. Contributed by Nijel.
2015-03-24 23:06:18 +05:30
51f1f49374
HDFS-7976. Update NFS user guide for mount option 'sync' to minimize or avoid reordered writes. Contributed by Brandon Li
2015-03-24 10:28:38 -07:00
6413d34986
HDFS-7961. Trigger full block report after hot swapping disk. Contributed by Eddy Xu.
2015-03-24 09:07:02 -07:00
c6c396fcd6
HDFS-3325. When configuring 'dfs.namenode.safemode.threshold-pct' to a value greater or equal to 1 there is mismatch in the UI report (Contributed by J.Andreina)
2015-03-24 12:12:01 +05:30
970ee3fc56
HDFS-7956. Improve logging for DatanodeRegistration. Contributed by Plamen Jeliazkov.
2015-03-23 23:05:21 -07:00
50ee8f4e67
HDFS-7960. The full block report should prune zombie storages even if they're not empty. Contributed by Colin McCabe and Eddy Xu.
2015-03-23 22:00:34 -07:00
d7e3c3364e
HDFS-7884. Fix NullPointerException in BlockSender when the generation stamp provided by the client is larger than the one stored in the datanode. Contributed by Brahma Reddy Battula
2015-03-24 13:49:17 +09:00
2c238ae4e0
HDFS-7917. Use file to replace data dirs in test to simulate a disk failure. Contributed by Lei (Eddy) Xu.
2015-03-23 16:29:51 -07:00
36af4a913c
HDFS-7942. NFS: support regexp grouping in nfs.exports.allowed.hosts. Contributed by Brandon Li
2015-03-23 10:06:47 -07:00
75ead273be
HDFS-6841. Use Time.monotonicNow() wherever applicable instead of Time.now(). Contributed by Vinayakumar B
2015-03-20 14:02:09 -05:00
d368d3647a
HDFS-7957. Truncate should verify quota before making changes. Contributed by Jing Zhao.
2015-03-20 11:50:24 -07:00
a6a5aae472
HDFS-7829. Code clean up for LocatedBlock. Contributed by Takanobu Asanuma.
2015-03-20 10:50:19 -07:00
15612313f5
HDFS-7835. make initial sleeptime in locateFollowingBlock configurable for DFSClient. Contributed by Zhihai Xu.
2015-03-20 09:12:42 -07:00
978ef11f26
HDFS-7962. Remove duplicated logs in BlockManager. (yliu)
2015-03-20 05:29:25 +08:00
e37ca221bf
HDFS-7930. commitBlockSynchronization() does not remove locations. (yliu)
2015-03-19 23:23:19 +08:00
61a4c7fc98
HDFS-7932. Speed up the shutdown of datanode during rolling upgrade. Contributed by Kihwal Lee.
2015-03-19 12:27:03 -05:00
5be5129d93
HDFS.7849. Update documentation for enabling a new feature in rolling upgrade ( Contributed by J.Andreina )
2015-03-19 19:05:42 +05:30
e79be0ee12
HDFS-7816. Unable to open webhdfs paths with "+". Contributed by Haohui Mai
2015-03-19 08:01:01 -05:00
355e008ffb
HDFS-7867. Update action param from 'start' to 'prepare' in rolling upgrade ( Contributed by J.Andreina) Updated JIRA id.
2015-03-19 12:10:39 +05:30
338b477ff7
HDFS-7869. Update action param from 'start' to 'prepare' in rolling upgrade ( Contributed by J.Andreina)
2015-03-19 11:59:31 +05:30
c7c71cdba5
HDFS-7587. Edit log corruption can happen if append fails with a quota violation. Contributed by Jing Zhao.
2015-03-18 18:53:50 -07:00
43b41f2241
HDFS-7929. inotify unable fetch pre-upgrade edit log segments once upgrade starts (Zhe Zhang via Colin P. McCabe)
2015-03-18 18:48:54 -07:00
bee5a6a64a
HDFS-7943. Append cannot handle the last block with length greater than the preferred block size. Contributed by Jing Zhao.
2015-03-18 18:40:59 -07:00
8234fd0e10
HDFS-7054. Make DFSOutputStream tracing more fine-grained (cmccabe)
2015-03-18 18:14:54 -07:00
8c40e88d5d
HDFS-7945. The WebHdfs system on DN does not honor the length parameter. Contributed by Haohui Mai.
2015-03-18 16:19:46 -07:00
c239b6d376
HDFS-7914. TestJournalNode#testFailToStartWithBadConfig fails when the default dfs.journalnode.http-address port 8480 is in use. (Contributed by Xiaoyu Yao)
2015-03-18 14:04:53 -07:00
f0dea037ff
HDFS-7697. Mark the PB OIV tool as experimental. Contributed by Lei (Eddy) Xu.
2015-03-18 13:33:41 -07:00
02a67aad65
Fix CHANGES.txt for HDFS-7722.
2015-03-18 12:52:42 -07:00
e817cedcdc
HDFS-7951. Fix NPE for TestFsDatasetImpl#testAddVolumeFailureReleasesInUseLock on Linux. (Contributed by Xiaoyu Yao)
2015-03-18 12:45:46 -07:00
d462c62755
HDFS-7950. Fix TestFsDatasetImpl#testAddVolumes failure on Windows. (Contributed by Xiaoyu Yao)
2015-03-18 12:35:30 -07:00
fdd58aa32f
HDFS-7948. TestDataNodeHotSwapVolumes#testAddVolumeFailures failed on Windows. (Contributed by Xiaoyu Yao)
2015-03-18 12:26:00 -07:00
402817cd9b
HDFS-7953. NN Web UI fails to navigate to paths that contain #. Contributed by kanaka kumar avvaru.
2015-03-18 11:08:08 -07:00
5b322c6a82
HDFS-7946. TestDataNodeVolumeFailureReporting NPE on Windows. (Contributed by Xiaoyu Yao)
2015-03-17 21:34:31 -07:00
d8846707c5
HDFS-7940. Add tracing to DFSClient#setQuotaByStorageType (Rakesh R via Colin P. McCabe)
2015-03-17 10:47:21 -07:00
018893e81e
HDFS-5356. MiniDFSCluster should close all open FileSystems when shutdown() (Contributed by Rakesh R)
2015-03-17 15:32:34 +05:30
48c2db34ef
HDFS-7838. Expose truncate API for libhdfs. (yliu)
2015-03-17 07:22:17 +08:00
046521cd65
HDFS-2360. Ugly stacktrce when quota exceeds. (harsh)
2015-03-17 10:28:17 +05:30
ce5de93a58
HDFS-7886. Fix TestFileTruncate falures. Contributed by Plamen Jeliazkov and Konstantin Shvachko.
2015-03-16 12:54:04 -07:00
bc9cb3e271
HDFS-7915. The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error (cmccabe)
2015-03-14 22:36:46 -07:00
32741cf3d2
Revert "HDFS-7915. The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error (cmccabe)" (jenkins didn't run yet)
...
This reverts commit 5aa892ed48
2015-03-13 18:40:20 -07:00
5aa892ed48
HDFS-7915. The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error (cmccabe)
2015-03-13 18:29:49 -07:00
dfd3201700
HDFS-2605. Remove redundant "Release 0.21.1" section from CHANGES.txt. Contributed by Allen Wittenauer.
2015-03-13 13:32:45 -07:00
6acb7f2110
HDFS-7903. Cannot recover block after truncate and delete snapshot. Contributed by Plamen Jeliazkov.
2015-03-13 13:12:51 -07:00
d324164a51
HDFS-7435. PB encoding of block reports is very inefficient. Contributed by Daryn Sharp.
2015-03-13 14:23:37 -05:00
f446669afb
HDFS-7926. NameNode implementation of ClientProtocol.truncate(..) is not idempotent. Contributed by Tsz Wo Nicholas Sze
2015-03-13 10:42:22 -07:00
b49c3a1813
HDFS-7722. DataNode#checkDiskError should also remove Storage when error is found. (Lei Xu via Colin P. McCabe)
2015-03-12 12:00:18 -07:00
6dae6d12ec
HDFS-6833. DirectoryScanner should not register a deleting block with memory of DataNode. Contributed by Shinichi Yamashita
2015-03-13 02:25:32 +08:00
fb34f45727
HDFS-7491. Add incremental blockreport latency to DN metrics. Contributed by Ming Ma.
2015-03-11 14:11:19 -07:00
5c1036d598
HDFS-7830. DataNode does not release the volume lock when adding a volume fails. (Lei Xu via Colin P. McCabe)
2015-03-10 18:20:58 -07:00
82db3341bf
HDFS-6806. HDFS Rolling upgrade document should mention the versions available. Contributed by J.Andreina.
2015-03-10 11:22:11 +09:00
e43882e84a
HDFS-7898. Change TestAppendSnapshotTruncate to fail-fast. Contributed by Tsz Wo Nicholas Sze.
2015-03-09 10:52:17 -07:00
b3e699271b
Adding 2.8 section in CHANGES.txt
2015-03-08 20:24:33 -07:00
6ee0d32b98
HDFS-7411. Change decommission logic to throttle by blocks rather
...
than nodes in each interval. Contributed by Andrew Wang
2015-03-08 18:31:04 -07:00
0f8ecb1d0c
HDFS-6488. Support HDFS superuser in NFSv3 gateway. Contributed by Brandon Li
2015-03-06 15:19:45 -08:00
c79710302e
HDFS-7818. OffsetParam should return the default value instead of throwing NPE when the value is unspecified. Contributed by Eric Payne.
2015-03-06 14:26:23 -08:00
01bfe6f05b
HADOOP-11653. shellprofiles should require .sh extension (Brahma Reddy Battula via aw)
2015-03-06 13:54:11 -08:00
24db0812be
HDFS-7885. Datanode should not trust the generation stamp provided by client. Contributed by Tsz Wo Nicholas Sze.
2015-03-06 10:55:56 -08:00
952640fa4c
HDFS-7855. Separate class Packet from DFSOutputStream. Contributed by Li Bo.
2015-03-05 10:58:53 -08:00
74a4754d1c
HADOOP-11648. Set DomainSocketWatcher thread name explicitly. Contributed by Liang Xie.
2015-03-05 16:05:44 +09:00
Kihwal Lee
Uma Maheswara Rao G
Vinayakumar B
Tsuyoshi Ozawa
Akira Ajisaka
Haohui Mai
Tsz-Wo Nicholas Sze
cnauroth
Konstantin V Shvachko
Xiaoyu Yao
Colin Patrick Mccabe
Arpit Agarwal
Arun Suresh
Jonathan Eagles
Yongjun Zhang
Jing Zhao
Andrew Wang
Allen Wittenauer
Vinod Kumar Vavilapalli
Jitendra Pandey
Aaron T. Myers
Andrew Wang
Brandon Li
yliu
Harsh J
Jitendra Pandey
Plamen Jeliazkov
Chris Douglas