Commit Graph

2683 Commits

Author SHA1 Message Date
Arpit Agarwal 8e3fdd0a40 HDFS-8229. LAZY_PERSIST file gets deleted after NameNode restart. (Contributed by Surendra Singh Lilhore) 2015-05-01 16:42:35 -07:00
Tsz-Wo Nicholas Sze 72751b957c HDFS-8086. Move LeaseRenewer to the hdfs.client.impl package. Contributed by Takanobu 2015-05-01 15:14:01 -07:00
Arun Suresh 8b6fc83ef4 Updating CHANGES.txt - Pulling in HDFS-8091 to branch-2.7 (for 2.7.1)
(cherry picked from commit 3393461197)
2015-05-01 11:49:38 -07:00
Colin Patrick Mccabe 9edea9507d HDFS-8213. DFSClient should use hdfs.client.htrace HTrace configuration prefix rather than hadoop.htrace (cmccabe)
(cherry picked from commit b82567d455)
2015-05-01 11:47:28 -07:00
Arpit Agarwal aa81b86898 HDFS-8276. LazyPersistFileScrubber should be disabled if scrubber interval configured zero. (Contributed by Surendra Singh Lilhore) 2015-05-01 11:11:56 -07:00
Jing Zhao ec7b392965 HDFS-8300. Fix unit test failures and findbugs warning caused by HDFS-8283. Contributed by Jing Zhao.
(cherry picked from commit 98a6176628)
2015-04-30 19:29:11 -07:00
Andrew Wang 34d686e6e9 HDFS-8292. Move conditional in fmt_time from dfs-dust.js to status.html. Contributed by Charles Lamb.
(cherry picked from commit 87e9978235)
2015-04-30 18:23:21 -07:00
Haohui Mai 01acf3a3af HDFS-8200. Refactor FSDirStatAndListingOp. Contributed by Haohui Mai. 2015-04-30 13:41:55 -07:00
Akira Ajisaka fdb886d656 HDFS-7770. Need document for storage type label of data node storage locations under dfs.data.dir. Contributed by Xiaoyu Yao.
(cherry picked from commit de9404f02f)
2015-04-30 20:13:18 +09:00
Akira Ajisaka 2f2d0aa990 HDFS-5574. Remove buffer copy in BlockReader.skip. Contributed by Binglin Chang.
(cherry picked from commit fd06186071bb369ee045b57a82419566e87257ec)
2015-04-30 19:11:46 +09:00
Andrew Wang 9f8412ac6e HDFS-8214. Secondary NN Web UI shows wrong date for Last Checkpoint. Contributed by Charles Lamb.
(cherry picked from commit aa22450442)
2015-04-29 17:38:09 -07:00
Haohui Mai 460127e6f2 HDFS-8269. getBlockLocations() does not resolve the .reserved path and generates incorrect edit logs when updating the atime. Contributed by Haohui Mai. 2015-04-29 11:12:54 -07:00
Jing Zhao ecdebb7369 HDFS-8283. DataStreamer cleanup and some minor improvement. Contributed by Tsz Wo Nicholas Sze.
(cherry picked from commit 7947e5b53b)
2015-04-29 10:43:52 -07:00
Haohui Mai fc9e7d7a24 HDFS-8280. Code Cleanup in DFSInputStream. Contributed by Jing Zhao. 2015-04-28 18:12:05 -07:00
Haohui Mai 7bbe9495c4 HDFS-8273. FSNamesystem#Delete() should not call logSync() when holding the lock. Contributed by Haohui Mai. 2015-04-28 18:06:08 -07:00
Tsz-Wo Nicholas Sze 9b62a8ed77 HDFS-8204. Mover/Balancer should not schedule two replicas to the same datanode. Contributed by Walter Su 2015-04-28 13:06:30 -07:00
cnauroth a82addd614 HDFS-8232. Missing datanode counters when using Metrics2 sink interface. Contributed by Anu Engineer.
(cherry picked from commit feb68cb547)
2015-04-27 16:48:25 -07:00
Arpit Agarwal de85ff58dc HDFS-8205. Fix CHANGES.txt 2015-04-27 12:30:55 -07:00
Arpit Agarwal c254a2a671 HDFS-8205. CommandFormat#parse() should not parse option as value of option. (Contributed by Peter Shi and Xiaoyu Yao) 2015-04-27 12:25:45 -07:00
Xiaoyu Yao 7aa3399cc5 HDFS-8206. Fix the typos in hadoop-hdfs-httpfs. (Brahma Reddy Battula via xyao) 2015-04-25 22:24:38 -07:00
cnauroth 8d256c56db HDFS-8247. TestDiskspaceQuotaUpdate#testAppendOverTypeQuota is failing. Contributed by Xiaoyu Yao.
(cherry picked from commit a00e001a1a)
2015-04-25 11:37:41 -07:00
Arpit Agarwal 932cff610a HDFS-8211. DataNode UUID is always null in the JMX counter. (Contributed by Anu Engineer) 2015-04-24 16:47:56 -07:00
Andrew Wang 89a15d6074 HDFS-8191. Fix byte to integer casting in SimulatedFSDataset#simulatedByte. Contributed by Zhe Zhang.
(cherry picked from commit c7d9ad68e3)
2015-04-24 11:54:48 -07:00
Jing Zhao 5870d504e1 HDFS-8176. Record from/to snapshots in audit log for snapshot diff report. Contributed by J. Andreina.
(cherry picked from commit cf6c8a1b4e)
2015-04-24 10:24:12 -07:00
Vinayakumar B 2ec356fcdb HDFS-8231. StackTrace displayed at client while QuotaByStorageType exceeds (Contributed by J.Andreina and Xiaoyu Yao)
(cherry picked from commit c8d72907ff)
2015-04-24 12:51:56 +05:30
Vinayakumar B 68063cac3e HDFS-8217. During block recovery for truncate Log new Block Id in case of copy-on-truncate is true. (Contributed by Vinayakumar B)
(cherry picked from commit 262c1bc339)
2015-04-24 12:18:04 +05:30
Colin Patrick Mccabe 3d0385c3c8 HDFS-8070. Pre-HDFS-7915 DFSClient cannot use short circuit on post-HDFS-7915 DataNode (cmccabe)
(cherry picked from commit a8898445dc)
2015-04-23 19:15:33 -07:00
Haohui Mai b64bb2b9b4 HDFS-8052. Move WebHdfsFileSystem into hadoop-hdfs-client. Contributed by Haohui Mai. 2015-04-23 17:44:21 -07:00
Tsz-Wo Nicholas Sze f27a976a2f HDFS-8215. Refactor NamenodeFsck#check method. Contributed by Takanobu Asanuma 2015-04-23 14:23:02 -07:00
Tsz-Wo Nicholas Sze d6c8609663 HDFS-8147. StorageGroup in Dispatcher should override equals nad hashCode. Contributed by surendra singh lilhore 2015-04-23 11:56:09 -07:00
Arun Suresh 889b92fa40 HDFS-4448. Allow HA NN to start in secure mode with wildcard address configured (atm via asuresh)
(cherry picked from commit baf8bc6c48)
2015-04-23 01:45:33 -07:00
Haohui Mai 71c9f2f4e7 HDFS-8218. Move classes that used by ClientProtocol into hdfs-client. Contributed by Haohui Mai. 2015-04-22 11:33:32 -07:00
Haohui Mai f02ca4ab15 HDFS-8185. Separate client related routines in HAUtil into a new class. Contributed by Haohui Mai. 2015-04-21 22:09:13 -07:00
Colin Patrick Mccabe 447f2f699e HDFS-8133. Improve readability of deleted block check (Daryn Sharp via Colin P. McCabe)
(cherry picked from commit 997408eaac)
2015-04-21 12:06:33 -07:00
Arpit Agarwal 7b3acc5c9d HDFS-8163. Using monotonicNow for block report scheduling causes test failures on recently restarted systems. (Arpit Agarwal) 2015-04-21 10:58:12 -07:00
Vinayakumar B e7bb0fc922 HDFS-7993. Provide each Replica details in fsck (Contributed by J.Andreina)
(cherry picked from commit 8ddbb8dd43)
2015-04-21 15:27:15 +05:30
Vinod Kumar Vavilapalli 27fc4fb998 Set the release date for 2.7.0
(cherry picked from commit d52de61544)
2015-04-20 20:18:01 -07:00
Vinayakumar B 961051e569 HDFS-7916. 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop (Contributed by Vinayakumar B)
Updated CHANGES.TXT for correct version

(cherry picked from commit ed4137cebf)
2015-04-21 08:00:37 +05:30
Arpit Agarwal 95a8d452c5 HDFS-8179. DFSClient#getServerDefaults returns null within 1 hour of system start. (Contributed by Xiaoyu Yao) 2015-04-20 15:42:49 -07:00
Vinayakumar B c562e1b19b HDFS-8173. NPE thrown at DataNode shutdown when HTTP server was not able to create (Contributed by surendra singh lilhore)
(cherry picked from commit c17cd4f7c1)
2015-04-20 14:58:59 +05:30
Haohui Mai 5d3a4d51bd HDFS-8169. Move LocatedBlocks and related classes to hdfs-client. Contributed by Haohui Mai. 2015-04-20 00:36:19 -07:00
Arpit Agarwal 490fac391c HDFS-8152. Refactoring of lazy persist storage cases. (Arpit Agarwal) 2015-04-19 16:09:12 -07:00
Tsuyoshi Ozawa 890238b496 HDFS-8043. NPE in MiniDFSCluster teardown. Contributed by Brahma Reddy Battula.
(cherry picked from commit 5459b241c8)
2015-04-19 18:23:57 +09:00
Tsuyoshi Ozawa e083c07913 HDFS-7863. Missing description of some methods and parameters in javadoc of FSDirDeleteOp. Contributed by Brahma Reddy Battula.
(cherry picked from commit 5112477d9e)
2015-04-19 18:07:19 +09:00
Haohui Mai a825243280 HDFS-8165. Move GRANDFATHER_GENERATION_STAMP and GRANDFATER_INODE_ID to hdfs-client. Contributed by Haohui Mai. 2015-04-16 22:54:33 -07:00
Jitendra Pandey 04962efe43 HDFS-8153. Error Message points to wrong parent directory in case of path component name length error. Contributed by Anu Engineer.
cherry picked from 369ddc67bd
2015-04-16 22:15:57 -07:00
Tsz-Wo Nicholas Sze fa7b18e387 HDFS-7891. A block placement policy with best rack failure tolerance. Contributed by Walter Su 2015-04-16 18:26:46 -07:00
Akira Ajisaka d363f853ab Revert "Merge r1588258 from trunk, HDFS-6153. Document "fileId" and "childrenNum" fields in the FileStatus Json schema"
This reverts commit 641cbc0feb.
2015-04-16 16:50:04 -05:00
Tsz-Wo Nicholas Sze bad547d969 HDFS-8082. Move dfs.client.read.*, dfs.client.short.circuit.*, dfs.client.mmap.* and dfs.client.hedged.read.* conf from DFSConfigKeys to HdfsClientConfigKeys. 2015-04-16 13:27:15 -07:00
Haohui Mai e1ebad8203 HDFS-8135. Remove the deprecated FSConstants class. Contributed by Li Lu. 2015-04-16 11:26:13 -07:00