Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,990 Commits 326 Branches 371 Tags
Commit Graph

3014 Commits

Author SHA1 Message Date
Colin Patrick Mccabe
9edea9507d HDFS-8213. DFSClient should use hdfs.client.htrace HTrace configuration prefix rather than hadoop.htrace (cmccabe) 
(cherry picked from commit b82567d45507c50d2f28eff4bbdf3b1a69d4bf1b)
 2015-05-01 11:47:28 -07:00
Arpit Agarwal
aa81b86898 HDFS-8276. LazyPersistFileScrubber should be disabled if scrubber interval configured zero. (Contributed by Surendra Singh Lilhore) 2015-05-01 11:11:56 -07:00
Jing Zhao
ec7b392965 HDFS-8300. Fix unit test failures and findbugs warning caused by HDFS-8283. Contributed by Jing Zhao. 
(cherry picked from commit 98a61766286321468bf801a9f17a843d7eae8d9e)
 2015-04-30 19:29:11 -07:00
Andrew Wang
34d686e6e9 HDFS-8292. Move conditional in fmt_time from dfs-dust.js to status.html. Contributed by Charles Lamb. 
(cherry picked from commit 87e997823581790cce8d82d20e5e82ef9dd80670)
 2015-04-30 18:23:21 -07:00
Haohui Mai
01acf3a3af HDFS-8200. Refactor FSDirStatAndListingOp. Contributed by Haohui Mai. 2015-04-30 13:41:55 -07:00
Akira Ajisaka
fdb886d656 HDFS-7770. Need document for storage type label of data node storage locations under dfs.data.dir. Contributed by Xiaoyu Yao. 
(cherry picked from commit de9404f02f36bf9a1100c67f41db907d494bb9ed)
 2015-04-30 20:13:18 +09:00
Akira Ajisaka
2f2d0aa990 HDFS-5574. Remove buffer copy in BlockReader.skip. Contributed by Binglin Chang. 
(cherry picked from commit fd06186071bb369ee045b57a82419566e87257ec)
 2015-04-30 19:11:46 +09:00
Andrew Wang
9f8412ac6e HDFS-8214. Secondary NN Web UI shows wrong date for Last Checkpoint. Contributed by Charles Lamb. 
(cherry picked from commit aa22450442ebe39916a6fd460fe97e347945526d)
 2015-04-29 17:38:09 -07:00
Haohui Mai
460127e6f2 HDFS-8269. getBlockLocations() does not resolve the .reserved path and generates incorrect edit logs when updating the atime. Contributed by Haohui Mai. 2015-04-29 11:12:54 -07:00
Jing Zhao
ecdebb7369 HDFS-8283. DataStreamer cleanup and some minor improvement. Contributed by Tsz Wo Nicholas Sze. 
(cherry picked from commit 7947e5b53b9ac9524b535b0384c1c355b74723ff)
 2015-04-29 10:43:52 -07:00
Haohui Mai
fc9e7d7a24 HDFS-8280. Code Cleanup in DFSInputStream. Contributed by Jing Zhao. 2015-04-28 18:12:05 -07:00
Haohui Mai
7bbe9495c4 HDFS-8273. FSNamesystem#Delete() should not call logSync() when holding the lock. Contributed by Haohui Mai. 2015-04-28 18:06:08 -07:00
Tsz-Wo Nicholas Sze
9b62a8ed77 HDFS-8204. Mover/Balancer should not schedule two replicas to the same datanode. Contributed by Walter Su 2015-04-28 13:06:30 -07:00
cnauroth
a82addd614 HDFS-8232. Missing datanode counters when using Metrics2 sink interface. Contributed by Anu Engineer. 
(cherry picked from commit feb68cb5470dc3e6c16b6bc1549141613e360601)
 2015-04-27 16:48:25 -07:00
Arpit Agarwal
de85ff58dc HDFS-8205. Fix CHANGES.txt 2015-04-27 12:30:55 -07:00
Arpit Agarwal
c254a2a671 HDFS-8205. CommandFormat#parse() should not parse option as value of option. (Contributed by Peter Shi and Xiaoyu Yao) 2015-04-27 12:25:45 -07:00
Xiaoyu Yao
7aa3399cc5 HDFS-8206. Fix the typos in hadoop-hdfs-httpfs. (Brahma Reddy Battula via xyao) 2015-04-25 22:24:38 -07:00
cnauroth
8d256c56db HDFS-8247. TestDiskspaceQuotaUpdate#testAppendOverTypeQuota is failing. Contributed by Xiaoyu Yao. 
(cherry picked from commit a00e001a1a9fa2c6287b2f078e425e9bb157e5ca)
 2015-04-25 11:37:41 -07:00
Arpit Agarwal
932cff610a HDFS-8211. DataNode UUID is always null in the JMX counter. (Contributed by Anu Engineer) 2015-04-24 16:47:56 -07:00
Andrew Wang
89a15d6074 HDFS-8191. Fix byte to integer casting in SimulatedFSDataset#simulatedByte. Contributed by Zhe Zhang. 
(cherry picked from commit c7d9ad68e34c7f8b9efada6cfbf7d5474cbeff11)
 2015-04-24 11:54:48 -07:00
Jing Zhao
5870d504e1 HDFS-8176. Record from/to snapshots in audit log for snapshot diff report. Contributed by J. Andreina. 
(cherry picked from commit cf6c8a1b4ee70dd45c2e42ac61999e61a05db035)
 2015-04-24 10:24:12 -07:00
Vinayakumar B
2ec356fcdb HDFS-8231. StackTrace displayed at client while QuotaByStorageType exceeds (Contributed by J.Andreina and Xiaoyu Yao) 
(cherry picked from commit c8d72907ff5a4cb9ce1effca8ad9b69689d11d1d)
 2015-04-24 12:51:56 +05:30
Vinayakumar B
68063cac3e HDFS-8217. During block recovery for truncate Log new Block Id in case of copy-on-truncate is true. (Contributed by Vinayakumar B) 
(cherry picked from commit 262c1bc3398ce2ede03f9d86fc97c35ca7a8e9db)
 2015-04-24 12:18:04 +05:30
Colin Patrick Mccabe
3d0385c3c8 HDFS-8070. Pre-HDFS-7915 DFSClient cannot use short circuit on post-HDFS-7915 DataNode (cmccabe) 
(cherry picked from commit a8898445dc9b5cdb7230e2e23a57393c9f378ff0)
 2015-04-23 19:15:33 -07:00
Colin Patrick Mccabe
788b76761d HADOOP-11802. DomainSocketWatcher thread terminates sometimes after there is an I/O error during requestShortCircuitShm (cmccabe) 
(cherry picked from commit a0e0a63209b5eb17dca5cc503be36aa52defeabd)
 2015-04-23 19:08:20 -07:00
Haohui Mai
b64bb2b9b4 HDFS-8052. Move WebHdfsFileSystem into hadoop-hdfs-client. Contributed by Haohui Mai. 2015-04-23 17:44:21 -07:00
Tsz-Wo Nicholas Sze
f27a976a2f HDFS-8215. Refactor NamenodeFsck#check method. Contributed by Takanobu Asanuma 2015-04-23 14:23:02 -07:00
Tsz-Wo Nicholas Sze
d6c8609663 HDFS-8147. StorageGroup in Dispatcher should override equals nad hashCode. Contributed by surendra singh lilhore 2015-04-23 11:56:09 -07:00
Arun Suresh
889b92fa40 HDFS-4448. Allow HA NN to start in secure mode with wildcard address configured (atm via asuresh) 
(cherry picked from commit baf8bc6c488de170d2caf76d9fa4c99faaa8f1a6)
 2015-04-23 01:45:33 -07:00
Haohui Mai
71c9f2f4e7 HDFS-8218. Move classes that used by ClientProtocol into hdfs-client. Contributed by Haohui Mai. 2015-04-22 11:33:32 -07:00
Haohui Mai
f02ca4ab15 HDFS-8185. Separate client related routines in HAUtil into a new class. Contributed by Haohui Mai. 2015-04-21 22:09:13 -07:00
Colin Patrick Mccabe
447f2f699e HDFS-8133. Improve readability of deleted block check (Daryn Sharp via Colin P. McCabe) 
(cherry picked from commit 997408eaaceef20b053ee7344468e28cb9a1379b)
 2015-04-21 12:06:33 -07:00
Arpit Agarwal
7b3acc5c9d HDFS-8163. Using monotonicNow for block report scheduling causes test failures on recently restarted systems. (Arpit Agarwal) 2015-04-21 10:58:12 -07:00
Vinayakumar B
e7bb0fc922 HDFS-7993. Provide each Replica details in fsck (Contributed by J.Andreina) 
(cherry picked from commit 8ddbb8dd433862509bd9b222dddafe2c3a74778a)
 2015-04-21 15:27:15 +05:30
Vinod Kumar Vavilapalli
27fc4fb998 Set the release date for 2.7.0 
(cherry picked from commit d52de61544060a04a273114f55979e7e929a576c)
 2015-04-20 20:18:01 -07:00
Vinayakumar B
961051e569 HDFS-7916. 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop (Contributed by Vinayakumar B) 
Updated CHANGES.TXT for correct version

(cherry picked from commit ed4137cebf27717e9c79eae515b0b83ab6676465)
 2015-04-21 08:00:37 +05:30
Arpit Agarwal
95a8d452c5 HDFS-8179. DFSClient#getServerDefaults returns null within 1 hour of system start. (Contributed by Xiaoyu Yao) 2015-04-20 15:42:49 -07:00
Vinayakumar B
c562e1b19b HDFS-8173. NPE thrown at DataNode shutdown when HTTP server was not able to create (Contributed by surendra singh lilhore) 
(cherry picked from commit c17cd4f7c163cf97d6e42865df25709f29d39e3d)
 2015-04-20 14:58:59 +05:30
Haohui Mai
5d3a4d51bd HDFS-8169. Move LocatedBlocks and related classes to hdfs-client. Contributed by Haohui Mai. 2015-04-20 00:36:19 -07:00
Arpit Agarwal
490fac391c HDFS-8152. Refactoring of lazy persist storage cases. (Arpit Agarwal) 2015-04-19 16:09:12 -07:00
Tsuyoshi Ozawa
890238b496 HDFS-8043. NPE in MiniDFSCluster teardown. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 5459b241c86cc9a26fecca9a06ceaf524e48fed4)
 2015-04-19 18:23:57 +09:00
Tsuyoshi Ozawa
e083c07913 HDFS-7863. Missing description of some methods and parameters in javadoc of FSDirDeleteOp. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 5112477d9e1f1ebc7d91757924c4bdc6eabc35a9)
 2015-04-19 18:07:19 +09:00
Haohui Mai
a825243280 HDFS-8165. Move GRANDFATHER_GENERATION_STAMP and GRANDFATER_INODE_ID to hdfs-client. Contributed by Haohui Mai. 2015-04-16 22:54:33 -07:00
Jitendra Pandey
04962efe43 HDFS-8153. Error Message points to wrong parent directory in case of path component name length error. Contributed by Anu Engineer. 
cherry picked from 369ddc67bdaf61cca3f2f766ab504e2932f6fb72
 2015-04-16 22:15:57 -07:00
Tsz-Wo Nicholas Sze
fa7b18e387 HDFS-7891. A block placement policy with best rack failure tolerance. Contributed by Walter Su 2015-04-16 18:26:46 -07:00
Akira Ajisaka
d363f853ab Revert "Merge r1588258 from trunk, HDFS-6153. Document "fileId" and "childrenNum" fields in the FileStatus Json schema" 
This reverts commit 641cbc0febe546e350a5fd4f37e717f2b8e52d6f.
 2015-04-16 16:50:04 -05:00
Tsz-Wo Nicholas Sze
bad547d969 HDFS-8082. Move dfs.client.read.*, dfs.client.short.circuit.*, dfs.client.mmap.* and dfs.client.hedged.read.* conf from DFSConfigKeys to HdfsClientConfigKeys. 2015-04-16 13:27:15 -07:00
Haohui Mai
e1ebad8203 HDFS-8135. Remove the deprecated FSConstants class. Contributed by Li Lu. 2015-04-16 11:26:13 -07:00
Andrew Wang
9123f26c73 HDFS-8142. DistributedFileSystem encryption zone commands should resolve relative paths. Contributed by Rakesh R. 
(cherry picked from commit 2e8ea780a45c0eccb8f106b2bf072b59446a1cc4)
 2015-04-16 07:14:53 -07:00
Akira Ajisaka
6d183561ff HDFS-8149. The footer of the Web UI "Hadoop, 2014" is old. Contributed by Brahma Reddy Battula. 
(cherry picked from commit de0f1700c150a819b38028c44ef1926507086e6c)
 2015-04-15 15:32:08 -05:00