Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,065 Commits 326 Branches 371 Tags
Commit Graph

3038 Commits

Author SHA1 Message Date
Vinayakumar B
d0fff5d328 HDFS-8067. haadmin prints out stale help messages (Contributed by Ajith S) 
(cherry picked from commit 66988476d09a6d04c0b81a663db1e6e5a28c37fb)
 2015-05-08 10:47:23 +05:30
Vinayakumar B
00954714a6 HDFS-8257. Namenode rollingUpgrade option is incorrect in document (Contributed by J.Andreina) 
(cherry picked from commit c7c26a1e4aff0b89016ec838d06ba2b628a6808e)
 2015-05-08 10:36:09 +05:30
Haohui Mai
a3abe8d7e4 HDFS-8037. CheckAccess in WebHDFS silently accepts malformed FsActions parameters. Contributed by Walter Su. 2015-05-07 15:25:36 -07:00
Haohui Mai
f6b908ab07 HDFS-8321. CacheDirectives and CachePool operations should throw RetriableException in safemode. Contributed by Haohui Mai. 2015-05-07 15:17:02 -07:00
Tsz-Wo Nicholas Sze
4e1f2eb395 HDFS-7980. Incremental BlockReport will dramatically slow down namenode startup. Contributed by Walter Su 2015-05-07 11:37:33 -07:00
Akira Ajisaka
ab7dab55ea HDFS-8325. Misspelling of threshold in log4j.properties for tests. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 449e4426a5cc1382eef0cbaa9bd4eb2221c89da1)
 2015-05-07 15:15:12 +09:00
cnauroth
276e2d3390 HDFS-7833. DataNode reconfiguration does not recalculate valid volumes required, based on configured failed volumes tolerated. Contributed by Lei (Eddy) Xu. 
(cherry picked from commit 6633a8474d7e92fa028ede8fd6c6e41b6c5887f5)
 2015-05-06 21:11:44 -07:00
Konstantin V Shvachko
193615c4b2 HDFS-2484. checkLease should throw FileNotFoundException when file does not exist. Contributed by Rakesh R. 2015-05-06 16:11:12 -07:00
Colin Patrick Mccabe
f79b1f0190 HDFS-7847. Modify NNThroughputBenchmark to be able to operate on a remote NameNode (Charles Lamb via Colin P. McCabe) 
(cherry picked from commit ffce9a3413277a69444fcb890460c885de56db69)
 2015-05-06 10:50:33 -07:00
Xiaoyu Yao
bd88215393 HDFS-8310. Fix TestCLI.testAll 'help: help for find' on Windows. (Kiran Kumar M R via Xiaoyu Yao) 
(cherry picked from commit 7a26d174aff9535f7a60711bee586e225891b383)
 2015-05-06 10:27:07 -07:00
Haohui Mai
a4f868f0b8 HDFS-8314. Move HdfsServerConstants#IO_FILE_BUFFER_SIZE and SMALL_BUFFER_SIZE to the users. Contributed by Li Lu. 2015-05-05 15:56:08 -07:00
Xiaoyu Yao
e68e8b3b5c HDFS-8219. setStoragePolicy with folder behavior is different after cluster restart. (surendra singh lilhore via Xiaoyu Yao) 
(cherry picked from commit 0100b155019496d077f958904de7d385697d65d9)
 2015-05-05 13:42:22 -07:00
Colin Patrick Mccabe
1f6bcf94cc HDFS-7758. Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead (Lei (Eddy) Xu via Colin P. McCabe) 
(cherry picked from commit 24d3a2d4fdd836ac9a5bc755a7fb9354f7a582b1)
 2015-05-05 11:09:28 -07:00
Colin Patrick Mccabe
1f01d8347a HDFS-8305: HDFS INotify: the destination field of RenameOp should always end with the file name (cmccabe) 
(cherry picked from commit fcd4cb751665adb241081e42b3403c3856b6c6fe)
 2015-05-05 11:06:47 -07:00
Vinayakumar B
01bdfd794c HDFS-7916. 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop (Contributed by Vinayakumar B) 
Reverted earlier commit

(cherry picked from commit 318081ccd7af1ec02ec18f35ea95c579326be728)
 2015-05-05 11:06:44 +05:30
Haohui Mai
db0bd6dca8 HDFS-8237. Move all protocol classes used by ClientProtocol to hdfs-client. Contributed by Haohui Mai. 2015-05-04 15:02:49 -07:00
Colin Patrick Mccabe
8efcf5bdbd HDFS-7397. Add more detail to the documentation for the conf key "dfs.client.read.shortcircuit.streams.cache.size" (Brahma Reddy Battula via Colin P. McCabe) 
(cherry picked from commit 3fe79e1db84391cb17dbed6b579fe9c803b3d1c2)
 2015-05-04 12:50:59 -07:00
cnauroth
a43080a2cf HDFS-8290. WebHDFS calls before namesystem initialization can cause NullPointerException. Contributed by Chris Nauroth. 
(cherry picked from commit c4578760b67d5b5169949a1b059f4472a268ff1b)
 2015-05-04 11:35:18 -07:00
Xiaoyu Yao
5b27d9e076 HDFS-8309. Skip unit test using DataNodeTestUtils#injectDataDirFailure() on Windows. (xyao) 
(cherry picked from commit a319771d1d9eebaf8e4165dba73383a229cb1525)
 2015-05-02 22:32:28 -07:00
Haohui Mai
65a19fbc30 HDFS-8249. Separate HdfsConstants into the client and the server side class. Contributed by Haohui Mai. 2015-05-02 10:03:04 -07:00
Jonathan Eagles
9ed6b77da1 HADOOP-11889. Make checkstyle runnable from root project (Gera Shegalov via jeagles) 
(cherry picked from commit 2d7363b27360e36fdd62546c0f9d0b1d78133f29)

Conflicts:
	pom.xml
 2015-05-01 19:04:41 -07:00
Arpit Agarwal
8e3fdd0a40 HDFS-8229. LAZY_PERSIST file gets deleted after NameNode restart. (Contributed by Surendra Singh Lilhore) 2015-05-01 16:42:35 -07:00
Tsz-Wo Nicholas Sze
72751b957c HDFS-8086. Move LeaseRenewer to the hdfs.client.impl package. Contributed by Takanobu 2015-05-01 15:14:01 -07:00
Arun Suresh
8b6fc83ef4 Updating CHANGES.txt - Pulling in HDFS-8091 to branch-2.7 (for 2.7.1) 
(cherry picked from commit 3393461197da869c3f1e47888e03670106bda023)
 2015-05-01 11:49:38 -07:00
Colin Patrick Mccabe
9edea9507d HDFS-8213. DFSClient should use hdfs.client.htrace HTrace configuration prefix rather than hadoop.htrace (cmccabe) 
(cherry picked from commit b82567d45507c50d2f28eff4bbdf3b1a69d4bf1b)
 2015-05-01 11:47:28 -07:00
Arpit Agarwal
aa81b86898 HDFS-8276. LazyPersistFileScrubber should be disabled if scrubber interval configured zero. (Contributed by Surendra Singh Lilhore) 2015-05-01 11:11:56 -07:00
Jing Zhao
ec7b392965 HDFS-8300. Fix unit test failures and findbugs warning caused by HDFS-8283. Contributed by Jing Zhao. 
(cherry picked from commit 98a61766286321468bf801a9f17a843d7eae8d9e)
 2015-04-30 19:29:11 -07:00
Andrew Wang
34d686e6e9 HDFS-8292. Move conditional in fmt_time from dfs-dust.js to status.html. Contributed by Charles Lamb. 
(cherry picked from commit 87e997823581790cce8d82d20e5e82ef9dd80670)
 2015-04-30 18:23:21 -07:00
Haohui Mai
01acf3a3af HDFS-8200. Refactor FSDirStatAndListingOp. Contributed by Haohui Mai. 2015-04-30 13:41:55 -07:00
Akira Ajisaka
fdb886d656 HDFS-7770. Need document for storage type label of data node storage locations under dfs.data.dir. Contributed by Xiaoyu Yao. 
(cherry picked from commit de9404f02f36bf9a1100c67f41db907d494bb9ed)
 2015-04-30 20:13:18 +09:00
Akira Ajisaka
2f2d0aa990 HDFS-5574. Remove buffer copy in BlockReader.skip. Contributed by Binglin Chang. 
(cherry picked from commit fd06186071bb369ee045b57a82419566e87257ec)
 2015-04-30 19:11:46 +09:00
Andrew Wang
9f8412ac6e HDFS-8214. Secondary NN Web UI shows wrong date for Last Checkpoint. Contributed by Charles Lamb. 
(cherry picked from commit aa22450442ebe39916a6fd460fe97e347945526d)
 2015-04-29 17:38:09 -07:00
Haohui Mai
460127e6f2 HDFS-8269. getBlockLocations() does not resolve the .reserved path and generates incorrect edit logs when updating the atime. Contributed by Haohui Mai. 2015-04-29 11:12:54 -07:00
Jing Zhao
ecdebb7369 HDFS-8283. DataStreamer cleanup and some minor improvement. Contributed by Tsz Wo Nicholas Sze. 
(cherry picked from commit 7947e5b53b9ac9524b535b0384c1c355b74723ff)
 2015-04-29 10:43:52 -07:00
Haohui Mai
fc9e7d7a24 HDFS-8280. Code Cleanup in DFSInputStream. Contributed by Jing Zhao. 2015-04-28 18:12:05 -07:00
Haohui Mai
7bbe9495c4 HDFS-8273. FSNamesystem#Delete() should not call logSync() when holding the lock. Contributed by Haohui Mai. 2015-04-28 18:06:08 -07:00
Tsz-Wo Nicholas Sze
9b62a8ed77 HDFS-8204. Mover/Balancer should not schedule two replicas to the same datanode. Contributed by Walter Su 2015-04-28 13:06:30 -07:00
cnauroth
a82addd614 HDFS-8232. Missing datanode counters when using Metrics2 sink interface. Contributed by Anu Engineer. 
(cherry picked from commit feb68cb5470dc3e6c16b6bc1549141613e360601)
 2015-04-27 16:48:25 -07:00
Arpit Agarwal
de85ff58dc HDFS-8205. Fix CHANGES.txt 2015-04-27 12:30:55 -07:00
Arpit Agarwal
c254a2a671 HDFS-8205. CommandFormat#parse() should not parse option as value of option. (Contributed by Peter Shi and Xiaoyu Yao) 2015-04-27 12:25:45 -07:00
Xiaoyu Yao
7aa3399cc5 HDFS-8206. Fix the typos in hadoop-hdfs-httpfs. (Brahma Reddy Battula via xyao) 2015-04-25 22:24:38 -07:00
cnauroth
8d256c56db HDFS-8247. TestDiskspaceQuotaUpdate#testAppendOverTypeQuota is failing. Contributed by Xiaoyu Yao. 
(cherry picked from commit a00e001a1a9fa2c6287b2f078e425e9bb157e5ca)
 2015-04-25 11:37:41 -07:00
Arpit Agarwal
932cff610a HDFS-8211. DataNode UUID is always null in the JMX counter. (Contributed by Anu Engineer) 2015-04-24 16:47:56 -07:00
Andrew Wang
89a15d6074 HDFS-8191. Fix byte to integer casting in SimulatedFSDataset#simulatedByte. Contributed by Zhe Zhang. 
(cherry picked from commit c7d9ad68e34c7f8b9efada6cfbf7d5474cbeff11)
 2015-04-24 11:54:48 -07:00
Jing Zhao
5870d504e1 HDFS-8176. Record from/to snapshots in audit log for snapshot diff report. Contributed by J. Andreina. 
(cherry picked from commit cf6c8a1b4ee70dd45c2e42ac61999e61a05db035)
 2015-04-24 10:24:12 -07:00
Vinayakumar B
2ec356fcdb HDFS-8231. StackTrace displayed at client while QuotaByStorageType exceeds (Contributed by J.Andreina and Xiaoyu Yao) 
(cherry picked from commit c8d72907ff5a4cb9ce1effca8ad9b69689d11d1d)
 2015-04-24 12:51:56 +05:30
Vinayakumar B
68063cac3e HDFS-8217. During block recovery for truncate Log new Block Id in case of copy-on-truncate is true. (Contributed by Vinayakumar B) 
(cherry picked from commit 262c1bc3398ce2ede03f9d86fc97c35ca7a8e9db)
 2015-04-24 12:18:04 +05:30
Colin Patrick Mccabe
3d0385c3c8 HDFS-8070. Pre-HDFS-7915 DFSClient cannot use short circuit on post-HDFS-7915 DataNode (cmccabe) 
(cherry picked from commit a8898445dc9b5cdb7230e2e23a57393c9f378ff0)
 2015-04-23 19:15:33 -07:00
Colin Patrick Mccabe
788b76761d HADOOP-11802. DomainSocketWatcher thread terminates sometimes after there is an I/O error during requestShortCircuitShm (cmccabe) 
(cherry picked from commit a0e0a63209b5eb17dca5cc503be36aa52defeabd)
 2015-04-23 19:08:20 -07:00
Haohui Mai
b64bb2b9b4 HDFS-8052. Move WebHdfsFileSystem into hadoop-hdfs-client. Contributed by Haohui Mai. 2015-04-23 17:44:21 -07:00