Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,213 Commits 326 Branches 371 Tags
Commit Graph

3073 Commits

Author SHA1 Message Date
Allen Wittenauer
3d0e2e54a1 HADOOP-8934. Shell command ls should include sort options (Jonathan Allen via aw) 
(cherry picked from commit 30b797ee9df30260314eeadffc7d51492871b352)

Conflicts:
	hadoop-common-project/hadoop-common/src/site/apt/FileSystemShell.apt.vm
 2015-05-19 17:38:22 +09:00
Vinayakumar B
6dee42f6db HDFS-6348. SecondaryNameNode not terminating properly on runtime exceptions (Contributed by Rakesh R) 
(cherry picked from commit 93972a332a9fc6390447fc5fc9785c98fb4c3344)
 2015-05-19 12:25:00 +05:30
Ravi Prakash
e5b805d361 HDFS-4185. Add a metric for number of active leases (Rakesh R via raviprak) 
(cherry picked from commit cdfae446ad285db979a79bf55665363fd943702c)
 2015-05-18 12:38:32 -07:00
Tsz-Wo Nicholas Sze
7bd4db968d HDFS-8405. Fix a typo in NamenodeFsck. Contributed by Takanobu Asanuma 2015-05-19 03:01:07 +08:00
Arpit Agarwal
9bcb740049 HDFS-8345. Storage policy APIs must be exposed via the FileSystem interface. (Arpit Agarwal) 2015-05-18 11:49:01 -07:00
Uma Maheswara Rao G
ea875939f1 Revert from branch-2: HDFS-8332. DFS client API calls should check filesystem closed. Contributed by Rakesh R. 2015-05-18 14:38:30 +05:30
Arpit Agarwal
151f6d6dcc HDFS-8157. Writes to RAM DISK reserve locked memory for block files. (Arpit Agarwal) 2015-05-16 09:05:50 -07:00
Haohui Mai
46d62e7016 HDFS-8403. Eliminate retries in TestFileCreation#testOverwriteOpenForWrite. Contributed by Arpit Agarwal. 2015-05-15 19:12:46 -07:00
Haohui Mai
1796d94d62 HDFS-8394. Move getAdditionalBlock() and related functionalities into a separate class. Contributed by Haohui Mai. 2015-05-15 19:10:05 -07:00
Jing Zhao
d6aa65d037 HDFS-8397. Refactor the error handling code in DataStreamer. Contributed by Tsz Wo Nicholas Sze. 
(cherry picked from commit 8f378733423a5244461df79a92c00239514b8b93)
 2015-05-15 16:32:25 -07:00
Vinayakumar B
d9455c790f HDFS-6888. Allow selectively audit logging ops (Contributed by Chen He) 
(cherry picked from commit 7f2e89fa7082840bfa3e8e593c93db050a80d04f)
 2015-05-15 11:05:26 +05:30
Akira Ajisaka
7fb3486eb3 HDFS-8350. Remove old webhdfs.xml and other outdated documentation stuff. Contributed by Brahma Reddy Battula. 2015-05-15 13:57:58 +09:00
Akira Ajisaka
2e5b7f24ab HDFS-8371. Fix test failure in TestHdfsConfigFields for spanreceiver properties. Contributed by Ray Chiang. 
(cherry picked from commit cbc01ed08ea36f70afca6112ccdbf7331567070b)
 2015-05-15 12:15:26 +09:00
Vinayakumar B
4bbcffa510 HDFS-8150. Make getFileChecksum fail for blocks under construction (Contributed by J.Andreina) 
(cherry picked from commit def9136e0259e118e6fd7b656260765d28ac9ae6)
 2015-05-14 15:55:20 +05:30
Haohui Mai
4b5915be9f HDFS-7728. Avoid updating quota usage while loading edits. Contributed by Jing Zhao. 2015-05-13 21:50:41 -07:00
Arpit Agarwal
33f6136ee3 HDFS-8243. Files written by TestHostsFiles and TestNameNodeMXBean are causing Release Audit Warnings. (Contributed by Ruth Wisniewski) 2015-05-13 19:46:34 -07:00
Colin Patrick Mccabe
52da75180a HDFS-8380. Always call addStoredBlock on blocks which have been shifted from one storage to another (cmccabe) 
(cherry picked from commit 281d47a96937bc329b1b4051ffcb8f5fcac98354)
 2015-05-13 14:45:37 -07:00
cnauroth
ddc4afeff2 HADOOP-11966. Variable cygwin is undefined in hadoop-config.sh when executed through hadoop-daemon.sh. Contributed by Chris Nauroth. 2015-05-13 12:25:49 -07:00
Kihwal Lee
2e9392c157 HDFS-8358. TestTraceAdmin fails. Contributed by Masatake Iwasaki. 
(cherry picked from commit f9a46a00d2020c6d6466fbc829ada0521cb78dc0)
 2015-05-13 14:16:37 -05:00
Tsz-Wo Nicholas Sze
bdf8f64be8 HDFS-8143. Mover should exit after some retry when failed to move blocks. Contributed by surendra singh lilhore 2015-05-13 11:58:35 -07:00
Vinayakumar B
2adb1257b1 HDFS-6300. Prevent multiple balancers from running simultaneously (Contributed by Rakesh R) 
(cherry picked from commit 065d8f2a34296b566e7ca541a284f7991212f14c)
 2015-05-13 17:30:40 +05:30
Akira Ajisaka
7596c6e731 HDFS-6184. Capture NN's thread dump when it fails over. Contributed by Ming Ma. 
(cherry picked from commit 2463666ecb553dbde1b8c540a21ad3d599239acf)
 2015-05-13 11:37:59 +09:00
yliu
c31c6fbda7 HDFS-8255. Rename getBlockReplication to getPreferredBlockReplication. (Contributed by Zhe Zhang) 2015-05-12 21:26:57 +08:00
Vinayakumar B
e1b8bb9d84 HDFS-8362. Java Compilation Error in TestHdfsConfigFields.java (Contributed by Arshad Mohammad) 
(cherry picked from commit 987abc99b0309a07f0a342746b2a5048d5c36ce0)
 2015-05-12 12:10:14 +05:30
Kihwal Lee
50778f9d45 HDFS-7916. 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop. Contributed by Rushabh Shah. 
(cherry picked from commit ea11590aad952b5b560a5101d064adf27d8656db)
 2015-05-11 14:33:45 -05:00
Junping Du
a1a7deebf8 YARN-3587. Fix the javadoc of DelegationTokenSecretManager in yarn, etc. projects. Contributed by Gabor Liptak. 
(cherry picked from commit 7e543c27fa2881aa65967be384a6203bd5b2304f)
 2015-05-11 05:28:25 -07:00
Akira Ajisaka
703f1e9d16 HDFS-8351. Remove namenode -finalize option from document. (aajisaka) 
(cherry picked from commit 3fa2efc09f051b6fc6244f0edca46d3d06f4ae3b)
 2015-05-11 15:37:12 +09:00
Haohui Mai
1f499a61dc HDFS-8357. Consolidate parameters of INode.CleanSubtree() into a parameter objects. Contributed by Li Lu. 2015-05-09 22:52:07 -07:00
Haohui Mai
300d36cee7 HDFS-8327. Compute storage type quotas in INodeFile.computeQuotaDeltaForTruncate(). Contributed by Haohui Mai. 2015-05-08 23:09:57 -07:00
Haohui Mai
51bfb66ec8 Add missing entry in CHANGES.txt for HDFS-6757. 2015-05-08 23:09:55 -07:00
Haohui Mai
73d61f7ae7 HDFS-6757. Simplify lease manager with INodeID. Contributed by Haohui Mai. 2015-05-08 23:04:57 -07:00
Arpit Agarwal
969a8f6c96 HDFS-8097. TestFileTruncate is failing intermittently. (Contributed by Rakesh R) 2015-05-08 16:29:01 -07:00
Kihwal Lee
f264a5aeed HDFS-8245. Standby namenode doesn't process DELETED_BLOCK if the addblock request is in edit log. Contributed by Rushabh S Shah. 
(cherry picked from commit 2d4ae3d18bc530fa9f81ee616db8af3395705fb9)
 2015-05-08 16:37:26 -05:00
Colin Patrick Mccabe
ab80a572be HDFS-8113. Add check for null BlockCollection pointers in BlockInfoContiguous structures (Chengbing Liu via Colin P. McCabe) 
(cherry picked from commit f523e963e4d88e4e459352387c6efeab59e7a809)
 2015-05-08 14:00:13 -07:00
Yongjun Zhang
fbb2cf54bc HDFS-8311. DataStreamer.transfer() should timeout the socket InputStream. (Esteban Gutierrez via Yongjun Zhang) 
(cherry picked from commit 730f9930a48259f34e48404aee51e8d641cc3d36)
 2015-05-08 01:38:01 -07:00
Kihwal Lee
30cb540b4d HDFS-7433. Optimize performance of DatanodeManager's node map. Contributed by Daryn Sharp. 
(cherry picked from commit 7a7960be41c32f20ffec9fea811878b113da62db)
 2015-05-08 15:20:14 -05:00
Colin Patrick Mccabe
d83ae68bb0 HDFS-8284. Update documentation about how to use HTrace with HDFS (Masatake Iwasaki via Colin P. McCabe) 
(cherry picked from commit 8f7c2364d7254a1d987b095ba442bf20727796f8)
 2015-05-08 12:30:34 -07:00
cnauroth
5c188908fe HDFS-5640. Add snapshot methods to FileContext. Contributed by Rakesh R. 
(cherry picked from commit 26f61d41df9e90a5053d9265f535cc492196f2a5)
 2015-05-08 11:21:02 -07:00
Arun Suresh
2124742e07 HDFS-7559. Create unit test to automatically compare HDFS related classes and hdfs-default.xml. (Ray Chiang via asuresh) 
(cherry picked from commit 3cefc02af73faa12a6edce904b98ba543167bec5)
 2015-05-08 10:31:23 -07:00
Arpit Agarwal
68d85e92bf HDFS-8340. Fix NFS documentation of nfs.wtmax. (Contributed by Ajith S) 2015-05-08 10:15:35 -07:00
Arpit Agarwal
a0905ae57a HDFS-8274. NFS configuration nfs.dump.dir not working (Contributed by Ajith S) 2015-05-08 10:04:11 -07:00
Haohui Mai
d4d7d7bf22 HDFS-8346. libwebhdfs build fails during link due to unresolved external symbols. Contributed by Chris Nauroth. 2015-05-08 09:58:00 -07:00
Kihwal Lee
802a5775f3 HDFS-7894. Rolling upgrade readiness is not updated in jmx until query command is issued. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 6f622672b62aa8d719060063ef0e47480cdc8655)
 2015-05-08 09:32:07 -05:00
Uma Maheswara Rao G
faf26f081c HDFS-6285. tidy an error log inside BlockReceiver. Contributed by Liang Xie. 
(cherry picked from commit 7b1ea9c481fb8c13fc7b64eb1894d96ddfbf4b5b)
 2015-05-08 17:25:07 +05:30
Vinayakumar B
d129bbbb37 HDFS-3384. DataStreamer thread should be closed immediatly when failed to setup a PipelineForAppendOrRecovery (Contributed by Uma Maheswara Rao G) 
(cherry picked from commit c648317a68891e1c900f04b7a9c98ba40c5faddb)
 2015-05-08 17:18:59 +05:30
Vinayakumar B
a87ab77fec HDFS-6576. Datanode log is generating at root directory in security mode (Contributed by surendra singh lilhore) 2015-05-08 16:37:36 +05:30
Vinayakumar B
3ee1b50dad HDFS-8226. Non-HA rollback compatibility broken (Contributed by J.Andreina) 
Added one missed change, missed while resolving conflict
 2015-05-08 15:39:47 +05:30
Vinayakumar B
3a894b4563 HDFS-8226. Non-HA rollback compatibility broken (Contributed by J.Andreina) 
(cherry picked from commit e01c1a979cbc8fb398d5b7a46693657bc2668a58)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-dfs.sh
	hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HdfsUserGuide.md
 2015-05-08 15:34:17 +05:30
Vinayakumar B
eaa5f3e448 HDFS-8209. Support different number of datanode directories in MiniDFSCluster. (Contributed by surendra singh lilhore) 
(cherry picked from commit 4c6816faf83726c71c9c3981e7280b461f824a4f)
 2015-05-08 15:04:58 +05:30
Tsuyoshi Ozawa
8109f29ee2 HDFS-8207. Improper log message when blockreport interval compared with initial delay. Contributed by Brahma Reddy Battula and Ashish Singhi. 
(cherry picked from commit 888e6309909ee4192ad23e0df79e2918b1ad77ac)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-05-08 18:14:08 +09:00