Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,029 Commits 326 Branches 371 Tags
Commit Graph

2987 Commits

Author SHA1 Message Date
Akira Ajisaka
bb6983e153 HDFS-9431. DistributedFileSystem#concat fails if the target path is relative. Contributed by Kazuho Fujii. 
(cherry picked from commit ac1aa6c8197268ea83f44747199d560be9e299ae)
(cherry picked from commit c74e42b4a2293c8adb99b22929047a8d07242d06)
 2015-11-19 20:55:52 +09:00
Ming Ma
1b0f277eae HDFS-9413. getContentSummary() on standby should throw StandbyException. (Brahma Reddy Battula via mingma) 
(cherry picked from commit 02653add98f34deedc27f4da2254d25e83e55b58)
(cherry picked from commit 42b55ff23e5fa30e00a6b56df92777a1899a1952)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

(cherry picked from commit 83200450f67c1fe2b17385ade23051d83c7354bf)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-11-17 16:12:58 +05:30
Akira Ajisaka
ab04c9ab5f HDFS-8615. Correct HTTP method in WebHDFS document. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 1a169a26bcc4e4bab7697965906cb9ca7ef8329e)
(cherry picked from commit 9f9315008e75765de4b905f7d57de9505fb5ca10)
 2015-11-17 16:32:07 +09:00
Kihwal Lee
6f678deb86 HDFS-9383. TestByteArrayManager#testByteArrayManager fails. Contributed by Tsz Wo Nicholas Sze. 
(cherry picked from commit ef926b2e3824475581454c1e17a0d7c94529efde)
 2015-11-09 08:58:58 -06:00
Arpit Agarwal
63ed399e1c HDFS-6481. DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs. (Contributed by szetszwo) 2015-11-06 10:32:34 -08:00
Kihwal Lee
616ed9084b HDFS-4937. ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom(). Contributed by Kihwal Lee. 
(cherry picked from commit ff47f35deed14ba6463cba76f0e6a6c15abb3eca)
 2015-11-05 09:27:36 -06:00
Kihwal Lee
397b554c36 HDFS-9289. Make DataStreamer#block thread safe and verify genStamp in commitBlock. Contributed by Chang Li. 2015-11-04 12:10:59 -06:00
Jason Lowe
7499f71e77 Add 2.7.3 release to CHANGES.txt 
(cherry picked from commit 0383a3973b3b734fb23c331a2256dc92cff05365)

Conflicts:

	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-mapreduce-project/CHANGES.txt
	hadoop-yarn-project/CHANGES.txt
 2015-11-04 16:29:56 +00:00
Vinod Kumar Vavilapalli
09348c4bce Preparing for 2.7.3 development 2015-11-03 15:18:10 -08:00
Kihwal Lee
2c51bbda51 HDFS-9221. HdfsServerConstants#ReplicaState#getState should avoid calling values() since it creates a temporary array. (Staffan Friberg via yliu) 
(cherry picked from commit 0ff1216100d16cfa862854a89cd1be8969b0bd7e)
 2015-11-02 09:07:16 -06:00
yliu
e1798e8f21 Revert "HDFS-4937. ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom(). Contributed by Kihwal Lee." 
This reverts commit c250b21c23945ce2c580186c224cc65ab2b501fc.
 2015-10-31 16:25:53 +08:00
Sangjin Lee
c8767fb68c Updated the 2.6.2 final release date. 
(cherry picked from commit a4a6b5b4b470b1e7a3c5e2d38433429c455bc709)
 2015-10-30 18:53:10 -07:00
Jason Lowe
e894be93f6 Creating 2.6.3 entries in CHANGES.txt files. 
(cherry picked from commit eadf7b3096cb010eb7f0afd9afd4ae0d67b2645f)

Conflicts:

	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-mapreduce-project/CHANGES.txt
	hadoop-yarn-project/CHANGES.txt
 2015-10-30 14:55:33 +00:00
Kihwal Lee
c250b21c23 HDFS-4937. ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom(). Contributed by Kihwal Lee. 
(cherry picked from commit 43539b5ff4ac0874a8a454dc93a2a782b0e0ea8f)
 2015-10-30 09:39:49 -05:00
Kihwal Lee
13b256ed22 HDFS-9083. Replication violates block placement policy. Contributed by Rushabh Shah. 2015-10-28 14:49:41 -05:00
Akira Ajisaka
ce01a5951b HDFS-9317. Document fsck -blockId and -storagepolicy options in branch-2.7. (aajisaka) 2015-10-28 13:14:58 +09:00
Kihwal Lee
59a2072135 HDFS-8950. NameNode refresh doesn't remove DataNodes that are no longer in the allowed list. Contributed by Daniel Templeton. 2015-10-27 16:42:33 -05:00
Kihwal Lee
1d23e1ec07 HDFS-7725. Incorrect 'nodes in service' metrics caused all writes to fail. Contributed by Ming Ma. 
(cherry picked from commit 8104d522690fe9556177893770a388291cea0749)
 2015-10-27 11:09:05 -05:00
Arpit Agarwal
653ef52ef2 HDFS-9305. Delayed heartbeat processing causes storm of subsequent heartbeats. (Contributed by Arpit Agarwal) 2015-10-26 15:47:37 -07:00
Kihwal Lee
f2fd011cc1 HDFS-9290. DFSClient#callAppend() is not backward compatible for slightly older NameNodes. Contributed by Tony Wu. 
(cherry picked from commit b9e0417bdf2b9655dc4256bdb43683eca1ab46be)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
 2015-10-23 16:46:14 -05:00
Kihwal Lee
4cf7f8441a HDFS-9220. Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum. Contributed by Jing Zhao. 
(cherry picked from commit c7c36cbd6218f46c33d7fb2f60cd52cb29e6d720)
 2015-10-15 11:26:14 -05:00
Kihwal Lee
efba749760 HDFS-8676. Delayed rolling upgrade finalization can cause heartbeat expiration. Contributed by Walter Su. 
(cherry picked from commit 5b43db47a313decccdcca8f45c5708aab46396df)
 2015-10-13 13:25:10 -05:00
Kihwal Lee
61388b41e7 HDFS-8656. Preserve compatibility of ClientProtocol#rollingUpgrade after finalization. 
(cherry picked from commit 60b858bfa65e0feb665e1a84784a3d45e9091c66)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/ClientProtocol.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestRollingUpgrade.java
 2015-10-13 10:46:20 -05:00
Kihwal Lee
3a5b9f49df HDFS-7645. Rolling upgrade is restoring blocks from trash multiple times (Contributed by Vinayakumar B and Keisuke Ogiwara) 
(cherry picked from commit abf3ad988ddf07450fccb7ca8f4bb4dd688c118a)
 2015-10-13 10:29:42 -05:00
Kihwal Lee
5cb80992fb HDFS-9178. Slow datanode I/O can cause a wrong node to be marked bad. Contributed by Kihwal Lee. 
(cherry picked from commit 99e5204ff5326430558b6f6fd9da7c44654c15d7)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BlockReceiver.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestClientProtocolForPipelineRecovery.java
 2015-10-07 10:24:55 -05:00
Kihwal Lee
b2bc72a051 HDFS-8850. VolumeScanner thread exits with exception if there is no block pool to be scanned but there are suspicious blocks. (Colin Patrick McCabe via yliu) 
(cherry picked from commit d2b941f94a835f7bdde7714d21a470b505aa582b)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-10-02 14:59:29 -05:00
Kihwal Lee
6e7c76a5bd HDFS-9106. Transfer failure during pipeline recovery causes permanent write failures. Contributed by Kihwal Lee. 2015-09-28 15:19:57 -05:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
2b4c7fcc67 Release process for 2.6.1: Set the release date for 2.6.1 
(cherry picked from commit 1f707ecffd80142c25ef0dee8708da49920646bc)
(cherry picked from commit f48af332a76caa89c9d8fa1d2654d290bffdc183)
 2015-09-23 15:13:09 -07:00
Vinayakumar B
d800e2e9ed HDFS-9043. Doc updation for commands in HDFS Federation (Contributed by J.Andreina) 
(cherry picked from commit 57003fa971658c8482240f70445a6822c7692844)
(cherry picked from commit 96e3fbf401763c10e040b9d7dac2123f97895090)
 2015-09-22 16:40:19 +05:30
Vinayakumar B
7d3e882a49 HDFS-9042. Update document for the Storage policy name (Contributed by J.Andreina) 
(cherry picked from commit d8455479b83e369fe9b5fe305c7beece93722fed)
 2015-09-12 12:37:01 +05:30
Kihwal Lee
f2cc6b5fdf HDFS-8099. Change "DFSInputStream has been closed already" message to debug log level (Charles Lamb via Colin P. McCabe) 
(cherry picked from commit 30acb7372ab97adf9bc86ead529c96cfe36e2396)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-09-11 15:59:29 -05:00
Vinod Kumar Vavilapalli
fb15053124 HDFS-7314. Moving to 2.6.1 CHANGES.txt section. 
(cherry picked from commit f103a70af5c5b01931b5cd2e5782eac5aeeb31cd)
 2015-09-10 16:48:53 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
c05ba079e3 Updating all CHANGES.txt files to move entires from future releases into 2.6.1 
section given the large number of backports to 2.6.1.

(cherry picked from commit fbbb7ff1ed111884d0375c177239073153139848)
(cherry picked from commit cbf90f93f9ab3463307292ddfe6fe98ab8b37842)
 2015-09-10 16:10:56 -07:00
Colin Patrick Mccabe
ee830b0d27 HDFS-8846. Add a unit test for INotify functionality across a layout version upgrade (Zhe Zhang via Colin P. McCabe) 
(cherry picked from commit a4d9acc51d1a977bc333da17780c00c72e8546f1)
(cherry picked from commit 9264b7e119efb70fb355904652beeb97e7ad90b9)
 2015-09-10 11:56:30 -07:00
Ming Ma
decf8a6653 HDFS-7314. When the DFSClient lease cannot be renewed, abort open-for-write files rather than the entire DFSClient. (mingma) 
(cherry picked from commit fbd88f1062f3c4b208724d208e3f501eb196dfab)
(cherry picked from commit 516bbf1c20547dc513126df0d9f0934bb65c10c7)
 2015-09-10 11:56:29 -07:00
Jing Zhao
6c127b44ca HDFS-7609. Avoid retry cache collision when Standby NameNode loading edits. Contributed by Ming Ma. 
(cherry picked from commit 7817674a3a4d097b647dd77f1345787dd376d5ea)
(cherry picked from commit 17fb442a4c4e43105374c97fccd68dd966729a19)
 2015-09-10 11:56:28 -07:00
cnauroth
188096f1fe HDFS-8431. hdfs crypto class not found in Windows. Contributed by Anu Engineer. 
(cherry picked from commit 50eeea13000f0c82e0567410f0f8b611248f8c1b)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs.cmd

(cherry picked from commit 25db34127811fbadb9a698fa3a76e24d426fb0f6)
 2015-09-10 11:56:27 -07:00
Xiaoyu Yao
d3562b4e1d HDFS-8219. setStoragePolicy with folder behavior is different after cluster restart. (surendra singh lilhore via Xiaoyu Yao) 
(cherry picked from commit 0100b155019496d077f958904de7d385697d65d9)
(cherry picked from commit e68e8b3b5cff85bfd8bb5b00b9033f63577856d6)
 2015-09-10 11:56:22 -07:00
Kihwal Lee
cfb27d7f78 HDFS-8046. Allow better control of getContentSummary. Contributed by Kihwal Lee. 
(cherry picked from commit 285b31e75e51ec8e3a796c2cb0208739368ca9b8)

(cherry picked from commit 7e622076d41a85fc9a8600fb270564a085f5cd83)
 2015-09-10 10:53:19 -07:00
Akira Ajisaka
c5a74c5c37 HDFS-9033. dfsadmin -metasave prints "NaN" for cache used%. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 0113e4528deda7563b62a29745fbf209ab31b81a)
(cherry picked from commit eb9e06f8e30a6f930db478683739230f8f5ada5d)
 2015-09-09 17:23:25 +09:00
Jing Zhao
fd100ccbae HDFS-8384. Allow NN to startup if there are files having a lease but are not under construction. Contributed by Jing Zhao. 2015-09-08 10:52:42 -07:00
Tsuyoshi Ozawa
139fd21c83 HADOOP-5323. Trash documentation should describe its directory structure and configurations. Contributed by Weiwei Yang. 
(cherry picked from commit 9a87f81ce6839d1b5ab3d663c1e82c7e572bdeb8)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HdfsDesign.md
 2015-09-03 22:39:12 +09:00
yliu
3ab43accaf HDFS-8995. Flaw in registration bookeeping can make DN die on reconnect. (Kihwal Lee via yliu) 2015-09-02 09:00:22 +08:00
Kihwal Lee
285dad32eb fix merge error in CHANGES.TXT 2015-08-28 15:37:07 -05:00
Kihwal Lee
42aa880df3 HDFS-8879. Quota by storage type usage incorrectly initialized upon namenode restart. Contributed by Xiaoyu Yao. 
(cherry picked from commit 3e715a4f4c46bcd8b3054cb0566e526c46bd5d66)
 2015-08-28 13:27:17 -05:00
Jing Zhao
ba0f66984c HDFS-8891. HDFS concat should keep srcs order. Contributed by Yong Zhang. 
(cherry picked from commit dc7a061668a3f4d86fe1b07a40d46774b5386938)
(cherry picked from commit 2edfc3ce715e47ce8deb1525f0040635fd8cf3a6)
 2015-08-20 20:42:20 -07:00
Vinod Kumar Vavilapalli
9faee040f9 Creating 2.6.2 entries in CHANGES.txt files. 
(cherry picked from commit 33474939a048ac7bbe07df772f0000c84979722f)
 2015-08-20 17:39:29 -07:00
yliu
d4b6c4a3cd HDFS-8863. The remaining space check in BlockPlacementPolicyDefault is flawed. (Kihwal Lee via yliu) 2015-08-20 20:43:26 +08:00
Jing Zhao
4c005a4e16 HDFS-8867. Enable optimized block reports. Contributed by Daryn Sharp. 
(cherry picked from commit f61120d964a609ae5eabeb5c4d6c9afe0a15cad8)
(cherry picked from commit c0a4cd978a9142a1fb9f6367d9af0dc7f0e711d9)
 2015-08-19 10:41:30 -07:00
Akira Ajisaka
f98b5ae3bb HDFS-8852. HDFS architecture documentation of version 2.x is outdated about append write support. Contributed by Ajith S. 
(cherry picked from commit fc509f66d814e7a5ed81d5d73b23c400625d573b)
(cherry picked from commit 38b344adfa7a0e57cad8931fb5c699ad4d48150f)
 2015-08-18 23:33:28 +09:00