Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
7,987 Commits 326 Branches 371 Tags
Commit Graph

2584 Commits

Author SHA1 Message Date
Zhe Zhang
3fea7f0a38 HDFS-9688. Test the effect of nested encryption zones in HDFS downgrade. 
Change-Id: I2a802325a2bc82c97012d2c9fb388b292fe3af8f
 2016-02-22 15:11:00 -08:00
Junping Du
43ac0b09e3 Set the release date for 2.6.4. 
(cherry picked from commit ec12ce8f48944c38271399a6e452aa2c2a9f5b80)
(cherry picked from commit a28be9edc72cc4fe42fab107c17bcac6789af4e5)
 2016-02-13 01:51:27 -08:00
Arpit Agarwal
d833823daf HDFS-9752. Permanent write failures may happen to slow writers during datanode rolling upgrades. (Contributed by Walter Su) 2016-02-09 09:41:35 -08:00
Zhe Zhang
1b25855b9b HDFS-9347. Invariant assumption in TestQuorumJournalManager.shutdown() is wrong. Contributed by Wei-Chiu Chuang. 
Change-Id: Idde8522e11c77f82b376e0c90a9bf33d163d5cb9
(cherry picked from commit ef3f3f6bb14cf44bef1778f1091d8ed8a4b764a3)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2016-02-09 10:20:40 +08:00
Vinayakumar B
ea517acfb6 HDFS-9629. Update the footer of Web UI to show year 2016 (Contributed by Xiao Chen and Vinayakumar B) 
(cherry picked from commit ddcd6954d03d3caadc8b69f7b886a3a17c3c9d0c)
(cherry picked from commit 8cdfdbf815bf89eee3184ec7cd00e1924c1ea316)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/datanode/index.html
	hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/hdfs/dfshealth.html
	hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/hdfs/explorer.html
	hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/journal/index.html
	hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/secondary/status.html
 2016-02-04 13:34:54 +05:30
Junping Du
89bfc884a5 Adding release 2.6.5 to CHANGES.txt. 2016-02-02 20:28:20 -08:00
Kihwal Lee
d8416aec3c HDFS-9220. Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum. Contributed by Jing Zhao. 
(cherry picked from commit c7c36cbd6218f46c33d7fb2f60cd52cb29e6d720)
(cherry picked from commit 4cf7f8441a288cefd44f126d60dae1998239892a)

Conflicts:

	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestFileAppend2.java
 2016-02-02 17:10:32 -08:00
Junping Du
cd93382a59 HDFS-8722. Optimize datanode writes for small writes and flushes. Contributed by Kihwal Lee. 2016-02-02 10:37:29 -08:00
Junping Du
30626ad35f HDFS-9178. Slow datanode I/O can cause a wrong node to be marked bad. Contributed by Kihwal Lee. 2016-02-02 10:29:31 -08:00
Junping Du
572b5872fe HDFS-4660. Block corruption can happen during pipeline recovery. Contributed by Kihwal Lee. 2016-02-02 10:16:59 -08:00
Colin Patrick Mccabe
8ef73cd4ce HDFS-7694. FSDataInputStream should support "unbuffer" (cmccabe) 
(cherry picked from commit 6b39ad0865cb2a7960dd59d68178f0bf28865ce2)
(cherry picked from commit e35788aa5a41940651af0b73dfeaeca011556904)
 2016-01-27 08:46:38 -08:00
Tsz-Wo Nicholas Sze
b05bb4984d HDFS-9294. DFSClient deadlock when close file and failed to renew lease. Contributed by Brahma Reddy Battula 2016-01-16 23:39:08 +08:00
Arpit Agarwal
f758dacb70 HDFS-9415. Document dfs.cluster.administrators and dfs.permissions.superusergroup. (Contributed by Xiaobing Zhou) 2016-01-14 14:19:04 -08:00
Junping Du
f5c50cd888 Add missing CHANGES.txt entry for HDFS-8767 for branch-2.6 2016-01-14 06:41:00 -08:00
Kihwal Lee
b91715bc83 Supplement to HDFS-9574. 2016-01-08 13:10:09 -06:00
Kihwal Lee
04b8a19f81 HDFS-9574. Reduce client failures during datanode restart. Contributed by Kihwal Lee. 
(cherry picked from commit b06e39de4fc4f9c35afb472eef0bba2adf91954f)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNodeFaultInjector.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataXceiver.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
 2016-01-08 12:26:05 -06:00
Vinayakumar B
79da1283d6 HDFS-9600. do not check replication if the block is under construction (Contributed by Phil Yang) 
(cherry picked from commit 34cd7cd76505d01ec251e30837c94ab03319a0c1)
(cherry picked from commit aa710bd461b593b0f3d7d7ac41ca68e1aa3fa9d6)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DecommissionManager.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlockManager.java
 2016-01-07 11:52:27 +05:30
Sangjin Lee
51a2e6304a Preparing for 2.6.4 development 2016-01-05 15:40:31 -08:00
Junping Du
236a6ba13e HDFS-9445. Datanode may deadlock while handling a bad volume. Contributed by Walter Su. 2016-01-04 06:27:52 -08:00
Akira Ajisaka
0381556a42 Set release date for 2.6.3 
(cherry picked from commit db99e30f670cb5d73d5ec79671026eeeaf337d3d)
(cherry picked from commit 247ab92464beb55bad58b6e63eeac1a41767f432)
 2016-01-04 16:18:38 +09:00
Akira Ajisaka
1823b3edd0 HADOOP-11252. RPC client does not time out by default. Contributed by Wilfred Spiegelenburg and Masatake Iwasaki. 
(cherry picked from commit 64ae85fd2ea91f46ab3b21f007befbeef8c3c947)
(cherry picked from commit d98cfe611f7cedc58cdecfb5a83829adb2521138)
 2016-01-04 14:38:35 +09:00
Akira Ajisaka
aadc864988 HDFS-6945. BlockManager should remove a block from excessReplicateMap and decrement ExcessBlocks metric when the block is removed. Contributed by Akira AJISAKA. 2016-01-03 15:10:54 -08:00
Vinod Kumar Vavilapalli
e7e0c4c0dd HDFS-9273. Moving to 2.6.3 CHANGES section to reflect the backport. 2015-12-08 11:37:06 -08:00
cnauroth
339714baa0 HDFS-9273. ACLs on root directory may be lost after NN restart. Contributed by Xiao Chen. 
(cherry picked from commit 1b525a9c32fabd8919c80717a58afbfa7fdce27e)
(cherry picked from commit faf1c608990408e2aa59a5e676f86d0c82dbd7f3)
 2015-12-08 11:29:06 -08:00
Zhe Zhang
203c7a648b Addendum fix for HDFS-9314 to fix compilation error caused by diamond operator. 
Change-Id: Ia8b8142c2cd3b5ec413a7da2bf037be64040dc85
 2015-12-04 10:57:24 -08:00
Zhe Zhang
4c631e8c73 HDFS-9314. Improve BlockPlacementPolicyDefault's picking of excess replicas. Contributed by Xiao Chen. 
Change-Id: Idf99293085531165239369155c039b55db0eed83

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-12-04 09:51:17 -08:00
Zhe Zhang
089169e4e5 HDFS-9313. Possible NullPointerException in BlockManager if no excess replica can be chosen. Contributed by Ming Ma. Branch-2.7 patch contributed by Xiao Chen. 
Change-Id: Iadaee6be2b44f7b0322d7b0e58f8fc983ef463f6

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-12-03 23:24:21 -08:00
Zhe Zhang
30dc4334bf HDFS-8647. Abstract BlockManager's rack policy into BlockPlacementPolicy. Contributed by Brahma Reddy Battula. Branch-2.6 patch contributed by Xiao Chen. 
Change-Id: Id08ade6862db1b8caf87ac9d786797d4fa7098a0
 2015-12-03 11:01:01 -08:00
Junping Du
e710a11a7f Creating 2.6.4 entries in CHANGES.txt files. 2015-12-01 08:28:37 -08:00
Andrew Wang
b2dd21e82d HDFS-9470. Encryption zone on root not loaded from fsimage after NN restart. Xiao Chen via wang. 
(cherry picked from commit 9b8e50b424d060e16c1175b1811e7abc476e2468)
(cherry picked from commit ce1111ceea830cce5f0833db55201e0e88c3b199)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java

(cherry picked from commit 10e8a67d23200d2b6fbab7a050adf922b27e77c4)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
 2015-11-30 15:01:08 -08:00
Tsz-Wo Nicholas Sze
d2518fd562 HDFS-9434. Recommission a datanode with 500k blocks may pause NN for 30 seconds for printing info log messags. 2015-11-24 14:34:51 -08:00
Tsz-Wo Nicholas Sze
83fcbd49a7 Revert "HDFS-9434. Recommission a datanode with 500k blocks may pause NN for 30 seconds for printing info log messags." 
This reverts commit 09dbb11566410f2e9101555637ad81c7acc7edfd.
 2015-11-24 14:08:45 -08:00
Tsz-Wo Nicholas Sze
09dbb11566 HDFS-9434. Recommission a datanode with 500k blocks may pause NN for 30 seconds for printing info log messags. 2015-11-24 12:40:24 -08:00
Kihwal Lee
238458b259 HDFS-9289. Make DataStreamer#block thread safe and verify genStamp in commitBlock. Contributed by Chang Li. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java

Change-Id: Ibd44ff1bf92bad7262db724990a6a64c1975ffb6
 2015-11-24 09:44:50 -08:00
Sangjin Lee
b9a6f9aa16 HDFS-9083. Replication violates block placement policy (Rushabh Shah) 2015-11-23 16:06:18 -08:00
Akira Ajisaka
68b1abe5cc HDFS-9431. DistributedFileSystem#concat fails if the target path is relative. Contributed by Kazuho Fujii. 
(cherry picked from commit ac1aa6c8197268ea83f44747199d560be9e299ae)
(cherry picked from commit c74e42b4a2293c8adb99b22929047a8d07242d06)
 2015-11-19 20:56:08 +09:00
Akira Ajisaka
866d0f6f04 HDFS-8615. Correct HTTP method in WebHDFS document. Contributed by Brahma Reddy Battula. 2015-11-17 16:11:47 +09:00
Sangjin Lee
8f8f3b1027 Updated the 2.6.2 final release date. 
(cherry picked from commit a4a6b5b4b470b1e7a3c5e2d38433429c455bc709)
 2015-10-30 18:51:50 -07:00
Jason Lowe
0af4f222a1 Creating 2.6.3 entries in CHANGES.txt files. 
(cherry picked from commit eadf7b3096cb010eb7f0afd9afd4ae0d67b2645f)

Conflicts:

	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-mapreduce-project/CHANGES.txt
	hadoop-yarn-project/CHANGES.txt
 2015-10-30 14:58:42 +00:00
Sangjin Lee
1d3bed1f94 Set the release date for 2.6.2 2015-10-28 20:57:16 -07:00
Sangjin Lee
6466ead9e0 Preparing for 2.6.3 development 2015-10-21 10:58:06 -07:00
Vinod Kumar Vavilapalli
b99a85139e Creating 2.6.2 entries in CHANGES.txt files. 
(cherry picked from commit 33474939a048ac7bbe07df772f0000c84979722f)
 2015-09-25 16:00:06 -07:00
Sangjin Lee
4cb7dbaead Preparing for 2.6.2 development: mvn versions:set -DnewVersion=2.6.2 2015-09-25 15:51:13 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
41d19f4740 Release process for 2.6.1: Set the release date for 2.6.1 2015-09-23 15:15:36 -07:00
Vinod Kumar Vavilapalli
b4d876d837 Set the release date for 2.6.1-RC1 2015-09-16 12:04:57 -07:00
Vinod Kumar Vavilapalli
075d899d10 Set the release date for 2.6.1-RC0 2015-09-09 15:39:02 -07:00
Vinod Kumar Vavilapalli
3462a00dd2 Preparing for release 2.6.1: mvn versions:set -DnewVersion=2.6.1 2015-09-09 15:29:57 -07:00
Colin Patrick Mccabe
adc3405321 HDFS-7552. Change FsVolumeList toString() to fix TestDataNodeVolumeFailureToleration (Liang Xie via Colin P. McCabe) 
(cherry picked from commit a4876c130f1627e59ef055e586640d1933fc49af)

(cherry picked from commit 22f72c79462c424e47610470fd48e871887ac326)
 2015-09-09 14:59:31 -07:00
yliu
0adcfe6c7e HDFS-8863. The remaining space check in BlockPlacementPolicyDefault is flawed. (Kihwal Lee via yliu) 
(cherry picked from commit 146db49f7ff0dec82cd51f366311030404b770d7)
 2015-09-08 22:57:36 -07:00
cnauroth
c3928b3068 HDFS-7570. SecondaryNameNode need twice memory when calling reloadFromImageFile. Contributed by zhaoyunjiong. 
(cherry picked from commit 85aec75ce53445e1abf840076d2e10f1e3c6d69b)
(cherry picked from commit 27eecaef10feb49c4160ad289fd301bba6608973)
 2015-09-08 17:21:58 -07:00