Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,020 Commits 326 Branches 371 Tags
Commit Graph

2594 Commits

Author SHA1 Message Date
Kihwal Lee
867b29be9c HDFS-8581. ContentSummary on / skips further counts on yielding lock (contributed by J.Andreina) 
(cherry picked from commit 4014ce5990bff9b0ecb3d38a633d40eaf6cf07a7)
(cherry picked from commit 8854cdd9eefd05c10d0518528a3bff6a7348f37e)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2016-06-14 08:31:00 -05:00
Zhe Zhang
1b00cebcdb HDFS-10458. getFileEncryptionInfo should return quickly for non-encrypted cluster. 
(cherry picked from commit 9b68eda2746702246c7f4b4abe412c974ba56339)
(cherry picked from commit 6de9213df111a9a4ed875db995d67af72d08a798)
(cherry picked from commit 06e38c835d0ad9619d4bea662f2dd7d0f62007a9)
(cherry picked from commit 0274636529cfac4d64582a7c21631aebbf4deb1b)
 2016-06-07 10:42:19 -07:00
Colin Patrick Mccabe
167e54ed34 HDFS-10377. CacheReplicationMonitor shutdown log message should use INFO level (Yiqun Lin via cmccabe) 
(cherry picked from commit f0252ad2525c90b2b89ae2ff1de12482da2c8ddd)
(cherry picked from commit 43f32d3f4a86d8f2a302530831003496c78fd561)
(cherry picked from commit 154332bb5463998d5e8f2251c8010d624f5e85a9)
(cherry picked from commit a61e04171f36ce75a8b5b501bc883e46fa67ef08)
 2016-05-10 11:22:42 -07:00
Haohui Mai
a9beec0221 HDFS-7258. CacheReplicationMonitor rescan schedule log should use DEBUG level instead of INFO level. Contributed by Xiaoyu Yao. 
(cherry picked from commit 0942c99eba12f6baf5609c9621cd07b09618a97e)
 2016-05-06 14:05:00 -07:00
Harsh J
916f949131 HDFS-2580. NameNode#main(...) can make use of GenericOptionsParser. Contributed by harsh. (harsh) 
(cherry picked from commit 54e612bfb9f877e58f7f153c43cb4147876826d3)
 2016-05-02 17:50:30 -07:00
Arpit Agarwal
fffa13b2d6 HDFS-10264. Logging improvements in FSImageFormatProtobuf.Saver. (Contributed by Xiaobing Zhou) 2016-04-21 14:55:54 -07:00
Vinayakumar B
5eb7b68efe Changed version to 2.6.5-SNAPSHOT 2016-04-12 12:06:27 +05:30
Vinayakumar B
a8b1a63b8f Addendum: HDFS-10271. 
Added CHANGES.txt entry

(cherry picked from commit b52ac3cb4d49a9ec9f3e5f1ed7a5f40521ef3cf1)
 2016-04-12 11:57:28 +05:30
Vinayakumar B
713ba2a732 HDFS-10271. Extra bytes are getting released from reservedSpace for append (Contributed by Brahma Reddy Battula) 
(cherry picked from commit 37e4e45390007536cb53f375d529910d65cd5d19)
 2016-04-12 11:33:13 +05:30
Walter Su
173681a477 HDFS-10182. Hedged read might overwrite user's buf. Contributed by zhouyingchao. 2016-03-29 16:10:50 +08:00
Zhe Zhang
3fea7f0a38 HDFS-9688. Test the effect of nested encryption zones in HDFS downgrade. 
Change-Id: I2a802325a2bc82c97012d2c9fb388b292fe3af8f
 2016-02-22 15:11:00 -08:00
Junping Du
43ac0b09e3 Set the release date for 2.6.4. 
(cherry picked from commit ec12ce8f48944c38271399a6e452aa2c2a9f5b80)
(cherry picked from commit a28be9edc72cc4fe42fab107c17bcac6789af4e5)
 2016-02-13 01:51:27 -08:00
Arpit Agarwal
d833823daf HDFS-9752. Permanent write failures may happen to slow writers during datanode rolling upgrades. (Contributed by Walter Su) 2016-02-09 09:41:35 -08:00
Zhe Zhang
1b25855b9b HDFS-9347. Invariant assumption in TestQuorumJournalManager.shutdown() is wrong. Contributed by Wei-Chiu Chuang. 
Change-Id: Idde8522e11c77f82b376e0c90a9bf33d163d5cb9
(cherry picked from commit ef3f3f6bb14cf44bef1778f1091d8ed8a4b764a3)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2016-02-09 10:20:40 +08:00
Vinayakumar B
ea517acfb6 HDFS-9629. Update the footer of Web UI to show year 2016 (Contributed by Xiao Chen and Vinayakumar B) 
(cherry picked from commit ddcd6954d03d3caadc8b69f7b886a3a17c3c9d0c)
(cherry picked from commit 8cdfdbf815bf89eee3184ec7cd00e1924c1ea316)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/datanode/index.html
	hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/hdfs/dfshealth.html
	hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/hdfs/explorer.html
	hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/journal/index.html
	hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/secondary/status.html
 2016-02-04 13:34:54 +05:30
Junping Du
89bfc884a5 Adding release 2.6.5 to CHANGES.txt. 2016-02-02 20:28:20 -08:00
Kihwal Lee
d8416aec3c HDFS-9220. Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum. Contributed by Jing Zhao. 
(cherry picked from commit c7c36cbd6218f46c33d7fb2f60cd52cb29e6d720)
(cherry picked from commit 4cf7f8441a288cefd44f126d60dae1998239892a)

Conflicts:

	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestFileAppend2.java
 2016-02-02 17:10:32 -08:00
Junping Du
cd93382a59 HDFS-8722. Optimize datanode writes for small writes and flushes. Contributed by Kihwal Lee. 2016-02-02 10:37:29 -08:00
Junping Du
30626ad35f HDFS-9178. Slow datanode I/O can cause a wrong node to be marked bad. Contributed by Kihwal Lee. 2016-02-02 10:29:31 -08:00
Junping Du
572b5872fe HDFS-4660. Block corruption can happen during pipeline recovery. Contributed by Kihwal Lee. 2016-02-02 10:16:59 -08:00
Colin Patrick Mccabe
8ef73cd4ce HDFS-7694. FSDataInputStream should support "unbuffer" (cmccabe) 
(cherry picked from commit 6b39ad0865cb2a7960dd59d68178f0bf28865ce2)
(cherry picked from commit e35788aa5a41940651af0b73dfeaeca011556904)
 2016-01-27 08:46:38 -08:00
Tsz-Wo Nicholas Sze
b05bb4984d HDFS-9294. DFSClient deadlock when close file and failed to renew lease. Contributed by Brahma Reddy Battula 2016-01-16 23:39:08 +08:00
Arpit Agarwal
f758dacb70 HDFS-9415. Document dfs.cluster.administrators and dfs.permissions.superusergroup. (Contributed by Xiaobing Zhou) 2016-01-14 14:19:04 -08:00
Junping Du
f5c50cd888 Add missing CHANGES.txt entry for HDFS-8767 for branch-2.6 2016-01-14 06:41:00 -08:00
Kihwal Lee
b91715bc83 Supplement to HDFS-9574. 2016-01-08 13:10:09 -06:00
Kihwal Lee
04b8a19f81 HDFS-9574. Reduce client failures during datanode restart. Contributed by Kihwal Lee. 
(cherry picked from commit b06e39de4fc4f9c35afb472eef0bba2adf91954f)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNodeFaultInjector.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataXceiver.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
 2016-01-08 12:26:05 -06:00
Vinayakumar B
79da1283d6 HDFS-9600. do not check replication if the block is under construction (Contributed by Phil Yang) 
(cherry picked from commit 34cd7cd76505d01ec251e30837c94ab03319a0c1)
(cherry picked from commit aa710bd461b593b0f3d7d7ac41ca68e1aa3fa9d6)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DecommissionManager.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlockManager.java
 2016-01-07 11:52:27 +05:30
Sangjin Lee
51a2e6304a Preparing for 2.6.4 development 2016-01-05 15:40:31 -08:00
Junping Du
236a6ba13e HDFS-9445. Datanode may deadlock while handling a bad volume. Contributed by Walter Su. 2016-01-04 06:27:52 -08:00
Akira Ajisaka
0381556a42 Set release date for 2.6.3 
(cherry picked from commit db99e30f670cb5d73d5ec79671026eeeaf337d3d)
(cherry picked from commit 247ab92464beb55bad58b6e63eeac1a41767f432)
 2016-01-04 16:18:38 +09:00
Akira Ajisaka
1823b3edd0 HADOOP-11252. RPC client does not time out by default. Contributed by Wilfred Spiegelenburg and Masatake Iwasaki. 
(cherry picked from commit 64ae85fd2ea91f46ab3b21f007befbeef8c3c947)
(cherry picked from commit d98cfe611f7cedc58cdecfb5a83829adb2521138)
 2016-01-04 14:38:35 +09:00
Akira Ajisaka
aadc864988 HDFS-6945. BlockManager should remove a block from excessReplicateMap and decrement ExcessBlocks metric when the block is removed. Contributed by Akira AJISAKA. 2016-01-03 15:10:54 -08:00
Vinod Kumar Vavilapalli
e7e0c4c0dd HDFS-9273. Moving to 2.6.3 CHANGES section to reflect the backport. 2015-12-08 11:37:06 -08:00
cnauroth
339714baa0 HDFS-9273. ACLs on root directory may be lost after NN restart. Contributed by Xiao Chen. 
(cherry picked from commit 1b525a9c32fabd8919c80717a58afbfa7fdce27e)
(cherry picked from commit faf1c608990408e2aa59a5e676f86d0c82dbd7f3)
 2015-12-08 11:29:06 -08:00
Zhe Zhang
203c7a648b Addendum fix for HDFS-9314 to fix compilation error caused by diamond operator. 
Change-Id: Ia8b8142c2cd3b5ec413a7da2bf037be64040dc85
 2015-12-04 10:57:24 -08:00
Zhe Zhang
4c631e8c73 HDFS-9314. Improve BlockPlacementPolicyDefault's picking of excess replicas. Contributed by Xiao Chen. 
Change-Id: Idf99293085531165239369155c039b55db0eed83

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-12-04 09:51:17 -08:00
Zhe Zhang
089169e4e5 HDFS-9313. Possible NullPointerException in BlockManager if no excess replica can be chosen. Contributed by Ming Ma. Branch-2.7 patch contributed by Xiao Chen. 
Change-Id: Iadaee6be2b44f7b0322d7b0e58f8fc983ef463f6

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-12-03 23:24:21 -08:00
Zhe Zhang
30dc4334bf HDFS-8647. Abstract BlockManager's rack policy into BlockPlacementPolicy. Contributed by Brahma Reddy Battula. Branch-2.6 patch contributed by Xiao Chen. 
Change-Id: Id08ade6862db1b8caf87ac9d786797d4fa7098a0
 2015-12-03 11:01:01 -08:00
Junping Du
e710a11a7f Creating 2.6.4 entries in CHANGES.txt files. 2015-12-01 08:28:37 -08:00
Andrew Wang
b2dd21e82d HDFS-9470. Encryption zone on root not loaded from fsimage after NN restart. Xiao Chen via wang. 
(cherry picked from commit 9b8e50b424d060e16c1175b1811e7abc476e2468)
(cherry picked from commit ce1111ceea830cce5f0833db55201e0e88c3b199)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java

(cherry picked from commit 10e8a67d23200d2b6fbab7a050adf922b27e77c4)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
 2015-11-30 15:01:08 -08:00
Tsz-Wo Nicholas Sze
d2518fd562 HDFS-9434. Recommission a datanode with 500k blocks may pause NN for 30 seconds for printing info log messags. 2015-11-24 14:34:51 -08:00
Tsz-Wo Nicholas Sze
83fcbd49a7 Revert "HDFS-9434. Recommission a datanode with 500k blocks may pause NN for 30 seconds for printing info log messags." 
This reverts commit 09dbb11566410f2e9101555637ad81c7acc7edfd.
 2015-11-24 14:08:45 -08:00
Tsz-Wo Nicholas Sze
09dbb11566 HDFS-9434. Recommission a datanode with 500k blocks may pause NN for 30 seconds for printing info log messags. 2015-11-24 12:40:24 -08:00
Kihwal Lee
238458b259 HDFS-9289. Make DataStreamer#block thread safe and verify genStamp in commitBlock. Contributed by Chang Li. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java

Change-Id: Ibd44ff1bf92bad7262db724990a6a64c1975ffb6
 2015-11-24 09:44:50 -08:00
Sangjin Lee
b9a6f9aa16 HDFS-9083. Replication violates block placement policy (Rushabh Shah) 2015-11-23 16:06:18 -08:00
Akira Ajisaka
68b1abe5cc HDFS-9431. DistributedFileSystem#concat fails if the target path is relative. Contributed by Kazuho Fujii. 
(cherry picked from commit ac1aa6c8197268ea83f44747199d560be9e299ae)
(cherry picked from commit c74e42b4a2293c8adb99b22929047a8d07242d06)
 2015-11-19 20:56:08 +09:00
Akira Ajisaka
866d0f6f04 HDFS-8615. Correct HTTP method in WebHDFS document. Contributed by Brahma Reddy Battula. 2015-11-17 16:11:47 +09:00
Sangjin Lee
8f8f3b1027 Updated the 2.6.2 final release date. 
(cherry picked from commit a4a6b5b4b470b1e7a3c5e2d38433429c455bc709)
 2015-10-30 18:51:50 -07:00
Jason Lowe
0af4f222a1 Creating 2.6.3 entries in CHANGES.txt files. 
(cherry picked from commit eadf7b3096cb010eb7f0afd9afd4ae0d67b2645f)

Conflicts:

	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-mapreduce-project/CHANGES.txt
	hadoop-yarn-project/CHANGES.txt
 2015-10-30 14:58:42 +00:00
Sangjin Lee
1d3bed1f94 Set the release date for 2.6.2 2015-10-28 20:57:16 -07:00