Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,291 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

3188 Commits

Author SHA1 Message Date
Yongjun Zhang 0b61ccaeca HDFS-9351. checkNNStartup() need to be called when fsck calls FSNamesystem.getSnapshottableDirs(). (Xiao Chen via Yongjun Zhang) 
(cherry picked from commit 194251c852)
 2015-11-03 17:27:14 -08:00
Zhe Zhang 4f29f5d192 HDFS-9289. Make DataStreamer#block thread safe and verify genStamp in commitBlock. Contributed by Chang Li. 
Change-Id: I0591b1f9c6a0a8b368408b195151de2e0aa440c4
 2015-11-03 14:23:02 -08:00
cnauroth 246ab44b5e HDFS-9362. TestAuditLogger#testAuditLoggerWithCallContext assumes Unix line endings, fails on Windows. Contributed by Chris Nauroth. 
(cherry picked from commit 7e2829662b)
 2015-11-03 11:55:07 -08:00
cnauroth 9d11d2a8f2 HDFS-9354. Fix TestBalancer#testBalancerWithZeroThreadsForMove on Windows. Contributed by Xiaoyu Yao. 
(cherry picked from commit 095ac83402)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancer.java
 2015-11-03 11:41:50 -08:00
Ming Ma fd9a7f84bc HDFS-9313. Possible NullPointerException in BlockManager if no excess replica can be chosen. (mingma) 
(cherry picked from commit d565480da2)
 2015-11-02 19:37:38 -08:00
Lei Xu c6b9c8d698 HDFS-9308. Add truncateMeta() and deleteMeta() to MiniDFSCluster. (Tony Wu via lei) 
(cherry picked from commit 8e05dbf2bd)
 2015-11-02 18:06:34 -08:00
Lei Xu 41faf438e1 HDFS-9312. Fix TestReplication to be FsDataset-agnostic. (lei) 
(cherry picked from commit 7632409482)
 2015-11-02 17:10:16 -08:00
Zhe Zhang bd2867cd39 HDFS-9339. Extend full test of KMS ACLs. Contributed by Daniel Templeton. 
Change-Id: I61eeee8fa5e85250eabc1eef3d8c11f32700d6fb
 2015-11-02 13:52:21 -08:00
Zhe Zhang a47c4e7819 HDFS-9329. TestBootstrapStandby#testRateThrottling is flaky because fsimage size is smaller than IO buffer size. Contributed by Zhe Zhang. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestBootstrapStandby.java

Change-Id: Iffa62547483c1d9dc82a196d5e8d0856b397217d
 2015-11-02 10:32:28 -08:00
Kihwal Lee d65ca63c68 Fix CHANGES.txt 
(cherry picked from commit 2529464f08)
 2015-11-02 09:10:55 -06:00
Arpit Agarwal bb2ee9f8eb HDFS-9343. Empty caller context considered invalid. (Contributed by Mingliang Liu) 2015-11-01 15:35:11 -08:00
yliu caa5da06f2 Revert "HDFS-4937. ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom(). Contributed by Kihwal Lee." 
This reverts commit 0c7fd26302.
 2015-10-31 16:23:26 +08:00
yliu 511e724fff Revert "fix CHANGES.txt" 
This reverts commit 4c33f883c4.
 2015-10-31 16:23:16 +08:00
Sangjin Lee b2d6ea5e18 Updated the 2.6.2 final release date. 
(cherry picked from commit a4a6b5b4b4)
 2015-10-30 18:49:21 -07:00
Jason Lowe 8dce482f61 Creating 2.6.3 entries in CHANGES.txt files. 
(cherry picked from commit eadf7b3096)
 2015-10-30 14:52:06 +00:00
Kihwal Lee 4c33f883c4 fix CHANGES.txt 2015-10-30 09:41:45 -05:00
Kihwal Lee 0c7fd26302 HDFS-4937. ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom(). Contributed by Kihwal Lee. 
(cherry picked from commit 43539b5ff4)
 2015-10-30 09:30:11 -05:00
Andrew Wang 5e5e693a0a HDFS-9332. Fix Precondition failures from NameNodeEditLogRoller while saving namespace. 
(cherry picked from commit 888c6245e2)
 2015-10-29 11:30:52 -07:00
Zhe Zhang 30791cb0d0 HDFS-9229. Expose size of NameNode directory as a metric. Contributed by Surendra Singh Lilhore. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ha/EditLogTailer.java

Change-Id: I5f5895bac4f7d7e66e95788765a514b80b9b6766
 2015-10-29 11:21:57 -07:00
Vinayakumar B e3f1a02f50 HDFS-9044. Give Priority to FavouredNodes , before selecting nodes from FavouredNode's Node Group (Contributed by J.Andreina) 
(cherry picked from commit 588baab160)
 2015-10-29 11:44:52 +05:30
Vinayakumar B dea66a8392 HDFS-8545. Refactor FS#getUsed() to use ContentSummary and add an API to fetch the total file length from a specific path (Contributed by J.Andreina) 
(cherry picked from commit 7d2d16f4ee)
 2015-10-29 11:30:59 +05:30
Sangjin Lee 16db203a83 Set the release date for 2.6.2 2015-10-28 20:48:49 -07:00
Haohui Mai 9e911a2439 HDFS-9168. Move client side unit test to hadoop-hdfs-client. Contributed by Haohui Mai. 2015-10-28 15:54:53 -07:00
Zhe Zhang 986dc718d3 HDFS-9295. Add a thorough test of the full KMS code path. Contributed by Daniel Templeton. 
Change-Id: Ife1abb2f8e9a30102c4f705c47646d9ac8328786
 2015-10-28 14:36:56 -07:00
Kihwal Lee 75bc53a86a HDFS-9279. Decomissioned capacity should not be considered for configured/used capacity. Contributed by Kihu Shukla . 
(cherry picked from commit 19a77f5466)
 2015-10-28 11:59:36 -05:00
Zhe Zhang 5a7b407929 HDFS-9255. Consolidate block recovery related implementation into a single class. Contributed by Walter Su. 
Change-Id: I31c5d4778656053e60a4263970ec5fda441e9725
 2015-10-28 07:40:47 -07:00
yliu 7b90f74636 HDFS-9302. WebHDFS throws NullPointerException if newLength is not provided. (Jagadesh Kiran N via yliu) 2015-10-28 15:50:32 +08:00
Yongjun Zhang 6fed564d2c HDFS-9231. fsck doesn't list correct file path when Bad Replicas/Blocks are in a snapshot. (Xiao Chen via Yongjun Zhang) 
(cherry picked from commit 97913f430c)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFsck.java
 2015-10-28 00:06:50 -07:00
cnauroth af0f2e27d1 HDFS-9311. Support optional offload of NameNode HA service health checks to a separate RPC server. Contributed by Chris Nauroth. 
(cherry picked from commit bf8e452982)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeRpcServer.java
 2015-10-27 23:08:32 -07:00
Akira Ajisaka e984534314 Add HDFS-9317 to CHANGES.txt. 
(cherry picked from commit eca51b13af)
 2015-10-28 13:19:48 +09:00
Colin Patrick Mccabe 7eb0daefc8 HDFS-9307. fuseConnect should be private to fuse_connect.c (Mingliang Liu via Colin P. McCabe) 
(cherry picked from commit faeb6a3f89)
 2015-10-27 11:41:27 -07:00
Colin Patrick Mccabe bb87b4222c HDFS-9299. Give ReplicationMonitor a readable thread name (Staffan Friberg via Colin P. McCabe) 
(cherry picked from commit fe93577faf)
 2015-10-27 11:37:54 -07:00
Ming Ma 2c335a8434 HDFS-9259. Make SO_SNDBUF size configurable at DFSClient side for hdfs write scenario. (Mingliang Liu via mingma) 
(cherry picked from commit aa09880ab8)
 2015-10-27 09:29:37 -07:00
Lei Xu acbc8c1457 HDFS-9292. Make TestFileConcorruption independent to underlying FsDataset Implementation. (lei) 
(cherry picked from commit 399ad00915)
 2015-10-26 16:09:41 -07:00
Arpit Agarwal 764be68f47 HDFS-9305. Delayed heartbeat processing causes storm of subsequent heartbeats. (Contributed by Arpit Agarwal) 2015-10-26 15:54:08 -07:00
Andrew Wang 8e6cc44760 HDFS-8945. Update the description about replica placement in HDFS Architecture documentation. Contributed by Masatake Iwasaki. 
(cherry picked from commit e8aefdf08b)
 2015-10-26 15:48:15 -07:00
Lei Xu ce02c438fd HDFS-9291. Fix TestInterDatanodeProtocol to be FsDataset-agnostic. (lei) 2015-10-26 15:17:36 -07:00
Andrew Wang 9850827c24 HDFS-9284. fsck command should not print exception trace when file not found. Contributed by Jagadesh Kiran N. 
(cherry picked from commit 677a936bf7)
 2015-10-26 15:15:23 -07:00
Yongjun Zhang b50af4e04a HDFS-7284. Add more debug info to BlockInfoUnderConstruction#setGenerationStampAndVerifyReplicas. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit 5e718de522)
 2015-10-26 13:36:25 -07:00
Colin Patrick Mccabe 1405181d08 HDFS-9268. fuse_dfs chown crashes when uid is passed as -1 (cmccabe) 
(cherry picked from commit 2f1eb2bceb)
 2015-10-26 13:33:45 -07:00
Haohui Mai aeceb2eef6 HDFS-9304. Add HdfsClientConfigKeys class to TestHdfsConfigFields#configurationClasses. Contributed by Mingliang Liu. 2015-10-26 12:03:00 -07:00
Arpit Agarwal b727dfd61c HDFS-4015. Safemode should count and report orphaned blocks. (Contributed by Anu Engineer) 2015-10-23 21:40:26 -07:00
Lei Xu 509185c224 HDFS-9297. Update TestBlockMissingException to use corruptBlockOnDataNodesByDeletingBlockFile(). (Tony Wu via lei) 
(cherry picked from commit 5679e46b7f)
 2015-10-23 17:42:59 -07:00
Haohui Mai 558ae8c2df HDFS-9301. HDFS clients can't construct HdfsConfiguration instances. Contributed by Mingliang Liu. 2015-10-23 14:53:15 -07:00
Kihwal Lee d24d0fd981 HDFS-9290. DFSClient#callAppend() is not backward compatible for slightly older NameNodes. Contributed by Tony Wu. 
(cherry picked from commit b9e0417bdf)
 2015-10-23 16:38:47 -05:00
Zhe Zhang 1c468c2346 HDFS-8808. dfs.image.transfer.bandwidthPerSec should not apply to -bootstrapStandby. Contributed by Zhe Zhang. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ha/BootstrapStandby.java

Change-Id: I99c314bb932b96a25f9115772267176e0b815614
 2015-10-23 14:07:05 -07:00
Lei Xu 17be4b4c1f HDFS-9264. Minor cleanup of operations on FsVolumeList#volumes. (Walter Su via lei) 
(cherry picked from commit 533a2be5ac)
 2015-10-23 13:53:52 -07:00
Jitendra Pandey 63cebf57d0 HDFS-9184. Logging HDFS operation's caller context into audit logs. Contributed by Mingliang Liu. 2015-10-23 12:17:20 -07:00
cnauroth 4ee8297c89 HDFS-9286. HttpFs does not parse ACL syntax correctly for operation REMOVEACLENTRIES. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 124a412a37)
 2015-10-22 15:25:30 -07:00
Zhe Zhang a9deeb96b2 HDFS-9280. Document NFS gateway export point parameter. Contributed by Xiao Chen. 
Change-Id: I1cea610c31301d793db3c9ca4dae86d0e5d2d64b
 2015-10-22 11:40:09 -07:00