Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,458 Commits 326 Branches 371 Tags
Commit Graph

10458 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Yongjun Zhang
1bb89cbac7 HDFS-9377. Fix findbugs warnings in FSDirSnapshotOp. (Mingliang Liu via Yongjun Zhang) 
(cherry picked from commit 286cc6483fe458894cdd22ff1d8822c304e0d94f)
 2015-11-05 14:54:29 -08:00
Colin Patrick Mccabe
f7e6a5dfb1 Revert "HADOOP-11887. Introduce Intel ISA-L erasure coding library for native erasure encoding support (Kai Zheng via Colin P. McCabe)" 
This reverts commit bb3b2977cd3c1ccbf8d861cf264a06c249223dc8.
 2015-11-05 11:11:27 -08:00
Lei Xu
489c920c9a HDFS-9282. Make data directory count and storage raw capacity related tests FsDataset-agnostic. (Tony Wu via lei) 
(cherry picked from commit 5a1a54c9f5d9a8f7585000fe33ef106e62dbb43a)
 2015-11-05 10:46:46 -08:00
Lei Xu
7a2a17cb5f HDFS-9363. Add fetchReplica to FsDatasetTestUtils to return FsDataset-agnostic replica. (Tony Wu via lei) 
(cherry picked from commit 4976a02841592b61f2d2b40d2aadd5146571322c)
 2015-11-05 10:46:46 -08:00
Colin Patrick Mccabe
bb3b2977cd HADOOP-11887. Introduce Intel ISA-L erasure coding library for native erasure encoding support (Kai Zheng via Colin P. McCabe) 
(cherry picked from commit 482e35c55a4bec27fa62b29d9e5f125816f1d8bd)
 2015-11-05 10:46:12 -08:00
Haohui Mai
aa03030e4a HDFS-9372. Remove dead code in DataStorage.recoverTransitionRead. Contributed by Duo Zhang. 2015-11-05 10:00:18 -08:00
Kihwal Lee
37abd0e33b HDFS-4937. ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom(). Contributed by Kihwal Lee. 
(cherry picked from commit ff47f35deed14ba6463cba76f0e6a6c15abb3eca)
 2015-11-05 09:26:53 -06:00
cnauroth
6edd41ac69 HDFS-9378. hadoop-hdfs-client tests do not write logs. Contributed by Chris Nauroth. 
(cherry picked from commit c563401796c58119d1b42dda55d6916bdab56dfe)
 2015-11-05 06:48:32 -08:00
Xiaoyu Yao
891be39993 HDFS-9360. Storage type usage isn't updated properly after file deletion. Contributed by Ming Ma. 
(cherry picked from commit ea5bb483269b51a349c358b71f84904c76693a66)
 2015-11-05 01:40:05 -08:00
cnauroth
81f7e8af22 HADOOP-12540. TestAzureFileSystemInstrumentation#testClientErrorMetrics fails intermittently due to assumption that a lease error will be thrown. Contributed by Gaurav Kanade. 
(cherry picked from commit 0fb1867fd62b5df664ad66386d6067db8fbf2317)
 2015-11-04 10:29:01 -08:00
Lei Xu
8ed1fd2171 HDFS-9331. Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account for filesystem entirely allocated for DFS use. (Tony Wu via lei) 
(cherry picked from commit e2a5441b062fd0758138079d24a2740fc5e5e350)
 2015-11-04 10:28:00 -08:00
Haohui Mai
6d92778191 Revert "HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou." 
This reverts commit e7203b69548a7926a345e2b18f0a227f7f8ca52c.
 2015-11-04 10:22:21 -08:00
Lei Xu
3f2be7b18f HDFS-9007. Fix HDFS Balancer to honor upgrade domain policy. (Ming Ma via lei) 2015-11-04 10:21:58 -08:00
Kihwal Lee
c8ffea3db7 fix up CHANGES.txt 2015-11-04 12:15:58 -06:00
Haohui Mai
b61aa716e8 HDFS-9357. NN UI renders icons of decommissioned DN incorrectly. Contributed by Surendra Singh Lilhore. 2015-11-04 09:17:01 -08:00
Jason Lowe
b9389ac5b5 HADOOP-12296. when setnetgrent returns 0 in linux, exception should be thrown. Contributed by Chang Li 
(cherry picked from commit b9d25c3ee2d20166d6a786c5a16cc001e249f61c)
 2015-11-04 16:35:12 +00:00
Jason Lowe
8334d86472 Add 2.7.3 release to CHANGES.txt 
(cherry picked from commit 0383a3973b3b734fb23c331a2256dc92cff05365)
 2015-11-04 16:27:28 +00:00
Yongjun Zhang
0b61ccaeca HDFS-9351. checkNNStartup() need to be called when fsck calls FSNamesystem.getSnapshottableDirs(). (Xiao Chen via Yongjun Zhang) 
(cherry picked from commit 194251c85250fcbe80a6ffee88b2cd4689334be3)
 2015-11-03 17:27:14 -08:00
Zhe Zhang
4f29f5d192 HDFS-9289. Make DataStreamer#block thread safe and verify genStamp in commitBlock. Contributed by Chang Li. 
Change-Id: I0591b1f9c6a0a8b368408b195151de2e0aa440c4
 2015-11-03 14:23:02 -08:00
cnauroth
246ab44b5e HDFS-9362. TestAuditLogger#testAuditLoggerWithCallContext assumes Unix line endings, fails on Windows. Contributed by Chris Nauroth. 
(cherry picked from commit 7e2829662b4c4bf33ebaf2fa09312d0bed3d6f92)
 2015-11-03 11:55:07 -08:00
cnauroth
9d11d2a8f2 HDFS-9354. Fix TestBalancer#testBalancerWithZeroThreadsForMove on Windows. Contributed by Xiaoyu Yao. 
(cherry picked from commit 095ac834022df6136b42961c507ec745c6cf8f97)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancer.java
 2015-11-03 11:41:50 -08:00
Wangda Tan
3190446df9 YARN-4326. Fix TestDistributedShell timeout as AHS in MiniYarnCluster no longer binds to default port 8188. (Meng Ding via wangda) 
(cherry picked from commit 0783184f4b3f669f7211e42b395b62d63144100d)
 2015-11-03 11:36:11 -08:00
cnauroth
afff29113a HADOOP-12542. TestDNS fails on Windows after HADOOP-12437. Contributed by Chris Nauroth. 
(cherry picked from commit 957f0311a160afb40dbb0619f455445b4f5d1e32)
 2015-11-02 22:25:12 -08:00
Ming Ma
fd9a7f84bc HDFS-9313. Possible NullPointerException in BlockManager if no excess replica can be chosen. (mingma) 
(cherry picked from commit d565480da2f646b40c3180e1ccb2935c9863dfef)
 2015-11-02 19:37:38 -08:00
Lei Xu
c6b9c8d698 HDFS-9308. Add truncateMeta() and deleteMeta() to MiniDFSCluster. (Tony Wu via lei) 
(cherry picked from commit 8e05dbf2bddce95d5f5a5bae5df61acabf0ba7c5)
 2015-11-02 18:06:34 -08:00
Lei Xu
41faf438e1 HDFS-9312. Fix TestReplication to be FsDataset-agnostic. (lei) 
(cherry picked from commit 7632409482aaf06ecc6fe370a9f519afb969ad30)
 2015-11-02 17:10:16 -08:00
Zhe Zhang
bd2867cd39 HDFS-9339. Extend full test of KMS ACLs. Contributed by Daniel Templeton. 
Change-Id: I61eeee8fa5e85250eabc1eef3d8c11f32700d6fb
 2015-11-02 13:52:21 -08:00
Zhe Zhang
a47c4e7819 HDFS-9329. TestBootstrapStandby#testRateThrottling is flaky because fsimage size is smaller than IO buffer size. Contributed by Zhe Zhang. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestBootstrapStandby.java

Change-Id: Iffa62547483c1d9dc82a196d5e8d0856b397217d
 2015-11-02 10:32:28 -08:00
cnauroth
c1d7b26e94 HADOOP-12508. delete fails with exception when lease is held on blob. Contributed by Gaurav Kanade. 
(cherry picked from commit 9e7dcab185abf2fdabb28f2799b9952b5664a4b0)
 2015-11-02 10:21:46 -08:00
cnauroth
c260d7ec78 HADOOP-12533. Introduce FileNotFoundException in WASB for read and seek API. Contributed by Dushyanth. 
(cherry picked from commit 28790692624177d89fb1e4f59e2f83a659fc3089)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-11-02 09:39:27 -08:00
Kihwal Lee
d65ca63c68 Fix CHANGES.txt 
(cherry picked from commit 2529464f0841732792343d515cd1be1dccb3c453)
 2015-11-02 09:10:55 -06:00
Arpit Agarwal
bb2ee9f8eb HDFS-9343. Empty caller context considered invalid. (Contributed by Mingliang Liu) 2015-11-01 15:35:11 -08:00
yliu
caa5da06f2 Revert "HDFS-4937. ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom(). Contributed by Kihwal Lee." 
This reverts commit 0c7fd26302109273a07b6087a9b92c9dff080816.
 2015-10-31 16:23:26 +08:00
yliu
511e724fff Revert "fix CHANGES.txt" 
This reverts commit 4c33f883c468ad17528041f3ffb00f5603fccc8f.
 2015-10-31 16:23:16 +08:00
Sangjin Lee
b2d6ea5e18 Updated the 2.6.2 final release date. 
(cherry picked from commit a4a6b5b4b470b1e7a3c5e2d38433429c455bc709)
 2015-10-30 18:49:21 -07:00
Suresh Srinivas
b8d586fd8a HADOOP-9242. Duplicate surefire plugin config in hadoop-common. Contributed by Andrey Klochkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1438213 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 16acd69e587956105897ccff2d4dd4b473aaf8bc)
 2015-10-30 14:27:45 -07:00
Kihwal Lee
dae9f0ef53 Addendum to MAPREDUCE-6451 
(cherry picked from commit b24fe0648348d325d14931f80cee8a170fb3358a)
 2015-10-30 16:06:50 -05:00
Kihwal Lee
52819fe4ef MAPREDUCE-6451. DistCp has incorrect chunkFilePath for multiple jobs when strategy is dynamic. Contributed by Kuhu Shukla. 
(cherry picked from commit 2868ca0328d908056745223fb38d9a90fd2811ba)
 2015-10-30 14:57:57 -05:00
Jason Lowe
a7d8895b60 MAPREDUCE-6528. Memory leak for HistoryFileManager.getJobSummary(). Contributed by Junping Du 
(cherry picked from commit 6344b6a7694c70f296392b6462dba452ff762109)
 2015-10-30 15:32:48 +00:00
Jason Lowe
055e11c53e Update CHANGES.txt to reflect commit of MR-6273 to branch-2.6 
(cherry picked from commit 6ae9efaf5949bd5a5f4fd99b5777ce8f6d7f3a2c)
 2015-10-30 15:19:49 +00:00
Jason Lowe
8dce482f61 Creating 2.6.3 entries in CHANGES.txt files. 
(cherry picked from commit eadf7b3096cb010eb7f0afd9afd4ae0d67b2645f)
 2015-10-30 14:52:06 +00:00
Kihwal Lee
4c33f883c4 fix CHANGES.txt 2015-10-30 09:41:45 -05:00
Kihwal Lee
0c7fd26302 HDFS-4937. ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom(). Contributed by Kihwal Lee. 
(cherry picked from commit 43539b5ff4ac0874a8a454dc93a2a782b0e0ea8f)
 2015-10-30 09:30:11 -05:00
Tsuyoshi Ozawa
1c80473a41 YARN-4320. TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no longer binds to default port 8188. Contributed by Varun Saxena. 
(cherry picked from commit ce31b22739512804da38cf87e0ce1059e3128da3)
 2015-10-30 18:00:35 +09:00
Tsuyoshi Ozawa
dd144035a0 Add an entry of YARN-4312 to CHANGES.txt 
(cherry picked from commit d21214ce33cb176926aa3ae5a9f4efe00f66480b)
 2015-10-30 17:57:29 +09:00
Tsuyoshi Ozawa
c522a9ffc2 Move YARN-3580 in CHANGES.txt from 2.8 to 2.7.2. 
(cherry picked from commit d2e01f4ed87c3c41156ec9a68855f923f8c0adf9)
 2015-10-30 15:51:04 +09:00
Xuan
b505bf9e58 YARN-4313. Race condition in MiniMRYarnCluster when getting history 
server address. Contributed by Jian He

(cherry picked from commit 7412ff48eeb967c972c19c1370c77a41c5b3b81f)
 2015-10-29 17:37:24 -07:00
Jian He
2b197bbffd YARN-4127. RM fail with noAuth error if switched from failover to non-failover. Contributed by Varun Saxena 
(cherry picked from commit e5b1733e049dc0f1859b93618354e049a0efdc4a)
 2015-10-29 15:43:26 -07:00
Jonathan Eagles
42bc525acb YARN-4183. Enabling generic application history forces every job to get a timeline service delegation token (jeagles) 
(cherry picked from commit c293c58954cdab25c8c69418b0e839883b563fa4)
 2015-10-29 16:42:49 -05:00
Arun Suresh
8943abfb08 YARN-4310. FairScheduler: Log skipping reservation messages at DEBUG level (asuresh) 
(cherry picked from commit 58d1df585c2b8a4d2f78ae30726f07b4c6a94731)
 2015-10-29 13:43:43 -07:00