Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,521 Commits 326 Branches 371 Tags
Commit Graph

10521 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Konstantin V Shvachko
33d4588a7c HDFS-9484. NNThroughputBenchmark$BlockReportStats should not send empty block reports. Contributed by Mingliang Liu. 2015-12-03 14:56:00 -08:00
Konstantin V Shvachko
3aa73a867a HDFS-9436. Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default. Contributed by Mingliang. 2015-12-03 14:54:06 -08:00
Wangda Tan
51e448d295 YARN-4292. ResourceUtilization should be a part of NodeInfo REST API. (Sunil G via wangda) 
(cherry picked from commit a2c3bfc8c1349102a7f2bc4ea96b80b429ac227b)
 2015-12-03 14:30:25 -08:00
Jian He
23fe1abc02 YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999). Contributed by Mohammad Shahid Khan and Varun Saxena 
(cherry picked from commit 9f77ccad735f4843ce2c38355de9f434838d4507)
 2015-12-03 12:49:22 -08:00
Junping Du
e76ba91fa5 YARN-4408. Fix issue that NodeManager still reports negative running containers. Contributed by Robert Kanter. 
(cherry picked from commit 62e9348bc10bb97a5fcb4281f7996a09d8e69c60)
 2015-12-03 06:37:31 -08:00
Akira Ajisaka
15c2f709c6 HADOOP-12565. Replace DSA with RSA for SSH key type in SingleCluster.md. Contributed by Mingliang Liu. 
(cherry picked from commit 3857fed2c8fc601b46e8331f73a3104f4f33e498)
 2015-12-03 11:51:56 +08:00
Tsz-Wo Nicholas Sze
bac127a4e2 HDFS-9294. DFSClient deadlock when close file and failed to renew lease. Contributed by Brahma Reddy Battula 2015-12-02 17:49:16 -08:00
Jian He
48cbde9083 YARN-4398. Remove unnecessary synchronization in RMStateStore. Contributed by Ning Ding 2015-12-02 11:08:00 -08:00
Colin Patrick Mccabe
9b516a2a05 HDFS-9429. Tests in TestDFSAdminWithHA intermittently fail with EOFException (Xiao Chen via Colin P. McCabe) 
(cherry picked from commit 53e3bf7e704c332fb119f55cb92520a51b644bfc)
 2015-12-01 23:58:09 -08:00
Arpit Agarwal
0a1ef49b33 HDFS-6533. TestBPOfferService#testBasicFunctionalitytest fails intermittently. (Contributed by Wei-Chiu Chuang) 2015-12-01 13:32:37 -08:00
Jing Zhao
7e416aa70d HDFS-9485. Make BlockManager#removeFromExcessReplicateMap accept BlockInfo instead of Block. Contributed by Mingliang Liu. 
(cherry picked from commit 830eb252aaa4fec7ef2ec38cb66f669e8e1ecaa5)
 2015-12-01 13:07:19 -08:00
Zhe Zhang
9db4b77ea5 HDFS-9269. Update the documentation and wrapper for fuse-dfs. Contributed by Wei-Chiu Chuang. 
Change-Id: Ia9ec512de2464bf94725cc7c15c378c59d0f04c4
 2015-12-01 10:25:32 -08:00
Arpit Agarwal
19c2c22bbe HADOOP-12609. Fix intermittent failure of TestDecayRpcScheduler. (Contributed by Masatake Iwasaki) 2015-12-01 09:29:07 -08:00
Allen Wittenauer
45bb467918 HADOOP-12366. expose calculated paths (aw) 2015-12-01 08:16:20 -08:00
Junping Du
092c469059 Creating 2.6.4 entries in CHANGES.txt files. 
(cherry picked from commit 028894281bccd4e2f37eebff2e46409404ef64b7)
 2015-12-01 08:18:57 -08:00
Akira Ajisaka
402a2f2d64 HDFS-9336. deleteSnapshot throws NPE when snapshotname is null. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 1c05393b51748033279bff31dbc5c5cae7fc3a86)
 2015-12-01 11:30:11 +08:00
Andrew Wang
ce1111ceea HDFS-9470. Encryption zone on root not loaded from fsimage after NN restart. Xiao Chen via wang. 
(cherry picked from commit 9b8e50b424d060e16c1175b1811e7abc476e2468)
 2015-11-30 14:36:06 -08:00
Jason Lowe
854ef2be5b Update CHANGES.txt for commit of MR-6549 to branch-2.7 and branch-2.6. 
(cherry picked from commit 43acf9ab8ef4eea7950fa99096cd99459cfa25ad)
 2015-11-30 17:55:37 +00:00
cnauroth
669743ce11 HADOOP-12600. FileContext and AbstractFileSystem should be annotated as a Stable interface. Contributed by Chris Nauroth. 
(cherry picked from commit b2c78536cb55c58e4d4a0ea16f648a34c7e2f88c)
 2015-11-28 15:40:13 -08:00
Vinayakumar B
57e0c735f8 HDFS-9426. Rollingupgrade finalization is not backward compatible (Contributed by Kihwal Lee) 
(cherry picked from commit c62d42cd8bb09a5ffc0c5eefa2d87913e71b9e7e)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolClientSideTranslatorPB.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolServerSideTranslatorPB.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/proto/DatanodeProtocol.proto

(cherry picked from commit 9f256d1d716a7e17606245fcfc619901a8fa299a)
 2015-11-26 09:40:44 +05:30
Yongjun Zhang
165abe6c4f HADOOP-12468. Partial group resolution failure should not result in user lockout. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit 0348e769abc507c69d644db7bc56d31d971c51d1)
 2015-11-25 18:48:10 -08:00
Vinod Kumar Vavilapalli
b20e77eba3 Preparing for 2.9.0 development: mvn versions:set -DnewVersion=2.9.0 2015-11-25 17:47:22 -08:00
Vinod Kumar Vavilapalli
767815f317 Adding release 2.8.0 to CHANGES.txt 
(cherry picked from commit d57fd181c75c2578775fda0ec575b66da416adff)
 2015-11-25 17:37:47 -08:00
Robert Kanter
7b4bf23b2a MAPREDUCE-6550. archive-logs tool changes log ownership to the Yarn user when using DefaultContainerExecutor (rkanter) 
(cherry picked from commit 6d84cc16b3e0685fef01d0e3526b0f7556ceff51)
 2015-11-25 17:13:00 -08:00
Robert Kanter
8c6273d117 MAPREDUCE-6549. multibyte delimiters with LineRecordReader cause duplicate records (wilfreds via rkanter) 
(cherry picked from commit 7fd00b3db4b7d73afd41276ba9a06ec06a0e1762)
 2015-11-25 17:03:52 -08:00
Jing Zhao
288cf8437b HDFS-9467. Fix data race accessing writeLockHeldTimeStamp in FSNamesystem. Contributed by Mingliang Liu. 
(cherry picked from commit e556c35b0596700f9ec9d0a51cf5027259d531b5)
 2015-11-25 14:23:06 -08:00
Konstantin V Shvachko
9c1ef648a9 HDFS-9407. TestFileTruncate should not use fixed NN port. Contributed by Brahma Reddy Battula. 2015-11-25 14:16:03 -08:00
Xiaoyu Yao
4f1f9f7eff HDFS-8512. WebHDFS : GETFILESTATUS should return LocatedBlock with storage type info. Contributed by Xiaoyu Yao. 
(cherry picked from commit e3d673901b396cf5bbede5ed6f607ce68301ec0a)
 2015-11-25 13:54:22 -08:00
Haohui Mai
15caaa7d0a HDFS-9459. hadoop-hdfs-native-client fails test build on Windows after transition to ctest. Contributed by Chris Nauroth. 2015-11-25 10:32:13 -08:00
Junping Du
628c782870 Tests in mapreduce-client-app are writing outside of target. Contributed by Akira AJISAKA. 
(cherry picked from commit 15d577bfbb3f18fc95251d22378b53aa4210115f)
 2015-11-25 09:16:22 -08:00
Yongjun Zhang
48b294c58e HDFS-9438. TestPipelinesFailover assumes Linux ifconfig. (John Zhuge via Yongjun Zhang) 
(cherry picked from commit 8176ea7dc694841a993f2bfc30669fe22f9ec1d2)
 2015-11-25 08:50:02 -08:00
Yongjun Zhang
7ac8d8f510 HDFS-6694. Addendum. Update CHANGES.txt for cherry-picking to 2.8. 
(cherry picked from commit 84d01ad7f43bc498bc2e9d3afe68aed7f4a4d462)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-11-25 08:49:26 -08:00
arp
566ceac1ff HDFS-6694. TestPipelinesFailover.testPipelineRecoveryStress tests fail intermittently with various symptoms - debugging patch (Contributed by Yongjun Zhang) 
(cherry picked from commit c5d9a4a91e4e0faae3a8530408da35b591396060)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-11-25 08:45:59 -08:00
Akira Ajisaka
4257991257 HADOOP-12598. Add XML namespace declarations for some hadoop/tools modules. Contributed by Xin Wang. 
(cherry picked from commit b53f20135599cc7825b6213794e2f999bc43e2ad)
 2015-11-26 01:21:32 +09:00
Tsuyoshi Ozawa
d76b523b02 YARN-4380. TestResourceLocalizationService.testDownloadingResourcesOnContainerKill fails intermittently. Contributed by Varun Saxena. 
(cherry picked from commit 0656d2dc83af6a48a8d8d0e37cdf1f813124f366)
 2015-11-26 01:10:41 +09:00
Akira Ajisaka
5794dc83b0 Fix indents in the 2.8.0 section of MapReduce CHANGES.txt. 
(cherry picked from commit 177975e962284a2bbd954ebb32bf8f6da5fc975e)
 2015-11-25 16:44:25 +09:00
Akira Ajisaka
c6cf7910a4 MAPREDUCE-6553. Replace '\u2b05' with '<-' in rendering job configuration. Contributed by Gabor Liptak. 
(cherry picked from commit 5ec44fc35c129d266edaebbc6fa17754a89b2ad6)
 2015-11-25 16:33:18 +09:00
Tom Zeng
d6f7d22929 HADOOP-12415. Add io.netty dependency to hadoop-nfs and to hadoop-hdfs, needed to build Bigtop successfuly, see BIGTOP-2049 
Signed-off-by: Konstantin Boudnik <cos@boudnik.org>
(cherry picked from commit b4c6b511e705230dfe4580288addacb81f5c5c5f)
 2015-11-24 18:39:01 -08:00
Wangda Tan
7b9f7eaf5c YARN-4384. updateNodeResource CLI should not accept negative values for resource. (Junping Du via wangda) 
(cherry picked from commit 23c625ec571b01c0a2811728608890da38f86890)
 2015-11-24 16:36:30 -08:00
Tsz-Wo Nicholas Sze
79e55fb47f HDFS-8807. dfs.datanode.data.dir does not handle spaces between storageType and URI correctly. Contributed by Anu Engineer 2015-11-24 16:05:21 -08:00
Jason Lowe
3a2f5d6329 YARN-4365. FileSystemNodeLabelStore should check for root dir existence on startup. Contributed by Kuhu Shukla 
(cherry picked from commit f5acf94ecafb301a0cc8e8f91f19c8bcbc8da701)
 2015-11-24 23:47:54 +00:00
Jason Lowe
9e54433c6c YARN-4132. Separate configs for nodemanager to resourcemanager connection timeout and retries. Contributed by Chang Li 
(cherry picked from commit 4ac6799d4a8b071e0d367c2d709e84d8ea06942d)
 2015-11-24 22:36:19 +00:00
Jason Lowe
2f18218508 MAPREDUCE-5870. Support for passing Job priority through Application Submission Context in Mapreduce Side. Contributed by Sunil G 
(cherry picked from commit f634505d48d97e4d461980d68a0cbdf87223646d)

Conflicts:

	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestJobConf.java
 2015-11-24 22:15:37 +00:00
Jason Lowe
ef3e01a1e4 MAPREDUCE-5883. "Total megabyte-seconds" in job counters is slightly misleading. Contributed by Nathan Roberts 
(cherry picked from commit cab3c7c8892ad33a7eb0955b01e99872ab95e192)
 2015-11-24 22:01:53 +00:00
Haohui Mai
b07c91a16b HDFS-8335. FSNamesystem should construct FSPermissionChecker only if permission is enabled. Contributed by Gabor Liptak. 2015-11-24 13:07:45 -08:00
Allen Wittenauer
38f8952c4d HADOOP-11954. Solaris does not support RLIMIT_MEMLOCK as in Linux (Alan Burlison via aw) 2015-11-24 12:48:02 -08:00
Tsz-Wo Nicholas Sze
15ecbc95bf Move HDFS-9434 to 2.6.3 in CHANGES.txt. 2015-11-24 12:44:37 -08:00
Jason Lowe
7923130114 Revert "HADOOP-11361. Fix a race condition in MetricsSourceAdapter.updateJmxCache. Contributed by Brahma Reddy Battula." 
This reverts commit 4356e8a5ef0ac6d11a34704b80ef360a710e623a.

Conflicts:

	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/impl/MetricsSourceAdapter.java
(cherry picked from commit 17b1a5482b32dab82225e8233648990bc77674ba)
 2015-11-24 19:13:26 +00:00
Ming Ma
85d04dc464 HDFS-9314. Improve BlockPlacementPolicyDefault's picking of excess replicas. (Xiao Chen via mingma) 
(cherry picked from commit 0e54b164a8d8acf09aca8712116bf7a554cb4846)
 2015-11-24 10:31:23 -08:00
cnauroth
c79f017752 HDFS-6101. TestReplaceDatanodeOnFailure fails occasionally. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 1777608fa075a807c645619fda87cb8de1b0350c)
 2015-11-24 09:39:37 -08:00