Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,474 Commits 326 Branches 371 Tags
Commit Graph

10474 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Haohui Mai
274af9b579 HADOOP-10729. Add tests for PB RPC in case version mismatch of client and server. Contributed by Junping Du. 2015-12-09 05:44:36 +08:00
Chris Douglas
3d100163de YARN-4248. Followup patch adding asf-licence exclusions for json test files 
(cherry picked from commit 9f50e13d5dc329c3a6df7f9bcaf2f29b35adc52b)
(cherry picked from commit bfe4796802c8f706fdc4c393324ddb9f24194677)
 2015-12-08 12:08:53 -08:00
Vinod Kumar Vavilapalli
469bf56801 HDFS-9273. Moving to 2.6.3 CHANGES section to reflect the backport. 2015-12-08 11:35:28 -08:00
=
3205fe3da8 YARN-4248. REST API for submit/update/delete Reservations. (curino) 
(cherry picked from commit c25a6354598ec855bec7f695a7c3eed8794cd381)
(cherry picked from commit 4ac1564418597e2ebbaa80600eb5f002b1431281)
 2015-12-07 13:46:37 -08:00
rohithsharmaks
03e615ba55 YARN-3456. Improve handling of incomplete TimelineEntities. (Varun Saxena via rohithsharmaks) 
(cherry picked from commit 01a641bc447c464b2830d58addd482f47dbd92ae)
 2015-12-07 15:20:50 +05:30
Arun Suresh
db69c5f744 YARN-4358. Reservation System: Improve relationship between SharingPolicy and ReservationAgent. (Carlo Curino via asuresh) 
(cherry picked from commit 742632e346604fd2b263bd42367165638fcf2416)
 2015-12-05 21:35:32 -08:00
Arpit Agarwal
43241bf8e5 HDFS-9214. Add missing license header 2015-12-04 15:33:30 -08:00
Arpit Agarwal
da3dfd77fd HDFS-9214. Support reconfiguring dfs.datanode.balance.max.concurrent.moves without DN restart. (Contributed by Xiaobing Zhou) 2015-12-04 14:47:01 -08:00
Yongjun Zhang
560d49da8f HDFS-9474. TestPipelinesFailover should not fail when printing debug message. (John Zhuge via Yongjun Zhang) 
(cherry picked from commit 59dbe8b3e96d13c2322cabd87c7f893c5a3812ba)
 2015-12-04 14:02:28 -08:00
Tsz-Wo Nicholas Sze
afc76eb218 HDFS-9294. DFSClient deadlock when close file and failed to renew lease. Contributed by Brahma Reddy Battula 2015-12-03 11:35:29 -08:00
Junping Du
6af5255b02 YARN-4408. Fix issue that NodeManager still reports negative running containers. Contributed by Robert Kanter. 
(cherry picked from commit 62e9348bc10bb97a5fcb4281f7996a09d8e69c60)
(cherry picked from commit e76ba91fa58dae6750f608c0f8b86e9a43e80005)
 2015-12-03 06:39:07 -08:00
Akira Ajisaka
78552d8857 HADOOP-12565. Replace DSA with RSA for SSH key type in SingleCluster.md. Contributed by Mingliang Liu. 
(cherry picked from commit 3857fed2c8fc601b46e8331f73a3104f4f33e498)
(cherry picked from commit 15c2f709c685986518feba60fc35222574ce3f0f)
 2015-12-03 11:52:11 +08:00
Colin Patrick Mccabe
228ad84e9c HDFS-9429. Tests in TestDFSAdminWithHA intermittently fail with EOFException (Xiao Chen via Colin P. McCabe) 
(cherry picked from commit 53e3bf7e704c332fb119f55cb92520a51b644bfc)
(cherry picked from commit 9b516a2a0501242b27f10a8f3e8551ed85a11320)
 2015-12-02 15:40:49 -08:00
Junping Du
12fb8b4cc5 Add 2.6.4 as release entry to CHANGES.txt 2015-12-02 07:38:03 -08:00
Arpit Agarwal
05d7202b1e HDFS-6533. TestBPOfferService#testBasicFunctionalitytest fails intermittently. (Contributed by Wei-Chiu Chuang) 2015-12-01 15:29:42 -08:00
Arpit Agarwal
a99274ea96 HADOOP-12609. Fix intermittent failure of TestDecayRpcScheduler. (Contributed by Masatake Iwasaki) 2015-12-01 15:29:39 -08:00
Yongjun Zhang
3b9043348a HADOOP-12468. Partial group resolution failure should not result in user lockout. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit 0348e769abc507c69d644db7bc56d31d971c51d1)
(cherry picked from commit 165abe6c4fe18ab3ba6d34b19b940a16e11e7242)
 2015-12-01 15:01:56 -08:00
Kihwal Lee
b70b380f37 HDFS-9426. Rollingupgrade finalization is not backward compatible (Contributed by Kihwal Lee) 
(cherry picked from commit c62d42cd8bb09a5ffc0c5eefa2d87913e71b9e7e)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolClientSideTranslatorPB.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolServerSideTranslatorPB.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/proto/DatanodeProtocol.proto
(cherry picked from commit 9f256d1d716a7e17606245fcfc619901a8fa299a)
 2015-12-01 16:43:27 -06:00
Zhe Zhang
456426fe6b HDFS-9269. Update the documentation and wrapper for fuse-dfs. Contributed by Wei-Chiu Chuang. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

Change-Id: Idebd3b5d2ab09910c71cfde19e4b4d88f7ce1efb
 2015-12-01 14:41:57 -08:00
Jing Zhao
084ad2b420 HDFS-9485. Make BlockManager#removeFromExcessReplicateMap accept BlockInfo instead of Block. Contributed by Mingliang Liu. 
(cherry picked from commit 830eb252aaa4fec7ef2ec38cb66f669e8e1ecaa5)
(cherry picked from commit 7e416aa70d76c39dcbc582d1b5bc4b36f557454e)
 2015-12-01 13:10:56 -08:00
Allen Wittenauer
81a7ad45c9 HADOOP-12366. expose calculated paths (aw) 2015-12-01 08:15:57 -08:00
Akira Ajisaka
745772c975 HDFS-9336. deleteSnapshot throws NPE when snapshotname is null. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 1c05393b51748033279bff31dbc5c5cae7fc3a86)
(cherry picked from commit 402a2f2d6463383b623cd4c59c6631768907e299)
 2015-12-01 11:30:26 +08:00
Andrew Wang
8676959d13 HDFS-9470. Encryption zone on root not loaded from fsimage after NN restart. Xiao Chen via wang. 
(cherry picked from commit 9b8e50b424d060e16c1175b1811e7abc476e2468)
(cherry picked from commit ce1111ceea830cce5f0833db55201e0e88c3b199)
 2015-11-30 18:04:46 -08:00
cnauroth
6417121ddb HADOOP-12600. FileContext and AbstractFileSystem should be annotated as a Stable interface. Contributed by Chris Nauroth. 
(cherry picked from commit b2c78536cb55c58e4d4a0ea16f648a34c7e2f88c)
(cherry picked from commit 669743ce114181e5d95eb946be3ef1604de78665)
 2015-11-28 15:40:25 -08:00
Vinod Kumar Vavilapalli
efaef45a24 Reverting previous commit which added 2.9.0 entries. Don't need that in branch-2.8. 
Revert "Adding release 2.8.0 to CHANGES.txt"

This reverts commit 767815f3176c4776ea828994a662404df303f890.
 2015-11-25 17:49:48 -08:00
Vinod Kumar Vavilapalli
767815f317 Adding release 2.8.0 to CHANGES.txt 
(cherry picked from commit d57fd181c75c2578775fda0ec575b66da416adff)
 2015-11-25 17:37:47 -08:00
Robert Kanter
7b4bf23b2a MAPREDUCE-6550. archive-logs tool changes log ownership to the Yarn user when using DefaultContainerExecutor (rkanter) 
(cherry picked from commit 6d84cc16b3e0685fef01d0e3526b0f7556ceff51)
 2015-11-25 17:13:00 -08:00
Robert Kanter
8c6273d117 MAPREDUCE-6549. multibyte delimiters with LineRecordReader cause duplicate records (wilfreds via rkanter) 
(cherry picked from commit 7fd00b3db4b7d73afd41276ba9a06ec06a0e1762)
 2015-11-25 17:03:52 -08:00
Jing Zhao
288cf8437b HDFS-9467. Fix data race accessing writeLockHeldTimeStamp in FSNamesystem. Contributed by Mingliang Liu. 
(cherry picked from commit e556c35b0596700f9ec9d0a51cf5027259d531b5)
 2015-11-25 14:23:06 -08:00
Konstantin V Shvachko
9c1ef648a9 HDFS-9407. TestFileTruncate should not use fixed NN port. Contributed by Brahma Reddy Battula. 2015-11-25 14:16:03 -08:00
Xiaoyu Yao
4f1f9f7eff HDFS-8512. WebHDFS : GETFILESTATUS should return LocatedBlock with storage type info. Contributed by Xiaoyu Yao. 
(cherry picked from commit e3d673901b396cf5bbede5ed6f607ce68301ec0a)
 2015-11-25 13:54:22 -08:00
Haohui Mai
15caaa7d0a HDFS-9459. hadoop-hdfs-native-client fails test build on Windows after transition to ctest. Contributed by Chris Nauroth. 2015-11-25 10:32:13 -08:00
Junping Du
628c782870 Tests in mapreduce-client-app are writing outside of target. Contributed by Akira AJISAKA. 
(cherry picked from commit 15d577bfbb3f18fc95251d22378b53aa4210115f)
 2015-11-25 09:16:22 -08:00
Yongjun Zhang
48b294c58e HDFS-9438. TestPipelinesFailover assumes Linux ifconfig. (John Zhuge via Yongjun Zhang) 
(cherry picked from commit 8176ea7dc694841a993f2bfc30669fe22f9ec1d2)
 2015-11-25 08:50:02 -08:00
Yongjun Zhang
7ac8d8f510 HDFS-6694. Addendum. Update CHANGES.txt for cherry-picking to 2.8. 
(cherry picked from commit 84d01ad7f43bc498bc2e9d3afe68aed7f4a4d462)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-11-25 08:49:26 -08:00
arp
566ceac1ff HDFS-6694. TestPipelinesFailover.testPipelineRecoveryStress tests fail intermittently with various symptoms - debugging patch (Contributed by Yongjun Zhang) 
(cherry picked from commit c5d9a4a91e4e0faae3a8530408da35b591396060)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-11-25 08:45:59 -08:00
Akira Ajisaka
4257991257 HADOOP-12598. Add XML namespace declarations for some hadoop/tools modules. Contributed by Xin Wang. 
(cherry picked from commit b53f20135599cc7825b6213794e2f999bc43e2ad)
 2015-11-26 01:21:32 +09:00
Tsuyoshi Ozawa
d76b523b02 YARN-4380. TestResourceLocalizationService.testDownloadingResourcesOnContainerKill fails intermittently. Contributed by Varun Saxena. 
(cherry picked from commit 0656d2dc83af6a48a8d8d0e37cdf1f813124f366)
 2015-11-26 01:10:41 +09:00
Akira Ajisaka
5794dc83b0 Fix indents in the 2.8.0 section of MapReduce CHANGES.txt. 
(cherry picked from commit 177975e962284a2bbd954ebb32bf8f6da5fc975e)
 2015-11-25 16:44:25 +09:00
Akira Ajisaka
c6cf7910a4 MAPREDUCE-6553. Replace '\u2b05' with '<-' in rendering job configuration. Contributed by Gabor Liptak. 
(cherry picked from commit 5ec44fc35c129d266edaebbc6fa17754a89b2ad6)
 2015-11-25 16:33:18 +09:00
Tom Zeng
d6f7d22929 HADOOP-12415. Add io.netty dependency to hadoop-nfs and to hadoop-hdfs, needed to build Bigtop successfuly, see BIGTOP-2049 
Signed-off-by: Konstantin Boudnik <cos@boudnik.org>
(cherry picked from commit b4c6b511e705230dfe4580288addacb81f5c5c5f)
 2015-11-24 18:39:01 -08:00
Wangda Tan
7b9f7eaf5c YARN-4384. updateNodeResource CLI should not accept negative values for resource. (Junping Du via wangda) 
(cherry picked from commit 23c625ec571b01c0a2811728608890da38f86890)
 2015-11-24 16:36:30 -08:00
Tsz-Wo Nicholas Sze
79e55fb47f HDFS-8807. dfs.datanode.data.dir does not handle spaces between storageType and URI correctly. Contributed by Anu Engineer 2015-11-24 16:05:21 -08:00
Jason Lowe
3a2f5d6329 YARN-4365. FileSystemNodeLabelStore should check for root dir existence on startup. Contributed by Kuhu Shukla 
(cherry picked from commit f5acf94ecafb301a0cc8e8f91f19c8bcbc8da701)
 2015-11-24 23:47:54 +00:00
Jason Lowe
9e54433c6c YARN-4132. Separate configs for nodemanager to resourcemanager connection timeout and retries. Contributed by Chang Li 
(cherry picked from commit 4ac6799d4a8b071e0d367c2d709e84d8ea06942d)
 2015-11-24 22:36:19 +00:00
Jason Lowe
2f18218508 MAPREDUCE-5870. Support for passing Job priority through Application Submission Context in Mapreduce Side. Contributed by Sunil G 
(cherry picked from commit f634505d48d97e4d461980d68a0cbdf87223646d)

Conflicts:

	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestJobConf.java
 2015-11-24 22:15:37 +00:00
Jason Lowe
ef3e01a1e4 MAPREDUCE-5883. "Total megabyte-seconds" in job counters is slightly misleading. Contributed by Nathan Roberts 
(cherry picked from commit cab3c7c8892ad33a7eb0955b01e99872ab95e192)
 2015-11-24 22:01:53 +00:00
Haohui Mai
b07c91a16b HDFS-8335. FSNamesystem should construct FSPermissionChecker only if permission is enabled. Contributed by Gabor Liptak. 2015-11-24 13:07:45 -08:00
Allen Wittenauer
38f8952c4d HADOOP-11954. Solaris does not support RLIMIT_MEMLOCK as in Linux (Alan Burlison via aw) 2015-11-24 12:48:02 -08:00
Tsz-Wo Nicholas Sze
15ecbc95bf Move HDFS-9434 to 2.6.3 in CHANGES.txt. 2015-11-24 12:44:37 -08:00