Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,589 Commits 326 Branches 371 Tags
Commit Graph

10589 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jian He
16f7ac48d4 YARN-4403. (AM/NM/Container)LivelinessMonitor should use monotonic time when calculating period. Contributed by Junping Du 2015-12-14 13:52:33 -08:00
Jing Zhao
73a055bb9f HDFS-9535. Newly completed blocks in IBR should not be considered under-replicated too quickly. Contributed by Mingliang Liu. 
(cherry picked from commit e53456981474d6e16e3c134e3777b3588dc6fedf)
(cherry picked from commit e02ad5a6187d4560c8ee58b4a5582042592fa817)
 2015-12-14 11:20:10 -08:00
Arun Suresh
c2e788a7b5 YARN-4358 addendum patch to fix javadoc error 
(cherry picked from commit 7fb212e5e672b3f285493f6c7b2598ef7e61406b)
 2015-12-12 22:26:35 -08:00
Uma Mahesh
4c0b9c9062 HDFS-9528. Cleanup namenode audit/log/exception messages. (szetszwo via umamahesh) 
(cherry picked from commit 796a676d18bd7cd3ed4113d002e0e69cf261d6d1)
 2015-12-11 19:32:40 -08:00
Yongjun Zhang
d02886bf8d HDFS-9532. Detailed exception info is lost in reportTo methods of ErrorReportAction and ReportBadBlockAction. (Yongjun Zhang) 
(cherry picked from commit f5a911452f8f6bc8a37617d1fc155e5ec23f3a78)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

(cherry picked from commit e00888d5cba7f47e1d5006d329f2523139423da3)
 2015-12-11 18:30:57 -08:00
Kihwal Lee
937a43dc29 HDFS-9445. Datanode may deadlock while handling a bad volume. Contributed by Walter Su. 
(cherry picked from commit a48301791e9564363bc2abad4e89e344b0d7a5ff)
 2015-12-11 08:46:42 -06:00
Uma Mahesh
d028295414 HDFS-9472. concat() API does not give proper exception messages on ./reserved relative path (Rakesh R via umamahesh) 
(cherry picked from commit e363417e7b7abdd5d149f303f729ecf3e95ef8f3)
 2015-12-11 00:02:49 -08:00
Akira Ajisaka
028f66b8a2 HADOOP-12602. TestMetricsSystemImpl#testQSize occasionally fails. Contributed by Masatake Iwasaki. 
(cherry picked from commit eee0cf4611b02171e8a043f1cc5f7dbad47fc3b4)
(cherry picked from commit 5047ee56af9edd2e6240286e2238b638a738f570)
 2015-12-11 16:19:12 +09:00
Junping Du
5adf7d851c YARN-3623. Add a config to indicate the Timeline Service version. Contributed by Xuan Gong. 
(cherry picked from commit f910e4f639dc311fcb257bfcb869b1aa8b2c0643)
(cherry picked from commit 0b5e76e9ff14811ad2617e632854f21d82558e5e)
 2015-12-10 02:58:28 -08:00
Tsz-Wo Nicholas Sze
26c8950fb4 HDFS-9527. The return type of FSNamesystem.getBlockCollection should be changed to INodeFile. 2015-12-09 18:14:07 -08:00
Akira Ajisaka
59c892683f YARN-4434. NodeManager Disk Checker parameter documentation is not correct. Contributed by Weiwei Yang. 
(cherry picked from commit 16dc65811d4e0e7ab61c61295149848fe53ddd89)
(cherry picked from commit 925bb94d87db7e916ed380d4512225e796f9e03d)
 2015-12-09 16:33:12 +09:00
Uma Mahesh
9c5650cf03 HADOOP-12618. Fix NPE in TestSequenceFile. (Brahma Reddy Battula via umamahesh) 
(cherry picked from commit ad53c520630847834b3e68b7f41aa88ee10b3300)
 2015-12-08 23:03:19 -08:00
rohithsharmaks
5bc33c5ae4 YARN-4421. Remove dead code in RmAppImpl.RMAppRecoveredTransition. (Daniel Templeton via rohithsharmaks) 
(cherry picked from commit a5e2e1ecb06a3942903cb79f61f0f4bb02480f19)
 2015-12-09 11:35:02 +05:30
rohithsharmaks
6a6bbc51c4 YARN-4431. Not necessary to do unRegisterNM() if NM get stop due to failed to connect to RM. (Junpin Du via rohithsharmaks) 2015-12-09 11:06:31 +05:30
mattf
05a7fb3a9a HADOOP-12617. SPNEGO authentication request to non-default realm gets default realm name inserted in target server principal. (mattf) 2015-12-08 17:46:36 -08:00
Haohui Mai
274af9b579 HADOOP-10729. Add tests for PB RPC in case version mismatch of client and server. Contributed by Junping Du. 2015-12-09 05:44:36 +08:00
Chris Douglas
3d100163de YARN-4248. Followup patch adding asf-licence exclusions for json test files 
(cherry picked from commit 9f50e13d5dc329c3a6df7f9bcaf2f29b35adc52b)
(cherry picked from commit bfe4796802c8f706fdc4c393324ddb9f24194677)
 2015-12-08 12:08:53 -08:00
Vinod Kumar Vavilapalli
469bf56801 HDFS-9273. Moving to 2.6.3 CHANGES section to reflect the backport. 2015-12-08 11:35:28 -08:00
=
3205fe3da8 YARN-4248. REST API for submit/update/delete Reservations. (curino) 
(cherry picked from commit c25a6354598ec855bec7f695a7c3eed8794cd381)
(cherry picked from commit 4ac1564418597e2ebbaa80600eb5f002b1431281)
 2015-12-07 13:46:37 -08:00
rohithsharmaks
03e615ba55 YARN-3456. Improve handling of incomplete TimelineEntities. (Varun Saxena via rohithsharmaks) 
(cherry picked from commit 01a641bc447c464b2830d58addd482f47dbd92ae)
 2015-12-07 15:20:50 +05:30
Arun Suresh
db69c5f744 YARN-4358. Reservation System: Improve relationship between SharingPolicy and ReservationAgent. (Carlo Curino via asuresh) 
(cherry picked from commit 742632e346604fd2b263bd42367165638fcf2416)
 2015-12-05 21:35:32 -08:00
Arpit Agarwal
43241bf8e5 HDFS-9214. Add missing license header 2015-12-04 15:33:30 -08:00
Arpit Agarwal
da3dfd77fd HDFS-9214. Support reconfiguring dfs.datanode.balance.max.concurrent.moves without DN restart. (Contributed by Xiaobing Zhou) 2015-12-04 14:47:01 -08:00
Yongjun Zhang
560d49da8f HDFS-9474. TestPipelinesFailover should not fail when printing debug message. (John Zhuge via Yongjun Zhang) 
(cherry picked from commit 59dbe8b3e96d13c2322cabd87c7f893c5a3812ba)
 2015-12-04 14:02:28 -08:00
Tsz-Wo Nicholas Sze
afc76eb218 HDFS-9294. DFSClient deadlock when close file and failed to renew lease. Contributed by Brahma Reddy Battula 2015-12-03 11:35:29 -08:00
Junping Du
6af5255b02 YARN-4408. Fix issue that NodeManager still reports negative running containers. Contributed by Robert Kanter. 
(cherry picked from commit 62e9348bc10bb97a5fcb4281f7996a09d8e69c60)
(cherry picked from commit e76ba91fa58dae6750f608c0f8b86e9a43e80005)
 2015-12-03 06:39:07 -08:00
Akira Ajisaka
78552d8857 HADOOP-12565. Replace DSA with RSA for SSH key type in SingleCluster.md. Contributed by Mingliang Liu. 
(cherry picked from commit 3857fed2c8fc601b46e8331f73a3104f4f33e498)
(cherry picked from commit 15c2f709c685986518feba60fc35222574ce3f0f)
 2015-12-03 11:52:11 +08:00
Colin Patrick Mccabe
228ad84e9c HDFS-9429. Tests in TestDFSAdminWithHA intermittently fail with EOFException (Xiao Chen via Colin P. McCabe) 
(cherry picked from commit 53e3bf7e704c332fb119f55cb92520a51b644bfc)
(cherry picked from commit 9b516a2a0501242b27f10a8f3e8551ed85a11320)
 2015-12-02 15:40:49 -08:00
Junping Du
12fb8b4cc5 Add 2.6.4 as release entry to CHANGES.txt 2015-12-02 07:38:03 -08:00
Arpit Agarwal
05d7202b1e HDFS-6533. TestBPOfferService#testBasicFunctionalitytest fails intermittently. (Contributed by Wei-Chiu Chuang) 2015-12-01 15:29:42 -08:00
Arpit Agarwal
a99274ea96 HADOOP-12609. Fix intermittent failure of TestDecayRpcScheduler. (Contributed by Masatake Iwasaki) 2015-12-01 15:29:39 -08:00
Yongjun Zhang
3b9043348a HADOOP-12468. Partial group resolution failure should not result in user lockout. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit 0348e769abc507c69d644db7bc56d31d971c51d1)
(cherry picked from commit 165abe6c4fe18ab3ba6d34b19b940a16e11e7242)
 2015-12-01 15:01:56 -08:00
Kihwal Lee
b70b380f37 HDFS-9426. Rollingupgrade finalization is not backward compatible (Contributed by Kihwal Lee) 
(cherry picked from commit c62d42cd8bb09a5ffc0c5eefa2d87913e71b9e7e)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolClientSideTranslatorPB.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/DatanodeProtocolServerSideTranslatorPB.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/proto/DatanodeProtocol.proto
(cherry picked from commit 9f256d1d716a7e17606245fcfc619901a8fa299a)
 2015-12-01 16:43:27 -06:00
Zhe Zhang
456426fe6b HDFS-9269. Update the documentation and wrapper for fuse-dfs. Contributed by Wei-Chiu Chuang. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

Change-Id: Idebd3b5d2ab09910c71cfde19e4b4d88f7ce1efb
 2015-12-01 14:41:57 -08:00
Jing Zhao
084ad2b420 HDFS-9485. Make BlockManager#removeFromExcessReplicateMap accept BlockInfo instead of Block. Contributed by Mingliang Liu. 
(cherry picked from commit 830eb252aaa4fec7ef2ec38cb66f669e8e1ecaa5)
(cherry picked from commit 7e416aa70d76c39dcbc582d1b5bc4b36f557454e)
 2015-12-01 13:10:56 -08:00
Allen Wittenauer
81a7ad45c9 HADOOP-12366. expose calculated paths (aw) 2015-12-01 08:15:57 -08:00
Akira Ajisaka
745772c975 HDFS-9336. deleteSnapshot throws NPE when snapshotname is null. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 1c05393b51748033279bff31dbc5c5cae7fc3a86)
(cherry picked from commit 402a2f2d6463383b623cd4c59c6631768907e299)
 2015-12-01 11:30:26 +08:00
Andrew Wang
8676959d13 HDFS-9470. Encryption zone on root not loaded from fsimage after NN restart. Xiao Chen via wang. 
(cherry picked from commit 9b8e50b424d060e16c1175b1811e7abc476e2468)
(cherry picked from commit ce1111ceea830cce5f0833db55201e0e88c3b199)
 2015-11-30 18:04:46 -08:00
cnauroth
6417121ddb HADOOP-12600. FileContext and AbstractFileSystem should be annotated as a Stable interface. Contributed by Chris Nauroth. 
(cherry picked from commit b2c78536cb55c58e4d4a0ea16f648a34c7e2f88c)
(cherry picked from commit 669743ce114181e5d95eb946be3ef1604de78665)
 2015-11-28 15:40:25 -08:00
Vinod Kumar Vavilapalli
efaef45a24 Reverting previous commit which added 2.9.0 entries. Don't need that in branch-2.8. 
Revert "Adding release 2.8.0 to CHANGES.txt"

This reverts commit 767815f3176c4776ea828994a662404df303f890.
 2015-11-25 17:49:48 -08:00
Vinod Kumar Vavilapalli
767815f317 Adding release 2.8.0 to CHANGES.txt 
(cherry picked from commit d57fd181c75c2578775fda0ec575b66da416adff)
 2015-11-25 17:37:47 -08:00
Robert Kanter
7b4bf23b2a MAPREDUCE-6550. archive-logs tool changes log ownership to the Yarn user when using DefaultContainerExecutor (rkanter) 
(cherry picked from commit 6d84cc16b3e0685fef01d0e3526b0f7556ceff51)
 2015-11-25 17:13:00 -08:00
Robert Kanter
8c6273d117 MAPREDUCE-6549. multibyte delimiters with LineRecordReader cause duplicate records (wilfreds via rkanter) 
(cherry picked from commit 7fd00b3db4b7d73afd41276ba9a06ec06a0e1762)
 2015-11-25 17:03:52 -08:00
Jing Zhao
288cf8437b HDFS-9467. Fix data race accessing writeLockHeldTimeStamp in FSNamesystem. Contributed by Mingliang Liu. 
(cherry picked from commit e556c35b0596700f9ec9d0a51cf5027259d531b5)
 2015-11-25 14:23:06 -08:00
Konstantin V Shvachko
9c1ef648a9 HDFS-9407. TestFileTruncate should not use fixed NN port. Contributed by Brahma Reddy Battula. 2015-11-25 14:16:03 -08:00
Xiaoyu Yao
4f1f9f7eff HDFS-8512. WebHDFS : GETFILESTATUS should return LocatedBlock with storage type info. Contributed by Xiaoyu Yao. 
(cherry picked from commit e3d673901b396cf5bbede5ed6f607ce68301ec0a)
 2015-11-25 13:54:22 -08:00
Haohui Mai
15caaa7d0a HDFS-9459. hadoop-hdfs-native-client fails test build on Windows after transition to ctest. Contributed by Chris Nauroth. 2015-11-25 10:32:13 -08:00
Junping Du
628c782870 Tests in mapreduce-client-app are writing outside of target. Contributed by Akira AJISAKA. 
(cherry picked from commit 15d577bfbb3f18fc95251d22378b53aa4210115f)
 2015-11-25 09:16:22 -08:00
Yongjun Zhang
48b294c58e HDFS-9438. TestPipelinesFailover assumes Linux ifconfig. (John Zhuge via Yongjun Zhang) 
(cherry picked from commit 8176ea7dc694841a993f2bfc30669fe22f9ec1d2)
 2015-11-25 08:50:02 -08:00
Yongjun Zhang
7ac8d8f510 HDFS-6694. Addendum. Update CHANGES.txt for cherry-picking to 2.8. 
(cherry picked from commit 84d01ad7f43bc498bc2e9d3afe68aed7f4a4d462)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-11-25 08:49:26 -08:00