Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,040 Commits 326 Branches 371 Tags
Commit Graph

8040 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Kihwal Lee
020ef7f5bb HADOOP-13052. ChecksumFileSystem mishandles crc file permissions. Contributed by Daryn Sharp. 
(cherry picked from commit 9dbdc8e12d009e76635b2d20ce940851725cb069)
(cherry picked from commit 0bb23e22cef74a6f6dbd46f77288f15fb69a0c03)
 2016-09-13 17:00:30 -07:00
Rohith Sharma K S
d42af00cad YARN-4794. Deadlock in NMClientImpl. Contributed by Jian He. 
(cherry picked from commit 3afdac6e2c5b98cf1b5e3069ae722a06f645d58d)
 2016-09-13 16:46:27 -07:00
Kihwal Lee
3b39721f30 HDFS-10178. Permanent write failures can happen if pipeline recoveries occur for the first packet. Contributed by Kihwal Lee. 
(cherry picked from commit a7d1fb0cd2fdbf830602eb4dbbd9bbe62f4d5584)
(cherry picked from commit 69d4fa0deb27a4992cee15203277b2caa9d26d79)
 2016-09-13 16:38:39 -07:00
Andrew Wang
980098c45e MAPREDUCE-6637. Testcase Failure : TestFileInputFormat.testSplitLocationInfo. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 37577852ba54ba506b0b6c4db5e95d176f5e9b63)
(cherry picked from commit 7f6737951a124480af2f3fff9358865fff3ed091)
(cherry picked from commit 403934c0115c12e895509ce5321046d3af731377)
 2016-09-13 16:27:27 -07:00
Vinayakumar B
a5424e2a10 HADOOP-12810. FileSystem#listLocatedStatus causes unnecessary RPC calls (Contributed by Ryan Blue) 
(cherry picked from commit 96ea3094315bb1e1a5e268e3817c7fdedc3e9462)
(cherry picked from commit 2bf5a005fab287689a148c1928f3b04c0a8dcedf)
(cherry picked from commit a9c1bb42418dbde8958dbbc115f6045e696ea2ea)
 2016-09-13 16:22:11 -07:00
Colin Patrick Mccabe
e6856d66e6 HDFS-9669. TcpPeerServer should respect ipc.server.listen.queue.size (Elliot Clark via cmccabe) 
(cherry picked from commit 2da03b48eba53d4dec2a77209ad9835d808171d1)
(cherry picked from commit 60d3a3c30b05fdeec5cc369a698297ee309d620e)
(cherry picked from commit c4c94e1cf2a8e03ee7888c69a7dd8f2b7e2df14d)
(cherry picked from commit 449d2ad85c64f2e1ab9cde38460094b935faa66e)
 2016-09-13 16:16:51 -07:00
Kihwal Lee
54b408a326 HDFS-8845. DiskChecker should not traverse the entire tree (Chang Li via Colin P. McCabe) 
(cherry picked from commit ec183faadcf7edaf432aca3b25d24215d505c2ec)
(cherry picked from commit a4492dc6ac67d1234853fb3731c6d1a7bce0e409)
 2016-09-13 16:10:10 -07:00
Karthik Kambatla
6ad254b821 MAPREDUCE-5817. Mappers get rescheduled on node transition even after all reducers are completed. (Sangjin Lee via kasha) 
(cherry picked from commit 27d24f96ab8d17e839a1ef0d7076efc78d28724a)

(cherry picked from commit b826168173c3386738acc12a5d62577f12aa06e9)
 2016-09-13 16:02:17 -07:00
Jason Lowe
9074ebc0d1 YARN-5009. NMLeveldbStateStoreService database can grow substantially leading to longer recovery times. Contributed by Jason Lowe 2016-09-13 16:29:05 +00:00
Akira Ajisaka
4ed74a917c HADOOP-13579. Fix source-level compatibility after HADOOP-11252. Contributed by Tsuyoshi Ozawa. 2016-09-09 14:30:01 +09:00
Arpit Agarwal
3f87efc0c8 HDFS-9530. ReservedSpace is not cleared for abandoned Blocks (Brahma Reddy Battula) 2016-08-17 14:59:04 -07:00
Andrew Wang
2586b75004 HADOOP-13494. ReconfigurableBase can log sensitive information. Contributed by Sean Mackrory. 2016-08-17 13:18:44 -07:00
Jason Lowe
f1d91cea21 YARN-5483. Optimize RMAppAttempt#pullJustFinishedContainers. Contributed by sandflee 2016-08-10 18:13:30 +00:00
Jason Lowe
2dc43a2054 YARN-5262. Optimize sending RMNodeFinishedContainersPulledByAMEvent for every AM heartbeat. Contributed by Rohith Sharma K S 
(cherry picked from commit 26b5e6116f392b6be91dca57968259f87554ce33)
 2016-08-09 22:20:49 +00:00
Jason Lowe
4feb17ea28 YARN-4573. Fix test failure in TestRMAppTransitions#testAppRunningKill and testAppKilledKilled. (Takashi Ohnishi via rohithsharmaks) 
(cherry picked from commit c01bee010832ca31d8e60e5461181cdf05140602)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2016-08-05 20:14:23 +00:00
Jason Lowe
96e0771684 YARN-5462. TestNodeStatusUpdater.testNodeStatusUpdaterRetryAndNMShutdown fails intermittently. Contributed by Eric Badger 
(cherry picked from commit db646540f094077941b56ed681a4f3e5853f5b7f)
 2016-08-03 19:26:25 +00:00
Jing Zhao
b9d4144c2b HDFS-10653. Optimize conversion from path string to components. Contributed by Daryn Sharp. 
(cherry picked from commit bd3dcf46e263b6e6aa3fca6a5d9936cc49e3280f)
(cherry picked from commit 6a7fe835f19141cc633824cd5d21f1e30f014bce)
(cherry picked from commit 2a5b8e5b3a7ac716253f68ccd25f95ae189bc3ea)
 2016-07-22 08:47:17 -07:00
Tsuyoshi Ozawa
2f546755c8 HADOOP-13298. Fix the leftover L&N files in hadoop-build-tools/src/main/resources/META-INF/. (ozawa) 
(cherry picked from commit ea9f43781e5a9a4a6121dd3be106ced6b811754d)
(cherry picked from commit 65adabd0d1bba1c59653cfcd9b4b6253815adb15)
 2016-07-16 08:34:57 +09:00
Zhe Zhang
fc335e5297 HADOOP-13290. Appropriate use of generics in FairCallQueue. Contributed by Jonathan Hung. 
(cherry picked from commit 728bf7f6988e13f17f03d2e3a4037b7238c4fd45)
(cherry picked from commit b95f1af8a9aafb3e482c7b8825f2097f2ceb0e8e)
(cherry picked from commit cbd885b6fa26b7a84a4a19d6084d95665f21378a)
(cherry picked from commit 45ed97e0d2a5a842842c3738f0413345aa633184)
 2016-07-13 16:52:38 -07:00
Zhe Zhang
9684b659ff HDFS-10544. Balancer doesn't work with IPFailoverProxyProvider. 
(cherry picked from commit 087290e6b1cb1082646d966b65494082712ebe3e)
(cherry picked from commit 5b4e916b3cae2540267d48716fd9240dfc055288)
(cherry picked from commit af94dfaa53532d7c650478050621d216360e04b5)
(cherry picked from commit c7e1e92c1afea72b37fc4788956caa20fea7e5c6)
 2016-07-13 14:54:43 -07:00
Varun Saxena
6b1ee2cfb7 YARN-5353. ResourceManager can leak delegation tokens when they are shared across apps. (Jason Lowe via Varun Saxena). 2016-07-13 07:30:15 +05:30
Jason Lowe
7af3395a49 YARN-4393. Fix intermittent test failure for TestResourceLocalizationService#testFailedDirsResourceRelease (Varun Saxana via rohithsharmaks) 
(cherry picked from commit 791c1639ae0b351e0bf0b2ecec854dc72ab07935)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2016-07-12 19:37:18 +00:00
Akira Ajisaka
59818313d4 HADOOP-13297. Add missing dependency in setting maven-remote-resource-plugin to fix builds. Contributed by Sean Busbey. 
(cherry picked from commit 7bd5d4272cd686e06c5d5fcc489b69312dacb47b)
(cherry picked from commit 02b037f6257e7379b6bbd656ccbe4472d3f46c40)
 2016-07-11 17:26:46 -07:00
Andrew Wang
e64094484d HADOOP-13350. Additional fix to LICENSE and NOTICE. Contributed by Xiao Chen. 
(cherry picked from commit 830516b8c5d25b8dd1434d8b9caab89cf5e43359)
 2016-07-07 10:45:07 -07:00
Rohith Sharma K S
ce2fcd932d YARN-5197. RM leaks containers if running container disappears from node update. Contributed by Jason Lowe. 2016-06-21 11:04:05 +05:30
Xiaoyu Yao
392e7e2d06 HADOOP-13255. KMSClientProvider should check and renew tgt when doing delegation token operations. Contributed by Xiao Chen. 
(cherry picked from commit ddf66427ff92a3886f94954e21d59e998412059b)
 2016-06-16 20:17:24 -07:00
Konstantin V Shvachko
02b5091a14 HADOOP-13189. FairCallQueue makes callQueue larger than the configured capacity. Contributed by Vinitha Gankidi. 2016-06-16 19:13:53 -07:00
Akira Ajisaka
fbbd1571e6 HADOOP-12893. Verify LICENSE.txt and NOTICE.txt. Contributed by Xiao Chen, Andrew Wang, and Akira Ajisaka. 2016-06-15 13:45:56 +09:00
Kihwal Lee
867b29be9c HDFS-8581. ContentSummary on / skips further counts on yielding lock (contributed by J.Andreina) 
(cherry picked from commit 4014ce5990bff9b0ecb3d38a633d40eaf6cf07a7)
(cherry picked from commit 8854cdd9eefd05c10d0518528a3bff6a7348f37e)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2016-06-14 08:31:00 -05:00
Jason Lowe
a2d960b6dc YARN-5206. RegistrySecurity includes id:pass in exception text if considered invalid. Contributed by Steve Loughran 
(cherry picked from commit 8c8a377cac10b086a7ff37ee366b79e6b04d2738)
 2016-06-08 14:22:08 +00:00
Zhe Zhang
1b00cebcdb HDFS-10458. getFileEncryptionInfo should return quickly for non-encrypted cluster. 
(cherry picked from commit 9b68eda2746702246c7f4b4abe412c974ba56339)
(cherry picked from commit 6de9213df111a9a4ed875db995d67af72d08a798)
(cherry picked from commit 06e38c835d0ad9619d4bea662f2dd7d0f62007a9)
(cherry picked from commit 0274636529cfac4d64582a7c21631aebbf4deb1b)
 2016-06-07 10:42:19 -07:00
Jason Lowe
7fe08d762f YARN-4459. container-executor should only kill process groups. Contributed by Jun Gong 
(cherry picked from commit f0520a2c94a9052e9907847cd8381844285a7f5f)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2016-05-25 21:56:50 +00:00
Jason Lowe
07b702d9d5 MAPREDUCE-6558. multibyte delimiters with compressed input files generate duplicate records. Contributed by Wilfred Spiegelenburg 
(cherry picked from commit 9227dfc25f373a99cb66ad7d6bacef8dcf336f77)
 2016-05-13 14:38:57 +00:00
Colin Patrick Mccabe
167e54ed34 HDFS-10377. CacheReplicationMonitor shutdown log message should use INFO level (Yiqun Lin via cmccabe) 
(cherry picked from commit f0252ad2525c90b2b89ae2ff1de12482da2c8ddd)
(cherry picked from commit 43f32d3f4a86d8f2a302530831003496c78fd561)
(cherry picked from commit 154332bb5463998d5e8f2251c8010d624f5e85a9)
(cherry picked from commit a61e04171f36ce75a8b5b501bc883e46fa67ef08)
 2016-05-10 11:22:42 -07:00
Jason Lowe
5c457e37e9 Addendum to CHANGES.txt for MR-6689 2016-05-06 22:56:35 +00:00
Jason Lowe
0bd88aa78b MAPREDUCE-6689. MapReduce job can infinitely increase number of reducer resource requests. Contributed by Wangda Tan 
(cherry picked from commit c9bb96fa81fc925e33ccc0b02c98cc2d929df120)

Conflicts:

	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/rm/TestRMContainerAllocator.java
 2016-05-06 22:34:12 +00:00
Haohui Mai
a9beec0221 HDFS-7258. CacheReplicationMonitor rescan schedule log should use DEBUG level instead of INFO level. Contributed by Xiaoyu Yao. 
(cherry picked from commit 0942c99eba12f6baf5609c9621cd07b09618a97e)
 2016-05-06 14:05:00 -07:00
Vinod Kumar Vavilapalli
ab4fad0d82 MAPREDUCE-6514. Fixed MapReduce ApplicationMaster to properly updated resources ask after ramping down of all reducers avoiding job hangs. Contributed by Varun Saxena and Wangda Tan. 
Updated the 2.7 branch patch to fix a minor issue in TestRMContainerAllocator.java and a minor fix in the 2.6 patch.

(cherry picked from commit 8d48266720dcf0e71cfd87fef18b60a53aa1bef9)
(cherry picked from commit 9f51a3f430e4a8efc54193af4fe9fc1509f9980f)
 2016-05-05 20:43:07 -07:00
Harsh J
916f949131 HDFS-2580. NameNode#main(...) can make use of GenericOptionsParser. Contributed by harsh. (harsh) 
(cherry picked from commit 54e612bfb9f877e58f7f153c43cb4147876826d3)
 2016-05-02 17:50:30 -07:00
Arpit Agarwal
fffa13b2d6 HDFS-10264. Logging improvements in FSImageFormatProtobuf.Saver. (Contributed by Xiaobing Zhou) 2016-04-21 14:55:54 -07:00
Andrew Wang
36a9150b2b HADOOP-13043. Add LICENSE.txt entries for bundled javascript dependencies. 
(cherry picked from commit 08b7efa95202b6d6ada143cab9369fac4ebb4c49)
(cherry picked from commit e16040b2af5046e3919a1f20cb801ba2ebc823c9)
(cherry picked from commit 22403be0c3b311c54a66d9d8a5d606bf5045fc1d)
(cherry picked from commit 7cf625188cbc2b369986bf5c98c3f1bbfb8cd198)
 2016-04-21 14:12:09 -07:00
Andrew Wang
ccd4b83972 HADOOP-13042. Restore lost leveldbjni LICENSE and NOTICE changes. 
(cherry picked from commit fea50c5440d83225958c5e346299334559fc37a4)
(cherry picked from commit c28e4b0651cfd5ed142980dc10f4c2a7388a39a0)
(cherry picked from commit bae229ae27605d039d692fdd1edc5b4d946ddbe8)

 Conflicts:
	LICENSE.txt

(cherry picked from commit b8febb774a195f185a41824de673fa17aad8e5f0)
 2016-04-21 13:52:03 -07:00
Vinayakumar B
5eb7b68efe Changed version to 2.6.5-SNAPSHOT 2016-04-12 12:06:27 +05:30
Vinayakumar B
a8b1a63b8f Addendum: HDFS-10271. 
Added CHANGES.txt entry

(cherry picked from commit b52ac3cb4d49a9ec9f3e5f1ed7a5f40521ef3cf1)
 2016-04-12 11:57:28 +05:30
Vinayakumar B
713ba2a732 HDFS-10271. Extra bytes are getting released from reservedSpace for append (Contributed by Brahma Reddy Battula) 
(cherry picked from commit 37e4e45390007536cb53f375d529910d65cd5d19)
 2016-04-12 11:33:13 +05:30
Wangda Tan
74aca34882 MAPREDUCE-6302. Preempt reducers after a configurable timeout irrespective of headroom. (kasha via wangda) 2016-04-08 14:34:15 -07:00
Vinayakumar B
783c99d292 HADOOP-7817. RawLocalFileSystem.append() should give FSDataOutputStream with accurate .getPos() (Contributed by kanaka kumar avvaru) 
(cherry picked from commit 48ca23def1d1c28448a65238814070e79c8f4c4e)
(cherry picked from commit d21bc811d82f685b0a1338bc513d9a925d305a17)

(cherry picked from commit 62da8f6fa688b503ed124313bc2f6f664175d225)

 Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
        hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/RawLocalFileSystem.java
 2016-04-06 10:52:28 +08:00
Jason Lowe
95b8700969 YARN-4773. Log aggregation performs extraneous filesystem operations when rolling log aggregation is disabled. Contributed by Jun Gong 2016-04-05 14:05:11 +00:00
Walter Su
173681a477 HDFS-10182. Hedged read might overwrite user's buf. Contributed by zhouyingchao. 2016-03-29 16:10:50 +08:00
Jason Lowe
c092a8c1bb HADOOP-12958. PhantomReference for filesystem statistics can trigger OOM. Contributed by Sangjin Lee 
(cherry picked from commit 9a09200a1f5f752e266d4fb8e0c808073080bde8)
 2016-03-25 23:05:29 +00:00