Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,800 Commits 326 Branches 371 Tags
Commit Graph

10800 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Yongjun Zhang
fc8d9cc758 HDFS-9406. FSImage may get corrupted after deleting snapshot. (Contributed by Jing Zhao, Stanislav Antic, Vinayakumar B, Yongjun Zhang) 
(cherry picked from commit 34ab50ea92370cc7440a8f7649286b148c2fde65)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestINodeFile.java
 2016-02-01 14:09:52 -08:00
Lei Xu
d2f8e6c269 HDFS-9701. DN may deadlock when hot-swapping under load. (Xiao Chen via lei) 
(cherry picked from commit 12a4ebb4471f78b642e12c2ec0784c20f62cca3c)
 2016-02-01 12:56:00 -08:00
Xiaoyu Yao
7cc3b1c7a3 HDFS-9210. Fix some misuse of %n in VolumeScanner#printStats. Contributed by Xiaoyu Yao. 
(cherry picked from commit b11008d54d8aa3eb9c7c10c3a0734d95b9ef41e9)
 2016-02-01 11:57:11 -08:00
Jason Lowe
f5f6652137 MAPREDUCE-6618. YarnClientProtocolProvider leaking the YarnClient thread. Contributed by Xuan Gong 
(cherry picked from commit 59a212b6e1265adfa9b55c71b65a22157dfccf77)
 2016-02-01 16:06:42 +00:00
Steve Loughran
7786e97df2 HDFS-9708. FSNamesystem.initAuditLoggers() doesn't trim classnames (Mingliang Liu via stevel) 2016-02-01 16:01:32 +00:00
Vinayakumar B
71374cca9d HDFS-9566. Remove expensive 'BlocksMap#getStorages(Block b, final DatanodeStorage.State state)' method (Contributed by Daryn Sharp) 
(cherry picked from commit e418bd1fb0568ce7ae22f588fea2dd9c95567383)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
 2016-02-01 13:32:00 +05:30
Rohith Sharma K S
676f215595 YARN-4615. Fix random test failure in TestAbstractYarnScheduler#testResourceRequestRecoveryToTheRightAppAttempt. (Sunil G via rohithsharmaks) 
(cherry picked from commit 2673cbaf556eb4d0e44519cdbb8c6f0f02412a21)
 2016-02-01 10:45:05 +05:30
Jason Lowe
016c685135 YARN-4428. Redirect RM page to AHS page when AHS turned on and RM page is not available. Contributed by Chang Li 
(cherry picked from commit 772ea7b41b06beaa1f4ac4fa86eac8d6e6c8cd36)
 2016-01-29 21:54:56 +00:00
Jian He
885c76d85f YARN-4617. LeafQueue#pendingOrderingPolicy should always use fixed ordering policy instead of using same as active applications ordering policy. Contributed by Rohith Sharma K S 2016-01-29 12:22:44 -08:00
Yongjun Zhang
2fb711bde9 HDFS-9638. Improve DistCp Help and documentation. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit eddd823cd6246ddc66218eb01009c44b0236eaaa)
 2016-01-29 12:13:03 -08:00
Karthik Kambatla
9d1371d390 YARN-4647. Make RegisterNodeManagerRequestPBImpl thread-safe. (kasha) 
(cherry picked from commit c9a09d6926b258e205a4ff7998ce5a86bf5dbe3b)
 2016-01-29 08:19:34 -08:00
Devaraj K
123269c07f YARN-4411. RMAppAttemptImpl#createApplicationAttemptReport throws 
IllegalArgumentException. Contributed by Bibin A Chundatt and yarntime.

(cherry picked from commit a277bdc9edc66bef419fcd063b832073e512f234)
 2016-01-29 13:52:47 +05:30
Akira Ajisaka
6ce9b1240e MAPREDUCE-6616. Fail to create jobhistory file if there are some multibyte characters in the job name. Contributed by Kousuke Saruta. 
(cherry picked from commit d314a3f99d5d03c62a3b8fb8883886440ab7d1db)
 2016-01-29 16:20:37 +09:00
Yongjun Zhang
a24898fd49 HDFS-9706. Log more details in debug logs in BlockReceiver's constructor. (Xiao Chen via Yongjun Zhang) 
(cherry picked from commit 8ee060311c89b7faa71dd039481a97ba15e2413d)
 2016-01-28 23:13:41 -08:00
Rohith Sharma K S
b8d5df06f2 YARN-4543. Fix random test failure in TestNodeStatusUpdater.testStopReentrant. (Akihiro Suda via rohithsharmaks) 
(cherry picked from commit ac686668031ee9837deed3f3566f09f33c437870)
 2016-01-29 12:30:53 +05:30
Rohith Sharma K S
0466743afb YARN-4219. addendum patch to fix javadoc errors 
(cherry picked from commit 09d831c95ba18e2892cddd749f6e06f112dda7f5)
 2016-01-29 11:53:06 +05:30
Colin Patrick Mccabe
dc65479fc0 HDFS-7764. DirectoryScanner shouldn't abort the scan if one directory had an error (Rakesh R via cmccabe) 
(cherry picked from commit f67149ab08bb49381def6c535ab4c4610e0a4221)
 2016-01-28 20:12:18 -08:00
Karthik Kambatla
363a8212ec HADOOP-12702. Add an HDFS metrics sink. (Daniel Templeton via kasha) 
(cherry picked from commit ee005e010cff3f97a5daa8000ac2cd151e2631ca)
 2016-01-28 17:45:50 -08:00
Jian He
36f0e73882 YARN-4519. Potential deadlock of CapacityScheduler between decrease container and assign containers. Contributed by Meng Ding 2016-01-28 14:52:00 -08:00
cnauroth
bd01fdb64d MAPREDUCE-6563. Streaming documentation contains a stray % character. Contributed by Chris Nauroth. 
(cherry picked from commit 41da9a07738c6d019e2467f139750b7e2f50a914)

Conflicts:
	hadoop-mapreduce-project/CHANGES.txt
 2016-01-28 14:46:42 -08:00
Xuan
2f00d8d3a7 YARN-4219. New levelDB cache storage for timeline v1.5. Contributed by 
Li Lu

(cherry picked from commit 9fab22b36673e7f1a0bb629d2c07966ac2482e99)
 2016-01-28 14:36:58 -08:00
Jason Lowe
29195c7668 YARN-4643. Container recovery is broken with delegating container runtime. Contributed by Sidharta Seethana 
(cherry picked from commit 61382ff8fabc76b3a51f227646573cdf367fea1a)
 2016-01-28 19:00:51 +00:00
Rohith Sharma K S
6947a5d4be YARN-4633. Fix random test failure in TestRMRestart#testRMRestartAfterPreemption. (Bibin A Chundatt via rohithsharmaks) 
(cherry picked from commit ef343be82b4268ebd52f6a11e1a1ce53a5d232a9)
 2016-01-28 21:55:12 +05:30
Junping Du
db7ff115c0 MAPREDUCE-6595. Fix findbugs warnings in OutputCommitter and FileOutputCommitter. Contributed by Akira AJISAKA. 
(cherry picked from commit 86560a4978c498bd5e892c509a466807a812b8a7)
 2016-01-28 06:18:59 -08:00
Tsz-Wo Nicholas Sze
d37ecbf721 HDFS-9654. Code refactoring for HDFS-8578. 2016-01-28 10:56:39 +08:00
Tsz-Wo Nicholas Sze
b10d8ced21 HDFS-8999. Allow a file to be closed with COMMITTED but not yet COMPLETE blocks. 2016-01-28 10:42:40 +08:00
Robert Kanter
a99fa74490 MAPREDUCE-6431. JobClient should be an AutoClosable (haibochen via rkanter) 
(cherry picked from commit dca0dc8ac28e843acd8b79c9560245638a539fde)
 2016-01-27 17:11:41 -08:00
Jing Zhao
d7982222fa HDFS-9677. Rename generationStampV1/generationStampV2 to legacyGenerationStamp/generationStamp. Contributed by Mingliang Liu. 2016-01-27 15:51:10 -08:00
Jian He
da18bbedaf MAPREDUCE-6619. HADOOP_CLASSPATH is overwritten in MR container. Contributed by Junping Du 2016-01-27 13:16:59 -08:00
Karthik Kambatla
c25154576b YARN-4462. FairScheduler: Disallow preemption from a queue. (Tao Jie via kasha) 
(cherry picked from commit fb238d7e5dcd96466c8938b13ca7f13cedecb08a)
 2016-01-27 12:29:25 -08:00
Colin Patrick Mccabe
b94fbdf6f0 HADOOP-12735. core-default.xml misspells hadoop.workaround.non.threadsafe.getpwuid (Ray Chiang via cmccabe) 
(cherry picked from commit 2e8ab3d46568162af6aa90b612ed61d487e7c7b0)
 2016-01-27 11:40:42 -08:00
Yongjun Zhang
a1f913fb6e HADOOP-12718. Incorrect error message by fs -put local dir without permission. (John Zhuge via Yongjun Zhang) 
(cherry picked from commit 97056c3355810a803f07baca89b89e2bf6bb7201)
 2016-01-27 08:05:17 -08:00
Rohith Sharma K S
0b8767e01a YARN-4573. Fix test failure in TestRMAppTransitions#testAppRunningKill and testAppKilledKilled. (Takashi Ohnishi via rohithsharmaks) 
(cherry picked from commit c01bee010832ca31d8e60e5461181cdf05140602)
 2016-01-27 08:24:37 +05:30
Xuan
69f3fa71a2 YARN-4612. Fix rumen and scheduler load simulator handle killed tasks 
properly. Contributed by Ming Ma.

(cherry picked from commit 4efdf3a979c361348612f817a3253be6d0de58f7)
 2016-01-26 18:18:03 -08:00
Zhe Zhang
2056dd7d3a HDFS-9541. Add hdfsStreamBuilder API to libhdfs to support defaultBlockSizes greater than 2 GB. Contributed by Colin Patrick McCabe. 
Change-Id: Ifce1b9be534dc8f7e9d2634cd60e423921b9810f
 2016-01-26 11:26:31 -08:00
Jian He
ad42229683 MAPREDUCE-6610. JobHistoryEventHandler should not swallow timeline response. Contributed by Li Lu 2016-01-25 23:01:29 -08:00
Tsz-Wo Nicholas Sze
c59c142f47 HDFS-9690. ClientProtocol.addBlock is not idempotent after HDFS-8071. 2016-01-26 14:56:23 +08:00
Jitendra Pandey
4334976187 HDFS-9672. o.a.h.hdfs.TestLeaseRecovery2 fails intermittently. Contributed by Mingliang Liu. 2016-01-25 17:06:36 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
47b20d0c74 YARN-3542. Refactored existing CPU cgroups support to use the newer and integrated ResourceHandler mechanism, and also deprecated the old LCEResourceHandler inteface hierarchy. Contributed by Varun Vasudev. 
(cherry picked from commit 2085e60a9655b59aa2ba8917acdc511ab71ff6e4)
 2016-01-25 16:22:47 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
97f6cfa94b Release process for 2.7.2: Set the release date for 2.7.2 
(cherry picked from commit ec4d2d9f40c1cb52ca4561b3d010ffc046a73495)
 2016-01-25 15:47:02 -08:00
Jian He
2d236c9de2 YARN-4520. Finished app info is unnecessarily persisted in NM state-store if container is acquired but not lunched on this node. Contributed by sandflee 2016-01-25 15:36:40 -08:00
Arpit Agarwal
0dbaef4377 HDFS-9094. Add command line option to ask NameNode reload configuration. (Contributed by Xiaobing Zhou) 2016-01-25 12:16:45 -08:00
Walter Su
75b83af20e HADOOP-12715. TestValueQueue#testgetAtMostPolicyALL fails intermittently. Contributed by Xiao Chen. 
(cherry picked from commit 6eacdea0e475b4fff91cedce5005a7c11749cf64)
 2016-01-25 19:42:56 +08:00
Akira Ajisaka
02d4a1fce3 YARN-4592. Remove unused GetContainerStatus proto. Contributed by Chang Li. 
(cherry picked from commit 56a0c175082b2b62698f65c1769a64224b3fb821)
 2016-01-25 15:20:45 +09:00
Akira Ajisaka
38ec290455 HADOOP-12736. TestTimedOutTestsListener#testThreadDumpAndDeadlocks sometimes times out. Contributed by Xiao Chen. 
(cherry picked from commit 643227927a7d7974655627d7e97aae42600692ae)
 2016-01-25 13:59:48 +09:00
Akira Ajisaka
4edd7bd820 HADOOP-12731. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta. 
(cherry picked from commit 736eb17a796a1c1ad5f4db2c6a64f6752db7bec3)
 2016-01-25 13:48:28 +09:00
Akira Ajisaka
a9386cae6e MAPREDUCE-6614. Remove unnecessary code in TestMapreduceConfigFields. Contributed by Kai Sasaki. 2016-01-25 11:39:42 +09:00
Eric Yang
da61953a0b HDFS-9653. Added blocks pending deletion report to dfsadmin. 
(Weiwei Yang via eyang)
 2016-01-24 14:26:46 -08:00
rohithsharmaks
7e66b2f22c YARN-4613. Fix test failure in TestClientRMService#testGetClusterNodes. (Takashi Ohnishi via rohithsharmaks) 
(cherry picked from commit 10dc2c049304671f0ed9fd737a30cd843427b53e)
 2016-01-24 23:37:11 +05:30
rohithsharmaks
280c9b8401 YARN-4614. Fix random failure in TestApplicationPriority#testApplicationPriorityAllocationWithChangeInPriority. (Sunil G via rohithsharmaks) 
(cherry picked from commit 99829eb221482928d8a1b148ae3c802cc7c9253e)
 2016-01-23 07:58:16 +05:30