10544 Commits

Author SHA1 Message Date
Jason Lowe
fad2c5b862 YARN-4461. Redundant nodeLocalityDelay log in LeafQueue. Contributed by Eric Payne
(cherry picked from commit 91828fef6b9314f72d1f973f00e81404dc6bba91)
2015-12-16 23:23:19 +00:00
Vinod Kumar Vavilapalli
74a011d73a Revert "MAPREDUCE-6566. Add retry support to mapreduce CLI tool. Contributed by Varun Vasudev"
This reverts commit 3b10ff6a6f7becea181506c306a52973602b0481.
2015-12-16 15:12:24 -08:00
Vinod Kumar Vavilapalli
36781a3a5a HADOOP-12415. Fixed pom files to correctly include compile-time dependency on netty. (Tom Zeng via cos)
Addendum commit to include CHANGES.txt entry.

(cherry picked from commit ce16541c62728f69634111dc2ddb321690d3d29b)
2015-12-16 14:41:25 -08:00
Wangda Tan
5060fd1840 YARN-4416. Deadlock due to synchronised get Methods in AbstractCSQueue. (Naganarasimha G R via wangda)
(cherry picked from commit 9b856d9787be5ec88ef34574b9b98755d7b669ea)
2015-12-16 13:29:08 -08:00
Wangda Tan
2f5435acbd YARN-4225. Add preemption status to yarn queue -status for capacity scheduler. (Eric Payne via wangda)
(cherry picked from commit 7faa406f27f687844c941346f59a27a375af3233)
2015-12-16 13:29:02 -08:00
Wangda Tan
9f4a6ec663 YARN-4293. ResourceUtilization should be a part of yarn node CLI. (Sunil G via wangda)
(cherry picked from commit 79c41b1d83e981ae74cb8b58ffcf7907b7612ad4)
2015-12-16 13:28:56 -08:00
Siddharth Seth
433212ef87 YARN-4207. Add a non-judgemental YARN app completion status. Contributed by Rich Haase.
(cherry picked from commit 0f708d465fbc4260f2c36e8067e27cd8b285fde7)
2015-12-16 11:35:38 -08:00
cnauroth
e8e3737ce8 HDFS-9557. Reduce object allocation in PB conversion. Contributed by Daryn Sharp.
(cherry picked from commit c470c8953d4927043b6383fad8e792289c634c09)
2015-12-16 11:11:27 -08:00
Junping Du
1a2ef845b5 YARN-4452. NPE when submit Unmanaged application. Contributed by Naganarasimha G R.
(cherry picked from commit 50bd067e1d63d4c80dc1e7bf4024bfaf42cf4416)
2015-12-16 10:58:40 -08:00
Zhihai Xu
65cbac9de4 Update CHANGES.txt to move MAPREDUCE-6436 from YARN to MAPREDUCE
(cherry picked from commit 7092d47fc0b3b792dd31f967c01d460dc089f60b)
2015-12-15 21:49:22 -08:00
Uma Mahesh
dd3867ab9f HADOOP-12639. Improve JavaDoc for getTrimmedStrings. (BELUGA BEHR via umamahesh)
(cherry picked from commit ae67c8424c188a2b00920108e6104690137c61b7)
2015-12-15 15:19:27 -08:00
Andrew Wang
2796c1099f HDFS-8894. Set SO_KEEPALIVE on DN server sockets. Contributed by Kanaka Kumar Avvaru.
(cherry picked from commit 49949a4bb03aa81cbb9115e91ab1c61cc6dc8a62)
2015-12-15 14:39:04 -08:00
Jing Zhao
e0abb0a4e7 HDFS-9371. Code cleanup for DatanodeManager. Contributed by Jing Zhao.
(cherry picked from commit 8602692338d6f493647205e0241e4116211fab75)
2015-12-15 11:02:04 -08:00
Zhihai Xu
83c72ce9f6 Update CHANGES.txt to add YARN-3857 and YARN-3535 to branch-2.6
(cherry picked from commit 0c3a53e5a978140e56b9ebbc82c8d04fc978e640)
2015-12-15 01:51:48 -08:00
Zhihai Xu
da7bde60c0 MAPREDUCE-6436. JobHistory cache issue. Contributed by Kai Sasaki
(cherry picked from commit 5b7078d06921893200163a3d29c8901c3c0107cb)
2015-12-15 01:03:10 -08:00
Plamen Jeliazkov
15124c86d8 HDFS-9516. Truncate file fails with data dirs on multiple disks. Contributed by Plamen Jeliazkov. 2015-12-15 00:39:42 -08:00
Zhihai Xu
be50df687b YARN-4440. FSAppAttempt#getAllowedLocalityLevelByTime should init the lastScheduler time. Contributed by Lin Yiqun
(cherry picked from commit 2aaed1032719e978660d1f14a8ed299e83b5f65e)
2015-12-15 00:21:13 -08:00
Xuan
992f65dd8b YARN-4439. Clarify NMContainerStatus#toString method. Contributed by
Jian He

(cherry picked from commit d8a45425eba372cdebef3be50436b6ddf1c4e192)
2015-12-14 15:42:07 -08:00
Jian He
72544db3cd YARN-4402. TestNodeManagerShutdown And TestNodeManagerResync fails with bind exception. Contributed by Brahma Reddy Battula 2015-12-14 14:59:18 -08:00
Jian He
34e86d8d47 YARN-4403. (AM/NM/Container)LivelinessMonitor should use monotonic time when calculating period. Contributed by Junping Du 2015-12-14 13:52:04 -08:00
Lei Xu
6df45118e5 Revert "Revert "HDFS-8860. Remove unused Replica copyOnWrite code (Lei (Eddy) Xu via Colin P. McCabe)""
This reverts commit fb909554a8dfdc8b6244842d3b5ecb8eabc7f99a.
2015-12-14 11:26:32 -08:00
Wangda Tan
c915a658c8 YARN-4418. AM Resource Limit per partition can be updated to ResourceUsage as well. (Sunil G via wangda)
(cherry picked from commit 07b0fb996a32020678bd2ce482b672f0434651f0)
2015-12-14 11:25:00 -08:00
Jing Zhao
e02ad5a618 HDFS-9535. Newly completed blocks in IBR should not be considered under-replicated too quickly. Contributed by Mingliang Liu.
(cherry picked from commit e53456981474d6e16e3c134e3777b3588dc6fedf)
2015-12-14 11:18:28 -08:00
Wangda Tan
9f979107c2 YARN-4309. Add container launch related debug information to container logs when a container fails. (Varun Vasudev via wangda)
(cherry picked from commit dfcbbddb0963c89c0455d41223427165b9f9e537)
2015-12-14 11:13:51 -08:00
Lei Xu
0852d3562a HDFS-9281. Change TestDeleteBlockPool to not explicitly use File to check block pool existence. (lei)
(cherry picked from commit db975af5fae506eb3d586bd9201f76adb3fd1281)
2015-12-14 11:01:48 -08:00
Wangda Tan
a1a723fdff YARN-3946. Update exact reason as to why a submitted app is in ACCEPTED state to app's diagnostic message. (Naganarasimha G R via wangda)
(cherry picked from commit 6cb0af3c39a5d49cb2f7911ee21363a9542ca2d7)
2015-12-14 10:54:20 -08:00
Arun Suresh
0bf328984a YARN-4358 addendum patch to fix javadoc error
(cherry picked from commit 7fb212e5e672b3f285493f6c7b2598ef7e61406b)
2015-12-12 22:25:59 -08:00
Yongjun Zhang
be167d0154 HDFS-9514. TestDistributedFileSystem.testDFSClientPeerWriteTimeout failing; exception being swallowed. (Wei-Chiu Chuang via Yongjun Zhang)
(cherry picked from commit bf5295b118a24e762f21bb2b9054e5e0c1d1d14a)
2015-12-11 20:56:58 -08:00
Yongjun Zhang
3fc9593318 HDFS-9519. Some coding improvement in SecondaryNameNode#main. (Xiao Chen via Yongjun Zhang)
(cherry picked from commit 2a4c7d4facabb8b99d6dcbf4ccfe2afedf4fd445)
2015-12-11 20:56:46 -08:00
Xiaoyu Yao
08616b3654 HDFS-8785. TestDistributedFileSystem is failing in trunk. Contributed by Xiaoyu Yao.
(cherry picked from commit 2196e39e142b0f8d1944805db2bfacd4e3244625)
2015-12-11 20:56:12 -08:00
Uma Mahesh
5b1e1dfb3f HDFS-9528. Cleanup namenode audit/log/exception messages. (szetszwo via umamahesh)
(cherry picked from commit 796a676d18bd7cd3ed4113d002e0e69cf261d6d1)
2015-12-11 19:18:25 -08:00
Yongjun Zhang
e00888d5cb HDFS-9532. Detailed exception info is lost in reportTo methods of ErrorReportAction and ReportBadBlockAction. (Yongjun Zhang)
(cherry picked from commit f5a911452f8f6bc8a37617d1fc155e5ec23f3a78)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2015-12-11 18:24:50 -08:00
Sangjin Lee
605914caac YARN-4341 addendum. Moved the changelog entry from 2.8.0 to 2.9.0.
(cherry picked from commit b7b292367ff611f5025605304db9f24a6cfe5653)
2015-12-11 09:53:40 -08:00
Sangjin Lee
8be667208f YARN-4341. add doc about timeline performance tool usage (Chang Li via sjlee)
(cherry picked from commit e8964589de27a507c31203a87c3cbe0a8d68d3dd)
2015-12-11 09:53:17 -08:00
Xiaoyu Yao
5595b912e4 HDFS-8326. Documentation about when checkpoints are run is out of date. (Misty Stanley-Jones via xyao)
(cherry picked from commit d0e75e60fb16ffd6c95648a06ff3958722f71e4d)
2015-12-11 08:41:30 -08:00
Kihwal Lee
a72ef921f0 HDFS-9445. Datanode may deadlock while handling a bad volume. Contributed by Walter Su.
(cherry picked from commit a48301791e9564363bc2abad4e89e344b0d7a5ff)
2015-12-11 08:46:03 -06:00
Uma Mahesh
7dc558b6a7 HDFS-9472. concat() API does not give proper exception messages on ./reserved relative path (Rakesh R via umamahesh)
(cherry picked from commit e363417e7b7abdd5d149f303f729ecf3e95ef8f3)
2015-12-11 00:01:02 -08:00
Akira Ajisaka
5047ee56af HADOOP-12602. TestMetricsSystemImpl#testQSize occasionally fails. Contributed by Masatake Iwasaki.
(cherry picked from commit eee0cf4611b02171e8a043f1cc5f7dbad47fc3b4)
2015-12-11 16:18:58 +09:00
Lei Xu
fb909554a8 Revert "HDFS-8860. Remove unused Replica copyOnWrite code (Lei (Eddy) Xu via Colin P. McCabe)"
This reverts commit b9bf1a9391f0619d75604a5601763c2fab1ae1c5.

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/DataNodeTestUtils.java
2015-12-10 11:23:02 -10:00
Xuan
455c6f39c5 YARN-3623-Addendum: Improve the description for Timeline Service Version configuration in yarn-default.xml
(cherry picked from commit 21daa6c68a0bff51a14e748bf14d56b2f5a5580f)
2015-12-10 10:57:35 -08:00
Junping Du
0b5e76e9ff YARN-3623. Add a config to indicate the Timeline Service version. Contributed by Xuan Gong.
(cherry picked from commit f910e4f639dc311fcb257bfcb869b1aa8b2c0643)
2015-12-10 02:57:46 -08:00
Tsz-Wo Nicholas Sze
c65a796f88 HDFS-9527. The return type of FSNamesystem.getBlockCollection should be changed to INodeFile. 2015-12-09 18:10:34 -08:00
Robert Kanter
8dfaa7ded6 HADOOP-12625. Add a config to disable the /logs endpoints (rkanter)
(cherry picked from commit e27fffdb9036d9ed9759d59b964020423b982e22)
2015-12-09 14:35:50 -08:00
Akira Ajisaka
6451313560 YARN-4434. NodeManager Disk Checker parameter documentation is not correct. Contributed by Weiwei Yang.
(cherry picked from commit 16dc65811d4e0e7ab61c61295149848fe53ddd89)
2015-12-09 16:32:52 +09:00
Uma Mahesh
d20681896b HADOOP-12618. Fix NPE in TestSequenceFile. (Brahma Reddy Battula via umamahesh)
(cherry picked from commit ad53c520630847834b3e68b7f41aa88ee10b3300)
2015-12-08 22:57:00 -08:00
rohithsharmaks
81f8a2b008 YARN-4421. Remove dead code in RmAppImpl.RMAppRecoveredTransition. (Daniel Templeton via rohithsharmaks)
(cherry picked from commit a5e2e1ecb06a3942903cb79f61f0f4bb02480f19)
2015-12-09 11:33:49 +05:30
rohithsharmaks
f626d18cc3 YARN-4431. Not necessary to do unRegisterNM() if NM get stop due to failed to connect to RM. (Junpin Du via rohithsharmaks)
(cherry picked from commit 15c3e7ffe3d1c57ad36afd993f09fc47889c93bd)
2015-12-09 10:51:57 +05:30
mattf
472541291b HADOOP-12617. SPNEGO authentication request to non-default realm gets default realm name inserted in target server principal. (mattf) 2015-12-08 17:35:25 -08:00
Wangda Tan
7013f9d6cd YARN-4424. Fix deadlock in RMAppImpl. (Jian he via wangda)
(cherry picked from commit 7e4715186d31ac889fba26d453feedcebb11fc70)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2015-12-08 14:30:01 -08:00
Haohui Mai
417fbf2dca HADOOP-10729. Add tests for PB RPC in case version mismatch of client and server. Contributed by Junping Du. 2015-12-09 05:42:24 +08:00