Commit Graph

10732 Commits

Author SHA1 Message Date
Jing Zhao e0abb0a4e7 HDFS-9371. Code cleanup for DatanodeManager. Contributed by Jing Zhao.
(cherry picked from commit 8602692338)
2015-12-15 11:02:04 -08:00
Zhihai Xu 83c72ce9f6 Update CHANGES.txt to add YARN-3857 and YARN-3535 to branch-2.6
(cherry picked from commit 0c3a53e5a9)
2015-12-15 01:51:48 -08:00
Zhihai Xu da7bde60c0 MAPREDUCE-6436. JobHistory cache issue. Contributed by Kai Sasaki
(cherry picked from commit 5b7078d069)
2015-12-15 01:03:10 -08:00
Plamen Jeliazkov 15124c86d8 HDFS-9516. Truncate file fails with data dirs on multiple disks. Contributed by Plamen Jeliazkov. 2015-12-15 00:39:42 -08:00
Zhihai Xu be50df687b YARN-4440. FSAppAttempt#getAllowedLocalityLevelByTime should init the lastScheduler time. Contributed by Lin Yiqun
(cherry picked from commit 2aaed10327)
2015-12-15 00:21:13 -08:00
Xuan 992f65dd8b YARN-4439. Clarify NMContainerStatus#toString method. Contributed by
Jian He

(cherry picked from commit d8a45425eb)
2015-12-14 15:42:07 -08:00
Jian He 72544db3cd YARN-4402. TestNodeManagerShutdown And TestNodeManagerResync fails with bind exception. Contributed by Brahma Reddy Battula 2015-12-14 14:59:18 -08:00
Jian He 34e86d8d47 YARN-4403. (AM/NM/Container)LivelinessMonitor should use monotonic time when calculating period. Contributed by Junping Du 2015-12-14 13:52:04 -08:00
Lei Xu 6df45118e5 Revert "Revert "HDFS-8860. Remove unused Replica copyOnWrite code (Lei (Eddy) Xu via Colin P. McCabe)""
This reverts commit fb909554a8.
2015-12-14 11:26:32 -08:00
Wangda Tan c915a658c8 YARN-4418. AM Resource Limit per partition can be updated to ResourceUsage as well. (Sunil G via wangda)
(cherry picked from commit 07b0fb996a)
2015-12-14 11:25:00 -08:00
Jing Zhao e02ad5a618 HDFS-9535. Newly completed blocks in IBR should not be considered under-replicated too quickly. Contributed by Mingliang Liu.
(cherry picked from commit e534569814)
2015-12-14 11:18:28 -08:00
Wangda Tan 9f979107c2 YARN-4309. Add container launch related debug information to container logs when a container fails. (Varun Vasudev via wangda)
(cherry picked from commit dfcbbddb09)
2015-12-14 11:13:51 -08:00
Lei Xu 0852d3562a HDFS-9281. Change TestDeleteBlockPool to not explicitly use File to check block pool existence. (lei)
(cherry picked from commit db975af5fae506eb3d586bd9201f76adb3fd1281)
2015-12-14 11:01:48 -08:00
Wangda Tan a1a723fdff YARN-3946. Update exact reason as to why a submitted app is in ACCEPTED state to app's diagnostic message. (Naganarasimha G R via wangda)
(cherry picked from commit 6cb0af3c39)
2015-12-14 10:54:20 -08:00
Arun Suresh 0bf328984a YARN-4358 addendum patch to fix javadoc error
(cherry picked from commit 7fb212e5e6)
2015-12-12 22:25:59 -08:00
Yongjun Zhang be167d0154 HDFS-9514. TestDistributedFileSystem.testDFSClientPeerWriteTimeout failing; exception being swallowed. (Wei-Chiu Chuang via Yongjun Zhang)
(cherry picked from commit bf5295b118)
2015-12-11 20:56:58 -08:00
Yongjun Zhang 3fc9593318 HDFS-9519. Some coding improvement in SecondaryNameNode#main. (Xiao Chen via Yongjun Zhang)
(cherry picked from commit 2a4c7d4fac)
2015-12-11 20:56:46 -08:00
Xiaoyu Yao 08616b3654 HDFS-8785. TestDistributedFileSystem is failing in trunk. Contributed by Xiaoyu Yao.
(cherry picked from commit 2196e39e14)
2015-12-11 20:56:12 -08:00
Uma Mahesh 5b1e1dfb3f HDFS-9528. Cleanup namenode audit/log/exception messages. (szetszwo via umamahesh)
(cherry picked from commit 796a676d18)
2015-12-11 19:18:25 -08:00
Yongjun Zhang e00888d5cb HDFS-9532. Detailed exception info is lost in reportTo methods of ErrorReportAction and ReportBadBlockAction. (Yongjun Zhang)
(cherry picked from commit f5a911452f)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2015-12-11 18:24:50 -08:00
Sangjin Lee 605914caac YARN-4341 addendum. Moved the changelog entry from 2.8.0 to 2.9.0.
(cherry picked from commit b7b292367f)
2015-12-11 09:53:40 -08:00
Sangjin Lee 8be667208f YARN-4341. add doc about timeline performance tool usage (Chang Li via sjlee)
(cherry picked from commit e8964589de)
2015-12-11 09:53:17 -08:00
Xiaoyu Yao 5595b912e4 HDFS-8326. Documentation about when checkpoints are run is out of date. (Misty Stanley-Jones via xyao)
(cherry picked from commit d0e75e60fb)
2015-12-11 08:41:30 -08:00
Kihwal Lee a72ef921f0 HDFS-9445. Datanode may deadlock while handling a bad volume. Contributed by Walter Su.
(cherry picked from commit a48301791e)
2015-12-11 08:46:03 -06:00
Uma Mahesh 7dc558b6a7 HDFS-9472. concat() API does not give proper exception messages on ./reserved relative path (Rakesh R via umamahesh)
(cherry picked from commit e363417e7b)
2015-12-11 00:01:02 -08:00
Akira Ajisaka 5047ee56af HADOOP-12602. TestMetricsSystemImpl#testQSize occasionally fails. Contributed by Masatake Iwasaki.
(cherry picked from commit eee0cf4611)
2015-12-11 16:18:58 +09:00
Lei Xu fb909554a8 Revert "HDFS-8860. Remove unused Replica copyOnWrite code (Lei (Eddy) Xu via Colin P. McCabe)"
This reverts commit b9bf1a9391.

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/DataNodeTestUtils.java
2015-12-10 11:23:02 -10:00
Xuan 455c6f39c5 YARN-3623-Addendum: Improve the description for Timeline Service Version configuration in yarn-default.xml
(cherry picked from commit 21daa6c68a)
2015-12-10 10:57:35 -08:00
Junping Du 0b5e76e9ff YARN-3623. Add a config to indicate the Timeline Service version. Contributed by Xuan Gong.
(cherry picked from commit f910e4f639)
2015-12-10 02:57:46 -08:00
Tsz-Wo Nicholas Sze c65a796f88 HDFS-9527. The return type of FSNamesystem.getBlockCollection should be changed to INodeFile. 2015-12-09 18:10:34 -08:00
Robert Kanter 8dfaa7ded6 HADOOP-12625. Add a config to disable the /logs endpoints (rkanter)
(cherry picked from commit e27fffdb90)
2015-12-09 14:35:50 -08:00
Akira Ajisaka 6451313560 YARN-4434. NodeManager Disk Checker parameter documentation is not correct. Contributed by Weiwei Yang.
(cherry picked from commit 16dc65811d4e0e7ab61c61295149848fe53ddd89)
2015-12-09 16:32:52 +09:00
Uma Mahesh d20681896b HADOOP-12618. Fix NPE in TestSequenceFile. (Brahma Reddy Battula via umamahesh)
(cherry picked from commit ad53c52063)
2015-12-08 22:57:00 -08:00
rohithsharmaks 81f8a2b008 YARN-4421. Remove dead code in RmAppImpl.RMAppRecoveredTransition. (Daniel Templeton via rohithsharmaks)
(cherry picked from commit a5e2e1ecb0)
2015-12-09 11:33:49 +05:30
rohithsharmaks f626d18cc3 YARN-4431. Not necessary to do unRegisterNM() if NM get stop due to failed to connect to RM. (Junpin Du via rohithsharmaks)
(cherry picked from commit 15c3e7ffe3)
2015-12-09 10:51:57 +05:30
mattf 472541291b HADOOP-12617. SPNEGO authentication request to non-default realm gets default realm name inserted in target server principal. (mattf) 2015-12-08 17:35:25 -08:00
Wangda Tan 7013f9d6cd YARN-4424. Fix deadlock in RMAppImpl. (Jian he via wangda)
(cherry picked from commit 7e4715186d)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2015-12-08 14:30:01 -08:00
Haohui Mai 417fbf2dca HADOOP-10729. Add tests for PB RPC in case version mismatch of client and server. Contributed by Junping Du. 2015-12-09 05:42:24 +08:00
Chris Douglas bfe4796802 YARN-4248. Followup patch adding asf-licence exclusions for json test files
(cherry picked from commit 9f50e13d5d)
2015-12-08 12:08:35 -08:00
Vinod Kumar Vavilapalli e81cb68508 HDFS-9273. Moving to 2.6.3 CHANGES section to reflect the backport. 2015-12-08 11:34:05 -08:00
cnauroth 1072be12b9 HDFS-9414. Refactor reconfiguration of ClientDatanodeProtocol for reusability. Contributed by Xiaobing Zhou.
(cherry picked from commit 303f80e656)
2015-12-08 10:50:13 -08:00
Xuan 3b10ff6a6f MAPREDUCE-6566. Add retry support to mapreduce CLI tool. Contributed by Varun Vasudev
(cherry picked from commit fc470840a0)
2015-12-07 14:15:50 -08:00
Jing Zhao c993327483 HDFS-9129. Move the safemode block count into BlockManager. Contributed by Mingliang Liu. 2015-12-07 13:46:12 -08:00
= 4ac1564418 YARN-4248. REST API for submit/update/delete Reservations. (curino)
(cherry picked from commit c25a635459)
2015-12-07 13:38:38 -08:00
Jonathan Eagles 7c604c3d06 YARN-4422. Generic AHS sometimes doesn't show started, node, or logs on App page (Eric Payne via jeagles)
(cherry picked from commit 4ff973f96a)
2015-12-07 15:05:15 -06:00
Xuan 7decba83ef YARN-4392. ApplicationCreatedEvent event time resets after RM
restart/failover. Contributed by Naganarasimha G R and Xuan Gong

(cherry picked from commit 4546c7582b)
2015-12-07 12:26:09 -08:00
rohithsharmaks 04e056f4f5 YARN-3456. Improve handling of incomplete TimelineEntities. (Varun Saxena via rohithsharmaks)
(cherry picked from commit 01a641bc44)
2015-12-07 15:19:59 +05:30
Steve Loughran af14458de7 HADOOP-12321. Make JvmPauseMonitor an AbstractService. (Sunil G via Stevel) [includes HDFS-8947 MAPREDUCE-6462 and YARN-4072] 2015-12-06 17:42:56 +00:00
Arun Suresh 78a07e99dd YARN-4358. Reservation System: Improve relationship between SharingPolicy and ReservationAgent. (Carlo Curino via asuresh)
(cherry picked from commit 742632e346)
2015-12-05 21:30:48 -08:00
Arpit Agarwal 6999e764cb HDFS-9414. Add missing license header 2015-12-05 09:24:44 -08:00