Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,311 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

2782 Commits

Author SHA1 Message Date
Sunil G e5ada740ff YARN-5892. Support user-specific minimum user limit percentage in Capacity Scheduler. Contributed by Eric Payne. 2017-07-28 20:08:20 +05:30
Kihwal Lee c586b7ab7d HADOOP-13933. Add haadmin -getAllServiceState option to get the HA state of all the NameNodes/ResourceManagers. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit e407449ddb)
(cherry picked from commit 2d6be7ea23)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/cli/TestRMAdminCLI.java
 2017-07-26 14:15:39 -05:00
Jason Lowe db0bc8fafa YARN-6768. Improve performance of yarn api record toString and fromString. Contributed by Jonathan Eagles 
(cherry picked from commit 24853bf32a)
 2017-07-24 10:25:04 -05:00
Jason Lowe 4fc070ac59 YARN-4731. container-executor should not follow symlinks in recursive_unlink_children. Contributed by Colin Patrick McCabe 
(cherry picked from commit c58a6d53c5)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/test/test-container-executor.c
 2017-07-21 14:46:18 -05:00
Jason Lowe 293ac4c18b YARN-4594. container-executor fails to remove directory tree when chmod required. Contributed by Colin Patrick McCabe 
(cherry picked from commit fa328e2d39)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/test/test-container-executor.c
 2017-07-21 14:33:34 -05:00
Eric Payne 95be843851 YARN-6450. TestContainerManagerWithLCE requires override for each new test added to ContainerManagerTest? Contributed by Jason Lowe. 
(cherry picked from commit a16ab2be91)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestContainerManagerWithLCE.java
 2017-07-21 10:32:35 -05:00
Jason Lowe 6e45c543cb YARN-6837. Null LocalResource visibility or resource type can crash the nodemanager. Contributed by Jinjiang Ling 
(cherry picked from commit c8df3668ec)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/api/records/impl/pb/TestApplicationClientProtocolRecords.java
 2017-07-20 11:11:41 -05:00
Wangda Tan a39617df63 YARN-6775. CapacityScheduler: Improvements to assignContainers, avoid unnecessary canAssignToUser/Queue calls. (Nathan Roberts via wangda) 
Change-Id: I5951f0997547de7d2e4a30b4ad87ab0a59b3066a
 2017-07-19 15:29:45 -07:00
Rohith Sharma K S 4daf5741e0 YARN-5920. Fix deadlock in TestRMHA.testTransitionedToStandbyShouldNotHang. Contributed by Varun Saxena. 
(cherry picked from commit e15c20edba)
 2017-07-17 14:52:06 -05:00
Jason Lowe 1edc16ee54 YARN-3260. AM attempt fail to register before RM processes launch event. Contributed by Bibin A Chundatt 
(cherry picked from commit a5ae5ac50e)
 2017-07-14 15:06:31 -05:00
Jason Lowe 8c69b040ac YARN-6805. NPE in LinuxContainerExecutor due to null PrivilegedOperationException exit code. Contributed by Jason Lowe 
(cherry picked from commit a77fb561ef)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/LinuxContainerExecutor.java
 2017-07-13 18:00:05 -05:00
Jason Lowe 9cff53fed9 YARN-6654. RollingLevelDBTimelineStore backwards incompatible after fst upgrade. Contributed by Jonathan Eagles 
(cherry picked from commit 5f1ee72b0e)
 2017-07-13 17:30:57 -05:00
Jason Lowe 4f1dfcc118 YARN-6797. TimelineWriter does not fully consume the POST response. Contributed by Jason Lowe 
(cherry picked from commit 655110393b)
 2017-07-12 15:54:49 -05:00
Akira Ajisaka ebb66d2038
YARN-6809. Fix typo in ResourceManagerHA.md. Contributed by Yeliang Cang. 
(cherry picked from commit b628d0da51)
(cherry picked from commit 3419381e98)
 2017-07-12 19:39:29 +09:00
Naganarasimha 0f9f7bb0c6 YARN-6770. A small mistake in the example of TimelineClient. Contributed by Jinjiang Ling. 
(cherry picked from commit ba5b056e8a)
 2017-07-09 21:40:16 +05:30
Naganarasimha ad70e929b2 YARN-6428. Queue AM limit is not honored in CS always. Contributed by Bibin A Chundutt. 2017-07-09 17:34:47 +05:30
Eric Payne 8949a9d541 YARN-2113. Add cross-user preemption within CapacityScheduler's leaf-queue. (Contributed by Sunil G) 2017-07-06 10:53:47 -05:00
Jason Lowe cd895d0586 YARN-6708. Nodemanager container crash after ext3 folder limit. Contributed by Bibin A Chundatt 
(cherry picked from commit 7576a688ea)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/ContainerLocalizer.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestContainerLocalizer.java
 2017-07-06 09:53:13 -05:00
Naganarasimha 69480ba686 YARN-6681. Eliminate double-copy of child queues in canAssignToThisQueue. Contributed by Daryn Sharp. 2017-07-01 12:58:36 +05:30
bibinchundatt f6fcbf426f YARN-6749. TestAppSchedulingInfo.testPriorityAccounting fails consistently. Contributed by Naganarasimha G R 2017-06-30 21:52:16 +05:30
Naganarasimha 29c68ccc6f YARN-6467. CSQueueMetrics needs to update the current metrics for default partition only. Contributed by Manikandan R. 2017-06-29 00:25:32 +05:30
Jason Lowe 486dc3f9eb YARN-6738. LevelDBCacheTimelineStore should reuse ObjectMapper instances. Contributed by Zoltan Haindrich 
(cherry picked from commit 63ce1593c5)
 2017-06-27 17:14:30 -05:00
Akira Ajisaka f16524ec9f
YARN-6713. Fix dead link in the Javadoc of FairSchedulerEventLog.java. Contributed by Weiwei Yang. 
(cherry picked from commit 099dfe92a9)
(cherry picked from commit 35f6c7c9c7)
 2017-06-20 17:47:25 +09:00
Naganarasimha 363ef7b8ad YARN-6680. Avoid locking overhead for NO_LABEL lookups. Contributed by Daryn Sharp 
(cherry picked from commit ee89ac84e6)
 2017-06-19 22:49:28 +05:30
Eric Payne 9849b5a489 YARN-6585. RM fails to start when upgrading from 2.7 for clusters with node labels. Contributed by Sunil G. 
(cherry picked from commit 5578af8603)
 2017-06-09 16:44:30 -05:00
Naganarasimha cdac9a4d9d YARN-6682. Improve performance of AssignmentInformation datastructures. Contributed by Daryn Sharp. 2017-06-09 11:59:01 +05:30
Vinod Kumar Vavilapalli (I am also known as @tshooter.) 396de0fd8f Preparing for 2.8.3 development 2017-06-07 15:38:20 -07:00
Karthik Kambatla 5410ec995d YARN-4927. TestRMHA#testTransitionedToActiveRefreshFail fails with FairScheduler. (Bibin A Chundatt via kasha) 
(cherry picked from commit ff95fd547b)
 2017-06-05 21:46:59 +05:30
Sunil G 34958e358b YARN-5988. RM unable to start in secure setup. Contributed by Ajith S. 2017-06-04 14:09:08 +05:30
Sunil G 13b4a6b2b9 YARN-5333. Some recovered apps are put into default queue when RM HA. Contributed by Jun Gong. 2017-06-04 10:46:47 +05:30
Nathan Roberts 1f077f45f9 YARN-6649. RollingLevelDBTimelineServer throws RuntimeException if object decoding ever fails runtime exception. Contributed by Jon Eagles. 
(cherry picked from commit 4369690ce6)
 2017-05-31 12:47:38 -05:00
Jason Lowe b89d59e21e YARN-6641. Non-public resource localization on a bad disk causes subsequent containers failure. Contributed by Kuhu Shukla 2017-05-26 09:45:49 -05:00
Jason Lowe 8739c4d2f8 YARN-6643. TestRMFailover fails rarely due to port conflict. Contributed by Robert Kanter 
(cherry picked from commit 3fd6a2da4e)
 2017-05-25 16:09:29 -05:00
Varun Vasudev c1f3cd765f Addendum patch to fix Docker sanitization. 
(cherry picked from commit 2ff2a1f50e8c7c0f33676b010b256d6c8daf912d)
(cherry picked from commit 983c4437c2b1aaafddfc97b19371cdb992389a61)
 2017-05-25 14:54:17 +05:30
Akira Ajisaka d50f240784
YARN-6141. ppc64le on Linux doesn't trigger __linux get_executable codepath. Contributed by Sonia Garudi and Ayappan. 
(cherry picked from commit bc28da65fb)
(cherry picked from commit ca1c0cbc62)
 2017-05-25 17:08:18 +09:00
Jason Lowe 7ef01c7c49 YARN-6615. AmIpFilter drops query parameters on redirect. Contributed by Wilfred Spiegelenburg 2017-05-24 11:27:21 -05:00
Wangda Tan 836e8f3e69 YARN-6493. Print requested node partition in assignContainer logs. (Jonathan Hung via wangda) 
Change-Id: I3c5c012eb8d0887a4a37d58662bc37aac07ea86e
 2017-05-22 14:57:54 -07:00
Eric Payne 71d91d53bf YARN-6618. TestNMLeveldbStateStoreService#testCompactionCycle can fail if compaction occurs more than once. Contributed by Jason Lowe. 
(cherry picked from commit 19482e0d09)
 2017-05-19 11:36:18 -05:00
Varun Vasudev 23bbbce63e Sanitize arguments before launching Docker containers. 2017-05-18 12:03:52 +05:30
Varun Vasudev 51e65cc710 Validate docker image name before launching container. 2017-05-18 11:53:16 +05:30
Chris Douglas 9791ecc9d8 YARN-6577. Remove unused ContainerLocalization classes. Contributed by ZhangBing Lin 
(cherry picked from commit b23fcc86c6)
(cherry picked from commit 3d2afb209c)
 2017-05-17 20:42:27 -07:00
Rohith Sharma K S c61956dd1e HADOOP-14412. HostsFileReader#getHostDetails is very expensive on large clusters. Contributed by Jason Lowe. 2017-05-17 08:26:17 +05:30
Jason Lowe c2d7c12477 YARN-6603. NPE in RMAppsBlock. Contributed by Jason Lowe 
(cherry picked from commit 489f85933c)
 2017-05-16 09:29:18 -05:00
Jonathan Eagles c992cf638e YARN-6598. History server getApplicationReport NPE when fetching report for pre-2.8 job (Jason Lowe via jeagles) 2017-05-15 12:10:12 -05:00
Min Shen aae0600a67 YARN-5543. ResourceManager SchedulingMonitor could potentially terminate the preemption checker thread. Contributed by Min Shen. 
(cherry picked from commit 2ada100da7)
 2017-05-11 13:31:02 -07:00
Jason Lowe f32db1be1e YARN-6552. Increase YARN test timeouts from 1 second to 10 seconds. Contributed by Eric Badger 
(cherry picked from commit 6099deebcb)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/cli/TestLogsCLI.java
 2017-05-10 08:53:33 -05:00
Haibo Chen 3799625e90 YARN-6457. Allow custom SSL configuration to be supplied in WebApps. (Sanjay M Pujare via Haibo Chen) 
(cherry picked from commit 1769b12a77)
(cherry picked from commit 86fcb8a66c)
 2017-05-09 08:52:37 -07:00
Varun Vasudev 341457a0f2 YARN-4562. YARN WebApp ignores the configuration passed to it for keystore settings. Contributed by Sergey Shelukhin. 
(cherry picked from commit 07920acc16)
(cherry picked from commit 4baee3eb67)
 2017-05-09 10:59:15 +05:30
Karthik Kambatla dd46bc0f54 YARN-5343. TestContinuousScheduling#testSortedNodes fails intermittently. (Yufei Gu via kasha) 
(cherry picked from commit 7992c0b42c)
 2017-05-02 16:46:10 -05:00
Karthik Kambatla d382a21423 YARN-4812. TestFairScheduler#testContinuousScheduling fails intermittently. (kasha) 
(cherry picked from commit f84af8bd58)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestContinuousScheduling.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestFairScheduler.java
 2017-05-02 16:40:46 -05:00