Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,302 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

3953 Commits

Author SHA1 Message Date
Anu Engineer 2d6ab20007 HDFS-12990. Change default NameNode RPC port back to 8020. Contributed by Xiao Chen. 
(cherry picked from commit 4304fcd5bd)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/ViewFs.md
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/tools/TestGetConf.java

(cherry picked from commit 9264f10bb3)
 2018-02-07 11:16:53 -08:00
Billie Rinaldi 0ec45f73a1 Revert "YARN-6078. Containers stuck in Localizing state. Contributed by Billie Rinaldi." 
This reverts commit ef212b8550.
 2018-02-07 07:51:56 -08:00
Billie Rinaldi 615bd15072 YARN-7890. NPE during container relaunch. Contributed by Jason Lowe 
(cherry picked from commit a196ee9362)
 2018-02-06 11:34:49 -08:00
Lei Xu 7b377f43d0 Preparing for 3.0.2 development 2018-02-06 10:50:37 -08:00
Jason Lowe 07f779483c YARN-7849. TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails due to heartbeat sync error. Contributed by Botong Huang 
(cherry picked from commit 60656bceca)
 2018-02-05 17:17:15 -06:00
Jason Lowe 84297f69d8 Revert "YARN-7677. Docker image cannot set HADOOP_CONF_DIR. Contributed by Jim Brennan" 
This reverts commit 874bdbc401.
 2018-02-01 12:17:23 -06:00
Jason Lowe 874bdbc401 YARN-7677. Docker image cannot set HADOOP_CONF_DIR. Contributed by Jim Brennan 
(cherry picked from commit 12eaae383a)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/linux/runtime/DockerLinuxContainerRuntime.java
 2018-01-31 11:45:57 -06:00
Sunil G 0463ede09d YARN-7790. Improve Capacity Scheduler Async Scheduling to better handle node failures. Contributed by Wangda Tan. 
(cherry picked from commit e9c72d04be)
 2018-01-29 20:46:32 +05:30
Jinjiang Ling 1d7e9b9ad8
YARN-7698. A misleading variable's name in ApplicationAttemptEventDispatcher 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 3400d0c535)
 2018-01-30 00:12:40 +09:00
Jian He 3316779364 YARN-7765. Fixed an issue that kerberos tgt not found when NM posting timeline events. Contributed by Rohith Sharma K S 2018-01-27 22:20:49 -08:00
Jason Lowe 217f408aaa YARN-7102. NM heartbeat stuck when responseId overflows MAX_INT. Contributed by Botong Huang 
(cherry picked from commit ff8378eb1b)
 2018-01-25 17:51:51 -06:00
Sunil G 88bacad50f YARN-7728. Expose container preemptions related information in Capacity Scheduler queue metrics. Contributed by Eric Payne. 
(cherry picked from commit 82cc6f6968)
 2018-01-25 14:33:42 +05:30
Zhe Zhang 83a4f92a3f YARN-7737. prelaunch.err file not found exception on container failure. Contributed by Keqiu Hu. 
(cherry picked from commit fa8cf4d1b4)
 2018-01-24 12:57:27 -08:00
Jian He 7598f73320 YARN-7801. AmFilterInitializer should addFilter after fill all parameters. Contributed by Wangda Tan 2018-01-24 11:20:23 -08:00
Sunil G ecfdd01be7 YARN-7806. Distributed Shell should use timeline async api's. Contributed by Rohith Sharma K S 
(cherry picked from commit 97607617ce)
 2018-01-24 16:56:51 +05:30
Miklos Szegedi bf795560fb YARN-7796. Container-executor fails with segfault on certain OS configurations. Contributed by Gergo Repas. 
(cherry picked from commit e7642a3e6f)
 2018-01-23 22:21:12 -08:00
Jian He 92f789a131 YARN-7782. Enable user re-mapping for Docker containers in yarn-default.xml. Contributed by Eric Yang 2018-01-23 14:06:48 -08:00
Haibo Chen 8793e45f53 YARN-5094. some YARN container events have timestamp of -1. 
(cherry picked from commit 4aca4ff759)
 2018-01-19 10:29:33 -08:00
Miklos Szegedi 7629353153 YARN-7758. Add an additional check to the validity of container and application ids passed to container-executor. Contributed by Yufei Gu. 
(cherry picked from commit 41049ba5d1)
 2018-01-17 13:47:44 -08:00
Robert Kanter e54c65a326 YARN-7479. TestContainerManagerSecurity.testContainerManager[Simple] flaky in trunk (ajisakaa via rkanter) 
(cherry picked from commit 5ac109909a)
 2018-01-16 10:21:12 -08:00
Rohith Sharma K S 2a01652809 YARN-6736. Consider writing to both ats v1 & v2 from RM for smoother upgrades. Contributed by Aaron Gresch. 
(cherry picked from commit d09058b2fd)
 2018-01-16 08:42:07 +05:30
Miklos Szegedi 75c0b19bea YARN-7705. Create the container log directory with correct sticky bit in C code. Contributed by Yufei Gu. 
(cherry picked from commit 2dcfc18)
 2018-01-12 17:55:58 -08:00
Sunil G f270818ed3 YARN-7727. Incorrect log levels in few logs with QueuePriorityContainerCandidateSelector. Contributed by Prabhu Joseph. 
(cherry picked from commit 128d773a23)
 2018-01-12 15:42:06 +05:30
Miklos Szegedi ed9c516bc8 YARN-7590. Improve container-executor validation check. Contributed by Eric Yang. 
(cherry picked from commit bc285da)
 2018-01-11 10:28:08 -08:00
Akira Ajisaka a13a773edb
YARN-7735. Fix typo in YARN documentation. Contributed by Takanobu Asanuma. 
(cherry picked from commit fbbbf59c82)
 2018-01-11 15:59:55 +09:00
Haibo Chen 7b32d6811c YARN-7665. Allow FS scheduler state dump to be turned on/off separately from FS debug log. (Wilfred Spiegelenburg via Haibo Chen) 
(cherry picked from commit 8ee7080e5d)
 2018-01-09 16:53:10 -08:00
Haibo Chen cf816bc751 YARN-7716. metricsTimeStart and metricsTimeEnd should be all lower case in the doc. 
(cherry picked from commit f725b9e267)
 2018-01-09 08:59:04 -08:00
Jason Lowe effce9b117 YARN-6948. Invalid event: ATTEMPT_ADDED at FINAL_SAVING. Contributed by lujie 
(cherry picked from commit 90c86d6e09)
 2018-01-09 10:52:21 -06:00
Jason Lowe d2c2d8c913 YARN-7663. RMAppImpl:Invalid event: START at KILLED. Contributed by lujie 
(cherry picked from commit ebff4decfe)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/RMAppImpl.java
 2018-01-09 09:57:45 -06:00
bibinchundatt c57e71b542 YARN-7508. NPE in FiCaSchedulerApp when debug log enabled in async-scheduling mode. Contributed by Tao Yang. 
(cherry picked from commit b26e30ab16)
 2018-01-09 20:01:42 +05:30
Rohith Sharma K S 281350674c YARN-7699. queueUsagePercentage is coming as INF for getApp REST api call. Contributed by Sunil G. 2018-01-08 15:52:03 +05:30
Sunil G a79abbc03e YARN-7619. Max AM Resource value in Capacity Scheduler UI has to be refreshed for every user. Contributed by Eric Payne. 2018-01-05 14:50:17 +05:30
Jason Lowe c155d8e756 YARN-7678. Ability to enable logging of container memory stats. Contributed by Jim Brennan 
(cherry picked from commit d795661868)
 2018-01-04 10:18:32 -06:00
Haibo Chen 889bebf8bb YARN-7602. NM should reference the singleton JvmMetrics instance. 
(cherry picked from commit 2f6c038be6)
 2018-01-03 09:44:33 -08:00
Rohith Sharma K S 2c67985bd2 YARN-7692. Skip validating priority acls while recovering applications. Contributed by Sunil G. 
(cherry picked from commit c9bf813c9a)
 2018-01-03 18:21:47 +05:30
Arun Suresh 829917e9ba YARN-7691. Add Unit Tests for ContainersLauncher. (Sampada Dehankar via asuresh) 
(cherry picked from commit c0c7cce81d)
 2018-01-02 22:03:56 -08:00
Arun Suresh bd4dcc7772 YARN-7542. Fix issue that causes some Running Opportunistic Containers to be recovered as PAUSED. (Sampada Dehankar via asuresh) 
(cherry picked from commit a55884c68e)
 2017-12-28 22:21:52 -08:00
Rohith Sharma K S 7d42433f37 YARN-7674. Update Timeline Reader web app address in UI2. Contributed by Sunil G. 
(cherry picked from commit 13ad7479b0)
 2017-12-20 22:29:23 +05:30
Sunil G 2026817a75 YARN-7032. [ATSv2] NPE while starting hbase co-processor when HBase authorization is enabled. Contributed by Rohith Sharma K S. 
(cherry picked from commit d62932c3b2)
 2017-12-20 11:33:12 +05:30
Eric Yang 62c3801af0 YARN-7466. addendum patch for failing unit test. (Contributed by Chandni Singh) 2017-12-19 19:56:40 -05:00
Varun Saxena f92ea68367 YARN-7662. [ATSv2] Define new set of configurations for reader and collectors to bind (Rohith Sharma K S via Varun Saxena) 
(cherry picked from commit c0aeb666a4)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml
 2017-12-19 22:41:52 +05:30
Junping Du 53b9d81f46 Add 2.8.3 release jdiff files. 
(cherry picked from commit c89f99aade)
 2017-12-18 22:40:04 -08:00
Jason Lowe f3c10beb16 YARN-7661. NodeManager metrics return wrong value after update node resource. Contributed by Yang Wang 
(cherry picked from commit 811fabdebe)
 2017-12-18 15:23:58 -06:00
Akira Ajisaka 01dd11d977
YARN-7664. Several javadoc errors. Contributed by Sean Mackrory. 2017-12-18 22:52:39 +09:00
Weiwei Yang de2156dc90 YARN-7617. Add a flag in distributed shell to automatically PROMOTE opportunistic containers to guaranteed once they are started. Contributed by Weiwei Yang. 
(cherry picked from commit 9289641020)
 2017-12-18 10:27:17 +08:00
Wangda Tan 90636cf127 YARN-7629. TestContainerLaunch# fails after YARN-7381. (Jason Lowe via wangda) 
Change-Id: Ia6a3f05c9a7e797d8190123d304ecc4e2b018e33
(cherry picked from commit 44825f0960)
 2017-12-15 15:45:35 -08:00
Wangda Tan c3e6ab8c89 YARN-5418. When partial log aggregation is enabled, display the list of aggregated files on the container log page. (Xuan Gong via wangda) 
Change-Id: I1befb0bbaeb89fb315bafe3e2f3379663f8cf1ec
(cherry picked from commit 631b5c2db7)
 2017-12-15 15:45:28 -08:00
Rohith Sharma K S 53033c69f3 YARN-7190. Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath. Contributed by Varun Saxena. 
(cherry picked from commit 09d996fdd4)
 2017-12-15 22:17:43 +05:30
Weiwei Yang 1011bfd220 YARN-7642. Add test case to verify context update after container promotion or demotion with or without auto update. Contributed by Weiwei Yang. 
(cherry picked from commit 89b6c482c1)
 2017-12-15 12:55:03 +08:00
Sunil G 9ee1649cec YARN-7119. Support multiple resource types in rmadmin updateNodeResource command. Contributed by Manikandan R. 
(cherry picked from commit 2564b4d07f)
 2017-12-14 16:12:43 +05:30