Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,304 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

18304 Commits

Author SHA1 Message Date
Jason Lowe daa739fa13 MAPREDUCE-7086. Add config to allow FileInputFormat to ignore directories when recursive=false. Contributed by Sergey Shelukhin 
(cherry picked from commit 68c6ec719d)
 2018-05-03 12:40:26 -05:00
Eric Yang 2148fc1c3a YARN-8226. Improved anti-affinity description in YARN Service doc. 
Contributed by Gour Saha

(cherry picked from commit 7698737207)
 2018-05-03 13:38:21 -04:00
Eric Yang b09af11117 YARN-7961. Improve status message for YARN service. 
Contributed by Gour Saha
(cherry picked from commit 7fe3214d4b)
 2018-05-03 13:29:07 -04:00
Eric Yang cf46533bca YARN-7973. Added ContainerRelaunch feature for Docker containers. 
Addendum patch 001
            Contributed by Shane Kumpf
 2018-05-03 12:46:04 -04:00
Eric Yang f729fb0baa YARN-8194. Fixed reinitialization error for LinuxContainerExecutor. 
Contributed by Chandni Singh

(cherry picked from commit f4d280f02b)
 2018-05-03 11:59:35 -04:00
Eric Yang e4b9981612 YARN-7973. Added ContainerRelaunch feature for Docker containers. 
Contributed by Shane Kumpf
 2018-05-03 11:57:01 -04:00
Rohith Sharma K S 4c93cd228c YARN-8217. RmAuthenticationFilterInitializer and TimelineAuthenticationFilterInitializer should use Configuration.getPropsWithPrefix instead of iterator. Contributed by Suma Shivaprasad. 
(cherry picked from commit ee2ce923a9)
 2018-05-03 18:20:21 +05:30
Daniel Templeton 57e4115436 HDFS-13481. TestRollingFileSystemSinkWithHdfs#testFlushThread: test failed intermittently 
(Contributed by Gabor Bota via Daniel Templeton)

Change-Id: I9921981dfa69669fe7912dd2a31ae8b638283204
(cherry picked from commit 87c23ef643)
 2018-05-02 17:17:46 -07:00
Eric Yang 61fac20c9e YARN-8209. Fixed NPE in Yarn Service deletion. 
Contributed by Eric Badger
 2018-05-02 15:05:30 -04:00
Konstantinos Karanasos 62ad9d512d YARN-8113. Update placement constraints doc with application namespaces and inter-app constraints. Contributed by Weiwei Yang. 
(cherry picked from commit 3b34fca4b5)
 2018-05-02 11:51:45 -07:00
Weiwei Yang 6fce88765a YARN-8222. Fix potential NPE when gets RMApp from RM context. Contributed by Tao Yang. 2018-05-02 18:02:24 +08:00
Yiqun Lin 2741af505f
YARN-6385. Fix checkstyle warnings in TestFileSystemApplicationHistoryStore 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 3265b55119)
 2018-05-02 18:15:53 +09:00
Jason Lowe cacd267b0d
HADOOP-15406. hadoop-nfs dependencies for mockito and junit are not test scope 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit e07156e8b0)
 2018-05-02 17:32:08 +09:00
Bibin A Chundatt 254933cf31
MAPREDUCE-7073. Optimize TokenCache#obtainTokensForNamenodesInternal 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 1a95a4524a)
 2018-05-02 16:15:18 +09:00
Yiqun Lin 5fef28d0d4 HDFS-13488. RBF: Reject requests when a Router is overloaded. Contributed by Inigo Goiri. 
(cherry picked from commit 37269261d1)
 2018-05-02 14:56:15 +08:00
Eric Yang a6f3d6ffcb YARN-7799. Improved YARN service jar file handling. 
Contributed by Billie Rinaldi
(cherry picked from commit 24eeea8b18)
 2018-05-01 16:49:29 -04:00
Inigo Goiri 4aadfb3c92 HDFS-13503. Fix TestFsck test failures on Windows. Contributed by Xiao Liang. 
(cherry picked from commit 9e2cfb2d3f)
 2018-05-01 08:13:30 -07:00
Billie Rinaldi 4174a0ed25 YARN-2674. Fix distributed shell AM container relaunch during RM work preserving restart. Contributed by Shane Kumpf 
(cherry picked from commit 4e1382aca4)
 2018-05-01 08:04:39 -07:00
Sunil G 12fe48b5e5 YARN-8187. [UI2] Individual Node page does not contain breadcrumb trail. Contributed by Zian Chen. 
(cherry picked from commit d6139c5106)
 2018-05-01 14:02:20 +05:30
Weiwei Yang f34f4e9c11 YARN-8212. Pending backlog for async allocation threads should be configurable. Contributed by Tao Yang. 
(cherry picked from commit 2d319e3793)
 2018-05-01 09:57:15 +08:00
Eric Yang 0fc55a8f57 YARN-8228. Added hostname length check for docker container. 
Contributed by Shane Kumpf

(cherry picked from commit a966ec6e23)
 2018-04-30 19:14:37 -04:00
Inigo Goiri 4c13e7e3a0 HDFS-13283. Percentage based Reserved Space Calculation for DataNode. Contributed by Lukas Majercak. 
(cherry picked from commit fc074a359c)
 2018-04-30 13:31:03 -07:00
Konstantinos Karanasos 9d2967098d YARN-8195. Fix constraint cardinality check in the presence of multiple target allocation tags. Contributed by Weiwei Yang. 
(cherry picked from commit 9b09555451)
 2018-04-30 11:55:26 -07:00
Inigo Goiri ce62991648 HDFS-13509. Bug fix for breakHardlinks() of ReplicaInfo/LocalReplica, and fix TestFileAppend failures on Windows. Contributed by Xiao Liang. 
(cherry picked from commit eb7fe1d588)
 2018-04-28 09:05:59 -07:00
Weiwei Yang 36fc9a6939 YARN-8225. YARN precommit build failing in TestPlacementConstraintTransformations. Contributed by Shane Kumpf. 
(cherry picked from commit 2c95eb8111)
 2018-04-28 18:50:51 +08:00
Inigo Goiri 9923fa2490 HDFS-13508. RBF: Normalize paths (automatically) when adding, updating, removing or listing mount table entries. Contributed by Ekanth S. 
(cherry picked from commit 484440602c)
 2018-04-27 16:29:41 -07:00
Inigo Goiri f26f764857 HDFS-13434. RBF: Fix dead links in RBF document. Contributed by Chetna Chaudhari. 
(cherry picked from commit f469628bba)
 2018-04-27 15:14:18 -07:00
Wangda Tan 090a8a274e YARN-8005. Add unit tests for queue priority with dominant resource calculator. (Zian Chen via wangda) 
Change-Id: I17a645f20869a1e5d86fa7a325c93fec908b91dc
(cherry picked from commit 92c5331423)
 2018-04-27 13:13:52 -07:00
Wangda Tan f9add5fdd9 YARN-8210. AMRMClient logging on every heartbeat to track updation of AM RM token causes too many log lines to be generated in AM logs. (Suma Shivaprasad via wangda) 
Change-Id: I70edd6e301fd5e78d479e1882aedc9332a0827aa
(cherry picked from commit b1833d9ba2)
 2018-04-27 13:13:47 -07:00
Rohith Sharma K S b3fd464e55 YARN-8221. RMWebServices also need to honor yarn.resourcemanager.display.per-user-apps. Contributed by Sunil G. 
(cherry picked from commit ef3ecc308d)
 2018-04-27 22:59:16 +05:30
Eric Yang e75aeacf29 YARN-7781. Update YARN service documentation. 
Contributed by Gour Saha
(cherry picked from commit 24a5ccbf4b)
 2018-04-27 12:40:24 -04:00
Eric Yang 0e19c0dd72 YARN-8204. Added a flag to disable YARN service upgrade. 
Contributed by Chandni Singh
(cherry picked from commit 14b47990af)
 2018-04-27 12:25:57 -04:00
Billie Rinaldi 90a31dc61c YARN-8211. Yarn registry dns log finds BufferUnderflowException on port ping. Contributed by Eric Yang 
(cherry picked from commit 9ab3f97089)
 2018-04-27 08:00:04 -07:00
Billie Rinaldi b20f68ddaa YARN-8208. Add log statement for Docker client configuration file at INFO level. Contributed by Yesha Vora 
(cherry picked from commit 914d6b5cb1)
 2018-04-27 06:11:34 -07:00
Weiwei Yang 386c39cd84 YARN-8152. Add chart in SLS to illustrate the throughput of the scheduler. Contributed by Tao Yang. 2018-04-27 15:44:35 +08:00
Sunil G 28e63f3d88 YARN-8004. Add unit tests for inter queue preemption for dominant resource calculator. Contributed by Zian Chen. 
(cherry picked from commit 71220d218d)
 2018-04-27 10:42:59 +05:30
Sunil G a1a2f1ddc1 YARN-8215. ATS v2 returns invalid YARN_CONTAINER_ALLOCATED_HOST_HTTP_ADDRESS from NM. Contributed by Rohith Sharma K S. 
(cherry picked from commit 7fc09c4f72)
 2018-04-27 10:34:29 +05:30
Sunil G e2901d97ba YARN-8205. Application State is not updated to ATS if AM launching is delayed. Contributed by Rohith Sharma K S. 
(cherry picked from commit 1634de0fc1)
 2018-04-27 10:28:18 +05:30
Yiqun Lin e097998c22 HDFS-13499. RBF: Show disabled name services in the UI. Contributed by Inigo Goiri. 
(cherry picked from commit 0a293de00d)
 2018-04-27 10:39:21 +08:00
Eric Yang 2253616064 YARN-8122. Added component health monitoring for YARN service. 
Contributed by Gour Saha
(cherry picked from commit 93979db840)
 2018-04-26 19:19:29 -04:00
Billie Rinaldi 91b24278da YARN-8140. Improve log message when launch cmd is ran for stopped yarn service. Contributed by Eric Yang 
(cherry picked from commit ed4e0676c357d5d18c15998b1f6b5d305848cb04)
 2018-04-26 13:18:56 -07:00
Inigo Goiri 921a3e1678 HDFS-13326. RBF: Improve the interfaces to modify and view mount tables. Contributed by Gang Li. 
(cherry picked from commit c394051a3d4d9d531f418503cb519606ae2b2e69)
 2018-04-26 13:01:16 -07:00
Eric Yang b39d183d92 YARN-7939. Added support to upgrade a component instance. 
Contributed by Chandni Singh

(cherry picked from commit 86ae380e55ca3b1b12744b9338d60b34e8c717a6)
 2018-04-26 15:54:12 -04:00
Eric Yang 050bd4cd2a YARN-8043. Added the exception message for failed launches running under LCE. 
Contributed by Shane Kumpf
 2018-04-26 08:26:10 -07:00
Sunil G 099e9fb226 MAPREDUCE-7042. Killed MR job data does not move to mapreduce.jobhistory.done-dir when ATS v2 is enabled. Contributed by Rohith Sharma K S. 
(cherry picked from commit 583a2f4edfdf71c32001cc2f2a03d16f9371d533)
 2018-04-26 19:07:48 +05:30
Wangda Tan da9d5a3fee HADOOP-15411. AuthenticationFilter should use Configuration.getPropsWithPrefix instead of iterator. (Suma Shivaprasad via wangda) 
Change-Id: Ia19458a43aceb4ffdb1e8eccc519655235d92ba9
(cherry picked from commit 3559d8b1dacf5cf207424de37cb6ba8865d26ffe)
 2018-04-25 22:16:07 -07:00
Wangda Tan af286319fd YARN-8193. YARN RM hangs abruptly (stops allocating resources) when running successive applications. (Zian Chen via wangda) 
Change-Id: Ia83dd2499ee9000b9e09ae5a932f21a13c0ddee6
(cherry picked from commit af986b442b7be0f2fad1241ca9e267a15c20bf43)
 2018-04-25 22:16:07 -07:00
Sunil G 44d28692a8 YARN-8188. RM Nodes UI data table index for sorting column need to be corrected post Application tags display. Contributed by Weiwei Yang. 
(cherry picked from commit 626690612cd0957316628376744a8be62f891665)
 2018-04-25 14:58:07 +05:30
Yiqun Lin 999ea44b9f HDFS-13484. RBF: Disable Nameservices from the federation. Contributed by Inigo Goiri. 
(cherry picked from commit 30fef0bf1e5c8c0ca073df99ad9b33cb0e4431a5)
 2018-04-25 15:23:54 +08:00
Wangda Tan 3043a93d46 YARN-8183. Fix ConcurrentModificationException inside RMAppAttemptMetrics#convertAtomicLongMaptoLongMap. (Suma Shivaprasad via wangda) 
Change-Id: I347871d672001653a3afe2e99adefd74e0d798cd
(cherry picked from commit bb3c504764f807fccba7f28298a12e2296f284cb)
 2018-04-24 17:44:58 -07:00