Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,269 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

14269 Commits

Author SHA1 Message Date
Sunil G b354357733 YARN-7728. Expose container preemptions related information in Capacity Scheduler queue metrics. Contributed by Eric Payne. 
(cherry picked from commit 82cc6f6968)
 2018-01-25 15:55:45 +05:30
Yiqun Lin 44cfee9af4 HDFS-13042. RBF: Heartbeat Router State. Contributed by Inigo Goiri. 
(cherry picked from commit 7721fff744)
 2018-01-25 15:55:24 +08:00
Jianfei Jiang 1b5f0e819e
HDFS-13063. Fix the incorrect spelling in HDFSHighAvailabilityWithQJM.md 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit eb2dd08688)
(cherry picked from commit f4656e2150)
 2018-01-25 15:32:36 +09:00
Jian He cbaf6d242d YARN-7801. AmFilterInitializer should addFilter after fill all parameters. Contributed by Wangda Tan 2018-01-24 16:18:36 -08:00
Zhe Zhang 258fb117d2 YARN-7737. prelaunch.err file not found exception on container failure. Contributed by Keqiu Hu. 
(cherry picked from commit fa8cf4d1b4)
(cherry picked from commit 83a4f92a3f)
(cherry picked from commit e9a338ff64)
 2018-01-24 13:10:58 -08:00
Inigo Goiri a43100adad HDFS-12772. RBF: Federation Router State State Store internal API. Contributed by Inigo Goiri. 
(cherry picked from commit 95743c672e)
 2018-01-23 19:17:47 -08:00
Jian He 6da08837da YARN-7782. Enable user re-mapping for Docker containers in yarn-default.xml. Contributed by Eric Yang 2018-01-23 14:07:41 -08:00
Masahiro Tanaka 93220f90ea
HADOOP-15181. Typo in SecureMode.md 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 6e27b20b4d)
(cherry picked from commit ab482ebe73)
 2018-01-22 17:15:54 +09:00
Haibo Chen c4ba8eb003 YARN-5094. some YARN container events have timestamp of -1. 
(cherry picked from commit 4aca4ff759)
(cherry picked from commit 8793e45f53)
(cherry picked from commit 895a0391fe)
 2018-01-19 10:38:18 -08:00
Inigo Goiri 8702882b54 HDFS-13028. RBF: Fix spurious TestRouterRpc#testProxyGetStats. Contributed by Inigo Goiri. 
(cherry picked from commit 130f8bce00)
(cherry picked from commit c6139332f9)
 2018-01-19 09:53:22 -08:00
Jitendra Pandey dd1de1ea37 HADOOP-15143. NPE due to Invalid KerberosTicket in UGI. Contributed by Mukul Kumar Singh. 
(cherry picked from commit cb60c05c3a)
 2018-01-18 20:18:19 -08:00
Miklos Szegedi 6e11ef7c44 YARN-7590. Improve container-executor validation check. Contributed by Eric Yang. 2018-01-17 22:18:08 -08:00
Brahma Reddy Battula 3cdc392150 HADOOP-15150. in FsShell, UGI params should be overidden through env vars(-D arg). Contributed by Brahma Reddy Battula. 
(cherry picked from commit 08332e12d0)
 2018-01-18 11:02:38 +05:30
Akira Ajisaka c614a39e9f
HADOOP-15177. Update the release year to 2018. Contributed by Bharat Viswanadham. 
(cherry picked from commit cdaf92c9f5)
(cherry picked from commit b0c9b89281)
 2018-01-18 13:17:42 +09:00
Jason Lowe 98835e14ae Revert "HADOOP-15027. AliyunOSS: Support multi-thread pre-read to improve sequential read from Hadoop to Aliyun OSS performance. (Contributed by Jinhu Wu)" 
This reverts commit 622f6b65d6.
 2018-01-17 09:59:31 -06:00
Vinayakumar B 62b82d7f41 HDFS-9049. Make Datanode Netty reverse proxy port to be configurable. Contributed by Vinayakumar B. 
(cherry picked from commit 09efdfe9e1)
(cherry picked from commit b3eeea0b6e)
 2018-01-17 14:23:33 +05:30
Sammi Chen 622f6b65d6 HADOOP-15027. AliyunOSS: Support multi-thread pre-read to improve sequential read from Hadoop to Aliyun OSS performance. (Contributed by Jinhu Wu) 
(cherry picked from commit 9195a6e302)
(cherry picked from commit 55142849db)
(cherry picked from commit 082a707bae)
(cherry picked from commit 896dc7c780)
 2018-01-17 16:37:25 +08:00
Brahma Reddy Battula 28f69755f1 HDFS-8693. refreshNamenodes does not support adding a new standby to a running DN. Contributed by Ajith S. 
(cherry picked from commit 880b9d24ff)
 2018-01-16 16:33:34 +05:30
Sunil G 4e28aa4dcf YARN-7727. Incorrect log levels in few logs with QueuePriorityContainerCandidateSelector. Contributed by Prabhu Joseph. 
(cherry picked from commit 128d773a23)
 2018-01-12 15:57:04 +05:30
Akira Ajisaka fff7f77c96
YARN-7735. Fix typo in YARN documentation. Contributed by Takanobu Asanuma. 
(cherry picked from commit fbbbf59c82)
(cherry picked from commit 68b7908aa8)
 2018-01-11 16:00:50 +09:00
Inigo Goiri 6dc0b885a4 HDFS-12802. RBF: Control MountTableResolver cache size. Contrubuted by Inigo Goiri. 
(cherry picked from commit d9006d8a4e)
 2018-01-09 19:02:45 -08:00
Haibo Chen 6602182a2b YARN-7716. metricsTimeStart and metricsTimeEnd should be all lower case in the doc. 
(cherry picked from commit f725b9e267)
(cherry picked from commit cf816bc751)
(cherry picked from commit a58034cdfd)
 2018-01-09 09:05:25 -08:00
Jason Lowe 3701c399b3 YARN-6948. Invalid event: ATTEMPT_ADDED at FINAL_SAVING. Contributed by lujie 
(cherry picked from commit 90c86d6e09)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java
 2018-01-09 11:00:10 -06:00
Jason Lowe 52097cf2f4 YARN-7663. RMAppImpl:Invalid event: START at KILLED. Contributed by lujie 
(cherry picked from commit d2c2d8c913)
 2018-01-09 10:04:16 -06:00
bibinchundatt 7ee994a536 YARN-7508. NPE in FiCaSchedulerApp when debug log enabled in async-scheduling mode. Contributed by Tao Yang. 
(cherry picked from commit b26e30ab16)
 2018-01-09 20:04:40 +05:30
Wei Yan 5e8029eff9 HDFS-12945. Switch to ClientProtocol instead of NamenodeProtocols in NamenodeWebHdfsMethods. Contributed by Wei Yan. 
(cherry picked from commit 2ee0d64ace)
 2018-01-08 15:13:53 -08:00
Steve Loughran a35267b47a HADOOP-15086. NativeAzureFileSystem file rename is not atomic. 
Contributed by Thomas Marquardt
(Backported to branch-2 via /HADOOP-15156)
 2018-01-08 15:12:41 +00:00
Rohith Sharma K S 8e0a5b1514 YARN-7699. queueUsagePercentage is coming as INF for getApp REST api call. Contributed by Sunil G. 
(cherry picked from commit 281350674c)
 2018-01-08 15:57:56 +05:30
Inigo Goiri c1d48cbda0 HDFS-12988. RBF: Mount table entries not properly updated in the local cache. Contributed by Inigo Goiri. 
(cherry picked from commit 83b513ac6d)
 2018-01-05 09:14:25 -08:00
Sunil G c4e0821d72 YARN-7619. Max AM Resource value in Capacity Scheduler UI has to be refreshed for every user. Contributed by Eric Payne. 
(cherry picked from commit a79abbc03e)
 2018-01-05 14:55:17 +05:30
Jason Lowe ea78313d55 YARN-7678. Ability to enable logging of container memory stats. Contributed by Jim Brennan 
(cherry picked from commit 42964c2a66)
 2018-01-04 10:22:54 -06:00
Tsz-Wo Nicholas Sze f3a92d89f3 HDFS-12347. TestBalancerRPCDelay#testBalancerRPCDelay fails very frequently. Contributed by Bharat Viswanadham 
(cherry picked from commit c7499f2d24)
 2018-01-04 06:48:04 +05:30
Jason Lowe a316a4cc47 MAPREDUCE-7028. Concurrent task progress updates causing NPE in Application Master. Contributed by Gergo Repas 
(cherry picked from commit fe35103591)
 2018-01-03 11:12:55 -06:00
Rohith Sharma K S 50f635ec73 YARN-7692. Skip validating priority acls while recovering applications. Contributed by Sunil G. 
(cherry picked from commit c9bf813c9a)
 2018-01-03 18:34:12 +05:30
Arun Suresh 7854745c5f YARN-7691. Add Unit Tests for ContainersLauncher. (Sampada Dehankar via asuresh) 
(cherry picked from commit c0c7cce81d)
 2018-01-02 22:04:57 -08:00
Xiao Chen e4df9ef10a HADOOP-15149. CryptoOutputStream should implement StreamCapabilities. 
(cherry picked from commit 81127616c5)
(cherry picked from commit 8c275c63ff)
(cherry picked from commit 9dee5c6779f12597c0d6134bb639876649da9cd3)
 2017-12-29 13:57:55 -08:00
John Zhuge a1334ea177 HADOOP-14872. CryptoInputStream should implement unbuffer. Contributed by John Zhuge. 
(cherry picked from commit 6c32ddad30)
(cherry picked from commit fc9e156484)
(cherry picked from commit 5e0f4f212d)
 2017-12-29 13:57:55 -08:00
Xiao Chen 141cc8ffa2 HADOOP-15056. Fix TestUnbuffer#testUnbufferException failure. Contributed by Jack Bearden. 
(cherry picked from commit 19e0894209)
(cherry picked from commit 1d1401ad38)
(cherry picked from commit 31436a12d5)
 2017-12-29 13:57:55 -08:00
Xiao Chen 52adaa43db HADOOP-15012. Add readahead, dropbehind, and unbuffer to StreamCapabilities. Contributed by John Zhuge. 
(cherry picked from commit c9d48352c2)
 2017-12-29 13:57:55 -08:00
Arun Suresh 41601363ca YARN-7542. Fix issue that causes some Running Opportunistic Containers to be recovered as PAUSED. (Sampada Dehankar via asuresh) 
(cherry picked from commit a55884c68e)
 2017-12-28 22:21:19 -08:00
Xiao Chen 947d484d35 HDFS-9023. When NN is not able to identify DN for replication, reason behind it can be logged. 
(cherry picked from commit 50b233d356)
 2017-12-28 11:56:12 -08:00
Yiqun Lin 06cfe4b11b HDFS-12937. RBF: Add more unit tests for router admin commands. Contributed by Yiqun Lin. 
(cherry picked from commit e040c97b77)
 2017-12-19 15:36:28 +08:00
Junping Du c6f5d36ff2 Add 2.8.3 release jdiff files. 
(cherry picked from commit c89f99aade)
 2017-12-18 22:38:26 -08:00
Junping Du 63ae39bc23 Add 2.8.3 Releasenotes and Changes. 
(cherry picked from commit 7bdd324028)
 2017-12-18 22:33:58 -08:00
Jason Lowe 6c20eeb76d YARN-7661. NodeManager metrics return wrong value after update node resource. Contributed by Yang Wang 
(cherry picked from commit 811fabdebe)
 2017-12-18 15:29:31 -06:00
Jason Lowe 7b447e261b HADOOP-15085. Output streams closed with IOUtils suppressing write errors. Contributed by Jim Brennan 
(cherry picked from commit 93fdc3d935)
 2017-12-15 17:18:32 -06:00
Jason Lowe 3929982ee6 YARN-7595. Container launching code suppresses close exceptions after writes. Contributed by Jim Brennan 
(cherry picked from commit 0f8de8cd91)
 2017-12-15 16:01:40 -06:00
Jason Lowe 605b8560f6 HDFS-12881. Output streams closed with IOUtils suppressing write errors. Contributed by Ajay Kumar 
(cherry picked from commit 9ae8d1a8de)
 2017-12-15 14:49:43 -06:00
Sammi Chen 6af3ea58c9 HADOOP-15111. Aliyun OSS: backport HADOOP-14993 to branch-2. Contributed by Genmao Yu. 
(cherry picked from commit 1fee447bf2)
 2017-12-15 14:45:32 +08:00
Yiqun Lin c629f33761 HDFS-12895. RBF: Add ACL support for mount table. Contributed by Yiqun Lin. 
(cherry picked from commit ee028bfdf1)
 2017-12-15 14:14:42 +08:00