Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,277 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

14277 Commits

Author SHA1 Message Date
Jason Lowe ba7b103c95 MAPREDUCE-6930. mapreduce.map.cpu.vcores and mapreduce.reduce.cpu.vcores are both present twice in mapred-default.xml. Contributed by Sen Zhao 
(cherry picked from commit 32fa3a63e0)
 2018-03-09 10:46:35 -06:00
Yiqun Lin 04e18e747b HDFS-13233. RBF: MountTableResolver doesn't return the correct mount point of the given path. Contributed by wangzhiyuan. 
(cherry picked from commit f879504fe1)
 2018-03-09 15:53:17 +08:00
Kihwal Lee 6fafaa7b7f HDFS-12614. FSPermissionChecker#getINodeAttrs() throws NPE when INodeAttributesProvider configured. Contributed by Manoj Govindassamy. 
(cherry picked from commit 0aa52d4085)
 2018-03-08 14:26:42 -06:00
Inigo Goiri 44abf77d9b HDFS-13232. RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns. Contributed by Chao Sun. 
(cherry picked from commit 0c2b969e01)
 2018-03-08 09:34:07 -08:00
Yiqun Lin e3c80d7391 HDFS-13214. RBF: Complete document of Router configuration. Contributed by Yiqun Lin. 
(cherry picked from commit 253ef33f80)
 2018-03-07 16:09:23 +08:00
Xiaoyu Yao 321766bcc8 HDFS-13109. Support fully qualified hdfs path in EZ commands. Contributed by Hanisha Koneru. 
(cherry picked from commit edf9445708)
 2018-03-06 18:33:11 -08:00
Allen Wittenauer ef54f78530
HADOOP-15279. increase maven heap size recommendations 
Signed-off-by: Jason Lowe <jlowe@apache.org>
Signed-off-by: Chris Douglas <cdouglas@apache.org>
(cherry picked from commit d4cc50f622)
(cherry picked from commit dbd69cb2ce)
 2018-03-06 13:59:01 -08:00
Sen Zhao 2ee654acfe
YARN-7736. Fix itemization in YARN federation document 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 245751ffdc)
(cherry picked from commit bda2a9c2a0)
 2018-03-05 11:55:31 -08:00
Akira Ajisaka 9c7be95470
HADOOP-15283. Upgrade from findbugs 3.0.1 to spotbugs 3.1.2 in branch-2 to fix docker image build. 
(cherry picked from commit 8ad3ec6aab)
 2018-03-04 07:03:24 -08:00
Gergely Novák bea5dff7b3
MAPREDUCE-7023. TestHadoopArchiveLogs.testCheckFilesAndSeedApps fails on rerun 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit e99a1e7767)
(cherry picked from commit 278676508f)
 2018-03-02 16:22:49 -08:00
Jason Lowe 2d313c8264 YARN-7511. NPE in ContainerLocalizer when localization failed for running container. Contributed by Tao Yang 
(cherry picked from commit 83798f15f8)
 2018-03-02 10:17:31 -06:00
Nanda kumar 2599b97697
HADOOP-15275. Incorrect javadoc for return type of RetryPolicy#shouldRetry 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 55d04a6db1)
(cherry picked from commit 45ec3e18e3)
 2018-03-01 19:05:22 +09:00
Steve Loughran 717295e464 HADOOP-13972. ADLS to support per-store configuration. 
Contributed by Sharad Sonker.

(cherry picked from commit 050f5287b7)
(cherry picked from commit 07c7df4b26)
 2018-02-28 14:54:17 -08:00
Inigo Goiri 0d7a3f48bc HDFS-13199. RBF: Fix the hdfs router page missing label icon issue. Contributed by maobaolong. 
(cherry picked from commit d86f301d46)
 2018-02-27 17:43:07 -08:00
Yiqun Lin 13e86a7ab8 HDFS-13184. RBF: Improve the unit test TestRouterRPCClientRetries. Contributed by Yiqun Lin. 
(cherry picked from commit 1e85a995d1)
 2018-02-27 10:55:39 +08:00
Chris Douglas 6024b3a2ad Backport HADOOP-13514 (surefire upgrade) to branch-2 
(cherry picked from commit 762125b864)
 2018-02-26 16:32:19 -08:00
Wei Yan 39e1f963bb HDFS-13187. RBF: Fix Routers information shown in the web UI. Contributed by Inigo Goiri and Wei Yan. 
(cherry picked from commit 6ce9f79cc9)
 2018-02-26 15:36:21 -08:00
Kihwal Lee a6343ff808 HDFS-12070. Failed block recovery leaves files open indefinitely and at risk for data loss. Contributed by Kihwal Lee. 
(cherry picked from commit 4b43f2aa56)
 2018-02-26 10:59:47 -06:00
Arpit Agarwal 627a32375c HDFS-12781. After Datanode down, In Namenode UI Datanode tab is throwing warning message.. Contributed by Brahma Reddy Battula. 2018-02-24 15:13:02 -08:00
Xiao Chen 16e14b9969 HDFS-13164. File not closed if streamer fail with DSQuotaExceededException. 
(cherry picked from commit 51088d3233)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestQuota.java

(cherry picked from commit 80f7165374)
 2018-02-23 14:01:19 -08:00
Jason Lowe 76d4d5c759 YARN-7945. Java Doc error in UnmanagedAMPoolManager for branch-2. Contributed by Botong Huang 
(cherry picked from commit 7a6aa7bf99)
 2018-02-22 11:01:27 -06:00
Brahma Reddy Battula b32cc32ee2 HADOOP-14903. Add json-smart explicitly to pom.xml. Contributed by Brahma Reddy Battula and Ray Chiang 
(cherry picked from commit 7307a89ec1)
 2018-02-22 18:53:29 +05:30
Ray Chiang ed17197305 HADOOP-14799. Update nimbus-jose-jwt to 4.41.1. (rchiang) 
(cherry picked from commit 556812c179)
 2018-02-22 18:11:20 +05:30
Sunil G d9d8fa1d3a YARN-7947. Capacity Scheduler intra-queue preemption can NPE for non-schedulable apps. Contributed by Eric Payne. 
(cherry picked from commit bdd2a184d7)
 2018-02-21 15:32:54 +05:30
Yiqun Lin 14ddac3174 HDFS-13119. RBF: Manage unavailable clusters. Contributed by Yiqun Lin. 
(cherry picked from commit 8896d20b91)
 2018-02-20 13:03:55 -08:00
Xiao Chen c16b91fde0 HDFS-11187. Optimize disk access for last partial chunk checksum of Finalized replica. Contributed by Gabor Bota, Wei-Chiu Chuang. 
(cherry picked from commit 49ed7d7fc9)
 2018-02-19 19:19:02 -08:00
Jason Lowe c753df4b69 YARN-7813. Capacity Scheduler Intra-queue Preemption should be configurable for each queue. Contributed by Eric Payne 
(cherry picked from commit 51ad923f51)
 2018-02-19 16:07:19 -06:00
Jason Lowe 03a4d9a7b4 HADOOP-15206. BZip2 drops and duplicates records when input split size is small. Contributed by Aki Tanaka 
(cherry picked from commit 0898ff42e9)
 2018-02-16 15:08:43 -06:00
Eric Payne ebf183fa56 MAPREDUCE-7053: Timed out tasks can fail to produce thread dump. Contributed by Jason Lowe. 
(cherry picked from commit 904a6bf263)
 2018-02-16 08:51:12 -06:00
Kihwal Lee 01fc51fca7 HDFS-13112. Token expiration edits may cause log corruption or deadlock. Contributed by Daryn Sharp. 
(cherry picked from commit 47473952e5)
 2018-02-15 15:39:23 -06:00
Jason Lowe 1871e6844e MAPREDUCE-7052. TestFixedLengthInputFormat#testFormatCompressedIn is flaky. Contributed by Peter Bacsko 
(cherry picked from commit a53d62ab26)
 2018-02-15 15:31:50 -06:00
Kihwal Lee 961876e94f xattr api cleanup 
(cherry picked from commit da59acd8ca)
 2018-02-15 11:29:29 -06:00
Kihwal Lee 5b4725fb04 Revert "HADOOP-14799. Update nimbus-jose-jwt to 4.41.1. (rchiang)" 
This reverts commit 557d6f2814.
 2018-02-14 15:22:05 -06:00
Ray Chiang 557d6f2814 HADOOP-14799. Update nimbus-jose-jwt to 4.41.1. (rchiang) 
(cherry picked from commit 556812c179)
 2018-02-14 00:24:14 +05:30
Jason Lowe b8b67e4b8d MAPREDUCE-7048. Uber AM can crash due to unknown task in statusUpdate. Contributed by Peter Bacsko 
(cherry picked from commit 08feac4c83)
 2018-02-12 14:33:32 -06:00
Brahma Reddy Battula ed512645b2 HDFS-8693. Addendum patch to execute the command using UGI. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 35c17351ca)
(cherry picked from commit 24af0bc144)
 2018-02-12 22:27:21 +05:30
Arpit Agarwal 41d434d08e HDFS-10453. ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.. Contributed by He Xiaoqiao. 2018-02-12 07:12:02 -08:00
Yiqun Lin 050aa531ba HDFS-13099. RBF: Use the ZooKeeper as the default State Store. Contributed by Yiqun Lin. 
(cherry picked from commit 543f3abbee)
 2018-02-09 14:03:13 +08:00
Xiaoyu Yao 77c6439c33 HDFS-13120. Snapshot diff could be corrupted after concat. Contributed by Xiaoyu Yao. 
(cherry picked from commit 8faf0b50d4)
 2018-02-08 10:20:55 -08:00
Brahma Reddy Battula 3487f2b722 HDFS-12935. Get ambiguous result for DFSAdmin command in HA mode when only one namenode is up. Contributed by Jianfei Jiang. 
(cherry picked from commit 9873eb63a7)
 2018-02-08 18:44:34 +05:30
Billie Rinaldi 52281fd893 Revert "YARN-6078. Containers stuck in Localizing state. Contributed by Billie Rinaldi." 
This reverts commit 9229fb3523.
 2018-02-07 09:57:46 -08:00
Kihwal Lee 39963d53df HADOOP-15212. Add independent secret manager method for logging expired tokens. Contributed by Daryn Sharp. 
(cherry picked from commit 2dd960de98)
 2018-02-06 15:38:32 -06:00
Billie Rinaldi 43ea9a42d7 YARN-7890. NPE during container relaunch. Contributed by Jason Lowe 
(cherry picked from commit a196ee9362)
 2018-02-06 12:06:25 -08:00
Jason Lowe e73e820d2a YARN-7849. TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails due to heartbeat sync error. Contributed by Botong Huang 
(cherry picked from commit 60656bceca)
 2018-02-05 17:29:49 -06:00
Haibo Chen e78a701687 YARN-6868. Add test scope to certain entries in hadoop-yarn-server-resourcemanager pom.xml. (Ray Chiang via Haibo Chen) 
(cherry picked from commit a20e7105ea)
(cherry picked from commit c25c082961)
 2018-02-05 10:51:39 -08:00
Yongjun Zhang 1ed6ae7b12 HDFS-13100. Handle IllegalArgumentException when GETSERVERDEFAULTS is not implemented in webhdfs. Contributed by Aaron T. Myers and Yongjun Zhang. 
(cherry picked from commit 4e9a59ce16)
 2018-02-02 23:45:28 -08:00
Yiqun Lin 024127e471 HDFS-13068. RBF: Add router admin option to manage safe mode. Contributed by Yiqun Lin. 
(cherry picked from commit 712e9381d2)
 2018-02-02 17:37:14 +08:00
Inigo Goiri 6769c78cdd HDFS-13043. RBF: Expose the state of the Routers in the federation. Contributed by Inigo Goiri. 
(cherry picked from commit 6ca7204ceb)
 2018-02-01 10:39:25 -08:00
Inigo Goiri 38c3e17117 HDFS-13044. RBF: Add a safe mode for the Router. Contributed by Inigo Goiri. 
(cherry picked from commit 961dcb693d)
 2018-01-31 09:17:40 -08:00
Inigo Goiri ffba476192 HDFS-13083. RBF: Fix doc error setting up client. Contributed by tartarus. 
(cherry picked from commit 5206b2c7ca)
 2018-01-30 18:28:54 -08:00