Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,186 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

14186 Commits

Author SHA1 Message Date
Rohith Sharma K S 50f635ec73 YARN-7692. Skip validating priority acls while recovering applications. Contributed by Sunil G. 
(cherry picked from commit c9bf813c9a)
 2018-01-03 18:34:12 +05:30
Arun Suresh 7854745c5f YARN-7691. Add Unit Tests for ContainersLauncher. (Sampada Dehankar via asuresh) 
(cherry picked from commit c0c7cce81d)
 2018-01-02 22:04:57 -08:00
Xiao Chen e4df9ef10a HADOOP-15149. CryptoOutputStream should implement StreamCapabilities. 
(cherry picked from commit 81127616c5)
(cherry picked from commit 8c275c63ff)
(cherry picked from commit 9dee5c6779f12597c0d6134bb639876649da9cd3)
 2017-12-29 13:57:55 -08:00
John Zhuge a1334ea177 HADOOP-14872. CryptoInputStream should implement unbuffer. Contributed by John Zhuge. 
(cherry picked from commit 6c32ddad30)
(cherry picked from commit fc9e156484)
(cherry picked from commit 5e0f4f212d)
 2017-12-29 13:57:55 -08:00
Xiao Chen 141cc8ffa2 HADOOP-15056. Fix TestUnbuffer#testUnbufferException failure. Contributed by Jack Bearden. 
(cherry picked from commit 19e0894209)
(cherry picked from commit 1d1401ad38)
(cherry picked from commit 31436a12d5)
 2017-12-29 13:57:55 -08:00
Xiao Chen 52adaa43db HADOOP-15012. Add readahead, dropbehind, and unbuffer to StreamCapabilities. Contributed by John Zhuge. 
(cherry picked from commit c9d48352c2)
 2017-12-29 13:57:55 -08:00
Arun Suresh 41601363ca YARN-7542. Fix issue that causes some Running Opportunistic Containers to be recovered as PAUSED. (Sampada Dehankar via asuresh) 
(cherry picked from commit a55884c68e)
 2017-12-28 22:21:19 -08:00
Xiao Chen 947d484d35 HDFS-9023. When NN is not able to identify DN for replication, reason behind it can be logged. 
(cherry picked from commit 50b233d356)
 2017-12-28 11:56:12 -08:00
Yiqun Lin 06cfe4b11b HDFS-12937. RBF: Add more unit tests for router admin commands. Contributed by Yiqun Lin. 
(cherry picked from commit e040c97b77)
 2017-12-19 15:36:28 +08:00
Junping Du c6f5d36ff2 Add 2.8.3 release jdiff files. 
(cherry picked from commit c89f99aade)
 2017-12-18 22:38:26 -08:00
Junping Du 63ae39bc23 Add 2.8.3 Releasenotes and Changes. 
(cherry picked from commit 7bdd324028)
 2017-12-18 22:33:58 -08:00
Jason Lowe 6c20eeb76d YARN-7661. NodeManager metrics return wrong value after update node resource. Contributed by Yang Wang 
(cherry picked from commit 811fabdebe)
 2017-12-18 15:29:31 -06:00
Jason Lowe 7b447e261b HADOOP-15085. Output streams closed with IOUtils suppressing write errors. Contributed by Jim Brennan 
(cherry picked from commit 93fdc3d935)
 2017-12-15 17:18:32 -06:00
Jason Lowe 3929982ee6 YARN-7595. Container launching code suppresses close exceptions after writes. Contributed by Jim Brennan 
(cherry picked from commit 0f8de8cd91)
 2017-12-15 16:01:40 -06:00
Jason Lowe 605b8560f6 HDFS-12881. Output streams closed with IOUtils suppressing write errors. Contributed by Ajay Kumar 
(cherry picked from commit 9ae8d1a8de)
 2017-12-15 14:49:43 -06:00
Sammi Chen 6af3ea58c9 HADOOP-15111. Aliyun OSS: backport HADOOP-14993 to branch-2. Contributed by Genmao Yu. 
(cherry picked from commit 1fee447bf2)
 2017-12-15 14:45:32 +08:00
Yiqun Lin c629f33761 HDFS-12895. RBF: Add ACL support for mount table. Contributed by Yiqun Lin. 
(cherry picked from commit ee028bfdf1)
 2017-12-15 14:14:42 +08:00
Sammi Chen b2b9e0da6c HADOOP-15104. Aliyun OSS: change the default value of max error retry. Contributed by Jinhu Wu. 
(cherry picked from commit ce04340ec7)
(cherry picked from commit 27807e4ccb)
 2017-12-15 13:56:44 +08:00
Weiwei Yang 108f8b8fa1 YARN-7642. Add test case to verify context update after container promotion or demotion with or without auto update. Contributed by Weiwei Yang. 
(cherry picked from commit 89b6c482c1)
 2017-12-15 12:33:41 +08:00
Subru Krishnan 2b77729fdf YARN-7630. Fix AMRMToken rollover handling in AMRMProxy. Contributed by Botong Huang. 
(cherry picked from commit 17ba74be29)
(cherry picked from commit 8d3d7fa1c5)
 2017-12-14 14:11:07 -08:00
Kihwal Lee 43b9fbc2b4 HDFS-12907. Allow read-only access to reserved raw for non-superusers. Contributed by Rushabh S Shah. 
(cherry picked from commit 08a50da95f)
 2017-12-14 15:06:04 -06:00
Yiqun Lin 053a6fc126 HDFS-12883. RBF: Document Router and State Store metrics. Contributed by Yiqun Lin. 
(cherry picked from commit 91c96bdf8e)
 2017-12-14 16:04:31 +08:00
Surendra Singh Lilhore 4f0ae1b108 HDFS-12833. Distcp : Update the usage of delete option for dependency with update and overwrite option. Contributed by usharani. 
(cherry picked from commit 8d69b7f2d4)
 2017-12-13 10:50:01 +05:30
Weiwei Yang dff710632e YARN-7647. NM print inappropriate error log when node-labels is enabled. Contributed by Yang Wang. 2017-12-13 13:13:12 +08:00
Inigo Goiri 118d653eea HDFS-12875. RBF: Complete logic for -readonly option of dfsrouteradmin add command. Contributed by Inigo Goiri. 
(cherry picked from commit 5cd1056ad7)
 2017-12-11 15:17:49 -08:00
Weiwei Yang 98eb4b2c6b YARN-7608. Incorrect sTarget column causing DataTable warning on RM application and scheduler web page. Contributed by Gergely Novák. 2017-12-11 10:37:22 +08:00
Wangda Tan 524ecb19ef YARN-7591. NPE in async-scheduling mode of CapacityScheduler. (Tao Yang via wangda) 
Change-Id: I67e086d6d35c3166ec0f6305490ea6527bd6d799
(cherry picked from commit 41796ea60a)
(cherry picked from commit c27a5ba65c)
 2017-12-08 21:57:26 -08:00
Subru Krishnan 39d0fdf1b2 YARN-6704. Add support for work preserving NM restart when FederationInterceptor is enabled in AMRMProxyService. (Botong Huang via Subru). 
(cherry picked from commit 670e8d4ec7)
(cherry picked from commit 850bd0ed7c)
 2017-12-08 15:46:13 -08:00
Sammi Chen 4a064dd644 HADOOP-15024. AliyunOSS: Support user agent configuration and include that & Hadoop version information to oss server. 
(cherry picked from commit 94390fcd52)
 2017-12-08 22:37:17 +08:00
Sammi Chen 0f95a1d26a HADOOP-14997. Add hadoop-aliyun as dependency of hadoop-cloud-storage. Contributed by Genmao Yu. 
(cherry picked from commit 96adff7370)
 2017-12-08 20:15:32 +08:00
Sammi Chen d06281486d HADOOP-15080. Aliyun OSS: update oss sdk from 2.8.1 to 2.8.3 to remove its dependency on Cat-x json-lib. 
(cherry picked from commit 67b2661e3d)
(cherry picked from commit c225ac3f8f)
 2017-12-07 15:58:56 -07:00
Weiwei Yang 1a8f6bad34 YARN-7607. Remove the trailing duplicated timestamp in container diagnostics message. Contributed by Weiwei Yang. 2017-12-07 17:30:35 +08:00
Chris Douglas ae3dc443f4 HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak 
(cherry picked from commit afc606c3aa)
 2017-12-07 00:47:02 -08:00
Akira Ajisaka 89314b78dd
HDFS-12889. Addendum patch to add missing file. 
(cherry picked from commit 6cca5b3bcb)
(cherry picked from commit 046424cf8a)
 2017-12-07 13:25:02 +09:00
Weiwei Yang 42deb54049 YARN-7611. Node manager web UI should display container type in containers page. Contributed by Weiwei Yang. 
Previous commit 218d622529 introduces a compile error,
  so it was reverted by commit db74ada80f.
  This commit fixed the issue.

(cherry picked from commit 05c347fe51)
 2017-12-06 20:22:52 +08:00
Weiwei Yang db74ada80f Revert "YARN-7611. Node manager web UI should display container type in containers page. Contributed by Weiwei Yang." 
This reverts commit 218d622529.
 2017-12-06 19:58:51 +08:00
Weiwei Yang 218d622529 YARN-7611. Node manager web UI should display container type in containers page. Contributed by Weiwei Yang. 
(cherry picked from commit 05c347fe51)
 2017-12-06 12:57:22 +08:00
Akira Ajisaka 7fd6407886
HDFS-12889. Router UI is missing robots.txt file. Contributed by Bharat Viswanadham. 
(cherry picked from commit 44b06d34a5)
(cherry picked from commit 4e92b1e89e)
 2017-12-06 11:43:08 +09:00
Akira Ajisaka 981f117a1b
HADOOP-14985. Remove subversion related code from VersionInfoMojo.java. Contributed by Ajay Kumar. 
(cherry picked from commit 9f1bdafedb)
 2017-12-05 14:32:34 +09:00
Xiao Chen 55df9df9fb HDFS-12396. Webhdfs file system should get delegation token from kms provider. Contributed by Rushabh S Shah. 
(cherry picked from commit 274bbb193f)
 2017-12-04 10:45:30 -08:00
Arun Suresh cc0c966a4e YARN-7587. Skip dispatching opportunistic containers to nodes whose queue is already full. (Weiwei Yang via asuresh) 
(cherry picked from commit 37ca416950)
 2017-12-03 22:25:06 -08:00
Jason Lowe 487c920bb0 YARN-7455. quote_and_append_arg can overflow buffer. Contributed by Jim Brennan 
(cherry picked from commit 60f95fb719)
 2017-12-01 15:54:03 -06:00
Jason Lowe 74cfca02dd MAPREDUCE-5124. AM lacks flow control for task events. Contributed by Peter Bacsko 
(cherry picked from commit d0fc1cd0c8)
 2017-12-01 14:19:34 -06:00
Konstantin V Shvachko 0f5ec01ef7 HDFS-12638. Delete copy-on-truncate block along with the original block, when deleting a file being truncated. Contributed by Konstantin Shvachko. 
(cherry picked from commit 60fd0d7fd7)
 2017-11-30 18:28:18 -08:00
Jason Lowe 5a8a1e66c6 YARN-7495. Improve robustness of the AggregatedLogDeletionService. Contributed by Jonathan Eagles 
(cherry picked from commit 5cfaee2e6d)
 2017-11-30 12:47:43 -06:00
Wangda Tan a6d7fa91d9 YARN-7509. AsyncScheduleThread and ResourceCommitterService are still running after RM is transitioned to standby. (Tao Yang via wangda) 
Change-Id: I7477fe355419fd4a0a6e2bdda7319abad4c4c748
(cherry picked from commit 834e91ee91)
(cherry picked from commit 94f7b0f99f)
 2017-11-29 15:48:51 -08:00
Wei Yan 17289ca677 YARN-6851. Capacity Scheduler: document configs for controlling # containers allowed to be allocated per node heartbeat. 
(cherry picked from commit 333ef303ff)
 2017-11-29 14:48:19 -08:00
Kihwal Lee 7d2b13f0be HDFS-11754. Make FsServerDefaults cache configurable. Contributed by Mikhail Erofeev. 
(cherry picked from commit 53509f295b)
 2017-11-29 15:16:17 -06:00
Wei Yan 5e31b109c6 HDFS-12835. Fix the javadoc errors in Router-based federation. 
(cherry picked from commit 301641811d)
 2017-11-29 09:49:51 -08:00
Konstantin V Shvachko 3f9f0055eb HDFS-12832. INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit. Contribuited by Konstantin Shvachko. 
(cherry picked from commit d331762f24)
 2017-11-28 18:11:38 -08:00