Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,207 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

14207 Commits

Author SHA1 Message Date
Brahma Reddy Battula 3cdc392150 HADOOP-15150. in FsShell, UGI params should be overidden through env vars(-D arg). Contributed by Brahma Reddy Battula. 
(cherry picked from commit 08332e12d0)
 2018-01-18 11:02:38 +05:30
Akira Ajisaka c614a39e9f
HADOOP-15177. Update the release year to 2018. Contributed by Bharat Viswanadham. 
(cherry picked from commit cdaf92c9f5)
(cherry picked from commit b0c9b89281)
 2018-01-18 13:17:42 +09:00
Jason Lowe 98835e14ae Revert "HADOOP-15027. AliyunOSS: Support multi-thread pre-read to improve sequential read from Hadoop to Aliyun OSS performance. (Contributed by Jinhu Wu)" 
This reverts commit 622f6b65d6.
 2018-01-17 09:59:31 -06:00
Vinayakumar B 62b82d7f41 HDFS-9049. Make Datanode Netty reverse proxy port to be configurable. Contributed by Vinayakumar B. 
(cherry picked from commit 09efdfe9e1)
(cherry picked from commit b3eeea0b6e)
 2018-01-17 14:23:33 +05:30
Sammi Chen 622f6b65d6 HADOOP-15027. AliyunOSS: Support multi-thread pre-read to improve sequential read from Hadoop to Aliyun OSS performance. (Contributed by Jinhu Wu) 
(cherry picked from commit 9195a6e302)
(cherry picked from commit 55142849db)
(cherry picked from commit 082a707bae)
(cherry picked from commit 896dc7c780)
 2018-01-17 16:37:25 +08:00
Brahma Reddy Battula 28f69755f1 HDFS-8693. refreshNamenodes does not support adding a new standby to a running DN. Contributed by Ajith S. 
(cherry picked from commit 880b9d24ff)
 2018-01-16 16:33:34 +05:30
Sunil G 4e28aa4dcf YARN-7727. Incorrect log levels in few logs with QueuePriorityContainerCandidateSelector. Contributed by Prabhu Joseph. 
(cherry picked from commit 128d773a23)
 2018-01-12 15:57:04 +05:30
Akira Ajisaka fff7f77c96
YARN-7735. Fix typo in YARN documentation. Contributed by Takanobu Asanuma. 
(cherry picked from commit fbbbf59c82)
(cherry picked from commit 68b7908aa8)
 2018-01-11 16:00:50 +09:00
Inigo Goiri 6dc0b885a4 HDFS-12802. RBF: Control MountTableResolver cache size. Contrubuted by Inigo Goiri. 
(cherry picked from commit d9006d8a4e)
 2018-01-09 19:02:45 -08:00
Haibo Chen 6602182a2b YARN-7716. metricsTimeStart and metricsTimeEnd should be all lower case in the doc. 
(cherry picked from commit f725b9e267)
(cherry picked from commit cf816bc751)
(cherry picked from commit a58034cdfd)
 2018-01-09 09:05:25 -08:00
Jason Lowe 3701c399b3 YARN-6948. Invalid event: ATTEMPT_ADDED at FINAL_SAVING. Contributed by lujie 
(cherry picked from commit 90c86d6e09)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java
 2018-01-09 11:00:10 -06:00
Jason Lowe 52097cf2f4 YARN-7663. RMAppImpl:Invalid event: START at KILLED. Contributed by lujie 
(cherry picked from commit d2c2d8c913)
 2018-01-09 10:04:16 -06:00
bibinchundatt 7ee994a536 YARN-7508. NPE in FiCaSchedulerApp when debug log enabled in async-scheduling mode. Contributed by Tao Yang. 
(cherry picked from commit b26e30ab16)
 2018-01-09 20:04:40 +05:30
Wei Yan 5e8029eff9 HDFS-12945. Switch to ClientProtocol instead of NamenodeProtocols in NamenodeWebHdfsMethods. Contributed by Wei Yan. 
(cherry picked from commit 2ee0d64ace)
 2018-01-08 15:13:53 -08:00
Steve Loughran a35267b47a HADOOP-15086. NativeAzureFileSystem file rename is not atomic. 
Contributed by Thomas Marquardt
(Backported to branch-2 via /HADOOP-15156)
 2018-01-08 15:12:41 +00:00
Rohith Sharma K S 8e0a5b1514 YARN-7699. queueUsagePercentage is coming as INF for getApp REST api call. Contributed by Sunil G. 
(cherry picked from commit 281350674c)
 2018-01-08 15:57:56 +05:30
Inigo Goiri c1d48cbda0 HDFS-12988. RBF: Mount table entries not properly updated in the local cache. Contributed by Inigo Goiri. 
(cherry picked from commit 83b513ac6d)
 2018-01-05 09:14:25 -08:00
Sunil G c4e0821d72 YARN-7619. Max AM Resource value in Capacity Scheduler UI has to be refreshed for every user. Contributed by Eric Payne. 
(cherry picked from commit a79abbc03e)
 2018-01-05 14:55:17 +05:30
Jason Lowe ea78313d55 YARN-7678. Ability to enable logging of container memory stats. Contributed by Jim Brennan 
(cherry picked from commit 42964c2a66)
 2018-01-04 10:22:54 -06:00
Tsz-Wo Nicholas Sze f3a92d89f3 HDFS-12347. TestBalancerRPCDelay#testBalancerRPCDelay fails very frequently. Contributed by Bharat Viswanadham 
(cherry picked from commit c7499f2d24)
 2018-01-04 06:48:04 +05:30
Jason Lowe a316a4cc47 MAPREDUCE-7028. Concurrent task progress updates causing NPE in Application Master. Contributed by Gergo Repas 
(cherry picked from commit fe35103591)
 2018-01-03 11:12:55 -06:00
Rohith Sharma K S 50f635ec73 YARN-7692. Skip validating priority acls while recovering applications. Contributed by Sunil G. 
(cherry picked from commit c9bf813c9a)
 2018-01-03 18:34:12 +05:30
Arun Suresh 7854745c5f YARN-7691. Add Unit Tests for ContainersLauncher. (Sampada Dehankar via asuresh) 
(cherry picked from commit c0c7cce81d)
 2018-01-02 22:04:57 -08:00
Xiao Chen e4df9ef10a HADOOP-15149. CryptoOutputStream should implement StreamCapabilities. 
(cherry picked from commit 81127616c5)
(cherry picked from commit 8c275c63ff)
(cherry picked from commit 9dee5c6779f12597c0d6134bb639876649da9cd3)
 2017-12-29 13:57:55 -08:00
John Zhuge a1334ea177 HADOOP-14872. CryptoInputStream should implement unbuffer. Contributed by John Zhuge. 
(cherry picked from commit 6c32ddad30)
(cherry picked from commit fc9e156484)
(cherry picked from commit 5e0f4f212d)
 2017-12-29 13:57:55 -08:00
Xiao Chen 141cc8ffa2 HADOOP-15056. Fix TestUnbuffer#testUnbufferException failure. Contributed by Jack Bearden. 
(cherry picked from commit 19e0894209)
(cherry picked from commit 1d1401ad38)
(cherry picked from commit 31436a12d5)
 2017-12-29 13:57:55 -08:00
Xiao Chen 52adaa43db HADOOP-15012. Add readahead, dropbehind, and unbuffer to StreamCapabilities. Contributed by John Zhuge. 
(cherry picked from commit c9d48352c2)
 2017-12-29 13:57:55 -08:00
Arun Suresh 41601363ca YARN-7542. Fix issue that causes some Running Opportunistic Containers to be recovered as PAUSED. (Sampada Dehankar via asuresh) 
(cherry picked from commit a55884c68e)
 2017-12-28 22:21:19 -08:00
Xiao Chen 947d484d35 HDFS-9023. When NN is not able to identify DN for replication, reason behind it can be logged. 
(cherry picked from commit 50b233d356)
 2017-12-28 11:56:12 -08:00
Yiqun Lin 06cfe4b11b HDFS-12937. RBF: Add more unit tests for router admin commands. Contributed by Yiqun Lin. 
(cherry picked from commit e040c97b77)
 2017-12-19 15:36:28 +08:00
Junping Du c6f5d36ff2 Add 2.8.3 release jdiff files. 
(cherry picked from commit c89f99aade)
 2017-12-18 22:38:26 -08:00
Junping Du 63ae39bc23 Add 2.8.3 Releasenotes and Changes. 
(cherry picked from commit 7bdd324028)
 2017-12-18 22:33:58 -08:00
Jason Lowe 6c20eeb76d YARN-7661. NodeManager metrics return wrong value after update node resource. Contributed by Yang Wang 
(cherry picked from commit 811fabdebe)
 2017-12-18 15:29:31 -06:00
Jason Lowe 7b447e261b HADOOP-15085. Output streams closed with IOUtils suppressing write errors. Contributed by Jim Brennan 
(cherry picked from commit 93fdc3d935)
 2017-12-15 17:18:32 -06:00
Jason Lowe 3929982ee6 YARN-7595. Container launching code suppresses close exceptions after writes. Contributed by Jim Brennan 
(cherry picked from commit 0f8de8cd91)
 2017-12-15 16:01:40 -06:00
Jason Lowe 605b8560f6 HDFS-12881. Output streams closed with IOUtils suppressing write errors. Contributed by Ajay Kumar 
(cherry picked from commit 9ae8d1a8de)
 2017-12-15 14:49:43 -06:00
Sammi Chen 6af3ea58c9 HADOOP-15111. Aliyun OSS: backport HADOOP-14993 to branch-2. Contributed by Genmao Yu. 
(cherry picked from commit 1fee447bf2)
 2017-12-15 14:45:32 +08:00
Yiqun Lin c629f33761 HDFS-12895. RBF: Add ACL support for mount table. Contributed by Yiqun Lin. 
(cherry picked from commit ee028bfdf1)
 2017-12-15 14:14:42 +08:00
Sammi Chen b2b9e0da6c HADOOP-15104. Aliyun OSS: change the default value of max error retry. Contributed by Jinhu Wu. 
(cherry picked from commit ce04340ec7)
(cherry picked from commit 27807e4ccb)
 2017-12-15 13:56:44 +08:00
Weiwei Yang 108f8b8fa1 YARN-7642. Add test case to verify context update after container promotion or demotion with or without auto update. Contributed by Weiwei Yang. 
(cherry picked from commit 89b6c482c1)
 2017-12-15 12:33:41 +08:00
Subru Krishnan 2b77729fdf YARN-7630. Fix AMRMToken rollover handling in AMRMProxy. Contributed by Botong Huang. 
(cherry picked from commit 17ba74be29)
(cherry picked from commit 8d3d7fa1c5)
 2017-12-14 14:11:07 -08:00
Kihwal Lee 43b9fbc2b4 HDFS-12907. Allow read-only access to reserved raw for non-superusers. Contributed by Rushabh S Shah. 
(cherry picked from commit 08a50da95f)
 2017-12-14 15:06:04 -06:00
Yiqun Lin 053a6fc126 HDFS-12883. RBF: Document Router and State Store metrics. Contributed by Yiqun Lin. 
(cherry picked from commit 91c96bdf8e)
 2017-12-14 16:04:31 +08:00
Surendra Singh Lilhore 4f0ae1b108 HDFS-12833. Distcp : Update the usage of delete option for dependency with update and overwrite option. Contributed by usharani. 
(cherry picked from commit 8d69b7f2d4)
 2017-12-13 10:50:01 +05:30
Weiwei Yang dff710632e YARN-7647. NM print inappropriate error log when node-labels is enabled. Contributed by Yang Wang. 2017-12-13 13:13:12 +08:00
Inigo Goiri 118d653eea HDFS-12875. RBF: Complete logic for -readonly option of dfsrouteradmin add command. Contributed by Inigo Goiri. 
(cherry picked from commit 5cd1056ad7)
 2017-12-11 15:17:49 -08:00
Weiwei Yang 98eb4b2c6b YARN-7608. Incorrect sTarget column causing DataTable warning on RM application and scheduler web page. Contributed by Gergely Novák. 2017-12-11 10:37:22 +08:00
Wangda Tan 524ecb19ef YARN-7591. NPE in async-scheduling mode of CapacityScheduler. (Tao Yang via wangda) 
Change-Id: I67e086d6d35c3166ec0f6305490ea6527bd6d799
(cherry picked from commit 41796ea60a)
(cherry picked from commit c27a5ba65c)
 2017-12-08 21:57:26 -08:00
Subru Krishnan 39d0fdf1b2 YARN-6704. Add support for work preserving NM restart when FederationInterceptor is enabled in AMRMProxyService. (Botong Huang via Subru). 
(cherry picked from commit 670e8d4ec7)
(cherry picked from commit 850bd0ed7c)
 2017-12-08 15:46:13 -08:00
Sammi Chen 4a064dd644 HADOOP-15024. AliyunOSS: Support user agent configuration and include that & Hadoop version information to oss server. 
(cherry picked from commit 94390fcd52)
 2017-12-08 22:37:17 +08:00