Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,210 Commits 326 Branches 371 Tags
Commit Graph

14210 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Inigo Goiri
8702882b54 HDFS-13028. RBF: Fix spurious TestRouterRpc#testProxyGetStats. Contributed by Inigo Goiri. 
(cherry picked from commit 130f8bce00e8cab59c3aa4d668e8bddd84544713)
(cherry picked from commit c6139332f9d55ce176701e63426b158060c97d38)
 2018-01-19 09:53:22 -08:00
Jitendra Pandey
dd1de1ea37 HADOOP-15143. NPE due to Invalid KerberosTicket in UGI. Contributed by Mukul Kumar Singh. 
(cherry picked from commit cb60c05c3aff762c39d7d81df9a7b6e071acb181)
 2018-01-18 20:18:19 -08:00
Miklos Szegedi
6e11ef7c44 YARN-7590. Improve container-executor validation check. Contributed by Eric Yang. 2018-01-17 22:18:08 -08:00
Brahma Reddy Battula
3cdc392150 HADOOP-15150. in FsShell, UGI params should be overidden through env vars(-D arg). Contributed by Brahma Reddy Battula. 
(cherry picked from commit 08332e12d055d85472f0c9371fefe9b56bfea1ed)
 2018-01-18 11:02:38 +05:30
Akira Ajisaka
c614a39e9f
HADOOP-15177. Update the release year to 2018. Contributed by Bharat Viswanadham. 
(cherry picked from commit cdaf92c9f57560219b8f915a19ad8603ddf2a505)
(cherry picked from commit b0c9b89281c9264c70ae79b1e4830e0fa2411b4f)
 2018-01-18 13:17:42 +09:00
Jason Lowe
98835e14ae Revert "HADOOP-15027. AliyunOSS: Support multi-thread pre-read to improve sequential read from Hadoop to Aliyun OSS performance. (Contributed by Jinhu Wu)" 
This reverts commit 622f6b65d684ce498a811784a229fb0386745711.
 2018-01-17 09:59:31 -06:00
Vinayakumar B
62b82d7f41 HDFS-9049. Make Datanode Netty reverse proxy port to be configurable. Contributed by Vinayakumar B. 
(cherry picked from commit 09efdfe9e13c9695867ce4034aa6ec970c2032f1)
(cherry picked from commit b3eeea0b6e27f9e74c35d2a930b541617fc7c8f2)
 2018-01-17 14:23:33 +05:30
Sammi Chen
622f6b65d6 HADOOP-15027. AliyunOSS: Support multi-thread pre-read to improve sequential read from Hadoop to Aliyun OSS performance. (Contributed by Jinhu Wu) 
(cherry picked from commit 9195a6e302028ed3921d1016ac2fa5754f06ebf0)
(cherry picked from commit 55142849db02a9191db0dd6f4e1401ff19ec242a)
(cherry picked from commit 082a707bae4bb97444a34c00eecd62975807388d)
(cherry picked from commit 896dc7c7801adaa4460fa6c19a4f452a6a6112d8)
 2018-01-17 16:37:25 +08:00
Brahma Reddy Battula
28f69755f1 HDFS-8693. refreshNamenodes does not support adding a new standby to a running DN. Contributed by Ajith S. 
(cherry picked from commit 880b9d24ff7b5f350ec99bac9b0862009460b486)
 2018-01-16 16:33:34 +05:30
Sunil G
4e28aa4dcf YARN-7727. Incorrect log levels in few logs with QueuePriorityContainerCandidateSelector. Contributed by Prabhu Joseph. 
(cherry picked from commit 128d773a2315fa6baaa3a52b13c53c77e741b69c)
 2018-01-12 15:57:04 +05:30
Akira Ajisaka
fff7f77c96
YARN-7735. Fix typo in YARN documentation. Contributed by Takanobu Asanuma. 
(cherry picked from commit fbbbf59c82658e18dad7e0e256613187b5b75d0f)
(cherry picked from commit 68b7908aa828a070534e7853df56e74ed281af7e)
 2018-01-11 16:00:50 +09:00
Inigo Goiri
6dc0b885a4 HDFS-12802. RBF: Control MountTableResolver cache size. Contrubuted by Inigo Goiri. 
(cherry picked from commit d9006d8a4e34eae78dfa1cf3be50eeb81c2fc11f)
 2018-01-09 19:02:45 -08:00
Haibo Chen
6602182a2b YARN-7716. metricsTimeStart and metricsTimeEnd should be all lower case in the doc. 
(cherry picked from commit f725b9e267c604fbcec09956e3a39caf04798809)
(cherry picked from commit cf816bc751e3b82be1f1931d6d0d5cbd77cb3e17)
(cherry picked from commit a58034cdfd592fa61a85c873b5249f9b6a3a825e)
 2018-01-09 09:05:25 -08:00
Jason Lowe
3701c399b3 YARN-6948. Invalid event: ATTEMPT_ADDED at FINAL_SAVING. Contributed by lujie 
(cherry picked from commit 90c86d6e090d668414681fcb5eb02add5d419b33)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java
 2018-01-09 11:00:10 -06:00
Jason Lowe
52097cf2f4 YARN-7663. RMAppImpl:Invalid event: START at KILLED. Contributed by lujie 
(cherry picked from commit d2c2d8c913dfc12585394a1168d4a92934a4cfb4)
 2018-01-09 10:04:16 -06:00
bibinchundatt
7ee994a536 YARN-7508. NPE in FiCaSchedulerApp when debug log enabled in async-scheduling mode. Contributed by Tao Yang. 
(cherry picked from commit b26e30ab1655a8cdf369862a5512db5c2a88ec46)
 2018-01-09 20:04:40 +05:30
Wei Yan
5e8029eff9 HDFS-12945. Switch to ClientProtocol instead of NamenodeProtocols in NamenodeWebHdfsMethods. Contributed by Wei Yan. 
(cherry picked from commit 2ee0d64aceed876f57f09eb9efe1872b6de98d2e)
 2018-01-08 15:13:53 -08:00
Steve Loughran
a35267b47a HADOOP-15086. NativeAzureFileSystem file rename is not atomic. 
Contributed by Thomas Marquardt
(Backported to branch-2 via /HADOOP-15156)
 2018-01-08 15:12:41 +00:00
Rohith Sharma K S
8e0a5b1514 YARN-7699. queueUsagePercentage is coming as INF for getApp REST api call. Contributed by Sunil G. 
(cherry picked from commit 281350674c70d65233363849a8b60e9b7dc965cf)
 2018-01-08 15:57:56 +05:30
Inigo Goiri
c1d48cbda0 HDFS-12988. RBF: Mount table entries not properly updated in the local cache. Contributed by Inigo Goiri. 
(cherry picked from commit 83b513ac6d5448f3771b0b95f91e7aa7961ae2cc)
 2018-01-05 09:14:25 -08:00
Sunil G
c4e0821d72 YARN-7619. Max AM Resource value in Capacity Scheduler UI has to be refreshed for every user. Contributed by Eric Payne. 
(cherry picked from commit a79abbc03e75a5d2982de12587bd3b45169cc884)
 2018-01-05 14:55:17 +05:30
Jason Lowe
ea78313d55 YARN-7678. Ability to enable logging of container memory stats. Contributed by Jim Brennan 
(cherry picked from commit 42964c2a66cfe6d7885c6231a2ec7dbde324eb67)
 2018-01-04 10:22:54 -06:00
Tsz-Wo Nicholas Sze
f3a92d89f3 HDFS-12347. TestBalancerRPCDelay#testBalancerRPCDelay fails very frequently. Contributed by Bharat Viswanadham 
(cherry picked from commit c7499f2d242c64bee8f822a22161d956525f7153)
 2018-01-04 06:48:04 +05:30
Jason Lowe
a316a4cc47 MAPREDUCE-7028. Concurrent task progress updates causing NPE in Application Master. Contributed by Gergo Repas 
(cherry picked from commit fe35103591ece0209f8345aba5544313e45a073c)
 2018-01-03 11:12:55 -06:00
Rohith Sharma K S
50f635ec73 YARN-7692. Skip validating priority acls while recovering applications. Contributed by Sunil G. 
(cherry picked from commit c9bf813c9a6c018d14f2bef49ba086ec0e60c761)
 2018-01-03 18:34:12 +05:30
Arun Suresh
7854745c5f YARN-7691. Add Unit Tests for ContainersLauncher. (Sampada Dehankar via asuresh) 
(cherry picked from commit c0c7cce81d5609f6347bff67929d5026d5893d75)
 2018-01-02 22:04:57 -08:00
Xiao Chen
e4df9ef10a HADOOP-15149. CryptoOutputStream should implement StreamCapabilities. 
(cherry picked from commit 81127616c571b7cd25686e60a1105f96ca0626b7)
(cherry picked from commit 8c275c63ffd06db2cde26cbadc6a2ce4195c7b43)
(cherry picked from commit 9dee5c6779f12597c0d6134bb639876649da9cd3)
 2017-12-29 13:57:55 -08:00
John Zhuge
a1334ea177 HADOOP-14872. CryptoInputStream should implement unbuffer. Contributed by John Zhuge. 
(cherry picked from commit 6c32ddad30240a251caaefdf7fec9ff8ad177a7c)
(cherry picked from commit fc9e156484824fcb59faef2b2914f3cb53901b87)
(cherry picked from commit 5e0f4f212d0a2889edb7a7efb030f539faa4a8b9)
 2017-12-29 13:57:55 -08:00
Xiao Chen
141cc8ffa2 HADOOP-15056. Fix TestUnbuffer#testUnbufferException failure. Contributed by Jack Bearden. 
(cherry picked from commit 19e089420999dd9d97d981dcd0abd64b6166152d)
(cherry picked from commit 1d1401ad3898834a740f4b9bfcea83d28635a3b6)
(cherry picked from commit 31436a12d5cd7c8d96414fcf37f9b8aebe497cd3)
 2017-12-29 13:57:55 -08:00
Xiao Chen
52adaa43db HADOOP-15012. Add readahead, dropbehind, and unbuffer to StreamCapabilities. Contributed by John Zhuge. 
(cherry picked from commit c9d48352c232ac9e031559cb99a18ff249d2b6c1)
 2017-12-29 13:57:55 -08:00
Arun Suresh
41601363ca YARN-7542. Fix issue that causes some Running Opportunistic Containers to be recovered as PAUSED. (Sampada Dehankar via asuresh) 
(cherry picked from commit a55884c68eb175f1c9f61771386c086bf1ee65a9)
 2017-12-28 22:21:19 -08:00
Xiao Chen
947d484d35 HDFS-9023. When NN is not able to identify DN for replication, reason behind it can be logged. 
(cherry picked from commit 50b233d35692d249d2115a2481cde770f50cf7a7)
 2017-12-28 11:56:12 -08:00
Yiqun Lin
06cfe4b11b HDFS-12937. RBF: Add more unit tests for router admin commands. Contributed by Yiqun Lin. 
(cherry picked from commit e040c97b7743469f363eeae52c8abcf4fe7c65d5)
 2017-12-19 15:36:28 +08:00
Junping Du
c6f5d36ff2 Add 2.8.3 release jdiff files. 
(cherry picked from commit c89f99aade575ab1f6a9836df719cda272293d90)
 2017-12-18 22:38:26 -08:00
Junping Du
63ae39bc23 Add 2.8.3 Releasenotes and Changes. 
(cherry picked from commit 7bdd324028a263cff51ce094107c6492f2b54869)
 2017-12-18 22:33:58 -08:00
Jason Lowe
6c20eeb76d YARN-7661. NodeManager metrics return wrong value after update node resource. Contributed by Yang Wang 
(cherry picked from commit 811fabdebe881248756c0165bf7667bfc22be9bb)
 2017-12-18 15:29:31 -06:00
Jason Lowe
7b447e261b HADOOP-15085. Output streams closed with IOUtils suppressing write errors. Contributed by Jim Brennan 
(cherry picked from commit 93fdc3d935cd940d5776cd923938b0bfabcd0dcd)
 2017-12-15 17:18:32 -06:00
Jason Lowe
3929982ee6 YARN-7595. Container launching code suppresses close exceptions after writes. Contributed by Jim Brennan 
(cherry picked from commit 0f8de8cd91f6f74774d399378ecf8cbafcbe8f09)
 2017-12-15 16:01:40 -06:00
Jason Lowe
605b8560f6 HDFS-12881. Output streams closed with IOUtils suppressing write errors. Contributed by Ajay Kumar 
(cherry picked from commit 9ae8d1a8de2ffbc8a0082a0089f477d4cefea030)
 2017-12-15 14:49:43 -06:00
Sammi Chen
6af3ea58c9 HADOOP-15111. Aliyun OSS: backport HADOOP-14993 to branch-2. Contributed by Genmao Yu. 
(cherry picked from commit 1fee447bf2d0cda914c3972d226552ae8f4926c0)
 2017-12-15 14:45:32 +08:00
Yiqun Lin
c629f33761 HDFS-12895. RBF: Add ACL support for mount table. Contributed by Yiqun Lin. 
(cherry picked from commit ee028bfdf1c88a27cd925bed93ebb599a164dd2e)
 2017-12-15 14:14:42 +08:00
Sammi Chen
b2b9e0da6c HADOOP-15104. Aliyun OSS: change the default value of max error retry. Contributed by Jinhu Wu. 
(cherry picked from commit ce04340ec73617daff74378056a95c5d0cc0a790)
(cherry picked from commit 27807e4ccb5601173d09caf82029f9ec37067b47)
 2017-12-15 13:56:44 +08:00
Weiwei Yang
108f8b8fa1 YARN-7642. Add test case to verify context update after container promotion or demotion with or without auto update. Contributed by Weiwei Yang. 
(cherry picked from commit 89b6c482c1720a7f7ac86ce022c403825a086fa0)
 2017-12-15 12:33:41 +08:00
Subru Krishnan
2b77729fdf YARN-7630. Fix AMRMToken rollover handling in AMRMProxy. Contributed by Botong Huang. 
(cherry picked from commit 17ba74be29193ac15474f73baaaf4e647a95078b)
(cherry picked from commit 8d3d7fa1c5fda4ec394b2f64baf1008e7b0d9524)
 2017-12-14 14:11:07 -08:00
Kihwal Lee
43b9fbc2b4 HDFS-12907. Allow read-only access to reserved raw for non-superusers. Contributed by Rushabh S Shah. 
(cherry picked from commit 08a50da95fd8509d87c6a3e5b46862b8eb6f7318)
 2017-12-14 15:06:04 -06:00
Yiqun Lin
053a6fc126 HDFS-12883. RBF: Document Router and State Store metrics. Contributed by Yiqun Lin. 
(cherry picked from commit 91c96bdf8eb9a06193b719186b527563091d7666)
 2017-12-14 16:04:31 +08:00
Surendra Singh Lilhore
4f0ae1b108 HDFS-12833. Distcp : Update the usage of delete option for dependency with update and overwrite option. Contributed by usharani. 
(cherry picked from commit 8d69b7f2d41e6a76c8c706ead21b1abe86592881)
 2017-12-13 10:50:01 +05:30
Weiwei Yang
dff710632e YARN-7647. NM print inappropriate error log when node-labels is enabled. Contributed by Yang Wang. 2017-12-13 13:13:12 +08:00
Inigo Goiri
118d653eea HDFS-12875. RBF: Complete logic for -readonly option of dfsrouteradmin add command. Contributed by Inigo Goiri. 
(cherry picked from commit 5cd1056ad77a2ebb0466e7bc5933337b57f6fe30)
 2017-12-11 15:17:49 -08:00
Weiwei Yang
98eb4b2c6b YARN-7608. Incorrect sTarget column causing DataTable warning on RM application and scheduler web page. Contributed by Gergely Novák. 2017-12-11 10:37:22 +08:00