Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,208 Commits 326 Branches 371 Tags
Commit Graph

17208 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Wei Yan
cbecf554c9 HDFS-12945. Switch to ClientProtocol instead of NamenodeProtocols in NamenodeWebHdfsMethods. Contributed by Wei Yan. 
(cherry picked from commit 2ee0d64aceed876f57f09eb9efe1872b6de98d2e)
 2018-01-08 14:56:22 -08:00
Rohith Sharma K S
281350674c YARN-7699. queueUsagePercentage is coming as INF for getApp REST api call. Contributed by Sunil G. 2018-01-08 15:52:03 +05:30
Inigo Goiri
53a7bd186d HDFS-12988. RBF: Mount table entries not properly updated in the local cache. Contributed by Inigo Goiri. 
(cherry picked from commit 83b513ac6d5448f3771b0b95f91e7aa7961ae2cc)
 2018-01-05 09:12:43 -08:00
Sunil G
a79abbc03e YARN-7619. Max AM Resource value in Capacity Scheduler UI has to be refreshed for every user. Contributed by Eric Payne. 2018-01-05 14:50:17 +05:30
Lei Xu
47773d68b2 HDFS-12860. StripedBlockUtil#getRangesInternalBlocks throws exception for the block group size larger than 2GB. (Contributed by Lei (Eddy) Xu) 
(cherry picked from commit 85067eaa8e352afeed9c094da3815100873c84e4)
 2018-01-04 10:33:34 -08:00
Jason Lowe
c155d8e756 YARN-7678. Ability to enable logging of container memory stats. Contributed by Jim Brennan 
(cherry picked from commit d795661868e330ac55d6ac7b0ee62fb658e03ff7)
 2018-01-04 10:18:32 -06:00
Sean Mackrory
91b59b7c28 HDFS-12913. TestDNFencingWithReplication sometimes fails because of NameNode in standby state. Contributed by Zsolt Venczel. 
(cherry picked from commit 45a47198b43a96817679d5bf9e570d405555e3eb)
 2018-01-04 08:47:02 -07:00
Haibo Chen
889bebf8bb YARN-7602. NM should reference the singleton JvmMetrics instance. 
(cherry picked from commit 2f6c038be6c23522ea64fc4e415910fb72493eb2)
 2018-01-03 09:44:33 -08:00
Jason Lowe
2a870d91fe MAPREDUCE-7028. Concurrent task progress updates causing NPE in Application Master. Contributed by Gergo Repas 
(cherry picked from commit fe35103591ece0209f8345aba5544313e45a073c)
 2018-01-03 11:03:16 -06:00
Rohith Sharma K S
2c67985bd2 YARN-7692. Skip validating priority acls while recovering applications. Contributed by Sunil G. 
(cherry picked from commit c9bf813c9a6c018d14f2bef49ba086ec0e60c761)
 2018-01-03 18:21:47 +05:30
Arun Suresh
829917e9ba YARN-7691. Add Unit Tests for ContainersLauncher. (Sampada Dehankar via asuresh) 
(cherry picked from commit c0c7cce81d5609f6347bff67929d5026d5893d75)
 2018-01-02 22:03:56 -08:00
Miklos Szegedi
c3cff8eac6 HADOOP-15122. Lock down version of doxia-module-markdown plugin. Contributed by Marton Elek. 
(cherry picked from commit 4bb765ee2e9fa16bb18c70d8f62ab885d883f414)
 2017-12-29 17:53:32 -08:00
Xiao Chen
8c275c63ff HADOOP-15149. CryptoOutputStream should implement StreamCapabilities. 
(cherry picked from commit 81127616c571b7cd25686e60a1105f96ca0626b7)
 2017-12-29 13:41:43 -08:00
Lei Xu
8f9603cb9d HDFS-12915. Fix findbugs warning in INodeFile$HeaderFormat.getBlockLayoutRedundancy. (Contributed by Chris Douglas) 
(cherry picked from commit 6e3e1b8cde737e4c03b0f5279cab0239e7069a72)
 2017-12-29 12:23:33 -08:00
Arun Suresh
bd4dcc7772 YARN-7542. Fix issue that causes some Running Opportunistic Containers to be recovered as PAUSED. (Sampada Dehankar via asuresh) 
(cherry picked from commit a55884c68eb175f1c9f61771386c086bf1ee65a9)
 2017-12-28 22:21:52 -08:00
Xiao Chen
b7701495f4 HDFS-9023. When NN is not able to identify DN for replication, reason behind it can be logged. 
(cherry picked from commit 5bf7e594d7d54e5295fe4240c3d60c08d4755ab7)
 2017-12-28 11:55:14 -08:00
Steve Loughran
72a49503fe HADOOP-15086. NativeAzureFileSystem file rename is not atomic. 
Contributed by Thomas Marquardt

(cherry picked from commit 52babbb4a0e3c89f2025bf6e9a1b51a96e8f8fb0)
 2017-12-22 14:31:20 +00:00
Steve Loughran
11f577f3e6 HADOOP-14965. S3a input stream "normal" fadvise mode to be adaptive 
(cherry picked from commit 1ba491ff907fc5d2618add980734a3534e2be098)
 2017-12-22 11:41:45 +00:00
Lei Xu
2fbfaac6c0 HDFS-12938. TestErasureCodigCLI testAll failing consistently. (Contributed by Ajay Kumar) 
(cherry picked from commit b318bed01affa150d70661f263efff9a5c9422f6)
 2017-12-21 10:30:40 -08:00
Rohith Sharma K S
7d42433f37 YARN-7674. Update Timeline Reader web app address in UI2. Contributed by Sunil G. 
(cherry picked from commit 13ad7479b0e35a2c2d398e28c676871d9e672dc3)
 2017-12-20 22:29:23 +05:30
Sunil G
2026817a75 YARN-7032. [ATSv2] NPE while starting hbase co-processor when HBase authorization is enabled. Contributed by Rohith Sharma K S. 
(cherry picked from commit d62932c3b2fcacc81dc1f5048cdeb60fb0d38504)
 2017-12-20 11:33:12 +05:30
Eric Yang
62c3801af0 YARN-7466. addendum patch for failing unit test. (Contributed by Chandni Singh) 2017-12-19 19:56:40 -05:00
Arpit Agarwal
d85576aefd HDFS-12845. JournalNode Test failures. Contributed by Bharat Viswanadham. 2017-12-19 14:12:25 -08:00
Varun Saxena
f92ea68367 YARN-7662. [ATSv2] Define new set of configurations for reader and collectors to bind (Rohith Sharma K S via Varun Saxena) 
(cherry picked from commit c0aeb666a4d43aac196569d9ec6768d62139d2b9)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml
 2017-12-19 22:41:52 +05:30
Yiqun Lin
f7b3950f27 HDFS-12937. RBF: Add more unit tests for router admin commands. Contributed by Yiqun Lin. 
(cherry picked from commit e040c97b7743469f363eeae52c8abcf4fe7c65d5)
 2017-12-19 15:34:01 +08:00
Junping Du
53b9d81f46 Add 2.8.3 release jdiff files. 
(cherry picked from commit c89f99aade575ab1f6a9836df719cda272293d90)
 2017-12-18 22:40:04 -08:00
Yiqun Lin
a56f4c2ca7 HDFS-12930. Remove the extra space in HdfsImageViewer.md. Contributed by Rahul Pathak. 
(cherry picked from commit 25a36b74528678f56c63be643c76d819d6f07840)
 2017-12-19 11:25:01 +08:00
Jason Lowe
f3c10beb16 YARN-7661. NodeManager metrics return wrong value after update node resource. Contributed by Yang Wang 
(cherry picked from commit 811fabdebe881248756c0165bf7667bfc22be9bb)
 2017-12-18 15:23:58 -06:00
Erik Krogen
7c648d3e72 HDFS-12818. Support multiple storages in DataNodeCluster / SimulatedFSDataset. Contributed by Erik Krogen. 
(cherry picked from commit 94576b17fbc19c440efafb6c3322f53ec78a5b55)
 2017-12-18 11:41:06 -08:00
Steve Loughran
f61edab1d0 HADOOP-15123. KDiag tries to load krb5.conf from KRB5CCNAME instead of KRB5_CONFIG. 
Contributed by Vipin Rathor.

(cherry picked from commit 1ef906e29e0989aafcb35c51ad2acbb262b3c8e7)
 2017-12-18 18:49:41 +00:00
Akira Ajisaka
01dd11d977
YARN-7664. Several javadoc errors. Contributed by Sean Mackrory. 2017-12-18 22:52:39 +09:00
Weiwei Yang
de2156dc90 YARN-7617. Add a flag in distributed shell to automatically PROMOTE opportunistic containers to guaranteed once they are started. Contributed by Weiwei Yang. 
(cherry picked from commit 928964102029e96406f5482e8900802f38164501)
 2017-12-18 10:27:17 +08:00
Wangda Tan
90636cf127 YARN-7629. TestContainerLaunch# fails after YARN-7381. (Jason Lowe via wangda) 
Change-Id: Ia6a3f05c9a7e797d8190123d304ecc4e2b018e33
(cherry picked from commit 44825f096068dfc17fe4dcfb7db3d775b08fa7a0)
 2017-12-15 15:45:35 -08:00
Wangda Tan
c3e6ab8c89 YARN-5418. When partial log aggregation is enabled, display the list of aggregated files on the container log page. (Xuan Gong via wangda) 
Change-Id: I1befb0bbaeb89fb315bafe3e2f3379663f8cf1ec
(cherry picked from commit 631b5c2db733b0733a779e843b8035f68d0fcdf3)
 2017-12-15 15:45:28 -08:00
Lei Xu
0191a862a3 HDFS-12927. Update erasure coding doc to address unsupported APIs. (Contributed by Lei (Eddy) Xu) 
(cherry picked from commit 949be14b0881186d76c3b60ee2f39ce67dc1654c)
 2017-12-15 10:29:08 -08:00
Lei Xu
2821edf6d0 HDFS-12819. Setting/Unsetting EC policy shows warning if the directory is not empty. (Contributed by Lei (Eddy) Xu) 
(cherry picked from commit 1c15b1751c0698bd3063d5c25f556d4821b161d2)
 2017-12-15 10:06:00 -08:00
Rohith Sharma K S
53033c69f3 YARN-7190. Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath. Contributed by Varun Saxena. 
(cherry picked from commit 09d996fdd429a85822a06ab87f0e2322d0d7ca68)
 2017-12-15 22:17:43 +05:30
Yiqun Lin
61e16bff63 HDFS-12895. RBF: Add ACL support for mount table. Contributed by Yiqun Lin. 
(cherry picked from commit ee028bfdf1c88a27cd925bed93ebb599a164dd2e)
 2017-12-15 14:12:00 +08:00
Weiwei Yang
1011bfd220 YARN-7642. Add test case to verify context update after container promotion or demotion with or without auto update. Contributed by Weiwei Yang. 
(cherry picked from commit 89b6c482c1720a7f7ac86ce022c403825a086fa0)
 2017-12-15 12:55:03 +08:00
Xiao Chen
cb2c5e1707 HDFS-12910. Secure Datanode Starter should log the port when it fails to bind. Contributed by Stephen O'Donnell and Nanda kumar. 
(cherry picked from commit e1cb278cd0287ce47f923941147d17540b199a99)
 2017-12-14 19:23:18 -08:00
Kihwal Lee
52c36d6d4d HDFS-12907. Allow read-only access to reserved raw for non-superusers. Contributed by Rushabh S Shah. 
(cherry picked from commit f5a72424c0009c454aab6759c30f74b397a7e935)
 2017-12-14 15:00:27 -06:00
Jason Lowe
6e253c0391 HADOOP-15085. Output streams closed with IOUtils suppressing write errors. Contributed by Jim Brennan 
(cherry picked from commit f8af0e2feb9f45aeaa9711dbf93115ffb1a07e5d)
 2017-12-14 10:19:07 -06:00
Jason Lowe
c661f30a78 HDFS-12881. Output streams closed with IOUtils suppressing write errors. Contributed by Ajay Kumar 
(cherry picked from commit 80db744ee57c52a1dc306c576c663ccc76cced4c)
 2017-12-14 09:53:56 -06:00
Sunil G
9ee1649cec YARN-7119. Support multiple resource types in rmadmin updateNodeResource command. Contributed by Manikandan R. 
(cherry picked from commit 2564b4d07f63de142fe1909d61904831c108667c)
 2017-12-14 16:12:43 +05:30
Yiqun Lin
925f3e62db HDFS-12883. RBF: Document Router and State Store metrics. Contributed by Yiqun Lin. 
(cherry picked from commit 91c96bdf8eb9a06193b719186b527563091d7666)
 2017-12-14 16:02:37 +08:00
Andrew Wang
58225e4030 Update CHANGES, RELEASENOTES, jdiff for 3.0.0 release. 
(cherry picked from commit d447152d4925a5f84d28a8ebd561286b39134d75)
 2017-12-13 13:05:45 -08:00
Sunil G
6d814ae068 YARN-7383. Node resource is not parsed correctly for resource names containing dot. Contributed by Gergely Novák. 
(cherry picked from commit 10fc8d2a7dc975ce70de63f88a2674389314f197)
 2017-12-13 22:01:28 +05:30
Weiwei Yang
415c69b36f YARN-7647. NM print inappropriate error log when node-labels is enabled. Contributed by Yang Wang. 2017-12-13 13:18:54 +08:00
Jason Lowe
472c7edc62 YARN-7595. Container launching code suppresses close exceptions after writes. Contributed by Jim Brennan 
(cherry picked from commit 2abab1d7c53e64c160384fd5a3ac4cd8ffa57af4)
 2017-12-12 16:07:47 -06:00
Wei-Chiu Chuang
8062a7428d HDFS-12891. Do not invalidate blocks if toInvalidate is empty. Contributed by Zsolt Venczel. 
(cherry picked from commit 55fc2d6485702a99c6d4bb261a720d1f0498af2b)
 2017-12-11 16:43:42 -08:00