Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,090 Commits 326 Branches 371 Tags
Commit Graph

17090 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Akira Ajisaka
24ac7c6e79
Revert "HADOOP-13514. Upgrade maven surefire plugin to 2.19.1." 
This reverts commit 372997f3954e97200220ebb3117eed4a175f101c.
 2017-10-13 18:01:50 +09:00
Chris Trezzo
24b03eb79f MAPREDUCE-5951. Add support for the YARN Shared Cache. 
(cherry picked from commit e46d5bb962b0c942f993afc505b165b1cd96e51b)
 2017-10-12 11:15:46 -07:00
Carlo Curino
97b7d39a5f YARN-7317. Fix overallocation resulted from ceiling in LocalityMulticastAMRMProxyPolicy. (contributed by Botong Huang via curino) 
(cherry picked from commit 13fcfb3d46ee7a0d606b4bb221d1cd66ef2a5a7c)
 2017-10-12 10:40:44 -07:00
Anu Engineer
beb54e5279 HADOOP-13102. Update GroupsMapping documentation to reflect the new changes. Contributed by Esther Kundin. 
(cherry picked from commit 075358eb6fff5ae4a40ac4dfde292e2a9a4ceddf)
 2017-10-11 16:24:08 -07:00
Arun Suresh
52844ec0a1 HADOOP-13556. Change Configuration.getPropsWithPrefix to use getProps instead of iterator. (Larry McCay via asuresh) 
(cherry picked from commit b6c2c9058e83116dcca46cd6934db3428f931347)
 2017-10-11 15:22:18 -07:00
Arpit Agarwal
0a673f1539 HDFS-12599. Remove Mockito dependency from DataNodeTestUtils. Contributed by Ted Yu. 
(cherry picked from commit 09ad848b6484c4d36b2d59903f9ec370fdb18d3e)
 2017-10-11 15:31:39 -05:00
Jason Lowe
44f8b2a630 YARN-7082. TestContainerManagerSecurity failing in trunk. Contributed by Akira Ajisaka 
(cherry picked from commit ebb34c7053ee93296412591f83a776846765fda5)
 2017-10-11 10:32:23 -05:00
Kai Zheng
8947c0b881 HDFS-12635. Unnecessary exception declaration of the CellBuffers constructor. Contributed by Huafeng Wang 2017-10-11 15:47:00 +08:00
Akira Ajisaka
372997f395
HADOOP-13514. Upgrade maven surefire plugin to 2.19.1. 
(cherry picked from commit 3d04c00aed63ca49420210f5f34efe39897aae63)
 2017-10-11 10:44:29 +09:00
Andrew Wang
a26da9dcf2 HDFS-12547. Extend TestQuotaWithStripedBlocks with a random EC policy. Contributed by Takanobu Asanuma. 
(cherry picked from commit a297fb08866305860dc17813c3db5701e9515101)
 2017-10-10 17:35:56 -07:00
Jason Lowe
c0d56cad5c HADOOP-14912. FairCallQueue may defer servicing calls. Contributed by Daryn Sharp 
(cherry picked from commit 1123f8f0b62292197f5433cd40e66d8620044608)
 2017-10-10 14:49:15 -05:00
Andrew Wang
61ac7c82f2 HADOOP-14939. Update project release notes with HDFS-10467 for 3.0.0. Contributed by Inigo Goiri. 
(cherry picked from commit 132cdac0ddb5c38205a96579a23b55689ea5a8e3)
 2017-10-10 10:16:39 -07:00
Andrew Wang
f1cfb2a8dc Revert "HDFS-12603. Enable async edit logging by default." 
This reverts commit e9f3f49b6dabca540ce48a633c1767fbdb49b6da.
 2017-10-09 17:54:19 -07:00
Xuan
fa676ba06b Merge branch 'YARN-5734-branch-3.0' into branch-3.0. (xgong) 2017-10-09 15:00:48 -07:00
Jonathan Hung
043a217017 YARN-7252. Removing queue then failing over results in exception 2017-10-09 14:54:57 -07:00
Jonathan Hung
168a3df8e6 YARN-7251. Misc changes to YARN-5734 2017-10-09 14:54:57 -07:00
Jonathan Hung
d35f544020 YARN-7238. Documentation for API based scheduler configuration management 2017-10-09 14:54:56 -07:00
Jonathan Hung
5105bc4721 YARN-7046. Add closing logic to configuration store 2017-10-09 14:54:56 -07:00
Wangda Tan
e6827a9121 YARN-6840. Implement zookeeper based store for scheduler configuration updates. (Jonathan Hung via wangda) 
Change-Id: I9debea674fe8c7e4109d4ca136965a1ea4c48bcc
 2017-10-09 14:54:56 -07:00
Xuan
4bf38062a5 YARN-7024: Fix issues on recovery in LevelDB store. Contributed by Jonathan Hung 2017-10-09 14:54:56 -07:00
Xuan
0b546420da YARN-6322: Disable queue refresh when configuration mutation is enabled. Contributed by Jonathan Hung 2017-10-09 14:54:55 -07:00
Xuan
793476e4b7 YARN-5947: Create LeveldbConfigurationStore class using Leveldb as backing store. Contributed by Jonathan Hung 2017-10-09 14:54:55 -07:00
Xuan
09b7c8766e YARN-5953 addendum: Move QueueConfigInfo and SchedConfUpdateInfo to package org.apache.hadoop.yarn.webapp.dao 2017-10-09 14:54:54 -07:00
Xuan
e09f0d64ac YARN-5953:Create CLI for changing YARN configurations. (Jonathan Hung via xgong) 2017-10-09 14:54:54 -07:00
Xuan
3f29c1585b YARN-6575. Support global configuration mutation in MutableConfProvider. (Jonathan Hung via Xuan Gong) 2017-10-09 14:54:54 -07:00
Wangda Tan
5fd1668a27 YARN-5949. Add pluggable configuration ACL policy interface and implementation. (Jonathan Hung via wangda) 
Change-Id: Ib98e82ff753bede21fcab2e6ca9ec1e7a5a2008f
 2017-10-09 14:54:53 -07:00
Wangda Tan
d1514bacd1 YARN-5952. Create REST API for changing YARN scheduler configurations. (Jonathan Hung via wangda) 2017-10-09 14:54:53 -07:00
Jonathan Hung
28754646e5 YARN-5948. Implement MutableConfigurationManager for handling storage into configuration store 2017-10-09 14:54:53 -07:00
Xuan
c4c2feeccf YARN-5946: Create YarnConfigurationStore interface and 
InMemoryConfigurationStore class. Contributed by Jonathan Hung
 2017-10-09 14:54:52 -07:00
Jonathan Hung
72169a0281 YARN-5951. Changes to allow CapacityScheduler to use configuration store 2017-10-09 14:54:52 -07:00
Andrew Wang
1d11701e55 HDFS-12541. Extend TestSafeModeWithStripedFile with a random EC policy. Contributed by Takanobu Asanuma. 
(cherry picked from commit 793820823325e390bb671f4cc1b3bc6920bba5de)
 2017-10-09 13:03:39 -07:00
Andrew Wang
e9f3f49b6d HDFS-12603. Enable async edit logging by default. 
(cherry picked from commit afb42aeabf1317b755ab79e0265bc90920c896ac)
 2017-10-09 11:20:04 -07:00
Lei Xu
015eb628b8 HDFS-12606. When using native decoder, DFSStripedStream.close crashes JVM after being called multiple times. (Lei (Eddy) Xu) 
(cherry picked from commit 46644319e1b3295ddbc7597c060956bf46487d11)
 2017-10-09 10:09:49 -07:00
Daniel Templeton
bec03f7060 YARN-2612 addendum: fixed javadoc error. 
(cherry picked from commit 6d6ca4c923142a893870fc8a6309c02f60dc2d24)
 2017-10-09 14:15:52 +02:00
Sunil G
84e2e2a6f6 YARN-7245. Max AM Resource column in Active Users Info section of Capacity Scheduler UI page should be updated per-user. Contributed by Eric Payne. 
(cherry picked from commit 8137254a1f4367974bf1883f1982e31ab2865107)
 2017-10-09 14:40:44 +05:30
John Zhuge
7dfe97d84f HDFS-12494. libhdfs SIGSEGV in setTLSExceptionStrings. Contributed by John Zhuge. 
(cherry picked from commit 2856eb207bfb206f22a6266f42cad0257083ab94)
 2017-10-07 00:09:36 -07:00
Inigo Goiri
ae9f82c603 HDFS-12577. Rename Router tooling. Contributed by Inigo Goiri. 
(cherry picked from commit 53e8d0d030525e4c7f3875e23807c6dbe778890f)
 2017-10-06 19:04:47 -07:00
Inigo Goiri
87b1f87094 HDFS-12273. Federation UI. Contributed by Inigo Goiri. 
(cherry picked from commit adbb2e00c7b85524fd43bd68895d49814c16680a)
 2017-10-06 19:04:46 -07:00
Inigo Goiri
c85b4ba028 HDFS-12580. Rebasing HDFS-10467 after HDFS-12447. Contributed by Inigo Goiri. 
(cherry picked from commit b12440d3479f19138bc66ea59baf41eb89061906)
 2017-10-06 19:04:46 -07:00
Inigo Goiri
3c621636e0 HDFS-12381. [Documentation] Adding configuration keys for the Router. Contributed by Inigo Goiri. 
(cherry picked from commit c2d6aa79055ef72406fa598e1c743b0c994b5da8)
 2017-10-06 19:04:45 -07:00
Inigo Goiri
43616f8531 HDFS-12450. Fixing TestNamenodeHeartbeat and support non-HA. Contributed by Inigo Goiri. 
(cherry picked from commit 928d1e87f9dbe64f89b858ccc1780723f3af58e7)
 2017-10-06 19:04:45 -07:00
Inigo Goiri
73d3ea8012 HDFS-12430. Rebasing HDFS-10467 After HDFS-12269 and HDFS-12218. Contributed by Inigo Goiri. 
(cherry picked from commit 3302e792d469b7e8f3bfa10151e4e1c546589734)
 2017-10-06 19:04:45 -07:00
Inigo Goiri
e6e7143545 HDFS-12335. Federation Metrics. Contributed by Inigo Goiri. 
(cherry picked from commit 3b19e77752afce87936f5c0d1e6d272fba798d7b)
 2017-10-06 19:04:44 -07:00
Inigo Goiri
e8b511ca33 HDFS-12384. Fixing compilation issue with BanDuplicateClasses. Contributed by Inigo Goiri. 
(cherry picked from commit fabe02c8fafa807198054da0c02b2ebaafda76aa)
 2017-10-06 19:04:44 -07:00
Inigo Goiri
ad48e844fa HDFS-10631. Federation State Store ZooKeeper implementation. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 23c4ddee11ab1300325a6361124ee8ad6f68d7a4)
 2017-10-06 19:04:44 -07:00
Inigo Goiri
503849477a HDFS-12312. Rebasing HDFS-10467 (2). Contributed by Inigo Goiri. 
(cherry picked from commit 90ba6843fb3ac5dc7576535e66a75a5e3433247b)
 2017-10-06 19:04:43 -07:00
Inigo Goiri
24d275842f HDFS-11554. [Documentation] Router-based federation documentation. Contributed by Inigo Goiri. 
(cherry picked from commit ee3260211d94aed223dd6f2386a166eb2c7d67af)
 2017-10-06 19:04:43 -07:00
Inigo Goiri
54a355dc8d HDFS-10646. Federation admin tool. Contributed by Inigo Goiri. 
(cherry picked from commit ae27e31fbcf546481db0b0345772db2e9132372e)
 2017-10-06 19:04:43 -07:00
Inigo Goiri
a0cce0fa0b HDFS-10880. Federation Mount Table State Store internal API. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 58b97df661441150d35abd44b3a8606206b46441)
 2017-10-06 19:04:42 -07:00
Inigo Goiri
c0fb7b283e HDFS-11826. Federation Namenode Heartbeat. Contributed by Inigo Goiri. 
(cherry picked from commit 928f8dab52191e733984d37f47b69719ccf11313)
 2017-10-06 19:04:41 -07:00