Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
16,881 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

16881 Commits

Author SHA1 Message Date
Andrew Wang a26da9dcf2 HDFS-12547. Extend TestQuotaWithStripedBlocks with a random EC policy. Contributed by Takanobu Asanuma. 
(cherry picked from commit a297fb0886)
 2017-10-10 17:35:56 -07:00
Jason Lowe c0d56cad5c HADOOP-14912. FairCallQueue may defer servicing calls. Contributed by Daryn Sharp 
(cherry picked from commit 1123f8f0b6)
 2017-10-10 14:49:15 -05:00
Andrew Wang 61ac7c82f2 HADOOP-14939. Update project release notes with HDFS-10467 for 3.0.0. Contributed by Inigo Goiri. 
(cherry picked from commit 132cdac0dd)
 2017-10-10 10:16:39 -07:00
Andrew Wang f1cfb2a8dc Revert "HDFS-12603. Enable async edit logging by default." 
This reverts commit e9f3f49b6d.
 2017-10-09 17:54:19 -07:00
Xuan fa676ba06b Merge branch 'YARN-5734-branch-3.0' into branch-3.0. (xgong) 2017-10-09 15:00:48 -07:00
Jonathan Hung 043a217017 YARN-7252. Removing queue then failing over results in exception 2017-10-09 14:54:57 -07:00
Jonathan Hung 168a3df8e6 YARN-7251. Misc changes to YARN-5734 2017-10-09 14:54:57 -07:00
Jonathan Hung d35f544020 YARN-7238. Documentation for API based scheduler configuration management 2017-10-09 14:54:56 -07:00
Jonathan Hung 5105bc4721 YARN-7046. Add closing logic to configuration store 2017-10-09 14:54:56 -07:00
Wangda Tan e6827a9121 YARN-6840. Implement zookeeper based store for scheduler configuration updates. (Jonathan Hung via wangda) 
Change-Id: I9debea674fe8c7e4109d4ca136965a1ea4c48bcc
 2017-10-09 14:54:56 -07:00
Xuan 4bf38062a5 YARN-7024: Fix issues on recovery in LevelDB store. Contributed by Jonathan Hung 2017-10-09 14:54:56 -07:00
Xuan 0b546420da YARN-6322: Disable queue refresh when configuration mutation is enabled. Contributed by Jonathan Hung 2017-10-09 14:54:55 -07:00
Xuan 793476e4b7 YARN-5947: Create LeveldbConfigurationStore class using Leveldb as backing store. Contributed by Jonathan Hung 2017-10-09 14:54:55 -07:00
Xuan 09b7c8766e YARN-5953 addendum: Move QueueConfigInfo and SchedConfUpdateInfo to package org.apache.hadoop.yarn.webapp.dao 2017-10-09 14:54:54 -07:00
Xuan e09f0d64ac YARN-5953:Create CLI for changing YARN configurations. (Jonathan Hung via xgong) 2017-10-09 14:54:54 -07:00
Xuan 3f29c1585b YARN-6575. Support global configuration mutation in MutableConfProvider. (Jonathan Hung via Xuan Gong) 2017-10-09 14:54:54 -07:00
Wangda Tan 5fd1668a27 YARN-5949. Add pluggable configuration ACL policy interface and implementation. (Jonathan Hung via wangda) 
Change-Id: Ib98e82ff753bede21fcab2e6ca9ec1e7a5a2008f
 2017-10-09 14:54:53 -07:00
Wangda Tan d1514bacd1 YARN-5952. Create REST API for changing YARN scheduler configurations. (Jonathan Hung via wangda) 2017-10-09 14:54:53 -07:00
Jonathan Hung 28754646e5 YARN-5948. Implement MutableConfigurationManager for handling storage into configuration store 2017-10-09 14:54:53 -07:00
Xuan c4c2feeccf YARN-5946: Create YarnConfigurationStore interface and 
InMemoryConfigurationStore class. Contributed by Jonathan Hung
 2017-10-09 14:54:52 -07:00
Jonathan Hung 72169a0281 YARN-5951. Changes to allow CapacityScheduler to use configuration store 2017-10-09 14:54:52 -07:00
Andrew Wang 1d11701e55 HDFS-12541. Extend TestSafeModeWithStripedFile with a random EC policy. Contributed by Takanobu Asanuma. 
(cherry picked from commit 7938208233)
 2017-10-09 13:03:39 -07:00
Andrew Wang e9f3f49b6d HDFS-12603. Enable async edit logging by default. 
(cherry picked from commit afb42aeabf)
 2017-10-09 11:20:04 -07:00
Lei Xu 015eb628b8 HDFS-12606. When using native decoder, DFSStripedStream.close crashes JVM after being called multiple times. (Lei (Eddy) Xu) 
(cherry picked from commit 46644319e1)
 2017-10-09 10:09:49 -07:00
Daniel Templeton bec03f7060 YARN-2612 addendum: fixed javadoc error. 
(cherry picked from commit 6d6ca4c923)
 2017-10-09 14:15:52 +02:00
Sunil G 84e2e2a6f6 YARN-7245. Max AM Resource column in Active Users Info section of Capacity Scheduler UI page should be updated per-user. Contributed by Eric Payne. 
(cherry picked from commit 8137254a1f)
 2017-10-09 14:40:44 +05:30
John Zhuge 7dfe97d84f HDFS-12494. libhdfs SIGSEGV in setTLSExceptionStrings. Contributed by John Zhuge. 
(cherry picked from commit 2856eb207b)
 2017-10-07 00:09:36 -07:00
Inigo Goiri ae9f82c603 HDFS-12577. Rename Router tooling. Contributed by Inigo Goiri. 
(cherry picked from commit 53e8d0d030)
 2017-10-06 19:04:47 -07:00
Inigo Goiri 87b1f87094 HDFS-12273. Federation UI. Contributed by Inigo Goiri. 
(cherry picked from commit adbb2e00c7)
 2017-10-06 19:04:46 -07:00
Inigo Goiri c85b4ba028 HDFS-12580. Rebasing HDFS-10467 after HDFS-12447. Contributed by Inigo Goiri. 
(cherry picked from commit b12440d347)
 2017-10-06 19:04:46 -07:00
Inigo Goiri 3c621636e0 HDFS-12381. [Documentation] Adding configuration keys for the Router. Contributed by Inigo Goiri. 
(cherry picked from commit c2d6aa7905)
 2017-10-06 19:04:45 -07:00
Inigo Goiri 43616f8531 HDFS-12450. Fixing TestNamenodeHeartbeat and support non-HA. Contributed by Inigo Goiri. 
(cherry picked from commit 928d1e87f9)
 2017-10-06 19:04:45 -07:00
Inigo Goiri 73d3ea8012 HDFS-12430. Rebasing HDFS-10467 After HDFS-12269 and HDFS-12218. Contributed by Inigo Goiri. 
(cherry picked from commit 3302e792d4)
 2017-10-06 19:04:45 -07:00
Inigo Goiri e6e7143545 HDFS-12335. Federation Metrics. Contributed by Inigo Goiri. 
(cherry picked from commit 3b19e77752)
 2017-10-06 19:04:44 -07:00
Inigo Goiri e8b511ca33 HDFS-12384. Fixing compilation issue with BanDuplicateClasses. Contributed by Inigo Goiri. 
(cherry picked from commit fabe02c8fa)
 2017-10-06 19:04:44 -07:00
Inigo Goiri ad48e844fa HDFS-10631. Federation State Store ZooKeeper implementation. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 23c4ddee11)
 2017-10-06 19:04:44 -07:00
Inigo Goiri 503849477a HDFS-12312. Rebasing HDFS-10467 (2). Contributed by Inigo Goiri. 
(cherry picked from commit 90ba6843fb)
 2017-10-06 19:04:43 -07:00
Inigo Goiri 24d275842f HDFS-11554. [Documentation] Router-based federation documentation. Contributed by Inigo Goiri. 
(cherry picked from commit ee3260211d)
 2017-10-06 19:04:43 -07:00
Inigo Goiri 54a355dc8d HDFS-10646. Federation admin tool. Contributed by Inigo Goiri. 
(cherry picked from commit ae27e31fbc)
 2017-10-06 19:04:43 -07:00
Inigo Goiri a0cce0fa0b HDFS-10880. Federation Mount Table State Store internal API. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 58b97df661)
 2017-10-06 19:04:42 -07:00
Inigo Goiri c0fb7b283e HDFS-11826. Federation Namenode Heartbeat. Contributed by Inigo Goiri. 
(cherry picked from commit 928f8dab52)
 2017-10-06 19:04:41 -07:00
Inigo Goiri a11e99efeb HDFS-10687. Federation Membership State Store internal API. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 95cae08849)
 2017-10-06 19:04:41 -07:00
Inigo Goiri ad0fca5dea HDFS-12223. Rebasing HDFS-10467. Contributed by Inigo Goiri. 
(cherry picked from commit 47db6e9d8e)
 2017-10-06 19:04:41 -07:00
Inigo Goiri 2b99a4d29f HDFS-11546. Federation Router RPC server. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 8a9cdebebf)
 2017-10-06 19:04:40 -07:00
Inigo Goiri 9b09f73006 HDFS-10630. Federation State Store FS Implementation. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit c6e0bd640c)
 2017-10-06 19:04:40 -07:00
Inigo 05afc382d9 HDFS-10882. Federation State Store Interface API. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 6d94c90ece)
 2017-10-06 19:04:39 -07:00
Inigo ff134679e0 HDFS-10881. Federation State Store Driver API. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 0f88e04915)
 2017-10-06 19:04:39 -07:00
Inigo 9e3491fafa HDFS-10629. Federation Roter. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 6821e80172)
 2017-10-06 19:04:16 -07:00
Yufei Gu 4cfc7d0af6 YARN-7207. Cache the RM proxy server address. (Yufei Gu) 
(cherry picked from commit 72d22b753a)

# Conflicts:
#	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMContext.java
#	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMContextImpl.java
 2017-10-06 10:03:48 -07:00
Yufei Gu 9bb9831347 YARN-2162. Add ability in Fair Scheduler to optionally configure maxResources in terms of percentage. (Yufei Gu) 2017-10-06 00:29:15 -07:00