Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
16,919 Commits 326 Branches 371 Tags
Commit Graph

16919 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Xuan
793476e4b7 YARN-5947: Create LeveldbConfigurationStore class using Leveldb as backing store. Contributed by Jonathan Hung 2017-10-09 14:54:55 -07:00
Xuan
09b7c8766e YARN-5953 addendum: Move QueueConfigInfo and SchedConfUpdateInfo to package org.apache.hadoop.yarn.webapp.dao 2017-10-09 14:54:54 -07:00
Xuan
e09f0d64ac YARN-5953:Create CLI for changing YARN configurations. (Jonathan Hung via xgong) 2017-10-09 14:54:54 -07:00
Xuan
3f29c1585b YARN-6575. Support global configuration mutation in MutableConfProvider. (Jonathan Hung via Xuan Gong) 2017-10-09 14:54:54 -07:00
Wangda Tan
5fd1668a27 YARN-5949. Add pluggable configuration ACL policy interface and implementation. (Jonathan Hung via wangda) 
Change-Id: Ib98e82ff753bede21fcab2e6ca9ec1e7a5a2008f
 2017-10-09 14:54:53 -07:00
Wangda Tan
d1514bacd1 YARN-5952. Create REST API for changing YARN scheduler configurations. (Jonathan Hung via wangda) 2017-10-09 14:54:53 -07:00
Jonathan Hung
28754646e5 YARN-5948. Implement MutableConfigurationManager for handling storage into configuration store 2017-10-09 14:54:53 -07:00
Xuan
c4c2feeccf YARN-5946: Create YarnConfigurationStore interface and 
InMemoryConfigurationStore class. Contributed by Jonathan Hung
 2017-10-09 14:54:52 -07:00
Jonathan Hung
72169a0281 YARN-5951. Changes to allow CapacityScheduler to use configuration store 2017-10-09 14:54:52 -07:00
Andrew Wang
1d11701e55 HDFS-12541. Extend TestSafeModeWithStripedFile with a random EC policy. Contributed by Takanobu Asanuma. 
(cherry picked from commit 793820823325e390bb671f4cc1b3bc6920bba5de)
 2017-10-09 13:03:39 -07:00
Andrew Wang
e9f3f49b6d HDFS-12603. Enable async edit logging by default. 
(cherry picked from commit afb42aeabf1317b755ab79e0265bc90920c896ac)
 2017-10-09 11:20:04 -07:00
Lei Xu
015eb628b8 HDFS-12606. When using native decoder, DFSStripedStream.close crashes JVM after being called multiple times. (Lei (Eddy) Xu) 
(cherry picked from commit 46644319e1b3295ddbc7597c060956bf46487d11)
 2017-10-09 10:09:49 -07:00
Daniel Templeton
bec03f7060 YARN-2612 addendum: fixed javadoc error. 
(cherry picked from commit 6d6ca4c923142a893870fc8a6309c02f60dc2d24)
 2017-10-09 14:15:52 +02:00
Sunil G
84e2e2a6f6 YARN-7245. Max AM Resource column in Active Users Info section of Capacity Scheduler UI page should be updated per-user. Contributed by Eric Payne. 
(cherry picked from commit 8137254a1f4367974bf1883f1982e31ab2865107)
 2017-10-09 14:40:44 +05:30
John Zhuge
7dfe97d84f HDFS-12494. libhdfs SIGSEGV in setTLSExceptionStrings. Contributed by John Zhuge. 
(cherry picked from commit 2856eb207bfb206f22a6266f42cad0257083ab94)
 2017-10-07 00:09:36 -07:00
Inigo Goiri
ae9f82c603 HDFS-12577. Rename Router tooling. Contributed by Inigo Goiri. 
(cherry picked from commit 53e8d0d030525e4c7f3875e23807c6dbe778890f)
 2017-10-06 19:04:47 -07:00
Inigo Goiri
87b1f87094 HDFS-12273. Federation UI. Contributed by Inigo Goiri. 
(cherry picked from commit adbb2e00c7b85524fd43bd68895d49814c16680a)
 2017-10-06 19:04:46 -07:00
Inigo Goiri
c85b4ba028 HDFS-12580. Rebasing HDFS-10467 after HDFS-12447. Contributed by Inigo Goiri. 
(cherry picked from commit b12440d3479f19138bc66ea59baf41eb89061906)
 2017-10-06 19:04:46 -07:00
Inigo Goiri
3c621636e0 HDFS-12381. [Documentation] Adding configuration keys for the Router. Contributed by Inigo Goiri. 
(cherry picked from commit c2d6aa79055ef72406fa598e1c743b0c994b5da8)
 2017-10-06 19:04:45 -07:00
Inigo Goiri
43616f8531 HDFS-12450. Fixing TestNamenodeHeartbeat and support non-HA. Contributed by Inigo Goiri. 
(cherry picked from commit 928d1e87f9dbe64f89b858ccc1780723f3af58e7)
 2017-10-06 19:04:45 -07:00
Inigo Goiri
73d3ea8012 HDFS-12430. Rebasing HDFS-10467 After HDFS-12269 and HDFS-12218. Contributed by Inigo Goiri. 
(cherry picked from commit 3302e792d469b7e8f3bfa10151e4e1c546589734)
 2017-10-06 19:04:45 -07:00
Inigo Goiri
e6e7143545 HDFS-12335. Federation Metrics. Contributed by Inigo Goiri. 
(cherry picked from commit 3b19e77752afce87936f5c0d1e6d272fba798d7b)
 2017-10-06 19:04:44 -07:00
Inigo Goiri
e8b511ca33 HDFS-12384. Fixing compilation issue with BanDuplicateClasses. Contributed by Inigo Goiri. 
(cherry picked from commit fabe02c8fafa807198054da0c02b2ebaafda76aa)
 2017-10-06 19:04:44 -07:00
Inigo Goiri
ad48e844fa HDFS-10631. Federation State Store ZooKeeper implementation. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 23c4ddee11ab1300325a6361124ee8ad6f68d7a4)
 2017-10-06 19:04:44 -07:00
Inigo Goiri
503849477a HDFS-12312. Rebasing HDFS-10467 (2). Contributed by Inigo Goiri. 
(cherry picked from commit 90ba6843fb3ac5dc7576535e66a75a5e3433247b)
 2017-10-06 19:04:43 -07:00
Inigo Goiri
24d275842f HDFS-11554. [Documentation] Router-based federation documentation. Contributed by Inigo Goiri. 
(cherry picked from commit ee3260211d94aed223dd6f2386a166eb2c7d67af)
 2017-10-06 19:04:43 -07:00
Inigo Goiri
54a355dc8d HDFS-10646. Federation admin tool. Contributed by Inigo Goiri. 
(cherry picked from commit ae27e31fbcf546481db0b0345772db2e9132372e)
 2017-10-06 19:04:43 -07:00
Inigo Goiri
a0cce0fa0b HDFS-10880. Federation Mount Table State Store internal API. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 58b97df661441150d35abd44b3a8606206b46441)
 2017-10-06 19:04:42 -07:00
Inigo Goiri
c0fb7b283e HDFS-11826. Federation Namenode Heartbeat. Contributed by Inigo Goiri. 
(cherry picked from commit 928f8dab52191e733984d37f47b69719ccf11313)
 2017-10-06 19:04:41 -07:00
Inigo Goiri
a11e99efeb HDFS-10687. Federation Membership State Store internal API. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 95cae08849d23cf12c5d280c29f90908e6a90d40)
 2017-10-06 19:04:41 -07:00
Inigo Goiri
ad0fca5dea HDFS-12223. Rebasing HDFS-10467. Contributed by Inigo Goiri. 
(cherry picked from commit 47db6e9d8e2c264671c89fdd6cb11a7c762d2cce)
 2017-10-06 19:04:41 -07:00
Inigo Goiri
2b99a4d29f HDFS-11546. Federation Router RPC server. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 8a9cdebebf26841a0f1e99fb08135f4597f2eba2)
 2017-10-06 19:04:40 -07:00
Inigo Goiri
9b09f73006 HDFS-10630. Federation State Store FS Implementation. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit c6e0bd640cdaf83a660fa050809cad6f1d4c6f4d)
 2017-10-06 19:04:40 -07:00
Inigo
05afc382d9 HDFS-10882. Federation State Store Interface API. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 6d94c90ece1c1d23d4c97e72c54e9991f5dbc481)
 2017-10-06 19:04:39 -07:00
Inigo
ff134679e0 HDFS-10881. Federation State Store Driver API. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 0f88e049156dce173afc0dbda864e29190dd2210)
 2017-10-06 19:04:39 -07:00
Inigo
9e3491fafa HDFS-10629. Federation Roter. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 6821e801724ac38e9737538b2164c9ae88792282)
 2017-10-06 19:04:16 -07:00
Yufei Gu
4cfc7d0af6 YARN-7207. Cache the RM proxy server address. (Yufei Gu) 
(cherry picked from commit 72d22b753abde4d07a727479d3f3d5d84d5dd6b2)

# Conflicts:
#	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMContext.java
#	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMContextImpl.java
 2017-10-06 10:03:48 -07:00
Yufei Gu
9bb9831347 YARN-2162. Add ability in Fair Scheduler to optionally configure maxResources in terms of percentage. (Yufei Gu) 2017-10-06 00:29:15 -07:00
Xiao Chen
3106552b75 HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah. 
(cherry picked from commit 212342d6db14673f8f5652a5209e1c4fcc0f0ede)
 2017-10-05 19:47:13 -07:00
Andrew Wang
e159272003 HDFS-12567. BlockPlacementPolicyRackFaultTolerant fails with racks with very few nodes. 
(cherry picked from commit 644c2f6924f341f51d809c91dccfff88fc82f6f0)
 2017-10-05 16:58:46 -07:00
Haibo Chen
c021c8a19f YARN-7009. TestNMClient.testNMClientNoCleanupOnStop is flaky by design. (Miklos Szegedi via Haibo Chen) 
(cherry picked from commit c071aad5da6f6601978e73d38ce5813958848bc4)
 2017-10-05 15:51:08 -07:00
Chris Trezzo
e5af16cf6c YARN-2960. Add documentation for the YARN shared cache. 
(cherry picked from commit 7e76f85bc68166b01b51fcf6ba4b3fd9281d4a03)
 2017-10-05 11:15:39 -07:00
Chris Trezzo
4b9b66f921 Revert "YARN-2960. Add documentation for the YARN shared cache." 
This reverts commit 54a01c28cc153872aa7eed68000ab0ddf010054a.
 2017-10-05 11:11:02 -07:00
Chris Trezzo
54a01c28cc YARN-2960. Add documentation for the YARN shared cache. 
(cherry picked from commit 7e76f85bc68166b01b51fcf6ba4b3fd9281d4a03)
 2017-10-05 10:54:44 -07:00
Arun Suresh
b61d12e300 YARN-7258. Add Node and Rack Hints to Opportunistic Scheduler. (Kartheek Muthyala via asuresh). 
(cherry picked from commit b733348dde18a242e6c9074c512116a8baf1d281)
 2017-10-05 10:06:30 -07:00
Sunil G
807d8b41ad YARN-6182. Fix alignment issues and missing information in new YARN UI's Queue page. Contributed by Akhil PB. 
(cherry picked from commit f702c9575495e3af99d4b5cae9f73969e1a6dfc2)
 2017-10-05 11:35:36 +05:30
Sunil G
6a152b3e91 YARN-7279. Fix typo in helper message of ContainerLauncher. Contributed by Elek, Marton. 
(cherry picked from commit 592bf2d550a07ea5c5df3ba0ab2952c34d941b4b)
 2017-10-05 10:52:49 +05:30
Subru Krishnan
829a8e26b9 YARN-5329. Placement Agent enhancements required to support recurring reservations in ReservationSystem. (Carlo Curino via Subru). 
(cherry picked from commit e6e614e380ed1d746973b50f666a9c40d272073e)
 2017-10-04 19:29:03 -07:00
Akira Ajisaka
5c2f07eed7
HADOOP-14616. Client fails to read a block with erasure code (XOR, native) when one of the data block is lost. Contributed by Huafeng Wang. 
(cherry picked from commit fe84cdc9daa37af791a23a390e080777090c5e24)
 2017-10-05 11:07:33 +09:00
Subru Krishnan
8d59b1fbee YARN-5330. SharingPolicy enhancements required to support recurring reservations in ReservationSystem. (Carlo Curino via Subru). 
(cherry picked from commit fa6137501c1499ae33f6e0e2adc31671a7e782dc)
 2017-10-04 16:41:18 -07:00