Yiqun Lin
|
5cada4564a
|
HDFS-12219. Javadoc for FSNamesystem#getMaxObjects is incorrect. Contributed by Erik Krogen.
(cherry picked from commit 20304b91cc1513e3d82a01d36f4ee9c4c81b60e4)
|
2017-11-01 16:43:44 +09:00 |
|
John Zhuge
|
0ec172b42f
|
HDFS-12714. Hadoop 3 missing fix for HDFS-5169. Contributed by Joe McDonnell.
(cherry picked from commit b8c8b5bc274211b29be125e5463662795a363f84)
|
2017-10-31 22:46:26 -07:00 |
|
Lei Xu
|
9ee04006cb
|
HDFS-12482. Provide a configuration to adjust the weight of EC recovery tasks to adjust the speed of recovery. (lei)
|
2017-10-31 22:03:44 -07:00 |
|
Daniel Templeton
|
c025c9ac62
|
YARN-7336. Unsafe cast from long to int Resource.hashCode() method
(Contributed by Miklos Szegedi via Daniel Templeton)
(cherry picked from commit d64736d58965722b71d6eade578b6c4c266e6448)
|
2017-10-31 15:06:18 -07:00 |
|
Daniel Templeton
|
7689d4781a
|
YARN-6927. Add support for individual resource types requests in MapReduce
(Contributed by Gergo Repas via Daniel Templeton)
(cherry picked from commit 9a7e81083801a57d6bb96584988415cbef67460d)
|
2017-10-31 15:06:18 -07:00 |
|
Daniel Templeton
|
77401022a7
|
YARN-7374. Improve performance of DRF comparisons for resource types in fair scheduler
(cherry picked from commit 9711b78998ca3a1f7734058a78c7baddd130ce0f)
|
2017-10-31 15:06:18 -07:00 |
|
Daniel Templeton
|
ab93bf5b00
|
YARN-7397. Reduce lock contention in FairScheduler#getAppWeight()
(cherry picked from commit e62bbbca7adafa0e050212e99c41c95a844700ff)
|
2017-10-31 15:06:18 -07:00 |
|
Daniel Templeton
|
c818c85238
|
YARN-6984. DominantResourceCalculator.isAnyMajorResourceZero() should test all resources
(Contributed by Sunil G via Daniel Templeton)
(cherry picked from commit 679f99b1455a1fcd785aef8ddc705f63cf0e6518)
|
2017-10-31 15:06:18 -07:00 |
|
Daniel Templeton
|
68585156dc
|
YARN-7270 addendum: Reapplied changes after YARN-3926 backports
|
2017-10-31 15:06:18 -07:00 |
|
Wangda Tan
|
6f41843906
|
YARN-7172. ResourceCalculator.fitsIn() should not take a cluster resource parameter. (Sen Zhao via wangda)
Change-Id: Icc3670c9381ce7591ca69ec12da5aa52d3612d34
(cherry picked from commit e81596d06d226f1cfa44b2390ce3095ed4dee621)
|
2017-10-31 15:06:18 -07:00 |
|
Yufei Gu
|
f30f78a736
|
YARN-6612. Update fair scheduler policies to be aware of resource types. (Contributed by Daniel Templeton via Yufei Gu)
(cherry picked from commit 09b476e6dabe8039a41dde7930c8a9c0d14bb750)
|
2017-10-31 15:06:18 -07:00 |
|
Sunil G
|
74030d808c
|
YARN-7137. [YARN-3926] Move newly added APIs to unstable in YARN-3926 branch. Contributed by Wangda Tan.
(cherry picked from commit da0b6a354bf6f6bf37ca5a05a4a8eece09aa4893)
|
2017-10-31 15:06:17 -07:00 |
|
Daniel Templeton
|
0db9ddb728
|
YARN-7136. Additional Performance Improvement for Resource Profile Feature
(Contributed by Wangda Tan via Daniel Templeton)
(cherry picked from commit bf2b687412f9a830ec4834477ccf25dbe76fddcd)
|
2017-10-31 15:06:17 -07:00 |
|
Wangda Tan
|
335e3a6334
|
YARN-7056. [Partial backport] Document Resource Profiles feature. (Sunil G via wangda)
Change-Id: I5f5d52cdf7aba4ac09684aab573e6916dbad183e
(cherry picked from commit 6b88cd1901a65b977fed759e322dcd75a2cd33b6)
|
2017-10-31 15:06:17 -07:00 |
|
Sunil G
|
4bf29910a8
|
YARN-6933. [YARN-3926] ResourceUtils.DISALLOWED_NAMES check is duplicated. Contributed by Manikandan R.
(cherry picked from commit 805095496dfd8e50f71b70cf20845e954d3ba47c)
|
2017-10-31 15:06:17 -07:00 |
|
Wangda Tan
|
00fcc8593b
|
YARN-7093. Improve log message in ResourceUtils. (Sunil G via wangda)
Change-Id: I88928a747ee3eec17bc76fb71e9aaa632d091f0f
(cherry picked from commit 53df3eac503064b8c4cd8eb2b659567622f4d8a7)
|
2017-10-31 15:06:17 -07:00 |
|
Wangda Tan
|
57bbdbeb80
|
YARN-7039. Fix javac and javadoc errors in YARN-3926 branch. (Sunil G via wangda)
Change-Id: I442bf6d838b3aba83f1f6779cf9dcf8596a2102d
(cherry picked from commit e490602e9b306d5b8a543b93fb15a7395bb9a03d)
|
2017-10-31 15:06:17 -07:00 |
|
Sunil G
|
5dd008ca2e
|
YARN-7067. [YARN-3926] Optimize ResourceType information display in UI. Contributed by Wangda Tan.
(cherry picked from commit a333ba54e3f5a1ca57b0fc94bfd008f3cbd5b14b)
|
2017-10-31 15:06:17 -07:00 |
|
Wangda Tan
|
605fcde012
|
YARN-7043. [Partial backport] Cleanup ResourceProfileManager. (wangda)
Change-Id: I463356f37bf1f6a3f1fc3c594c79916e8c0ab913
(cherry picked from commit 39240b61a163b127eec385decd30ffd96e694c28)
|
2017-10-31 15:06:17 -07:00 |
|
Sunil G
|
f2b881a505
|
YARN-6781. [YARN-3926] ResourceUtils#initializeResourcesMap takes an unnecessary Map parameter. Contributed by Yu-Tang Lin.
(cherry picked from commit 758b7719430c981a6d4d1644d9d03cd16b981cf3)
|
2017-10-31 15:06:17 -07:00 |
|
Wangda Tan
|
4af3deaeb0
|
YARN-6789. Add Client API to get all supported resource types from RM. (Sunil G via wangda)
Change-Id: I366d8db6f6700acd087db5acb7a1be7e41b2b68d
(cherry picked from commit df3855541af98a3805958f2b5b9db6be705d52ab)
|
2017-10-31 15:06:17 -07:00 |
|
Wangda Tan
|
255668a2a6
|
YARN-7042. Clean up unit tests after YARN-6610. (Daniel Templeton via wangda)
Change-Id: I8e40f704b6fcdd5b14faa9548a27986501044fa1
(cherry picked from commit b1fe3a222e7673fd84a878622969f958022061e9)
|
2017-10-31 15:06:17 -07:00 |
|
Sunil G
|
8827d93ca1
|
YARN-7030. [YARN-3926] Performance optimizations in Resource and ResourceUtils class. Contributed by Wangda Tan.
(cherry picked from commit a6989af1d91d8b6795862c39d154823f8488c8de)
|
2017-10-31 15:06:17 -07:00 |
|
Sunil G
|
1ba85a9305
|
YARN-6610. [YARN-3926] DominantResourceCalculator#getResourceAsValue dominant param is updated to handle multiple resources. Contributed by Daniel Templeton.
(cherry picked from commit a0030c8c6f5489d8285632a651394b2b2320255c)
|
2017-10-31 15:06:17 -07:00 |
|
Sunil G
|
5231c43bdb
|
YARN-6892. [YARN-3926] Improve API implementation in Resources and DominantResourceCalculator class. Contributed by Sunil G.
(cherry picked from commit 2b51b262aba0191b80dc93799574c0b959cb4f4e)
|
2017-10-31 15:06:16 -07:00 |
|
Yufei Gu
|
9c4505f3fa
|
YARN-6994. [YARN-3926] Remove last uses of Long from resource types code. (Daniel Templeton via Yufei Gu)
(cherry picked from commit d5e9939ebb59e4f6f8e5e2fe7f619fb032f2911c)
|
2017-10-31 15:06:16 -07:00 |
|
Daniel Templeton
|
99c292403d
|
YARN-6788. [YARN-3926] Improve performance of resource profile branch
(Contributed by Sunil Govindan via Daniel Templeton)
(cherry picked from commit 3aeaafecb823ef6c175ea5d0d9cb726faacaf32d)
|
2017-10-31 15:06:16 -07:00 |
|
Sunil G
|
58f2c07028
|
YARN-6786. [YARN-3926] ResourcePBImpl imports cleanup. Contributed by Yeliang Cang.
(cherry picked from commit 4e5632d28eb8f6b1b8830c2aa89ec6321d477977)
|
2017-10-31 15:06:16 -07:00 |
|
Sunil G
|
5fa0dc35c3
|
YARN-6761. Fix build for YARN-3926 branch. Contributed by Varun Vasudev.
(cherry picked from commit ca2808d8bbe49766029e5dba88ff863f6c993287)
|
2017-10-31 15:06:16 -07:00 |
|
Sunil G
|
48ddb8f5b4
|
YARN-6445. [YARN-3926] Performance improvements in resource profile branch with respect to SLS. Contributed by Varun Vasudev.
(cherry picked from commit 58da54640e37571f82eb340f32641d58160e92b2)
|
2017-10-31 15:06:16 -07:00 |
|
Sunil G
|
bda5486dad
|
YARN-6232. Update resource usage and preempted resource calculations to take into account all resource types. Contributed by Varun Vasudev.
(cherry picked from commit dae65f3bef8ffa34d02a37041f1dfdfeeee91845)
|
2017-10-31 15:06:16 -07:00 |
|
Sunil G
|
4045ef047d
|
YARN-5588. [Partial backport] [YARN-3926] Add support for resource profiles in distributed shell. Contributed by Varun Vasudev.
(cherry picked from commit 7805deed4896e470ebd2f6bbd1ba9962947c63cd)
|
2017-10-31 15:06:16 -07:00 |
|
Arun Suresh
|
a9fa0349a0
|
YARN-5587. [Partial backport] Add support for resource profiles. (vvasudev via asuresh)
(cherry picked from commit 6708ac330147b2d3816a31f2ee83e09c41fe0dd9)
|
2017-10-31 15:06:16 -07:00 |
|
Rohith Sharma K S
|
3d1b59e04a
|
YARN-5586. Update the Resources class to consider all resource types. Contributed by Varun Vasudev.
(cherry picked from commit 239c1824a07fede71dd751ed2c1f40036b22170e)
|
2017-10-31 15:06:16 -07:00 |
|
Rohith Sharma K S
|
feb6d00e2a
|
YARN-5242. Update DominantResourceCalculator to consider all resource types in calculations. Contributed by Varun Vasudev.
(cherry picked from commit 9e4ba6aff595b7a5b53d016c97c8334e10f1f2cb)
|
2017-10-31 15:06:16 -07:00 |
|
Varun Vasudev
|
16beac12ad
|
YARN-4830. Add support for resource types in the nodemanager. Contributed by Varun Vasudev.
(cherry picked from commit 759114b0063907d4c07ea6ee261e861bf5cc3a9a)
|
2017-10-31 15:06:16 -07:00 |
|
Arun Suresh
|
92ca475fdc
|
YARN-4829. Add support for binary units in Resource class.(vvasudev via asuresh)
(cherry picked from commit 7ba698997b6845b664b2f8c82e384b457c30d176)
|
2017-10-31 15:06:16 -07:00 |
|
Varun Vasudev
|
f1f9b83e4c
|
YARN-4715. Add support to read resource types from a config file. Contributed by Varun Vasudev.
(cherry picked from commit ceb12c59a34677518a198e19acb4e29cdfc8a0e1)
|
2017-10-31 15:06:15 -07:00 |
|
Wangda Tan
|
33fabe1e10
|
YARN-4172. Extend DominantResourceCalculator to account for all resources. (Varun Vasudev via wangda)
(cherry picked from commit 32c91223f1bd06561ea4ce2d1944e8d9a847f18c)
|
2017-10-31 15:06:15 -07:00 |
|
Wangda Tan
|
68da5218b7
|
YARN-4081. Add support for multiple resource types in the Resource class. (Varun Vasudev via wangda)
(cherry picked from commit 1bbab7c1570a2438b2fa6da70397dd1d5211a137)
|
2017-10-31 15:06:15 -07:00 |
|
Chris Douglas
|
b5f66b005c
|
Revert "HDFS-7878. API - expose a unique file identifier."
This reverts commit 1ce0eb7d23156175db2d31f3fcbbe6529944c04b.
|
2017-10-31 13:56:41 -07:00 |
|
Carlo Curino
|
1fbc72704e
|
YARN-3661. Basic Federation UI. (Contributed by Inigo Goiri via curino)
(cherry picked from commit ceca9694f9a0c78d07cab2c382036f175183e67b)
|
2017-10-31 13:42:36 -07:00 |
|
Haibo Chen
|
e785e83270
|
YARN-7389. Make TestResourceManager Scheduler agnostic. (Robert Kanter via Haibo Chen)
(cherry picked from commit d7f3737f3b3236fbf8c25fdd4656251ed63a2be9)
|
2017-10-31 13:41:44 -07:00 |
|
Wei-Chiu Chuang
|
cba1fa496b
|
HADOOP-14880. [KMS] Document&test missing KMS client side configs. Contributed by Gabor Bota.
(cherry picked from commit 97c70c7ac6881f87eee1575bcbdd28b31ecac231)
|
2017-10-31 12:54:53 -07:00 |
|
Chen Liang
|
af52a585f0
|
HADOOP-14915. method name is incorrect in ConfServlet. Contributed by Bharat Viswanadham.
(cherry picked from commit 563dcdfc1de7ea9ee7ce296163cf2678dfe5349c)
|
2017-10-31 12:54:28 -07:00 |
|
Wei-Chiu Chuang
|
0b3e3e4895
|
HADOOP-14948. Document missing config key hadoop.treat.subject.external. Contributed by Ajay Kumar.
(cherry picked from commit e906108fc98a011630d12a43e557b81d7ef7ea5d)
|
2017-10-31 12:54:03 -07:00 |
|
Wei-Chiu Chuang
|
1347e83c90
|
HDFS-12485. expunge may fail to remove trash from encryption zone. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 8dbc8909c92d502d10a7f94d1de3171878a43b04)
|
2017-10-31 12:52:58 -07:00 |
|
Manoj Govindassamy
|
166c75a0eb
|
HDFS-12544. SnapshotDiff - support diff generation on any snapshot root descendant directory.
(cherry picked from commit 075dd45a24398dcdcddd60da995f0dc152eee321)
|
2017-10-31 12:50:54 -07:00 |
|
Manoj Govindassamy
|
1375c7205f
|
HDFS-12573. Divide the total blocks metrics into replicated and erasure coded. Contributed by Takanobu Asanuma.
(cherry picked from commit 78af6cdc5359404139665d81447f28d26b7bb43b)
|
2017-10-31 12:50:21 -07:00 |
|
Manoj Govindassamy
|
014184127e
|
HDFS-12614. FSPermissionChecker#getINodeAttrs() throws NPE when INodeAttributesProvider configured.
(cherry picked from commit b406d8e3755d24ce72c443fd893a5672fd56babc)
|
2017-10-31 12:49:41 -07:00 |
|