eef34f2d87
YARN-9914. Use separate configs for free disk space checking for full and not-full disks. Contributed by Jim Brennan
2019-10-25 17:13:04 +00:00
ac6b6a6a85
HADOOP-16614. Add aarch64 support for dependent leveldbjni.
...
Contributed by liusheng
close #1546
2019-10-24 11:45:57 -04:00
fd84ca5161
YARN-9921. Issue in PlacementConstraint when YARN Service AM retries allocation on component failure. Contributed by Tarun Parimi
2019-10-24 10:05:00 +08:00
83d148074f
YARN-9915: Fix FindBug issue in QueueMetrics. Contributed by Prabhu Joseph.
2019-10-21 20:30:50 +00:00
3f7756dc6c
YARN-9922. Fixed YARN javadoc errors from YARN-9699.
...
Contributed by Peter Bacsko
2019-10-21 16:16:49 -04:00
155864da00
YARN-9875. Improve fair scheduler configuration store on HDFS.
...
Contributed by Prabhu Joseph
2019-10-18 20:30:11 -04:00
72b1bed998
YARN-9884. Make container-executor mount logic modular
...
Contributed by Eric Badger
2019-10-18 19:10:32 -04:00
6d92aa7c30
HADOOP-16579. Upgrade to Curator 4.2.0 and ZooKeeper 3.5.5 ( #1656 ). Contributed by Norbert Kalmár, Mate Szalay-Beko
...
* HADOOP-16579 - Upgrade to Apache Curator 4.2.0 and ZooKeeper 3.5.5
- Add a static initializer for the unit tests using ZooKeeper to enable
the four-letter-words diagnostic telnet commands. (this is an interface
that become disabled by default, so to keep the ZooKeeper 3.4.x behavior
we enabled it for the tests)
- Also fix ZKFailoverController to look for relevant fail-over ActiveAttempt
records. The new ZooKeeper seems to respond quicker during the fail-over
tests than the ZooKeeper, so we made sure to catch all the relevant records
by adding a new parameter to ZKFailoverontroller.waitForActiveAttempt().
Co-authored-by: Norbert Kalmár <nkalmar@cloudera.com>
2019-10-18 13:26:20 -07:00
3d41f33018
HADOOP-16152. Upgrade Eclipse Jetty version to 9.4.x. Contributed by Yuming Wang, Siyao Meng.
...
Co-authored-By: Siyao Meng <smeng@cloudera.com>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-10-18 08:25:02 -07:00
f0699a7406
YARN-9841. Capacity scheduler: add support for combined %user + %primary_group mapping. Contributed by Manikandan R
2019-10-18 11:19:49 +02:00
3990ffa083
YARN-9909. Offline format of YarnConfigurationStore. Contributed by Prabhu Joseph.
2019-10-17 06:43:06 +05:30
a5034c7988
YARN-9773: Add QueueMetrics for Custom Resources. Contributed by Manikandan R.
2019-10-16 21:10:08 +00:00
090f73a9aa
YARN-9900. Revert to previous state when Invalid Config is applied and Refresh Support in SchedulerConfig Format. Contributed by Prabhu Joseph.
2019-10-16 18:14:31 +05:30
a8ef03e961
YARN-9840. Capacity scheduler: add support for Secondary Group rule mapping. Contributed by Manikandan R
2019-10-15 17:22:52 +02:00
5cc7873a47
YARN-9699. Migration tool that help to generate CS config based on FS config [Phase 1]. Contributed by Peter Bacsko
2019-10-14 17:19:39 +02:00
ec86f42e40
YARN-8453. Additional Unit tests to verify queue limit and max-limit with multiple resource types. Contributed by Adam Antal
2019-10-11 14:01:19 +02:00
31e0122f4d
YARN-9860. Enable service mode for Docker containers on YARN
...
Contributed by Prabhu Joseph and Shane Kumpf
2019-10-10 19:02:02 -04:00
6f1ab95168
YARN-9128. Use SerializationUtils from apache commons to serialize / deserialize ResourceMappings. Contributed by Zoltan Siegl
2019-10-09 13:26:26 +02:00
35f093f5b3
YARN-9356. Add more tests to ratio method in TestResourceCalculator. Contributed by Zoltan Siegl
2019-10-09 13:09:09 +02:00
be901f4962
YARN-9873. Mutation API Config Change need to update Version Number. Contributed by Prabhu Joseph
2019-10-09 15:53:14 +05:30
5462d2176f
YARN-9760. Support configuring application priorities on a workflow level. Contributed by Varun Saxena
2019-10-08 11:20:13 -07:00
fb1ecff6a2
Revert "YARN-9873. Mutation API Config Change updates Version Number. Contributed by Prabhu Joseph"
...
This reverts commit 4510970e2f
2019-10-05 09:15:17 +05:30
4510970e2f
YARN-9873. Mutation API Config Change updates Version Number. Contributed by Prabhu Joseph
2019-10-04 21:49:07 +05:30
0d2d6f9267
YARN-9792. Document examples of SchedulerConf with Node Labels. Contributed by Prabhu Joseph
2019-10-02 23:43:47 +05:30
61a8436004
YARN-9870. Remove unused function from OpportunisticContainerAllocatorAMService. Contributed by Abhishek Modi.
2019-10-02 17:55:07 +05:30
d1ddba60e5
YARN-9862. Increase yarn-services-core test timeout value.
...
Contributed by Prabhu Joseph
2019-10-01 21:15:26 -04:00
99cd7572f1
YARN-9801. SchedConfCli does not work wiwith https mode. Contributed by Prabhu Joseph
2019-10-01 20:06:21 +05:30
425a6c89ae
YARN-9858. Optimize RMContext getExclusiveEnforcedPartitions. Contributed by Jonathan Hung.
2019-10-01 16:02:26 +05:30
137546a78a
YARN-9864. Format CS Configuration present in Configuration Store. Contributeed by Prabhu Joseph
2019-10-01 09:08:41 +05:30
4d3c580b03
YARN-9859. Refactoring of OpportunisticContainerAllocator. Contributed by Abhishek Modi.
2019-09-30 23:40:15 +05:30
18a8c2404e
YARN-9857. TestDelegationTokenRenewer throws NPE but tests pass. Contributed by Ahmed Hussein
2019-09-26 16:15:08 +00:00
606e341c1a
Addendum to YARN-9730. Support forcing configured partitions to be exclusive based on app node label
2019-09-25 17:54:53 -07:00
c72457787d
YARN-6715. Fix documentation about NodeHealthScriptRunner. Contributed by Peter Bacsko
2019-09-25 10:36:22 +02:00
bec0864394
YARN-9808. Zero length files in container log output haven't got a header. Contributed by Adam Antal
2019-09-25 10:28:34 +02:00
c2731d4b63
YARN-9730. Support forcing configured partitions to be exclusive based on app node label
2019-09-24 13:51:32 -07:00
bfe1dac29d
HADOOP-16560. [YARN] use protobuf-maven-plugin to generate protobuf classes ( #1496 )
...
Signed-off-by: Vinayakumar B <vinayakumarb@apache.org>
2019-09-24 08:50:36 +08:00
3d78b1223d
YARN-9762. Add submission context label to audit logs. Contributed by Manoj Kumar
2019-09-23 13:12:16 -07:00
1654497f98
HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1 ( #1432 )
...
HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1. Contributed by Vinayakumar B.
2019-09-20 16:08:30 +05:30
56248f9d87
HADOOP-16556. Fix some alerts raised by LGTM.
...
Contributed by Malcolm Taylor.
Change-Id: Ic60c3f4681dd9d48b3afcba7520bd1e4d3cc4231
2019-09-19 16:00:05 +01:00
01d7924473
YARN-9814. JobHistoryServer can't delete aggregated files, if remote app root directory is created by NodeManager. Contributed by Adam Antal.
2019-09-18 09:27:41 +05:30
f8c14326ee
YARN-2255. YARN Audit logging not added to log4j.properties. Contributed by Aihua Xu.
2019-09-18 09:12:28 +08:00
eefe9bc85c
YARN-9837. Fixed reading YARN Service JSON spec file larger than 128k.
...
Contributed by Tarun Parimi
2019-09-17 13:13:35 -04:00
c474e24c0b
YARN-9833. Race condition when DirectoryCollection.checkDirs() runs during container launch. Contributed by Peter Bacsko.
2019-09-17 19:41:38 +05:30
da2b4fe204
YARN-9794. RM crashes due to runtime errors in TimelineServiceV2Publisher. Contributed by Tarun Parimi.
2019-09-15 14:16:18 +05:30
4239007349
YARN-9787. Typo in analysesErrorMsg. Contributed by kevin su.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Reviewed-by: Surendra Singh Lilhore <surendralilhore@apache.org>
2019-09-13 10:36:45 -07:00
44850f6784
YARN-9816. EntityGroupFSTimelineStore#scanActiveLogs fails when undesired files are present under /ats/active. Contribued by Prabhu Joseph.
2019-09-12 12:50:10 +05:30
3b06f0bf9e
YARN-9819. Make TestOpportunisticContainerAllocatorAMService more resilient. Contribued by Abhishek Modi
2019-09-12 08:09:57 +05:30
56b7571131
YARN-9815 ReservationACLsTestBase fails with NPE. Contributed by Ahmed Hussein
2019-09-11 21:59:28 +00:00
f8f8598ea5
YARN-9824. Fall back to configured queue ordering policy class name
2019-09-10 15:19:07 -07:00
10144a580e
YARN-9728. Bugfix for escaping illegal xml characters for Resource Manager REST API.
...
Contributed by Prabhu Joseph
2019-09-10 17:04:39 -04:00
Eric Badger
Eric Yang
Zhankun Tang
Eric E Payne
Mate Szalay-Beko
Yuming Wang
Szilard Nemeth
Sunil G
Jonathan Hung
Abhishek Modi
bibinchundatt
Duo Zhang
Vinayakumar B
Malcolm Taylor
Weiwei Yang
HUAN-PING SU