Commit Graph

299 Commits

Author SHA1 Message Date
Gour Saha 541b64c798 YARN-7165. Miscellaneous fixes in yarn-native-services. Contributed by Jian He 2017-11-06 13:30:15 -08:00
Jian He eed9e3e8f4 Rebase onto trunk - fix some issues. Contributed by Rohith Sharma K S 2017-11-06 13:30:14 -08:00
Jian He 7dd4490a44 YARN-7073. Yarn native services rest API documentation. Contributed by Gour Saha 2017-11-06 13:30:14 -08:00
Jian He 59fe98cd50 YARN-7100. Added JsonIgnore annotation to Resource#getMemoryMB. Contributed by Eric Yang 2017-11-06 13:30:13 -08:00
Jian He fecf22b2fd YARN-7113. Clean up packaging and dependencies for yarn-native-services. Contributed by Billie Rinaldi 2017-11-06 13:30:13 -08:00
Billie Rinaldi 40ab068eab YARN-7091. Rename application to service in yarn-native-services. Contributed by Jian He 2017-11-06 13:30:13 -08:00
Billie Rinaldi 2191f5b533 YARN-7050. Post cleanup after YARN-6903, removal of org.apache.slider package. Contributed by Jian He 2017-11-06 13:30:12 -08:00
Billie Rinaldi 79bf5c084d YARN-7029. Add more UTs in yarn-native-services. Contributed by Jian He 2017-11-06 13:30:11 -08:00
Billie Rinaldi 1888318c89 YARN-6903. Yarn-native-service framework core rewrite. Contributed by Jian He 2017-11-06 13:30:11 -08:00
Jian He 27dcc67959 Update pom version to 3.0.0-beta1-SNAPSHOT 2017-11-06 13:30:10 -08:00
Jian He 8d335e59cf YARN-6804. [yarn-native-services changes] Allow custom hostname for docker containers in native services. Contributed by Billie Rinaldi 2017-11-06 13:30:10 -08:00
Billie Rinaldi 14f3f3b42e YARN-6655. Fix compilation failure in TestServiceApiUtil due to changes in YARN-6716. 2017-11-06 13:30:10 -08:00
Jian He 59a9b4f438 YARN-6655. Validate yarn native services application submission side to ensure that the hostname should be less than 63 characters. Contributed by Billie Rinaldi 2017-11-06 13:30:09 -08:00
Jian He e86d828548 YARN-6716. Native services support for specifying component start order. Contributed by Billie Rinaldi 2017-11-06 13:30:09 -08:00
Akira Ajisaka b7e5d739ba YARN-6722. Bumping up pom file hadoop version. Contributed by Panagiotis Garefalakis. 2017-11-06 13:30:09 -08:00
Billie Rinaldi a0b9e8a630 YARN-6617. Services API delete call first attempt usually fails. Contributed by Jian He 2017-11-06 13:30:09 -08:00
Jian He a0574e7f4f YARN-6613. Update json validation for new native services providers. Contributed by Billie Rinaldi 2017-11-06 13:30:08 -08:00
Jian He 9085cd5c6e YARN-6160. Create an agent-less docker-less provider in the native services framework. Contributed by Billie Rinaldi 2017-11-06 13:30:08 -08:00
Billie Rinaldi 02d68c4bcf YARN-6588. Add native-service AM log4j properties in classpath. Contributed by Jian He 2017-11-06 13:30:08 -08:00
Jian He a041373dd4 YARN-6533. Race condition in writing service record to registry in yarn native services. Contributed by Billie Rinaldi 2017-11-06 13:30:08 -08:00
Billie Rinaldi ce05c6e981 YARN-6545. Followup fix for YARN-6405. Contributed by Jian He 2017-11-06 13:30:07 -08:00
Sunil G ba812bf67f YARN-6446. addendum patch. Contributed by Rohith Sharma K S. 2017-11-06 13:30:07 -08:00
Jian He a8a273b064 YARN-6446. Revisit ATSv2 integration to ensure all required information is published. Contributed by Rohith Sharma K S 2017-11-06 13:30:07 -08:00
Billie Rinaldi 845764da14 YARN-6405. Improve configuring services through REST API. Contributed by Jian He 2017-11-06 13:28:42 -08:00
Jian He 384ee13eec YARN-6335. Port slider's groovy unit tests to yarn native services. Contributed by Billie Rinaldi 2017-11-06 13:28:42 -08:00
Jian He c3ac67e3e1 Rebase to latest trunk, fix conflicts and pom.xml 2017-11-06 13:28:41 -08:00
Jian He fd9d0d4ead YARN-6400. Remove some unneeded code after YARN-6255. Contributed by Jian He 2017-11-06 13:28:41 -08:00
Jian He f4216b7bba YARN-6395. Integrate service app master to write data into ATSv2. Contributed by Rohith Sharma K S 2017-11-06 13:28:41 -08:00
Jian He c31cd981eb YARN-6255. Refactor yarn-native-services framework. Contributed by Jian He 2017-11-06 13:28:41 -08:00
Billie Rinaldi 024e90a508 YARN-6192. Move yarn-native-service API records into hadoop-yarn-slider-core module. Contributed by Jian He 2017-11-06 13:28:41 -08:00
Gour Saha 0ed8d4ebe6 YARN-6205. Default lifetime for native services app is invalid. Contributed by Billie Rinaldi 2017-11-06 13:28:40 -08:00
Gour Saha 500695d726 YARN-6185. Apply SLIDER-1199 to yarn native services for blacklisting nodes. Contributed by Billie Rinaldi 2017-11-06 13:28:40 -08:00
Gour Saha 8967a1b812 YARN-6186 Handle InvalidResourceRequestException in native services AM onError 2017-11-06 13:28:40 -08:00
Billie Rinaldi e34ca6b02d YARN-6173. Add artifact info and privileged container details to the container info in API GET response. Contributed by Gour Saha 2017-11-06 13:28:40 -08:00
Jian He 68940ab8f6 Updated pom to point to 3.0.0-alpha3-SNAPSHOT 2017-11-06 13:28:40 -08:00
Billie Rinaldi d943eb4c15 YARN-6132. SliderClient bondToCluster should call findInstance with live states filter. Contributed by Gour Saha 2017-11-06 13:28:40 -08:00
Billie Rinaldi 7edc154e0e YARN-6115. Few additional paths in Slider client still uses get all Applications without tags/states filter. Contributed by Gour Saha 2017-11-06 13:28:40 -08:00
Gour Saha a5e20f0fc1 YARN-5993. Allow native services quicklinks to be exported for each component. Contributed by Billie Rinaldi 2017-11-06 13:28:39 -08:00
Billie Rinaldi 74fff4086e YARN-6014. Followup fix for slider core module findbugs. Contributed by Jian He 2017-11-06 13:28:39 -08:00
Billie Rinaldi 1ea43c443e YARN-6010. Fix findbugs, site warnings in yarn-services-api module. Contributed by Jian He 2017-11-06 13:28:38 -08:00
Billie Rinaldi db96e8aa21 YARN-5967. Fix slider core module findbugs warnings. Contributed by Jian He 2017-11-06 13:28:38 -08:00
Gour Saha c11f4b3c21 YARN-5996. Native services AM kills app on AMRMClientAsync onError call. Contributed by Billie Rinaldi 2017-11-06 13:28:38 -08:00
Gour Saha 2e1fa61253 YARN-5740. Add a new field in Slider status output - lifetime (remaining). Contributed by Jian He 2017-11-06 13:28:37 -08:00
Billie Rinaldi 2cea59dc54 YARN-5975. Remove the agent - slider AM ssl related code. Contributed by Jian He 2017-11-06 13:28:37 -08:00
Jian He efe7d44ead YARN-5961. Generate native services protobuf classes during build. Contributed by Billie Rinaldi 2017-11-06 13:28:37 -08:00
Gour Saha e4f0263e51 YARN-5958. Fix ASF license warnings for slider core module. Contributed by Billie Rinaldi 2017-11-06 13:28:37 -08:00
Gour Saha 1f44e6a5f4 YARN-5944. Native services AM should remain up if RM is down. Contributed by Billie Rinaldi 2017-11-06 13:28:37 -08:00
Gour Saha 6143aa135b YARN-5769. Integrate update app lifetime using feature implemented in YARN-5611. Contributed by Jian He 2017-11-06 13:28:37 -08:00
Gour Saha bd0e9f91b6 YARN-5941. Slider handles "per.component" for multiple components incorrectly. Contributed by Billie Rinaldi 2017-11-06 13:28:37 -08:00
Gour Saha 4f43ebdb9f YARN-5943. Write native services container stderr file to log directory. Contributed by Billie Rinaldi 2017-11-06 13:28:36 -08:00
Billie Rinaldi 7b8fd3abd6 YARN-5883 Avoid or eliminate expensive YARN get all applications call. Contributed by Gour Saha 2017-11-06 13:28:36 -08:00
Jian He 234dba84a1 YARN-5909. Remove agent related code in slider AM. Contributed by Jian He 2017-11-06 13:28:36 -08:00
Gour Saha d1ee95981e YARN-5828. Native services client errors out when config formats are uppercase. Contributed by Billie Rinaldi 2017-11-06 13:28:35 -08:00
Jian He 7757f6fe4a YARN-5812. Exception during GET call - "Failed to retrieve application: null". Contributed by Gour Saha 2017-11-06 13:28:35 -08:00
Gour Saha 25411a1742 YARN-5813. Slider should not try to set a negative lifetime timeout value. Contributed by Jian He 2017-11-06 13:28:35 -08:00
Jian He 3741e5518f YARN-5796. Convert enums values in service code to upper case and special handling of an error. Contributed by Gour Saha 2017-11-06 13:28:34 -08:00
Gour Saha 09e4b9e897 YARN-5690. Integrate native services modules into maven build. Contributed by Billie Rinaldi 2017-11-06 13:28:34 -08:00
Billie Rinaldi ef5a3628c2 YARN-5770. Performance improvement of native-services REST API service. Contributed by Gour Saha 2017-11-06 13:28:34 -08:00
Gour Saha 1d7a42e795 YARN-5680. Add 2 new fields in Slider status output - image-name and is-privileged-container. Contributed by Billie Rinaldi 2017-11-06 13:28:34 -08:00
Billie Rinaldi 773c565ac5 YARN-5775. Convert enums in swagger definition to uppercase. Contributed by Gour Saha 2017-11-06 13:28:34 -08:00
Gour Saha 6bdfce3ac7 YARN-5778. Add .keep file for yarn native services AM web app. Contributed by Billie Rinaldi 2017-11-06 13:28:34 -08:00
Jian He f206a43954 YARN-5701. Fix issues in yarn native services apps-of-apps. Contributed by Billie Rinaldi 2017-11-06 13:28:33 -08:00
Gour Saha 4ec1cbe86d YARN-5735. Make the service REST API use the app timeout feature YARN-4205. Contributed by Jian He 2017-11-06 13:28:33 -08:00
Jian He 7da243ebe0 YARN-5729. Bug fixes for the service Rest API. Contributed by Gour Saha 2017-11-06 13:28:33 -08:00
Jian He c0120e51b9 YARN-5689. Update native services REST API to use agentless docker provider. Contributed by Billie Rinaldi & Gour Saha 2017-11-06 13:28:33 -08:00
Jian He f66ecfecf6 Addendum patch for YARN-5610. Contributed by Gour Saha 2017-11-06 13:28:33 -08:00
Jian He 295b87d0fb YARN-5675. Swagger definition for YARN service API. Contributed by Gour Saha 2017-11-06 13:28:33 -08:00
Jian He 18bf0dce28 YARN-5610. Initial code for native services REST API. Contributed by Gour Saha 2017-11-06 13:28:33 -08:00
Jian He 9dc46aa379 YARN-5623. Apply SLIDER-1166 to yarn-native-services branch. Contributed by Gour Saha 2017-11-06 13:28:32 -08:00
Jian He bce06ed1af YARN-5505. Create an agent-less docker provider in the native-services framework. Contributed by Billie Rinaldi 2017-11-06 13:28:32 -08:00
Jian He 3279baecb9 YARN-5538. Apply SLIDER-875 to yarn-native-services. Contributed by Billie Rinaldi 2017-11-06 13:28:32 -08:00
Jian He 02e2740bdf YARN-5513. Move Java only tests from slider develop to yarn-native-services. Contributed by Gour Saha 2017-11-06 13:28:32 -08:00
Jian He 54ec9e2440 Modify pom file for slider 2017-11-06 13:28:32 -08:00
Jian He 804bb82d1b Rename org.apache.slider.core.build to org.apache.slider.core.buildutils 2017-11-06 13:28:32 -08:00
Jian He f47df51791 YARN-5461. Initial code ported from slider-core module. (jianhe) 2017-11-06 13:28:31 -08:00
Akira Ajisaka 785f1b0d11
YARN-7407. Moving logging APIs over to slf4j in hadoop-yarn-applications. Contributed by Yeliang Cang. 2017-10-31 16:36:02 +09:00
Yufei Gu 6b7c87c945 YARN-7355. TestDistributedShell should be scheduler agnostic. (Contributed by Haibo) 2017-10-20 11:15:20 -07:00
Wangda Tan e490602e9b YARN-7039. Fix javac and javadoc errors in YARN-3926 branch. (Sunil G via wangda)
Change-Id: I442bf6d838b3aba83f1f6779cf9dcf8596a2102d
2017-09-12 09:19:12 -07:00
Sunil G 7805deed48 YARN-5588. [YARN-3926] Add support for resource profiles in distributed shell. Contributed by Varun Vasudev. 2017-09-12 09:19:11 -07:00
Arun Suresh c41118a7f8 YARN-6978. Add updateContainer API to NMClient. (Kartheek Muthyala via asuresh) 2017-09-07 10:23:12 -07:00
Andrew Wang 0d419c984f Preparing for 3.1.0 development 2017-09-01 11:53:48 -07:00
Varun Saxena 3d00c8f394 Made fixes for whitespace errors and checstyle warnings before merge. 2017-08-30 11:29:54 +05:30
Sangjin Lee 092fead5d9 YARN-5792. Adopt the id prefix for YARN, MR, and DS entities. Contributed by Varun Saxena. 2017-08-30 11:29:51 +05:30
Andrew Wang af2773f609 Updating version for 3.0.0-beta1 development 2017-06-29 17:57:40 -07:00
Andrew Wang 16ad896d5c Update maven version for 3.0.0-alpha4 development 2017-05-26 14:09:44 -07:00
Daniel Templeton d81372dfad YARN-6646. Modifier 'static' is redundant for inner enums
(Contributed by ZhangBing Lin via Daniel Templeton)
2017-05-26 12:05:48 -07:00
Andrew Wang 539ef5aa2e HFDS-11596. hadoop-hdfs-client jar is in the wrong directory in release tarball. Contributed by Yuanbo Liu. 2017-04-05 16:04:09 -07:00
Chris Douglas 6eba79232f HADOOP-14271. Correct spelling of 'occurred' and variants. Contributed by Yeliang Cang 2017-04-03 20:13:14 -07:00
Sangjin Lee 4fa1afdb88 YARN-4675. Reorganize TimelineClient and TimelineClientImpl into separate classes for ATSv1.x and ATSv2. Contributed by Naganarasimha G R. 2017-02-16 11:41:04 -08:00
Andrew Wang 5d8b80ea9b Preparing for 3.0.0-alpha3 development 2017-01-19 15:50:07 -08:00
Daniel Templeton 71a4acf74b YARN-5991. Yarn Distributed Shell does not print throwable t to App Master When failed to start container
(Contributed by Jim Frankola via Daniel Templeton)
2017-01-06 14:26:08 -08:00
Robert Kanter 9262797e86 YARN-5257. Fix unreleased resources and null dereferences (yufeigu via rkanter) 2016-12-27 14:14:08 -08:00
Akira Ajisaka 209e805430 HADOOP-13506. Redundant groupid warning in child projects. Contributed by Kai Sasaki. 2016-11-28 14:34:57 +09:00
Akira Ajisaka d3bb69a667 YARN-5575. Many classes use bare yarn. properties instead of the defined constants. Contributed by Daniel Templeton. 2016-10-26 15:32:07 +09:00
Arun Suresh d6d9cff21b YARN-5221. Expose UpdateResourceRequest API to allow AM to request for change in container properties. (asuresh) 2016-08-30 15:52:29 -07:00
Andrew Wang da456ffd62 Preparing for 3.0.0-alpha2 development 2016-07-15 19:04:17 -07:00
Varun Saxena a3ac1c1943 YARN-5354. TestDistributedShell.checkTimelineV2 fails randomly for concurrent tests. (Sangjin Lee via Varun Saxena). 2016-07-12 20:41:52 +05:30
Sangjin Lee 6cf6ab7b78 Made a number of miscellaneous fixes for javac, javadoc, and checstyle warnings. 2016-07-10 08:46:05 -07:00
Varun Saxena 1ff6833bba YARN-5243. fix several rebase and other miscellaneous issues before merge. (Sangjin Lee via Varun Saxena) 2016-07-10 08:46:03 -07:00
Vrushali Channapattan 3832795e3c YARN-5210 NPE in Distributed Shell while publishing DS_CONTAINER_START event (Varun Saxena via Vrushali C) 2016-07-10 08:46:02 -07:00