Commit Graph

17280 Commits

Author SHA1 Message Date
Sunil G fb62bd625f YARN-7445. Render Applications and Services page with filters in new YARN UI. Contributed by Vasudevan Skm. 2017-11-13 19:41:49 +05:30
Subru Krishnan 3e26077848 YARN-7475. Fix Container log link in new YARN UI. (Sunil G via Subru).
(cherry picked from commit 3c5b46c2ed)
2017-11-12 09:53:39 -08:00
Sunil G ff9f7fcf7f YARN-7452. Decommissioning node default value to be zero in new YARN UI. Contributed by Vasudevan Skm. 2017-11-11 16:52:31 +05:30
bibinchundatt 2c2b7a3672 YARN-7406. Moving logging APIs over to slf4j in hadoop-yarn-api. Contributed by Yeliang Cang. 2017-11-11 10:36:27 +05:30
Chris Douglas 796a0d3a5c HADOOP-8522. ResetableGzipOutputStream creates invalid gzip files when finish() and resetState() are used. Contributed by Mike Percy 2017-11-10 17:41:29 -08:00
Arpit Agarwal 6d201f77c7 HDFS-12498. Journal Syncer is not started in Federated + HA cluster. Contributed by Bharat Viswanadham. 2017-11-10 16:30:38 -08:00
Arpit Agarwal 1d6f8bebe9 HADOOP-14929. Cleanup usage of decodecomponent and use QueryStringDecoder from netty. Contributed by Bharat Viswanadham. 2017-11-10 16:28:12 -08:00
Jitendra Pandey 8a1bd9a4f4 HDFS-12797. Add Test for NFS mount of not supported filesystems like (file:///). Contributed by Mukul Kumar Singh. 2017-11-09 23:53:17 -08:00
Xiao Chen 3c6adda291 HADOOP-14960. Add GC time percentage monitor/alerter. Contributed by Misha Dmitriev. 2017-11-09 21:06:06 -08:00
Chen Liang 10a1f557e7 HDFS-12791. NameNode Fsck http Connection can timeout for directories with multiple levels. Contributed by Mukul Kumar Singh. 2017-11-09 18:47:34 -08:00
Arun Suresh 5eb7dbe9b3 Fixing Job History Server Configuration parsing. (Jason Lowe via asuresh) 2017-11-09 15:15:51 -08:00
Wangda Tan dd07038ffa YARN-6909. Use LightWeightedResource when number of resource types more than two. (Sunil G via wangda)
Change-Id: I90e021c5dea7abd9ec6bd73b2287c8adebe14595
2017-11-09 14:51:15 -08:00
Sean Mackrory 1883a00249 YARN-7465. start-yarn.sh fails to start ResourceManagers unless running as root. 2017-11-09 14:47:43 -07:00
Konstantinos Karanasos ac4d2b1081 YARN-7437. Rename PlacementSet and SchedulingPlacementSet. (Wangda Tan via kkaranasos) 2017-11-09 13:01:24 -08:00
Robert Kanter a2c150a736 YARN-7386. Duplicate Strings in various places in Yarn memory (misha@cloudera.com via rkanter) 2017-11-09 12:12:52 -08:00
Daniel Templeton ba8136615a YARN-7413. Support resource type in SLS (Contributed by Yufei Gu via Daniel Templeton)
Change-Id: Ic0a897c123c5d2f57aae757ca6bcf1dad7b90d2b
2017-11-09 12:09:48 -08:00
Daniel Templeton 462f6c490e YARN-7143. FileNotFound handling in ResourceUtils is inconsistent
Change-Id: Ib1bb487e14a15edd2b5a42cf5078c5a2b295f069
2017-11-09 11:58:49 -08:00
Haibo Chen a1382a18df YARN-7388. TestAMRestart should be scheduler agnostic. 2017-11-09 10:49:50 -08:00
John Zhuge 6c32ddad30 HADOOP-14872. CryptoInputStream should implement unbuffer. Contributed by John Zhuge. 2017-11-09 10:16:12 -08:00
John Zhuge bf6a660232 HADOOP-15012. Add readahead, dropbehind, and unbuffer to StreamCapabilities. Contributed by John Zhuge. 2017-11-09 10:16:12 -08:00
bibinchundatt 0a72c2f56c YARN-7454. RMAppAttemptMetrics#getAggregateResourceUsage can NPE due to double lookup. Contributed by Jason Lowe. 2017-11-09 21:01:19 +05:30
Akira Ajisaka 3a3566e1d1
HDFS-12732. Correct spellings of ramdomly to randomly in log. Contributed by hu xiaodong. 2017-11-09 15:14:46 +09:00
Subru Krishnan f2df6b8983 HADOOP-15025. Ensure singleton for ResourceEstimatorService. (Rui Li via Subru). 2017-11-08 18:07:12 -08:00
Daniel Templeton 49b4c0b334 YARN-7458. TestContainerManagerSecurity is still flakey
(Contributed by Robert Kanter via Daniel Templeton)

Change-Id: Ibb1975ad086c3a33f8af0b4f8b9a13c3cdca3f7d
2017-11-08 17:31:14 -08:00
Daniel Templeton 0de10680b7 YARN-7166. Container REST endpoints should report resource types
Change-Id: If9c2fe58d4cf758bb6b6cf363dc01f35f8720987
2017-11-08 16:43:49 -08:00
Arun Suresh cb35a59589 YARN-7343. Add a junit test for ContainerScheduler recovery. (Sampada Dehankar via asuresh) 2017-11-08 08:14:02 -08:00
Arun Suresh a9c70b0e84 YARN-7453. Fix issue where RM fails to switch to active after first successful start. (Rohith Sharma K S via asuresh) 2017-11-08 08:00:53 -08:00
Akira Ajisaka e4c220ee4f
MAPREDUCE-7001. Moving logging APIs over to slf4j in hadoop-mapreduce-client-shuffle. Contributed by Jinjiang Ling. 2017-11-08 19:28:08 +09:00
Akira Ajisaka ffee10b68e
MAPREDUCE-6997. Moving logging APIs over to slf4j in hadoop-mapreduce-client-hs. Contributed by Gergely Novák. 2017-11-08 19:21:43 +09:00
Brahma Reddy Battula 410d0319cf HDFS-12788. Reset the upload button when file upload fails. Contributed by Brahma Reddy Battula 2017-11-08 14:41:16 +05:30
Weiwei Yang bb8a6eea52 HDFS-7060. Avoid taking locks when sending heartbeats from the DataNode. Contributed by Jiandan Yang. 2017-11-08 10:22:13 +08:00
Andrew Wang 51e882d5c9 HADOOP-15018. Update JAVA_HOME in create-release for Xenial Dockerfile. 2017-11-07 16:39:04 -08:00
Daniel Templeton 8db9d61ac2 YARN-7401. Reduce lock contention in ClusterNodeTracker#getClusterCapacity() 2017-11-07 14:53:48 -08:00
Wangda Tan 13fa2d4e3e YARN-7394. Merge code paths for Reservation/Plan queues and Auto Created queues. (Suma Shivaprasad via wangda) 2017-11-06 21:38:24 -08:00
Haibo Chen 8f214dc4f8 YARN-7360. TestRM.testNMTokenSentForNormalContainer() should be scheduler agnostic. 2017-11-06 15:45:37 -08:00
Jian He cbc632d9ab Merge branch 'yarn-native-services' into trunk 2017-11-06 14:02:19 -08:00
Jian He a55d0738f1 YARN-7371. Added allocateRequestId in NMContainerStatus for recovery. Contributed by Chandni Singh 2017-11-06 13:30:20 -08:00
Billie Rinaldi a127f7b0fb YARN-7423. Improve service client loggings. Contributed by Jian He 2017-11-06 13:30:20 -08:00
Billie Rinaldi a6c4bd74b6 YARN-6394. Support specifying YARN related params in the service REST API. Contributed by Jian He 2017-11-06 13:30:20 -08:00
Jian He a288b0accf YARN-7331. Change in few metrics in new YARN UI related to native-services. Contributed by Sunil G 2017-11-06 13:30:20 -08:00
Jian He ba7ed7b66a YARN-7384. Remove apiserver cmd and merge service cmd into application cmd. Contributed by Billie Rinaldi 2017-11-06 13:30:19 -08:00
Billie Rinaldi 8ec9e72cc3 YARN-7393. RegistryDNS doesn't work in tcp channel. Contributed by Eric Yang 2017-11-06 13:30:19 -08:00
Billie Rinaldi d2775fbcca YARN-7351. Fix high CPU usage issue in RegistryDNS. Contributed by Jian He 2017-11-06 13:30:19 -08:00
Billie Rinaldi 501be9b4be YARN-7326. Add recursion support and configure RegistryDNS to lookup upstream. Contributed by Eric Yang 2017-11-06 13:30:19 -08:00
Billie Rinaldi 68acd88dcb YARN-7323. Data structure update in service REST API. Contributed by Jian He 2017-11-06 13:30:18 -08:00
Jian He 3c30b1a97d Rebase to trunk 2017-11-06 13:30:18 -08:00
Jian He 9273480084 YARN-7198. Add jsvc support for RegistryDNS. Contributed by Billie Rinaldi 2017-11-06 13:30:18 -08:00
Jian He b57144a172 YARN-7202. Add UT for api-server. Contributed by Eric Yang 2017-11-06 13:30:18 -08:00
Jian He b8a7ef1b64 YARN-6744. Recover component information on YARN native services AM restart. Contributed by Billie Rinaldi 2017-11-06 13:30:18 -08:00
Jian He c723021579 YARN-6626. Embed REST API service into RM. Contributed by Eric Yang 2017-11-06 13:30:17 -08:00