Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,600 Commits 326 Branches 371 Tags
Commit Graph

4845 Commits

Author SHA1 Message Date
Weiwei Yang
0ee7e80047 YARN-8559. Expose mutable-conf scheduler's configuration in RM /scheduler-conf endpoint. Contributed by Weiwei Yang. 
(cherry picked from commit d352f167ebb865a6486afbbdac8e2a5e97a7bbad)
 2018-08-10 00:43:53 +08:00
Jason Lowe
3dd299a770 YARN-8331. Race condition in NM container launched after done. Contributed by Pradeep Ambati 
(cherry picked from commit cd04e954d2db27f0a15b7d1c492b7cdb656a51db)
 2018-08-09 10:23:02 -05:00
Sunil G
c6013b060d YARN-8633. Update DataTables version in yarn-common in line with JQuery 3 upgrade. Contributed by Akhil PB. 
(cherry picked from commit 00013d6ef7fdf65fa8a0f6eb56c0aef2f6e19444)
 2018-08-09 12:35:21 +05:30
Bharat Viswanadham
5430aab133 YARN-8426:Upgrade jquery-ui to 1.12.1 in YARN. Contributed by Sunil Govindan 
(cherry picked from commit 361ffb26bebf2491bbe3219ef4a83eb753660018)
 2018-08-09 12:27:50 +05:30
Robert Kanter
0ed91309d3 YARN-8568. Replace the deprecated zk-address property in the HA config example in ResourceManagerHA.md (bsteinbach via rkanter) 
(cherry picked from commit 8478732bb28e9e71061d6b4a043a3a1b5c688902)
 2018-08-08 15:10:52 -07:00
Wangda Tan
f16c311486 Make 3.1.1 awared by other branches - adding missing files 
(cherry picked from commit 3214cd75acd0474373951870e1ba2ec11833a3da)
 2018-08-08 13:06:14 -07:00
Wangda Tan
781620a44d Make 3.1.1 awared by other branches 
(cherry picked from commit 49c687608b65b772faeed614700ece8e526432e8)
 2018-08-08 13:04:05 -07:00
bibinchundatt
b4f957e655 YARN-8601. Print ExecutionType in Container report CLI. Contributed by Bilwa S T. 
(cherry picked from commit ff06bd1be83a2a6d2ee39cb002e91499720a7243)
 2018-08-08 22:46:16 +05:30
Wangda Tan
f2768eaa38 YARN-8407. Container launch exception in AM log should be printed in ERROR level. (Yesha Vora via wangda) 
Change-Id: I154e873df1df3503a09c41d6b3874ca195af91d9
(cherry picked from commit 861095f761b40171e0dc25f769f486d910cc3e88)
 2018-08-07 13:07:28 -07:00
Wangda Tan
450c791ecf YARN-8629. Container cleanup fails while trying to delete Cgroups. (Suma Shivaprasad via wangda) 
Change-Id: I392ef4f8baa84d5d7b1f2e438c560b5426b6d4f2
(cherry picked from commit d4258fcad71eabe2de3cf829cde36840200ab9b6)
 2018-08-07 12:41:55 -07:00
Eric Yang
947dc34229 YARN-8624. Updated verbiage around entry point support. 
Contributed by Craig Condit
 2018-08-06 12:39:22 -04:00
Shane Kumpf
7773904974 YARN-8287. Update documentation and yarn-default related to the Docker runtime. Contributed by Craig Condit 
(cherry picked from commit bcfc9851f4c6d37d9a119c16ea7d4d253d3b9614)
 2018-08-03 18:23:37 -06:00
Sunil G
d8fdcf8b42 YARN-8615. [UI2] Resource Usage tab shows only memory related info. No info available for vcores/gpu. Contributed by Akhil PB. 
(cherry picked from commit 3426f4062ae0867c1ff5c71bd4e3dcb2f1affb89)
 2018-08-03 19:36:19 +05:30
Sunil G
1bfce639e8 YARN-8620. [UI2] YARN Services UI new submission failures are not debuggable. Contributed by Akhil PB. 
(cherry picked from commit 29417dbbf4f6e3881baaaa97408b335c32fe6708)
 2018-08-03 19:19:17 +05:30
Rohith Sharma K S
4816d10ddb YARN-8608. [UI2] No information available per application appAttempt about 'Total Outstanding Resource Requests'. Contributed by Akhil PB. 
(cherry picked from commit 022592ae7941607091fa85e4a9e8608ba53f3814)
 2018-08-03 15:33:36 +05:30
Rohith Sharma K S
83ccb75b91 YARN-8603. [UI2] Latest run application should be listed first in the RM UI. Contributed by Akhil PB. 
(cherry picked from commit 33482d35e802ac3468317b844122b347fe486861)
 2018-08-03 15:33:24 +05:30
Jason Lowe
619019ccca YARN-8263. DockerClient still touches hadoop.tmp.dir. Contributed by Craig Condit 
(cherry picked from commit 7526815e3234ca352854ecfb142a13f1a188d5bd)
 2018-08-02 10:45:52 -05:00
Sunil G
d76ab31961 YARN-8318. [UI2] IP address in component page shows N/A. Contributed by Yesha Vora. 
(cherry picked from commit 5033d7da8f6f703d8774492c42e31e9b9cb692a5)
 2018-08-02 20:10:08 +05:30
Sunil G
b1fcbe7c2d YARN-8592. [UI2] rmip:port/ui2 endpoint shows a blank page in windows OS and Chrome browser. Contributed by Akhil PB. 
(cherry picked from commit 97870ec1f6e40ee863333f29411d71b6c687bbed)
 2018-08-02 16:12:12 +05:30
Sunil G
35b0686f24 YARN-8594. [UI2] Display current logged in user. Contributed by Akhil PB. 
(cherry picked from commit 1ea81169bad5bd6433348ef8e5e7ac12c5a9cb5e)
 2018-08-02 12:41:59 +05:30
Sunil G
1f77b20f08 YARN-8593. Add RM web service endpoint to get user information. Contributed by Akhil PB. 
(cherry picked from commit 735b4925569541fb8e65dc0c668ccc2aa2ffb30b)
 2018-08-02 08:35:54 +05:30
Eric Yang
680dac26d8 YARN-8610. Fixed initiate upgrade error message. 
Contributed by Chandni Singh

(cherry picked from commit 23f394240e1568a38025e63e9dc0842e8c5235f7)
 2018-08-01 20:43:22 -04:00
Shane Kumpf
62cc373dc5 YARN-8600. RegistryDNS hang when remote lookup does not reply. Contributed by Eric Yang 
(cherry picked from commit 603a57476ce0bf9514f0432a235f29432ca4c323)
 2018-08-01 12:31:28 -06:00
Billie Rinaldi
2a94823f32 YARN-8403. Change the log level for fail to download resource from INFO to ERROR. Contributed by Eric Yang 
(cherry picked from commit 67c65da261464a0dccb63dc27668109a52e05714)
 2018-08-01 08:58:15 -07:00
Sunil G
a6525e0744 YARN-8595. [UI2] Container diagnostic information is missing from container page. Contributed by Akhil PB. 
(cherry picked from commit d920b9db77be44adc4f8a2a0c2df889af82be04f)
 2018-08-01 14:28:35 +05:30
Sunil G
ff35f0c308 YARN-8606. Opportunistic scheduling does not work post RM failover. Contributed by Bibin A Chundatt. 
(cherry picked from commit a48a0cc7fd8e7ac1c07b260e6078077824f27c35)
 2018-08-01 12:17:53 +05:30
Wangda Tan
f4a3b26f9a YARN-8522. Application fails with InvalidResourceRequestException. (Zian Chen via wangda) 
Change-Id: I34dd7fa49bd4d10580c4a78051033b1068d28f1e
(cherry picked from commit 5cc8e99147276a059979813f7fd323dd7d77b248)
 2018-07-31 22:35:16 -07:00
Sunil G
cbfd7358d2 YARN-8397. Potential thread leak in ActivitiesManager. Contributed by Rohith Sharma K S. 
(cherry picked from commit 6310c0d17d6422a595f856a55b4f1fb82be43739)
 2018-08-01 08:34:09 +05:30
Eric Yang
7640d62716 YARN-8579. Recover NMToken of previous attempted component data. 
Contributed by Gour Saha
 2018-07-31 18:35:31 -04:00
Wangda Tan
5583711419 Preparing for 3.1.2 release 
Change-Id: If2793e2ed2b5b349a9e1f98f78df43f309dcfcbd
 2018-07-31 13:08:55 -07:00
Wangda Tan
7b552c9d72 YARN-8418. App local logs could leaked if log aggregation fails to initialize for the app. (Bibin A Chundatt via wangda) 
Change-Id: I29a23ca4b219b48c92e7975cd44cddb8b0e04104
(cherry picked from commit 4b540bbfcf02d828052999215c6135603d98f5db)
 2018-07-31 12:13:36 -07:00
Jonathan Hung
b91cf90e1c YARN-7974. Allow updating application tracking url after registration. Contributed by Jonathan Hung 2018-07-30 17:57:25 -07:00
bibinchundatt
8cd2a73777 YARN-8584. Several typos in Log Aggregation related classes. Contributed by Szilard Nemeth. 
(cherry picked from commit 2b39ad26984d641bad57db2cfcc0b7515ef95f46)
 2018-07-31 00:07:08 +05:30
Sunil G
f1eb5777a0 YARN-8591. [ATSv2] NPE while checking for entity acl in non-secure cluster. Contributed by Rohith Sharma K S. 
(cherry picked from commit 63e08ec071852640babea9e39780327a0907712a)
 2018-07-30 14:49:03 +05:30
bibinchundatt
2e7876a725 YARN-8558. NM recovery level db not cleaned up properly on container finish. Contributed by Bibin A Chundatt. 
(cherry picked from commit 3d586841aba99c7df98b2b4d3e48ec0144bad086)
 2018-07-28 20:56:35 +05:30
Eric Yang
c2c3eee69c YARN-8508. Release GPU resource for killed container. 
Contributed by Chandni Singh

(cherry picked from commit ed9d60e888d0acfd748fda7f66249f5b79a3ed6d)
 2018-07-27 19:36:21 -04:00
Billie Rinaldi
06166f2255 YARN-8571. Validate service principal format prior to launching yarn service. Contributed by Eric Yang 
(cherry picked from commit b429f19d32d8f60a3535e047ef10cfb3edeb54c8)
 2018-07-27 11:35:41 -07:00
Eric Yang
d6627cda9d YARN-8429. Improve diagnostic message when artifact is not set properly. 
Contributed by Gour Saha

(cherry picked from commit 8d3c068e59fdddd18e3f8260713fee83c458aa1d)
 2018-07-27 11:29:43 -04:00
Eric Yang
177f6045ac YARN-8545. Return allocated resource to RM for failed container. 
Contributed by Chandni Singh

(cherry picked from commit 40fad32824d2f8f960c779d78357e62103453da0)
 2018-07-26 18:25:41 -04:00
Eric Yang
8e3807afe0 YARN-8330. Improved publishing ALLOCATED events to ATS. 
Contributed by Suma Shivaprasad

(cherry picked from commit f93ecf5c1e0b3db27424963814fc01ec43eb76e0)
 2018-07-25 18:51:42 -04:00
Eric E Payne
830ef12af8 YARN-4606. CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps. Contributed by Manikandan R 
(cherry picked from commit 9485c9aee6e9bb935c3e6ae4da81d70b621781de)
 2018-07-25 16:30:30 +00:00
bibinchundatt
8e65057eb1 YARN-8541. RM startup failure on recovery after user deletion. Contributed by Bibin A Chundatt. 2018-07-25 15:54:32 +05:30
Weiwei Yang
b89624a943 YARN-8546. Resource leak caused by a reserved container being released more than once under async scheduling. Contributed by Tao Yang. 
(Cherry-picked from commit 5be9f4a5d05c9cb99348719fe35626b1de3055db)
 2018-07-25 17:53:40 +08:00
Haibo Chen
7e7792dd7b YARN-6966. NodeManager metrics may return wrong negative values when NM restart. (Szilard Nemeth via Haibo Chen) 
(cherry picked from commit 9d3c39e9dd88b8f32223c01328581bb68507d415)
 2018-07-24 12:50:43 -07:00
Sunil G
4488fd8295 YARN-7748. TestContainerResizing.testIncreaseContainerUnreservedWhenApplicationCompleted fails due to multiple container fail events. Contributed by Weiwei Yang. 
(cherry picked from commit 35ce6eb1f526ce3db7e015fb1761eee15604100c)
 2018-07-24 22:21:15 +05:30
bibinchundatt
a684a2efb8 YARN-8548. AllocationRespose proto setNMToken initBuilder not done. Contributed by Bilwa S T. 
(cherry picked from commit ff7c2eda34c2c40ad71b50df6462a661bd213fbd)
 2018-07-24 16:30:31 +05:30
bibinchundatt
0710107f8d YARN-8544. [DS] AM registration fails when hadoop authorization is enabled. Contributed by Bibin A Chundatt. 
(cherry picked from commit 84612788339392fcda1aef0e27c43f5c6b2a19e5)
 2018-07-24 13:11:31 +05:30
Eric Yang
23b8546a80 YARN-8380. Support bind propagation options for mounts in docker runtime. 
Contributed by Billie Rinaldi

(cherry picked from commit 8688a0c7f88f2adf1a7fce695e06f3dd1f745080)
 2018-07-23 20:13:41 -04:00
Eric Yang
e665c0a9dd YARN-8360. Improve YARN service restart policy and node manager auto restart policy. 
Contributed by Suma Shivaprasad

(cherry picked from commit 84d7bf1eeff6b9418361afa4aa713e5e6f771365)
 2018-07-23 12:59:37 -04:00
Eric Yang
4f2a129f2e YARN-8301. Added YARN service upgrade instructions. 
Contributed by Chandni Singh

(cherry picked from commit 10014a4d88f239d3c072e51bc0739cba1fca9406)
 2018-07-20 19:48:19 -04:00