Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,166 Commits 326 Branches 371 Tags
Commit Graph

672 Commits

Author SHA1 Message Date
Rohith Sharma K S
726c1f14b8 YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999). Contributed by Mohammad Shahid Khan and Varun Saxena 2016-05-19 10:50:32 +05:30
Jason Lowe
b452ecf4a0 YARN-4311. Removing nodes from include and exclude lists will not remove them from decommissioned nodes list. Contributed by Kuhu Shukla 
(cherry picked from commit ee86cef2fee992fb773e87c895000ffc2ee788b0)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml
 2016-05-05 14:40:35 +00:00
Jason Lowe
8013529746 YARN-4834. ProcfsBasedProcessTree doesn't track daemonized processes. Contributed by Nathan Roberts 
(cherry picked from commit c6b48391680c1b81a86aabc3ad4c725bfade6d2e)
 2016-05-03 22:15:31 +00:00
Jian He
5ba79d77fb YARN-5009. NMLeveldbStateStoreService database can grow substantially leading to longer recovery times. Contributed by Jason Lowe 
(cherry picked from commit 4a8508501bc753858693dacdafba61d604702f71)
 2016-04-28 21:54:53 -07:00
Jian He
e62162db46 YARN-5008. LeveldbRMStateStore database can grow substantially leading to long recovery times. Contributed by Jason Lowe 
(cherry picked from commit dd80042c42aadaa347db93028724f69c9aca69c6)
 2016-04-28 21:36:23 -07:00
Vinod Kumar Vavilapalli
92e45b8321 Fixed TimelineClient to retry SocketTimeoutException too. Contributed by Xuan Gong. 
(cherry picked from commit 477003730e6a7c7eff11892f5cedf74073ca867b)
 2016-04-18 11:51:21 -07:00
Xuan
84ab382939 YARN-4965. Distributed shell AM failed due to ClientHandlerException thrown by jersey. Contributed by Junping Du 
(cherry picked from commit e6c0742012ffeacad2bcaf712d86a7e5d1420b26)
(cherry picked from commit 94e4d349b018496ab25afc164e2f25c780010cfd)
 2016-04-16 19:40:46 -07:00
Naganarasimha
3e223d5dc0 YARN-4909. Fix intermittent failures of TestRMWebServices And TestRMWithCSRFFilter. Contributed by Bibin A Chundatt 
(cherry picked from commit fdbafbc9e59314d9f9f75e615de9d2dfdced017b)
 2016-04-16 00:00:03 +05:30
Jason Lowe
3cf7856878 Revert "YARN-4311. Removing nodes from include and exclude lists will not remove them from decommissioned nodes list. Contributed by Kuhu Shukla" 
This reverts commit 9d3c51eb5a701ae4ba296e2fd3fba154fa0097c0.
 2016-04-11 15:57:56 +00:00
Akira Ajisaka
13be7a849d YARN-4630. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta. 
(cherry picked from commit 1ff27f9d12e8124c1b9a722708264c5b07fd0fde)
(cherry picked from commit 8cf6630fc6cedbd86eff9da6f35ce1da4ed7ed2f)
 2016-04-11 14:55:54 +09:00
Jason Lowe
9d3c51eb5a YARN-4311. Removing nodes from include and exclude lists will not remove them from decommissioned nodes list. Contributed by Kuhu Shukla 
(cherry picked from commit 1cbcd4a491e6a57d466c2897335614dc6770b475)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml
 2016-04-05 13:47:05 +00:00
naganarasimha
9bd089ac64 YARN-4746. yarn web services should convert parse failures of appId, appAttemptId and containerId to 400. Contributed by Bibin A Chundatt 
(cherry picked from commit 5092c94195a63bd2c3e36d5a74b4c061cea1b847)
 2016-04-04 18:16:23 +05:30
Arun Suresh
82d1f858ee Missing file for YARN-4895. 
(cherry picked from commit 5686caa9fcb59759c9286385575f31e407a97c16)
 2016-04-01 15:58:54 -07:00
Sangjin Lee
5e94e539e0 YARN-4183. Clarify the behavior of timeline service config properties (Naganarasimha G R via sjlee) 
(cherry picked from commit 6d67420dbc5c6097216fa40fcec8ed626b2bae14)
 2016-03-31 10:50:18 -07:00
Jason Lowe
e06446be74 YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. Contributed by Xuan Gong 
(cherry picked from commit e8fc81f9c812b0c167411de7f1789a9a433a0d57)
 2016-03-25 20:20:01 +00:00
Junping Du
762c7d4361 YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. Contributed by Xuan Gong. 
(cherry picked from commit af1d125f9ce35ec69a610674a1c5c60cc17141a7)
(cherry picked from commit 76602161c006ddc9cf2404ac762f127f107d14cd)
 2016-03-23 09:02:56 -07:00
Xuan
d21bee170b Revert "YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. (Xuan Gong via gtcarrera9)" 
This reverts commit 3a0b69544183f71c4683bc477656473494fc09d0.

(cherry picked from commit a888b5bc533bb91a3394f15a69879be1d7838592)
(cherry picked from commit 398dbde538e0bda2ec8a3b9f21c52526dfa90754)
 2016-03-15 22:12:05 -07:00
Li Lu
8640a9c45f YARN-4817. Change Log Level to DEBUG for putDomain call in ATS 1.5. (Xuan Gong via gtcarrera9) 
(cherry-picked from commit 5176a69868484f864c977a6cd13923167082407c)
 2016-03-15 11:49:09 -07:00
Li Lu
0ebc947140 YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. (Xuan Gong via gtcarrera9) 
(cherry picked from commit 3a0b69544183f71c4683bc477656473494fc09d0)
 2016-03-15 11:43:39 -07:00
Junping Du
4f5b496b8a YARN-4545. Allow YARN distributed shell to use ATS v1.5 APIs. Li Lu via junping_du 
(cherry picked from commit f291d82cd49c04a81380bc45c97c279d791b571c)
(cherry picked from commit 3d5ac829da9946ec0de0309e39f5b7269ee7b0c0)
 2016-03-14 08:34:08 -07:00
Li Lu
8e89bb9d38 YARN-4696. Improving EntityGroupFSTimelineStore on exception handling, test setup, and concurrency. (Steve Loughran via gtcarrera9) 
(cherry-picked from commit d49cfb350454c2dfa2f3eb70f79b6d5030ce7bec)
 2016-03-10 10:58:51 -08:00
Li Lu
b22f4db3a0 YARN-4680. TimerTasks leak in ATS V1.5 Writer. (Xuan Gong via 
gtcarrera9)

(cherry picked from commit 9e0f7b8b69ead629f999aa86c8fb7eb581e175d8)
 2016-02-24 14:08:28 -08:00
Sangjin Lee
6b59e59865 YARN-4722. AsyncDispatcher logs redundant event queue sizes (Jason Lowe via sjlee) 
(cherry picked from commit 553b591ba06bbf0b18dca674d25a48218fed0a26)
 2016-02-24 09:32:54 -08:00
Varun Vasudev
5f68f640a5 YARN-4709. NMWebServices produces incorrect JSON for containers. Contributed by Varun Saxena. 
(cherry picked from commit 140cb5d74565aad848b40a251ec02b597a3a20d4)
(cherry picked from commit 2c218ca8a8da9bdea3ba052da10d87e5716c1d16)
 2016-02-23 12:33:11 +05:30
Zhe Zhang
6d4a4e785b HADOOP-12668. Support excluding weak Ciphers in HttpServer2 through ssl-server.conf. Contributed by Vijay Singh. 
Change-Id: Ie46a5427d29188935427f67e55203c19fcd83335
 2016-02-22 14:15:11 -08:00
Arun Suresh
379c2f4c05 YARN-2575. Create separate ACLs for Reservation create/update/delete/list ops (Sean Po via asuresh) 2016-02-11 15:54:45 -08:00
Devaraj K
aeea77ce14 YARN-4100. Add Documentation for Distributed and Delegated-Centralized 
Node Labels feature. Contributed by Naganarasimha G R.

(cherry picked from commit db144eb1c51c1f37bdd1e0c18e9a5b0969c82e33)
 2016-02-02 12:08:56 +05:30
Wangda Tan
c487453b91 YARN-4340. Add list API to reservation system. (Sean Po via wangda) 
(cherry picked from commit 9875325d5c63f343809907d06bf48a298035a611)
 2016-02-02 10:23:25 +08:00
Xuan
353518f54c YARN-4219. New levelDB cache storage for timeline v1.5. Contributed by 
Li Lu

(cherry picked from commit 9fab22b36673e7f1a0bb629d2c07966ac2482e99)
(cherry picked from commit 2f00d8d3a7e8b41d073c8ed0e6efcb12f8758c0e)
 2016-01-28 14:37:27 -08:00
Wangda Tan
5dc2e78c97 HADOOP-12356. Fix computing CPU usage statistics on Windows. (Inigo Goiri via wangda) 
(cherry picked from commit 89d1fd5dac4bccf42d82686e146b02eb60d14736)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2016-01-19 21:31:35 +08:00
Junping Du
a04f29ca90 YARN-4265. Provide new timeline plugin storage to support fine-grained entity caching. Contributed by Li Lu and Jason Lowe 
(cherry picked from commit 02f597c5db36ded385413958bdee793ad7eda40e)
(cherry picked from commit 4a30a44b115ce5164b7bd4689ad78339bf940c00)
 2016-01-17 17:44:17 -08:00
rohithsharmaks
9baeae9368 YARN-4389. Allow application to enable or disable am blacklisting. (Sunil G via rohithsharmaks) 
(cherry picked from commit d3c08cde68cbf31c7fc7b479be1da10072363ac0)
 2016-01-15 22:48:43 +05:30
Jason Lowe
a8292161fc YARN-4414. Nodemanager connection errors are retried at multiple levels. Contributed by Chang Li 
(cherry picked from commit 13de8359a1c6d9fc78cd5013c860c1086d86176f)
 2016-01-12 15:57:44 +00:00
Akira Ajisaka
3fced13eae HADOOP-12584. Disable browsing the static directory in HttpServer2. Contributed by Robert Kanter. 
(cherry picked from commit 9c89bcd04212543ae279d34938ec2ad319e5ba6d)
(cherry picked from commit 6f80be98758ff5d53a192f86ada6cc4062fcdef8)
 2016-01-12 13:35:03 +09:00
Junping Du
ce74b17028 YARN-4400. AsyncDispatcher.waitForDrained should be final. Contributed by Daniel Templeton. 
(cherry picked from commit bb5df272b9c0be9830ee8480cd33e75d26deb9d1)
(cherry picked from commit dbc4c79b446564502c62c51ce65096bd1b605e89)
 2015-12-23 08:56:37 -08:00
Junping Du
630b637ff3 YARN-4234. New put APIs in TimelineClient for ats v1.5. Contributed by Xuan Gong. 
(cherry picked from commit 882f2f04644a13cadb93070d5545f7a4f8691fde)
(cherry picked from commit 6e97a3c9686b847e6047e12b7e53a8316e2bebfa)
 2015-12-23 05:31:16 -08:00
cnauroth
eb5f46e34f YARN-3458. CPU resource monitoring in Windows. Contributed by Inigo Goiri. 
(cherry picked from commit 114b59095540bb80db5153c816f9d285e4029031)
(cherry picked from commit fdfcffb3d1054ae9587a66e4919a0bb10720df55)
 2015-12-21 16:59:24 -08:00
Wangda Tan
01c813d210 YARN-4454. NM to nodelabel mapping going wrong after RM restart. (Bibin A Chundatt via wangda) 
(cherry picked from commit bc038b382cb2ce561ce718405fbcee4382f3b204)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-12-21 11:31:54 -08:00
Wangda Tan
c4b1386b4e YARN-4225. Add preemption status to yarn queue -status for capacity scheduler. (Eric Payne via wangda) 
(cherry picked from commit 7faa406f27f687844c941346f59a27a375af3233)
(cherry picked from commit 2f5435acbda53470724d833cfa1c58dc3c3c9bb1)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-12-18 16:34:45 -08:00
Wangda Tan
9ed9eb265f YARN-4293. ResourceUtilization should be a part of yarn node CLI. (Sunil G via wangda) 
(cherry picked from commit 79c41b1d83e981ae74cb8b58ffcf7907b7612ad4)
(cherry picked from commit 9f4a6ec6630f3776859f8d677532370095a58d0c)
 2015-12-18 16:34:45 -08:00
Wangda Tan
c7e10d70de YARN-4309. Add container launch related debug information to container logs when a container fails. (Varun Vasudev via wangda) 
(cherry picked from commit dfcbbddb0963c89c0455d41223427165b9f9e537)
(cherry picked from commit 9f979107c22f365633811a38363d0dbd34573374)
 2015-12-18 16:34:44 -08:00
Xuan
41986d5373 YARN-3623-Addendum: Improve the description for Timeline Service Version configuration in yarn-default.xml 
(cherry picked from commit 21daa6c68a0bff51a14e748bf14d56b2f5a5580f)
(cherry picked from commit 455c6f39c582f5f482f0dc255d111e6fe149e66a)
 2015-12-18 16:34:43 -08:00
Jian He
12772f5a45 Add missing file for YARN-4419 
(cherry picked from commit 8a97ca4b00c4eea044d90e8ed0dc75038bd67bc6)
 2015-12-18 16:34:42 -08:00
Jian He
f355645ca4 YARN-4405. Support node label store in non-appendable file system. Contributed by Wangda Tan 
(cherry picked from commit 755dda8dd8bb23864abc752bad506f223fcac010)

(cherry picked from commit be404e168060c03a33a35c8d30925e317a64cad7)
 2015-12-18 16:34:42 -08:00
Jian He
9c22910570 YARN-4398. Remove unnecessary synchronization in RMStateStore. Contributed by Ning Ding 
(cherry picked from commit 48cbde908319775b82ae30f262cca0503866e88e)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-12-18 16:33:53 -08:00
Jian He
16f7ac48d4 YARN-4403. (AM/NM/Container)LivelinessMonitor should use monotonic time when calculating period. Contributed by Junping Du 2015-12-14 13:52:33 -08:00
Junping Du
5adf7d851c YARN-3623. Add a config to indicate the Timeline Service version. Contributed by Xuan Gong. 
(cherry picked from commit f910e4f639dc311fcb257bfcb869b1aa8b2c0643)
(cherry picked from commit 0b5e76e9ff14811ad2617e632854f21d82558e5e)
 2015-12-10 02:58:28 -08:00
rohithsharmaks
03e615ba55 YARN-3456. Improve handling of incomplete TimelineEntities. (Varun Saxena via rohithsharmaks) 
(cherry picked from commit 01a641bc447c464b2830d58addd482f47dbd92ae)
 2015-12-07 15:20:50 +05:30
Jason Lowe
3a2f5d6329 YARN-4365. FileSystemNodeLabelStore should check for root dir existence on startup. Contributed by Kuhu Shukla 
(cherry picked from commit f5acf94ecafb301a0cc8e8f91f19c8bcbc8da701)
 2015-11-24 23:47:54 +00:00
Jason Lowe
9e54433c6c YARN-4132. Separate configs for nodemanager to resourcemanager connection timeout and retries. Contributed by Chang Li 
(cherry picked from commit 4ac6799d4a8b071e0d367c2d709e84d8ea06942d)
 2015-11-24 22:36:19 +00:00