Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,716 Commits 326 Branches 371 Tags
Commit Graph

1262 Commits

Author SHA1 Message Date
Karthik Kambatla
4ddcc7e5b5 YARN-3464. Race condition in LocalizerRunner kills localizer before localizing all resources. (Zhihai Xu via kasha) 
(cherry picked from commit 47279c3228185548ed09c36579b420225e4894f5)
(cherry picked from commit 4045c41afe440b773d006e962bf8a5eae3fdc284)
 2015-04-27 13:37:06 -07:00
Xuan
bec78f9b85 YARN-3516. killing ContainerLocalizer action doesn't take effect when 
private localizer receives FETCH_FAILURE status. Contributed by zhihai
xu

(cherry picked from commit 0b3f8957a87ada1a275c9904b211fdbdcefafb02)
(cherry picked from commit 8f6053ae517d30dedece4f0577341ec3c2482252)
 2015-04-27 13:35:38 -07:00
Karthik Kambatla
b5cc78e57e YARN-3465. Use LinkedHashMap to preserve order of resource requests. (Zhihai Xu via kasha) 
(cherry picked from commit 6495940eae09418a939882a8955845f9241a6485)
(cherry picked from commit 53e0bf5c172c396780b96fda8dd31ad799a25fed)
 2015-04-27 12:39:21 -07:00
Jian He
5cf35b98e1 YARN-3472. Fixed possible leak in DelegationTokenRenewer#allTokens. Contributed by Rohith Sharmaks 
(cherry picked from commit a1afbc48b53f6bdbd30dc8eb56a7621d49c5d6db)
 2015-04-23 17:43:41 -07:00
Jian He
6cc0e9baa1 YARN-3382. Some of UserMetricsInfo metrics are incorrectly set to root queue metrics. Contributed by Rohit Agarwal 
(cherry picked from commit 944a16579fdb54c1c420162ef830ef2ac5451c69)
 2015-04-23 17:40:56 -07:00
Karthik Kambatla
e1843c9a46 YARN-3351. AppMaster tracking URL is broken in HA. (Anubhav Dhoot via kasha) 
(cherry picked from commit 20b49224eb90c796f042ac4251508f3979fd4787)
 2015-04-23 17:39:50 -07:00
Steve Loughran
b3f2826bfb YARN-2605. [RM HA] Rest api endpoints doing redirect incorrectly. (Xuan Gong via stevel) 2015-04-23 09:22:09 +01:00
Wangda Tan
d6105d944c YARN-3487. CapacityScheduler scheduler lock obtained unnecessarily when calling getQueue (Jason Lowe via wangda) 
(cherry picked from commit f47a5763acd55cb0b3f16152c7f8df06ec0e09a9)
 2015-04-17 17:23:34 -07:00
Akira Ajisaka
48d6e994bf MAPREDUCE-6300. Task list sort by task id broken. Contributed by Siqi Li. 
(cherry picked from commit 1fa8075794894b3e0053d251788277fb88e85533)
(cherry picked from commit 51c458a5c4562c54ff147824816f7b44c4b9b8f6)
 2015-04-16 10:16:48 -05:00
Harsh J
d4a462c02e YARN-3462. Patches applied for YARN-2424 are inconsistent between trunk and branch-2. Contributed by Naganarasimha G R. 2015-04-15 09:42:20 +05:30
Jason Lowe
70ac8cda41 YARN-3466. Fix RM nodes web page to sort by node HTTP-address, #containers and node-label column. (Jason Lowe via wangda) 
(cherry picked from commit 73d9e4c77b2aa4734845376d20fb76e6b91b6db0)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2015-04-10 13:52:34 +00:00
Vinod Kumar Vavilapalli
a7fa46c2e0 Preparing for 2.7.1 development: mvn versions:set 2015-04-09 14:13:30 -07:00
Vinod Kumar Vavilapalli
4c6867ff01 YARN-3055. Fixed ResourceManager's DelegationTokenRenewer to not stop token renewal of applications part of a bigger workflow. Contributed by Daryn Sharp. 
(cherry picked from commit 9c5911294e0ba71aefe4763731b0e780cde9d0ca)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-04-09 13:11:26 -07:00
Zhijie Shen
64cf079858 YARN-3430. Made headroom data available on app attempt page of RM WebUI. Contributed by Xuan Gong. 
(cherry picked from commit 8366a36ad356e6318b8ce6c5c96e201149f811bd)
 2015-04-06 13:18:16 -07:00
Jian He
edc3cb736e YARN-3273. Improve scheduler UI to facilitate scheduling analysis and debugging. Contributed Rohith Sharmaks 
(cherry picked from commit 658097d6da1b1aac8e01db459f0c3b456e99652f)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/AppAttemptBlock.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/dao/CapacitySchedulerLeafQueueInfo.java
 2015-04-06 13:17:31 -07:00
Zhijie Shen
cf33bc1050 Revert "YARN-3430. Made headroom data available on app attempt page of RM WebUI. Contributed by Xuan Gong." 
This reverts commit e4059b9cce2703c412abeacc08225c3cdfe415c1.
 2015-04-01 16:41:25 -07:00
Zhijie Shen
e4059b9cce YARN-3430. Made headroom data available on app attempt page of RM WebUI. Contributed by Xuan Gong. 
(cherry picked from commit 8366a36ad356e6318b8ce6c5c96e201149f811bd)
 2015-04-01 13:49:51 -07:00
Vinod Kumar Vavilapalli
35af6f1802 YARN-3304. Cleaning up ResourceCalculatorProcessTree APIs for public use and removing inconsistencies in the default values. Contributed by Junping Du and Karthik Kambatla. 
(cherry picked from commit c358368f511963ad8e35f030b9babee541e1bd01)
 2015-03-30 10:11:49 -07:00
Haohui Mai
28095c26f7 HADOOP-10670. Allow AuthenticationFilters to load secret from signature secret files. Contributed by Kai Zheng. 2015-03-25 12:30:58 -07:00
Xuan
646710318c YARN-2213. Change proxy-user cookie log in AmIpFilter to DEBUG. 
Contributed by Varun Saxena

(cherry picked from commit e556198e71df6be3a83e5598265cb702fc7a668b)
 2015-03-25 04:53:31 -07:00
Xuan
4dfd84ec08 YARN-3393. Getting application(s) goes wrong when app finishes before 
starting the attempt. Contributed by Zhijie Shen

(cherry picked from commit 9fae455e26e0230107e1c6db58a49a5b6b296cf4)
 2015-03-23 20:34:59 -07:00
cnauroth
57e297208d YARN-3336. FileSystem memory leak in DelegationTokenRenewer. 
(cherry picked from commit 6ca1f12024fd7cec7b01df0f039ca59f3f365dc1)
(cherry picked from commit 342c525eaa0749175f0e3827d245642776d043a5)
 2015-03-23 10:46:22 -07:00
Tsuyoshi Ozawa
d2e19160dc YARN-3384. TestLogAggregationService.verifyContainerLogs fails after YARN-2777. Contributed by Naganarasimha G R. 
(cherry picked from commit 82eda771e05cf2b31788ee1582551e65f1c0f9aa)
 2015-03-24 00:26:08 +09:00
Wangda Tan
57a0382f4b YARN-3369. Missing NullPointer check in AppSchedulingInfo causes RM to die. (Brahma Reddy Battula via wangda) 
(cherry picked from commit 6bc7710ec7f2592c4c87dd940fbe5827ef81fe72)
 2015-03-20 10:44:34 -07:00
Jian He
e67bd31ac0 YARN-3379. Fixed missing data in localityTable and ResourceRequests table in RM WebUI. Contributed by Xuan Gong 
(cherry picked from commit 4e886eb9cbd2dcb128bbfd17309c734083093a4c)
 2015-03-19 22:34:34 -07:00
Jian He
54e63c52c9 Backport part of YARN-3273 to rename CapacitySchedulerLeafQueueInfo#aMResourceLimit to AMResourceLimit. Contributed by Rohith Sharmaks 2015-03-17 22:08:10 -07:00
Karthik Kambatla
47e6fc2bf9 Revert "YARN-3181. FairScheduler: Fix up outdated findbugs issues. (kasha)" 
This reverts commit c2b185def846f5577a130003a533b9c377b58fab.

(cherry picked from commit 32b43304563c2430c00bc3e142a962d2bc5f4d58)
 2015-03-17 12:32:14 -07:00
Tsuyoshi Ozawa
f15a2b23ca YARN-3349. Treat all exceptions as failure in TestFSRMStateStore#testFSRMStateStoreClientRetry. Contributed by Zhihai Xu. 
(cherry picked from commit 7522a643faeea2d8a8e2c7409ae60e0973e7cf38)
 2015-03-17 08:10:57 +09:00
Tsuyoshi Ozawa
2b2f7f2b90 YARN-1453. [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments. Contributed by Akira AJISAKA, Andrew Purtell, and Allen Wittenauer. 
(cherry picked from commit 3da9a97cfbcc3a1c50aaf85b1a129d4d269cd5fd)
 2015-03-16 23:20:34 +09:00
Xuan
6ee45ae3a8 YARN-3171. Sort by Application id, AppAttempt and ContainerID doesn't 
work in ATS / RM web ui. Contributed by Naganarasimha G R

(cherry picked from commit 3ff1ba2a7b00fdf06270d00b2193bde4b56b06b3)
 2015-03-15 20:28:09 -07:00
Jonathan Eagles
e4d8dddb49 YARN-3267. Timelineserver applies the ACL rules after applying the limit on the number of records (Chang Li via jeagles) 
(cherry picked from commit 8180e676abb2bb500a48b3a0c0809d2a807ab235)
 2015-03-13 12:12:40 -05:00
Vinod Kumar Vavilapalli
0cd9eb9987 YARN-3154. Added additional APIs in LogAggregationContext to avoid aggregating running logs of application when rolling is enabled. Contributed by Xuan Gong. 
(cherry picked from commit 863079bb874ba77918ca1c0741eae10e245995c8)
 2015-03-12 13:34:33 -07:00
Zhijie Shen
ec9816b2b3 YARN-1884. Added nodeHttpAddress into ContainerReport and fixed the link to NM web page. Contributed by Xuan Gong. 
(cherry picked from commit 85f6d67fa78511f255fcfa810afc9a156a7b483b)
 2015-03-11 19:41:20 -07:00
Jian He
d579fddf24 YARN-3300. Outstanding_resource_requests table should not be shown in AHS. Contributed by Xuan Gong 
(cherry picked from commit c3003eba6f9802f15699564a5eb7c6e34424cb14)
 2015-03-09 20:48:09 -07:00
Zhijie Shen
6527be374b YARN-3287. Made TimelineClient put methods do as the correct login context. Contributed by Daryn Sharp and Jonathan Eagles. 
(cherry picked from commit d6e05c5ee26feefc17267b7c9db1e2a3dbdef117)
 2015-03-09 15:52:06 -07:00
Tsuyoshi Ozawa
28f4e6b222 HADOOP-11602. Backport 'Fix toUpperCase/toLowerCase to use Locale.ENGLISH.' (ozawa) 
(cherry picked from commit b46f9e72dbed6fd1f8cae1e12973252462d6ee15)
 2015-03-09 19:54:45 +09:00
Jason Lowe
ef3d9bdf6b YARN-3275. CapacityScheduler: Preemption happening on non-preemptable queues. Contributed by Eric Payne 
(cherry picked from commit 27e8ea820fab8dce59f4db9814e73bd60c1d4ef1)
 2015-03-06 22:45:09 +00:00
Jian He
6cef2c16de YARN-2190. Added CPU and memory limit options to the default container executor for Windows containers. Contributed by Chuan Liu 
(cherry picked from commit 21101c01f242439ec8ec40fb3a9ab1991ae0adc7)
 2015-03-06 14:18:56 -08:00
Jian He
a5f3fb4dc1 YARN-1809. Synchronize RM and TimeLineServer Web-UIs. Contributed by Zhijie Shen and Xuan Gong 
(cherry picked from commit 95bfd087dc89e57a93340604cc8b96042fa1a05a)
 2015-03-05 21:27:03 -08:00
Tsuyoshi Ozawa
6660c2f83b YARN-3249. Add a 'kill application' button to Resource Manager's Web UI. Contributed by Ryu Kobayashi. 
(cherry picked from commit 1b672096121fef775572b517d4f5721997abbac6)
 2015-03-05 19:56:59 +09:00
Karthik Kambatla
0d62e94887 YARN-3242. Asynchrony in ZK-close can lead to ZKRMStateStore watcher receiving events for old client. (Zhihai Xu via kasha) 
(cherry picked from commit 8d88691d162f87f95c9ed7e0a569ef08e8385d4f)
 2015-03-04 19:49:21 -08:00
Karthik Kambatla
721d7b5741 YARN-3231. FairScheduler: Changing queueMaxRunningApps interferes with pending jobs. (Siqi Li via kasha) 
(cherry picked from commit 22426a1c9f4bd616558089b6862fd34ab42d19a7)
 2015-03-04 18:07:33 -08:00
Karthik Kambatla
1749094fab YARN-3122. Metrics for container's actual CPU usage. (Anubhav Dhoot via kasha) 
(cherry picked from commit 53947f37c7a84a84ef4ab1a3cab63ff27c078385)
 2015-03-04 17:39:39 -08:00
Jian He
888a445638 YARN-3222. Fixed NPE on RMNodeImpl#ReconnectNodeTransition when a node is reconnected with a different port. Contributed by Rohith Sharmaks 
(cherry picked from commit b2f1ec312ee431aef762cfb49cb29cd6f4661e86)
 2015-03-03 16:28:55 -08:00
Wangda Tan
0a502c665b YARN-3272. Surface container locality info in RM web UI (Jian He via wangda) 
(cherry picked from commit e17e5ba9d7e2bd45ba6884f59f8045817594b284)
 2015-03-03 11:49:45 -08:00
Vinod Kumar Vavilapalli
253c78548b YARN-3265. Fixed a deadlock in CapacityScheduler by always passing a queue's available resource-limit from the parent queue. Contributed by Wangda Tan. 
(cherry picked from commit 14dd647c556016d351f425ee956ccf800ccb9ce2)
 2015-03-02 17:54:01 -08:00
Jian He
76b7283fa1 YARN-3281. Added RMStateStore to StateMachine visualization list. Contributed by Chengbing Liu 
(cherry picked from commit 5d0bae550f5b9a6005aa1d373cfe1ec80513dbd9)
 2015-03-02 14:43:12 -08:00
Wangda Tan
0b0be0056b YARN-3262. Surface application outstanding resource requests table in RM web UI. (Jian He via wangda) 
(cherry picked from commit edcecedc1c39d54db0f86a1325b4db26c38d2d4d)
 2015-02-27 16:14:35 -08:00
Tsuyoshi Ozawa
79f73f4613 YARN-2820. Retry in FileSystemRMStateStore when FS's operations fail due to IOException. Contributed by Zhihai Xu. 
(cherry picked from commit 01a1621930df17a745dd37892996c68fca3447d1)
 2015-02-28 00:57:01 +09:00
Konstantin V Shvachko
9e67f2cb0d YARN-3255. RM, NM, JobHistoryServer, and WebAppProxyServer's main() should support generic options. Contributed by Konstantin Shvachko. 2015-02-26 17:26:08 -08:00