Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,293 Commits 326 Branches 371 Tags
Commit Graph

1407 Commits

Author SHA1 Message Date
Xuan
0c4fa872be YARN-2213. Change proxy-user cookie log in AmIpFilter to DEBUG. 
Contributed by Varun Saxena

(cherry picked from commit e556198e71df6be3a83e5598265cb702fc7a668b)
 2015-03-25 04:51:55 -07:00
Wangda Tan
29629020c1 YARN-3383. AdminService should use warn instead of info to log exception when operation fails. (Li Lu via wangda) 
(cherry picked from commit 97a7277a2d696474b5c8e2d814c8291d4bde246e)
 2015-03-24 10:39:45 -07:00
Xuan
cbdcdfad6d YARN-3393. Getting application(s) goes wrong when app finishes before 
starting the attempt. Contributed by Zhijie Shen

(cherry picked from commit 9fae455e26e0230107e1c6db58a49a5b6b296cf4)
 2015-03-23 20:34:29 -07:00
Karthik Kambatla
4e0c48703e YARN-2868. FairScheduler: Metric for latency to allocate first container for an application. (Ray Chiang via kasha) 
(cherry picked from commit 972f1f1ab94a26ec446a272ad030fe13f03ed442)
 2015-03-23 14:10:23 -07:00
Karthik Kambatla
75591e4131 YARN-3241. FairScheduler handles invalid queue names inconsistently. (Zhihai Xu via kasha) 
(cherry picked from commit 2bc097cd14692e6ceb06bff959f28531534eb307)
 2015-03-23 13:24:22 -07:00
cnauroth
342c525eaa YARN-3336. FileSystem memory leak in DelegationTokenRenewer. 
(cherry picked from commit 6ca1f12024fd7cec7b01df0f039ca59f3f365dc1)
 2015-03-23 10:46:06 -07:00
Tsuyoshi Ozawa
cbacf20755 YARN-3384. TestLogAggregationService.verifyContainerLogs fails after YARN-2777. Contributed by Naganarasimha G R. 
(cherry picked from commit 82eda771e05cf2b31788ee1582551e65f1c0f9aa)
 2015-03-24 00:25:52 +09:00
Jian He
9c494cedaf YARN-3345. Add non-exclusive node label API. Contributed by Wangda Tan 
(cherry picked from commit e1feb4ea1a532d680d6ca69b55ffcae1552d64f0)
 2015-03-20 19:05:14 -07:00
Jian He
a3a155a34e YARN-3356. Capacity Scheduler FiCaSchedulerApp should use ResourceUsage to track used-resources-by-label. Contributed by Wangda Tan 
(cherry picked from commit 586348e4cbf197188057d6b843a6701cfffdaff3)
 2015-03-20 13:54:46 -07:00
Junping Du
f40f17489c YARN-3269. Yarn.nodemanager.remote-app-log-dir could not be configured to fully qualified path. Contributed by Xuan Gong 
(cherry picked from commit d81109e588493cef31e68508a3d671203bd23e12)
 2015-03-20 13:42:31 -07:00
Wangda Tan
8e142d27cb YARN-3369. Missing NullPointer check in AppSchedulingInfo causes RM to die. (Brahma Reddy Battula via wangda) 
(cherry picked from commit 6bc7710ec7f2592c4c87dd940fbe5827ef81fe72)
 2015-03-20 10:42:51 -07:00
Jian He
3f0c9e5fe3 YARN-3379. Fixed missing data in localityTable and ResourceRequests table in RM WebUI. Contributed by Xuan Gong 
(cherry picked from commit 4e886eb9cbd2dcb128bbfd17309c734083093a4c)
 2015-03-19 22:27:57 -07:00
Devaraj K
a888dac344 YARN-3357. Move TestFifoScheduler to FIFO package. Contributed by Rohith 
Sharmaks.

(cherry picked from commit 93d0f4acc8454b7a460da8883fbd14f14a575370)
 2015-03-19 12:18:08 +05:30
Karthik Kambatla
05627dd96d YARN-3351. AppMaster tracking URL is broken in HA. (Anubhav Dhoot via kasha) 
(cherry picked from commit 20b49224eb90c796f042ac4251508f3979fd4787)
 2015-03-18 16:33:57 -07:00
Jian He
15ebacf03a YARN-3273. Improve scheduler UI to facilitate scheduling analysis and debugging. Contributed Rohith Sharmaks 
(cherry picked from commit 658097d6da1b1aac8e01db459f0c3b456e99652f)
 2015-03-17 21:31:20 -07:00
Tsuyoshi Ozawa
b00b216a91 YARN-3205. FileSystemRMStateStore should disable FileSystem Cache to avoid get a Filesystem with an old configuration. Contributed by Zhihai Xu. 
(cherry picked from commit 3bc72cc16d8c7b8addd8f565523001dfcc32b891)
 2015-03-18 11:53:40 +09:00
Jian He
ab34e6975b YARN-3305. Normalize AM resource request on app submission. Contributed by Rohith Sharmaks 
(cherry picked from commit 968425e9f7b850ff9c2ab8ca37a64c3fdbe77dbf)
 2015-03-17 13:50:44 -07:00
Karthik Kambatla
1e77d92d62 Revert "YARN-3181. FairScheduler: Fix up outdated findbugs issues. (kasha)" 
This reverts commit c2b185def846f5577a130003a533b9c377b58fab.

(cherry picked from commit 32b43304563c2430c00bc3e142a962d2bc5f4d58)
 2015-03-17 12:31:44 -07:00
Jian He
1c601e492f YARN-3243. CapacityScheduler should pass headroom from parent to children to make sure ParentQueue obey its capacity limits. Contributed by Wangda Tan. 
(cherry picked from commit 487374b7fe0c92fc7eb1406c568952722b5d5b15)
 2015-03-17 10:25:07 -07:00
Devaraj K
895588b439 YARN-3197. Confusing log generated by CapacityScheduler. Contributed by 
Varun Saxena.

(cherry picked from commit 7179f94f9d000fc52bd9ce5aa9741aba97ec3ee8)
 2015-03-17 15:59:19 +05:30
Ravi Prakash
9f227ad696 YARN-3339. TestDockerContainerExecutor should pull a single image and not the entire centos repository. (Ravindra Kumar Naik via raviprak) 
(cherry picked from commit 56085203c43b8f2561bf3745910e03f8ac176a67)
 2015-03-16 16:18:42 -07:00
Tsuyoshi Ozawa
a20427d339 YARN-3349. Treat all exceptions as failure in TestFSRMStateStore#testFSRMStateStoreClientRetry. Contributed by Zhihai Xu. 
(cherry picked from commit 7522a643faeea2d8a8e2c7409ae60e0973e7cf38)
 2015-03-17 08:10:12 +09:00
Tsuyoshi Ozawa
d6e3ef2506 YARN-1453. [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments. Contributed by Akira AJISAKA, Andrew Purtell, and Allen Wittenauer. 
(cherry picked from commit 3da9a97cfbcc3a1c50aaf85b1a129d4d269cd5fd)
 2015-03-16 23:20:17 +09:00
Xuan
b6eb36dbdc YARN-3171. Sort by Application id, AppAttempt and ContainerID doesn't 
work in ATS / RM web ui. Contributed by Naganarasimha G R

(cherry picked from commit 3ff1ba2a7b00fdf06270d00b2193bde4b56b06b3)
 2015-03-15 20:27:44 -07:00
Jonathan Eagles
44aedad5dd YARN-3267. Timelineserver applies the ACL rules after applying the limit on the number of records (Chang Li via jeagles) 
(cherry picked from commit 8180e676abb2bb500a48b3a0c0809d2a807ab235)
 2015-03-13 12:05:21 -05:00
Vinod Kumar Vavilapalli
53aa3a4d1f YARN-3154. Added additional APIs in LogAggregationContext to avoid aggregating running logs of application when rolling is enabled. Contributed by Xuan Gong. 
(cherry picked from commit 863079bb874ba77918ca1c0741eae10e245995c8)
 2015-03-12 13:33:42 -07:00
Zhijie Shen
426535007b YARN-1884. Added nodeHttpAddress into ContainerReport and fixed the link to NM web page. Contributed by Xuan Gong. 
(cherry picked from commit 85f6d67fa78511f255fcfa810afc9a156a7b483b)
 2015-03-11 19:39:46 -07:00
Jian He
4021451746 YARN-3300. Outstanding_resource_requests table should not be shown in AHS. Contributed by Xuan Gong 
(cherry picked from commit c3003eba6f9802f15699564a5eb7c6e34424cb14)
 2015-03-09 20:47:33 -07:00
Zhijie Shen
a94d23762e YARN-3287. Made TimelineClient put methods do as the correct login context. Contributed by Daryn Sharp and Jonathan Eagles. 
(cherry picked from commit d6e05c5ee26feefc17267b7c9db1e2a3dbdef117)
 2015-03-09 13:55:51 -07:00
Tsuyoshi Ozawa
b46f9e72db HADOOP-11602. Backport 'Fix toUpperCase/toLowerCase to use Locale.ENGLISH.' (ozawa) 2015-03-09 19:53:55 +09:00
Vinod Kumar Vavilapalli
d9416317a9 Preparing for 2.8.0 development. Changing SNAPSHOT version to be 2.8 on branch-2. 2015-03-08 20:32:51 -07:00
Jason Lowe
ef3d9bdf6b YARN-3275. CapacityScheduler: Preemption happening on non-preemptable queues. Contributed by Eric Payne 
(cherry picked from commit 27e8ea820fab8dce59f4db9814e73bd60c1d4ef1)
 2015-03-06 22:45:09 +00:00
Jian He
6cef2c16de YARN-2190. Added CPU and memory limit options to the default container executor for Windows containers. Contributed by Chuan Liu 
(cherry picked from commit 21101c01f242439ec8ec40fb3a9ab1991ae0adc7)
 2015-03-06 14:18:56 -08:00
Jian He
a5f3fb4dc1 YARN-1809. Synchronize RM and TimeLineServer Web-UIs. Contributed by Zhijie Shen and Xuan Gong 
(cherry picked from commit 95bfd087dc89e57a93340604cc8b96042fa1a05a)
 2015-03-05 21:27:03 -08:00
Tsuyoshi Ozawa
6660c2f83b YARN-3249. Add a 'kill application' button to Resource Manager's Web UI. Contributed by Ryu Kobayashi. 
(cherry picked from commit 1b672096121fef775572b517d4f5721997abbac6)
 2015-03-05 19:56:59 +09:00
Karthik Kambatla
0d62e94887 YARN-3242. Asynchrony in ZK-close can lead to ZKRMStateStore watcher receiving events for old client. (Zhihai Xu via kasha) 
(cherry picked from commit 8d88691d162f87f95c9ed7e0a569ef08e8385d4f)
 2015-03-04 19:49:21 -08:00
Karthik Kambatla
721d7b5741 YARN-3231. FairScheduler: Changing queueMaxRunningApps interferes with pending jobs. (Siqi Li via kasha) 
(cherry picked from commit 22426a1c9f4bd616558089b6862fd34ab42d19a7)
 2015-03-04 18:07:33 -08:00
Karthik Kambatla
1749094fab YARN-3122. Metrics for container's actual CPU usage. (Anubhav Dhoot via kasha) 
(cherry picked from commit 53947f37c7a84a84ef4ab1a3cab63ff27c078385)
 2015-03-04 17:39:39 -08:00
Jian He
888a445638 YARN-3222. Fixed NPE on RMNodeImpl#ReconnectNodeTransition when a node is reconnected with a different port. Contributed by Rohith Sharmaks 
(cherry picked from commit b2f1ec312ee431aef762cfb49cb29cd6f4661e86)
 2015-03-03 16:28:55 -08:00
Wangda Tan
0a502c665b YARN-3272. Surface container locality info in RM web UI (Jian He via wangda) 
(cherry picked from commit e17e5ba9d7e2bd45ba6884f59f8045817594b284)
 2015-03-03 11:49:45 -08:00
Vinod Kumar Vavilapalli
253c78548b YARN-3265. Fixed a deadlock in CapacityScheduler by always passing a queue's available resource-limit from the parent queue. Contributed by Wangda Tan. 
(cherry picked from commit 14dd647c556016d351f425ee956ccf800ccb9ce2)
 2015-03-02 17:54:01 -08:00
Jian He
76b7283fa1 YARN-3281. Added RMStateStore to StateMachine visualization list. Contributed by Chengbing Liu 
(cherry picked from commit 5d0bae550f5b9a6005aa1d373cfe1ec80513dbd9)
 2015-03-02 14:43:12 -08:00
Wangda Tan
0b0be0056b YARN-3262. Surface application outstanding resource requests table in RM web UI. (Jian He via wangda) 
(cherry picked from commit edcecedc1c39d54db0f86a1325b4db26c38d2d4d)
 2015-02-27 16:14:35 -08:00
Tsuyoshi Ozawa
79f73f4613 YARN-2820. Retry in FileSystemRMStateStore when FS's operations fail due to IOException. Contributed by Zhihai Xu. 
(cherry picked from commit 01a1621930df17a745dd37892996c68fca3447d1)
 2015-02-28 00:57:01 +09:00
Konstantin V Shvachko
9e67f2cb0d YARN-3255. RM, NM, JobHistoryServer, and WebAppProxyServer's main() should support generic options. Contributed by Konstantin Shvachko. 2015-02-26 17:26:08 -08:00
Tsuyoshi Ozawa
dc348f4894 YARN-3217. Remove httpclient dependency from hadoop-yarn-server-web-proxy. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 773b6515ac51af3484824bd6f57685a9726a1e70)
 2015-02-27 00:25:12 +09:00
Devaraj K
f83d2e4410 YARN-3256. TestClientToAMTokens#testClientTokenRace is not running against 
all Schedulers even when using ParameterizedSchedulerTestBase. Contributed
by Anubhav Dhoot.

(cherry picked from commit 0d4296f0e0f545267f2e39a868d4ffefc9844db8)
 2015-02-26 15:47:32 +05:30
Jason Lowe
257087417e YARN-3239. WebAppProxy does not support a final tracking url which has query fragments and params. Contributed by Jian He 
(cherry picked from commit 1a68fc43464d3948418f453bb2f80df7ce773097)
 2015-02-25 16:15:35 +00:00
Tsuyoshi Ozawa
13e213c41a YARN-3247. TestQueueMappings should use CapacityScheduler explicitly. Contributed by Zhihai Xu. 
(cherry picked from commit 6cbd9f1113fca9ff86fd6ffa783ecd54b147e0db)
 2015-02-25 11:23:34 +09:00
Xuan
0ca974d0b0 YARN-2797. TestWorkPreservingRMRestart should use 
ParametrizedSchedulerTestBase. Contributed by Karthik Kambatla

(cherry picked from commit fe7a302473251b7310105a936edf220e401c613f)
 2015-02-21 19:19:08 -08:00