Commit Graph

15563 Commits

Author SHA1 Message Date
Karthik Kambatla 74dd142250 YARN-5798. Set UncaughtExceptionHandler for all FairScheduler threads. (Yufei Gu via kasha) 2017-02-16 00:03:09 -08:00
Karthik Kambatla 11be3f70e0 YARN-4212. FairScheduler: Can't create a DRF queue under a FAIR policy queue. (Yufei Gu via kasha) 2017-02-15 23:51:22 -08:00
Karthik Kambatla 6c25dbcdc0 YARN-6163. FS Preemption is a trickle for severely starved applications. (kasha) 2017-02-15 23:16:12 -08:00
Ming Ma a136936d01 HDFS-11265. Extend visualization for Maintenance Mode under Datanode tab in the NameNode UI. (Marton Elek via mingma) 2017-02-15 20:24:07 -08:00
Mingliang Liu 0741dd3b9a HDFS-11375. Display the volume storage type in datanode UI. Contributed by Surendra Singh Lilhore 2017-02-15 11:37:26 -08:00
Jing Zhao 627da6f717 HDFS-8498. Blocks can be committed with wrong size. Contributed by Jing Zhao. 2017-02-15 10:44:37 -08:00
Junping Du 0fc6f38379 Addendum patch for YARN-6174 - remove deleted file. 2017-02-15 09:07:49 -08:00
Junping Du ce2d5bfa5f YARN-6174. Log files pattern should be same for both running and finished container. Contributed by Xuan Gong. 2017-02-15 09:05:14 -08:00
Wei-Chiu Chuang 859bd159ae HDFS-11333. Print a user friendly error message when plugins are not found. Contributed by Wei-Chiu Chuang. 2017-02-15 02:50:35 -08:00
Sunil G ff75132355 YARN-6183. Few missing informations in Application and Application Attempt pages for new YARN UI. Contributed by Akhil PB. 2017-02-15 15:52:57 +05:30
Varun Saxena b7613e0f40 YARN-6156. AM blacklisting to consider node label partition (Bibin A Chundatt via Varun Saxena) 2017-02-15 14:48:17 +05:30
Kai Zheng cd3e59a3dc HADOOP-14072. AliyunOSS: Failed to read from stream when seek beyond the download size. Contributed by Genmao Yu 2017-02-15 16:34:30 +08:00
Akira Ajisaka 8acb376c9c HDFS-11238. Fix checkstyle warnings in NameNode#createNameNode. Contributed by Ethan Li. 2017-02-15 16:53:50 +09:00
Akira Ajisaka 1e11080b78 HADOOP-13942. Update checkstyle and checkstyle plugin version to handle indentation of JDK8 Lambdas. 2017-02-15 16:35:08 +09:00
Masatake Iwasaki fbc0c2bd76 YARN-4753. Use doxia macro to generate in-page TOC of YARN site documentation. (iwasakims) 2017-02-15 13:09:10 +09:00
Karthik Kambatla 353a9b2d91 YARN-6061. Addendum. Remove extraneous change. 2017-02-14 15:19:52 -08:00
Yongjun Zhang 8e53f2b9b0 HDFS-11391. Numeric usernames do no work with WebHDFS FS write access. (Pierre Villard via Yongjun Zhang) 2017-02-14 13:40:53 -08:00
Karthik Kambatla 652679aa8a YARN-6061. Add an UncaughtExceptionHandler for critical threads in RM. (Yufei Gu via kasha) 2017-02-14 13:39:41 -08:00
Xiaoyu Yao aaf2713235 HDFS-11409. DatanodeInfo getNetworkLocation and setNetworkLocation shoud use volatile instead of synchronized. Contributed by Chen Liang. 2017-02-14 12:52:34 -08:00
Wei-Chiu Chuang 0cf5993712 HDFS-11084. Add a regression test for sticky bit support of OIV ReverseXML processor. Contributed by Wei-Chiu Chuang. 2017-02-14 09:11:55 -08:00
Sunil G 1fa084c425 YARN-5912. Fix breadcrumb issues for various pages in new YARN UI. Contributed by Akhil P B. 2017-02-14 22:29:21 +05:30
Akira Ajisaka b9f8491252 HADOOP-14058. Fix NativeS3FileSystemContractBaseTest#testDirWithDifferentMarkersWorks. Contributed by Yiqun Lin. 2017-02-15 01:45:56 +09:00
Arun Suresh aaf106fde3 YARN-5966. AMRMClient changes to support ExecutionType update. (asuresh) 2017-02-14 06:09:10 -08:00
Yiqun Lin 4164a2032a HDFS-11408. The config name of balance bandwidth is out of date. Contributed by Yiqun Lin. 2017-02-14 18:57:20 +08:00
Yiqun Lin 719df99c05 HDFS-11407. Document the missing usages of OfflineImageViewer processors. Contributed by Yiqun Lin. 2017-02-14 18:48:08 +08:00
Lei Xu 71c23c9fc9 HADOOP-13929. ADLS connector should not check in contract-test-options.xml. (John Zhuge via lei) 2017-02-13 13:33:13 -08:00
Chris Douglas 4ed33e9ca3 HDFS-11026. Convert BlockTokenIdentifier to use Protobuf. Contributed by Ewan Higgs. 2017-02-13 11:29:18 -08:00
Karthik Kambatla 646c6d6509 YARN-3933. FairScheduler: Multiple calls to completedContainer are not safe. (Shiwei Guo and Miklos Szegedi via kasha) 2017-02-13 11:26:30 -08:00
Wei-Chiu Chuang cc45da79fd HADOOP-13233. help of stat is confusing. Contributed by Attila Bukor. 2017-02-13 10:14:45 -08:00
Junping Du 464ff479ce YARN-6113. Re-direct NM Web Service to get container logs for finished applications. Contributed by Xuan Gong. 2017-02-13 06:12:54 -08:00
Kai Zheng 243c0f33ec HADOOP-13769. AliyunOSS: update oss sdk version. Contributed by Genmao Yu 2017-02-13 13:21:44 +08:00
Kai Zheng 01be4503c3 HADOOP-14069. AliyunOSS: listStatus returns wrong file info. Contributed by Fei Hui 2017-02-13 13:18:20 +08:00
Lei Xu 839b690ed5 HADOOP-13075. Add support for SSE-KMS and SSE-C in s3a filesystem. (Steve Moist via lei) 2017-02-11 13:59:03 -08:00
Varun Saxena 649deb72fb YARN-6170. TimelineReaderServer should wait to join with HttpServer2 (Sangjin Lee via Varun Saxena) 2017-02-11 19:21:45 +05:30
Arpit Agarwal 0aacd8fd25 HDFS-11403. Zookeper ACLs on NN HA enabled clusters should be handled consistently. Contributed by Hanisha Koneru. 2017-02-11 01:17:56 -08:00
Kihwal Lee 07a5184f74 HDFS-11379. DFSInputStream may infinite loop requesting block locations. Contributed by Daryn Sharp. 2017-02-10 12:27:08 -06:00
Arpit Agarwal 2b7a7bbe0f HADOOP-14055. SwiftRestClient includes pass length in exception if auth fails. Contributed by Marcell Hegedus. 2017-02-10 10:09:31 -08:00
Daniel Templeton 1238fa71f8 YARN-6166. Unnecessary INFO logs in AMRMClientAsyncImpl$CallbackHandlerThread.run (Contributed by Grant Whiteheart via Daniel Templeton) 2017-02-10 09:46:11 -08:00
Sunil G 3a0a0a485a YARN-6118. Add javadoc for Resources.isNone. Contributed by Andres Perez. 2017-02-10 15:48:46 +05:30
Kai Zheng 5b151290ae HADOOP-13768. AliyunOSS: handle the failure in the batch delete operation `deleteDirs`. Contributed by Genmao Yu 2017-02-10 14:53:18 +08:00
Karthik Kambatla 08f93978f3 YARN-6144. FairScheduler: preempted resources can become negative. (Miklos Szegedi via kasha) 2017-02-09 14:45:04 -08:00
Kihwal Lee 0c01cf5798 HADOOP-14033. Reduce fair call queue lock contention. Contributed by Daryn Sharp. 2017-02-09 16:17:24 -06:00
Karthik Kambatla 9b85053583 YARN-6112. UpdateCallDuration is calculated only when debug logging is enabled. (Yufei Gu via kasha) 2017-02-09 13:09:32 -08:00
Wangda Tan 5fb723bb77 YARN-5889. Improve and refactor user-limit calculation in Capacity Scheduler. (Sunil G via wangda) 2017-02-09 10:23:50 -08:00
Kihwal Lee b6bb99c18a HADOOP-14034. Allow ipc layer exceptions to selectively close connections. Contributed by Daryn Sharp. 2017-02-09 10:47:29 -06:00
Kihwal Lee a0bfb41504 HADOOP-14032. Reduce fair call queue priority inversion. Contributed by Daryn Sharp. 2017-02-09 10:04:28 -06:00
Kai Zheng a8a594b4c8 HADOOP-14065. AliyunOSS: oss directory filestatus should use meta time. Contributed by Fei Hui 2017-02-09 18:00:22 +08:00
Jason Lowe 37b4acf7ce YARN-6137. Yarn client implicitly invoke ATS client which accesses HDFS. Contributed by Li Lu 2017-02-08 14:59:09 -06:00
Junping Du eec52e158b YARN-6145. Improve log message on fail over. Contributed by Jian He. 2017-02-08 02:11:19 -08:00
Xiao Chen 2007e0cf2a HDFS-11210. Enhance key rolling to guarantee new KeyVersion is returned from generateEncryptedKeys after a key is rolled. 2017-02-07 20:36:11 -08:00