Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,811 Commits 326 Branches 371 Tags
Commit Graph

12811 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Arpit Agarwal
32a0c2b5e7 HDFS-11403. Zookeper ACLs on NN HA enabled clusters should be handled consistently. Contributed by Hanisha Koneru. 2017-02-11 01:18:07 -08:00
Kihwal Lee
33c62d2d19 HDFS-11379. DFSInputStream may infinite loop requesting block locations. Contributed by Daryn Sharp. 2017-02-10 12:52:14 -06:00
Arpit Agarwal
c88ec54588 HADOOP-14055. SwiftRestClient includes pass length in exception if auth fails. Contributed by Marcell Hegedus. 2017-02-10 10:09:39 -08:00
Daniel Templeton
7c3578ca17 YARN-6166. Unnecessary INFO logs in AMRMClientAsyncImpl$CallbackHandlerThread.run (Contributed by Grant Whiteheart via Daniel Templeton) 
(cherry picked from commit 1238fa71f8e62cecde6e2437d1b83ad3922295f8)
 2017-02-10 09:48:50 -08:00
Sunil G
7b2b6caf12 YARN-6118. Add javadoc for Resources.isNone. Contributed by Andres Perez. 
(cherry picked from commit 3a0a0a485a4145e3bd2e5946731ee1d901b51ead)
 2017-02-10 15:54:59 +05:30
Karthik Kambatla
e259a818ad YARN-6144. FairScheduler: preempted resources can become negative. (Miklos Szegedi via kasha) 
(cherry picked from commit 08f93978f3ec724b24a93d7ef538f158da75802f)
 2017-02-09 14:45:21 -08:00
Kihwal Lee
5de6f1b791 HADOOP-14033. Reduce fair call queue lock contention. Contributed by Daryn Sharp. 
(cherry picked from commit 0c01cf57987bcc7a17154a3538960b67f625a9e5)
 2017-02-09 16:20:06 -06:00
Karthik Kambatla
41361ec39e YARN-6112. UpdateCallDuration is calculated only when debug logging is enabled. (Yufei Gu via kasha) 2017-02-09 13:12:21 -08:00
Kihwal Lee
d008b55153 HADOOP-14034. Allow ipc layer exceptions to selectively close connections. Contributed by Daryn Sharp. 2017-02-09 10:55:40 -06:00
Kihwal Lee
2039d021f9 HADOOP-14032. Reduce fair call queue priority inversion. Contributed by Daryn Sharp. 
(cherry picked from commit a0bfb4150464013a618f30c2e38d88fc6de11ad2)
 2017-02-09 10:13:37 -06:00
Jason Lowe
e330c3806c YARN-6137. Yarn client implicitly invoke ATS client which accesses HDFS. Contributed by Li Lu 
(cherry picked from commit 37b4acf7cee1f05599a84bbb1ebf07979a71f82f)
 2017-02-08 15:00:50 -06:00
Junping Du
33e7c3044f YARN-6145. Improve log message on fail over. Contributed by Jian He. 
(cherry picked from commit eec52e158b7bc14b2d3d53512323ba05e15e09e3)
 2017-02-08 02:15:11 -08:00
Sidharta S
127ed38d13 YARN-5258. Document Use of Docker with LinuxContainerExecutor (Contributed by Daniel Templeton) 2017-02-07 16:35:56 -08:00
Daniel Templeton
85261cbe0e MAPREDUCE-6842. Update the links in PiEstimator document (Contributed by Jung Yoo via Daniel Templeton) 
(cherry picked from commit 0e58b368f001b3bb4031b923b63dce7c81d42d39)
 2017-02-07 13:06:50 -08:00
Junping Du
ab41da7e64 YARN-6108. Improve AHS webservice to accept NM address as a parameter to get container logs. Contributed by Xuan Gong. 
(cherry picked from commit 9dbfab1284015af6983b4a55b79c9e65bc0194e5)
 2017-02-07 02:14:09 -08:00
Junping Du
81e2d54ac6 MAPREDUCE-6404. Allow AM to specify a port range for starting its webapp. Contributed by Varun Saxena. 
(cherry picked from commit 7afe5b1a3165e284ae831cd307a526763399f66d)
 2017-02-07 01:46:17 -08:00
Yiqun Lin
26bed5ce53 HDFS-11377. Balancer hung due to no available mover threads. Contributed by yunjiong zhao. 
(cherry picked from commit 9cbbd1eae893b21212c9bc9e6745c6859317a667)
 2017-02-06 13:18:14 +08:00
Junping Du
b7d59e790b HADOOP-12097. Allow port range to be specified while starting webapp. Contributed by Varun Saxena. 
(cherry picked from commit cce35c38159b23eb55204b3c9afcaa3215f4f4ef)

Conflicts:

	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/http/HttpServer2.java
 2017-02-05 20:13:49 -08:00
Junping Du
378d62663f MAPREDUCE-6338. MR AppMaster does not honor ephemeral port range. Contributed by Frank Nguyen. 
(cherry picked from commit d401e63b6c3695d1f8f3f4958b8d592b15342b17)
 2017-02-05 19:28:53 -08:00
Akira Ajisaka
be9b02e0b6 HADOOP-14053. Update the link to HTrace SpanReceivers. Contributed by Yiqun Lin. 
(cherry picked from commit cb8f3f3adf7a22e8fb6fdfc44f3ec781c1526bfd)
 2017-02-04 10:59:18 +09:00
Xiao Chen
05ed48b75a HADOOP-14044. Synchronization issue in delegation token cancel functionality. Contributed by Hrishikesh Gadre. 
(cherry picked from commit ba75bc759334c8987e5f7dd4b21d025f0cccbde7)
 2017-02-03 17:27:35 -08:00
Kihwal Lee
7baa6dac54 HADOOP-14050. Add process name to kms process. Contributed by Rushabh S Shah. 2017-02-03 15:38:55 -06:00
Arpit Agarwal
f17d3eddcf HDFS-11387. Socket reuse address option is not honored in PrivilegedNfsGatewayStarter. Contributed by Mukul Kumar Singh. 2017-02-03 12:28:17 -08:00
Xiao Chen
b0a1703f10 HDFS-11363. Need more diagnosis info when seeing Slow waitForAckedSeqno. 
(cherry picked from commit 0914fcca312b5e9d20bcf1b6633bc13c9034ba46)
 2017-02-02 10:09:20 -08:00
Junping Du
c699ce70ea YARN-6100. Improve YARN webservice to output aggregated container logs. Contributed by Xuan Gong. 2017-02-02 00:45:27 -08:00
Arpit Agarwal
b64d9093e1 HDFS-11112. Journal Nodes should refuse to format non-empty directories. Contributed by Yiqun Lin. 2017-02-01 16:52:07 -08:00
Masatake Iwasaki
2f4cf07fb1 MAPREDUCE-6644. Use doxia macro to generate in-page TOC of MapReduce site documentation. (iwasakims) 
(cherry picked from commit 3619ae32bea227f17ecc9ef964e9194bc09fac0b)
 2017-02-02 01:23:02 +09:00
Lei Xu
d258077bc1 HDFS-11335. Remove HdfsClientConfigKeys.DFS_CLIENT_SLOW_IO_WARNING_THRESHOLD_KEY usage from DNConf. (Manoj Govindassamy via lei) 
(cherry picked from commit bec9b7aa1dd3ed95b8783597135f8d90b3cc8dcd)
 2017-02-01 14:44:08 +08:00
Daniel Templeton
be14bda5c0 YARN-4658. Typo in o.a.h.yarn.server.resourcemanager.scheduler.fair.TestFairScheduler comment (Contributed by Udai Potluri via Daniel Templeton) 
(cherry picked from commit 3e06475307e30377092547dfdebe6c2c6ac6e78f)
 2017-01-31 16:26:41 -08:00
Daniel Templeton
ccf33bc36c YARN-6103. Log updates for ZKRMStateStore (Contributed by Daniel Sturman via Daniel Templeton) 
(cherry picked from commit 87852b6ef4b9d973b7b3999974d41c8860fb1495)
 2017-01-30 21:46:38 -08:00
Ray Chiang
9f0b813350 YARN-6106. Document FairScheduler 'allowPreemptionFrom' queue property. (Yufei Gu via rchiang) 
(cherry picked from commit 3f970ac363dc2faf4f54180ee5b64d0c60807097)
 2017-01-30 13:42:11 -08:00
Karthik Kambatla
c9824c5ff6 YARN-6131. FairScheduler: Lower update interval for faster tests. (kasha) 
(cherry picked from commit 11e44bdda74b3357714f4b11a66f703d64c0f14f)
 2017-01-30 13:39:35 -08:00
Karthik Kambatla
8b01d5cbba HDFS-11378. Addendum to fix branch-2 compilation. Verify multiple DataNodes can be decommissioned/maintenance at the same time. (Manoj Govindassamy via kasha) 2017-01-29 11:18:54 -08:00
Ming Ma
34f9ceab4a HDFS-11378. Verify multiple DataNodes can be decommissioned/maintenance at the same time. (Manoj Govindassamy via mingma) 
(cherry picked from commit 312b36d113d83640b92c62fdd91ede74bd04c00f)
 2017-01-27 16:17:51 -08:00
Masatake Iwasaki
528bff9c42 HDFS-9884. Use doxia macro to generate in-page TOC of HDFS site documentation. (iwasakims) 2017-01-28 08:11:40 +09:00
Anu Engineer
d20dc8691e HDFS-9911. TestDataNodeLifeline Fails intermittently. Contributed by Yiqun Lin 
(cherry picked from commit a95639068c99ebcaefe8b6c4268449d12a6577d6)
 2017-01-27 20:55:59 +00:00
Jason Lowe
4703f5d20b YARN-5641. Localizer leaves behind tarballs after container is complete. Contributed by Eric Badger 2017-01-27 15:25:57 +00:00
Junping Du
660f4d8631 YARN-6126. Obtaining app logs for Running application fails with json parse error. Contributed by Xuan Gong. 
(cherry picked from commit 1a16431bd0df52d2df32c594f8b9b506c2101ad8)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/LogsCLI.java
 2017-01-27 06:33:44 -08:00
Xiaoyu Yao
6b602c6e34 HADOOP-14029. Fix KMSClientProvider for non-secure proxyuser use case. Contributed by Xiaoyu Yao. 
(cherry picked from commit 2034315763cd7b1eb77e96c719918fc14e2dabf6)
 2017-01-26 20:36:43 -08:00
Arpit Agarwal
17d4ba26fc HDFS-11374. Skip FSync in CreateEditsLog to speed up edit log generation. Contributed by Hanisha Koneru. 2017-01-26 16:21:38 -08:00
Xiao Chen
67d2875f8f Revert "HDFS-8377. Support HTTP/2 in datanode. Contributed by Duo Zhang." 
This reverts commit f70b9d92413940739ed6f6cd468e6d09702939d1.
 2017-01-26 14:21:17 -08:00
Karthik Kambatla
1b1a25cca6 YARN-6000. Make AllocationFileLoaderService.Listener public. (Tao Jie via kasha) 
(cherry picked from commit 4d3f73acc0a5cabc748132889dbe670bea178a3f)
 2017-01-26 14:11:50 -08:00
Daniel Templeton
c4eeac02de YARN-4975. Fair Scheduler: exception thrown when a parent queue marked 'parent' has configured child queues 
(Contributed by Yufei Gu via Daniel Templeton)

(cherry picked from commit f85b74ccf9f1c1c1444cc00750b03468cbf40fb9)
 2017-01-26 14:08:46 -08:00
Daniel Templeton
443f2803ac YARN-4997. Update fair scheduler to use pluggable auth provider (Contributed by Tao Jie via Daniel Templeton) 
(cherry picked from commit b3befc021b0e2d63d1a3710ea450797d1129f1f5)
 2017-01-26 14:07:46 -08:00
Xiao Chen
4a48f0e702 HADOOP-14003. Make additional KMS tomcat settings configurable. Contributed by Andrew Wang. 2017-01-26 11:22:16 -08:00
Karthik Kambatla
a91cc63d37 MAPREDUCE-6829. Add peak memory usage counter for each task. (Miklos Szegedi via kasha) 
(cherry picked from commit c65f884fc7e08118524f8c88737119d8196b4c1b)
 2017-01-26 11:08:53 -08:00
Xiao Chen
827cd30923 HDFS-11364. Add a test to verify Audit log entries for setfacl/getfacl commands over FS shell. Contributed by Manoj Govindassamy. 
(cherry picked from commit 44606aa8508a6e98219b8330e625c8d397bfb067)
 2017-01-26 10:58:17 -08:00
Arpit Agarwal
deb3ef4587 HDFS-11369. Change exception message in StorageLocationChecker. 2017-01-26 09:12:46 -08:00
Jason Lowe
b806201f0a Revert "YARN-5641. Localizer leaves behind tarballs after container is complete. Contributed by Eric Badger" 
This reverts commit 45407acaed05284ad897d04f4575ab0a4ee7a88b.
 2017-01-26 14:42:22 +00:00
Sangjin Lee
b799ea7641 YARN-3637. Handle localization sym-linking correctly at the YARN level. Contributed by Chris Trezzo. 
(cherry picked from commit 425a7e502869c4250aba927ecc3c6f3c561c6ff2)
 2017-01-25 15:52:05 -08:00