Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,888 Commits 326 Branches 371 Tags
Commit Graph

12888 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Mingliang Liu
b23e93d465 HADOOP-14040. Use shaded aws-sdk uber-JAR 1.11.86. Contributed by Steve Loughran and Sean Mackrory 
(cherry picked from commit 658702efffdf52cf5ddf8e92f959f1157c95a348)
 2017-02-16 16:59:31 -08:00
Mingliang Liu
29e1007172 HADOOP-14019. Fix some typos in the s3a docs. Contributed by Steve Loughran 
(cherry picked from commit bdad8b7b97d7f48119f016d68f32982d680c8796)
 2017-02-16 16:42:56 -08:00
Karthik Kambatla
afc8124ff6 YARN-6171. ConcurrentModificationException on FSAppAttempt.containersToPreempt. (Miklos Szegedi via kasha) 
(cherry picked from commit a77f432449aad67da31bd8bf8644b71def741bde)
 2017-02-16 15:03:35 -08:00
Li Lu
8fc67e5973 YARN-6177. Yarn client should exit with an informative error message if an incompatible Jersey library is used at client. Contributed by Weiwei Yang. 
(cherry picked from commit 5d339c46f5b16b951afd82afd9e907b9aa2ded9a)
 2017-02-16 13:46:30 -08:00
Rohith Sharma K S
f07b52dc5a YARN-6200. Reverting since the same functionality achieved by YARN-1623. 
Revert "YARN-5068. Expose scheduler queue to application master. (Harish Jaiprakash via rohithsharmaks)"

This reverts commit a37b3694ead2ab4e8753e68213f31868b68376b8.
 2017-02-16 17:58:38 +05:30
Karthik Kambatla
9fecd5063f YARN-5798. Set UncaughtExceptionHandler for all FairScheduler threads. (Yufei Gu via kasha) 
(cherry picked from commit 74dd14225059322825f706120aa57cf673820daf)
 2017-02-16 00:03:26 -08:00
Karthik Kambatla
fefac1276a YARN-4212. FairScheduler: Can't create a DRF queue under a FAIR policy queue. (Yufei Gu via kasha) 
(cherry picked from commit 11be3f70e029c2324b167563168c8a254d234aef)
 2017-02-15 23:51:51 -08:00
Karthik Kambatla
46b6c95e0a YARN-6163. FS Preemption is a trickle for severely starved applications. (kasha) 
(cherry picked from commit 6c25dbcdc0517a825b92fb16444aa1d3761e160c)
 2017-02-15 23:23:18 -08:00
Ming Ma
0f8b99fd34 HDFS-11265. Extend visualization for Maintenance Mode under Datanode tab in the NameNode UI. (Marton Elek via mingma) 
(cherry picked from commit a136936d018b5cebb7aad9a01ea0dcc366e1c3b8)
 2017-02-15 20:25:04 -08:00
Mingliang Liu
96be70513a HDFS-11375. Display the volume storage type in datanode UI. Contributed by Surendra Singh Lilhore 
(cherry picked from commit 0741dd3b9abdeb65bb783c1a8b01f078c4bdba17)
 2017-02-15 12:34:43 -08:00
Junping Du
323782b389 Addendum patch for YARN-6174 - remove deleted file. 
(cherry picked from commit 0fc6f38379f0047afd23ac14abcb5086d65a7f67)
 2017-02-15 09:09:27 -08:00
Junping Du
2aa6f317f6 YARN-6174. Log files pattern should be same for both running and finished container. Contributed by Xuan Gong. 
(cherry picked from commit ce2d5bfa5f84e7e563980796549b56ef1e4bbf1e)
 2017-02-15 09:08:54 -08:00
Wei-Chiu Chuang
a8531d5d52 HDFS-11333. Print a user friendly error message when plugins are not found. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 859bd159ae554174200334b5eb1d7e8dbef958ad)
 2017-02-15 02:59:45 -08:00
Varun Saxena
9cab25a63d YARN-6156. AM blacklisting to consider node label partition (Bibin A Chundatt via Varun Saxena) 
(cherry picked from commit b7613e0f406fb2b9bd5b1b3c79658e801f63c587)
 2017-02-15 14:58:39 +05:30
Masatake Iwasaki
cba7e2c346 YARN-4753. Use doxia macro to generate in-page TOC of YARN site documentation. (iwasakims) 2017-02-15 13:37:25 +09:00
Karthik Kambatla
58acb676a2 YARN-6061. Addendum. Remove extraneous change. 
(cherry picked from commit 353a9b2d9165a221491395edbadf8acc3a39990b)
 2017-02-14 15:20:11 -08:00
Yongjun Zhang
eb5500f0e7 HDFS-11391. Numeric usernames do no work with WebHDFS FS write access. (Pierre Villard via Yongjun Zhang) 
(cherry picked from commit 8e53f2b9b08560bf4f8e81e697063277dbdc68f9)
 2017-02-14 14:11:45 -08:00
Karthik Kambatla
37921b3fef YARN-6061. Add an UncaughtExceptionHandler for critical threads in RM. (Yufei Gu via kasha) 
(cherry picked from commit 652679aa8ad6f9e61b8ed8e2b04b3e0332025e94)
 2017-02-14 13:40:06 -08:00
Xiaoyu Yao
d72f1c5976 HDFS-11409. DatanodeInfo getNetworkLocation and setNetworkLocation shoud use volatile instead of synchronized. Contributed by Chen Liang. 
(cherry picked from commit aaf27132350547fcde1fdb372f19626838f44bc4)
 2017-02-14 12:55:49 -08:00
Xiao Chen
92dbdbc490 HDFS-11390. Add process name to httpfs process. Contributed by Weiwei Yang. 2017-02-14 09:46:55 -08:00
Wei-Chiu Chuang
8e291e1015 HDFS-11084. Add a regression test for sticky bit support of OIV ReverseXML processor. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 89cadb42111e4ffbd3f4bde8250013bba23eb51e)
 2017-02-14 09:08:37 -08:00
Akira Ajisaka
25ac54a52e HADOOP-14058. Fix NativeS3FileSystemContractBaseTest#testDirWithDifferentMarkersWorks. Contributed by Yiqun Lin. 
(cherry picked from commit b9f8491252f5a23a91a1d695d748556a0fd803ae)
 2017-02-15 01:46:59 +09:00
Karthik Kambatla
30ff5bff1a YARN-3933. FairScheduler: Multiple calls to completedContainer are not safe. (Shiwei Guo and Miklos Szegedi via kasha) 
(cherry picked from commit 646c6d6509f515b1373288869fb92807fa2ddc9b)
 2017-02-13 11:27:02 -08:00
Wei-Chiu Chuang
12ad077aa6 HADOOP-13233. help of stat is confusing. Contributed by Attila Bukor. 
(cherry picked from commit cc45da79fda7dfba2795ac397d62f40a858dcdd9)
 2017-02-13 10:17:41 -08:00
Junping Du
205fc1f10c YARN-6113. Re-direct NM Web Service to get container logs for finished applications. Contributed by Xuan Gong. 
(cherry picked from commit 464ff479ceec76609dca3539081de6b503b17325)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/webapp/TestNMWebServices.java
 2017-02-13 06:16:04 -08:00
Lei Xu
6d62d0ea87 HADOOP-13204. Add support for SSE-KMS and SSE-C in s3a filesystem. (Steve Moist via lei) 2017-02-11 15:02:19 -08:00
Arpit Agarwal
4c5655ef1a HDFS-11403. Addendum fix for branch-2. 2017-02-11 01:25:43 -08:00
Arpit Agarwal
32a0c2b5e7 HDFS-11403. Zookeper ACLs on NN HA enabled clusters should be handled consistently. Contributed by Hanisha Koneru. 2017-02-11 01:18:07 -08:00
Kihwal Lee
33c62d2d19 HDFS-11379. DFSInputStream may infinite loop requesting block locations. Contributed by Daryn Sharp. 2017-02-10 12:52:14 -06:00
Arpit Agarwal
c88ec54588 HADOOP-14055. SwiftRestClient includes pass length in exception if auth fails. Contributed by Marcell Hegedus. 2017-02-10 10:09:39 -08:00
Daniel Templeton
7c3578ca17 YARN-6166. Unnecessary INFO logs in AMRMClientAsyncImpl$CallbackHandlerThread.run (Contributed by Grant Whiteheart via Daniel Templeton) 
(cherry picked from commit 1238fa71f8e62cecde6e2437d1b83ad3922295f8)
 2017-02-10 09:48:50 -08:00
Sunil G
7b2b6caf12 YARN-6118. Add javadoc for Resources.isNone. Contributed by Andres Perez. 
(cherry picked from commit 3a0a0a485a4145e3bd2e5946731ee1d901b51ead)
 2017-02-10 15:54:59 +05:30
Karthik Kambatla
e259a818ad YARN-6144. FairScheduler: preempted resources can become negative. (Miklos Szegedi via kasha) 
(cherry picked from commit 08f93978f3ec724b24a93d7ef538f158da75802f)
 2017-02-09 14:45:21 -08:00
Kihwal Lee
5de6f1b791 HADOOP-14033. Reduce fair call queue lock contention. Contributed by Daryn Sharp. 
(cherry picked from commit 0c01cf57987bcc7a17154a3538960b67f625a9e5)
 2017-02-09 16:20:06 -06:00
Karthik Kambatla
41361ec39e YARN-6112. UpdateCallDuration is calculated only when debug logging is enabled. (Yufei Gu via kasha) 2017-02-09 13:12:21 -08:00
Kihwal Lee
d008b55153 HADOOP-14034. Allow ipc layer exceptions to selectively close connections. Contributed by Daryn Sharp. 2017-02-09 10:55:40 -06:00
Kihwal Lee
2039d021f9 HADOOP-14032. Reduce fair call queue priority inversion. Contributed by Daryn Sharp. 
(cherry picked from commit a0bfb4150464013a618f30c2e38d88fc6de11ad2)
 2017-02-09 10:13:37 -06:00
Jason Lowe
e330c3806c YARN-6137. Yarn client implicitly invoke ATS client which accesses HDFS. Contributed by Li Lu 
(cherry picked from commit 37b4acf7cee1f05599a84bbb1ebf07979a71f82f)
 2017-02-08 15:00:50 -06:00
Junping Du
33e7c3044f YARN-6145. Improve log message on fail over. Contributed by Jian He. 
(cherry picked from commit eec52e158b7bc14b2d3d53512323ba05e15e09e3)
 2017-02-08 02:15:11 -08:00
Sidharta S
127ed38d13 YARN-5258. Document Use of Docker with LinuxContainerExecutor (Contributed by Daniel Templeton) 2017-02-07 16:35:56 -08:00
Daniel Templeton
85261cbe0e MAPREDUCE-6842. Update the links in PiEstimator document (Contributed by Jung Yoo via Daniel Templeton) 
(cherry picked from commit 0e58b368f001b3bb4031b923b63dce7c81d42d39)
 2017-02-07 13:06:50 -08:00
Junping Du
ab41da7e64 YARN-6108. Improve AHS webservice to accept NM address as a parameter to get container logs. Contributed by Xuan Gong. 
(cherry picked from commit 9dbfab1284015af6983b4a55b79c9e65bc0194e5)
 2017-02-07 02:14:09 -08:00
Junping Du
81e2d54ac6 MAPREDUCE-6404. Allow AM to specify a port range for starting its webapp. Contributed by Varun Saxena. 
(cherry picked from commit 7afe5b1a3165e284ae831cd307a526763399f66d)
 2017-02-07 01:46:17 -08:00
Yiqun Lin
26bed5ce53 HDFS-11377. Balancer hung due to no available mover threads. Contributed by yunjiong zhao. 
(cherry picked from commit 9cbbd1eae893b21212c9bc9e6745c6859317a667)
 2017-02-06 13:18:14 +08:00
Junping Du
b7d59e790b HADOOP-12097. Allow port range to be specified while starting webapp. Contributed by Varun Saxena. 
(cherry picked from commit cce35c38159b23eb55204b3c9afcaa3215f4f4ef)

Conflicts:

	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/http/HttpServer2.java
 2017-02-05 20:13:49 -08:00
Junping Du
378d62663f MAPREDUCE-6338. MR AppMaster does not honor ephemeral port range. Contributed by Frank Nguyen. 
(cherry picked from commit d401e63b6c3695d1f8f3f4958b8d592b15342b17)
 2017-02-05 19:28:53 -08:00
Akira Ajisaka
be9b02e0b6 HADOOP-14053. Update the link to HTrace SpanReceivers. Contributed by Yiqun Lin. 
(cherry picked from commit cb8f3f3adf7a22e8fb6fdfc44f3ec781c1526bfd)
 2017-02-04 10:59:18 +09:00
Xiao Chen
05ed48b75a HADOOP-14044. Synchronization issue in delegation token cancel functionality. Contributed by Hrishikesh Gadre. 
(cherry picked from commit ba75bc759334c8987e5f7dd4b21d025f0cccbde7)
 2017-02-03 17:27:35 -08:00
Kihwal Lee
7baa6dac54 HADOOP-14050. Add process name to kms process. Contributed by Rushabh S Shah. 2017-02-03 15:38:55 -06:00
Arpit Agarwal
f17d3eddcf HDFS-11387. Socket reuse address option is not honored in PrivilegedNfsGatewayStarter. Contributed by Mukul Kumar Singh. 2017-02-03 12:28:17 -08:00