Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,175 Commits 326 Branches 371 Tags
Commit Graph

11175 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Robert Kanter
3584cbc355 MAPREDUCE-6647. MR usage counters use the resources requested instead of the resources allocated (haibochen via rkanter) 
(cherry picked from commit 3be1ab485f557c8a3c6a5066453f24d8d61f30be)
 2016-04-06 17:16:10 -07:00
Jian He
42bc565630 YARN-4769. Add support for CSRF header in the dump capacity scheduler logs and kill app buttons in RM web UI. Contributed by Varun Vasudev 2016-04-06 16:14:13 -07:00
Eric Payne
caef78afe6 HDFS-9945. Datanode command for evicting writers. Contributed by Kihwal Lee 
(cherry picked from commit aede8c10ecad4f2a8802a834e4bd0b8286cebade)
 2016-04-06 20:31:20 +00:00
Colin Patrick Mccabe
387d3f25c1 HDFS-6520. hdfs fsck passes invalid length value when creating BlockReader (Xiao Chen via cmccabe) 
(cherry picked from commit 188f65287d5b2f26a8862c88198f83ac59035016)
 2016-04-06 11:37:57 -07:00
Jing Zhao
7cac807eb3 HDFS-10192. Namenode safemode not coming out during failover. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 221b3a8722f84f8e9ad0a98eea38a12cc4ad2f24)
 2016-04-06 10:43:38 -07:00
Junping Du
5574f82799 MAPREDUCE-6670. TestJobListCache#testEviction sometimes fails on Windows with timeout. Contributed by Gergely Novák. 
(cherry picked from commit de96d7c88a42cd54bd88ce2de63122998e967efa)
 2016-04-06 08:35:51 -07:00
Akira Ajisaka
1371f993a9 HADOOP-12022. fix site -Pdocs -Pdist in hadoop-project-dist; cleanout remaining forrest bits. Contributed by Allen Wittenauer. 2016-04-06 17:43:31 +09:00
Varun Vasudev
8f9b97ccce YARN-4906. Capture container start/finish time in container metrics. Contributed by Jian He. 
(cherry picked from commit b41e65e5bc9459b4d950a2c53860a223f1a0d2ec)
 2016-04-06 13:42:06 +05:30
Wangda Tan
11e796b5cd YARN-4699. Scheduler UI and REST o/p is not in sync when -replaceLabelsOnNode is used to change label of a node. (Sunil G via wangda) 
(cherry picked from commit 21eb4284487d6f8e4beedb8a0c3168e952f224fc)
 2016-04-05 16:25:55 -07:00
Kihwal Lee
6e37c5fe80 HDFS-10261. TestBookKeeperHACheckpoints doesn't handle ephemeral HTTP ports. Contributed by Eric Badger. 
(cherry picked from commit 9ba1e5af06070ba01dcf46e1a4c66713a1d43352)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal/src/test/java/org/apache/hadoop/contrib/bkjournal/TestBookKeeperHACheckpoints.java
 2016-04-05 16:49:59 -05:00
Ravi Prakash
2ca6251a6a HDFS-10235. Last contact for Live Nodes should be relative time. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 0cd320a8463efe19a6228f9fe14693aa37ac8a10)
 2016-04-05 13:43:42 -07:00
Masatake Iwasaki
e98bb0279b YARN-4917. Fix typos in documentation of Capacity Scheduler. (Takashi Ohnishi via iwasakims) 
(cherry picked from commit 500e5a5952f8f34bf0e1e2653fa01b357d68cc8f)
 2016-04-06 04:01:34 +09:00
Masatake Iwasaki
36a3fe0334 YARN-4915. Fix typo in YARN Secure Containers documentation (Takashi Ohnishi via iwasakims) 
(cherry picked from commit 30206346cf13fe1b7267f86e7c210b77c86b88c9)
 2016-04-06 03:47:42 +09:00
Masatake Iwasaki
2542e9bccf HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims) 
(cherry picked from commit 85ec5573eb9fd746a9295ecc6fe1ae683073aaf5)
 2016-04-06 03:26:33 +09:00
Junping Du
0907ce8c93 YARN-4916. TestNMProxy.tesNMProxyRPCRetry fails. Contributed by Tibor Kiss. 
(cherry picked from commit 00058167431475c6e63c80207424f1d365569e3a)
 2016-04-05 09:02:50 -07:00
Kihwal Lee
ef3da82357 HDFS-10239. Fsshell mv fails if port usage doesn't match in src and destination paths. Contributed by Kuhu Shukla. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSShell.java
 2016-04-05 09:16:05 -05:00
Junping Du
eeff2e35f8 YARN-4893. Fix some intermittent test failures in TestRMAdminService. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 6be28bcc461292b24589dae17a235b3eaadc07ed)
 2016-04-05 07:05:06 -07:00
Jason Lowe
814ceeb489 YARN-4311. Removing nodes from include and exclude lists will not remove them from decommissioned nodes list. Contributed by Kuhu Shukla 
(cherry picked from commit 1cbcd4a491e6a57d466c2897335614dc6770b475)
 2016-04-05 13:41:18 +00:00
Rohith Sharma K S
13a4e25f26 YARN-4609. RM Nodes list page takes too much time to load. Contributed by Bibin A Chundatt 
(cherry picked from commit 776b549e2ac20a68a5513cbcaac0edc33233dc03)
 2016-04-05 14:53:24 +05:30
Rohith Sharma K S
eec23580b4 YARN-4880. Running TestZKRMStateStorePerf with real zookeeper cluster throws NPE. Contributed by Sunil G 
(cherry picked from commit 552237d4a34ab10fa5f9ec7aad7942f2a110993e)
 2016-04-05 14:37:31 +05:30
Vinayakumar B
ad08114b92 HDFS-9917. IBR accumulate more objects when SNN was down for sometime. (Contributed by Brahma Reddy Battula) 
(cherry picked from commit 818d6b799eead13a17a0214172df60a269b046fb)
 2016-04-05 09:53:57 +08:00
Colin Patrick Mccabe
d55af8b5a3 HDFS-8496. Calling stopWriter() with FSDatasetImpl lock held may block other threads (cmccabe) 
(cherry picked from commit f6b1a818124cc42688c4c5acaf537d96cf00e43b)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockRecovery.java
 2016-04-04 18:07:01 -07:00
Li Lu
236d1a5093 YARN-4706. UI Hosting Configuration in TimelineServer doc is broken. (Akira AJISAKA via gtcarrera9) 
(cherry picked from commit f61de4173684aa1767cef20b3cb4d54df20273cd)
 2016-04-04 14:41:40 -07:00
Kihwal Lee
9e91433295 HDFS-10178. Permanent write failures can happen if pipeline recoveries occur for the first packet. Contributed by Kihwal Lee. 
(cherry picked from commit a7d1fb0cd2fdbf830602eb4dbbd9bbe62f4d5584)
 2016-04-04 16:40:44 -05:00
Masatake Iwasaki
c981efb0f6 HDFS-9599. TestDecommissioningStatus.testDecommissionStatus occasionally fails (Lin Yiqun via iwasakims) 
(cherry picked from commit 154d2532cf015e9ab9141864bd3ab0d6100ef597)
 2016-04-05 03:39:10 +09:00
Arpit Agarwal
30e12edb67 HADOOP-11212. NetUtils.wrapException to handle SocketException explicitly. (Contributed by Steve Loughran) 2016-04-04 10:50:28 -07:00
Steve Loughran
caaadf9f3e HADOOP-12169 ListStatus on empty dir in S3A lists itself instead of returning an empty list. author: Pieter Reuse. - omitted new S3A subclass 2016-04-04 17:01:37 +01:00
naganarasimha
3772602848 YARN-4746. yarn web services should convert parse failures of appId, appAttemptId and containerId to 400. Contributed by Bibin A Chundatt 
(cherry picked from commit 5092c94195a63bd2c3e36d5a74b4c061cea1b847)
 2016-04-04 18:08:18 +05:30
Rohith Sharma K S
c8271cd117 YARN-4607. Pagination support for AppAttempt page TotalOutstandingResource Requests table. Contributed by Bibin A Chundatt 
(cherry picked from commit 1e6f92977dc5431b117745feb5a3491e88a559c0)
 2016-04-04 08:13:03 +05:30
Steve Loughran
20e808d83e HADOOP-12169 ListStatus on empty dir in S3A lists itself instead of returning an empty list. author: Pieter Reuse. 2016-04-03 16:39:51 +01:00
Vinayakumar B
aa38748997 HDFS-10253. Fix TestRefreshCallQueue failure (Contributed by Xiaoyu Yao) 
(cherry picked from commit 54b2e78fd28c9def42bec7f0418833bad352686c)
 2016-04-03 13:28:22 +05:30
Allen Wittenauer
92a3dbe44f YARN-4850. test-fair-scheduler.xml isn't valid xml (Yufei Gu via aw) 
(cherry picked from commit b1394d6307425a41d388c71e39f0880babb2c7a9)
 2016-04-01 16:57:31 -07:00
Karthik Kambatla
ecfd25dc65 YARN-4657. Javadoc comment is broken for Resources.multiplyByAndAddTo(). (Daniel Templeton via kasha) 
(cherry picked from commit 81d04cae41182808ace5d86cdac7e4d71871eb1e)
 2016-04-01 16:20:18 -07:00
Arun Suresh
f56266fccc Missing file for YARN-4895. 
(cherry picked from commit 5686caa9fcb59759c9286385575f31e407a97c16)
 2016-04-01 15:58:38 -07:00
Arun Suresh
24ce9ea456 YARN-4895. Add subtractFrom method to ResourceUtilization class. Contributed by Konstantinos Karanasos. 
(cherry picked from commit 82621e38a0445832998bc00693279e23a98605c1)
 2016-04-01 15:00:02 -07:00
Harsh J
7c5b55d4e5 HADOOP-11687. Ignore x-* and response headers when copying an Amazon S3 object. Contributed by Aaron Peterson and harsh. 
(cherry picked from commit 256c82fe2981748cd0befc5490d8118d139908f9)
 2016-04-01 14:35:58 +05:30
Varun Vasudev
10d8f8a39c Revert "YARN-4857. Add missing default configuration regarding preemption of CapacityScheduler. Contributed by Kai Sasaki." 
This reverts commit 0064cba169d1bb761f6e81ee86830be598d7c500.

(cherry picked from commit 3488c4f2c9767684eb1007bb00250f474c06d5d8)
 2016-04-01 12:21:49 +05:30
Akira Ajisaka
80d122d7fe HADOOP-11661. Deprecate FileUtil#copyMerge. Contributed by Brahma Reddy Battula. 
(cherry picked from commit a8d8b80a205c78bf0aa65d32a6a83c16d3ea3f0b)
 2016-04-01 13:59:45 +09:00
Xiaoyu Yao
ab9dc84d4a HADOOP-12950. ShutdownHookManager should have a timeout for each of the Registered shutdown hook. Contributed by Xiaoyu Yao. 
(cherry picked from commit aac4d65bf9c6d68f53610e5fe9997a391e3fa053)
(cherry picked from commit dc78250aa4ba17e3ddaf0c5c0b0457ba7023c4cb)
 2016-03-31 15:50:17 -07:00
Robert Kanter
633f612d67 YARN-4639. Remove dead code in TestDelegationTokenRenewer added in YARN-3055 (templedf via rkanter) 
(cherry picked from commit 7a021471c376ce846090fbd1a315266bada048d4)
 2016-03-31 15:47:44 -07:00
Wangda Tan
d36d9d676d YARN-4634. Scheduler UI/Metrics need to consider cases like non-queue label mappings. (Sunil G via wangda) 
(cherry picked from commit 12b11e2e688158404feeb3ded37eb6cccad4ea5c)
 2016-03-31 14:35:59 -07:00
Jian He
3afc2caec8 YARN-4811. Generate histograms in ContainerMetrics for actual container resource usage 2016-03-31 14:31:38 -07:00
Sangjin Lee
b91928cd26 YARN-4183. Clarify the behavior of timeline service config properties (Naganarasimha G R via sjlee) 
(cherry picked from commit 6d67420dbc5c6097216fa40fcec8ed626b2bae14)
 2016-03-31 10:49:45 -07:00
Xiaoyu Yao
6db3c9d394 HADOOP-12916. Allow RPC scheduler/callqueue backoff using response times. Contributed by Xiaoyu Yao. 
(cherry picked from commit d95c6eb32cec7768ac418fb467b1198ccf3cf0dc)
(cherry picked from commit a0c001c0b95f9c98b747f0534c33e3725940adab)
 2016-03-31 09:05:37 -07:00
Varun Vasudev
dcad99892d YARN-4857. Add missing default configuration regarding preemption of CapacityScheduler. Contributed by Kai Sasaki. 
(cherry picked from commit 0064cba169d1bb761f6e81ee86830be598d7c500)
 2016-03-31 14:06:45 +05:30
Varun Vasudev
cda9e1d09b YARN-4884. Fix missing documentation about rmadmin command regarding node labels. Contributed by Kai Sasaki. 
(cherry picked from commit f1b8f6b2c16403869f78a54268ae1165982a7050)
 2016-03-31 14:03:08 +05:30
Akira Ajisaka
b4fbc22688 HADOOP-12902. JavaDocs for SignerSecretProvider are out-of-date in AuthenticationFilter. Contributed by Gabor Liptak. 
(cherry picked from commit acca149ec96f2932bebc492452a63a159de9ce47)
 2016-03-31 16:05:51 +09:00
Akira Ajisaka
0795ee687b HDFS-10221. Add .json to the rat exclusions. Contributed by Ming Ma. 
(cherry picked from commit 32c0c3ecdf72e89a63f4aee5e75d1c5a12714b89)
 2016-03-31 09:06:34 +09:00
Zhe ZHang
9216993b02 HADOOP-12886. Exclude weak ciphers in SSLFactory through ssl-server.xml. Contributed by Wei-Chiu Chuang. 2016-03-30 14:14:05 -07:00
Colin Patrick Mccabe
be5894c12d HDFS-10223. peerFromSocketAndKey performs SASL exchange before setting connection timeouts (cmccabe) 
(cherry picked from commit 37e23ce45c592f3c9c48a08a52a5f46787f6c0e9)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/erasurecode/ErasureCodingWorker.java
 2016-03-30 13:42:24 -07:00