Commit Graph

11317 Commits

Author SHA1 Message Date
Masatake Iwasaki 97cda4077a HDFS-9599. TestDecommissioningStatus.testDecommissionStatus occasionally fails (Lin Yiqun via iwasakims)
(cherry picked from commit 154d2532cf)
2016-04-05 03:44:12 +09:00
Arpit Agarwal 334beb337f HADOOP-11212. NetUtils.wrapException to handle SocketException explicitly. (Contributed by Steve Loughran) 2016-04-04 10:50:38 -07:00
Steve Loughran 4d7162e934 HADOOP-12169 ListStatus on empty dir in S3A lists itself instead of returning an empty list. author: Pieter Reuse. - omitted new S3A subclass 2016-04-04 17:00:51 +01:00
naganarasimha 9bd089ac64 YARN-4746. yarn web services should convert parse failures of appId, appAttemptId and containerId to 400. Contributed by Bibin A Chundatt
(cherry picked from commit 5092c94195)
2016-04-04 18:16:23 +05:30
Steve Loughran ab67b50543 HADOOP-12169 ListStatus on empty dir in S3A lists itself instead of returning an empty list. author: Pieter Reuse. 2016-04-03 16:39:14 +01:00
Vinayakumar B bafcb584a8 HDFS-10253. Fix TestRefreshCallQueue failure (Contributed by Xiaoyu Yao)
(cherry picked from commit 54b2e78fd2)
(cherry picked from commit aa38748997)
2016-04-03 13:28:52 +05:30
Allen Wittenauer 608223b51b YARN-4850. test-fair-scheduler.xml isn't valid xml (Yufei Gu via aw)
(cherry picked from commit b1394d6307)
(cherry picked from commit 92a3dbe44f)
2016-04-01 16:58:00 -07:00
Arun Suresh 82d1f858ee Missing file for YARN-4895.
(cherry picked from commit 5686caa9fc)
2016-04-01 15:58:54 -07:00
Arun Suresh 9def4d4d39 YARN-4895. Add subtractFrom method to ResourceUtilization class. Contributed by Konstantinos Karanasos.
(cherry picked from commit 82621e38a0)
2016-04-01 15:00:30 -07:00
Harsh J 719c131c4d HADOOP-11687. Ignore x-* and response headers when copying an Amazon S3 object. Contributed by Aaron Peterson and harsh.
(cherry picked from commit 256c82fe29)
(cherry picked from commit 7c5b55d4e5)
2016-04-01 14:15:43 +01:00
Akira Ajisaka 7887fab815 HADOOP-11661. Deprecate FileUtil#copyMerge. Contributed by Brahma Reddy Battula.
(cherry picked from commit a8d8b80a20)
(cherry picked from commit 80d122d7fe)
2016-04-01 14:01:14 +09:00
Xiaoyu Yao dc78250aa4 HADOOP-12950. ShutdownHookManager should have a timeout for each of the Registered shutdown hook. Contributed by Xiaoyu Yao.
(cherry picked from commit aac4d65bf9)
2016-03-31 15:44:19 -07:00
Wangda Tan 6d454a5d6e YARN-4634. Scheduler UI/Metrics need to consider cases like non-queue label mappings. (Sunil G via wangda)
(cherry picked from commit 12b11e2e68)
2016-03-31 14:36:34 -07:00
Sangjin Lee 5e94e539e0 YARN-4183. Clarify the behavior of timeline service config properties (Naganarasimha G R via sjlee)
(cherry picked from commit 6d67420dbc)
2016-03-31 10:50:18 -07:00
Xiaoyu Yao a0c001c0b9 HADOOP-12916. Allow RPC scheduler/callqueue backoff using response times. Contributed by Xiaoyu Yao.
(cherry picked from commit d95c6eb32c)
2016-03-31 08:58:46 -07:00
Akira Ajisaka 2d7084db20 HADOOP-12902. JavaDocs for SignerSecretProvider are out-of-date in AuthenticationFilter. Contributed by Gabor Liptak.
(cherry picked from commit acca149ec9)
(cherry picked from commit b4fbc22688)
2016-03-31 16:06:03 +09:00
Akira Ajisaka 3892efd3fb HDFS-10221. Add .json to the rat exclusions. Contributed by Ming Ma.
(cherry picked from commit 32c0c3ecdf)
(cherry picked from commit 0795ee687b)
2016-03-31 09:06:48 +09:00
Zhe ZHang 2da1194699 HADOOP-12886. Exclude weak ciphers in SSLFactory through ssl-server.xml. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 9216993b02)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/ssl/SSLFactory.java
2016-03-30 14:19:29 -07:00
Colin Patrick Mccabe 5cf55c5fb6 HDFS-10223. peerFromSocketAndKey performs SASL exchange before setting connection timeouts (cmccabe)
(cherry picked from commit 37e23ce45c)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/erasurecode/ErasureCodingWorker.java

(cherry picked from commit be5894c12d)
2016-03-30 13:45:05 -07:00
Vinayakumar B def143e1e1 HDFS-5177. blocksScheduled count should be decremented for abandoned blocks (Contributed by Vinayakumar B)
(cherry picked from commit 09d63d5a19)
(cherry picked from commit 0852e44110)
2016-03-30 14:23:56 +08:00
Akira Ajisaka 73d51f5c47 MAPREDUCE-6663. [NNBench] Refactor nnbench as a Tool implementation. Contributed by Brahma Reddy Battula.
(cherry picked from commit 690d8a368d)
(cherry picked from commit 94b2ba89a4)
2016-03-30 11:44:49 +09:00
Colin Patrick Mccabe 28c81640d3 HADOOP-12972. Lz4Compressor#getLibraryName returns the wrong version number (cmccabe)
(cherry picked from commit e3d15a2e23)
(cherry picked from commit 9df2e54160)
2016-03-29 17:15:31 -07:00
Arpit Agarwal bfe657e83a HDFS-10228. TestHDFSCLI fails. (Contributed by Akira AJISAKA) 2016-03-29 13:56:12 -07:00
Arpit Agarwal 9c4631b6f1 HDFS-9478. Reason for failing ipc.FairCallQueue contruction should be thrown. (Contributed by Ajith S) 2016-03-29 12:09:25 -07:00
Andrew Wang 026b84bf70 HDFS-10197. TestFsDatasetCache failing intermittently due to timeout. Contributed by Lin Yiqun.
(cherry picked from commit f2aec4eb82)
(cherry picked from commit 1d79b57c14)
2016-03-29 11:55:04 -07:00
Akira Ajisaka 68cd8112e7 MAPREDUCE-6543. Migrate MR client test cases part 2. Contributed by Dustin Cote.
(cherry picked from commit 0050fa5f1c)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/TestMRJobClient.java
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/lib/partition/TestTotalOrderPartitioner.java

(cherry picked from commit 7b2cf29f4f)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/TestMRJobClient.java
2016-03-29 18:24:22 +09:00
Xuan d5ea2462c2 YARN-4863. AHS Security login should be in serviceInit() instead of serviceStart(). Contributed by Junping Du
(cherry picked from commit 80182809ae)
(cherry picked from commit ffe01e05cd)
2016-03-28 22:21:31 -07:00
Vinayakumar B 88b56cdfaa HDFS-9871. "Bytes Being Moved" -ve(-1 B) when cluster was already balanced. (Contributed by Brahma Reddy Battulla)
(cherry picked from commit 1f004b3367)
(cherry picked from commit f74364e8b9)
2016-03-29 11:31:18 +08:00
Jason Lowe 35f9cfda61 YARN-4773. Log aggregation performs extraneous filesystem operations when rolling log aggregation is disabled. Contributed by Jun Gong
(cherry picked from commit 948b758070)
2016-03-28 23:03:16 +00:00
Andrew Wang cb79533777 HADOOP-10965. Print fully qualified path in CommandWithDestination error messages. Contributed by John Zhuge.
(cherry picked from commit 8bfaa80037)
(cherry picked from commit a61a90c562)
2016-03-28 14:14:07 -07:00
Jian He 7c81e374da YARN-4117. End to end unit test with mini YARN cluster for AMRMProxy Service. Contributed by Giovanni Matteo Fumarola 2016-03-28 13:23:53 -07:00
Jian He 0c84f9aee2 YARN-998. Keep NM resource updated through dynamic resource config for RM/NM restart. Contributed by Junping Du
(cherry picked from commit c7d843af3b)
2016-03-28 11:28:59 -07:00
Walter Su d71843558b HDFS-10182. Hedged read might overwrite user's buf. Contributed by zhouyingchao.
(cherry picked from commit d8383c687c)
2016-03-28 15:45:40 +08:00
Akira Ajisaka 0286ac2576 Revert "MAPREDUCE-6543. Migrate MR client test cases part 2. Contributed by Dustin Cote."
This reverts commit 416ea158c2.
2016-03-28 16:06:10 +09:00
Akira Ajisaka b029011a23 HADOOP-12873. Remove MRv1 terms from HttpAuthentication.md. Contributed by Brahma Reddy Battula.
(cherry picked from commit 01cfee6381)
(cherry picked from commit 42d312663f)
2016-03-28 15:58:40 +09:00
Jason Lowe 25b476e93b HADOOP-12958. PhantomReference for filesystem statistics can trigger OOM. Contributed by Sangjin Lee
(cherry picked from commit 9a09200a1f)
2016-03-25 23:00:18 +00:00
Arun Suresh 1a194f8751 YARN-4823. Refactor the nested reservation id field in listReservation to simple string field. (subru via asuresh)
(cherry picked from commit 00bebb7e58)
2016-03-25 15:57:11 -07:00
Andrew Wang d2c33ba61e HADOOP-12962. KMS key names are incorrectly encoded when creating key. Contributed by Xiao Chen.
(cherry picked from commit d4df7849a5)
(cherry picked from commit c58599acba)
2016-03-25 15:29:09 -07:00
Jason Lowe e06446be74 YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. Contributed by Xuan Gong
(cherry picked from commit e8fc81f9c8)
2016-03-25 20:20:01 +00:00
Akira Ajisaka 416ea158c2 MAPREDUCE-6543. Migrate MR client test cases part 2. Contributed by Dustin Cote.
(cherry picked from commit 2c268cc936)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/TestMRJobClient.java
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/lib/partition/TestTotalOrderPartitioner.java

(cherry picked from commit 0dc1453626)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/TestMRJobClient.java
2016-03-25 15:33:01 +09:00
Arun Suresh 945e3cd55c YARN-4687. Document Reservation ACLs (Contributed by Sean Po)
(cherry picked from commit 2e1d0ff4e9)
2016-03-24 10:42:07 -07:00
Arun Suresh 2399e1e46a YARN-4683. Document the List Reservations REST API. (Contributed by Sean Po)
(cherry picked from commit d820975c1a)
2016-03-24 10:32:13 -07:00
Arun Suresh 3c2b610b68 YARN-4825. Remove redundant code in ClientRMService::listReservations. (subru via asuresh)
(cherry picked from commit d82e797b65)
2016-03-24 10:02:17 -07:00
Junping Du 782db43d18 YARN-4820. ResourceManager web redirects in HA mode drops query parameters. Contributed by Varun Vasudev.
(cherry picked from commit 19b645c938)
(cherry picked from commit c722262c75)
2016-03-23 19:39:09 -07:00
Andrew Wang e0dad0b53a HADOOP-12947. Update documentation Hadoop Groups Mapping to add static group mapping, negative cache. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 938222b2e2)
(cherry picked from commit daf24eeb6b)
2016-03-23 14:57:32 -07:00
Andrew Wang d4aeddee31 HDFS-10200. Docs for WebHDFS still describe GETDELEGATIONTOKENS operation. Contributed by Wellington Chevreuil.
(cherry picked from commit 8f85e5d212)
(cherry picked from commit c658deabb6)
2016-03-23 12:56:17 -07:00
Chris Nauroth f3e4dac87d HDFS-10199. Unit tests TestCopyFiles, TestDistCh, TestLogalyzer under org.apache.hadoop.tools are failing. Contributed by Tibor Kiss.
(cherry picked from commit 57a0e6543c)
2016-03-23 12:17:39 -07:00
Colin Patrick Mccabe 4ca13e7b98 HDFS-10193. fuse_dfs segfaults if uid cannot be resolved to a username (John Thiltges via cmccabe)
(cherry picked from commit 0d19a0ce98)
(cherry picked from commit 7ad3162df4)
2016-03-23 11:20:12 -07:00
Junping Du 762c7d4361 YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. Contributed by Xuan Gong.
(cherry picked from commit af1d125f9c)
(cherry picked from commit 76602161c0)
2016-03-23 09:02:56 -07:00
Akira Ajisaka f362b8a403 MAPREDUCE-6656. [NNBench] OP_DELETE operation isn't working after MAPREDUCE-6363. Contributed by J.Andreina.
(cherry picked from commit 368c77376a)
(cherry picked from commit 7a3fd1bc1a)
2016-03-23 23:24:40 +09:00