Commit Graph

11276 Commits

Author SHA1 Message Date
Colin Patrick Mccabe be5894c12d HDFS-10223. peerFromSocketAndKey performs SASL exchange before setting connection timeouts (cmccabe)
(cherry picked from commit 37e23ce45c)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/erasurecode/ErasureCodingWorker.java
2016-03-30 13:42:24 -07:00
Jian He f1f441b80f YARN-4822. Refactor existing Preemption Policy of CS for easier adding new approach to select preemption candidates. Contributed by Wangda Tan 2016-03-30 12:46:36 -07:00
Vinayakumar B 0852e44110 HDFS-5177. blocksScheduled count should be decremented for abandoned blocks (Contributed by Vinayakumar B)
(cherry picked from commit 09d63d5a19)
2016-03-30 14:23:11 +08:00
Akira Ajisaka 94b2ba89a4 MAPREDUCE-6663. [NNBench] Refactor nnbench as a Tool implementation. Contributed by Brahma Reddy Battula.
(cherry picked from commit 690d8a368d)
2016-03-30 11:44:33 +09:00
Robert Kanter b7e6d5cbfe YARN-4436. DistShell ApplicationMaster.ExecBatScripStringtPath is misspelled (mattlamantia via rkanter)
(cherry picked from commit 8286270466)
2016-03-29 17:21:50 -07:00
Colin Patrick Mccabe 9df2e54160 HADOOP-12972. Lz4Compressor#getLibraryName returns the wrong version number (cmccabe)
(cherry picked from commit e3d15a2e23)
2016-03-29 17:14:36 -07:00
Wangda Tan 6856a7183a YARN-4865. Track Reserved resources in ResourceUsage and QueueCapacities. (Sunil G via wangda)
(cherry picked from commit fc055a3cbe)
2016-03-29 17:10:17 -07:00
Arpit Agarwal ed15cb9a30 HDFS-9439. Support reconfiguring fs.protected.directories without NN restart. (Contributed by Xiaobing Zhou) 2016-03-29 13:56:02 -07:00
Arpit Agarwal 8ee2140706 HDFS-10228. TestHDFSCLI fails. (Contributed by Akira AJISAKA) 2016-03-29 13:56:00 -07:00
Arpit Agarwal 759d0acdd4 HDFS-9478. Reason for failing ipc.FairCallQueue contruction should be thrown. (Contributed by Ajith S) 2016-03-29 12:09:10 -07:00
Andrew Wang 1d79b57c14 HDFS-10197. TestFsDatasetCache failing intermittently due to timeout. Contributed by Lin Yiqun.
(cherry picked from commit f2aec4eb82)
2016-03-29 11:54:52 -07:00
Akira Ajisaka 7b2cf29f4f MAPREDUCE-6543. Migrate MR client test cases part 2. Contributed by Dustin Cote.
(cherry picked from commit 0050fa5f1c)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/TestMRJobClient.java
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/lib/partition/TestTotalOrderPartitioner.java
2016-03-29 18:20:01 +09:00
Xuan ffe01e05cd YARN-4863. AHS Security login should be in serviceInit() instead of serviceStart(). Contributed by Junping Du
(cherry picked from commit 80182809ae)
2016-03-28 22:18:56 -07:00
Vinayakumar B f74364e8b9 HDFS-9871. "Bytes Being Moved" -ve(-1 B) when cluster was already balanced. (Contributed by Brahma Reddy Battulla)
(cherry picked from commit 1f004b3367)
2016-03-29 11:28:10 +08:00
Rohith Sharma K S f22ce96b50 MAPREDUCE-6662. Clear ASF Warnings on test data files. Contributed by Vinayakumar B
(cherry picked from commit 0ef8bbfd87)
2016-03-29 10:35:04 +08:00
Jason Lowe edf17fe8e5 YARN-4773. Log aggregation performs extraneous filesystem operations when rolling log aggregation is disabled. Contributed by Jun Gong
(cherry picked from commit 948b758070)
2016-03-28 23:02:15 +00:00
Andrew Wang a61a90c562 HADOOP-10965. Print fully qualified path in CommandWithDestination error messages. Contributed by John Zhuge.
(cherry picked from commit 8bfaa80037)
2016-03-28 14:14:05 -07:00
Jian He c7d843af3b YARN-998. Keep NM resource updated through dynamic resource config for RM/NM restart. Contributed by Junping Du 2016-03-28 11:13:02 -07:00
Robert Kanter 5a552973f4 HADOOP-12954. Add a way to change hadoop.security.token.service.use_ip (rkanter)
(cherry picked from commit 8cac1bb09f)
2016-03-28 10:37:58 -07:00
Jian He d2f9adca88 Missing file for YARN-4117. 2016-03-28 09:23:06 -07:00
Junping Du ae29b1a17b MAPREDUCE-6655. Fix a typo (STRICT_IE6) in Encrypted Shuffle. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 90fcb16c0f)
2016-03-28 05:31:46 -07:00
Walter Su 07b0abe0b3 HDFS-10182. Hedged read might overwrite user's buf. Contributed by zhouyingchao.
(cherry picked from commit d8383c687c)
2016-03-28 15:46:01 +08:00
Akira Ajisaka 2b1f066d2d Revert "MAPREDUCE-6543. Migrate MR client test cases part 2. Contributed by Dustin Cote."
This reverts commit 0dc1453626.
2016-03-28 16:05:55 +09:00
Akira Ajisaka 42d312663f HADOOP-12873. Remove MRv1 terms from HttpAuthentication.md. Contributed by Brahma Reddy Battula.
(cherry picked from commit 01cfee6381)
2016-03-28 15:58:28 +09:00
Jian He bdc648ebe7 YARN-4117. End to end unit test with mini YARN cluster for AMRMProxy Service. Contributed by Giovanni Matteo Fumarola 2016-03-27 20:22:49 -07:00
Karthik Kambatla 4212f2e2bf YARN-4805. Don't go through all schedulers in ParameterizedTestBase. (kasha)
(cherry picked from commit 49ff54c860)
2016-03-26 21:45:29 -07:00
Lei Xu ae98314980 Add missing files from HDFS-9005. (lei) 2016-03-25 18:13:01 -07:00
Lei Xu 493648611d HDFS-9005. Provide support for upgrade domain script. (Ming Ma via Lei Xu) 2016-03-25 17:12:44 -07:00
Jason Lowe 5e823d839d HADOOP-12958. PhantomReference for filesystem statistics can trigger OOM. Contributed by Sangjin Lee
(cherry picked from commit 9a09200a1f)
2016-03-25 22:59:14 +00:00
Andrew Wang c58599acba HADOOP-12962. KMS key names are incorrectly encoded when creating key. Contributed by Xiao Chen.
(cherry picked from commit d4df7849a5)
2016-03-25 15:29:06 -07:00
Jason Lowe 3cea00a294 YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. Contributed by Xuan Gong
(cherry picked from commit e8fc81f9c8)
2016-03-25 20:19:15 +00:00
Jason Lowe 8360d98d6a MAPREDUCE-6535. TaskID default constructor results in NPE on toString(). Contributed by Daniel Templeton
(cherry picked from commit 3f622a143c)
2016-03-25 20:07:56 +00:00
Akira Ajisaka 0dc1453626 MAPREDUCE-6543. Migrate MR client test cases part 2. Contributed by Dustin Cote.
(cherry picked from commit 2c268cc936)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/TestMRJobClient.java
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/lib/partition/TestTotalOrderPartitioner.java
2016-03-25 15:23:23 +09:00
Junping Du c722262c75 YARN-4820. ResourceManager web redirects in HA mode drops query parameters. Contributed by Varun Vasudev.
(cherry picked from commit 19b645c938)
2016-03-23 19:35:14 -07:00
Andrew Wang daf24eeb6b HADOOP-12947. Update documentation Hadoop Groups Mapping to add static group mapping, negative cache. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 938222b2e2)
2016-03-23 14:57:18 -07:00
Andrew Wang c658deabb6 HDFS-10200. Docs for WebHDFS still describe GETDELEGATIONTOKENS operation. Contributed by Wellington Chevreuil.
(cherry picked from commit 8f85e5d212)
2016-03-23 12:55:23 -07:00
Chris Nauroth 57a0e6543c HDFS-10199. Unit tests TestCopyFiles, TestDistCh, TestLogalyzer under org.apache.hadoop.tools are failing. Contributed by Tibor Kiss. 2016-03-23 12:17:27 -07:00
Colin Patrick Mccabe 7ad3162df4 HDFS-10193. fuse_dfs segfaults if uid cannot be resolved to a username (John Thiltges via cmccabe)
(cherry picked from commit 0d19a0ce98)
2016-03-23 11:19:55 -07:00
Junping Du 76602161c0 YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. Contributed by Xuan Gong.
(cherry picked from commit af1d125f9c)
2016-03-23 08:58:05 -07:00
Akira Ajisaka 7a3fd1bc1a MAPREDUCE-6656. [NNBench] OP_DELETE operation isn't working after MAPREDUCE-6363. Contributed by J.Andreina.
(cherry picked from commit 368c77376a)
2016-03-23 23:24:30 +09:00
Akira Ajisaka c0c6dd9093 HADOOP-12952. BUILDING example of zero-docs dist should skip javadocs. Contributed by Steve Loughran.
(cherry picked from commit a107cee14b)
2016-03-23 14:16:11 +09:00
Akira Ajisaka 12c1cc889a MAPREDUCE-6580. Test failure: TestMRJobsWithProfiler. Contributed by Eric Badger.
(cherry picked from commit 0bfe5a0167)
2016-03-23 13:19:08 +09:00
Colin Patrick Mccabe a68a9eb2b1 HDFS-10189. PacketResponder#toString should include the downstreams for PacketResponderType.HAS_DOWNSTREAM_IN_PIPELINE (Joe Pallas via cmccabe)
(cherry picked from commit a7d8f2b396)
2016-03-22 17:21:54 -07:00
Li Lu 8bbb5efbfb MAPREDUCE-6110. JobHistoryServer CLI throws NullPointerException with job ids that do not exist. (Kai Sasaki via gtcarrera9)
(cherry picked from commit 57ead18a85)
2016-03-22 14:29:12 -07:00
Benoy Antony 4dd02f9484 HADOOP-12929. JWTRedirectAuthenticationHandler must accommodate null expiration time. Contributed by Larry McCay.
(cherry picked from commit e7ed05e4f5)
2016-03-21 13:21:54 -07:00
Colin Patrick Mccabe 2ce24bf218 HDFS-9951. Use string constants for XML tags in OfflineImageReconstructor (Lin Yiqun via cmccabe)
(cherry picked from commit 680716f31e)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/offlineImageViewer/OfflineImageReconstructor.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/offlineImageViewer/PBImageXmlWriter.java
2016-03-21 11:46:09 -07:00
Andrew Wang e826d860a7 HDFS-9405. Warmup NameNode EDEK caches in background thread. Contributed by Xiao Chen.
(cherry picked from commit e3bb38d625)
2016-03-21 11:39:19 -07:00
Sangjin Lee d956e0a0bb HDFS-9579. Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level (Ming Ma via sjlee) 2016-03-21 10:56:32 -07:00
Haohui Mai 478a25b929 HADOOP-12819. Migrate TestSaslRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng. 2016-03-20 17:41:20 -07:00
Haohui Mai 6236782151 HDFS-7166. SbNN Web UI shows #Under replicated blocks and #pending deletion blocks. Contributed by Wei-Chiu Chuang. 2016-03-20 17:21:53 -07:00