Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,229 Commits 326 Branches 371 Tags
Commit Graph

11229 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Akira Ajisaka
b4fbc22688 HADOOP-12902. JavaDocs for SignerSecretProvider are out-of-date in AuthenticationFilter. Contributed by Gabor Liptak. 
(cherry picked from commit acca149ec96f2932bebc492452a63a159de9ce47)
 2016-03-31 16:05:51 +09:00
Akira Ajisaka
0795ee687b HDFS-10221. Add .json to the rat exclusions. Contributed by Ming Ma. 
(cherry picked from commit 32c0c3ecdf72e89a63f4aee5e75d1c5a12714b89)
 2016-03-31 09:06:34 +09:00
Zhe ZHang
9216993b02 HADOOP-12886. Exclude weak ciphers in SSLFactory through ssl-server.xml. Contributed by Wei-Chiu Chuang. 2016-03-30 14:14:05 -07:00
Colin Patrick Mccabe
be5894c12d HDFS-10223. peerFromSocketAndKey performs SASL exchange before setting connection timeouts (cmccabe) 
(cherry picked from commit 37e23ce45c592f3c9c48a08a52a5f46787f6c0e9)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/erasurecode/ErasureCodingWorker.java
 2016-03-30 13:42:24 -07:00
Jian He
f1f441b80f YARN-4822. Refactor existing Preemption Policy of CS for easier adding new approach to select preemption candidates. Contributed by Wangda Tan 2016-03-30 12:46:36 -07:00
Vinayakumar B
0852e44110 HDFS-5177. blocksScheduled count should be decremented for abandoned blocks (Contributed by Vinayakumar B) 
(cherry picked from commit 09d63d5a192b5d6b172f94ff6c94da348fd49ea6)
 2016-03-30 14:23:11 +08:00
Akira Ajisaka
94b2ba89a4 MAPREDUCE-6663. [NNBench] Refactor nnbench as a Tool implementation. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 690d8a368d3e967495eafea27659b6124989c89e)
 2016-03-30 11:44:33 +09:00
Robert Kanter
b7e6d5cbfe YARN-4436. DistShell ApplicationMaster.ExecBatScripStringtPath is misspelled (mattlamantia via rkanter) 
(cherry picked from commit 82862704665aa0bad51118b1b48c7230b194c01c)
 2016-03-29 17:21:50 -07:00
Colin Patrick Mccabe
9df2e54160 HADOOP-12972. Lz4Compressor#getLibraryName returns the wrong version number (cmccabe) 
(cherry picked from commit e3d15a2e236f93325c67f9e52fb16f645c44238a)
 2016-03-29 17:14:36 -07:00
Wangda Tan
6856a7183a YARN-4865. Track Reserved resources in ResourceUsage and QueueCapacities. (Sunil G via wangda) 
(cherry picked from commit fc055a3cbe9545cf1c59421641c7b296aa33f953)
 2016-03-29 17:10:17 -07:00
Arpit Agarwal
ed15cb9a30 HDFS-9439. Support reconfiguring fs.protected.directories without NN restart. (Contributed by Xiaobing Zhou) 2016-03-29 13:56:02 -07:00
Arpit Agarwal
8ee2140706 HDFS-10228. TestHDFSCLI fails. (Contributed by Akira AJISAKA) 2016-03-29 13:56:00 -07:00
Arpit Agarwal
759d0acdd4 HDFS-9478. Reason for failing ipc.FairCallQueue contruction should be thrown. (Contributed by Ajith S) 2016-03-29 12:09:10 -07:00
Andrew Wang
1d79b57c14 HDFS-10197. TestFsDatasetCache failing intermittently due to timeout. Contributed by Lin Yiqun. 
(cherry picked from commit f2aec4eb824647a01e14b4eede03af0babe65fb6)
 2016-03-29 11:54:52 -07:00
Akira Ajisaka
7b2cf29f4f MAPREDUCE-6543. Migrate MR client test cases part 2. Contributed by Dustin Cote. 
(cherry picked from commit 0050fa5f1c20087009bd76a0bb2183a479f787f0)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/TestMRJobClient.java
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/lib/partition/TestTotalOrderPartitioner.java
 2016-03-29 18:20:01 +09:00
Xuan
ffe01e05cd YARN-4863. AHS Security login should be in serviceInit() instead of serviceStart(). Contributed by Junping Du 
(cherry picked from commit 80182809aed76fb9522d25db9bf5e445395dd573)
 2016-03-28 22:18:56 -07:00
Vinayakumar B
f74364e8b9 HDFS-9871. "Bytes Being Moved" -ve(-1 B) when cluster was already balanced. (Contributed by Brahma Reddy Battulla) 
(cherry picked from commit 1f004b3367c57de9e8a67040a57efc31c9ba8ee2)
 2016-03-29 11:28:10 +08:00
Rohith Sharma K S
f22ce96b50 MAPREDUCE-6662. Clear ASF Warnings on test data files. Contributed by Vinayakumar B 
(cherry picked from commit 0ef8bbfd8791899c7cfed3dd9c1670182fd87575)
 2016-03-29 10:35:04 +08:00
Jason Lowe
edf17fe8e5 YARN-4773. Log aggregation performs extraneous filesystem operations when rolling log aggregation is disabled. Contributed by Jun Gong 
(cherry picked from commit 948b75807068c304ffe789e32f2b850c0d653e0a)
 2016-03-28 23:02:15 +00:00
Andrew Wang
a61a90c562 HADOOP-10965. Print fully qualified path in CommandWithDestination error messages. Contributed by John Zhuge. 
(cherry picked from commit 8bfaa80037365c0790083313a905d1e7d88b0682)
 2016-03-28 14:14:05 -07:00
Jian He
c7d843af3b YARN-998. Keep NM resource updated through dynamic resource config for RM/NM restart. Contributed by Junping Du 2016-03-28 11:13:02 -07:00
Robert Kanter
5a552973f4 HADOOP-12954. Add a way to change hadoop.security.token.service.use_ip (rkanter) 
(cherry picked from commit 8cac1bb09f55ff2f285914e349507472ff86f4d7)
 2016-03-28 10:37:58 -07:00
Jian He
d2f9adca88 Missing file for YARN-4117. 2016-03-28 09:23:06 -07:00
Junping Du
ae29b1a17b MAPREDUCE-6655. Fix a typo (STRICT_IE6) in Encrypted Shuffle. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 90fcb16c0fc7cded2593948f1cc08f3d1ae88bda)
 2016-03-28 05:31:46 -07:00
Walter Su
07b0abe0b3 HDFS-10182. Hedged read might overwrite user's buf. Contributed by zhouyingchao. 
(cherry picked from commit d8383c687c95dbb37effa307ab2d41497da1cfc2)
 2016-03-28 15:46:01 +08:00
Akira Ajisaka
2b1f066d2d Revert "MAPREDUCE-6543. Migrate MR client test cases part 2. Contributed by Dustin Cote." 
This reverts commit 0dc145362642f6e5f9def8f50775b5c16599f6e6.
 2016-03-28 16:05:55 +09:00
Akira Ajisaka
42d312663f HADOOP-12873. Remove MRv1 terms from HttpAuthentication.md. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 01cfee63815a1c9d63652edc21db63626df7e53c)
 2016-03-28 15:58:28 +09:00
Jian He
bdc648ebe7 YARN-4117. End to end unit test with mini YARN cluster for AMRMProxy Service. Contributed by Giovanni Matteo Fumarola 2016-03-27 20:22:49 -07:00
Karthik Kambatla
4212f2e2bf YARN-4805. Don't go through all schedulers in ParameterizedTestBase. (kasha) 
(cherry picked from commit 49ff54c8609431f5d1a6bee84df3b52fec445379)
 2016-03-26 21:45:29 -07:00
Lei Xu
ae98314980 Add missing files from HDFS-9005. (lei) 2016-03-25 18:13:01 -07:00
Lei Xu
493648611d HDFS-9005. Provide support for upgrade domain script. (Ming Ma via Lei Xu) 2016-03-25 17:12:44 -07:00
Jason Lowe
5e823d839d HADOOP-12958. PhantomReference for filesystem statistics can trigger OOM. Contributed by Sangjin Lee 
(cherry picked from commit 9a09200a1f5f752e266d4fb8e0c808073080bde8)
 2016-03-25 22:59:14 +00:00
Andrew Wang
c58599acba HADOOP-12962. KMS key names are incorrectly encoded when creating key. Contributed by Xiao Chen. 
(cherry picked from commit d4df7849a5caf749403bd89d29652f69c9c3f5a8)
 2016-03-25 15:29:06 -07:00
Jason Lowe
3cea00a294 YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. Contributed by Xuan Gong 
(cherry picked from commit e8fc81f9c812b0c167411de7f1789a9a433a0d57)
 2016-03-25 20:19:15 +00:00
Jason Lowe
8360d98d6a MAPREDUCE-6535. TaskID default constructor results in NPE on toString(). Contributed by Daniel Templeton 
(cherry picked from commit 3f622a143c5fb15fee7e5dded99e4a4136f19810)
 2016-03-25 20:07:56 +00:00
Akira Ajisaka
0dc1453626 MAPREDUCE-6543. Migrate MR client test cases part 2. Contributed by Dustin Cote. 
(cherry picked from commit 2c268cc9365851f5b02d967d13c8c0cbca850a86)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/TestMRJobClient.java
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/lib/partition/TestTotalOrderPartitioner.java
 2016-03-25 15:23:23 +09:00
Junping Du
c722262c75 YARN-4820. ResourceManager web redirects in HA mode drops query parameters. Contributed by Varun Vasudev. 
(cherry picked from commit 19b645c93801a53d4486f9a7639186525e51f723)
 2016-03-23 19:35:14 -07:00
Andrew Wang
daf24eeb6b HADOOP-12947. Update documentation Hadoop Groups Mapping to add static group mapping, negative cache. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 938222b2e20791d6eb410e36f8fec3e1520e1078)
 2016-03-23 14:57:18 -07:00
Andrew Wang
c658deabb6 HDFS-10200. Docs for WebHDFS still describe GETDELEGATIONTOKENS operation. Contributed by Wellington Chevreuil. 
(cherry picked from commit 8f85e5d2128c54c47d2a0098f6f4d4e04d53d74b)
 2016-03-23 12:55:23 -07:00
Chris Nauroth
57a0e6543c HDFS-10199. Unit tests TestCopyFiles, TestDistCh, TestLogalyzer under org.apache.hadoop.tools are failing. Contributed by Tibor Kiss. 2016-03-23 12:17:27 -07:00
Colin Patrick Mccabe
7ad3162df4 HDFS-10193. fuse_dfs segfaults if uid cannot be resolved to a username (John Thiltges via cmccabe) 
(cherry picked from commit 0d19a0ce98053572447bdadf88687ec55f2f1f46)
 2016-03-23 11:19:55 -07:00
Junping Du
76602161c0 YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. Contributed by Xuan Gong. 
(cherry picked from commit af1d125f9ce35ec69a610674a1c5c60cc17141a7)
 2016-03-23 08:58:05 -07:00
Akira Ajisaka
7a3fd1bc1a MAPREDUCE-6656. [NNBench] OP_DELETE operation isn't working after MAPREDUCE-6363. Contributed by J.Andreina. 
(cherry picked from commit 368c77376a3704e3fa395d72b1816d388b5cd782)
 2016-03-23 23:24:30 +09:00
Akira Ajisaka
c0c6dd9093 HADOOP-12952. BUILDING example of zero-docs dist should skip javadocs. Contributed by Steve Loughran. 
(cherry picked from commit a107cee14bb5446057da81d1c95d7fffd759e497)
 2016-03-23 14:16:11 +09:00
Akira Ajisaka
12c1cc889a MAPREDUCE-6580. Test failure: TestMRJobsWithProfiler. Contributed by Eric Badger. 
(cherry picked from commit 0bfe5a0167f0af65f1d7a8bc251a1c404ed41316)
 2016-03-23 13:19:08 +09:00
Colin Patrick Mccabe
a68a9eb2b1 HDFS-10189. PacketResponder#toString should include the downstreams for PacketResponderType.HAS_DOWNSTREAM_IN_PIPELINE (Joe Pallas via cmccabe) 
(cherry picked from commit a7d8f2b3960d27c74abb17ce2aa4bcd999706ad2)
 2016-03-22 17:21:54 -07:00
Li Lu
8bbb5efbfb MAPREDUCE-6110. JobHistoryServer CLI throws NullPointerException with job ids that do not exist. (Kai Sasaki via gtcarrera9) 
(cherry picked from commit 57ead18a85e15aef1993f49157cf05aed38f1c87)
 2016-03-22 14:29:12 -07:00
Benoy Antony
4dd02f9484 HADOOP-12929. JWTRedirectAuthenticationHandler must accommodate null expiration time. Contributed by Larry McCay. 
(cherry picked from commit e7ed05e4f5b0421e93f2f2cadc5beda3d28b9911)
 2016-03-21 13:21:54 -07:00
Colin Patrick Mccabe
2ce24bf218 HDFS-9951. Use string constants for XML tags in OfflineImageReconstructor (Lin Yiqun via cmccabe) 
(cherry picked from commit 680716f31e120f4d3ee70b095e4db46c05b891d9)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/offlineImageViewer/OfflineImageReconstructor.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/offlineImageViewer/PBImageXmlWriter.java
 2016-03-21 11:46:09 -07:00
Andrew Wang
e826d860a7 HDFS-9405. Warmup NameNode EDEK caches in background thread. Contributed by Xiao Chen. 
(cherry picked from commit e3bb38d62567eafe57d16b78deeba1b71c58e41c)
 2016-03-21 11:39:19 -07:00