Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,946 Commits 326 Branches 371 Tags
Commit Graph

10946 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Colin Patrick Mccabe
28c81640d3 HADOOP-12972. Lz4Compressor#getLibraryName returns the wrong version number (cmccabe) 
(cherry picked from commit e3d15a2e236f93325c67f9e52fb16f645c44238a)
(cherry picked from commit 9df2e54160d3d959138857757d2d64d595b54093)
 2016-03-29 17:15:31 -07:00
Arpit Agarwal
bfe657e83a HDFS-10228. TestHDFSCLI fails. (Contributed by Akira AJISAKA) 2016-03-29 13:56:12 -07:00
Arpit Agarwal
9c4631b6f1 HDFS-9478. Reason for failing ipc.FairCallQueue contruction should be thrown. (Contributed by Ajith S) 2016-03-29 12:09:25 -07:00
Andrew Wang
026b84bf70 HDFS-10197. TestFsDatasetCache failing intermittently due to timeout. Contributed by Lin Yiqun. 
(cherry picked from commit f2aec4eb824647a01e14b4eede03af0babe65fb6)
(cherry picked from commit 1d79b57c14410417b1ecccabfe2c695a1c6cd6a2)
 2016-03-29 11:55:04 -07:00
Akira Ajisaka
68cd8112e7 MAPREDUCE-6543. Migrate MR client test cases part 2. Contributed by Dustin Cote. 
(cherry picked from commit 0050fa5f1c20087009bd76a0bb2183a479f787f0)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/TestMRJobClient.java
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/lib/partition/TestTotalOrderPartitioner.java

(cherry picked from commit 7b2cf29f4f673a955910b335d46687989cde478b)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/TestMRJobClient.java
 2016-03-29 18:24:22 +09:00
Xuan
d5ea2462c2 YARN-4863. AHS Security login should be in serviceInit() instead of serviceStart(). Contributed by Junping Du 
(cherry picked from commit 80182809aed76fb9522d25db9bf5e445395dd573)
(cherry picked from commit ffe01e05cdfe0c1484de0f2116014a63cdc51364)
 2016-03-28 22:21:31 -07:00
Vinayakumar B
88b56cdfaa HDFS-9871. "Bytes Being Moved" -ve(-1 B) when cluster was already balanced. (Contributed by Brahma Reddy Battulla) 
(cherry picked from commit 1f004b3367c57de9e8a67040a57efc31c9ba8ee2)
(cherry picked from commit f74364e8b9423f2cd923097a3b30fbd925c70d19)
 2016-03-29 11:31:18 +08:00
Jason Lowe
35f9cfda61 YARN-4773. Log aggregation performs extraneous filesystem operations when rolling log aggregation is disabled. Contributed by Jun Gong 
(cherry picked from commit 948b75807068c304ffe789e32f2b850c0d653e0a)
 2016-03-28 23:03:16 +00:00
Andrew Wang
cb79533777 HADOOP-10965. Print fully qualified path in CommandWithDestination error messages. Contributed by John Zhuge. 
(cherry picked from commit 8bfaa80037365c0790083313a905d1e7d88b0682)
(cherry picked from commit a61a90c5621f7cbc28d150aeaa1fbd92ad76e498)
 2016-03-28 14:14:07 -07:00
Jian He
7c81e374da YARN-4117. End to end unit test with mini YARN cluster for AMRMProxy Service. Contributed by Giovanni Matteo Fumarola 2016-03-28 13:23:53 -07:00
Jian He
0c84f9aee2 YARN-998. Keep NM resource updated through dynamic resource config for RM/NM restart. Contributed by Junping Du 
(cherry picked from commit c7d843af3b1adde602fe0335f52ffa28b0371bf4)
 2016-03-28 11:28:59 -07:00
Walter Su
d71843558b HDFS-10182. Hedged read might overwrite user's buf. Contributed by zhouyingchao. 
(cherry picked from commit d8383c687c95dbb37effa307ab2d41497da1cfc2)
 2016-03-28 15:45:40 +08:00
Akira Ajisaka
0286ac2576 Revert "MAPREDUCE-6543. Migrate MR client test cases part 2. Contributed by Dustin Cote." 
This reverts commit 416ea158c2aa197b4a997ed420842154a1294b1d.
 2016-03-28 16:06:10 +09:00
Akira Ajisaka
b029011a23 HADOOP-12873. Remove MRv1 terms from HttpAuthentication.md. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 01cfee63815a1c9d63652edc21db63626df7e53c)
(cherry picked from commit 42d312663fd1399d4b5eaa99584090ddaaec1d9b)
 2016-03-28 15:58:40 +09:00
Jason Lowe
25b476e93b HADOOP-12958. PhantomReference for filesystem statistics can trigger OOM. Contributed by Sangjin Lee 
(cherry picked from commit 9a09200a1f5f752e266d4fb8e0c808073080bde8)
 2016-03-25 23:00:18 +00:00
Arun Suresh
1a194f8751 YARN-4823. Refactor the nested reservation id field in listReservation to simple string field. (subru via asuresh) 
(cherry picked from commit 00bebb7e58ba6899904e1619d151aa1b2f5b6acd)
 2016-03-25 15:57:11 -07:00
Andrew Wang
d2c33ba61e HADOOP-12962. KMS key names are incorrectly encoded when creating key. Contributed by Xiao Chen. 
(cherry picked from commit d4df7849a5caf749403bd89d29652f69c9c3f5a8)
(cherry picked from commit c58599acba369fd18f42e4c0c32094440787b2cc)
 2016-03-25 15:29:09 -07:00
Jason Lowe
e06446be74 YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. Contributed by Xuan Gong 
(cherry picked from commit e8fc81f9c812b0c167411de7f1789a9a433a0d57)
 2016-03-25 20:20:01 +00:00
Akira Ajisaka
416ea158c2 MAPREDUCE-6543. Migrate MR client test cases part 2. Contributed by Dustin Cote. 
(cherry picked from commit 2c268cc9365851f5b02d967d13c8c0cbca850a86)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/TestMRJobClient.java
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/lib/partition/TestTotalOrderPartitioner.java

(cherry picked from commit 0dc145362642f6e5f9def8f50775b5c16599f6e6)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/TestMRJobClient.java
 2016-03-25 15:33:01 +09:00
Arun Suresh
945e3cd55c YARN-4687. Document Reservation ACLs (Contributed by Sean Po) 
(cherry picked from commit 2e1d0ff4e901b8313c8d71869735b94ed8bc40a0)
 2016-03-24 10:42:07 -07:00
Arun Suresh
2399e1e46a YARN-4683. Document the List Reservations REST API. (Contributed by Sean Po) 
(cherry picked from commit d820975c1aadd74e79ed6c7da02a4124abcc1172)
 2016-03-24 10:32:13 -07:00
Arun Suresh
3c2b610b68 YARN-4825. Remove redundant code in ClientRMService::listReservations. (subru via asuresh) 
(cherry picked from commit d82e797b652f248e238bdf1818e6b4a5b91cea7a)
 2016-03-24 10:02:17 -07:00
Junping Du
782db43d18 YARN-4820. ResourceManager web redirects in HA mode drops query parameters. Contributed by Varun Vasudev. 
(cherry picked from commit 19b645c93801a53d4486f9a7639186525e51f723)
(cherry picked from commit c722262c759d5cddf97de4249c563c8d165b7c9f)
 2016-03-23 19:39:09 -07:00
Andrew Wang
e0dad0b53a HADOOP-12947. Update documentation Hadoop Groups Mapping to add static group mapping, negative cache. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 938222b2e20791d6eb410e36f8fec3e1520e1078)
(cherry picked from commit daf24eeb6bdb99b811a3e5077181cb4299e3577f)
 2016-03-23 14:57:32 -07:00
Andrew Wang
d4aeddee31 HDFS-10200. Docs for WebHDFS still describe GETDELEGATIONTOKENS operation. Contributed by Wellington Chevreuil. 
(cherry picked from commit 8f85e5d2128c54c47d2a0098f6f4d4e04d53d74b)
(cherry picked from commit c658deabb66ce2e02bf462ccdf603e21eb65e100)
 2016-03-23 12:56:17 -07:00
Chris Nauroth
f3e4dac87d HDFS-10199. Unit tests TestCopyFiles, TestDistCh, TestLogalyzer under org.apache.hadoop.tools are failing. Contributed by Tibor Kiss. 
(cherry picked from commit 57a0e6543cd00c5b8a9c0ee5a9613596a7e8b78e)
 2016-03-23 12:17:39 -07:00
Colin Patrick Mccabe
4ca13e7b98 HDFS-10193. fuse_dfs segfaults if uid cannot be resolved to a username (John Thiltges via cmccabe) 
(cherry picked from commit 0d19a0ce98053572447bdadf88687ec55f2f1f46)
(cherry picked from commit 7ad3162df421ee1104c90de08235af467d08e76b)
 2016-03-23 11:20:12 -07:00
Junping Du
762c7d4361 YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. Contributed by Xuan Gong. 
(cherry picked from commit af1d125f9ce35ec69a610674a1c5c60cc17141a7)
(cherry picked from commit 76602161c006ddc9cf2404ac762f127f107d14cd)
 2016-03-23 09:02:56 -07:00
Akira Ajisaka
f362b8a403 MAPREDUCE-6656. [NNBench] OP_DELETE operation isn't working after MAPREDUCE-6363. Contributed by J.Andreina. 
(cherry picked from commit 368c77376a3704e3fa395d72b1816d388b5cd782)
(cherry picked from commit 7a3fd1bc1a2ce93100b6887a97733e262b5e1d56)
 2016-03-23 23:24:40 +09:00
Akira Ajisaka
9d7c88f275 MAPREDUCE-6580. Test failure: TestMRJobsWithProfiler. Contributed by Eric Badger. 
(cherry picked from commit 0bfe5a0167f0af65f1d7a8bc251a1c404ed41316)
(cherry picked from commit 12c1cc889ab955c30a8dc5ed68f1df1a5c557933)
 2016-03-23 13:19:26 +09:00
Colin Patrick Mccabe
31843df277 HDFS-10189. PacketResponder#toString should include the downstreams for PacketResponderType.HAS_DOWNSTREAM_IN_PIPELINE (Joe Pallas via cmccabe) 
(cherry picked from commit a7d8f2b3960d27c74abb17ce2aa4bcd999706ad2)
(cherry picked from commit a68a9eb2b131e426ad16854e83ef81418442e989)
 2016-03-22 17:22:15 -07:00
Benoy Antony
1b263ea490 HADOOP-12929. JWTRedirectAuthenticationHandler must accommodate null expiration time. Contributed by Larry McCay. 
(cherry picked from commit e7ed05e4f5b0421e93f2f2cadc5beda3d28b9911)
 2016-03-21 13:31:55 -07:00
Colin Patrick Mccabe
29872506bc HDFS-9951. Use string constants for XML tags in OfflineImageReconstructor (Lin Yiqun via cmccabe) 
(cherry picked from commit 680716f31e120f4d3ee70b095e4db46c05b891d9)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/offlineImageViewer/OfflineImageReconstructor.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/offlineImageViewer/PBImageXmlWriter.java

(cherry picked from commit 2ce24bf21826fcb81cbb27765807ca9d12bedf6a)
 2016-03-21 11:49:19 -07:00
Andrew Wang
ea44650a64 HDFS-9405. Warmup NameNode EDEK caches in background thread. Contributed by Xiao Chen. 
(cherry picked from commit e3bb38d62567eafe57d16b78deeba1b71c58e41c)
(cherry picked from commit e826d860a7f587fac95e0abf257750d0a40ec65d)
 2016-03-21 11:40:26 -07:00
Haohui Mai
88e7466c4b HADOOP-12819. Migrate TestSaslRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng. 2016-03-20 17:43:10 -07:00
Haohui Mai
57fed702f1 HDFS-7166. SbNN Web UI shows #Under replicated blocks and #pending deletion blocks. Contributed by Wei-Chiu Chuang. 2016-03-20 17:22:09 -07:00
Eric Payne
878e1cfc77 YARN-4686. MiniYARNCluster.start() returns before cluster is completely started. Contributed by Eric Badger. 
(cherry picked from commit 92b7e0d41302b6b110927f99de5c2b4a4a93c5fd)
 2016-03-18 17:19:06 +00:00
Akira Ajisaka
2fe4225051 HDFS-3677. dfs.namenode.edits.dir.required is missing from hdfs-default.xml. Contributed by Mark Yang. 
(cherry picked from commit 414f33126ac178a44146666cc7c00059cfc9cabf)
(cherry picked from commit 41621a994dd3add51ec95a3136070c148b133726)
 2016-03-19 01:11:06 +09:00
Kihwal Lee
242c7f1fee HDFS-9874. Long living DataXceiver threads cause volume shutdown to block. Contributed by Rushabh Shah. 
(cherry picked from commit 63c966a3fbeb675959fc4101e65de9f57aecd17d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
 2016-03-18 10:33:13 -05:00
Colin Patrick Mccabe
73b5a44b0e HDFS-9949. Add a test case to ensure that the DataNode does not regenerate its UUID when a storage directory is cleared (Harsh J via cmccabe) 
(cherry picked from commit dc951e606f40bb779632a8a3e3a46aeccc4a446a)
(cherry picked from commit f69a6c36325f53d5a1b201c8357d94e4139b9a93)
 2016-03-17 10:43:07 -07:00
Junping Du
52ce763a54 YARN-4785. inconsistent value type of the type field for LeafQueueInfo in response of RM REST API. 
(cherry picked from commit ca8106d2dd03458944303d93679daa03b1d82ad5)
(cherry picked from commit 66257613b420ea8e0754f6ea8fc2d6816f0741e0)
 2016-03-17 09:30:43 -07:00
Akira Ajisaka
73ab502271 MAPREDUCE-6645. TestWordStats outputs logs under directories other than target/test-dir. Contributed by Gabor Liptak. 
(cherry picked from commit 80fa70c4e15f16b411cb3691df546499c6a19d4c)
(cherry picked from commit 365d236175ad64c0155926713b74823e1e493bb7)
 2016-03-17 18:09:38 +09:00
Xuan
d21bee170b Revert "YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. (Xuan Gong via gtcarrera9)" 
This reverts commit 3a0b69544183f71c4683bc477656473494fc09d0.

(cherry picked from commit a888b5bc533bb91a3394f15a69879be1d7838592)
(cherry picked from commit 398dbde538e0bda2ec8a3b9f21c52526dfa90754)
 2016-03-15 22:12:05 -07:00
Wangda Tan
2d9f42d685 MAPREDUCE-6579. JobStatus#getFailureInfo should not output diagnostic information when the job is running. (Akira AJISAKA via wangda) 
(cherry picked from commit 6529c87551e07e9da1e1b273eff4c6bad6b3e838)
 2016-03-15 17:32:32 -07:00
Li Lu
8640a9c45f YARN-4817. Change Log Level to DEBUG for putDomain call in ATS 1.5. (Xuan Gong via gtcarrera9) 
(cherry-picked from commit 5176a69868484f864c977a6cd13923167082407c)
 2016-03-15 11:49:09 -07:00
Li Lu
0ebc947140 YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. (Xuan Gong via gtcarrera9) 
(cherry picked from commit 3a0b69544183f71c4683bc477656473494fc09d0)
 2016-03-15 11:43:39 -07:00
Kihwal Lee
fce39557d3 HDFS-9904. testCheckpointCancellationDuringUpload occasionally fails. Contributed by Lin Yiqun. 
(cherry picked from commit d4574017845cfa7521e703f80efd404afd09b8c4)
 2016-03-15 10:55:10 -05:00
Tsz-Wo Nicholas Sze
d59c2c4518 HADOOP-12923. Move the test code in ipc.Client to test. 2016-03-14 15:55:20 -07:00
Ravi Prakash
9e804d14c9 HDFS-9953. Download File from UI broken after pagination. Contributed by Brahma Reddy Battula 
(cherry picked from commit 51b7d8935af7487547d46693946b386409edc6c8)
 2016-03-14 14:33:29 -07:00
Chris Nauroth
e6c6f4ddac HDFS-9941. Do not log StandbyException on NN, other minor logging fixes. Contributed by Arpit Agarwal. 
(cherry picked from commit 5644137adad30c84e40d2c4719627b3aabc73628)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockUnderConstructionFeature.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirWriteFileOp.java

(cherry picked from commit dd462bc32f77799827c1bd438ee8fa54dacb20eb)
 2016-03-14 09:55:34 -07:00