Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,252 Commits 326 Branches 371 Tags
Commit Graph

11252 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jian He
bdc648ebe7 YARN-4117. End to end unit test with mini YARN cluster for AMRMProxy Service. Contributed by Giovanni Matteo Fumarola 2016-03-27 20:22:49 -07:00
Karthik Kambatla
4212f2e2bf YARN-4805. Don't go through all schedulers in ParameterizedTestBase. (kasha) 
(cherry picked from commit 49ff54c8609431f5d1a6bee84df3b52fec445379)
 2016-03-26 21:45:29 -07:00
Lei Xu
ae98314980 Add missing files from HDFS-9005. (lei) 2016-03-25 18:13:01 -07:00
Lei Xu
493648611d HDFS-9005. Provide support for upgrade domain script. (Ming Ma via Lei Xu) 2016-03-25 17:12:44 -07:00
Jason Lowe
5e823d839d HADOOP-12958. PhantomReference for filesystem statistics can trigger OOM. Contributed by Sangjin Lee 
(cherry picked from commit 9a09200a1f5f752e266d4fb8e0c808073080bde8)
 2016-03-25 22:59:14 +00:00
Andrew Wang
c58599acba HADOOP-12962. KMS key names are incorrectly encoded when creating key. Contributed by Xiao Chen. 
(cherry picked from commit d4df7849a5caf749403bd89d29652f69c9c3f5a8)
 2016-03-25 15:29:06 -07:00
Jason Lowe
3cea00a294 YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. Contributed by Xuan Gong 
(cherry picked from commit e8fc81f9c812b0c167411de7f1789a9a433a0d57)
 2016-03-25 20:19:15 +00:00
Jason Lowe
8360d98d6a MAPREDUCE-6535. TaskID default constructor results in NPE on toString(). Contributed by Daniel Templeton 
(cherry picked from commit 3f622a143c5fb15fee7e5dded99e4a4136f19810)
 2016-03-25 20:07:56 +00:00
Akira Ajisaka
0dc1453626 MAPREDUCE-6543. Migrate MR client test cases part 2. Contributed by Dustin Cote. 
(cherry picked from commit 2c268cc9365851f5b02d967d13c8c0cbca850a86)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/TestMRJobClient.java
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/lib/partition/TestTotalOrderPartitioner.java
 2016-03-25 15:23:23 +09:00
Junping Du
c722262c75 YARN-4820. ResourceManager web redirects in HA mode drops query parameters. Contributed by Varun Vasudev. 
(cherry picked from commit 19b645c93801a53d4486f9a7639186525e51f723)
 2016-03-23 19:35:14 -07:00
Andrew Wang
daf24eeb6b HADOOP-12947. Update documentation Hadoop Groups Mapping to add static group mapping, negative cache. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 938222b2e20791d6eb410e36f8fec3e1520e1078)
 2016-03-23 14:57:18 -07:00
Andrew Wang
c658deabb6 HDFS-10200. Docs for WebHDFS still describe GETDELEGATIONTOKENS operation. Contributed by Wellington Chevreuil. 
(cherry picked from commit 8f85e5d2128c54c47d2a0098f6f4d4e04d53d74b)
 2016-03-23 12:55:23 -07:00
Chris Nauroth
57a0e6543c HDFS-10199. Unit tests TestCopyFiles, TestDistCh, TestLogalyzer under org.apache.hadoop.tools are failing. Contributed by Tibor Kiss. 2016-03-23 12:17:27 -07:00
Colin Patrick Mccabe
7ad3162df4 HDFS-10193. fuse_dfs segfaults if uid cannot be resolved to a username (John Thiltges via cmccabe) 
(cherry picked from commit 0d19a0ce98053572447bdadf88687ec55f2f1f46)
 2016-03-23 11:19:55 -07:00
Junping Du
76602161c0 YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. Contributed by Xuan Gong. 
(cherry picked from commit af1d125f9ce35ec69a610674a1c5c60cc17141a7)
 2016-03-23 08:58:05 -07:00
Akira Ajisaka
7a3fd1bc1a MAPREDUCE-6656. [NNBench] OP_DELETE operation isn't working after MAPREDUCE-6363. Contributed by J.Andreina. 
(cherry picked from commit 368c77376a3704e3fa395d72b1816d388b5cd782)
 2016-03-23 23:24:30 +09:00
Akira Ajisaka
c0c6dd9093 HADOOP-12952. BUILDING example of zero-docs dist should skip javadocs. Contributed by Steve Loughran. 
(cherry picked from commit a107cee14bb5446057da81d1c95d7fffd759e497)
 2016-03-23 14:16:11 +09:00
Akira Ajisaka
12c1cc889a MAPREDUCE-6580. Test failure: TestMRJobsWithProfiler. Contributed by Eric Badger. 
(cherry picked from commit 0bfe5a0167f0af65f1d7a8bc251a1c404ed41316)
 2016-03-23 13:19:08 +09:00
Colin Patrick Mccabe
a68a9eb2b1 HDFS-10189. PacketResponder#toString should include the downstreams for PacketResponderType.HAS_DOWNSTREAM_IN_PIPELINE (Joe Pallas via cmccabe) 
(cherry picked from commit a7d8f2b3960d27c74abb17ce2aa4bcd999706ad2)
 2016-03-22 17:21:54 -07:00
Li Lu
8bbb5efbfb MAPREDUCE-6110. JobHistoryServer CLI throws NullPointerException with job ids that do not exist. (Kai Sasaki via gtcarrera9) 
(cherry picked from commit 57ead18a85e15aef1993f49157cf05aed38f1c87)
 2016-03-22 14:29:12 -07:00
Benoy Antony
4dd02f9484 HADOOP-12929. JWTRedirectAuthenticationHandler must accommodate null expiration time. Contributed by Larry McCay. 
(cherry picked from commit e7ed05e4f5b0421e93f2f2cadc5beda3d28b9911)
 2016-03-21 13:21:54 -07:00
Colin Patrick Mccabe
2ce24bf218 HDFS-9951. Use string constants for XML tags in OfflineImageReconstructor (Lin Yiqun via cmccabe) 
(cherry picked from commit 680716f31e120f4d3ee70b095e4db46c05b891d9)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/offlineImageViewer/OfflineImageReconstructor.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/offlineImageViewer/PBImageXmlWriter.java
 2016-03-21 11:46:09 -07:00
Andrew Wang
e826d860a7 HDFS-9405. Warmup NameNode EDEK caches in background thread. Contributed by Xiao Chen. 
(cherry picked from commit e3bb38d62567eafe57d16b78deeba1b71c58e41c)
 2016-03-21 11:39:19 -07:00
Sangjin Lee
d956e0a0bb HDFS-9579. Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level (Ming Ma via sjlee) 2016-03-21 10:56:32 -07:00
Haohui Mai
478a25b929 HADOOP-12819. Migrate TestSaslRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng. 2016-03-20 17:41:20 -07:00
Haohui Mai
6236782151 HDFS-7166. SbNN Web UI shows #Under replicated blocks and #pending deletion blocks. Contributed by Wei-Chiu Chuang. 2016-03-20 17:21:53 -07:00
Karthik Kambatla
95b59c17a7 YARN-4732. *ProcessTree classes have too many whitespace issues 
(cherry picked from commit 7fae4c68e6d599d0c01bb2cb2c8d5e52925b3e1e)
 2016-03-20 10:47:56 -07:00
Chris Nauroth
283e44f978 HADOOP-12926. lz4.c does not detect 64-bit mode properly. Contributed by Alan Burlison. 
(cherry picked from commit 33239c99257dac08f7644be3701770daa75044cd)
 2016-03-18 16:33:28 -07:00
Eric Payne
dd1e4107e5 YARN-4686. MiniYARNCluster.start() returns before cluster is completely started. Contributed by Eric Badger. 
(cherry picked from commit 92b7e0d41302b6b110927f99de5c2b4a4a93c5fd)
 2016-03-18 17:05:53 +00:00
Akira Ajisaka
41621a994d HDFS-3677. dfs.namenode.edits.dir.required is missing from hdfs-default.xml. Contributed by Mark Yang. 
(cherry picked from commit 414f33126ac178a44146666cc7c00059cfc9cabf)
 2016-03-19 01:10:44 +09:00
Kihwal Lee
ead63bc297 HDFS-9874. Long living DataXceiver threads cause volume shutdown to block. Contributed by Rushabh Shah. 
(cherry picked from commit 63c966a3fbeb675959fc4101e65de9f57aecd17d)
 2016-03-18 10:26:57 -05:00
Colin Patrick Mccabe
f69a6c3632 HDFS-9949. Add a test case to ensure that the DataNode does not regenerate its UUID when a storage directory is cleared (Harsh J via cmccabe) 
(cherry picked from commit dc951e606f40bb779632a8a3e3a46aeccc4a446a)
 2016-03-17 10:42:37 -07:00
Junping Du
66257613b4 YARN-4785. inconsistent value type of the type field for LeafQueueInfo in response of RM REST API. 
(cherry picked from commit ca8106d2dd03458944303d93679daa03b1d82ad5)
 2016-03-17 09:25:36 -07:00
Karthik Kambatla
bbe9bb078c YARN-4812. TestFairScheduler#testContinuousScheduling fails intermittently. (kasha) 
(cherry picked from commit f84af8bd588763c4e99305742d8c86ed596e8359)
 2016-03-17 05:54:40 -07:00
Akira Ajisaka
365d236175 MAPREDUCE-6645. TestWordStats outputs logs under directories other than target/test-dir. Contributed by Gabor Liptak. 
(cherry picked from commit 80fa70c4e15f16b411cb3691df546499c6a19d4c)
 2016-03-17 18:09:20 +09:00
Andrew Wang
d4370f224b HDFS-10173. Typo in DataXceiverServer. Contributed by Michael Han. 
(cherry picked from commit 02a250db9f4bc54436cd9900a084215e5e3c8dae)
 2016-03-16 18:50:00 -07:00
Wangda Tan
484976fa2b YARN-4108. CapacityScheduler: Improve preemption to only kill containers that would satisfy the incoming request. (Wangda Tan) 
(cherry picked from commit 7e8c9beb4156dcaeb3a11e60aaa06d2370626913)
(cherry picked from commit ae14e5d07f1b6702a5160637438028bb03d9387e)
 2016-03-16 17:03:35 -07:00
Steve Loughran
186a7c6bb3 YARN-4593 Deadlock in AbstractService.getConfig() (stevel) 2016-03-16 14:35:13 +00:00
Steve Loughran
1463400aad HADOOP-12888 Shell to disable bash and setsid support when running under JVM security manager (Costin Leau via stevel) 2016-03-16 14:31:50 +00:00
Karthik Kambatla
ab03266831 YARN-4560. Make scheduler error checking message more user friendly. (Ray Chiang via kasha) 
(cherry picked from commit 3ef5500783f043ff206458d8c10ed3d5405a8b0c)
 2016-03-15 23:47:19 -07:00
Xuan
398dbde538 Revert "YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. (Xuan Gong via gtcarrera9)" 
This reverts commit 3a0b69544183f71c4683bc477656473494fc09d0.

(cherry picked from commit a888b5bc533bb91a3394f15a69879be1d7838592)
 2016-03-15 22:11:16 -07:00
Wangda Tan
abfb2957d1 MAPREDUCE-6579. JobStatus#getFailureInfo should not output diagnostic information when the job is running. (Akira AJISAKA via wangda) 
(cherry picked from commit 6529c87551e07e9da1e1b273eff4c6bad6b3e838)
 2016-03-15 17:30:37 -07:00
Li Lu
94649b9cc0 YARN-4817. Change Log Level to DEBUG for putDomain call in ATS 1.5. (Xuan Gong via gtcarrera9) 
(cherry-picked from commit 5176a69868484f864c977a6cd13923167082407c)
 2016-03-15 11:48:37 -07:00
Li Lu
14a4110b75 YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. (Xuan Gong via gtcarrera9) 
(cherry picked from commit 3a0b69544183f71c4683bc477656473494fc09d0)
 2016-03-15 11:42:30 -07:00
Robert Kanter
da24fde333 TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IllegalArgumentException from cleanup (templedf via rkanter) 
(cherry picked from commit 22ca176dfe125a4f7bf38cc63ab8106c40a7a7ba)
 2016-03-15 10:05:28 -07:00
Kihwal Lee
8b00d9de25 HDFS-9904. testCheckpointCancellationDuringUpload occasionally fails. Contributed by Lin Yiqun. 
(cherry picked from commit d4574017845cfa7521e703f80efd404afd09b8c4)
 2016-03-15 10:54:37 -05:00
Masatake Iwasaki
d595429538 HDFS-9928. Make HDFS commands guide up to date (Wei-Chiu Chuang via iwasakims) 2016-03-15 21:04:14 +09:00
Siddharth Seth
edd9abf302 YARN-4816. Fix incompatible change in SystemClock. 
(cherry picked from commit eba66a64d28b50a660d6f537c767677f5fa0f7ea)
 2016-03-14 20:15:41 -07:00
Tsz-Wo Nicholas Sze
f85d979a3f HADOOP-12923. Move the test code in ipc.Client to test. 2016-03-14 15:49:34 -07:00
Colin Patrick Mccabe
8ac3fc7540 HDFS-9947. Block#toString should not output information from derived classes (cmccabe) 
(cherry picked from commit 9a43094e12ab8d35d49ceda2e2c5f83093bb3a5b)
 2016-03-14 14:59:46 -07:00