Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,189 Commits 326 Branches 371 Tags
Commit Graph

11189 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Colin Patrick Mccabe
7ad3162df4 HDFS-10193. fuse_dfs segfaults if uid cannot be resolved to a username (John Thiltges via cmccabe) 
(cherry picked from commit 0d19a0ce98053572447bdadf88687ec55f2f1f46)
 2016-03-23 11:19:55 -07:00
Junping Du
76602161c0 YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. Contributed by Xuan Gong. 
(cherry picked from commit af1d125f9ce35ec69a610674a1c5c60cc17141a7)
 2016-03-23 08:58:05 -07:00
Akira Ajisaka
7a3fd1bc1a MAPREDUCE-6656. [NNBench] OP_DELETE operation isn't working after MAPREDUCE-6363. Contributed by J.Andreina. 
(cherry picked from commit 368c77376a3704e3fa395d72b1816d388b5cd782)
 2016-03-23 23:24:30 +09:00
Akira Ajisaka
c0c6dd9093 HADOOP-12952. BUILDING example of zero-docs dist should skip javadocs. Contributed by Steve Loughran. 
(cherry picked from commit a107cee14bb5446057da81d1c95d7fffd759e497)
 2016-03-23 14:16:11 +09:00
Akira Ajisaka
12c1cc889a MAPREDUCE-6580. Test failure: TestMRJobsWithProfiler. Contributed by Eric Badger. 
(cherry picked from commit 0bfe5a0167f0af65f1d7a8bc251a1c404ed41316)
 2016-03-23 13:19:08 +09:00
Colin Patrick Mccabe
a68a9eb2b1 HDFS-10189. PacketResponder#toString should include the downstreams for PacketResponderType.HAS_DOWNSTREAM_IN_PIPELINE (Joe Pallas via cmccabe) 
(cherry picked from commit a7d8f2b3960d27c74abb17ce2aa4bcd999706ad2)
 2016-03-22 17:21:54 -07:00
Li Lu
8bbb5efbfb MAPREDUCE-6110. JobHistoryServer CLI throws NullPointerException with job ids that do not exist. (Kai Sasaki via gtcarrera9) 
(cherry picked from commit 57ead18a85e15aef1993f49157cf05aed38f1c87)
 2016-03-22 14:29:12 -07:00
Benoy Antony
4dd02f9484 HADOOP-12929. JWTRedirectAuthenticationHandler must accommodate null expiration time. Contributed by Larry McCay. 
(cherry picked from commit e7ed05e4f5b0421e93f2f2cadc5beda3d28b9911)
 2016-03-21 13:21:54 -07:00
Colin Patrick Mccabe
2ce24bf218 HDFS-9951. Use string constants for XML tags in OfflineImageReconstructor (Lin Yiqun via cmccabe) 
(cherry picked from commit 680716f31e120f4d3ee70b095e4db46c05b891d9)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/offlineImageViewer/OfflineImageReconstructor.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/offlineImageViewer/PBImageXmlWriter.java
 2016-03-21 11:46:09 -07:00
Andrew Wang
e826d860a7 HDFS-9405. Warmup NameNode EDEK caches in background thread. Contributed by Xiao Chen. 
(cherry picked from commit e3bb38d62567eafe57d16b78deeba1b71c58e41c)
 2016-03-21 11:39:19 -07:00
Sangjin Lee
d956e0a0bb HDFS-9579. Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level (Ming Ma via sjlee) 2016-03-21 10:56:32 -07:00
Haohui Mai
478a25b929 HADOOP-12819. Migrate TestSaslRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng. 2016-03-20 17:41:20 -07:00
Haohui Mai
6236782151 HDFS-7166. SbNN Web UI shows #Under replicated blocks and #pending deletion blocks. Contributed by Wei-Chiu Chuang. 2016-03-20 17:21:53 -07:00
Karthik Kambatla
95b59c17a7 YARN-4732. *ProcessTree classes have too many whitespace issues 
(cherry picked from commit 7fae4c68e6d599d0c01bb2cb2c8d5e52925b3e1e)
 2016-03-20 10:47:56 -07:00
Chris Nauroth
283e44f978 HADOOP-12926. lz4.c does not detect 64-bit mode properly. Contributed by Alan Burlison. 
(cherry picked from commit 33239c99257dac08f7644be3701770daa75044cd)
 2016-03-18 16:33:28 -07:00
Eric Payne
dd1e4107e5 YARN-4686. MiniYARNCluster.start() returns before cluster is completely started. Contributed by Eric Badger. 
(cherry picked from commit 92b7e0d41302b6b110927f99de5c2b4a4a93c5fd)
 2016-03-18 17:05:53 +00:00
Akira Ajisaka
41621a994d HDFS-3677. dfs.namenode.edits.dir.required is missing from hdfs-default.xml. Contributed by Mark Yang. 
(cherry picked from commit 414f33126ac178a44146666cc7c00059cfc9cabf)
 2016-03-19 01:10:44 +09:00
Kihwal Lee
ead63bc297 HDFS-9874. Long living DataXceiver threads cause volume shutdown to block. Contributed by Rushabh Shah. 
(cherry picked from commit 63c966a3fbeb675959fc4101e65de9f57aecd17d)
 2016-03-18 10:26:57 -05:00
Colin Patrick Mccabe
f69a6c3632 HDFS-9949. Add a test case to ensure that the DataNode does not regenerate its UUID when a storage directory is cleared (Harsh J via cmccabe) 
(cherry picked from commit dc951e606f40bb779632a8a3e3a46aeccc4a446a)
 2016-03-17 10:42:37 -07:00
Junping Du
66257613b4 YARN-4785. inconsistent value type of the type field for LeafQueueInfo in response of RM REST API. 
(cherry picked from commit ca8106d2dd03458944303d93679daa03b1d82ad5)
 2016-03-17 09:25:36 -07:00
Karthik Kambatla
bbe9bb078c YARN-4812. TestFairScheduler#testContinuousScheduling fails intermittently. (kasha) 
(cherry picked from commit f84af8bd588763c4e99305742d8c86ed596e8359)
 2016-03-17 05:54:40 -07:00
Akira Ajisaka
365d236175 MAPREDUCE-6645. TestWordStats outputs logs under directories other than target/test-dir. Contributed by Gabor Liptak. 
(cherry picked from commit 80fa70c4e15f16b411cb3691df546499c6a19d4c)
 2016-03-17 18:09:20 +09:00
Andrew Wang
d4370f224b HDFS-10173. Typo in DataXceiverServer. Contributed by Michael Han. 
(cherry picked from commit 02a250db9f4bc54436cd9900a084215e5e3c8dae)
 2016-03-16 18:50:00 -07:00
Wangda Tan
484976fa2b YARN-4108. CapacityScheduler: Improve preemption to only kill containers that would satisfy the incoming request. (Wangda Tan) 
(cherry picked from commit 7e8c9beb4156dcaeb3a11e60aaa06d2370626913)
(cherry picked from commit ae14e5d07f1b6702a5160637438028bb03d9387e)
 2016-03-16 17:03:35 -07:00
Steve Loughran
186a7c6bb3 YARN-4593 Deadlock in AbstractService.getConfig() (stevel) 2016-03-16 14:35:13 +00:00
Steve Loughran
1463400aad HADOOP-12888 Shell to disable bash and setsid support when running under JVM security manager (Costin Leau via stevel) 2016-03-16 14:31:50 +00:00
Karthik Kambatla
ab03266831 YARN-4560. Make scheduler error checking message more user friendly. (Ray Chiang via kasha) 
(cherry picked from commit 3ef5500783f043ff206458d8c10ed3d5405a8b0c)
 2016-03-15 23:47:19 -07:00
Xuan
398dbde538 Revert "YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. (Xuan Gong via gtcarrera9)" 
This reverts commit 3a0b69544183f71c4683bc477656473494fc09d0.

(cherry picked from commit a888b5bc533bb91a3394f15a69879be1d7838592)
 2016-03-15 22:11:16 -07:00
Wangda Tan
abfb2957d1 MAPREDUCE-6579. JobStatus#getFailureInfo should not output diagnostic information when the job is running. (Akira AJISAKA via wangda) 
(cherry picked from commit 6529c87551e07e9da1e1b273eff4c6bad6b3e838)
 2016-03-15 17:30:37 -07:00
Li Lu
94649b9cc0 YARN-4817. Change Log Level to DEBUG for putDomain call in ATS 1.5. (Xuan Gong via gtcarrera9) 
(cherry-picked from commit 5176a69868484f864c977a6cd13923167082407c)
 2016-03-15 11:48:37 -07:00
Li Lu
14a4110b75 YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. (Xuan Gong via gtcarrera9) 
(cherry picked from commit 3a0b69544183f71c4683bc477656473494fc09d0)
 2016-03-15 11:42:30 -07:00
Robert Kanter
da24fde333 TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IllegalArgumentException from cleanup (templedf via rkanter) 
(cherry picked from commit 22ca176dfe125a4f7bf38cc63ab8106c40a7a7ba)
 2016-03-15 10:05:28 -07:00
Kihwal Lee
8b00d9de25 HDFS-9904. testCheckpointCancellationDuringUpload occasionally fails. Contributed by Lin Yiqun. 
(cherry picked from commit d4574017845cfa7521e703f80efd404afd09b8c4)
 2016-03-15 10:54:37 -05:00
Masatake Iwasaki
d595429538 HDFS-9928. Make HDFS commands guide up to date (Wei-Chiu Chuang via iwasakims) 2016-03-15 21:04:14 +09:00
Siddharth Seth
edd9abf302 YARN-4816. Fix incompatible change in SystemClock. 
(cherry picked from commit eba66a64d28b50a660d6f537c767677f5fa0f7ea)
 2016-03-14 20:15:41 -07:00
Tsz-Wo Nicholas Sze
f85d979a3f HADOOP-12923. Move the test code in ipc.Client to test. 2016-03-14 15:49:34 -07:00
Colin Patrick Mccabe
8ac3fc7540 HDFS-9947. Block#toString should not output information from derived classes (cmccabe) 
(cherry picked from commit 9a43094e12ab8d35d49ceda2e2c5f83093bb3a5b)
 2016-03-14 14:59:46 -07:00
Ravi Prakash
51b7d8935a HDFS-9953. Download File from UI broken after pagination. Contributed by Brahma Reddy Battula 2016-03-14 14:32:42 -07:00
Karthik Kambatla
b4c8693096 YARN-4719. Add a helper library to maintain node state and allows common queries. (kasha) 
(cherry picked from commit 20d389ce61eaacb5ddfb329015f50e96ad894f8d)
 2016-03-14 14:22:21 -07:00
Chris Nauroth
dd462bc32f HDFS-9941. Do not log StandbyException on NN, other minor logging fixes. Contributed by Arpit Agarwal. 
(cherry picked from commit 5644137adad30c84e40d2c4719627b3aabc73628)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockUnderConstructionFeature.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirWriteFileOp.java
 2016-03-14 09:55:27 -07:00
Junping Du
3d5ac829da YARN-4545. Allow YARN distributed shell to use ATS v1.5 APIs. Li Lu via junping_du 
(cherry picked from commit f291d82cd49c04a81380bc45c97c279d791b571c)
 2016-03-14 08:30:07 -07:00
Colin Patrick Mccabe
b67b5b09a7 HDFS-9942. Add an HTrace span when refreshing the groups for a username (cmccabe) 
(cherry picked from commit 6e9a582eb1ab040f532fbe95694f5272cda34188)
 2016-03-11 12:27:12 -08:00
Steve Loughran
1c96fd0a23 Revert "HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims)" 
This reverts commit 7994ab3fa01699ebea3edb3d0b28946e90825ba2.
 2016-03-11 16:59:42 +00:00
Akira Ajisaka
c2e14d1bbb MAPREDUCE-6520. Migrate MR Client test cases part 1. Contributed by Dustin Cote. 
(cherry picked from commit 247a7906092065289ea81139e71badcac6abef1e)
 2016-03-11 22:54:40 +09:00
Akira Ajisaka
99f61afcdd Revert "MAPREDUCE-6520. Migrate MR Client test cases part 1." 
This reverts commit 7d665f0a987c17dcf8a26113c61a70dee196ee3d.
 2016-03-11 22:52:10 +09:00
Akira Ajisaka
7d665f0a98 MAPREDUCE-6520. Migrate MR Client test cases part 1. 
(cherry picked from commit ef68b441957c6deb65adae2272d60ac929d00733)
 2016-03-11 22:25:29 +09:00
Masatake Iwasaki
7994ab3fa0 HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims) 
(cherry picked from commit 682adc6ba9db3bed94fd4ea3d83761db6abfe695)
 2016-03-11 15:05:34 +09:00
Arpit Agarwal
b0ea50bb29 HDFS-1477. Support reconfiguring dfs.heartbeat.interval and dfs.namenode.heartbeat.recheck-interval without NN restart. (Contributed by Xiaobing Zhou) 2016-03-10 19:05:22 -08:00
Colin Patrick Mccabe
710811652c HDFS-9933. ReverseXML should be capitalized in oiv usage message (cmccabe) 
(cherry picked from commit 79961ecea888e0ee85b7a75e239bb6bb3335eb17)
 2016-03-10 13:45:02 -08:00
Colin Patrick Mccabe
c82d1e1187 HDFS-9934. ReverseXML oiv processor should bail out if the XML file's layoutVersion doesn't match oiv's (cmccabe) 
(cherry picked from commit bd49354c6d6387620b0de2219eab1714ec2d64f8)
 2016-03-10 13:41:32 -08:00