Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,414 Commits 326 Branches 371 Tags
Commit Graph

8414 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
yliu
fee29e4a4f HDFS-7656. Expose truncate API for HDFS httpfs. (yliu) 2015-02-19 08:38:25 +08:00
yliu
000b9e6c24 HADOOP-11595. Add default implementation for AbstractFileSystem#truncate. (yliu) 2015-02-19 08:28:15 +08:00
Plamen Jeliazkov
32d215dc89 MAPREDUCE-6228. Add truncate operation to SLive. Contributed by Plamen Jeliazkov. 2015-02-19 00:14:11 -08:00
Akira Ajisaka
10da1bfce2 HADOOP-11440. Use "test.build.data" instead of "build.test.dir" for testing in ClientBaseWithFixes. Contributed by Kengo Seki. 
(cherry picked from commit 18fb421fab73789a9b692f21a99d619b5dc5c9ff)
 2015-02-18 17:56:02 -08:00
Tsuyoshi Ozawa
fef5efa0cb YARN-1615. Fix typos in delay scheduler's description. Contributed by Akira Ajisaka. 
(cherry picked from commit b8a14efdf535d42bcafa58d380bd2c7f4d36f8cb)
 2015-02-19 10:24:40 +09:00
Jian He
b8fe1a747e YARN-1514. Utility to benchmark ZKRMStateStore#loadState for RM HA. Contributed by Tsuyoshi OZAWA 
(cherry picked from commit 1c03376300a46722d4147f5b8f37242f68dba0a2)
 2015-02-18 16:34:42 -08:00
Haohui Mai
3605928bd0 HDFS-7808. Remove obsolete -ns options in in DFSHAAdmin.java. Contributed by Arshad Mohammad. 2015-02-18 15:14:53 -08:00
cnauroth
b1b1e05e18 HDFS-7772. Document hdfs balancer -exclude/-include option in HDFSCommands.html. Contributed by Xiaoyu Yao. 2015-02-18 12:03:00 -08:00
Jian He
8f06eaa251 YARN-3132. RMNodeLabelsManager should remove node from node-to-label mapping when node becomes deactivated. Contributed by Wangda Tan 
(cherry picked from commit f5da5566d9c392a5df71a2dce4c2d0d50eea51ee)
 2015-02-18 11:52:28 -08:00
Jason Lowe
386e62ace3 MAPREDUCE-6261. NullPointerException if MapOutputBuffer.flush invoked twice. Contributed by Tsuyoshi OZAWA 
(cherry picked from commit 4981d082d4f3c82d1c2c900c7488b83bf20301cc)
 2015-02-18 19:28:45 +00:00
Akira Ajisaka
5a1531fff6 HADOOP-11545. ArrayIndexOutOfBoundsException is thrown with "hadoop credential list -provider". Contributed by Brahma Reddy Battula. 
(cherry picked from commit 17146099197000d85b3aedc84a672111f2c7908a)
 2015-02-18 11:18:21 -08:00
Tsuyoshi Ozawa
f10335b08d HADOOP-11599. Client#getTimeout should use IPC_CLIENT_PING_DEFAULT when IPC_CLIENT_PING_KEY is not configured. Contributed by zhihai xu. 
(cherry picked from commit 3f56a4cb0c57583e285e85a4d0c1584c4de9f1f1)
 2015-02-18 18:00:18 +09:00
Kihwal Lee
6c01e58619 HADOOP-11295. RPC Server Reader thread can't shutdown if RPCCallQueue is full. Contributed by Ming Ma. 
(cherry picked from commit 685af8a3d0504724fe588daf3722519fedc45b01)
 2015-02-18 17:44:11 +09:00
Tsuyoshi Ozawa
9523b52da5 MAPREDUCE-4286. TestClientProtocolProviderImpls passes on failure conditions. Contributed by Devaraj K. 
(cherry picked from commit 7c782047c609b29178945bd566a0d162e64dbfdb)
 2015-02-18 15:46:06 +09:00
Xuan
ba18adbb27 YARN-3207. Secondary filter matches entites which do not have the key 
being filtered for. Contributed by Zhijie Shen

(cherry picked from commit 57db50cbe3ce42618ad6d6869ae337d15b261f4e)
 2015-02-17 18:18:56 -08:00
Akira Ajisaka
6d6c684567 HDFS-7780. Update use of Iterator to Iterable in DataXceiverServer and SnapshotDiffInfo. Contributed by Ray Chiang. 
(cherry picked from commit 6dc8812a95bf369ec1f2e3d8a9473033172736cd)
 2015-02-17 14:49:03 -08:00
Haohui Mai
f92a4904bf HDFS-6662. WebHDFS cannot open a file if its path contains "%". Contributed by Gerson Carlos. 2015-02-17 13:05:00 -08:00
Steve Loughran
411c8a7cda HADOOP-11521. Make connection timeout configurable in s3a. (Thomas Demoor via stevel) 2015-02-17 20:00:00 +00:00
Kihwal Lee
8b37b4a78b HDFS-7795. Show warning if not all favored nodes were chosen by namenode. Contributed by Kihwal Lee. 
(cherry picked from commit db6606223ca2e17aa7e1b2e2be13c1a19d8e7465)
 2015-02-17 13:06:41 -06:00
Steve Loughran
f52fcdc2e0 HADOOP-11522. Update S3A Documentation. (Thomas Demoor via stevel) 2015-02-17 18:14:31 +00:00
Steve Loughran
701b96ca8e HADOOP-11570. S3AInputStream.close() downloads the remaining bytes of the object from S3. (Dan Hecht via stevel). 2015-02-17 16:36:32 +00:00
Uma Maheswara Rao G
2cbac36fd3 HDFS-4266. BKJM: Separate write and ack quorum (Rakesh R via umamahesh) 
(cherry picked from commit f0412de1c1d42b3c2a92531f81d97a24df920523)
 2015-02-17 21:31:43 +05:30
Uma Maheswara Rao G
35fecb5306 HDFS-7797. Add audit log for setQuota operation (Rakesh R via umamahesh) 
(cherry picked from commit f24a56787a15e89a7c1e777b8043ab9ae8792505)
 2015-02-17 20:16:34 +05:30
Tsuyoshi Ozawa
00fb0710b6 HADOOP-11600. Fix up source codes to be compiled with Guava 17.0. (ozawa) 
(cherry picked from commit 2f0f756b26ea83e142a5b9379fa75862c2fc6ad5)
 2015-02-17 21:57:58 +09:00
Vinayakumar B
005e1df540 HADOOP-11000. HAServiceProtocol's health state is incorrectly transitioned to SERVICE_NOT_RESPONDING (Contributed by Ming Ma) 
(cherry picked from commit cf4b7f506dd338ecf2ed4c643b6a6a334e070fca)
 2015-02-17 15:19:44 +05:30
Vinayakumar B
91a5d92916 HDFS-7703. Support favouredNodes for the append for new blocks ( Contributed by Vinayakumar B) 
(cherry picked from commit 89a544928083501625bc69f96b530040228f0a5f)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-02-17 15:19:03 +05:30
yliu
54e33baaf6 HDFS-7798. Checkpointing failure caused by shared KerberosAuthenticator. (Chengbing Liu via yliu) 2015-02-17 07:50:14 +08:00
cnauroth
441dfa4867 HDFS-7604. Track and display failed DataNode storage locations in NameNode. Contributed by Chris Nauroth. 
(cherry picked from commit 9729b244de50322c2cc889c97c2ffb2b4675cf77)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/HeartbeatManager.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestDeadDatanode.java
 2015-02-16 14:44:49 -08:00
Junping Du
1d91daaae9 MAPREDUCE-6225. Fix new findbug warnings in hadoop-mapreduce-client-core. Contributed by Varun Saxena 
(cherry picked from commit 814afa46efef201cb782072432fc744e1cb9c463)
 2015-02-16 09:39:20 -08:00
Tsuyoshi Ozawa
fabac2ff30 YARN-1299. Improve a log message in AppSchedulingInfo by adding application id. Contributed by Ashutosh Jindal and Devaraj K. 
(cherry picked from commit 556386a07084b70a5d2ae0c2bd4445a348306db8)
 2015-02-17 01:54:09 +09:00
Tsuyoshi Ozawa
42368b91c4 Revert "YARN-1299. Improve a log message in AppSchedulingInfo by adding application id. Contributed by Ashutosh Jindal and devaraj." 
This reverts commit 67e3a77720cfcb0fc540e8e0c80a5d42b8140fcc.
 2015-02-17 01:53:58 +09:00
Tsuyoshi Ozawa
67e3a77720 YARN-1299. Improve a log message in AppSchedulingInfo by adding application id. Contributed by Ashutosh Jindal and devaraj. 
(cherry picked from commit 9aae81c93421874b726c7b6ff970895c429e502d)
 2015-02-17 01:48:53 +09:00
Tsuyoshi Ozawa
fd8f7e2c7d YARN-3203. Correct a log message in AuxServices. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 447bd7b5a61a5788dc2a5d29cedfc19f0e99c0f5)
 2015-02-16 23:56:32 +09:00
Junping Du
eee89bd18c YARN-2749. Fix some testcases from TestLogAggregationService fails in trunk. (Contributed by Xuan Gong) 
(cherry picked from commit ab0b958a522d502426b91b6e4ab6dd29caccc372)
 2015-02-15 06:48:29 -08:00
Tsuyoshi Ozawa
7011125778 MAPREDUCE-6256. Removed unused private methods in o.a.h.mapreduce.Job.java. Contributed by Naganarasimha G R. 
(cherry picked from commit 3338f6d90795dafd445891cbd2f4d46b53012382)
 2015-02-15 10:10:11 +09:00
Tsuyoshi Ozawa
b7836c18e4 HADOOP-11589. NetUtils.createSocketAddr should trim the input URI. Contributed by Rakesh R. 
(cherry picked from commit ef950ea1c08f5a95137a95df6d4c90241a25b70e)
 2015-02-15 00:31:33 +09:00
Tsuyoshi Ozawa
481124bd61 Revert "HADOOP-11589. NetUtils.createSocketAddr should trim the input URI. Contributed by Rakesh R." 
This reverts commit e082992e2a238543bf3caf22df133869df108409.
 2015-02-15 00:31:15 +09:00
Tsuyoshi Ozawa
e082992e2a HADOOP-11589. NetUtils.createSocketAddr should trim the input URI. Contributed by Rakesh R. 
(cherry picked from commit 965ce9e24ed051c6705defc0f85dcfaa4fc9a3ef)
 2015-02-15 00:13:38 +09:00
cnauroth
48302e687a YARN-2899. Run TestDockerContainerExecutorWithMocks on Linux only. Contributed by Ming Ma. 
(cherry picked from commit 6804d689019e4d2dfb2b35fd82f775a13e85960c)
 2015-02-13 21:59:14 -08:00
Arpit Agarwal
c6aa6cbfe5 HDFS-7775. Use consistent naming for NN-internal quota related types and functions. (Contributed bu Xiaoyu Yao) 2015-02-13 21:01:54 -08:00
cnauroth
751b834ad1 HDFS-7778. Rename FsVolumeListTest to TestFsVolumeList and commit it to branch-2. Contributed by Lei (Eddy) Xu. 
(cherry picked from commit 2efb2347a969ecff75934cd10f2432eade1d77dc)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/TestFsVolumeList.java
 2015-02-13 16:30:53 -08:00
Akira Ajisaka
3ad1d8d533 HDFS-4265. BKJM doesn't take advantage of speculative reads. Contributed by Rakesh R. 
(cherry picked from commit 0d521e33262193e6cf709deaa69a54811a97ef6a)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-02-13 15:25:13 -08:00
Colin Patrick Mccabe
7b9c978df2 HDFS-7686. Re-add rapid rescan of possibly corrupt block feature to the block scanner (cmccabe) 
(cherry picked from commit 8bb9a5000ed06856abbad268c43ce1d5ad5bdd43)
 2015-02-13 15:19:04 -08:00
Colin Patrick Mccabe
6edcb9a503 HDFS-7721. The HDFS BlockScanner may run fast during the first hour (cmccabe) 
(cherry picked from commit 115428176e1d919fe7d54d01b34dfda57d1b3950)
 2015-02-13 15:18:10 -08:00
Colin Patrick Mccabe
a54b4a7fc6 HDFS-7430 backport addendum. Add missing change. (cmccabe) 2015-02-13 15:11:14 -08:00
Colin Patrick Mccabe
a8c6a96f3b HDFS-7430. Refactor the BlockScanner to use O(1) memory and use multiple threads (cmccabe) 
(cherry picked from commit 6e62a1a6728b1f782f64065424f92b292c3f163a)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/FsDatasetSpi.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/FsVolumeSpi.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsVolumeListTest.java
 2015-02-13 15:04:06 -08:00
Robert Kanter
ebf6499498 HADOOP-11467. KerberosAuthenticator can connect to a non-secure cluster. (yzhangal via rkanter) 
(cherry picked from commit 875256834b892b574499d5fe68f95a9aed244f7d)

Conflicts:
	hadoop-common-project/hadoop-auth/src/test/java/org/apache/hadoop/security/authentication/server/TestAuthenticationToken.java
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-02-13 14:12:38 -08:00
Jason Lowe
c9cd58d711 YARN-2847. Linux native container executor segfaults if default banned user detected. Contributed by Olaf Flebbe 
(cherry picked from commit 1a0f508b6386b1c26ec606f6d73afddaa191b7d8)
 2015-02-13 20:22:12 +00:00
Arpit Agarwal
f507791554 HDFS-7776. Adding additional unit tests for Quota By Storage Type. (Contributed by Xiaoyu Yao) 2015-02-13 12:02:54 -08:00
Tsuyoshi Ozawa
7386323735 MAPREDUCE-6255. Fix JobCounter's format to use grouping separator. Contributed by Ryu Kobayashi. 
(cherry picked from commit ba3c80a5ca8fefae9d0e67232f9973e1a0458f58)
 2015-02-13 16:11:16 +09:00