Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,838 Commits 326 Branches 371 Tags
Commit Graph

11838 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Lei Xu
9cb6d291ea HDFS-10457. DataNode should not auto-format block pool directory if VERSION is missing. (Wei-Chiu Chuang via lei) 
(cherry picked from commit bb3bcb9397593fc8a2fa63a48eba126609f72c42)
 2016-08-08 16:19:58 -07:00
Wei-Chiu Chuang
cc20316b55 HADOOP-13395. Enhance TestKMSAudit. Contributed by Xiao Chen. 
(cherry picked from commit 070548943a16370a74277d1b1d10b713e2ca81d0)

Conflicts:
hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMSAudit.java
 2016-08-08 15:16:14 -07:00
Lei Xu
2cd4092c81 HADOOP-13380. TestBasicDiskValidator should not write data to /tmp (Yufei Gu via lei) 
(cherry picked from commit 6418edd6feeafc0204536e1860942eeb1cb1a9ce)
 2016-08-08 15:06:45 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
31bb302c91 YARN-5470. Addedum to differentiate exactly matching of log-files with regex in yarn log CLI. Contributed by Xuan Gong. 
(cherry picked from commit 83a2ffec408fc3ebb89ab13ab4788d9f02fae33b)
 2016-08-08 14:29:24 -07:00
Arpit Agarwal
2dbe16c024 HADOOP-13457. Remove hardcoded absolute path for shell executable. (Chen Liang) 2016-08-08 12:36:30 -07:00
Chris Nauroth
287688d6ca HADOOP-13403. AzureNativeFileSystem rename/delete performance improvements. Contributed by Subramanyam Pattipaka. 
(cherry picked from commit 2ed58c40e5dcbf5c5303c00e85096085b1055f85)
 2016-08-08 12:28:46 -07:00
Jitendra Pandey
e9955b1806 HADOOP-10823. TestReloadingX509TrustManager is flaky. Contributed by Mingliang Liu. 2016-08-08 11:02:07 -07:00
Varun Saxena
ce8df272f4 YARN-4910. Fix incomplete log info in ResourceLocalizationService (Jun Gong via Varun Saxena) 2016-08-08 22:14:56 +05:30
Varun Saxena
8b09292f4f MAPREDUCE-6748. Enhance logging for Cluster.java around InetSocketAddress (Vrushali C via Varun Saxena) 2016-08-08 21:53:29 +05:30
Konstantin V Shvachko
ab130f97ca HDFS-10693. metaSave should print blocks, not LightWeightHashSet. Contributed by Yuanbo Liu. 
(cherry picked from commit 4d3af47f2765f6f57936d316ef2a4150b787cc97)
 2016-08-07 14:35:35 -07:00
Masatake Iwasaki
9cdd97a15e HADOOP-13418. Fix javadoc warnings by JDK8 in hadoop-nfs package. Contributed by Kai Sasaki. 
(cherry picked from commit 10ed06a0c96cbb8b70e03deeb5bb94df700f9518)
 2016-08-06 12:25:05 +09:00
Naganarasimha
991823482f YARN-4624. NPE in PartitionQueueCapacitiesInfo while accessing Schduler UI. Contributed by Brahma Reddy Battula 
(cherry picked from commit d81b8163b4e5c0466a6af6e1068f512c5fd24a61)
 2016-08-06 07:04:30 +05:30
Wei-Chiu Chuang
d875dfef3d HADOOP-13353. LdapGroupsMapping getPassward shouldn't return null when IOException throws. Contributed by Zhaohao Liang and Wei-Chiu Chuang. 
(cherry picked from commit 49ba09a9221ad1e25e89800f6c455bbaad41483b)
 2016-08-05 16:35:28 -07:00
Varun Saxena
0e48f29937 YARN-5429. Fix return related javadoc warnings in yarn-api (Vrushali C via Varun Saxena) 2016-08-06 01:13:30 +05:30
Junping Du
adcecd417b YARN-5470. Differentiate exactly match with regex in yarn log CLI. Contributed by Xuan Gong. 
(cherry picked from commit e605d47df05619c6b1c18aca59f709899498da75)
 2016-08-05 11:00:13 -07:00
Wangda Tan
a73e118437 YARN-4888. Changes in scheduler to identify resource-requests explicitly by allocation-id. (Subru Krishnan via wangda) 
(cherry picked from commit 3f100d76ff5df020dbb8ecd4f5b4f9736a0a8270)
 2016-08-05 10:44:07 -07:00
Rohith Sharma K S
69da77c357 YARN-5333. Some recovered apps are put into default queue when RM HA. Contributed by Jun Gong. 
(cherry picked from commit d9a354c2f39274b2810144d1ae133201e44e3bfc)
 2016-08-05 21:37:05 +05:30
Akira Ajisaka
6863866127 HDFS-10715. NPE when applying AvailableSpaceBlockPlacementPolicy. Contributed by Guangbin Zhu. 
(cherry picked from commit ef432579a7763cc0e482fe049027c6e5325eb034)
 2016-08-05 17:32:23 +09:00
Kihwal Lee
09b06a6e9e HDFS-10673. Optimize FSPermissionChecker's internal path usage. Contributed by Daryn Sharp. 
(cherry picked from commit 438a9f047eb6af2a4b916a4f6ef6f68adeab8068)
 2016-08-04 16:17:41 -05:00
Kihwal Lee
690ec789f0 HDFS-10343. BlockManager#createLocatedBlocks may return blocks on failed storages. Contributed by Kuhu Shukla. 
(cherry picked from commit 57369a678c4c51627fe9a654e697a906a6bef123)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
 2016-08-04 15:12:21 -05:00
Arpit Agarwal
4f74b5e793 HADOOP-13466. Add an AutoCloseableLock class. (Chen Liang) 2016-08-04 12:32:23 -07:00
Kihwal Lee
6ead6f3bb8 HDFS-10717. Fix findbugs warnings of hadoop-hdfs-client in branch-2. Contributed by Akira Ajisaka. 2016-08-04 12:34:54 -05:00
Arpit Agarwal
365a27099c HADOOP-13467. Shell#getSignalKillCommand should use the bash builtin on Linux. (Arpit Agarwal) 2016-08-04 10:08:23 -07:00
Kihwal Lee
3b2554f3b0 HDFS-10722. Fix race condition in TestEditLog#testBatchedSyncWithClosedLogs. Contributed by Daryn Sharp. 
(cherry picked from commit 4a8e6dc02fb1d0dc89c3981b444575494511444a)
 2016-08-04 11:55:52 -05:00
Tsz-Wo Nicholas Sze
5004b0571e In Balancer, the target task should be removed when its size < 0. Contributed by Yiqun Lin 2016-08-04 09:53:15 -07:00
Kihwal Lee
c7fe1f5ec5 HADOOP-13442. Optimize UGI group lookups. Contributed by Daryn Sharp. 
(cherry picked from commit 94225152399e6e89fa7b4cff6d17d33e544329a3)
 2016-08-04 10:48:17 -05:00
Kihwal Lee
77b61d1f4e HDFS-10662. Optimize UTF8 string/byte conversions. Contributed by Daryn Sharp. 
(cherry picked from commit 6ae39199dac6ac7be6802b31452552c76da16e24)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirWriteFileOp.java
 2016-08-04 09:43:56 -05:00
Kihwal Lee
c0166b0743 HDFS-10707. Replace org.apache.commons.io.Charsets with java.nio.charset.StandardCharsets. Contributed by Vincent Poon. 2016-08-04 09:28:30 -05:00
Akira Ajisaka
e54de94e5a MAPREDUCE-6730. Use StandardCharsets instead of String overload in TextOutputFormat. Contributed by Sahil Kang. 
This closes #114

(cherry picked from commit 70c278115249898132490a89a548fd936c09f54b)
 2016-08-04 20:18:13 +09:00
Varun Vasudev
19d894538d YARN-5459. Add support for docker rm. Contributed by Shane Kumpf. 
(cherry picked from commit 08e33381f5342590a68c65504c79c296b40fe5af)
 2016-08-04 14:18:01 +05:30
Xiao Chen
bb10750067 HADOOP-13443. KMS should check the type of underlying keyprovider of KeyProviderExtension before falling back to default. Contributed by Anthony Young-Garner. 
(cherry picked from commit 05db64913d8c620cf481f74219bac9b72cb142af)
 2016-08-04 16:08:25 +08:00
Wei-Chiu Chuang
5964d65a4d HADOOP-13458. LoadBalancingKMSClientProvider#doOp should log IOException stacktrace. Contributed by Chen Liang. 
(cherry picked from commit a1f6564d31c16582ea949e4448091f1cc56c7dfe)
 2016-08-03 14:27:33 -07:00
Kihwal Lee
1ca2ab4013 HDFS-10569. A bug causes OutOfIndex error in BlockListAsLongs. Contributed by Weiwei Yang. 
(cherry picked from commit 6f63566694f8cec64a469448a8fa00ce921ce367)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/protocol/TestBlockListAsLongs.java
 2016-08-03 15:27:03 -05:00
Jason Lowe
5a34fa670e HADOOP-10980. TestActiveStandbyElector fails occasionally in trunk. Contributed by Eric Badger 
(cherry picked from commit c82745432a962c817a8a7db92bb830fb6af01e33)
 2016-08-03 20:19:52 +00:00
Jason Lowe
65a91c8527 YARN-5469. Increase timeout of TestAmFilter.testFilter. Contributed by Eric Badger 
(cherry picked from commit db4a61dc617954cf448a0d44cb4ac79f2abf9db3)
 2016-08-03 19:53:28 +00:00
Jing Zhao
180a26d9fb HDFS-10710. In BlockManager#rescanPostponedMisreplicatedBlocks(), postponed misreplicated block counts should be retrieved within the NN lock protection.Contributed by GAO Rui. 
(cherry picked from commit f4ba5ff1d70ef92d59851c09c4bd4b43d6c04971)
 2016-08-03 12:42:44 -07:00
Jason Lowe
1ea03411c2 YARN-5462. TestNodeStatusUpdater.testNodeStatusUpdaterRetryAndNMShutdown fails intermittently. Contributed by Eric Badger 
(cherry picked from commit db646540f094077941b56ed681a4f3e5853f5b7f)
 2016-08-03 19:18:50 +00:00
Kihwal Lee
9d62caa440 HADOOP-13483. Optimize IPC server protobuf decoding. Contributed by Daryn Sharp. 
(cherry picked from commit 580a8334963709e728ed677c815fb7fef9bca70e)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/ProtobufRpcEngine.java
 2016-08-03 14:12:13 -05:00
Jason Lowe
9a0ac56a5c YARN-4280. CapacityScheduler reservations may not prevent indefinite postponement on a busy cluster. Contributed by Kuhu Shukla 
(cherry picked from commit 4d92aefd35d4517d9435d81bafdec0d77905a7a0)
 2016-08-03 19:00:06 +00:00
Kihwal Lee
a5d12d9c1f HDFS-10674. Optimize creating a full path from an inode. Contributed by Daryn Sharp. 
(cherry picked from commit 22ef5286bc8511ddee9594b7cecc598bf41a850b)
 2016-08-03 13:15:28 -05:00
Kihwal Lee
c15959fa60 HDFS-742. A down DataNode makes Balancer to hang on repeatingly asking NameNode its partial block list. Contributed by Mit Desai. 
(cherry picked from commit 58db263e93daf08280e6a586a10cebd6122cf72a)
 2016-08-03 12:18:15 -05:00
Kihwal Lee
ab7072838f HDFS-10656. Optimize conversion of byte arrays back to path string. Contributed by Daryn Sharp. 
(cherry picked from commit bebf10d2455cad1aa8985553417d4d74a61150ee)
 2016-08-03 11:54:51 -05:00
Kihwal Lee
dd21d242eb HADOOP-13426. More efficiently build IPC responses. Contributed by Daryn Sharp. 
(cherry picked from commit 2d8227605fe22c1c05f31729edc8939013763c05)
 2016-08-03 09:33:04 -05:00
Varun Vasudev
1087745d79 YARN-5460. Change container runtime type logging in DelegatingLinuxContainerRuntime to debug. Contributed by Shane Kumpf. 
(cherry picked from commit d848184e905d70835293ceac7a01b5a0ca21cc0a)
 2016-08-03 12:03:31 +05:30
Chris Nauroth
8ec3d702a3 HADOOP-13459. hadoop-azure runs several test cases repeatedly, causing unnecessarily long running time. Contributed by Chris Nauroth. 
(cherry picked from commit 4ef1bc0bdb6b2c907431492e4c8395035fa96c84)
 2016-08-02 22:32:37 -07:00
Arpit Agarwal
9850cf07fa HDFS-9353. Code and comment mismatch in JavaKeyStoreProvider. (Andras Bokor) 2016-08-02 15:18:01 -07:00
Arpit Agarwal
158dd2d5a2 HADOOP-13434. Add bash quoting to Shell class. (Owen O'Malley) 2016-08-02 13:40:56 -07:00
Kihwal Lee
dc0a17e828 HDFS-5805. TestCheckpoint.testCheckpoint fails intermittently on branch-2. Contributed by Eric Badger. 
(cherry picked from commit 5e5b8793fba8e25aeba7a74878da4cf8e806f061)
 2016-08-02 15:39:03 -05:00
Chris Nauroth
ec522a1907 HADOOP-13081. add the ability to create multiple UGIs/subjects from one kerberos login. Contributed by Sergey Shelukhin. 
(cherry picked from commit 0458a2af6e925d023882714e8b7b0568eca7a775)
 2016-08-02 12:43:51 -07:00
Junping Du
7e213844a7 YARN-5226. Remove AHS enable check from LogsCLI#fetchAMContainerLogs. Contributed by Xuan Gong. 
(cherry picked from commit 3818393297c7b337e380e8111a55f2ac4745cb83)
 2016-08-02 10:42:31 -07:00