Commit Graph

8127 Commits

Author SHA1 Message Date
Haohui Mai e870851b4a HDFS-7536. Remove unused CryptoCodec in org.apache.hadoop.fs.Hdfs. Contributed by Haohui Mai. 2014-12-16 13:26:52 -08:00
Haohui Mai ba0969fb0e Revert HADOOP-11356 in branch-2. 2014-12-16 13:21:58 -08:00
Colin Patrick Mccabe 1b91a6d011 HDFS-7494. Checking of closed in DFSInputStream#pread() should be protected by synchronization (Ted Yu via Colin P. McCabe)
(cherry picked from commit a97a1e7317)
2014-12-16 11:08:02 -08:00
Jian He 878350a0e8 YARN-2762. Fixed RMAdminCLI to trim and check node-label related arguments before sending to RM. Contributed by Rohith Sharmaks
(cherry picked from commit c65f1b382e)
2014-12-16 11:01:24 -08:00
Kihwal Lee b70c0c295c HDFS-6425. Large postponedMisreplicatedBlocks has impact on blockReport latency. Contributed by Ming Ma.
(cherry picked from commit b7923a356e)
2014-12-16 10:31:57 -06:00
Steve Loughran a1b8b9ca59 HADOOP-11412 POMs mention "The Apache Software License" rather than "Apache License". (Herve Boutemy via stevel) 2014-12-16 11:03:02 +00:00
Gera Shegalov 7c7bccfc31 MAPREDUCE-6166. Reducers do not validate checksum of map outputs when fetching directly to disk. (Eric Payne via gera)
(cherry picked from commit af006937e8)
2014-12-15 19:21:46 -08:00
Colin Patrick Mccabe 19c8f7b72c HADOOP-11410. Make the rpath of libhadoop.so configurable (cmccabe)
(cherry picked from commit fb20797b62)
2014-12-15 18:55:38 -08:00
Benoy Antony 2eabbae292 HADOOP-10852 Fix thread safety issues in NetgroupCache. (Benoy Antony)
(cherry picked from commit a095622f36)
2014-12-15 14:02:15 -08:00
Karthik Kambatla b1ccf68db3 YARN-2914. [YARN-1492] Potential race condition in Singleton implementation of SharedCacheUploaderMetrics, CleanerMetrics, ClientSCMMetrics. (Varun Saxena via kasha)
(cherry picked from commit e597249d36)
2014-12-15 12:00:46 -08:00
Brandon Li 781a1e352c HDFS-7516. Fix findbugs warnings in hdfs-nfs project. Contributed by Brandon Li
(cherry picked from commit 42d8858c5d)
2014-12-15 11:29:37 -08:00
Jian He d2356a552a Revert "YARN-2890. MiniYARNCluster should start the timeline server based on the configuration. Contributed by Mit Desai."
This reverts commit 51af8d367d.

Conflicts:
	hadoop-yarn-project/CHANGES.txt
(cherry picked from commit a4f2995b9e)
2014-12-15 11:08:44 -08:00
Haohui Mai 282b5ed8ec HDFS-7506. Consolidate implementation of setting inode attributes into a single class. Contributed by Haohui Mai. 2014-12-15 10:49:10 -08:00
Colin Patrick Mccabe c9950f00a3 HDFS-7513. HDFS inotify: add defaultBlockSize to CreateEvent (cmccabe)
(cherry picked from commit 6e13fc62e1)
2014-12-15 10:30:50 -08:00
Devaraj K 4c6760bc6b YARN-2356. yarn status command for non-existent application/application
attempt/container is too verbose. Contributed by Sunil G.

(cherry picked from commit fae3e8614f)
2014-12-15 14:46:27 +05:30
Harsh J a3fa1f0761 MAPREDUCE-6194. Bubble up final exception in failures during creation of output collectors. Contributed by Varun Saxena.
(cherry picked from commit 298d09c9b5)
2014-12-15 14:27:49 +05:30
Gera Shegalov 6465931c19 MAPREDUCE-4879. TeraOutputFormat may overwrite an existing output directory. (gera)
(cherry picked from commit 25a0440238)
2014-12-13 18:12:02 -08:00
cnauroth b9f1e88df7 HADOOP-11396. Provide navigation in the site documentation linking to the Hadoop Compatible File Systems. Contributed by Chris Nauroth.
(cherry picked from commit cbfb996fb4)
2014-12-12 23:32:55 -08:00
cnauroth 21347a05f5 HADOOP-11394. hadoop-aws documentation missing. Contributed by Chris Nauroth.
(cherry picked from commit 9458cd5bce)
2014-12-12 23:29:40 -08:00
Harsh J da36252077 YARN-2950. Change message to mandate, not suggest JS requirement on UI. Contributed by Dustin Cote.
(cherry picked from commit 0e37bbc8e3)
2014-12-13 07:27:37 +05:30
Andrew Wang 6bc65d769b HDFS-7426. Change nntop JMX format to be a JSON blob.
(cherry picked from commit fa7b9248e4)
2014-12-12 17:04:41 -08:00
Colin Patrick Mccabe b521d91c0f HADOOP-11238. Update the NameNode's Group Cache in the background when possible (Chris Li via Colin P. McCabe)
(cherry picked from commit e5a6925199)
2014-12-12 16:32:04 -08:00
Jing Zhao 614b4046ba HDFS-7059. Avoid resolving path multiple times. Contributed by Jing Zhao. 2014-12-12 15:14:15 -08:00
arp d15fb57f46 HDFS-7514. TestTextCommand fails on Windows. (Arpit Agarwal) 2014-12-12 14:28:46 -08:00
Haohui Mai d9f31c6472 HDFS-7517. Remove redundant non-null checks in FSNamesystem#getBlockLocations. Contributed by Haohui Mai. 2014-12-12 11:51:29 -08:00
Steve Loughran a858d726c8 YARN-2912 Jersey Tests failing with port in use. (varun saxena via stevel) 2014-12-12 17:10:54 +00:00
Devaraj K 10ff600b35 YARN-2243. Order of arguments for Preconditions.checkNotNull() is wrong in
SchedulerApplicationAttempt ctor. Contributed by Devaraj K.

(cherry picked from commit bda748ac3a)
2014-12-12 12:37:13 +05:30
Devaraj K 25f4a0193b MAPREDUCE-6046. Change the class name for logs in RMCommunicator.
Contributed by Sahil Takiar.

(cherry picked from commit 0bd0229110)
2014-12-12 11:44:00 +05:30
Andrew Wang 7f39cab356 HDFS-7497. Inconsistent report of decommissioning DataNodes between dfsadmin and NameNode webui. Contributed by Yongjun Zhang.
(cherry picked from commit b437f5eef4)
2014-12-11 18:13:14 -08:00
Haohui Mai 5bc3aae6fb HADOOP-11389. Clean up byte to string encoding issues in hadoop-common. Contributed by Haohui Mai. 2014-12-11 16:51:46 -08:00
Brandon Li 23289d13ff HDFS-7449. Add metrics to NFS gateway. Contributed by Brandon Li
(cherry picked from commit f6f2a3f1c7)
2014-12-11 15:43:06 -08:00
Gera Shegalov 8437c31b67 HADOOP-11211. mapreduce.job.classloader.system.classes semantics should be order-independent. (Yitong Zhou via gera)
(cherry picked from commit 0bcea111e5)
2014-12-11 13:29:40 -08:00
Haohui Mai c8eb139977 HDFS-7515. Fix new findbugs warnings in hadoop-hdfs. Contributed by Haohui Mai. 2014-12-11 12:36:20 -08:00
Jian He 41f0d20fcb YARN-2917. Fixed potential deadlock when system.exit is called in AsyncDispatcher. Contributed by Rohith Sharmaks
(cherry picked from commit 614b6afea4)
2014-12-11 11:18:45 -08:00
arp e4f9ddfdbc HDFS-7503. Namenode restart after large deletions can cause slow processReport (Arpit Agarwal) 2014-12-10 23:37:26 -08:00
Haohui Mai 9e1c059815 HDFS-7463. Simplify FSNamesystem#getBlockLocationsUpdateTimes. Contributed by Haohui Mai. 2014-12-10 23:01:28 -08:00
Harsh J 6e06a51e30 MAPREDUCE-5420. Remove mapreduce.task.tmp.dir from mapred-default.xml. Contributed by James Carman. (harsh)
(cherry picked from commit cb99f43305)
2014-12-11 09:46:08 +05:30
arp d39809016d HDFS-7475. Make TestLazyPersistFiles#testLazyPersistBlocksAreSaved deterministic. (Contributed by Xiaoyu Yao) 2014-12-10 18:24:50 -08:00
Haohui Mai 87b3fc8cae HDFS-5578. [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments. Contributed by Andrew Purtell. 2014-12-10 14:54:52 -08:00
Haohui Mai 38afeb5f12 HADOOP-11386. Replace \n by %n in format hadoop-common format strings. Contributed by Li Lu. 2014-12-10 14:37:39 -08:00
Haohui Mai df5af744ad HADOOP-11388. Remove deprecated o.a.h.metrics.file.FileContext. Contributed by Li Lu. 2014-12-10 12:49:26 -08:00
Haohui Mai 7e51350d9a HADOOP-10482. Fix various findbugs warnings in hadoop-common. Contributed by Haohui Mai. 2014-12-10 12:44:32 -08:00
Haohui Mai a1e4a12dc0 HADOOP-11381. Fix findbugs warnings in hadoop-distcp, hadoop-aws, hadoop-azure, and hadoop-openstack. Contributed by Li Lu. 2014-12-09 20:46:44 -08:00
Haohui Mai c2514aaa83 HDFS-7502. Fix findbugs warning in hdfs-nfs project. Contributed by Brandon Li. 2014-12-09 20:43:20 -08:00
Vinayakumar B 19627e5897 HDFS-7481. Add ACL indicator to the 'Permission Denied' exception. (Contributed by Vinayakumar B )
(cherry picked from commit d93f3b9815)
2014-12-10 08:32:39 +05:30
Jian He b31dfb17d8 YARN-2924. Fixed RMAdminCLI to not convert node labels to lower case. Contributed by Wangda Tan
(cherry picked from commit 437322afca)
2014-12-09 17:56:41 -08:00
Jian He 0f47e4e745 YARN-2930. Fixed TestRMRestart#testRMRestartRecoveringNodeLabelManager intermittent failure. Contributed by Wangda Tan
(cherry picked from commit 2ed90a57fd)
2014-12-09 16:48:46 -08:00
Colin Patrick Mccabe 3637bc8cd9 HADOOP-11349. RawLocalFileSystem leaks file descriptor while creating a file if creat succeeds but chmod fails. (Varun Saxena via Colin P. McCabe)
(cherry picked from commit 03867eb1bb)
2014-12-09 14:32:25 -08:00
Karthik Kambatla 1986ea8dd2 YARN-2910. FSLeafQueue can throw ConcurrentModificationException. (Wilfred Spiegelenburg via kasha)
(cherry picked from commit a2e07a5456)
2014-12-09 14:00:52 -08:00
Haohui Mai 784f481473 HADOOP-11378. Fix new findbugs warnings in hadoop-kms. Contributed by Li Lu. 2014-12-09 13:10:09 -08:00