Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,189 Commits 326 Branches 371 Tags
Commit Graph

8189 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Allen Wittenauer
9a2e4f4f98 HADOOP-10946. Fix a bunch of typos in log messages (Ray Chiang via aw) 
(cherry picked from commit 9f03a7c018bb2c497cd0ef758f1a3e08e8163d06)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2014-12-17 14:57:13 -08:00
cnauroth
156e78c1da HADOOP-10690. Correct CHANGES.txt. 2014-12-17 14:57:13 -08:00
Chris Nauroth
cb6eb5931f HADOOP-10690. Lack of synchronization on access to InputStream in NativeAzureFileSystem#NativeAzureFsInputStream#close(). Contributed by Chen He. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604236 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 61bf9f779919206296d2ce84a8a6b2d912709a59)
 2014-12-17 14:57:12 -08:00
Chris Nauroth
02a3bf8bda HADOOP-10840. Fix OutOfMemoryError caused by metrics system in Azure File System. Contributed by Shanyu Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611247 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 0a02b5a19bcca8d0c49d2adfc3909aebdf9d606e)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2014-12-17 14:57:12 -08:00
Chris Nauroth
b928b8c775 HADOOP-10728. Metrics system for Windows Azure Storage Filesystem. Contributed by Dexter Bradshaw, Mostafa Elhemali, Xi Fang, Johannes Klein, David Lao, Mike Liddell, Chuan Liu, Lengning Liu, Ivan Mitic, Michael Rys, Alexander Stojanovic, Brian Swan, and Min Wei. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605187 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 0d91576ec31f63402f2db6107a04155368e2632d)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2014-12-17 14:57:12 -08:00
Chris Nauroth
80d005c66f HADOOP-10689. InputStream is not closed in AzureNativeFileSystemStore#retrieve(). Contributed by Chen He. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604233 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 8300b9fb385b47672d98ea62ab291991424f3cce)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2014-12-17 14:57:12 -08:00
Chris Nauroth
82268d87bc HADOOP-9629. Support Windows Azure Storage - Blob as a file system in Hadoop. Contributed by Dexter Bradshaw, Mostafa Elhemali, Xi Fang, Johannes Klein, David Lao, Mike Liddell, Chuan Liu, Lengning Liu, Ivan Mitic, Michael Rys, Alexander Stojanovic, Brian Swan, and Min Wei. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601781 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 81bc395deb3ba00567dc067d6ca71bacf9e3bc82)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-project/pom.xml
	hadoop-tools/hadoop-tools-dist/pom.xml
	hadoop-tools/pom.xml
 2014-12-17 14:56:05 -08:00
Haohui Mai
a7c5456c72 HDFS-7528. Consolidate symlink-related implementation into a single class. Contributed by Haohui Mai. 2014-12-17 14:54:24 -08:00
Haohui Mai
e869276005 HADOOP-11420. Use latest maven-site-plugin and replace link to svn with link to git. Contributed by Hervé Boutemy. 2014-12-17 14:05:59 -08:00
Karthik Kambatla
300a665307 YARN-2189. Admin service for cache manager. Addendum to fix merge conflicts 2014-12-17 11:47:24 -08:00
Colin Patrick Mccabe
89d6ac498a HADOOP-11416. Move ChunkedArrayList into hadoop-common (cmccabe) 
(cherry picked from commit 4281c96e24739387bc2084f819c0176d0051a5e9)
 2014-12-17 10:36:59 -08:00
cnauroth
36068768d8 HADOOP-11321. copyToLocal cannot save a file to an SMB share unless the user has Full Control permissions. Contributed by Chris Nauroth. 
(cherry picked from commit e996a1bfd4f3ada6cbd9633fe68fda1e0c910bdf)
 2014-12-16 15:32:23 -08:00
Haohui Mai
e870851b4a HDFS-7536. Remove unused CryptoCodec in org.apache.hadoop.fs.Hdfs. Contributed by Haohui Mai. 2014-12-16 13:26:52 -08:00
Haohui Mai
ba0969fb0e Revert HADOOP-11356 in branch-2. 2014-12-16 13:21:58 -08:00
Colin Patrick Mccabe
1b91a6d011 HDFS-7494. Checking of closed in DFSInputStream#pread() should be protected by synchronization (Ted Yu via Colin P. McCabe) 
(cherry picked from commit a97a1e73177974cff8afafad6ca43a96563f3c61)
 2014-12-16 11:08:02 -08:00
Jian He
878350a0e8 YARN-2762. Fixed RMAdminCLI to trim and check node-label related arguments before sending to RM. Contributed by Rohith Sharmaks 
(cherry picked from commit c65f1b382ec5ec93dccf459dbf8b2c93c3e150ab)
 2014-12-16 11:01:24 -08:00
Kihwal Lee
b70c0c295c HDFS-6425. Large postponedMisreplicatedBlocks has impact on blockReport latency. Contributed by Ming Ma. 
(cherry picked from commit b7923a356e9f111619375b94d12749d634069347)
 2014-12-16 10:31:57 -06:00
Steve Loughran
a1b8b9ca59 HADOOP-11412 POMs mention "The Apache Software License" rather than "Apache License". (Herve Boutemy via stevel) 2014-12-16 11:03:02 +00:00
Gera Shegalov
7c7bccfc31 MAPREDUCE-6166. Reducers do not validate checksum of map outputs when fetching directly to disk. (Eric Payne via gera) 
(cherry picked from commit af006937e8ba82f98f468dc7375fe89c2e0a7912)
 2014-12-15 19:21:46 -08:00
Colin Patrick Mccabe
19c8f7b72c HADOOP-11410. Make the rpath of libhadoop.so configurable (cmccabe) 
(cherry picked from commit fb20797b6237054f3d16ff94a665cbad4cbe3293)
 2014-12-15 18:55:38 -08:00
Benoy Antony
2eabbae292 HADOOP-10852 Fix thread safety issues in NetgroupCache. (Benoy Antony) 
(cherry picked from commit a095622f36c5e9fff3ec02b14b800038a81f6286)
 2014-12-15 14:02:15 -08:00
Karthik Kambatla
b1ccf68db3 YARN-2914. [YARN-1492] Potential race condition in Singleton implementation of SharedCacheUploaderMetrics, CleanerMetrics, ClientSCMMetrics. (Varun Saxena via kasha) 
(cherry picked from commit e597249d361bbe8383fb9b564eacda7c990b781d)
 2014-12-15 12:00:46 -08:00
Brandon Li
781a1e352c HDFS-7516. Fix findbugs warnings in hdfs-nfs project. Contributed by Brandon Li 
(cherry picked from commit 42d8858c5d237c4d9ab439c570a17b7fcaf781c2)
 2014-12-15 11:29:37 -08:00
Jian He
d2356a552a Revert "YARN-2890. MiniYARNCluster should start the timeline server based on the configuration. Contributed by Mit Desai." 
This reverts commit 51af8d367de94689770f57c64bea3b244d7755f6.

Conflicts:
	hadoop-yarn-project/CHANGES.txt
(cherry picked from commit a4f2995b9ec8347612b7aeeb5a3a8b7191278790)
 2014-12-15 11:08:44 -08:00
Haohui Mai
282b5ed8ec HDFS-7506. Consolidate implementation of setting inode attributes into a single class. Contributed by Haohui Mai. 2014-12-15 10:49:10 -08:00
Colin Patrick Mccabe
c9950f00a3 HDFS-7513. HDFS inotify: add defaultBlockSize to CreateEvent (cmccabe) 
(cherry picked from commit 6e13fc62e1f284f22fd0089f06ce281198bc7c2a)
 2014-12-15 10:30:50 -08:00
Devaraj K
4c6760bc6b YARN-2356. yarn status command for non-existent application/application 
attempt/container is too verbose. Contributed by Sunil G.

(cherry picked from commit fae3e8614f4f9a42904e39c51ca68b0d1e67469f)
 2014-12-15 14:46:27 +05:30
Harsh J
a3fa1f0761 MAPREDUCE-6194. Bubble up final exception in failures during creation of output collectors. Contributed by Varun Saxena. 
(cherry picked from commit 298d09c9b583088f364038adcb1edf1eb1c2c196)
 2014-12-15 14:27:49 +05:30
Gera Shegalov
6465931c19 MAPREDUCE-4879. TeraOutputFormat may overwrite an existing output directory. (gera) 
(cherry picked from commit 25a04402389dce0222938df4375d4545f8c1f34f)
 2014-12-13 18:12:02 -08:00
cnauroth
b9f1e88df7 HADOOP-11396. Provide navigation in the site documentation linking to the Hadoop Compatible File Systems. Contributed by Chris Nauroth. 
(cherry picked from commit cbfb996fb4787e9d4bbaee1d01e3eca2caf0ce55)
 2014-12-12 23:32:55 -08:00
cnauroth
21347a05f5 HADOOP-11394. hadoop-aws documentation missing. Contributed by Chris Nauroth. 
(cherry picked from commit 9458cd5bce20358e31c0cfb594bc545c7824b10d)
 2014-12-12 23:29:40 -08:00
Harsh J
da36252077 YARN-2950. Change message to mandate, not suggest JS requirement on UI. Contributed by Dustin Cote. 
(cherry picked from commit 0e37bbc8e3f8e96acd96522face2f4bb01584cb4)
 2014-12-13 07:27:37 +05:30
Andrew Wang
6bc65d769b HDFS-7426. Change nntop JMX format to be a JSON blob. 
(cherry picked from commit fa7b9248e415c04bb555772f44fadaf8d9f34974)
 2014-12-12 17:04:41 -08:00
Colin Patrick Mccabe
b521d91c0f HADOOP-11238. Update the NameNode's Group Cache in the background when possible (Chris Li via Colin P. McCabe) 
(cherry picked from commit e5a692519956aefb3a540ed0137b63cf598ac10d)
 2014-12-12 16:32:04 -08:00
Jing Zhao
614b4046ba HDFS-7059. Avoid resolving path multiple times. Contributed by Jing Zhao. 2014-12-12 15:14:15 -08:00
arp
d15fb57f46 HDFS-7514. TestTextCommand fails on Windows. (Arpit Agarwal) 2014-12-12 14:28:46 -08:00
Haohui Mai
d9f31c6472 HDFS-7517. Remove redundant non-null checks in FSNamesystem#getBlockLocations. Contributed by Haohui Mai. 2014-12-12 11:51:29 -08:00
Steve Loughran
a858d726c8 YARN-2912 Jersey Tests failing with port in use. (varun saxena via stevel) 2014-12-12 17:10:54 +00:00
Devaraj K
10ff600b35 YARN-2243. Order of arguments for Preconditions.checkNotNull() is wrong in 
SchedulerApplicationAttempt ctor. Contributed by Devaraj K.

(cherry picked from commit bda748ac3abf30f6cd4c0e22c80c73396abc59fb)
 2014-12-12 12:37:13 +05:30
Devaraj K
25f4a0193b MAPREDUCE-6046. Change the class name for logs in RMCommunicator. 
Contributed by Sahil Takiar.

(cherry picked from commit 0bd022911013629a8c9e7357fae8cf4399d7a1e3)
 2014-12-12 11:44:00 +05:30
Andrew Wang
7f39cab356 HDFS-7497. Inconsistent report of decommissioning DataNodes between dfsadmin and NameNode webui. Contributed by Yongjun Zhang. 
(cherry picked from commit b437f5eef40874287d4fbf9d8e43f1a857b5621f)
 2014-12-11 18:13:14 -08:00
Haohui Mai
5bc3aae6fb HADOOP-11389. Clean up byte to string encoding issues in hadoop-common. Contributed by Haohui Mai. 2014-12-11 16:51:46 -08:00
Brandon Li
23289d13ff HDFS-7449. Add metrics to NFS gateway. Contributed by Brandon Li 
(cherry picked from commit f6f2a3f1c73266bfedd802eacde60d8b19b81015)
 2014-12-11 15:43:06 -08:00
Gera Shegalov
8437c31b67 HADOOP-11211. mapreduce.job.classloader.system.classes semantics should be order-independent. (Yitong Zhou via gera) 
(cherry picked from commit 0bcea111e5daa9a4315346cf6919a4cfc8d90e0d)
 2014-12-11 13:29:40 -08:00
Haohui Mai
c8eb139977 HDFS-7515. Fix new findbugs warnings in hadoop-hdfs. Contributed by Haohui Mai. 2014-12-11 12:36:20 -08:00
Jian He
41f0d20fcb YARN-2917. Fixed potential deadlock when system.exit is called in AsyncDispatcher. Contributed by Rohith Sharmaks 
(cherry picked from commit 614b6afea450ebb897fbb2519c6f02e13b9bd12d)
 2014-12-11 11:18:45 -08:00
arp
e4f9ddfdbc HDFS-7503. Namenode restart after large deletions can cause slow processReport (Arpit Agarwal) 2014-12-10 23:37:26 -08:00
Haohui Mai
9e1c059815 HDFS-7463. Simplify FSNamesystem#getBlockLocationsUpdateTimes. Contributed by Haohui Mai. 2014-12-10 23:01:28 -08:00
Harsh J
6e06a51e30 MAPREDUCE-5420. Remove mapreduce.task.tmp.dir from mapred-default.xml. Contributed by James Carman. (harsh) 
(cherry picked from commit cb99f43305bd1577d4ba9527d237ac6cdb9ae730)
 2014-12-11 09:46:08 +05:30
arp
d39809016d HDFS-7475. Make TestLazyPersistFiles#testLazyPersistBlocksAreSaved deterministic. (Contributed by Xiaoyu Yao) 2014-12-10 18:24:50 -08:00