Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,340 Commits 326 Branches 371 Tags
Commit Graph

43 Commits

Author SHA1 Message Date
cnauroth
81f7e8af22 HADOOP-12540. TestAzureFileSystemInstrumentation#testClientErrorMetrics fails intermittently due to assumption that a lease error will be thrown. Contributed by Gaurav Kanade. 
(cherry picked from commit 0fb1867fd62b5df664ad66386d6067db8fbf2317)
 2015-11-04 10:29:01 -08:00
cnauroth
c1d7b26e94 HADOOP-12508. delete fails with exception when lease is held on blob. Contributed by Gaurav Kanade. 
(cherry picked from commit 9e7dcab185abf2fdabb28f2799b9952b5664a4b0)
 2015-11-02 10:21:46 -08:00
cnauroth
c260d7ec78 HADOOP-12533. Introduce FileNotFoundException in WASB for read and seek API. Contributed by Dushyanth. 
(cherry picked from commit 28790692624177d89fb1e4f59e2f83a659fc3089)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-11-02 09:39:27 -08:00
cnauroth
c7f87dc2d0 HADOOP-12519. hadoop-azure tests should avoid creating a metrics configuration fiale in the module root directory. Contributed by Chris Nauroth. 
(cherry picked from commit 2d10cb8e00fd84be26b51f9fba819e3e5b6cdcbf)
 2015-10-28 09:44:21 -07:00
cnauroth
0377795e06 HADOOP-11685. StorageException complaining " no lease ID" during HBase distributed log splitting. Contributed by Duo Xu. 
(cherry picked from commit 1f7ecb0c84042783f9fcf3f77d7d889dc58c9ead)
 2015-10-27 22:56:33 -07:00
cnauroth
a23f79b92c HADOOP-12520. Use XInclude in hadoop-azure test configuration to isolate Azure Storage account keys for service integration tests. Contributed by Chris Nauroth. 
(cherry picked from commit 73822de7c38e189f7654444ff48d15cbe0df7404)
 2015-10-27 22:49:04 -07:00
cnauroth
b023539c19 HADOOP-12484. Single File Rename Throws Incorrectly In Potential Race Condition Scenarios. Contributed by Gaurav Kanade. 
(cherry picked from commit cb282d5b89fdece4719cc4ad37a6e27f13371534)
 2015-10-22 14:30:09 -07:00
cnauroth
10398daadf HADOOP-12334. Change Mode Of Copy Operation of HBase WAL Archiving to bypass Azure Storage Throttling after retries. Contributed by Gaurav Kanade. 
(cherry picked from commit 47641fcbc9c41f4a338d8899501e4a310d2e81ad)
 2015-10-22 12:21:44 -07:00
cnauroth
535762fadb HADOOP-12350. WASB Logging: Improve WASB Logging around deletes, reads and writes. Contributed by Dushyanth. 
(cherry picked from commit 5f6edb30c2bb648d5564c951edc25645e17e6636)
 2015-10-05 20:12:33 -07:00
Kihwal Lee
95b8f1f3a6 HADOOP-12446. Undeprecate createNonRecursive(). Contributed by Ted Yu. 
(cherry picked from commit 3abbdc929bde05f8819f5410cef1eaeb8940203f)
 2015-09-28 17:33:20 -05:00
cnauroth
b83d475252 HADOOP-12304. Applications using FileContext fail with the default file system configured to be wasb/s3/etc. Contributed by Chris Nauroth. 
(cherry picked from commit 3da0bedaec38714a62c3b7244e84bc4f981ddf45)
 2015-08-05 14:56:54 -07:00
cnauroth
bb080b32d4 HADOOP-12239. StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB. Contributed by Duo Xu. 
(cherry picked from commit efa97243ecb84b3b468e732897cd685e3869f480)
 2015-07-22 11:17:00 -07:00
cnauroth
399df10c58 HADOOP-12089. StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB. Contributed by Duo Xu. 
(cherry picked from commit 460e98f7b3ec84f3c5afcb2aad4f4e7031d16e3a)
 2015-06-29 13:49:12 -07:00
cnauroth
f5b0cce7fa HADOOP-12073. Azure FileSystem PageBlobInputStream does not return -1 on EOF. Contributed by Ivan Mitic. 
(cherry picked from commit c45784bc9031353b938f4756473937cca759b3dc)
 2015-06-08 22:42:24 -07:00
cnauroth
39f451e721 HADOOP-11959. WASB should configure client side socket timeout in storage client blob request options. Contributed by Ivan Mitic. 
(cherry picked from commit 94e7d49a6dab7e7f4e873dcca67e7fcc98e7e1f8)

Conflicts:
	hadoop-project/pom.xml
 2015-05-28 12:32:55 -07:00
cnauroth
91855c2340 HADOOP-11960. Enable Azure-Storage Client Side logging. Contributed by Dushyanth. 
(cherry picked from commit cb8e69a80cecb95abdfc93a787bea0bedef275ed)
 2015-05-14 22:22:46 -07:00
Vinayakumar B
14d88a85e4 HADOOP-11922. Misspelling of threshold in log4j.properties for tests in hadoop-tools (Contributed by Gabor Liptak) 
(cherry picked from commit f33efbc82709e75d9b4c4ed9835629668dbade7d)
 2015-05-08 10:23:27 +05:30
Jonathan Eagles
9ed6b77da1 HADOOP-11889. Make checkstyle runnable from root project (Gera Shegalov via jeagles) 
(cherry picked from commit 2d7363b27360e36fdd62546c0f9d0b1d78133f29)

Conflicts:
	pom.xml
 2015-05-01 19:04:41 -07:00
Tsuyoshi Ozawa
77297017d8 HADOOP-11720. [JDK8] Fix javadoc errors caused by incorrect or illegal tags in hadoop-tools. Contributed by Akira AJISAKA. 
(cherry picked from commit ef9946cd52d54200c658987c1dbc3e6fce133f77)
 2015-03-17 16:09:38 +09:00
cnauroth
dcc4850ff3 HADOOP-11693. Azure Storage FileSystem rename operations are throttled too aggressively to complete HBase WAL archiving. Contributed by Duo Xu. 
(cherry picked from commit 7a346bcb4fa5b56191ed00a39e72e51c9bdf1b56)
 2015-03-11 14:37:22 -07:00
Tsuyoshi Ozawa
b46f9e72db HADOOP-11602. Backport 'Fix toUpperCase/toLowerCase to use Locale.ENGLISH.' (ozawa) 2015-03-09 19:53:55 +09:00
Vinod Kumar Vavilapalli
d9416317a9 Preparing for 2.8.0 development. Changing SNAPSHOT version to be 2.8 on branch-2. 2015-03-08 20:32:51 -07:00
cnauroth
02cadbd24b HADOOP-11642. Upgrade azure sdk version from 0.6.0 to 2.0.0. Contributed by Shashank Khandelwal and Ivan Mitic. 
(cherry picked from commit 608ebd52bafecf980e9726d397c786a9c2422eba)

Conflicts:
	hadoop-project/pom.xml
 2015-03-06 15:29:22 -08:00
cnauroth
1bc4c6808d HADOOP-11629. WASB filesystem should not start BandwidthGaugeUpdater if fs.azure.skip.metrics set to true. Contributed by Shanyu Zhao. 
(cherry picked from commit 5731c0e0d08c3048fafdf62a14ca7611be4df5d7)
 2015-02-25 09:09:15 -08:00
Tsuyoshi Ozawa
f92d4fa20f HADOOP-11546. Checkstyle failing: Unable to instantiate DoubleCheckedLockingCheck. (ozawa) 
(cherry picked from commit ba58da29f49da15f7eb6300f996e0ae7ba9d0d1e)
 2015-02-05 00:51:40 +09:00
cnauroth
dedfb982f1 HADOOP-11442. hadoop-azure: Create test jar. Contributed by Shashank Khandelwal. 
(cherry picked from commit 1c09ca2ba4d97d827cc6e86ef6bd2930bc77b5ae)
 2015-02-02 11:51:01 -08:00
cnauroth
4607ca2854 HADOOP-11523. StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB. Contributed by Duo Xu. 
(cherry picked from commit f2c91098c400da6db0f5e8e49e9bf0e6444af531)
 2015-01-29 17:02:48 -08:00
cnauroth
fa2378d866 HADOOP-11441. Hadoop-azure: Change few methods scope to public. Contributed by Shashank Khandelwal. 
(cherry picked from commit ad55083f75cb920fde58302d7bc8857086c1978c)
 2015-01-29 13:07:59 -08:00
arp
0a5b28605f HADOOP-11395. Add site documentation for Azure Storage FileSystem integration. (Contributed by Chris Nauroth) 2014-12-19 18:54:35 -08:00
Haohui Mai
99c176ea6a HADOOP-11431. Clean up redundant maven-site-plugin configuration. Contributed by Herve Boutemy. 2014-12-18 16:24:17 -08:00
Haohui Mai
c28449d4b5 HADOOP-11381. Fix findbugs warnings in hadoop-distcp, hadoop-aws, hadoop-azure, and hadoop-openstack. Contributed by Li Lu. 
(cherry picked from commit 2e98ad34ce64a9e5184c53447004de20a637f927)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2014-12-17 14:57:14 -08:00
Steve Loughran
e71484be18 HADOOP-11412 POMs mention "The Apache Software License" rather than "Apache License". (Herve Boutemy via stevel) 
(cherry picked from commit 07bb0b0bbb4732687c4992e8ce61a43ce8ba3db6)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2014-12-17 14:57:13 -08:00
cnauroth
5c32c4b2e4 HADOOP-10809. SyncableDataOutputStream must implement sync method on branch-2. 2014-12-17 14:57:13 -08:00
Aaron T. Myers
66808e6aac HADOOP-10400. Incorporate new S3A FileSystem implementation. Contributed by Jordan Mendelson and Dave Wang. 
(cherry picked from commit 24d920b80eb3626073925a1d0b6dcf148add8cc0)

Conflicts:
	hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/BasicAWSCredentialsProvider.java
	hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/Constants.java
	hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java
	hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AInputStream.java
	hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AOutputStream.java
	hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/contract/s3a/TestS3AContractRename.java
	hadoop-tools/hadoop-aws/src/test/resources/contract/s3a.xml
 2014-12-17 14:57:13 -08:00
cnauroth
535d98bbb3 HADOOP-11248. Add hadoop configuration to disable Azure Filesystem metrics collection. Contributed by Shanyu Zhao. 
(cherry picked from commit 734eeb4f357ad3210355a0d3fdbc80706a770d61)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2014-12-17 14:57:13 -08:00
cnauroth
1646cc9f29 HADOOP-11188. hadoop-azure: automatically expand page blobs when they become full. Contributed by Eric Hanson. 
(cherry picked from commit f4b7e99f4ebac5b0295b7f7f42eb5705af41f079)
 2014-12-17 14:57:13 -08:00
cnauroth
5a737026cc HADOOP-10809. hadoop-azure: page blob support. Contributed by Dexter Bradshaw, Mostafa Elhemali, Eric Hanson, and Mike Liddell. 
(cherry picked from commit 2217e2f8ff418b88eac6ad36cafe3a9795a11f40)
 2014-12-17 14:57:13 -08:00
Allen Wittenauer
9a2e4f4f98 HADOOP-10946. Fix a bunch of typos in log messages (Ray Chiang via aw) 
(cherry picked from commit 9f03a7c018bb2c497cd0ef758f1a3e08e8163d06)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2014-12-17 14:57:13 -08:00
Chris Nauroth
cb6eb5931f HADOOP-10690. Lack of synchronization on access to InputStream in NativeAzureFileSystem#NativeAzureFsInputStream#close(). Contributed by Chen He. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604236 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 61bf9f779919206296d2ce84a8a6b2d912709a59)
 2014-12-17 14:57:12 -08:00
Chris Nauroth
02a3bf8bda HADOOP-10840. Fix OutOfMemoryError caused by metrics system in Azure File System. Contributed by Shanyu Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611247 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 0a02b5a19bcca8d0c49d2adfc3909aebdf9d606e)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2014-12-17 14:57:12 -08:00
Chris Nauroth
b928b8c775 HADOOP-10728. Metrics system for Windows Azure Storage Filesystem. Contributed by Dexter Bradshaw, Mostafa Elhemali, Xi Fang, Johannes Klein, David Lao, Mike Liddell, Chuan Liu, Lengning Liu, Ivan Mitic, Michael Rys, Alexander Stojanovic, Brian Swan, and Min Wei. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605187 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 0d91576ec31f63402f2db6107a04155368e2632d)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2014-12-17 14:57:12 -08:00
Chris Nauroth
80d005c66f HADOOP-10689. InputStream is not closed in AzureNativeFileSystemStore#retrieve(). Contributed by Chen He. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604233 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 8300b9fb385b47672d98ea62ab291991424f3cce)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2014-12-17 14:57:12 -08:00
Chris Nauroth
82268d87bc HADOOP-9629. Support Windows Azure Storage - Blob as a file system in Hadoop. Contributed by Dexter Bradshaw, Mostafa Elhemali, Xi Fang, Johannes Klein, David Lao, Mike Liddell, Chuan Liu, Lengning Liu, Ivan Mitic, Michael Rys, Alexander Stojanovic, Brian Swan, and Min Wei. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601781 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 81bc395deb3ba00567dc067d6ca71bacf9e3bc82)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-project/pom.xml
	hadoop-tools/hadoop-tools-dist/pom.xml
	hadoop-tools/pom.xml
 2014-12-17 14:56:05 -08:00