1559 Commits

Author SHA1 Message Date
Vinayakumar B
4f53c98ca4 HADOOP-7139. Allow appending to existing SequenceFiles (Contributed by kanaka kumar avvaru)
(cherry picked from commit 295d678be8853a52c3ec3da43d9265478d6632b3)
(cherry picked from commit 80697e4f324948ec32b4cad3faccba55287be652)
(cherry picked from commit b3546b60340e085c5abd8f8f0990d45c7445fe07)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt

(cherry picked from commit e9c8d8c58516aa64589cd44e9e5dd0a23ba72a17)
2015-09-03 14:15:23 -07:00
Gera Shegalov
c90f025e90 HADOOP-11491. HarFs incorrectly declared as requiring an authority. (Brahma Reddy Battula via gera)
(cherry picked from commit f343f8657e2b01773a32c2c7d960dc368954b42e)
(cherry picked from commit 58970d69de8a1662e4548cd6d4ca460dd70562f8)
2015-09-02 15:16:43 -07:00
Colin Patrick Mccabe
8770f1f039 HADOOP-11802. DomainSocketWatcher thread terminates sometimes after there is an I/O error during requestShortCircuitShm (cmccabe)
(cherry picked from commit a0e0a63209b5eb17dca5cc503be36aa52defeabd)
(cherry picked from commit 788b76761d5dfadf688406d50169e95401fe5d33)
2015-09-02 14:38:26 -07:00
Steve Loughran
e0e93e9f8d HADOOP-11730. Regression: s3n read failure recovery broken. (Takenori Sato via stevel)
(cherry picked from commit a6a5d1d6b5ee76c829ba7b54a4ad619f7b986681)
2015-09-02 14:01:53 -07:00
Gera Shegalov
736ebeca33 HADOOP-11812. Implement listLocatedStatus for ViewFileSystem to speed up split calculation (gera)
(cherry picked from commit 6d2cf9fbbd02482315a091ab07af26e40cc5134f)
(cherry picked from commit 1544c63602089b690e850e0e30af4589513a2371)
2015-09-02 11:46:47 -07:00
yliu
2230754f2a HADOOP-11710. Make CryptoOutputStream behave like DFSOutputStream wrt synchronization. (Sean Busbey via yliu)
(cherry picked from commit 813c93cb250d6d556604fe98845b979970bd5e18)
2015-09-01 15:42:37 -07:00
yliu
bb1b87f3b8 HADOOP-11674. oneByteBuf in CryptoInputStream and CryptoOutputStream should be non static. (Sean Busbey via yliu)
(cherry picked from commit b569c3ab1cb7e328dde822f6b2405d24b9560e3a)
2015-09-01 14:28:19 -07:00
cnauroth
342504f790 HADOOP-11604. Prevent ConcurrentModificationException while closing domain sockets during shutdown of DomainSocketWatcher thread. Contributed by Chris Nauroth.
(cherry picked from commit 3c5ff0759c4f4e10c97c6d9036add00edb8be2b5)
(cherry picked from commit 187e081d5a8afe1ddfe5d7b5e7de7a94512aa53e)
2015-09-01 11:10:41 -07:00
Kihwal Lee
4ec7b6174d HADOOP-11295. RPC Server Reader thread can't shutdown if RPCCallQueue is full. Contributed by Ming Ma.
(cherry picked from commit 685af8a3d0504724fe588daf3722519fedc45b01)
(cherry picked from commit 6c01e586198a3c3ebaa7561778c124ae62553246)
2015-08-31 18:10:00 -07:00
Gera Shegalov
bb8a1551c3 HADOOP-11506. Configuration variable expansion regex expensive for long values. (Gera Shegalov via gera)
(cherry picked from commit 644548f201743408904dfe24b9f5b515b2c96713)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/conf/TestConfiguration.java

(cherry picked from commit 3d36d4737c160d7dc8829e9dd6b801ef6726c0c0)
2015-08-31 16:00:32 -07:00
Andrew Wang
24da944241 HADOOP-11482. Use correct UGI when KMSClientProvider is called by a proxy user. Contributed by Arun Suresh.
(cherry picked from commit 4b00935643f6c3656ccbd7eeb54884738bc12c2e)
(cherry picked from commit 7b69719455a1a374c9417417ef0c8d7ba6bf593f)
2015-08-31 15:14:41 -07:00
Haohui Mai
31c99a3dbf HADOOP-11350. The size of header buffer of HttpServer is too small when HTTPS is enabled. Contributed by Benoy Antony.
(cherry picked from commit 2e4df8710435c8362506fe944a935e74ad5919c0)
2015-08-31 12:59:50 -07:00
Colin Patrick Mccabe
1698110acc HADOOP-11238. Update the NameNode's Group Cache in the background when possible (Chris Li via Colin P. McCabe)
(cherry picked from commit e5a692519956aefb3a540ed0137b63cf598ac10d)

(cherry picked from commit b521d91c0f5b6d114630b6727f6a01db56dba4f1)
2015-08-30 19:47:15 -07:00
Andrew Wang
2a2888f2f3 HADOOP-11368. Fix SSLFactory truststore reloader thread leak in KMSClientProvider. Contributed by Arun Suresh.
(cherry picked from commit 74d4bfded98239507511dedb515bc6a54958d5a8)
(cherry picked from commit deaa172e7a2ab09656cc9eb431a3e68a73e0bd96)
2015-08-30 13:41:40 -07:00
Andrew Wang
65180617fb HADOOP-11343. Overflow is not properly handled in caclulating final iv for AES CTR. Contributed by Jerry Chen.
(cherry picked from commit 0707e4eca906552c960e3b8c4e20d9913145eca6)
(cherry picked from commit dabdd2d746d1e1194c124c5c7fe73fcc025e78d2)
2015-08-30 13:31:43 -07:00
Colin Patrick Mccabe
bfc0a19d6d HADOOP-11333. Fix deadlock in DomainSocketWatcher when the notification pipe is full (zhaoyunjiong via cmccabe)
(cherry picked from commit 86e3993def01223f92b8d1dd35f6c1f8ab6033f5)

(cherry picked from commit f6d1bf5ed1cf647d82e676df15587de42b1faa42)
2015-08-27 19:18:45 -07:00
Vinayakumar B
d6666e8d26 HADOOP-10786. Fix UGI#reloginFromKeytab on Java 8. Contributed by Stephen Chu.
Moved CHANGES.txt entry to 2.6.1

(cherry picked from commit d6050f06a3b7e049541b1cb4597c388abf00a5be)
2015-08-27 18:18:32 -07:00
Haohui Mai
7405de4970 HADOOP-10786. Fix UGI#reloginFromKeytab on Java 8. Contributed by Stephen Chu.
(cherry picked from commit 9e63cb4492896ffb78c84e27f263a61ca12148c8)
(cherry picked from commit 7adb6f9501e8efaa712fb70fe5a97e233622e3e1)
2015-08-27 18:18:25 -07:00
Colin Patrick Mccabe
ebb515f5e7 HADOOP-11466. FastByteComparisons: do not use UNSAFE_COMPARER on the SPARC architecture because it is slower there (Suman Somasundar via Colin P. McCabe)
(cherry picked from commit ee7d22e90ce67de3e7ee92f309c048a1d4be0bbe)
(cherry picked from commit 2c69f8cf81aed731762524e821088fd779210601)
2015-01-26 11:19:24 -08:00
Karthik Kambatla
5913c5143b Update release date for 2.5.2
(cherry picked from commit 1e9a3f42ff49be788ac99e5f06a7984d1d0638cc)
2014-11-21 14:35:06 -08:00
Karthik Kambatla
2740d24ad3 HADOOP-11307. create-release script should run git clean first (kasha)
(cherry picked from commit 4fb96dbe3bbfd3ae88b41c816e15acee04518851)
2014-11-14 15:38:23 -08:00
Arun C. Murthy
98a4538cf4 Preparing to release hadoop-2.6.0-rc1.
(cherry picked from commit 9ff7315cbe9804bebcd1ec093fac7828a72ddf59)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-mapreduce-project/CHANGES.txt
	hadoop-yarn-project/CHANGES.txt
2014-11-13 13:05:50 -08:00
Arun C. Murthy
dc04b33768 HADOOP-9576. Merging to branch-2.6 for hadoop-2.6.0-rc1. 2014-11-12 10:01:09 -08:00
Karthik Kambatla
ba01844260 Set the release date for 2.5.2
(cherry picked from commit 68a050872896f93582f95420dd6e2bdefa4fd7cc)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

(cherry picked from commit 92de44c2c58321c12bd8796859d54638e3cba9bd)
2014-11-10 15:24:14 -08:00
Arun C. Murthy
be31db82f7 Updated CHANGES.txt to reflect hadoop-2.6.0 release dates.
(cherry picked from commit 770cc144425b6188d9b93178c77a35cd830a60df)
2014-11-09 18:53:55 -08:00
Arun C. Murthy
e1608c28d5 Revert "HADOOP-10786. Fix UGI#reloginFromKeytab on Java 8. Contributed by Stephen Chu."
Moving this to 2.7 only.
2014-11-09 18:16:02 -08:00
Haohui Mai
35bd0f3b20 HADOOP-10786. Fix UGI#reloginFromKeytab on Java 8. Contributed by Stephen Chu. 2014-11-09 17:48:50 -08:00
Arun C. Murthy
85531834b3 HADOOP-11286. Copied LimitInputStream from guava-0.14 to hadoop to avoid issues with newer versions of guava in applications. Contributed by Christopher Tubbs.
(cherry picked from commit 6caa8100d5d2547e34356dc279fd5e65b81a925a)
2014-11-09 05:25:01 -08:00
cnauroth
a07f478b40 HADOOP-11282. Skip NFS TestShellBasedIdMapping tests that are irrelevant on Windows. Contributed by Chris Nauroth.
(cherry picked from commit 68db5b3736287ef218acc861368c6b95b72fa2f4)
(cherry picked from commit 3ef876712c389391784068fe05f724d84957bbec)
2014-11-07 14:33:39 -08:00
cnauroth
e398048035 HADOOP-11280. TestWinUtils#testChmod fails after removal of NO_PROPAGATE_INHERIT_ACE. Contributed by Chris Nauroth.
(cherry picked from commit 42bbe3794e4a8edef020e08111dbd7f1058938e2)
(cherry picked from commit a3496b7e01d2c7a928170b94ce0b763e63e64e98)
2014-11-07 00:05:54 -08:00
Jing Zhao
a081bdcf63 Revert "HADOOP-11274. ConcurrentModificationException in Configuration Copy Constructor. Contributed by Junping Du."
This reverts commit 16b34824673f5a50d464727b8fad98470e5e984a.
2014-11-06 18:31:18 -08:00
Jing Zhao
bc6bc80251 HADOOP-11274. ConcurrentModificationException in Configuration Copy Constructor. Contributed by Junping Du. 2014-11-06 17:00:42 -08:00
cnauroth
0d573cc4c0 HADOOP-11265. Credential and Key Shell Commands not available on Windows. Contributed by Larry McCay.
(cherry picked from commit a7fbd4e633c18aeeda93c0f013c0a1fcd5963556)
(cherry picked from commit a339fd364664bb9a5b791312846b0f307a1276bc)
2014-11-05 08:45:13 -08:00
Karthik Kambatla
d76756dfe1 Adding release 2.5.2 to CHANGES.txt
(cherry picked from commit 4de56d27fbed566f143b286aa74b16ef94260190)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2014-11-04 16:52:56 -08:00
Karthik Kambatla
c7b3356bfb HADOOP-11260. Patch up Jetty to disable SSLv3. (Mike Yoder via kasha)
(cherry picked from commit dbf30e3c0e1522e6588aecac71c990c0b01fd8fb)
2014-11-04 16:24:09 -08:00
Vinod Kumar Vavilapalli
5d4d11400e HADOOP-11254. Changed visibility of AccessControlList to be public for consumption by ecosystem. Contributed by Zhijie Shen.
(cherry picked from commit b18e8a272eaf69d05d567b8c39e3e7c556935b08)
2014-11-01 11:11:43 -07:00
Zhijie Shen
eb1718b71a HADOOP-11241. Fixed intermittent TestNMSimulator failure due to timing issue. Contributed by Varun Vasudev.
(cherry picked from commit 260ab6d5f462d0fe1a4312cbba1c098141e3870e)
2014-10-31 18:05:05 -07:00
Haohui Mai
2bb845de3c HADOOP-11253. Hadoop streaming test TestStreamXmlMultipleRecords fails on Windows. Contributed by Varun Vasudev. 2014-10-31 11:54:48 -07:00
Haohui Mai
4e419b6ede HADOOP-11247. Fix a couple javac warnings in NFS. Contributed by Brandon Li.
(cherry picked from commit c7d1db7495e772ff81077b3865337838eded025a)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2014-10-30 12:08:50 -07:00
Tsz-Wo Nicholas Sze
c3de2fc1eb HADOOP-11221. IdentityHashStore assumes System.identityHashCode() is non-negative. Contributed by Jinghui Wang 2014-10-30 11:01:03 -07:00
Colin Patrick Mccabe
a4b54dfc84 HADOOP-11250. fix endmacro of set_find_shared_library_without_version in CMakeLists (Yi Liu via Colin P. McCabe)
(cherry picked from commit e488f0d93bf22d25aaaac7a6a88fc300f9aa6d5a)
(cherry picked from commit e107ea5177776bbe14178859a53740f72a46b64b)
2014-10-30 10:38:39 -07:00
yliu
2f313cfaeb HADOOP-11216. Improve Openssl library finding. (cmccabe via yliu) 2014-10-30 10:41:09 +08:00
Jason Lowe
ba86f06cf7 HADOOP-9740. Fix FsShell '-text' command to be able to read Avro files stored in HDFS and other filesystems. Contributed by Allan Yan
(cherry picked from commit 0c15130db2a127ffe2ddc767dc9519567ae8c756)
2014-10-29 20:25:25 +00:00
cnauroth
de1044f48d HADOOP-11068. Match hadoop.auth cookie format to jetty output. Contributed by Gregory Chanan.
(cherry picked from commit 5c900b522e70b512498ab7689f56eb1c5e4b963f)
(cherry picked from commit b4446cb3704439c5b9e6e420bb54dfe2d95f5b19)
2014-10-29 11:24:34 -07:00
Brandon Li
19ec4212d6 HADOOP-11195. Move Id-Name mapping in NFS to the hadoop-common area for better maintenance. Contributed by Yongjun Zhang
(cherry picked from commit 72a556d3b0def0ab4e4509528cc513f6df06b084)
(cherry picked from commit 6caf36f9eb979bcf3fefb285def0480e2c45192a)
2014-10-29 11:10:10 -07:00
Karthik Kambatla
d8212c0b7e HADOOP-11243. SSLFactory shouldn't allow SSLv3. (Wei Yan via kasha)
(cherry picked from commit 3c5f5af1184e85158dec962df0b0bc2be8d0d1e3)
2014-10-28 18:10:06 -07:00
Karthik Kambatla
3e901e63e4 HADOOP-11217. Disable SSLv3 in KMS. (Robert Kanter via kasha)
(cherry picked from commit 1a780823384a9c4289b8bb0b3c73e6b886d78fd0)
2014-10-28 17:34:27 -07:00
Karthik Kambatla
7bb5071a9e HADOOP-11170. ZKDelegationTokenSecretManager fails to renewToken created by a peer. (Arun Suresh and Gregory Chanan via kasha)
(cherry picked from commit db45f047ab6b19d8a3e7752bb2cde10827cd8dad)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2014-10-26 11:28:50 -07:00
Jian He
f236e17216 HADOOP-11228. Winutils task: unsecure path should not call AddNodeManagerAndUserACEsToObject. Contributed by Remus Rusanu
(cherry picked from commit f7e89bb349d4512b47f94b545e3f489a85e851f0)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
(cherry picked from commit 299c9b456de1944181c8a54d9bd6033901718cc1)
2014-10-24 12:58:11 -07:00
Karthik Kambatla
6064b9d02f HADOOP-11122. Fix findbugs in ZK DelegationTokenSecretManagers. (Arun Suresh via kasha)
(cherry picked from commit 70719e5c62f32836914bea88e1ddd99c0ed009e1)
2014-10-22 14:36:06 -07:00