Commit Graph

1983 Commits

Author SHA1 Message Date
Zhe Zhang 30dc4334bf HDFS-8647. Abstract BlockManager's rack policy into BlockPlacementPolicy. Contributed by Brahma Reddy Battula. Branch-2.6 patch contributed by Xiao Chen.
Change-Id: Id08ade6862db1b8caf87ac9d786797d4fa7098a0
2015-12-03 11:01:01 -08:00
Junping Du e710a11a7f Creating 2.6.4 entries in CHANGES.txt files. 2015-12-01 08:28:37 -08:00
Jason Lowe 53dccddfdb MAPREDUCE-6549. multibyte delimiters with LineRecordReader cause duplicate records (wilfreds via rkanter)
(cherry picked from commit 7fd00b3db4)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
2015-11-30 17:51:37 +00:00
Jason Lowe 16e3dc24c5 MAPREDUCE-6481. LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes. Contributed by Zhihai Xu
(cherry picked from commit 58d1a02b8d)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/lib/input/TestLineRecordReader.java
2015-11-23 21:15:14 +00:00
Jason Lowe e307078e78 MAPREDUCE-5948. org.apache.hadoop.mapred.LineRecordReader does not handle multibyte record delimiters well. Contributed by Vinayakumar B, Rushabh Shah, and Akira AJISAKA
(cherry picked from commit 077250d8d7)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestLineRecordReader.java
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/lib/input/TestLineRecordReader.java
2015-11-23 21:07:39 +00:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) 5633fb844a HADOOP-12577. Bumped up commons-collections version to 3.2.2 to address a security flaw. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 70c26703f4)
2015-11-23 10:05:44 -08:00
Sangjin Lee f55e1a4f3e HADOOP-12526. there are duplicate dependency definitions in pom's (sjlee) 2015-11-08 18:00:03 -08:00
Steve Loughran 6165fd8663 HADOOP-10134 [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments.
(cherry picked from commit 2bc3f1064f)
2015-11-08 17:22:46 -08:00
Jason Lowe cab916cc7b HADOOP-12413. AccessControlList should avoid calling getGroupNames in isUserInList with empty groups. Contributed by Zhihai Xu.
(cherry picked from commit b2017d9b03)

Conflicts:

	hadoop-common-project/hadoop-common/CHANGES.txt
2015-11-06 17:12:19 +00:00
cnauroth 0b55634b9c HADOOP-10668. TestZKFailoverControllerStress#testExpireBackAndForth occasionally fails. Contributed by Ming Ma.
(cherry picked from commit 7fc1f2f5cf)
2015-11-05 17:24:51 -08:00
Haohui Mai da70755b4d HADOOP-11267. TestSecurityUtil fails when run with JDK8 because of empty principal names. Contributed by Stephen Chu.
(cherry picked from commit 8549fa5dc9)
2015-11-05 10:37:07 -08:00
cnauroth 46c7a8977a HADOOP-10668. Addendum patch to fix TestZKFailoverController. Contributed by Ming Ma.
(cherry picked from commit 925c9fed33)
2015-11-05 10:31:00 -08:00
Sangjin Lee 8f8f3b1027 Updated the 2.6.2 final release date.
(cherry picked from commit a4a6b5b4b4)
2015-10-30 18:51:50 -07:00
Suresh Srinivas 22095d7a72 HADOOP-9242. Duplicate surefire plugin config in hadoop-common. Contributed by Andrey Klochkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1438213 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 16acd69e58)
2015-10-30 14:38:51 -07:00
Akira Ajisaka eedbd033d3 HADOOP-12230. hadoop-project declares duplicate, conflicting curator dependencies. Contributed by Rakesh R.
(cherry picked from commit 966f9508c3)
(cherry picked from commit 3249c3ce56)
2015-10-30 14:02:44 -07:00
Jason Lowe 0af4f222a1 Creating 2.6.3 entries in CHANGES.txt files.
(cherry picked from commit eadf7b3096)

Conflicts:

	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-mapreduce-project/CHANGES.txt
	hadoop-yarn-project/CHANGES.txt
2015-10-30 14:58:42 +00:00
Sangjin Lee 1d3bed1f94 Set the release date for 2.6.2 2015-10-28 20:57:16 -07:00
Sangjin Lee 6466ead9e0 Preparing for 2.6.3 development 2015-10-21 10:58:06 -07:00
Jian He c09bb46579 YARN-4101. RM should print alert messages if Zookeeper and Resourcemanager gets connection issue. Contributed by Xuan Gong
(cherry picked from commit 214fd1408c21f596d1d15217c11b58b34561aab7)
2015-09-25 16:26:18 -07:00
Vinod Kumar Vavilapalli b99a85139e Creating 2.6.2 entries in CHANGES.txt files.
(cherry picked from commit 33474939a0)
2015-09-25 16:00:06 -07:00
Sangjin Lee 4cb7dbaead Preparing for 2.6.2 development: mvn versions:set -DnewVersion=2.6.2 2015-09-25 15:51:13 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) 41d19f4740 Release process for 2.6.1: Set the release date for 2.6.1 2015-09-23 15:15:36 -07:00
Vinod Kumar Vavilapalli b4d876d837 Set the release date for 2.6.1-RC1 2015-09-16 12:04:57 -07:00
Vinod Kumar Vavilapalli 075d899d10 Set the release date for 2.6.1-RC0 2015-09-09 15:39:02 -07:00
Vinod Kumar Vavilapalli c86d9bd10b Preparing for release 2.6.1: Posting release notes generated. 2015-09-09 15:31:14 -07:00
Vinod Kumar Vavilapalli 3462a00dd2 Preparing for release 2.6.1: mvn versions:set -DnewVersion=2.6.1 2015-09-09 15:29:57 -07:00
Xuan d59bf81e08 YARN-3999. RM hangs on draing events. Contributed by Jian He
(cherry picked from commit 3ae716fa69)
(cherry picked from commit 2ebdf5bfce)
2015-09-08 22:57:35 -07:00
cnauroth c76f5b3188 HADOOP-11934. Use of JavaKeyStoreProvider in LdapGroupsMapping causes infinite loop. Contributed by Larry McCay.
(cherry picked from commit 860b8373c3)
(cherry picked from commit 33648268ce)
2015-09-07 11:09:20 -07:00
Colin Patrick Mccabe 3bd9b7459b HADOOP-12280. Skip unit tests based on maven profile rather than NativeCodeLoader.isNativeCodeLoaded (Masatake Iwasaki via Colin P. McCabe)
(cherry picked from commit 6f83274afc)
(cherry picked from commit e92107b18f)
2015-09-03 15:02:33 -07:00
Jian He d8ddfea491 HADOOP-11932. MetricsSinkAdapter may hang when being stopped. Contributed by Brahma Reddy Battula
(cherry picked from commit f59612edd7)

(cherry picked from commit 5950c1f6f8)
2015-09-03 14:45:04 -07:00
Harsh J 34739fc91e HADOOP-8151. Error handling in snappy decompressor throws invalid exceptions. Contributed by Matt Foley. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389006 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit ac31d6a448)

Conflicts:

	hadoop-common-project/hadoop-common/CHANGES.txt

(cherry picked from commit 55427fb66c)
2015-09-03 14:30:35 -07:00
Vinayakumar B 4f53c98ca4 HADOOP-7139. Allow appending to existing SequenceFiles (Contributed by kanaka kumar avvaru)
(cherry picked from commit 295d678be8)
(cherry picked from commit 80697e4f32)
(cherry picked from commit b3546b6034)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt

(cherry picked from commit e9c8d8c58516aa64589cd44e9e5dd0a23ba72a17)
2015-09-03 14:15:23 -07:00
Gera Shegalov c90f025e90 HADOOP-11491. HarFs incorrectly declared as requiring an authority. (Brahma Reddy Battula via gera)
(cherry picked from commit f343f8657e)
(cherry picked from commit 58970d69de)
2015-09-02 15:16:43 -07:00
Colin Patrick Mccabe 8770f1f039 HADOOP-11802. DomainSocketWatcher thread terminates sometimes after there is an I/O error during requestShortCircuitShm (cmccabe)
(cherry picked from commit a0e0a63209)
(cherry picked from commit 788b76761d)
2015-09-02 14:38:26 -07:00
Steve Loughran e0e93e9f8d HADOOP-11730. Regression: s3n read failure recovery broken. (Takenori Sato via stevel)
(cherry picked from commit a6a5d1d6b5)
2015-09-02 14:01:53 -07:00
Gera Shegalov 736ebeca33 HADOOP-11812. Implement listLocatedStatus for ViewFileSystem to speed up split calculation (gera)
(cherry picked from commit 6d2cf9fbbd)
(cherry picked from commit 1544c63602)
2015-09-02 11:46:47 -07:00
yliu 2230754f2a HADOOP-11710. Make CryptoOutputStream behave like DFSOutputStream wrt synchronization. (Sean Busbey via yliu)
(cherry picked from commit 813c93cb25)
2015-09-01 15:42:37 -07:00
yliu bb1b87f3b8 HADOOP-11674. oneByteBuf in CryptoInputStream and CryptoOutputStream should be non static. (Sean Busbey via yliu)
(cherry picked from commit b569c3ab1c)
2015-09-01 14:28:19 -07:00
Karthik Kambatla 5a6755cc0f YARN-3242. Asynchrony in ZK-close can lead to ZKRMStateStore watcher receiving events for old client. (Zhihai Xu via kasha)
(cherry picked from commit 8d88691d16)
(cherry picked from commit 0d62e94887)
(cherry picked from commit 4a5b0e708d42fbff571229a43d1762d1767e2db5)
2015-09-01 14:06:34 -07:00
cnauroth be4d4c9cbf HDFS-7009. Active NN and standby NN have different live nodes. Contributed by Ming Ma.
(cherry picked from commit 769507bd7a)
(cherry picked from commit 657a6e389b)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDatanodeProtocolRetryPolicy.java

(cherry picked from commit d5ddc3450f2f49ea411de590ff3de15b5ec4e17c)
2015-09-01 11:23:26 -07:00
cnauroth 342504f790 HADOOP-11604. Prevent ConcurrentModificationException while closing domain sockets during shutdown of DomainSocketWatcher thread. Contributed by Chris Nauroth.
(cherry picked from commit 3c5ff0759c)
(cherry picked from commit 187e081d5a)
2015-09-01 11:10:41 -07:00
Kihwal Lee 4ec7b6174d HADOOP-11295. RPC Server Reader thread can't shutdown if RPCCallQueue is full. Contributed by Ming Ma.
(cherry picked from commit 685af8a3d0)
(cherry picked from commit 6c01e58619)
2015-08-31 18:10:00 -07:00
Gera Shegalov bb8a1551c3 HADOOP-11506. Configuration variable expansion regex expensive for long values. (Gera Shegalov via gera)
(cherry picked from commit 644548f201)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/conf/TestConfiguration.java

(cherry picked from commit 3d36d4737c)
2015-08-31 16:00:32 -07:00
Andrew Wang 24da944241 HADOOP-11482. Use correct UGI when KMSClientProvider is called by a proxy user. Contributed by Arun Suresh.
(cherry picked from commit 4b00935643)
(cherry picked from commit 7b69719455)
2015-08-31 15:14:41 -07:00
Haohui Mai 31c99a3dbf HADOOP-11350. The size of header buffer of HttpServer is too small when HTTPS is enabled. Contributed by Benoy Antony.
(cherry picked from commit 2e4df87104)
2015-08-31 12:59:50 -07:00
Colin Patrick Mccabe 1698110acc HADOOP-11238. Update the NameNode's Group Cache in the background when possible (Chris Li via Colin P. McCabe)
(cherry picked from commit e5a6925199)

(cherry picked from commit b521d91c0f)
2015-08-30 19:47:15 -07:00
Andrew Wang 2a2888f2f3 HADOOP-11368. Fix SSLFactory truststore reloader thread leak in KMSClientProvider. Contributed by Arun Suresh.
(cherry picked from commit 74d4bfded9)
(cherry picked from commit deaa172e7a)
2015-08-30 13:41:40 -07:00
Andrew Wang 65180617fb HADOOP-11343. Overflow is not properly handled in caclulating final iv for AES CTR. Contributed by Jerry Chen.
(cherry picked from commit 0707e4eca9)
(cherry picked from commit dabdd2d746)
2015-08-30 13:31:43 -07:00
Colin Patrick Mccabe bfc0a19d6d HADOOP-11333. Fix deadlock in DomainSocketWatcher when the notification pipe is full (zhaoyunjiong via cmccabe)
(cherry picked from commit 86e3993def)

(cherry picked from commit f6d1bf5ed1)
2015-08-27 19:18:45 -07:00
Vinayakumar B d6666e8d26 HADOOP-10786. Fix UGI#reloginFromKeytab on Java 8. Contributed by Stephen Chu.
Moved CHANGES.txt entry to 2.6.1

(cherry picked from commit d6050f06a3b7e049541b1cb4597c388abf00a5be)
2015-08-27 18:18:32 -07:00