Commit Graph

10764 Commits

Author SHA1 Message Date
Masatake Iwasaki 2dd80938a2 HDFS-9700. DFSClient and DFSOutputStream should set TCP_NODELAY on sockets for DataTransferProtocol (Gary Helmling via iwasakims)
(cherry picked from commit 372d1302c6)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/impl/DfsClientConf.java

(cherry picked from commit f71fa500f9)
2016-02-13 03:34:07 +09:00
Akira Ajisaka df23f9c49d HDFS-9768. Reuse ObjectMapper instance in HDFS to improve the performance. Contributed by Lin Yiqun.
(cherry picked from commit e6a7044b85)
(cherry picked from commit a714d04f5d)
2016-02-13 02:04:22 +09:00
Steve Loughran 706351afb8 YARN-4682. AMRM client to log when AMRM token updated. (Prabhu Joseph via stevel) 2016-02-12 10:58:09 +00:00
Vinayakumar B 26934cf6c7 HADOOP-12776. Remove getaclstatus call for non-acl commands in getfacl. (Contributed by Brahma Reddy Battula)
(cherry picked from commit c78740a979)
(cherry picked from commit 488e6cbe16)
2016-02-12 11:56:00 +05:30
Arpit Agarwal 58d4c045e6 HDFS-9790. HDFS Balancer should exit with a proper message if upgrade is not finalized (Contributed by Xiaobing Zhou) 2016-02-11 20:40:49 -08:00
Andrew Wang 9afa321fd2 HADOOP-12699. TestKMS#testKMSProvider intermittently fails during 'test rollover draining'. Contributed by Xiao Chen.
(cherry picked from commit 8fdef0bd9d)
(cherry picked from commit fb57c01eaa)
2016-02-11 17:21:55 -08:00
cnauroth ddd82d24be HADOOP-12795. KMS does not log detailed stack trace for unexpected errors. Contributed by Chris Nauroth.
(cherry picked from commit 70c756d35e)
(cherry picked from commit 25dcb88630)
2016-02-11 16:53:21 -08:00
Arun Suresh 379c2f4c05 YARN-2575. Create separate ACLs for Reservation create/update/delete/list ops (Sean Po via asuresh) 2016-02-11 15:54:45 -08:00
Zhe Zhang 66a19d675e Add HADOOP-12764 to CHANGES.txt.
Change-Id: Ie32b71b7bd8892a3bb434aec12cdf2c43c61b897
2016-02-11 09:35:06 -08:00
Zhe Zhang 9023751de6 HADOOP-12764. Increase default value of KMS maxHttpHeaderSize and make it configurable. (zhz)
Change-Id: Iabb766f6311b83a1ac03093b0ba26a0284b74d70
2016-02-11 09:29:45 -08:00
Jian He fc06ae38ca YARN-4138. Roll back container resource allocation after resource increase token expires. Contributed by Meng Ding 2016-02-11 10:42:45 +08:00
Jian He 145add1aec YARN-4519. Potential deadlock of CapacityScheduler between decrease container and assign containers. Contributed Meng Ding 2016-02-11 10:30:02 +08:00
Andrew Wang 47746f65b0 HDFS-9788. Incompatible tag renumbering in HeartbeatResponseProto.
(cherry picked from commit aeb13ef2ab)
(cherry picked from commit d489570755)
2016-02-10 15:26:34 -08:00
Uma Maheswara Rao G 4324a3d012 HADOOP-12788. OpensslAesCtrCryptoCodec should log which random number generator is used. Contributed by Wei-Chiu Chuang.
(cherry picked from commit df4dcd3e75)
2016-02-10 15:07:33 -08:00
= 9220bb649b YARN-4420. Add REST API for List Reservations. (Sean Po via curino)
(cherry picked from commit fc9eb4577c)
2016-02-10 14:41:38 -08:00
Jason Lowe cad1436570 HADOOP-12792. TestUserGroupInformation#testGetServerSideGroups fails in chroot. Contributed by Eric Badger
(cherry picked from commit 6f03959e4d)
2016-02-10 21:55:53 +00:00
Arun Suresh 685aeeb1a7 YARN-4360. Improve GreedyReservationAgent to support "early" allocations, and performance improvements (curino via asuresh)
(cherry picked from commit 5cf5c41a89)
2016-02-10 09:13:31 -08:00
Jason Lowe 83985eed2a MAPREDUCE-6191. Improve clearing stale state of Java serialization
testcase.  (Sam Liu via Eric Yang)
(cherry picked from commit c379e102dd)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
(cherry picked from commit 303c650d0d)
2016-02-10 16:46:58 +00:00
Akira Ajisaka 811ab1bf94 HDFS-9686. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta.
(cherry picked from commit 802a7edfae)
(cherry picked from commit a60a0a7128)
2016-02-10 23:50:16 +09:00
Akira Ajisaka 321da0604a Revert "HDFS-9686. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta."
This reverts commit 3f8a30c956.
2016-02-10 23:45:44 +09:00
Uma Maheswara Rao G de24588ca2 HDFS-9779 . TestReplicationPolicyWithNodeGroup NODE variable picks wrong rack value. Contributed by Kuhu Shukla.
(cherry picked from commit a7fce9ab41)
2016-02-09 15:18:07 -08:00
Allen Wittenauer dc325ee550 HDFS-9760. WebHDFS AuthFilter cannot be configured with custom AltKerberos auth handler (Ryan Sasson via aw) 2016-02-09 14:16:02 -08:00
Akira Ajisaka e4769775b0 HDFS-9784. Example usage is not correct in Transparent Encryption document. Contributed by Ohnishi Takashi.
(cherry picked from commit 60d2011b7c)
(cherry picked from commit cb53dfcc95)
2016-02-10 03:30:56 +09:00
Akira Ajisaka f943bf0e22 MAPREDUCE-6626. Reuse ObjectMapper instance in MapReduce. Contributed by Lin Yiqun.
(cherry picked from commit 10393d9a666419a5d8dc0cfb48da96e9c690c11e)
(cherry picked from commit 8cbe65a07dd0deb150e91b13e3a1cec13e3716ee)
2016-02-10 03:05:23 +09:00
Jason Lowe 5d653a3fd1 Update CHANGES.txt to reflect recent commits to branch-2.7 and branch-2.6.
(cherry picked from commit fba6e9f5ef)
2016-02-09 16:56:12 +00:00
zhezhang 3257ce73bd HDFS-9244. Support nested encryption zones.
Change-Id: I43a13035a8b27956e90967ee82058efb647c3415
2016-02-08 16:32:11 -08:00
Uma Maheswara Rao G 3399119e72 HDFS-9777. Fix typos in DFSAdmin command line and documentation.(Wei-Chiu Chuang via umamahesh)
(cherry picked from commit bffaa38a91)
2016-02-08 14:12:52 -08:00
Sangjin Lee 13bb016ba9 HADOOP-12773. HBase classes fail to load with client/job classloader enabled (sjlee)
(cherry picked from commit 58acbf940a)
2016-02-08 13:59:10 -08:00
Kihwal Lee aae0f183af HDFS-9752. Permanent write failures may happen to slow writers during datanode rolling upgrades. Contributed by Walter Su.
(cherry picked from commit 193d27de0a)
2016-02-08 12:17:39 -06:00
cnauroth 44c6277d01 HADOOP-12752. Improve diagnostics/use of envvar/sysprop credential propagation. Contributed by Steve Loughran.
(cherry picked from commit cf3261570a)
(cherry picked from commit a76611d4ec)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2016-02-08 09:36:58 -08:00
Devaraj K 35651bab99 YARN-4667. RM Admin CLI for refreshNodesResources throws NPE when nothing
is configured. Contributed by Naganarasimha G R.

(cherry picked from commit 565af873d5)
2016-02-08 15:04:15 +05:30
Uma Maheswara Rao G 5690e11206 HDFS-9713. DataXceiver#copyBlock should return if block is pinned. Contributed by Uma Maheswara Rao G.
(cherry picked from commit aea31eee78)
2016-02-07 20:59:35 -08:00
Steve Loughran f4bcc76df6 HADOOP-12292. Make use of DeleteObjects optional. (Thomas Demoor via stevel) 2016-02-06 18:17:30 +00:00
Akira Ajisaka 3f8a30c956 HDFS-9686. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta.
(cherry picked from commit fe124da5ff)
(cherry picked from commit e4c01b8b1c)
2016-02-06 19:33:11 +09:00
cnauroth be115634f2 HADOOP-12426. Add Entry point for Kerberos health check. Contributed by Steve Loughran.
(cherry picked from commit cfa8513890)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/conf/hadoop-env.sh

(cherry picked from commit 4db6cc44cd)
2016-02-05 15:52:26 -08:00
cnauroth bad8006da1 HDFS-9761. Rebalancer sleeps too long between iterations. Contributed by Mingliang Liu.
(cherry picked from commit c6497949e8)
(cherry picked from commit a7232f5e1d)
2016-02-05 15:08:07 -08:00
cnauroth e01d8393b6 HADOOP-12758. Extend CSRF Filter with UserAgent Checks. Contributed by Larry McCay.
(cherry picked from commit a37e423e84)
(cherry picked from commit 5752df2362)
2016-02-05 14:38:40 -08:00
Kihwal Lee 150240cce0 HADOOP-12772. NetworkTopologyWithNodeGroup.getNodeGroup() can loop infinitely for invalid 'loc' values. Contributed by Kuhu Shukla.
(cherry picked from commit 49e176c29f)
2016-02-05 15:48:32 -06:00
Colin Patrick Mccabe 4fb2a098f4 HADOOP-12766. The default value of "hadoop.workaround.non.threadsafe.getpwuid" is different between core-default.xml and NativeIO.java (Akira AJISAKA via cmccabe)
(cherry picked from commit 9086dd58c3)
(cherry picked from commit 86760c0f52)
2016-02-05 10:58:39 -08:00
Xiaoyu Yao 740a1385d2 HADOOP-12771. Fix typo in JvmPauseMonitor#getNumGcWarnThreadholdExceeded. Contributed by Xiaobing Zhou.
(cherry picked from commit 5d00067ca7)
2016-02-05 10:41:02 -08:00
Tsz-Wo Nicholas Sze 494b6c7c4b HDFS-9726. Refactor IBR code to a new class. 2016-02-05 23:22:17 +08:00
Haohui Mai fdb89ac0ae HDFS-9724. Degraded performance in WebHDFS listing as it does not reuse ObjectMapper. Contributed by Akira Ajisaka. 2016-02-04 13:41:14 -08:00
Kihwal Lee 6090211872 HDFS-9730. Storage ID update does not happen when there is a layout change. Contributed by Tsz Wo Nicholas Sze.
(cherry picked from commit 496f33de0c)
2016-02-04 13:22:05 -06:00
Vinayakumar B adadc220fa HDFS-9629. Update the footer of Web UI to show year 2016 (Contributed by Xiao Chen and Vinayakumar B)
(cherry picked from commit ddcd6954d03d3caadc8b69f7b886a3a17c3c9d0c)
(cherry picked from commit 8cdfdbf815bf89eee3184ec7cd00e1924c1ea316)
2016-02-04 13:19:53 +05:30
Xuan acd90c6819 YARN-4662. Document some newly added metrics. Contributed by Jian He
(cherry picked from commit 63c63e298c)
(cherry picked from commit dfad608b22)
2016-02-03 20:06:57 -08:00
Konstantin V Shvachko 3f178be0bd HDFS-9503. Use generic option -fs for NNThroughputBenchmark instead of -namenode. Contributed by Mingliang Liu. 2016-02-03 14:45:09 -08:00
Masatake Iwasaki 5fd4bd1d8c HDFS-9601. NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding block (iwasakims) 2016-02-03 14:29:06 -08:00
Jing Zhao a79f570b6c HDFS-9748. Avoid duplication in pendingReplications when addExpectedReplicasToPending is called twice. Contributed by Walter Su.
(cherry picked from commit 7badf15604)
(cherry picked from commit 459c31de4a)
2016-02-03 13:33:59 -08:00
Sangjin Lee b49ac969bc HADOOP-12761. incremental maven build is not really incremental (sjlee)
(cherry picked from commit 4dc0a39493)
2016-02-03 09:02:02 -08:00
Vinayakumar B c2ec241989 HDFS-9740. Use a reasonable limit in DFSTestUtil.waitForMetric() (Contributed by Chang Li)
(cherry picked from commit eb2fb943fd)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java

(cherry picked from commit 6941e2ccbf)
2016-02-03 11:21:42 +05:30