Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,759 Commits 326 Branches 371 Tags
Commit Graph

10759 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Andrew Wang
9afa321fd2 HADOOP-12699. TestKMS#testKMSProvider intermittently fails during 'test rollover draining'. Contributed by Xiao Chen. 
(cherry picked from commit 8fdef0bd9d1ece560ab4e1a1ec7fc77c46a034bb)
(cherry picked from commit fb57c01eaaf572dee59e91e75d59237cf540d6d1)
 2016-02-11 17:21:55 -08:00
cnauroth
ddd82d24be HADOOP-12795. KMS does not log detailed stack trace for unexpected errors. Contributed by Chris Nauroth. 
(cherry picked from commit 70c756d35e6ed5608ce82d1a6fbfb02e19af5ecf)
(cherry picked from commit 25dcb88630eb4a6c30db4f20323beeb7fd2584cc)
 2016-02-11 16:53:21 -08:00
Arun Suresh
379c2f4c05 YARN-2575. Create separate ACLs for Reservation create/update/delete/list ops (Sean Po via asuresh) 2016-02-11 15:54:45 -08:00
Zhe Zhang
66a19d675e Add HADOOP-12764 to CHANGES.txt. 
Change-Id: Ie32b71b7bd8892a3bb434aec12cdf2c43c61b897
 2016-02-11 09:35:06 -08:00
Zhe Zhang
9023751de6 HADOOP-12764. Increase default value of KMS maxHttpHeaderSize and make it configurable. (zhz) 
Change-Id: Iabb766f6311b83a1ac03093b0ba26a0284b74d70
 2016-02-11 09:29:45 -08:00
Jian He
fc06ae38ca YARN-4138. Roll back container resource allocation after resource increase token expires. Contributed by Meng Ding 2016-02-11 10:42:45 +08:00
Jian He
145add1aec YARN-4519. Potential deadlock of CapacityScheduler between decrease container and assign containers. Contributed Meng Ding 2016-02-11 10:30:02 +08:00
Andrew Wang
47746f65b0 HDFS-9788. Incompatible tag renumbering in HeartbeatResponseProto. 
(cherry picked from commit aeb13ef2ab657a1c2f9d9ed5f80783f788c4953a)
(cherry picked from commit d48957075591e0c308da79eaa5412ca8f6f73c8a)
 2016-02-10 15:26:34 -08:00
Uma Maheswara Rao G
4324a3d012 HADOOP-12788. OpensslAesCtrCryptoCodec should log which random number generator is used. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit df4dcd3e75f1f935bd9a537e63758fee71cf4e02)
 2016-02-10 15:07:33 -08:00
=
9220bb649b YARN-4420. Add REST API for List Reservations. (Sean Po via curino) 
(cherry picked from commit fc9eb4577cdfd44cb99b933eae15f4794494836b)
 2016-02-10 14:41:38 -08:00
Jason Lowe
cad1436570 HADOOP-12792. TestUserGroupInformation#testGetServerSideGroups fails in chroot. Contributed by Eric Badger 
(cherry picked from commit 6f03959e4dc0bc11030fd7e30a025447a4d6948a)
 2016-02-10 21:55:53 +00:00
Arun Suresh
685aeeb1a7 YARN-4360. Improve GreedyReservationAgent to support "early" allocations, and performance improvements (curino via asuresh) 
(cherry picked from commit 5cf5c41a895f5ab8bf6270089f8cfdea50573a97)
 2016-02-10 09:13:31 -08:00
Jason Lowe
83985eed2a MAPREDUCE-6191. Improve clearing stale state of Java serialization 
testcase.  (Sam Liu via Eric Yang)
(cherry picked from commit c379e102ddab1b83fd69e4492a40c9901fb50675)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
(cherry picked from commit 303c650d0dfcb10760cea589b8cef6ace8e36417)
 2016-02-10 16:46:58 +00:00
Akira Ajisaka
811ab1bf94 HDFS-9686. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta. 
(cherry picked from commit 802a7edfaed778daaa471ee96466c6d69b35934c)
(cherry picked from commit a60a0a7128d23523cde2a80bc8576ae194162fc5)
 2016-02-10 23:50:16 +09:00
Akira Ajisaka
321da0604a Revert "HDFS-9686. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta." 
This reverts commit 3f8a30c956d464b86f91be3f0136ed7e15604f02.
 2016-02-10 23:45:44 +09:00
Uma Maheswara Rao G
de24588ca2 HDFS-9779 . TestReplicationPolicyWithNodeGroup NODE variable picks wrong rack value. Contributed by Kuhu Shukla. 
(cherry picked from commit a7fce9ab415fcc834ca1d91f913157ffd103fa5f)
 2016-02-09 15:18:07 -08:00
Allen Wittenauer
dc325ee550 HDFS-9760. WebHDFS AuthFilter cannot be configured with custom AltKerberos auth handler (Ryan Sasson via aw) 2016-02-09 14:16:02 -08:00
Akira Ajisaka
e4769775b0 HDFS-9784. Example usage is not correct in Transparent Encryption document. Contributed by Ohnishi Takashi. 
(cherry picked from commit 60d2011b7c0fe55b8bc44a141660d3e2df37a68d)
(cherry picked from commit cb53dfcc95ca9f6c45482600b52758bc096810b9)
 2016-02-10 03:30:56 +09:00
Akira Ajisaka
f943bf0e22 MAPREDUCE-6626. Reuse ObjectMapper instance in MapReduce. Contributed by Lin Yiqun. 
(cherry picked from commit 10393d9a666419a5d8dc0cfb48da96e9c690c11e)
(cherry picked from commit 8cbe65a07dd0deb150e91b13e3a1cec13e3716ee)
 2016-02-10 03:05:23 +09:00
Jason Lowe
5d653a3fd1 Update CHANGES.txt to reflect recent commits to branch-2.7 and branch-2.6. 
(cherry picked from commit fba6e9f5ef3d032986888117b3e53808e7dcf873)
 2016-02-09 16:56:12 +00:00
zhezhang
3257ce73bd HDFS-9244. Support nested encryption zones. 
Change-Id: I43a13035a8b27956e90967ee82058efb647c3415
 2016-02-08 16:32:11 -08:00
Uma Maheswara Rao G
3399119e72 HDFS-9777. Fix typos in DFSAdmin command line and documentation.(Wei-Chiu Chuang via umamahesh) 
(cherry picked from commit bffaa38a91b26920206a3350bf1cd60ec950aa74)
 2016-02-08 14:12:52 -08:00
Sangjin Lee
13bb016ba9 HADOOP-12773. HBase classes fail to load with client/job classloader enabled (sjlee) 
(cherry picked from commit 58acbf940a92ef8a761208a7a743175ee7b3377d)
 2016-02-08 13:59:10 -08:00
Kihwal Lee
aae0f183af HDFS-9752. Permanent write failures may happen to slow writers during datanode rolling upgrades. Contributed by Walter Su. 
(cherry picked from commit 193d27de0a5d23a61cabd41162ebc3292d8526d1)
 2016-02-08 12:17:39 -06:00
cnauroth
44c6277d01 HADOOP-12752. Improve diagnostics/use of envvar/sysprop credential propagation. Contributed by Steve Loughran. 
(cherry picked from commit cf3261570ae139c177225af165557038a9280a5d)
(cherry picked from commit a76611d4ec8f78faae436d7bdff31f4ae6d0d6fd)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2016-02-08 09:36:58 -08:00
Devaraj K
35651bab99 YARN-4667. RM Admin CLI for refreshNodesResources throws NPE when nothing 
is configured. Contributed by Naganarasimha G R.

(cherry picked from commit 565af873d5e9bc4178f1221805765a417f065192)
 2016-02-08 15:04:15 +05:30
Uma Maheswara Rao G
5690e11206 HDFS-9713. DataXceiver#copyBlock should return if block is pinned. Contributed by Uma Maheswara Rao G. 
(cherry picked from commit aea31eee78a287f251447686ba3f5bbcfe9c60a3)
 2016-02-07 20:59:35 -08:00
Steve Loughran
f4bcc76df6 HADOOP-12292. Make use of DeleteObjects optional. (Thomas Demoor via stevel) 2016-02-06 18:17:30 +00:00
Akira Ajisaka
3f8a30c956 HDFS-9686. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta. 
(cherry picked from commit fe124da5ffc16e4795c3dd5542accd58361e1b08)
(cherry picked from commit e4c01b8b1ce511de24db00afacef1e737845a4f7)
 2016-02-06 19:33:11 +09:00
cnauroth
be115634f2 HADOOP-12426. Add Entry point for Kerberos health check. Contributed by Steve Loughran. 
(cherry picked from commit cfa8513890ec1cd7f71258ff3c3083f6d89a4fc4)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/conf/hadoop-env.sh

(cherry picked from commit 4db6cc44cd1f1b2692ad3fdc18798cf5f32250ec)
 2016-02-05 15:52:26 -08:00
cnauroth
bad8006da1 HDFS-9761. Rebalancer sleeps too long between iterations. Contributed by Mingliang Liu. 
(cherry picked from commit c6497949e866594050153b953a85c0a1db59d2f8)
(cherry picked from commit a7232f5e1d20faf210f3718c551cbae4edb5933c)
 2016-02-05 15:08:07 -08:00
cnauroth
e01d8393b6 HADOOP-12758. Extend CSRF Filter with UserAgent Checks. Contributed by Larry McCay. 
(cherry picked from commit a37e423e8407c42988577d87907d13ce0432dda1)
(cherry picked from commit 5752df23622495cd288747e61b3644c4137251db)
 2016-02-05 14:38:40 -08:00
Kihwal Lee
150240cce0 HADOOP-12772. NetworkTopologyWithNodeGroup.getNodeGroup() can loop infinitely for invalid 'loc' values. Contributed by Kuhu Shukla. 
(cherry picked from commit 49e176c29f95c179c0f6b07d4d582e6a771a96bd)
 2016-02-05 15:48:32 -06:00
Colin Patrick Mccabe
4fb2a098f4 HADOOP-12766. The default value of "hadoop.workaround.non.threadsafe.getpwuid" is different between core-default.xml and NativeIO.java (Akira AJISAKA via cmccabe) 
(cherry picked from commit 9086dd58c3fc391ffdc017a913e56d1801040c7a)
(cherry picked from commit 86760c0f528ed50cf6211ba6592f6f226b085b90)
 2016-02-05 10:58:39 -08:00
Xiaoyu Yao
740a1385d2 HADOOP-12771. Fix typo in JvmPauseMonitor#getNumGcWarnThreadholdExceeded. Contributed by Xiaobing Zhou. 
(cherry picked from commit 5d00067ca7f1460bbda1330e7329205a7b1ce019)
 2016-02-05 10:41:02 -08:00
Tsz-Wo Nicholas Sze
494b6c7c4b HDFS-9726. Refactor IBR code to a new class. 2016-02-05 23:22:17 +08:00
Haohui Mai
fdb89ac0ae HDFS-9724. Degraded performance in WebHDFS listing as it does not reuse ObjectMapper. Contributed by Akira Ajisaka. 2016-02-04 13:41:14 -08:00
Kihwal Lee
6090211872 HDFS-9730. Storage ID update does not happen when there is a layout change. Contributed by Tsz Wo Nicholas Sze. 
(cherry picked from commit 496f33de0ce80dc455cfd51f19612da6f9b914f9)
 2016-02-04 13:22:05 -06:00
Vinayakumar B
adadc220fa HDFS-9629. Update the footer of Web UI to show year 2016 (Contributed by Xiao Chen and Vinayakumar B) 
(cherry picked from commit ddcd6954d03d3caadc8b69f7b886a3a17c3c9d0c)
(cherry picked from commit 8cdfdbf815bf89eee3184ec7cd00e1924c1ea316)
 2016-02-04 13:19:53 +05:30
Xuan
acd90c6819 YARN-4662. Document some newly added metrics. Contributed by Jian He 
(cherry picked from commit 63c63e298cf9ff252532297deedde15e77323809)
(cherry picked from commit dfad608b22b5b90f4a13a14fc8786c24c7dacbb9)
 2016-02-03 20:06:57 -08:00
Konstantin V Shvachko
3f178be0bd HDFS-9503. Use generic option -fs for NNThroughputBenchmark instead of -namenode. Contributed by Mingliang Liu. 2016-02-03 14:45:09 -08:00
Masatake Iwasaki
5fd4bd1d8c HDFS-9601. NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding block (iwasakims) 2016-02-03 14:29:06 -08:00
Jing Zhao
a79f570b6c HDFS-9748. Avoid duplication in pendingReplications when addExpectedReplicasToPending is called twice. Contributed by Walter Su. 
(cherry picked from commit 7badf156049b78cabf8537fff9846a0f9924a090)
(cherry picked from commit 459c31de4a0db322f7a27a9b80dc3b2eecfa470d)
 2016-02-03 13:33:59 -08:00
Sangjin Lee
b49ac969bc HADOOP-12761. incremental maven build is not really incremental (sjlee) 
(cherry picked from commit 4dc0a3949386ce2961356143a5a843dd537829dc)
 2016-02-03 09:02:02 -08:00
Vinayakumar B
c2ec241989 HDFS-9740. Use a reasonable limit in DFSTestUtil.waitForMetric() (Contributed by Chang Li) 
(cherry picked from commit eb2fb943fd97c191fd7c4f5333087a28ee5c87d8)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java

(cherry picked from commit 6941e2ccbf6f4c7c8663a68c7a7c9ed59bb49fbf)
 2016-02-03 11:21:42 +05:30
Vinayakumar B
e045856eda HDFS-9739. DatanodeStorage.isValidStorageId() is broken (Contributed by Mingliang Liu) 
(cherry picked from commit d6b1acb940180befeb4c855d0e4a339dbc035e7d)
(cherry picked from commit e8a9a69a2756f998f08c7b8452b84fd309921443)
 2016-02-03 10:34:35 +05:30
Junping Du
847158811b Adding release 2.6.5 to CHANGES.txt 2016-02-02 18:36:39 -08:00
Vinayakumar B
bf2936fd38 HDFS-9715. Check storage ID uniqueness on datanode startup (Contributed by Lei (Eddy) Xu) 
(cherry picked from commit 04375756a5ed6e907ee7548469c2c508aebbafb7)
(cherry picked from commit 8577c0b6a2bc7e4966866eac2bd1f2a112d0a7c1)
 2016-02-03 07:42:18 +05:30
Tsz-Wo Nicholas Sze
0ad3c51dfb HDFS-8999. Allow a file to be closed with COMMITTED but not yet COMPLETE blocks. 
(cherry picked from commit b10d8ced21a860390c46e7729a02b81d9f7b88e6)
 2016-02-03 07:41:06 +05:30
Andrew Wang
1d15c90233 HADOOP-12755. Fix typo in defaultFS warning message. 
(cherry picked from commit 8171874dd198a6d10f48211f311595b222e6b930)
(cherry picked from commit b4ad58796b70954804ad96f0c15381ad13e7a8ea)
 2016-02-02 11:57:00 -08:00