Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,933 Commits 326 Branches 371 Tags
Commit Graph

10933 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Xiaoyu Yao
5ff2012f64 HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou. 
(cherry picked from commit fe5624b85d71720ae9da90a01cad9a3d1ea41160)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/DatanodeHttpServer.java

(cherry picked from commit ad4fcd1f9f84cfef8dc8bb48ef7fbdd5c7c20c6a)
 2016-02-17 16:05:24 -08:00
Zhe Zhang
64d39b83cc HDFS-9799. Reimplement getCurrentTrashDir to remove incompatibility. (zhz) 
Change-Id: I7834bcebffed38cb384db5395ddb8b6dd9e79a0b
 2016-02-17 13:32:18 -08:00
cnauroth
26ce37a1a6 HADOOP-12548. Read s3a creds from a Credential Provider. Contributed by Larry McCay. 
(cherry picked from commit 76fab26c5c02cef38924d04136407489fd9457d9)

Conflicts:
	hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java

(cherry picked from commit 6731bb468dab743e0546e8e0fbbefaf46a1729c2)
 2016-02-17 12:20:49 -08:00
Haohui Mai
b318429ac9 HDFS-9815. Move o.a.h.fs.Hdfs to hadoop-hdfs-client. Contributed by Vinayakumar B. 2016-02-17 10:59:50 -08:00
Xiaoyu Yao
5953421544 HADOOP-12878. KMS SPNEGO sequence does not work with WEBHDFS. Contributed by Xiaoyu Yao. 
(cherry picked from commit fd1befb6ba450e45b1fcb3fb28b0da6c48daf6b3)
 2016-02-17 08:47:30 -08:00
Tsuyoshi Ozawa
7ccb0e0601 MAPREDUCE-6341. addendum patch to fix typos. Contributed by John Michael Luy. 
(cherry picked from commit 453e7e0d1091cf795152c8992c6c5cbc772d80d6)
 2016-02-17 14:18:24 +09:00
Vinayakumar B
e88c01fa58 HADOOP-12810. FileSystem#listLocatedStatus causes unnecessary RPC calls (Contributed by Ryan Blue) 
(cherry picked from commit 96ea3094315bb1e1a5e268e3817c7fdedc3e9462)
(cherry picked from commit 2bf5a005fab287689a148c1928f3b04c0a8dcedf)
 2016-02-17 10:15:43 +05:30
Junping Du
c7be3deff7 HDFS-9456. BlockPlacementPolicyWithNodeGroup should override verifyBlockPlacement(). Contributed by Xiaobing Zhou. 
(cherry picked from commit 77ba5add0d9cb10d45ca9122bca48baa7c8fb3b8)
(cherry picked from commit 6874a142d8a9be25801636db7ade3d3216fd6df8)
 2016-02-16 19:09:02 -08:00
Vinayakumar B
8d6fb15b03 HADOOP-12805. Annotate CanUnbuffer with @InterfaceAudience.Public (Contributed by Ted Yu) 
(cherry picked from commit 4b0e59fdc010be517dd67ddf35c962da204df547)
(cherry picked from commit e79a5e4460b5199eebb0d788fdc1eaa36d6b0ac4)
 2016-02-16 17:33:44 +05:30
Akira Ajisaka
19c149cdb9 HDFS-9765. TestBlockScanner#testVolumeIteratorWithCaching fails intermittently. (aajisaka) 
(cherry picked from commit 8ed07bd3e6b6a8af3b82e9a085c74be29f8dfd87)
(cherry picked from commit 8dec72bfd73174bdc2dfa8ce845b28af48a6bca4)
 2016-02-15 19:09:51 +09:00
Akira Ajisaka
4d1c23f55c HDFS-9773. Remove dead code related to SimulatedFSDataset in tests. Contributed by Brahma Reddy Battula. 
(cherry picked from commit b0738ae673e4a95060b33498c049cd7790d6e371)
(cherry picked from commit 5e78264cde3e141ed9809b9d2d4fc2e3f99b1788)
 2016-02-15 15:35:35 +09:00
Akira Ajisaka
bb02c3c803 HADOOP-12786. "hadoop key" command usage is not documented. Contributed by Xiao Chen. 
(cherry picked from commit 1c48e50ce71fd0e38740d69ce1e03119dca97a38)
(cherry picked from commit a670165bbd743f8271375b67236b00e95ae238a1)
 2016-02-15 11:39:09 +09:00
Jian He
e25d82bbc2 YARN-4653. Document YARN security model from the perspective of Application Developers. Contributed by Steve Loughran 2016-02-14 17:15:18 +08:00
Junping Du
aed60ae0bf Set the release date for 2.6.4. 
(cherry picked from commit ec12ce8f48944c38271399a6e452aa2c2a9f5b80)
(cherry picked from commit a28be9edc72cc4fe42fab107c17bcac6789af4e5)

Conflicts:

	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2016-02-13 01:48:50 -08:00
Masatake Iwasaki
e0fccc9c94 HADOOP-12589. Fix intermittent test failure of TestCopyPreserveFlag (iwasakims) 
(cherry picked from commit 36ba5cac37dee6b60e607401ac06d263e4ac5d8f)
 2016-02-13 15:02:15 +09:00
cnauroth
b846401307 HADOOP-12780. During WASB atomic rename handle crash when one directory has been renamed but not file under it. Contributed by Madhumita Chakraborty. 
(cherry picked from commit 91a96eaa534dbb27e81b6c24bbb8138200a80a83)
(cherry picked from commit ac5a7935901255e5fc56b88574e72f875942b906)
 2016-02-12 15:50:28 -08:00
Arpit Agarwal
8c1cf718aa HDFS-9801. ReconfigurableBase should update the cached configuration. (Arpit Agarwal) 2016-02-12 12:41:20 -08:00
Arun Suresh
4d7da8907f HDFS-9797. Log Standby exceptions thrown by RequestHedgingProxyProvider at DEBUG Level (Inigo Goiri via asuresh) 
(cherry picked from commit 9fdfb546fb67526ba261da5cbd005f33e0f1d9e1)
 2016-02-12 11:21:16 -08:00
Zhe Zhang
f72cfc416a HDFS-9644. Update encryption documentation to reflect nested EZs. (zhz) 
Change-Id: I84ae96f4711a16ded46d501c51ca322bfca5151d
 2016-02-12 10:49:41 -08:00
Masatake Iwasaki
2dd80938a2 HDFS-9700. DFSClient and DFSOutputStream should set TCP_NODELAY on sockets for DataTransferProtocol (Gary Helmling via iwasakims) 
(cherry picked from commit 372d1302c63c6f49f99be5766c5da9647ebd9ca6)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/impl/DfsClientConf.java

(cherry picked from commit f71fa500f9a43d928fbd27c873544898bff50dd4)
 2016-02-13 03:34:07 +09:00
Akira Ajisaka
df23f9c49d HDFS-9768. Reuse ObjectMapper instance in HDFS to improve the performance. Contributed by Lin Yiqun. 
(cherry picked from commit e6a7044b8530afded8f8e86ff309dd0e4d39238a)
(cherry picked from commit a714d04f5d8eaba34a24ee9454ceaec68ab00a15)
 2016-02-13 02:04:22 +09:00
Steve Loughran
706351afb8 YARN-4682. AMRM client to log when AMRM token updated. (Prabhu Joseph via stevel) 2016-02-12 10:58:09 +00:00
Vinayakumar B
26934cf6c7 HADOOP-12776. Remove getaclstatus call for non-acl commands in getfacl. (Contributed by Brahma Reddy Battula) 
(cherry picked from commit c78740a979c1b434c6595b302bd376fc3d432509)
(cherry picked from commit 488e6cbe16140f8e93bbf9a4c512211680c21777)
 2016-02-12 11:56:00 +05:30
Arpit Agarwal
58d4c045e6 HDFS-9790. HDFS Balancer should exit with a proper message if upgrade is not finalized (Contributed by Xiaobing Zhou) 2016-02-11 20:40:49 -08:00
Andrew Wang
9afa321fd2 HADOOP-12699. TestKMS#testKMSProvider intermittently fails during 'test rollover draining'. Contributed by Xiao Chen. 
(cherry picked from commit 8fdef0bd9d1ece560ab4e1a1ec7fc77c46a034bb)
(cherry picked from commit fb57c01eaaf572dee59e91e75d59237cf540d6d1)
 2016-02-11 17:21:55 -08:00
cnauroth
ddd82d24be HADOOP-12795. KMS does not log detailed stack trace for unexpected errors. Contributed by Chris Nauroth. 
(cherry picked from commit 70c756d35e6ed5608ce82d1a6fbfb02e19af5ecf)
(cherry picked from commit 25dcb88630eb4a6c30db4f20323beeb7fd2584cc)
 2016-02-11 16:53:21 -08:00
Arun Suresh
379c2f4c05 YARN-2575. Create separate ACLs for Reservation create/update/delete/list ops (Sean Po via asuresh) 2016-02-11 15:54:45 -08:00
Zhe Zhang
66a19d675e Add HADOOP-12764 to CHANGES.txt. 
Change-Id: Ie32b71b7bd8892a3bb434aec12cdf2c43c61b897
 2016-02-11 09:35:06 -08:00
Zhe Zhang
9023751de6 HADOOP-12764. Increase default value of KMS maxHttpHeaderSize and make it configurable. (zhz) 
Change-Id: Iabb766f6311b83a1ac03093b0ba26a0284b74d70
 2016-02-11 09:29:45 -08:00
Jian He
fc06ae38ca YARN-4138. Roll back container resource allocation after resource increase token expires. Contributed by Meng Ding 2016-02-11 10:42:45 +08:00
Jian He
145add1aec YARN-4519. Potential deadlock of CapacityScheduler between decrease container and assign containers. Contributed Meng Ding 2016-02-11 10:30:02 +08:00
Andrew Wang
47746f65b0 HDFS-9788. Incompatible tag renumbering in HeartbeatResponseProto. 
(cherry picked from commit aeb13ef2ab657a1c2f9d9ed5f80783f788c4953a)
(cherry picked from commit d48957075591e0c308da79eaa5412ca8f6f73c8a)
 2016-02-10 15:26:34 -08:00
Uma Maheswara Rao G
4324a3d012 HADOOP-12788. OpensslAesCtrCryptoCodec should log which random number generator is used. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit df4dcd3e75f1f935bd9a537e63758fee71cf4e02)
 2016-02-10 15:07:33 -08:00
=
9220bb649b YARN-4420. Add REST API for List Reservations. (Sean Po via curino) 
(cherry picked from commit fc9eb4577cdfd44cb99b933eae15f4794494836b)
 2016-02-10 14:41:38 -08:00
Jason Lowe
cad1436570 HADOOP-12792. TestUserGroupInformation#testGetServerSideGroups fails in chroot. Contributed by Eric Badger 
(cherry picked from commit 6f03959e4dc0bc11030fd7e30a025447a4d6948a)
 2016-02-10 21:55:53 +00:00
Arun Suresh
685aeeb1a7 YARN-4360. Improve GreedyReservationAgent to support "early" allocations, and performance improvements (curino via asuresh) 
(cherry picked from commit 5cf5c41a895f5ab8bf6270089f8cfdea50573a97)
 2016-02-10 09:13:31 -08:00
Jason Lowe
83985eed2a MAPREDUCE-6191. Improve clearing stale state of Java serialization 
testcase.  (Sam Liu via Eric Yang)
(cherry picked from commit c379e102ddab1b83fd69e4492a40c9901fb50675)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
(cherry picked from commit 303c650d0dfcb10760cea589b8cef6ace8e36417)
 2016-02-10 16:46:58 +00:00
Akira Ajisaka
811ab1bf94 HDFS-9686. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta. 
(cherry picked from commit 802a7edfaed778daaa471ee96466c6d69b35934c)
(cherry picked from commit a60a0a7128d23523cde2a80bc8576ae194162fc5)
 2016-02-10 23:50:16 +09:00
Akira Ajisaka
321da0604a Revert "HDFS-9686. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta." 
This reverts commit 3f8a30c956d464b86f91be3f0136ed7e15604f02.
 2016-02-10 23:45:44 +09:00
Uma Maheswara Rao G
de24588ca2 HDFS-9779 . TestReplicationPolicyWithNodeGroup NODE variable picks wrong rack value. Contributed by Kuhu Shukla. 
(cherry picked from commit a7fce9ab415fcc834ca1d91f913157ffd103fa5f)
 2016-02-09 15:18:07 -08:00
Allen Wittenauer
dc325ee550 HDFS-9760. WebHDFS AuthFilter cannot be configured with custom AltKerberos auth handler (Ryan Sasson via aw) 2016-02-09 14:16:02 -08:00
Akira Ajisaka
e4769775b0 HDFS-9784. Example usage is not correct in Transparent Encryption document. Contributed by Ohnishi Takashi. 
(cherry picked from commit 60d2011b7c0fe55b8bc44a141660d3e2df37a68d)
(cherry picked from commit cb53dfcc95ca9f6c45482600b52758bc096810b9)
 2016-02-10 03:30:56 +09:00
Akira Ajisaka
f943bf0e22 MAPREDUCE-6626. Reuse ObjectMapper instance in MapReduce. Contributed by Lin Yiqun. 
(cherry picked from commit 10393d9a666419a5d8dc0cfb48da96e9c690c11e)
(cherry picked from commit 8cbe65a07dd0deb150e91b13e3a1cec13e3716ee)
 2016-02-10 03:05:23 +09:00
Jason Lowe
5d653a3fd1 Update CHANGES.txt to reflect recent commits to branch-2.7 and branch-2.6. 
(cherry picked from commit fba6e9f5ef3d032986888117b3e53808e7dcf873)
 2016-02-09 16:56:12 +00:00
zhezhang
3257ce73bd HDFS-9244. Support nested encryption zones. 
Change-Id: I43a13035a8b27956e90967ee82058efb647c3415
 2016-02-08 16:32:11 -08:00
Uma Maheswara Rao G
3399119e72 HDFS-9777. Fix typos in DFSAdmin command line and documentation.(Wei-Chiu Chuang via umamahesh) 
(cherry picked from commit bffaa38a91b26920206a3350bf1cd60ec950aa74)
 2016-02-08 14:12:52 -08:00
Sangjin Lee
13bb016ba9 HADOOP-12773. HBase classes fail to load with client/job classloader enabled (sjlee) 
(cherry picked from commit 58acbf940a92ef8a761208a7a743175ee7b3377d)
 2016-02-08 13:59:10 -08:00
Kihwal Lee
aae0f183af HDFS-9752. Permanent write failures may happen to slow writers during datanode rolling upgrades. Contributed by Walter Su. 
(cherry picked from commit 193d27de0a5d23a61cabd41162ebc3292d8526d1)
 2016-02-08 12:17:39 -06:00
cnauroth
44c6277d01 HADOOP-12752. Improve diagnostics/use of envvar/sysprop credential propagation. Contributed by Steve Loughran. 
(cherry picked from commit cf3261570ae139c177225af165557038a9280a5d)
(cherry picked from commit a76611d4ec8f78faae436d7bdff31f4ae6d0d6fd)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2016-02-08 09:36:58 -08:00
Devaraj K
35651bab99 YARN-4667. RM Admin CLI for refreshNodesResources throws NPE when nothing 
is configured. Contributed by Naganarasimha G R.

(cherry picked from commit 565af873d5e9bc4178f1221805765a417f065192)
 2016-02-08 15:04:15 +05:30