Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,792 Commits 326 Branches 371 Tags
Commit Graph

10792 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Tsz-Wo Nicholas Sze
11c6930a17 HDFS-8923. Add -source flag to balancer usage message. Contributed by Chris Trezzo 2016-02-18 18:39:45 -08:00
cnauroth
49602ef580 HADOOP-11031. Design Document for Credential Provider API. Contributed by Larry McCay. 
(cherry picked from commit 8ab7658025616d154decd97578de3327ec6f9109)
(cherry picked from commit b4c4f30fa4fdb3bd9adcf669932b8633ab11fd25)
 2016-02-18 14:07:15 -08:00
Tsz-Wo Nicholas Sze
207ed9601f HADOOP-10865. Add a Crc32 chunked verification benchmark for both directly and non-directly buffer cases. 2016-02-18 11:59:58 -08:00
Kihwal Lee
bb8079e553 HDFS-4946. Allow preferLocalNode in BlockPlacementPolicyDefault to be configurable. Contributed by James Kinley and Nathan Roberts. 
(cherry picked from commit ba6d5ed955aa34cdcb7aaa4b1025da6ee5e91355)
 2016-02-18 13:28:17 -06:00
cnauroth
e5c8a34446 HDFS-9711. Integrate CSRF prevention filter in WebHDFS. Contributed by Chris Nauroth. 
(cherry picked from commit 5d1889a66d91608d34ca9411fb6e9161e637e9d3)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/DatanodeHttpServer.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java

(cherry picked from commit 779a69e28dfb6e520e7ebe08cfa76f2b03a0cee7)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
 2016-02-18 10:16:06 -08:00
cnauroth
2e047429be HADOOP-12691. Move files to correct location. 
(cherry picked from commit da77f423d142c4dda8810d4668edde3c7d2999e8)
(cherry picked from commit 2b9ea68ef8fbca524571eae27672323b4910464f)
 2016-02-18 10:15:31 -08:00
Akira Ajisaka
a06036bb1e HDFS-6832. Fix the usage of 'hdfs namenode' command. Contributed by Manjunath Ballur. 
(cherry picked from commit e78d8e66f748c68d2d88ee748facbfa35817d5e3)
(cherry picked from commit c183f235f1ae94d5b890bf010f7c9b7fa8cf92d2)
 2016-02-19 01:35:56 +09:00
Rohith Sharma K S
f18d092bda YARN-4654. Yarn node label CLI should parse "=" correctly when trying to remove all labels on a node. (Naganarasimha G R via rohithsharmaks) 
(cherry picked from commit c1afac3a98a4889d30a6ec7574a364fcbb6bb5b0)
 2016-02-18 14:21:55 +05:30
Sangjin Lee
3a8c7ffeb4 YARN-4690. Skip object allocation in FSAppAttempt#getResourceUsage when possible (Ming Ma via sjlee) 
(cherry picked from commit 7de70680fe44967e2afc92ba4c92f8e7afa7b151)
 2016-02-17 21:03:07 -08:00
Xiaoyu Yao
5ff2012f64 HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou. 
(cherry picked from commit fe5624b85d71720ae9da90a01cad9a3d1ea41160)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/DatanodeHttpServer.java

(cherry picked from commit ad4fcd1f9f84cfef8dc8bb48ef7fbdd5c7c20c6a)
 2016-02-17 16:05:24 -08:00
Zhe Zhang
64d39b83cc HDFS-9799. Reimplement getCurrentTrashDir to remove incompatibility. (zhz) 
Change-Id: I7834bcebffed38cb384db5395ddb8b6dd9e79a0b
 2016-02-17 13:32:18 -08:00
cnauroth
26ce37a1a6 HADOOP-12548. Read s3a creds from a Credential Provider. Contributed by Larry McCay. 
(cherry picked from commit 76fab26c5c02cef38924d04136407489fd9457d9)

Conflicts:
	hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java

(cherry picked from commit 6731bb468dab743e0546e8e0fbbefaf46a1729c2)
 2016-02-17 12:20:49 -08:00
Haohui Mai
b318429ac9 HDFS-9815. Move o.a.h.fs.Hdfs to hadoop-hdfs-client. Contributed by Vinayakumar B. 2016-02-17 10:59:50 -08:00
Xiaoyu Yao
5953421544 HADOOP-12878. KMS SPNEGO sequence does not work with WEBHDFS. Contributed by Xiaoyu Yao. 
(cherry picked from commit fd1befb6ba450e45b1fcb3fb28b0da6c48daf6b3)
 2016-02-17 08:47:30 -08:00
Tsuyoshi Ozawa
7ccb0e0601 MAPREDUCE-6341. addendum patch to fix typos. Contributed by John Michael Luy. 
(cherry picked from commit 453e7e0d1091cf795152c8992c6c5cbc772d80d6)
 2016-02-17 14:18:24 +09:00
Vinayakumar B
e88c01fa58 HADOOP-12810. FileSystem#listLocatedStatus causes unnecessary RPC calls (Contributed by Ryan Blue) 
(cherry picked from commit 96ea3094315bb1e1a5e268e3817c7fdedc3e9462)
(cherry picked from commit 2bf5a005fab287689a148c1928f3b04c0a8dcedf)
 2016-02-17 10:15:43 +05:30
Junping Du
c7be3deff7 HDFS-9456. BlockPlacementPolicyWithNodeGroup should override verifyBlockPlacement(). Contributed by Xiaobing Zhou. 
(cherry picked from commit 77ba5add0d9cb10d45ca9122bca48baa7c8fb3b8)
(cherry picked from commit 6874a142d8a9be25801636db7ade3d3216fd6df8)
 2016-02-16 19:09:02 -08:00
Vinayakumar B
8d6fb15b03 HADOOP-12805. Annotate CanUnbuffer with @InterfaceAudience.Public (Contributed by Ted Yu) 
(cherry picked from commit 4b0e59fdc010be517dd67ddf35c962da204df547)
(cherry picked from commit e79a5e4460b5199eebb0d788fdc1eaa36d6b0ac4)
 2016-02-16 17:33:44 +05:30
Akira Ajisaka
19c149cdb9 HDFS-9765. TestBlockScanner#testVolumeIteratorWithCaching fails intermittently. (aajisaka) 
(cherry picked from commit 8ed07bd3e6b6a8af3b82e9a085c74be29f8dfd87)
(cherry picked from commit 8dec72bfd73174bdc2dfa8ce845b28af48a6bca4)
 2016-02-15 19:09:51 +09:00
Akira Ajisaka
4d1c23f55c HDFS-9773. Remove dead code related to SimulatedFSDataset in tests. Contributed by Brahma Reddy Battula. 
(cherry picked from commit b0738ae673e4a95060b33498c049cd7790d6e371)
(cherry picked from commit 5e78264cde3e141ed9809b9d2d4fc2e3f99b1788)
 2016-02-15 15:35:35 +09:00
Akira Ajisaka
bb02c3c803 HADOOP-12786. "hadoop key" command usage is not documented. Contributed by Xiao Chen. 
(cherry picked from commit 1c48e50ce71fd0e38740d69ce1e03119dca97a38)
(cherry picked from commit a670165bbd743f8271375b67236b00e95ae238a1)
 2016-02-15 11:39:09 +09:00
Jian He
e25d82bbc2 YARN-4653. Document YARN security model from the perspective of Application Developers. Contributed by Steve Loughran 2016-02-14 17:15:18 +08:00
Junping Du
aed60ae0bf Set the release date for 2.6.4. 
(cherry picked from commit ec12ce8f48944c38271399a6e452aa2c2a9f5b80)
(cherry picked from commit a28be9edc72cc4fe42fab107c17bcac6789af4e5)

Conflicts:

	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2016-02-13 01:48:50 -08:00
Masatake Iwasaki
e0fccc9c94 HADOOP-12589. Fix intermittent test failure of TestCopyPreserveFlag (iwasakims) 
(cherry picked from commit 36ba5cac37dee6b60e607401ac06d263e4ac5d8f)
 2016-02-13 15:02:15 +09:00
cnauroth
b846401307 HADOOP-12780. During WASB atomic rename handle crash when one directory has been renamed but not file under it. Contributed by Madhumita Chakraborty. 
(cherry picked from commit 91a96eaa534dbb27e81b6c24bbb8138200a80a83)
(cherry picked from commit ac5a7935901255e5fc56b88574e72f875942b906)
 2016-02-12 15:50:28 -08:00
Arpit Agarwal
8c1cf718aa HDFS-9801. ReconfigurableBase should update the cached configuration. (Arpit Agarwal) 2016-02-12 12:41:20 -08:00
Arun Suresh
4d7da8907f HDFS-9797. Log Standby exceptions thrown by RequestHedgingProxyProvider at DEBUG Level (Inigo Goiri via asuresh) 
(cherry picked from commit 9fdfb546fb67526ba261da5cbd005f33e0f1d9e1)
 2016-02-12 11:21:16 -08:00
Zhe Zhang
f72cfc416a HDFS-9644. Update encryption documentation to reflect nested EZs. (zhz) 
Change-Id: I84ae96f4711a16ded46d501c51ca322bfca5151d
 2016-02-12 10:49:41 -08:00
Masatake Iwasaki
2dd80938a2 HDFS-9700. DFSClient and DFSOutputStream should set TCP_NODELAY on sockets for DataTransferProtocol (Gary Helmling via iwasakims) 
(cherry picked from commit 372d1302c63c6f49f99be5766c5da9647ebd9ca6)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/impl/DfsClientConf.java

(cherry picked from commit f71fa500f9a43d928fbd27c873544898bff50dd4)
 2016-02-13 03:34:07 +09:00
Akira Ajisaka
df23f9c49d HDFS-9768. Reuse ObjectMapper instance in HDFS to improve the performance. Contributed by Lin Yiqun. 
(cherry picked from commit e6a7044b8530afded8f8e86ff309dd0e4d39238a)
(cherry picked from commit a714d04f5d8eaba34a24ee9454ceaec68ab00a15)
 2016-02-13 02:04:22 +09:00
Steve Loughran
706351afb8 YARN-4682. AMRM client to log when AMRM token updated. (Prabhu Joseph via stevel) 2016-02-12 10:58:09 +00:00
Vinayakumar B
26934cf6c7 HADOOP-12776. Remove getaclstatus call for non-acl commands in getfacl. (Contributed by Brahma Reddy Battula) 
(cherry picked from commit c78740a979c1b434c6595b302bd376fc3d432509)
(cherry picked from commit 488e6cbe16140f8e93bbf9a4c512211680c21777)
 2016-02-12 11:56:00 +05:30
Arpit Agarwal
58d4c045e6 HDFS-9790. HDFS Balancer should exit with a proper message if upgrade is not finalized (Contributed by Xiaobing Zhou) 2016-02-11 20:40:49 -08:00
Andrew Wang
9afa321fd2 HADOOP-12699. TestKMS#testKMSProvider intermittently fails during 'test rollover draining'. Contributed by Xiao Chen. 
(cherry picked from commit 8fdef0bd9d1ece560ab4e1a1ec7fc77c46a034bb)
(cherry picked from commit fb57c01eaaf572dee59e91e75d59237cf540d6d1)
 2016-02-11 17:21:55 -08:00
cnauroth
ddd82d24be HADOOP-12795. KMS does not log detailed stack trace for unexpected errors. Contributed by Chris Nauroth. 
(cherry picked from commit 70c756d35e6ed5608ce82d1a6fbfb02e19af5ecf)
(cherry picked from commit 25dcb88630eb4a6c30db4f20323beeb7fd2584cc)
 2016-02-11 16:53:21 -08:00
Arun Suresh
379c2f4c05 YARN-2575. Create separate ACLs for Reservation create/update/delete/list ops (Sean Po via asuresh) 2016-02-11 15:54:45 -08:00
Zhe Zhang
66a19d675e Add HADOOP-12764 to CHANGES.txt. 
Change-Id: Ie32b71b7bd8892a3bb434aec12cdf2c43c61b897
 2016-02-11 09:35:06 -08:00
Zhe Zhang
9023751de6 HADOOP-12764. Increase default value of KMS maxHttpHeaderSize and make it configurable. (zhz) 
Change-Id: Iabb766f6311b83a1ac03093b0ba26a0284b74d70
 2016-02-11 09:29:45 -08:00
Jian He
fc06ae38ca YARN-4138. Roll back container resource allocation after resource increase token expires. Contributed by Meng Ding 2016-02-11 10:42:45 +08:00
Jian He
145add1aec YARN-4519. Potential deadlock of CapacityScheduler between decrease container and assign containers. Contributed Meng Ding 2016-02-11 10:30:02 +08:00
Andrew Wang
47746f65b0 HDFS-9788. Incompatible tag renumbering in HeartbeatResponseProto. 
(cherry picked from commit aeb13ef2ab657a1c2f9d9ed5f80783f788c4953a)
(cherry picked from commit d48957075591e0c308da79eaa5412ca8f6f73c8a)
 2016-02-10 15:26:34 -08:00
Uma Maheswara Rao G
4324a3d012 HADOOP-12788. OpensslAesCtrCryptoCodec should log which random number generator is used. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit df4dcd3e75f1f935bd9a537e63758fee71cf4e02)
 2016-02-10 15:07:33 -08:00
=
9220bb649b YARN-4420. Add REST API for List Reservations. (Sean Po via curino) 
(cherry picked from commit fc9eb4577cdfd44cb99b933eae15f4794494836b)
 2016-02-10 14:41:38 -08:00
Jason Lowe
cad1436570 HADOOP-12792. TestUserGroupInformation#testGetServerSideGroups fails in chroot. Contributed by Eric Badger 
(cherry picked from commit 6f03959e4dc0bc11030fd7e30a025447a4d6948a)
 2016-02-10 21:55:53 +00:00
Arun Suresh
685aeeb1a7 YARN-4360. Improve GreedyReservationAgent to support "early" allocations, and performance improvements (curino via asuresh) 
(cherry picked from commit 5cf5c41a895f5ab8bf6270089f8cfdea50573a97)
 2016-02-10 09:13:31 -08:00
Jason Lowe
83985eed2a MAPREDUCE-6191. Improve clearing stale state of Java serialization 
testcase.  (Sam Liu via Eric Yang)
(cherry picked from commit c379e102ddab1b83fd69e4492a40c9901fb50675)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
(cherry picked from commit 303c650d0dfcb10760cea589b8cef6ace8e36417)
 2016-02-10 16:46:58 +00:00
Akira Ajisaka
811ab1bf94 HDFS-9686. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta. 
(cherry picked from commit 802a7edfaed778daaa471ee96466c6d69b35934c)
(cherry picked from commit a60a0a7128d23523cde2a80bc8576ae194162fc5)
 2016-02-10 23:50:16 +09:00
Akira Ajisaka
321da0604a Revert "HDFS-9686. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta." 
This reverts commit 3f8a30c956d464b86f91be3f0136ed7e15604f02.
 2016-02-10 23:45:44 +09:00
Uma Maheswara Rao G
de24588ca2 HDFS-9779 . TestReplicationPolicyWithNodeGroup NODE variable picks wrong rack value. Contributed by Kuhu Shukla. 
(cherry picked from commit a7fce9ab415fcc834ca1d91f913157ffd103fa5f)
 2016-02-09 15:18:07 -08:00
Allen Wittenauer
dc325ee550 HDFS-9760. WebHDFS AuthFilter cannot be configured with custom AltKerberos auth handler (Ryan Sasson via aw) 2016-02-09 14:16:02 -08:00