Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,935 Commits 326 Branches 371 Tags
Commit Graph

10935 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Tsuyoshi Ozawa
56b82de6e1 HDFS-9084. Pagination, sorting and filtering of files/directories in the HDFS Web UI. (Contributed by Ravi Prakash) 
(cherry picked from commit 48c61cd6aa3feae6a4a71d2d1bb6d01a3d50c7b7)
 2016-02-23 19:31:22 +09:00
Rohith Sharma K S
544a2ff7c9 YARN-4651. Document movetoqueue option in 'YARN Commands'. (Takashi Ohnishi via rohithsharmaks) 
(cherry picked from commit de09f41147bf0b6501e82b44afe4e39fe5c3b835)
 2016-02-23 18:07:57 +08:00
Varun Vasudev
f1999fe275 MAPREDUCE-6635. Unsafe long to int conversion in UncompressedSplitLineReader and IndexOutOfBoundsException. Contributed by Junping Du. 
(cherry picked from commit c6f2d761d5430eac6b9f07f137a7028de4e0660c)
 2016-02-23 13:05:52 +05:30
Varun Vasudev
2c218ca8a8 YARN-4709. NMWebServices produces incorrect JSON for containers. Contributed by Varun Saxena. 
(cherry picked from commit 140cb5d74565aad848b40a251ec02b597a3a20d4)
 2016-02-23 12:32:16 +05:30
cnauroth
a5511debdb HADOOP-12555. WASB to read credentials from a credential provider. Contributed by Larry McCay. 
(cherry picked from commit 27b77751c1163ab4a1ce081a426e5190d1b8aff4)
 2016-02-22 17:30:32 -08:00
Tsz-Wo Nicholas Sze
9b10373b2b HDFS-8578. On upgrade, Datanode should process all storage/data dirs in parallel. Contributed by vinayakumarb and szetszwo 2016-02-22 15:16:14 -08:00
Zhe Zhang
56b7f2c2c1 HADOOP-12668. Support excluding weak Ciphers in HttpServer2 through ssl-server.conf. Contributed by Vijay Singh. 
Change-Id: Ie46a5427d29188935427f67e55203c19fcd83335
 2016-02-22 14:14:39 -08:00
cnauroth
3f14eed580 HADOOP-11613. Remove commons-httpclient dependency from hadoop-azure. Contributed by Masatake Iwasaki. 
(cherry picked from commit d4f5fc23b208635e8f9a14c375d4101141aefa4a)
 2016-02-22 13:39:45 -08:00
Arpit Agarwal
fef99bcae0 HDFS-9842. dfs.datanode.balance.bandwidthPerSec should accept friendly size units. (Contributed by Lin Yiqun) 2016-02-22 11:34:17 -08:00
Junping Du
7402448387 YARN-4386. refreshNodesGracefully() should send recommission event to active RMNodes only. Contributed by Kuhu Shukla. 
(cherry picked from commit 3fab88540f079591e5dae1c9184f8b26bb843427)
 2016-02-22 07:38:40 -08:00
Akira Ajisaka
34635f9e37 YARN-4707. Remove the extra char (>) from SecureContainer.md. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 5e7d4d51f856298e99a00895013ac665e67549b3)
 2016-02-22 17:18:03 +09:00
Vinayakumar B
2e3c35a835 HDFS-9425. Expose number of blocks per volume as a metric (Contributed by Brahma Reddy Battula) 
(cherry picked from commit 342c9572bf6a623287f34c5cc0bc3be6038c191a)
 2016-02-22 09:29:47 +05:30
Vinayakumar B
3e76768f21 HDFS-7452. skip StandbyException log for getCorruptFiles() (Contributed by Bramha Reddy Battula) 
(cherry picked from commit f313516731d787f6be64c9406ca83d941d47ee99)
 2016-02-22 09:22:12 +05:30
Tsuyoshi Ozawa
929e869ae0 YARN-4708. Missing default mapper type in TimelineServer performance test tool usage. Contributed by Kai Sasaki. 
(cherry picked from commit b68901d7dde9cb48545fcf0b94f2ac266b909a5d)
 2016-02-22 07:55:35 +09:00
Arpit Agarwal
7660cfd91a HDFS-9839. Reduce verbosity of processReport logging. (Contributed by Arpit Agarwal) 
This closes #78
 2016-02-20 23:20:18 -08:00
Andrew Wang
7f6737951a MAPREDUCE-6637. Testcase Failure : TestFileInputFormat.testSplitLocationInfo. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 37577852ba54ba506b0b6c4db5e95d176f5e9b63)
 2016-02-19 16:33:40 -08:00
Junping Du
e38c2ef6c5 Support additional compression levels for GzipCodec. Contributed by Ravi Mutyala. 
(cherry picked from commit 18f9b77a321b225677ce23c503b41d21478fc4a7)
 2016-02-19 14:22:39 -08:00
Yongjun Zhang
b144e0f15d HDFS-9764. DistCp doesn't print value for several arguments including -numListstatusThreads. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit ba1c9d484a8d6a18b4b7365c49d09635d24e579a)
 2016-02-19 10:29:27 -08:00
Yongjun Zhang
36c08f793a HADOOP-12828. Print user when services are started. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit a963baba10648859ad88d4ed9a4325b66b1af0d5)
 2016-02-19 09:57:45 -08:00
Tsz-Wo Nicholas Sze
5faa2934e8 Move HDFS-8923 to Release 2.8.0 in CHANGES.txt. 2016-02-18 18:44:40 -08:00
Tsz-Wo Nicholas Sze
2a09f00ac3 HDFS-8923. Add -source flag to balancer usage message. Contributed by Chris Trezzo 2016-02-18 18:39:09 -08:00
Robert Kanter
a33109a0b8 MAPREDUCE-6627. Add machine-readable output to mapred job -history command (rkanter) 
(cherry picked from commit 8eee59ce6b3044cb73bb41fed6b7ece959e7c2f8)
 2016-02-18 17:58:40 -08:00
cnauroth
b4c4f30fa4 HADOOP-11031. Design Document for Credential Provider API. Contributed by Larry McCay. 
(cherry picked from commit 8ab7658025616d154decd97578de3327ec6f9109)
 2016-02-18 14:07:09 -08:00
Tsz-Wo Nicholas Sze
38fc086940 HADOOP-10865. Add a Crc32 chunked verification benchmark for both directly and non-directly buffer cases. 2016-02-18 12:02:00 -08:00
Kihwal Lee
b83348c2e3 HDFS-4946. Allow preferLocalNode in BlockPlacementPolicyDefault to be configurable. Contributed by James Kinley and Nathan Roberts. 
(cherry picked from commit ba6d5ed955aa34cdcb7aaa4b1025da6ee5e91355)
 2016-02-18 13:27:39 -06:00
Robert Kanter
f864faaafa HADOOP-12817. Enable TLS v1.1 and 1.2 (rkanter) 
(cherry picked from commit a365a3941cf96a31c289cb22678a602738880f74)
 2016-02-18 11:11:32 -08:00
cnauroth
779a69e28d HDFS-9711. Integrate CSRF prevention filter in WebHDFS. Contributed by Chris Nauroth. 
(cherry picked from commit 5d1889a66d91608d34ca9411fb6e9161e637e9d3)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/DatanodeHttpServer.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java
 2016-02-18 10:09:33 -08:00
Akira Ajisaka
c183f235f1 HDFS-6832. Fix the usage of 'hdfs namenode' command. Contributed by Manjunath Ballur. 
(cherry picked from commit e78d8e66f748c68d2d88ee748facbfa35817d5e3)
 2016-02-19 01:35:43 +09:00
Varun Vasudev
212c519ad3 MAPREDUCE-6634. Log uncaught exceptions/errors in various thread pools in mapreduce. Contributed by Sidharta Seethana. 
(cherry picked from commit c50d1e54000c76880a041ce5959a2eb23c86bd35)
 2016-02-18 14:19:01 +05:30
Rohith Sharma K S
d4203c9aa2 YARN-4654. Yarn node label CLI should parse "=" correctly when trying to remove all labels on a node. (Naganarasimha G R via rohithsharmaks) 
(cherry picked from commit c1afac3a98a4889d30a6ec7574a364fcbb6bb5b0)
 2016-02-18 14:17:04 +05:30
Sangjin Lee
23b5c71729 YARN-4690. Skip object allocation in FSAppAttempt#getResourceUsage when possible (Ming Ma via sjlee) 
(cherry picked from commit 7de70680fe44967e2afc92ba4c92f8e7afa7b151)
 2016-02-17 21:05:10 -08:00
Karthik Kambatla
25c2597f9c YARN-4569. Remove incorrect part of maxResources in FairScheduler documentation. (Ray Chiang via kasha) 
(cherry picked from commit a0c95b5fc4c90ee3383619156619a66dfba889f7)
 2016-02-17 18:43:41 -08:00
Karthik Kambatla
33c1988595 YARN-4689. FairScheduler: Cleanup preemptContainer to be more readable. (Kai Sasaki via kasha) 
(cherry picked from commit 2ab4c476ed22d3ccf15b215710b67e32bbc7e5f0)
 2016-02-17 18:28:08 -08:00
Xiaoyu Yao
ad4fcd1f9f HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou. 
(cherry picked from commit fe5624b85d71720ae9da90a01cad9a3d1ea41160)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/DatanodeHttpServer.java
 2016-02-17 16:05:07 -08:00
Zhe Zhang
e226dbbc8a HDFS-9799. Reimplement getCurrentTrashDir to remove incompatibility. (zhz) 
Change-Id: I7834bcebffed38cb384db5395ddb8b6dd9e79a0b
 2016-02-17 13:31:48 -08:00
cnauroth
6731bb468d HADOOP-12548. Read s3a creds from a Credential Provider. Contributed by Larry McCay. 
(cherry picked from commit 76fab26c5c02cef38924d04136407489fd9457d9)

Conflicts:
	hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java
 2016-02-17 12:20:41 -08:00
Andrew Wang
c22aedac68 HDFS-9608. Disk IO imbalance in HDFS with heterogeneous storages. Contributed by Wei Zhou. 
(cherry picked from commit 3a23dc683c058d3a5262ae9dca2d1c8c588a6a3e)
 2016-02-17 11:30:13 -08:00
Haohui Mai
e7d1507e21 HDFS-9815. Move o.a.h.fs.Hdfs to hadoop-hdfs-client. Contributed by Vinayakumar B. 2016-02-17 10:56:57 -08:00
Xiaoyu Yao
91c4a3a816 HADOOP-12878. KMS SPNEGO sequence does not work with WEBHDFS. Contributed by Xiaoyu Yao. 
(cherry picked from commit fd1befb6ba450e45b1fcb3fb28b0da6c48daf6b3)
 2016-02-17 08:44:37 -08:00
Masatake Iwasaki
3e80aece2e HADOOP-12710. Remove dependency on commons-httpclient for TestHttpServerLogs (Wei-Chiu Chuang via iwasakims) 
(cherry picked from commit 1a1c2f5bab522ed39a35edbca30e6bed5a990992)
 2016-02-18 00:25:20 +09:00
Tsuyoshi Ozawa
a33cdfb875 MAPREDUCE-6341. addendum patch to fix typos. Contributed by John Michael Luy. 
(cherry picked from commit 453e7e0d1091cf795152c8992c6c5cbc772d80d6)
 2016-02-17 14:18:04 +09:00
Vinayakumar B
2bf5a005fa HADOOP-12810. FileSystem#listLocatedStatus causes unnecessary RPC calls (Contributed by Ryan Blue) 
(cherry picked from commit 96ea3094315bb1e1a5e268e3817c7fdedc3e9462)
 2016-02-17 10:15:08 +05:30
Junping Du
6874a142d8 HDFS-9456. BlockPlacementPolicyWithNodeGroup should override verifyBlockPlacement(). Contributed by Xiaobing Zhou. 
(cherry picked from commit 77ba5add0d9cb10d45ca9122bca48baa7c8fb3b8)
 2016-02-16 19:00:52 -08:00
Vinayakumar B
e79a5e4460 HADOOP-12805. Annotate CanUnbuffer with @InterfaceAudience.Public (Contributed by Ted Yu) 
(cherry picked from commit 4b0e59fdc010be517dd67ddf35c962da204df547)
 2016-02-16 17:32:35 +05:30
Akira Ajisaka
8dec72bfd7 HDFS-9765. TestBlockScanner#testVolumeIteratorWithCaching fails intermittently. (aajisaka) 
(cherry picked from commit 8ed07bd3e6b6a8af3b82e9a085c74be29f8dfd87)
 2016-02-15 19:08:35 +09:00
Akira Ajisaka
5e78264cde HDFS-9773. Remove dead code related to SimulatedFSDataset in tests. Contributed by Brahma Reddy Battula. 
(cherry picked from commit b0738ae673e4a95060b33498c049cd7790d6e371)
 2016-02-15 15:35:25 +09:00
Akira Ajisaka
75c5470165 HDFS-9691. TestBlockManagerSafeMode#testCheckSafeMode fails intermittently. Contributed by Mingliang Liu. 
(cherry picked from commit ac5da11399525dd31c49700a0bbf01cd37e347d5)
 2016-02-15 14:00:40 +09:00
Akira Ajisaka
a670165bbd HADOOP-12786. "hadoop key" command usage is not documented. Contributed by Xiao Chen. 
(cherry picked from commit 1c48e50ce71fd0e38740d69ce1e03119dca97a38)
 2016-02-15 11:38:54 +09:00
Jian He
68d98f70ba YARN-4653. Document YARN security model from the perspective of Application Developers. Contributed by Steve Loughran 2016-02-14 17:14:35 +08:00
Junping Du
a28be9edc7 Set the release date for 2.6.4. 
(cherry picked from commit ec12ce8f48944c38271399a6e452aa2c2a9f5b80)
 2016-02-13 01:44:12 -08:00