Commit Graph

11219 Commits

Author SHA1 Message Date
Kihwal Lee 51fc96f5cf HDFS-10282. The VolumeScanner should warn about replica files which are misplaced. Contributed by Colin Patrick McCabe.
(cherry picked from commit 0d1c1152f1)
2016-04-14 07:59:41 -05:00
Steve Loughran e124c3a2ae HADOOP-12963 Allow using path style addressing for accessing the s3 endpoint. (Stephen Montgomery via stevel) 2016-04-14 12:45:10 +01:00
Steve Loughran a59e05ad0a HADOOP-12969 Mark IPC.Client and IPC.Server as @Public, @Evolving (Xiaobing Zhou via stevel) 2016-04-14 10:35:20 +01:00
Akira Ajisaka 03bf09865f HADOOP-12822. Change "Metrics intern cache overflow" log level from WARN to INFO. Contributed by Andras Bokor.
(cherry picked from commit 27b131e79c)
2016-04-14 10:57:50 +09:00
Robert Kanter e79a47670b YARN-4541. Change log message in LocalizedResource#handle() to DEBUG (rchiang via rkanter)
(cherry picked from commit 0d9194df00)
2016-04-13 17:45:36 -07:00
Robert Kanter d9d12b9e72 HADOOP-12964. Http server vulnerable to clickjacking (haibochen via rkanter)
(cherry picked from commit 042a3ae960)
2016-04-13 17:42:28 -07:00
Xiaoyu Yao 1f75e62b6d HDFS-10209. Support enable caller context in HDFS namenode audit log without restart namenode. Contributed by Xiaobing Zhou.
(cherry picked from commit 5566177c9a)
2016-04-13 16:52:22 -07:00
Xiaoyu Yao 42040f706a HADOOP-12993. Change ShutdownHookManger complete shutdown log from INFO to DEBUG. Contributed by Xiaoyu Yao.
(cherry picked from commit 8ced42daff)
2016-04-13 16:42:55 -07:00
Andrew Wang 4c18f54c1d HDFS-10279. Improve validation of the configured number of tolerated failed volumes. Contributed by Lin Yiqun.
(cherry picked from commit 314aa21a89)
2016-04-13 16:39:59 -07:00
Xuan 5bc64dafc3 YARN-4886. Add HDFS caller context for EntityGroupFSTimelineStore. Contributed by Li Lu
(cherry picked from commit e0cb426758)
2016-04-13 10:39:31 -07:00
Kihwal Lee 4a7e52d302 HDFS-10270. TestJMXGet:testNameNode() fails. Contributed by Gergely Novák
(cherry picked from commit d2f3bbc290)
2016-04-13 11:24:06 -05:00
Walter Su c195b1c9fe HDFS-9772. TestBlockReplacement#testThrottler doesn't work as expected. Contributed by Lin Yiqun.
(cherry picked from commit 903428bf94)
2016-04-13 17:50:30 +08:00
Colin Patrick Mccabe 2b0b332e2f HADOOP-12973. Make DU pluggable. (Elliott Clark via cmccabe)
(cherry picked from commit 35f0770555)
2016-04-12 16:29:15 -07:00
Colin Patrick Mccabe 6e37e40dd2 HDFS-10273. Remove duplicate logSync() and log message in FSN#enterSafemode() (Vinayakumar B via cmccabe)
(cherry picked from commit 600d129bb8)
2016-04-12 10:55:43 -07:00
Naganarasimha 53c24e00e8 YARN-4810. NM applicationpage cause internal error 500. Contributed by Bibin A Chundatt.
(cherry picked from commit 437e9d6475)
2016-04-12 18:25:11 +05:30
Akira Ajisaka bb1ed426d1 HDFS-8356. Document missing properties in hdfs-default.xml. Contributed by Ray Chiang. 2016-04-12 15:28:05 +09:00
Vinayakumar B 04621537c9 HDFS-10271. Extra bytes are getting released from reservedSpace for append (Contributed by Brahma Reddy Battula)
(cherry picked from commit a9a607f8fc)
2016-04-12 11:45:44 +05:30
Akira Ajisaka 8f968171bd HDFS-10277. PositionedReadable test testReadFullyZeroByteFile failing in HDFS. Contributed by Steve Loughran.
(cherry picked from commit a409508b3f)
2016-04-12 14:55:25 +09:00
Rohith Sharma K S d93cfefea5 YARN-4897. dataTables_wrapper change min height. Contributed by Bibin A Chundatt.
(cherry picked from commit 4ee7f0a3e7)
2016-04-12 10:28:18 +05:30
Rohith Sharma K S e9d1d8afd7 YARN-4794. Deadlock in NMClientImpl. Contributed by Jian He.
(cherry picked from commit ff722bbbdf)
2016-04-12 10:03:29 +05:30
Vinod Kumar Vavilapalli f1dcd40294 YARN-4168. Fixed a failing test TestLogAggregationService.testLocalFileDeletionOnDiskFull. Contributed by Takashi Ohnishi.
(cherry picked from commit 44bbc50d91)
2016-04-11 12:12:30 -07:00
Vinod Kumar Vavilapalli 4041d2b49e HADOOP-12406. Fixed AbstractMapWritable.readFields to use the thread's ClassLoader to load class instead of System ClassLoader. Contributed by Nadeem Douba.
(cherry picked from commit 069c6c62de)
2016-04-11 12:03:39 -07:00
Jason Lowe f1a370ce8b Revert "YARN-4311. Removing nodes from include and exclude lists will not remove them from decommissioned nodes list. Contributed by Kuhu Shukla"
This reverts commit 814ceeb489.
2016-04-11 15:56:29 +00:00
Junping Du a3f8491410 YARN-4928. Some yarn.server.timeline.* tests fail on Windows attempting to use a test root path containing a colon. Contributed by Gergely Novák.
(cherry picked from commit 08ddb3ac6d)
2016-04-11 08:51:22 -07:00
Akira Ajisaka 8cf6630fc6 YARN-4630. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta.
(cherry picked from commit 1ff27f9d12)
2016-04-11 14:55:37 +09:00
Varun Vasudev 4baee3eb67 YARN-4562. YARN WebApp ignores the configuration passed to it for keystore settings. Contributed by Sergey Shelukhin.
(cherry picked from commit 07920acc16)
2016-04-11 09:40:28 +05:30
Akira Ajisaka 88556294e2 YARN-4938. MiniYarnCluster should not request transitionToActive to RM on non-HA environment. Contributed by Eric Badger.
(cherry picked from commit 1b78b2ba17)
2016-04-11 01:32:49 +09:00
Eric Payne 17c4f34b3d MAPREDUCE-6633. AM should retry map attempts if the reduce task encounters commpression related errors. Contributed by Rushabh Shah
(cherry picked from commit 1fec06e037)
2016-04-09 18:27:03 +00:00
Karthik Kambatla 94a88ae87b YARN-4927. TestRMHA#testTransitionedToActiveRefreshFail fails with FairScheduler. (Bibin A Chundatt via kasha)
(cherry picked from commit ff95fd547b)
2016-04-09 10:31:29 -07:00
Steve Loughran 9acfde3a03 HADOOP-12444 Support lazy seek in S3AInputStream. Rajesh Balamohan via stevel 2016-04-09 11:24:55 +01:00
Wangda Tan dac2021f87 YARN-4826. Document configuration of ReservationSystem for CapacityScheduler. (Subru Krishnan via wangda)
(cherry picked from commit fcb3fcd4c6)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md
2016-04-08 16:28:14 -07:00
Wangda Tan 12ccdd6540 YARN-3215. Respect labels in CapacityScheduler when computing headroom. (Naganarasimha G R via wangda)
(cherry picked from commit ec06957941)
2016-04-08 15:34:24 -07:00
Chris Nauroth 26a23eff82 HADOOP-12994. Specify PositionedReadable, add contract tests, fix problems. Contributed by Steve Loughran.
(cherry picked from commit 843ee8d59d)
2016-04-08 13:37:46 -07:00
Jian He 77a75de319 YARN-4740. AM may not receive the container complete msg when it restarts. Contributed by Jun Gong 2016-04-08 11:21:07 -07:00
Steve Loughran 1533403a9a HADOOP-12753 S3A JUnit tests failing if using HTTP proxy. (Zoran Rajic via stevel) 2016-04-08 17:09:47 +01:00
Steve Loughran c8797e0e39 HADOOP-13006 FileContextMainOperationsBaseTest.testListStatusThrowsExceptionForNonExistentFile() doesnt run. (Kai Sasaki via stevel) 2016-04-08 12:59:01 +01:00
Andrew Wang 2f983b161f HADOOP-12951. Improve documentation on KMS ACLs and delegation tokens. Contributed by Xiao Chen.
(cherry picked from commit 594c70f779)
2016-04-07 23:50:36 -07:00
Karthik Kambatla 2b97a50eec YARN-4756. Unnecessary wait in Node Status Updater during reboot. (Eric Badger via kasha)
(cherry picked from commit e82f961a39)
2016-04-07 17:30:54 -07:00
Tsz-Wo Nicholas Sze 46352de1a2 HADOOP-12909. Change ipc.Client to support asynchronous calls. Contributed by Xiaobing Zhou 2016-04-07 14:49:48 +08:00
Suresh Srinivas d72db7d3aa HADOOP-8813. Add InterfaceAudience and InterfaceStability annotations to RPC Server and Client classes. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389649 13f79535-47bb-0310-9956-ffa450edef68
2016-04-07 14:39:22 +08:00
Vinayakumar B aea518ef30 Addendum : HADOOP-12984. Add GenericTestUtils.getTestDir method and use it for emporary directory in tests (Contributed by Steve Loughran and Vinayakumar B) 2016-04-07 14:33:48 +08:00
Vinayakumar B c2b271fe05 HADOOP-12984. Add GenericTestUtils.getTestDir method and use it for emporary directory in tests (Contributed by Steve Loughran and Vinayakumar B
This closes #91

(cherry picked from commit 8d29e2451f)
2016-04-07 10:17:43 +05:30
Tsz-Wo Nicholas Sze bccc28914b HDFS-10186. DirectoryScanner: Improve logs by adding full path of both actual and expected block directories. Contributed by Rakesh R 2016-04-07 12:39:26 +08:00
Colin Patrick Mccabe b5e6ad457f HDFS-10267. Extra "synchronized" on FsDatasetImpl#recoverAppend and FsDatasetImpl#recoverClose
(cherry picked from commit 4bd7cbc29d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockRecovery.java
2016-04-06 21:08:42 -07:00
Robert Kanter 3584cbc355 MAPREDUCE-6647. MR usage counters use the resources requested instead of the resources allocated (haibochen via rkanter)
(cherry picked from commit 3be1ab485f)
2016-04-06 17:16:10 -07:00
Jian He 42bc565630 YARN-4769. Add support for CSRF header in the dump capacity scheduler logs and kill app buttons in RM web UI. Contributed by Varun Vasudev 2016-04-06 16:14:13 -07:00
Eric Payne caef78afe6 HDFS-9945. Datanode command for evicting writers. Contributed by Kihwal Lee
(cherry picked from commit aede8c10ec)
2016-04-06 20:31:20 +00:00
Colin Patrick Mccabe 387d3f25c1 HDFS-6520. hdfs fsck passes invalid length value when creating BlockReader (Xiao Chen via cmccabe)
(cherry picked from commit 188f65287d)
2016-04-06 11:37:57 -07:00
Jing Zhao 7cac807eb3 HDFS-10192. Namenode safemode not coming out during failover. Contributed by Brahma Reddy Battula.
(cherry picked from commit 221b3a8722)
2016-04-06 10:43:38 -07:00
Junping Du 5574f82799 MAPREDUCE-6670. TestJobListCache#testEviction sometimes fails on Windows with timeout. Contributed by Gergely Novák.
(cherry picked from commit de96d7c88a)
2016-04-06 08:35:51 -07:00