Commit Graph

10386 Commits

Author SHA1 Message Date
Haohui Mai 74d67b2250 HADOOP-12572. Update Hadoop's lz4 to r131. Contributed by Kevin Bowling. 2015-11-22 15:43:34 -08:00
Haohui Mai 2c185222f9 HDFS-9443. Disabling HDFS client socket cache causes logging message printed to console for CLI commands. Contributed by Chris Nauroth. 2015-11-22 15:06:36 -08:00
Steve Loughran edcd0dc0b2 Revert "HADOOP-12584. Disable browsing the static directory in HttpServer2. Contributed by Robert Kanter."
This reverts commit b7e3f419bd.
2015-11-22 11:41:44 +00:00
Arun Suresh cbbdbe3cdd YARN-3454. Add efficient merge operation to RLESparseResourceAllocation (Carlo Curino via asuresh)
(cherry picked from commit da1016365a)
2015-11-21 10:01:10 -08:00
Wangda Tan 08727287de move YARN-4326/YARN-3849 from 2.8.0 to 2.7.3 2015-11-20 16:42:11 -08:00
Wangda Tan cdca460ad4 YARN-3769. Consider user limit when calculating total pending resource for preemption policy in Capacity Scheduler. (Eric Payne via wangda)
(cherry picked from commit 2346fa3141)
2015-11-20 15:56:17 -08:00
Jason Lowe f3bca8bc1a YARN-4374. RM capacity scheduler UI rounds user limit factor. Contributed by Chang Li
(cherry picked from commit 060cdcbe5d)
2015-11-20 23:13:27 +00:00
Haohui Mai b7e3f419bd HADOOP-12584. Disable browsing the static directory in HttpServer2. Contributed by Robert Kanter. 2015-11-19 15:47:41 -08:00
Tsz-Wo Nicholas Sze bf82a8de30 HDFS-9434. Recommission a datanode with 500k blocks may pause NN for 30 seconds for printing info log messags. 2015-11-19 14:54:59 -08:00
Yongjun Zhang 0664782025 HDFS-9439. Include status of closeAck into exception message in DataNode#run. (Xiao Chen via Yongjun Zhang)
(cherry picked from commit 31dc5c650e)
2015-11-19 14:22:44 -08:00
Haohui Mai 03c292efb7 HADOOP-11901. BytesWritable fails to support 2G chunks due to integer overflow. Contributed by Reynold Xin. 2015-11-19 12:54:16 -08:00
Xuan 8347b1048d YARN-2859 addendum: move the entry from 2.6.2 to 2.6.3 in hadoop-yarn/CHANGES.txt.
(cherry picked from commit 866dce4e8e)
2015-11-19 10:17:20 -08:00
Xuan be65d319fa YARN-2859.addendum: fix the remaining issue from the previous patch
(cherry picked from commit f114e728da)
2015-11-19 10:09:48 -08:00
Ming Ma 5a3db21563 HDFS-8056. Decommissioned dead nodes should continue to be counted as dead after NN restart. (mingma)
(cherry picked from commit 1c4951a7a0)
2015-11-19 10:04:40 -08:00
Akira Ajisaka c74e42b4a2 HDFS-9431. DistributedFileSystem#concat fails if the target path is relative. Contributed by Kazuho Fujii.
(cherry picked from commit ac1aa6c819)
2015-11-19 20:55:36 +09:00
Tsuyoshi Ozawa aa792b7d0c HADOOP-12575. Add build instruction for docker toolbox instead of boot2docker. Contributed by Kai Sasaki.
(cherry picked from commit 25e82b4eb9)
2015-11-19 17:44:21 +09:00
Tsuyoshi Ozawa c5fb02ba25 HADOOP-12582. Using BytesWritable's getLength() and getBytes() instead of get() and getSize(). Contributed by Akira AJISAKA.
(cherry picked from commit bd166f0eed)
2015-11-19 17:27:35 +09:00
Wangda Tan 3504d0e795 move fix version of YARN-4287 from 2.8.0 to 2.7.3 2015-11-18 14:01:02 -08:00
Karthik Kambatla d3f9508096 YARN-4367. SLS webapp doesn't load. (kasha) 2015-11-18 13:45:00 -08:00
Steve Loughran a0b3e43a6d YARN-4279. Mark ApplicationId and ApplicationAttemptId static methods as @Public, @Unstable. (stevel) 2015-11-18 21:41:24 +00:00
cnauroth 7b94ae17ab HDFS-9400. TestRollingUpgradeRollback fails on branch-2. Contributed by Brahma Reddy Battula.
(cherry picked from commit bad2afe39a)
2015-11-18 11:00:18 -08:00
Jason Lowe 44011a1759 Update CHANGES.txt to reflect commit of MR-6377 to branch-2.7 and branch-2.6.
(cherry picked from commit be9f3bba73)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
2015-11-18 17:26:13 +00:00
Tsuyoshi Ozawa eb4c9765d9 HADOOP-12564. Upgrade JUnit3 TestCase to JUnit 4 in org.apache.hadoop.io package. Contributed by Dustin Cote.
(cherry picked from commit 989b9e3e11)
2015-11-19 01:38:40 +09:00
Eric Yang 123e0b16f2 HADOOP-8419. Fixed GzipCode NPE reset for IBM JDK. (Yu Li via eyang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431740 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 8064849203)
2015-11-19 01:36:24 +09:00
Akira Ajisaka d5782a4199 HADOOP-12568. Update core-default.xml to describe posixGroups support. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 4a3b8f1ed2)
2015-11-18 17:23:34 +09:00
cnauroth 397836a7b3 HADOOP-12567. NPE in SaslRpcServer. Contributed by Sergey Shelukhin.
(cherry picked from commit 7fab5c8cec)
2015-11-17 16:00:33 -08:00
Arun Suresh d8e60080e9 YARN-4184. Remove update reservation state api from state store as its not used by ReservationSystem (Sean Po via asuresh)
(cherry picked from commit 6a61928fb7)
2015-11-17 15:51:59 -08:00
Colin Patrick Mccabe 0f9f9ba3cb HDFS-9252. Change TestFileTruncate to use FsDatasetTestUtils to get block file size and genstamp. (Lei (Eddy) Xu via cmccabe)
(cherry picked from commit dfbde3fc51)
2015-11-17 10:54:32 -08:00
Akira Ajisaka 2babf12810 Move HDFS-8615 from 2.8.0 to 2.6.3 in CHANGES.txt.
(cherry picked from commit b82a6cee4b)
2015-11-17 16:34:04 +09:00
Akira Ajisaka 8de7911eb3 MAPREDUCE-6499. Add elapsed time for retired job in JobHistoryServer WebUI. Contributed by Lin Yiqun.
(cherry picked from commit a7f776ffdf)
2015-11-17 15:18:32 +09:00
Arpit Agarwal efcaf9c28f HDFS-9397. Fix typo for readChecksum() LOG.warn in BlockSender.java. (Contributed by Enrique Flores) 2015-11-16 21:02:06 -08:00
Jian He 2cf084ac76 Revert "YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan"
This reverts commit a4ff03b200.

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2015-11-16 20:19:31 -08:00
Walter Su bff9d08a43 HDFS-9358. TestNodeCount#testNodeCount timed out. Contributed by Masatake Iwasaki.
(cherry picked from commit 621cbb4f69)
2015-11-17 10:53:50 +08:00
Jian He f562c155d2 MAPREDUCE-5485. Allow repeating job commit by extending OutputCommitter API. Contributed by Junping Du 2015-11-16 17:08:22 -08:00
Xiaoyu Yao dceed6b0a8 HDFS-9421. NNThroughputBenchmark replication test NPE with -namenode option. Contributed by Mingliang Liu.
(cherry picked from commit a4f62a2d58)
2015-11-16 16:42:57 -08:00
Xiaoyu Yao 5ea3f03ecc HDFS-9387. Fix namenodeUri parameter parsing in NNThroughputBenchmark. Contributed by Mingliang Liu.
(cherry picked from commit 2701f2d255)
2015-11-16 16:31:06 -08:00
Ming Ma 42b55ff23e HDFS-9413. getContentSummary() on standby should throw StandbyException. (Brahma Reddy Battula via mingma)
(cherry picked from commit 02653add98)
2015-11-16 09:34:03 -08:00
Junping Du 1d107d8058 YARN-4354. Public resource localization fails with NPE. Contributed by Jason Lowe.
(cherry picked from commit 855d52927b)
2015-11-15 04:44:59 -08:00
Tsuyoshi Ozawa d66fe1155b Move HADOOP-11361, HADOOP-12348 and HADOOP-12482 from 2.8.0 to 2.7.3 in CHANGES.txt for backporting.
(cherry picked from commit c753617a48)
2015-11-14 14:44:17 +09:00
Akira Ajisaka 1b9385c56c Move HADOOP-12374 from 2.8.0 to 2.7.3 in CHANGES.txt.
(cherry picked from commit 47c79a2a4d)
2015-11-14 13:15:35 +09:00
Akira Ajisaka c5c663c05d HADOOP-12545. Hadoop javadoc has broken links for AccessControlList, ImpersonationProvider, DefaultImpersonationProvider, and DistCp. Contributed by Arshad Mohammad.
(cherry picked from commit f94d892704)
2015-11-13 21:53:23 +09:00
Walter Su 0f5aae5fd8 HDFS-9410. Some tests should always reset sysout and syserr. Contributed by Xiao Chen.
(cherry picked from commit cccf88480b)
2015-11-13 14:29:25 +08:00
Wangda Tan 875aec3177 YARN-1509. Make AMRMClient support send increase container request and get increased/decreased containers. (Meng Ding via wangda)
(cherry picked from commit 7ff280fca9)
2015-11-12 11:50:41 -08:00
Wangda Tan 13f8c7093b YARN-4347. Resource manager fails with Null pointer exception. (Jian He via wangda)
(cherry picked from commit 7f55a18071)
2015-11-12 11:24:04 -08:00
Wangda Tan 0c1fb15b29 YARN-4287. Capacity Scheduler: Rack Locality improvement (Nathan Roberts via wangda)
(cherry picked from commit 796638d9bc)
2015-11-12 11:12:11 -08:00
Haohui Mai 5d9212c139 HADOOP-12562. Make hadoop dockerfile usable by Yetus. Contributed by Allen Wittenauer. 2015-11-12 10:20:33 -08:00
Jason Lowe 9050078005 YARN-4345. yarn rmadmin -updateNodeResource doesn't work. Contributed by Junping Du
(cherry picked from commit 06a70311b9)
2015-11-12 14:49:55 +00:00
Sangjin Lee 3214c2331f MAPREDUCE-6540. TestMRTimelineEventHandling fails (sjlee)
(cherry picked from commit 9ad708a0df)
2015-11-11 16:22:28 -08:00
Kihwal Lee 8726a5e020 HDFS-9396. Total files and directories on jmx and web UI on standby is uninitialized. Contributed by Kihwal Lee.
(cherry picked from commit a2a104f3d3)
2015-11-11 15:37:11 -06:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) bb5dd7f772 YARN-4183. Reverting the patch to fix behaviour change.
Revert "YARN-4183. Enabling generic application history forces every job to get a timeline service delegation token (jeagles)"

This reverts commit 42bc525acb.
2015-11-11 10:42:52 -08:00