9062 Commits

Author SHA1 Message Date
Akira Ajisaka
c7f3dd1eb3 YARN-3572. Correct typos in WritingYarnApplications.md. Contributed by Gabor Liptak.
(cherry picked from commit a521b509551e092dfeb38cdf29bb96556d3e0266)
2015-05-08 13:25:07 +09:00
Akira Ajisaka
170f1b0afd YARN-1832. Fix wrong MockLocalizerStatus#equals implementation. Contributed by Hong Zhiguo.
(cherry picked from commit b167fe7605deb29ec533047d79d036eb65328853)
2015-05-08 11:15:28 +09:00
Jian He
d817fbb34d YARN-2918. RM should not fail on startup if queue's configured labels do not exist in cluster-node-labels. Contributed by Wangda Tan
(cherry picked from commit f489a4ec969f3727d03c8e85d51af1018fc0b2a1)
2015-05-07 17:36:24 -07:00
Haohui Mai
a3abe8d7e4 HDFS-8037. CheckAccess in WebHDFS silently accepts malformed FsActions parameters. Contributed by Walter Su. 2015-05-07 15:25:36 -07:00
Haohui Mai
f6b908ab07 HDFS-8321. CacheDirectives and CachePool operations should throw RetriableException in safemode. Contributed by Haohui Mai. 2015-05-07 15:17:02 -07:00
Jason Lowe
976a3c1f9d MAPREDUCE-6279. AM should explicity exit JVM after all services have stopped. Contributed by Eric Payne
(cherry picked from commit f30065c8b6099372f57015b505434120fe83c2b0)
2015-05-07 22:06:54 +00:00
Jian He
c35114a1e6 YARN-3584. Fixed attempt diagnostics format shown on the UI. Contributed by nijel
(cherry picked from commit b88700dcd0b9aa47662009241dfb83bc4446548d)
2015-05-07 13:56:25 -07:00
Allen Wittenauer
1886bab0f1 HADOOP-11936. Dockerfile references a removed image (aw) 2015-05-07 11:47:20 -07:00
Tsz-Wo Nicholas Sze
4e1f2eb395 HDFS-7980. Incremental BlockReport will dramatically slow down namenode startup. Contributed by Walter Su 2015-05-07 11:37:33 -07:00
Zhijie Shen
bb035ff087 YARN-3448. Added a rolling time-to-live LevelDB timeline store implementation. Contributed by Jonathan Eagles.
(cherry picked from commit daf3e4ef8bf73cbe4a799d51b4765809cd81089f)
2015-05-07 10:10:13 -07:00
Junping Du
684a5a6aeb YARN-3523. Cleanup ResourceManagerAdministrationProtocol interface audience. Contributed by Naganarasimha G R
(cherry picked from commit 8e991f4b1d7226fdcd75c5dc9fe6e5ce721679b9)
2015-05-07 05:40:13 -07:00
Akira Ajisaka
f7c011cbaa MAPREDUCE-6356. Misspelling of threshold in log4j.properties for tests. Contributed by Brahma Reddy Battula.
(cherry picked from commit d335071398fdb14153c854b740814b4fd385b658)
2015-05-07 19:41:44 +09:00
Akira Ajisaka
3b36f36576 HADOOP-10387. Misspelling of threshold in log4j.properties for tests in hadoop-common-project. Contributed by Brahma Reddy Battula.
(cherry picked from commit 305e4733d639830cb1801efaa2dba8e84b86cc29)
2015-05-07 16:54:30 +09:00
Akira Ajisaka
ab7dab55ea HDFS-8325. Misspelling of threshold in log4j.properties for tests. Contributed by Brahma Reddy Battula.
(cherry picked from commit 449e4426a5cc1382eef0cbaa9bd4eb2221c89da1)
2015-05-07 15:15:12 +09:00
Akira Ajisaka
67bebabb21 YARN-3577. Misspelling of threshold in log4j.properties for tests. Contributed by Brahma Reddy Battula.
(cherry picked from commit 995f1b5831fc33042de90267a689333dc110c4c3)
2015-05-07 13:33:17 +09:00
cnauroth
276e2d3390 HDFS-7833. DataNode reconfiguration does not recalculate valid volumes required, based on configured failed volumes tolerated. Contributed by Lei (Eddy) Xu.
(cherry picked from commit 6633a8474d7e92fa028ede8fd6c6e41b6c5887f5)
2015-05-06 21:11:44 -07:00
Vinod Kumar Vavilapalli
d127dd64a7 YARN-3385. Fixed a race-condition in ResourceManager's ZooKeeper based state-store to avoid crashing on duplicate deletes. Contributed by Zhihai Xu.
(cherry picked from commit 4c7b9b6abe2452c9752a11214762be2e7665fb32)
2015-05-06 17:52:13 -07:00
Junping Du
79babc4bd2 YARN-3580. [JDK8] TestClientRMService.testGetLabelsToNodes fails. Contributed by Robert Kanter.
(cherry picked from commit 31b627b2a8755dec0820d01f6f7ac96e4c6194e2)
2015-05-06 16:51:56 -07:00
Konstantin V Shvachko
193615c4b2 HDFS-2484. checkLease should throw FileNotFoundException when file does not exist. Contributed by Rakesh R. 2015-05-06 16:11:12 -07:00
Robert Kanter
28b40aca98 YARN-3491. PublicLocalizer#addResource is too slow. (zxu via rkanter)
(cherry picked from commit b72507810aece08e17ab4b5aae1f7eae1fe98609)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2015-05-06 14:20:08 -07:00
Jian He
f8488b5aeb YARN-3301. Fixed the format issue of the new RM attempt web page. Contributed by Xuan Gong
(cherry picked from commit 0d3188fd25f31b83caf16b77773620f4ee237409)
2015-05-06 13:51:44 -07:00
Colin Patrick Mccabe
f79b1f0190 HDFS-7847. Modify NNThroughputBenchmark to be able to operate on a remote NameNode (Charles Lamb via Colin P. McCabe)
(cherry picked from commit ffce9a3413277a69444fcb890460c885de56db69)
2015-05-06 10:50:33 -07:00
Vinod Kumar Vavilapalli
da410ea02a YARN-3243. Moving CHANGES.txt entry to the right release.
(cherry picked from commit 185e63a72638f01bb27e790c8dedf458923a2cae)
2015-05-06 10:44:19 -07:00
Xiaoyu Yao
bd88215393 HDFS-8310. Fix TestCLI.testAll 'help: help for find' on Windows. (Kiran Kumar M R via Xiaoyu Yao)
(cherry picked from commit 7a26d174aff9535f7a60711bee586e225891b383)
2015-05-06 10:27:07 -07:00
Xuan
a0445eae5c YARN-3582. NPE in WebAppProxyServlet. Contributed by Jian He
(cherry picked from commit a583a40693f5c56c40b39fd12cfa0bb7174fc526)
2015-05-05 21:43:35 -07:00
Colin Patrick Mccabe
606e4f4940 HADOOP-11912. Extra configuration key used in TraceUtils should respect prefix (Masatake Iwasaki via Colin P. McCabe)
(cherry picked from commit 90b384564875bb353224630e501772b46d4ca9c5)
2015-05-05 17:50:04 -07:00
Allen Wittenauer
b8e4507637 HADOOP-11926. test-patch.sh mv does wrong math (aw) 2015-05-05 17:02:35 -07:00
Haohui Mai
a4f868f0b8 HDFS-8314. Move HdfsServerConstants#IO_FILE_BUFFER_SIZE and SMALL_BUFFER_SIZE to the users. Contributed by Li Lu. 2015-05-05 15:56:08 -07:00
Robert Kanter
bd207b6cc0 MAPREDUCE-6192. Create unit test to automatically compare MR related classes and mapred-default.xml (rchiang via rkanter) 2015-05-05 14:47:52 -07:00
Brandon Li
a9d12128f3 HADOOP-11898. add nfs3 and portmap starting command in hadoop-daemon.sh in branch-2. Contributed by Brandon Li 2015-05-05 14:23:13 -07:00
Allen Wittenauer
f95fd5b6df HADOOP-11925. backport trunk's smart-apply-patch.sh to branch-2 (aw) 2015-05-05 14:11:08 -07:00
Xiaoyu Yao
e68e8b3b5c HDFS-8219. setStoragePolicy with folder behavior is different after cluster restart. (surendra singh lilhore via Xiaoyu Yao)
(cherry picked from commit 0100b155019496d077f958904de7d385697d65d9)
2015-05-05 13:42:22 -07:00
Jian He
eb0c6d2ee7 YARN-3343. Increased TestCapacitySchedulerNodeLabelUpdate#testNodeUpdate timeout. Contributed by Rohith Sharmaks
(cherry picked from commit e4c3b52c896291012f869ebc0a21e85e643fadd1)
2015-05-05 11:34:11 -07:00
Allen Wittenauer
50a5d0b62b HADOOP-11917. test-patch.sh should work with ${BASEDIR}/patchprocess setups (aw) 2015-05-05 11:28:16 -07:00
Colin Patrick Mccabe
1f6bcf94cc HDFS-7758. Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead (Lei (Eddy) Xu via Colin P. McCabe)
(cherry picked from commit 24d3a2d4fdd836ac9a5bc755a7fb9354f7a582b1)
2015-05-05 11:09:28 -07:00
Colin Patrick Mccabe
1f01d8347a HDFS-8305: HDFS INotify: the destination field of RenameOp should always end with the file name (cmccabe)
(cherry picked from commit fcd4cb751665adb241081e42b3403c3856b6c6fe)
2015-05-05 11:06:47 -07:00
Allen Wittenauer
51df9e8379 HADOOP-11904. test-patch.sh goes into an infinite loop on non-maven builds (aw) 2015-05-05 11:05:56 -07:00
Xuan
02cdcaec58 YARN-2123. Progress bars in Web UI always at 100% due to non-US locale.
Contributed by Akira AJISAKA

(cherry picked from commit b7dd3a4f04f712b7594c4e6e7ce50fd314f7c342)
2015-05-05 10:45:18 -07:00
Allen Wittenauer
02892f674b HADOOP-11911. test-patch should allow configuration of default branch (Sean Busbey via aw) 2015-05-05 10:03:22 -07:00
Junping Du
6ea007ba91 YARN-3396. Handle URISyntaxException in ResourceLocalizationService. (Contributed by Brahma Reddy Battula)
(cherry picked from commit 38102420621308f5ba91cdeb6a18a63aa5acf640)
2015-05-05 10:19:16 -07:00
Andrew Wang
84d8ba4f72 HADOOP-11120. hadoop fs -rmr gives wrong advice. Contributed by Juliet Houghland.
(cherry picked from commit 05adc76ace6bf28e4a3ff874044c2c41e3eba63f)
2015-05-05 08:37:41 -07:00
Jason Lowe
0f30913ea8 YARN-3552. RM Web UI shows -1 running containers for completed apps. Contributed by Rohith
(cherry picked from commit 9356cf8676fd18f78655e8a6f2e6c946997dbd40)
2015-05-05 13:43:57 +00:00
Vinayakumar B
01bdfd794c HDFS-7916. 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop (Contributed by Vinayakumar B)
Reverted earlier commit

(cherry picked from commit 318081ccd7af1ec02ec18f35ea95c579326be728)
2015-05-05 11:06:44 +05:30
Tsuyoshi Ozawa
aefadb838c HADOOP-11916. TestStringUtils#testLowerAndUpperStrings failed on MAC due to a JVM bug. Contributed by Ming Ma.
(cherry picked from commit 338e88a19eeb01364c7f5bcdc5f4b5c35d53852d)
2015-05-05 12:39:43 +09:00
Tsuyoshi Ozawa
4e96175b33 MAPREDUCE-6165. [JDK8] TestCombineFileInputFormat failed on JDK8. Contributed by Akira AJISAKA.
(cherry picked from commit 551615fa13f65ae996bae9c1bacff189539b6557)
2015-05-05 10:23:25 +09:00
Jian He
f71c49c5e3 YARN-2725. Added test cases of retrying creating znode in ZKRMStateStore. Contributed by Tsuyoshi Ozawa
(cherry picked from commit d701acc9c67adc578ba18035edde1166eedaae98)
2015-05-04 16:17:01 -07:00
Wangda Tan
4e77ee2f6f YARN-3375. NodeHealthScriptRunner.shouldRun() check is performing 3 times for starting NodeHealthScriptRunner (Devaraj K via wangda)
(cherry picked from commit 71f4de220c74bf2c90630bd0442979d92380d304)
2015-05-04 16:02:57 -07:00
Allen Wittenauer
02e650248d YARN-2980. Move health check script related functionality to hadoop-common (Varun Saxena via aw)
(cherry picked from commit d4ac6822e1c5dfac504ced48f10ab57a55b49e93)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeManager.java
2015-05-04 16:00:20 -07:00
Haohui Mai
db0bd6dca8 HDFS-8237. Move all protocol classes used by ClientProtocol to hdfs-client. Contributed by Haohui Mai. 2015-05-04 15:02:49 -07:00
Jason Lowe
81f128f293 MAPREDUCE-6259. IllegalArgumentException due to missing job submit time. Contributed by zhihai xu
(cherry picked from commit bf70c5ae2824a9139c1aa9d7c14020018881cec2)
2015-05-04 20:40:16 +00:00