Akira Ajisaka
8969a5d45a
HADOOP-10582. Fix the test case for copying to non-existent dir in TestFsShellCopy. Contributed by Kousuke Saruta.
...
(cherry picked from commit a46506d99cb1310c0e446d590f36fb9afae0fa60)
2015-05-18 16:32:22 +09:00
Akira Ajisaka
b26d99c394
HADOOP-11939. Deprecate DistCpV1 and Logalyzer. Contributed by Brahma Reddy Battula.
...
(cherry picked from commit f5c48238d5eb0c1d2b876f390ac6c35221efcb54)
2015-05-18 16:14:19 +09:00
Akira Ajisaka
343effa2c7
HADOOP-11988. Fix typo in the document for hadoop fs -find. Contributed by Kengo Seki.
...
(cherry picked from commit cab0dadbd878c84e3d94154b4fd1ae3b10f49f93)
2015-05-17 13:36:50 +09:00
Arpit Agarwal
151f6d6dcc
HDFS-8157. Writes to RAM DISK reserve locked memory for block files. (Arpit Agarwal)
2015-05-16 09:05:50 -07:00
Xuan
802676e1be
YARN-3526. ApplicationMaster tracking URL is incorrectly redirected on a QJM cluster. Contributed by Weiwei Yang
...
(cherry picked from commit b0ad644083a0dfae3a39159ac88b6fc09d846371)
2015-05-15 22:41:13 -07:00
Haohui Mai
46d62e7016
HDFS-8403. Eliminate retries in TestFileCreation#testOverwriteOpenForWrite. Contributed by Arpit Agarwal.
2015-05-15 19:12:46 -07:00
Haohui Mai
1796d94d62
HDFS-8394. Move getAdditionalBlock() and related functionalities into a separate class. Contributed by Haohui Mai.
2015-05-15 19:10:05 -07:00
Jing Zhao
d6aa65d037
HDFS-8397. Refactor the error handling code in DataStreamer. Contributed by Tsz Wo Nicholas Sze.
...
(cherry picked from commit 8f378733423a5244461df79a92c00239514b8b93)
2015-05-15 16:32:25 -07:00
Jason Lowe
ce64720516
YARN-2421. RM still allocates containers to an app in the FINISHING state. Contributed by Chang Li
...
(cherry picked from commit f7e051c4310024d4040ad466c34432c72e88b0fc)
2015-05-15 22:10:16 +00:00
Junping Du
cc671349bc
YARN-3505 addendum: fix an issue in previous patch.
...
(cherry picked from commit 03a293aed6de101b0cae1a294f506903addcaa75)
2015-05-15 06:40:28 -07:00
Devaraj K
b9865cbf3d
MAPREDUCE-6273. HistoryFileManager should check whether summaryFile exists
...
to avoid FileNotFoundException causing HistoryFileInfo into MOVE_FAILED
state. Contributed by zhihai xu.
(cherry picked from commit 1ea90144d58443a7431ff33ba49ee19278ebe42b)
2015-05-15 12:34:08 +05:30
Vinayakumar B
d9455c790f
HDFS-6888. Allow selectively audit logging ops (Contributed by Chen He)
...
(cherry picked from commit 7f2e89fa7082840bfa3e8e593c93db050a80d04f)
2015-05-15 11:05:26 +05:30
cnauroth
91855c2340
HADOOP-11960. Enable Azure-Storage Client Side logging. Contributed by Dushyanth.
...
(cherry picked from commit cb8e69a80cecb95abdfc93a787bea0bedef275ed)
2015-05-14 22:22:46 -07:00
Akira Ajisaka
7fb3486eb3
HDFS-8350. Remove old webhdfs.xml and other outdated documentation stuff. Contributed by Brahma Reddy Battula.
2015-05-15 13:57:58 +09:00
Akira Ajisaka
2e5b7f24ab
HDFS-8371. Fix test failure in TestHdfsConfigFields for spanreceiver properties. Contributed by Ray Chiang.
...
(cherry picked from commit cbc01ed08ea36f70afca6112ccdbf7331567070b)
2015-05-15 12:15:26 +09:00
Vinod Kumar Vavilapalli
ad3196e016
Fixing HDFS state-store. Contributed by Arun Suresh.
...
(cherry picked from commit 9a2a9553eee454ecd18120535d3e845f86fc3584)
2015-05-14 16:57:03 -07:00
Vinod Kumar Vavilapalli
87862970f1
Fixing MR intermediate spills. Contributed by Arun Suresh.
...
(cherry picked from commit 6b710a42e00acca405e085724c89cda016cf7442)
2015-05-14 16:56:56 -07:00
Ravi Prakash
4caadaa8bb
YARN-1519. Check in container-executor if sysconf is implemented before using it (Radim Kolar and Eric Payne via raviprak)
...
(cherry picked from commit 53fe4eff09fdaeed75a8cad3a26156bf963a8d37)
2015-05-14 15:56:36 -07:00
cnauroth
fa082e1a0a
HADOOP-11713. ViewFileSystem should support snapshot methods. Contributed by Rakesh R.
...
(cherry picked from commit 09fe16f166392a99e1e54001a9112c6a4632dfc8)
2015-05-14 14:56:13 -07:00
Junping Du
bc13c7d84b
YARN-3505. Node's Log Aggregation Report with SUCCEED should not cached in RMApps. Contributed by Xuan Gong.
...
(cherry picked from commit 15ccd967ee3e7046a50522089f67ba01f36ec76a)
2015-05-14 10:59:48 -07:00
Devaraj K
454236ec19
MAPREDUCE-5708. Duplicate String.format in
...
YarnOutputFiles.getSpillFileForWrite. Contributed by Konstantin Weitz.
(cherry picked from commit 05ff54c66c49301c4ec2549704d9d459e784572c)
2015-05-14 22:11:15 +05:30
Vinayakumar B
4bbcffa510
HDFS-8150. Make getFileChecksum fail for blocks under construction (Contributed by J.Andreina)
...
(cherry picked from commit def9136e0259e118e6fd7b656260765d28ac9ae6)
2015-05-14 15:55:20 +05:30
Vinayakumar B
085841d9ac
HADOOP-8174. Remove confusing comment in Path#isAbsolute() (Contributed by Suresh Srinivas)
...
(cherry picked from commit 0daa5ada68db483275aaa7f2ed9a2b5eaf5bb9bd)
2015-05-14 14:18:00 +05:30
Haohui Mai
4b5915be9f
HDFS-7728. Avoid updating quota usage while loading edits. Contributed by Jing Zhao.
2015-05-13 21:50:41 -07:00
Arpit Agarwal
33f6136ee3
HDFS-8243. Files written by TestHostsFiles and TestNameNodeMXBean are causing Release Audit Warnings. (Contributed by Ruth Wisniewski)
2015-05-13 19:46:34 -07:00
Tsuyoshi Ozawa
9f89c6656e
HADOOP-11361. Fix a race condition in MetricsSourceAdapter.updateJmxCache. Contributed by Brahma Reddy Battula.
...
(cherry picked from commit 4356e8a5ef0ac6d11a34704b80ef360a710e623a)
2015-05-14 10:20:57 +09:00
Wangda Tan
3a11baa15f
YARN-3362. Add node label usage in RM CapacityScheduler web UI. (Naganarasimha G R via wangda)
...
(cherry picked from commit 0e85044e26da698c45185585310ae0e99448cd80)
2015-05-13 17:01:23 -07:00
Colin Patrick Mccabe
52da75180a
HDFS-8380. Always call addStoredBlock on blocks which have been shifted from one storage to another (cmccabe)
...
(cherry picked from commit 281d47a96937bc329b1b4051ffcb8f5fcac98354)
2015-05-13 14:45:37 -07:00
Jason Lowe
a81ad81461
YARN-3641. NodeManager: stopRecoveryStore() shouldn't be skipped when exceptions happen in stopping NM's sub-services. Contributed by Junping Du
...
(cherry picked from commit 711d77cc54a64b2c3db70bdacc6bf2245c896a4b)
2015-05-13 21:08:45 +00:00
Jason Lowe
aefc2bae9e
Update fix version for YARN-3457 and YARN-3537.
...
(cherry picked from commit f7de6198da030cb9cd62dcfd3c378dbbf857e017)
2015-05-13 20:54:21 +00:00
Wangda Tan
d49262a172
YARN-3521. Support return structured NodeLabel objects in REST API (Sunil G via wangda)
...
(cherry picked from commit 7f19e7a2549a098236d06b29b7076bb037533f05)
2015-05-13 13:43:57 -07:00
Wangda Tan
8555a5146d
YARN-3579. CommonNodeLabelsManager should support NodeLabel instead of string label name when getting node-to-label/label-to-label mappings. (Sunil G via wangda)
...
(cherry picked from commit d4f53fc9631d682cd79ba440aefa6750dcc898be)
2015-05-13 13:33:38 -07:00
Xuan
487d9b0f3f
YARN-3626. On Windows localized resources are not moved to the front of the classpath when they should be. Contributed by Craig Welch
...
(cherry picked from commit 0f95921447ea547bdf9caf18f7fde46bc66031f8)
2015-05-13 13:12:04 -07:00
Wangda Tan
3df8880bbe
YARN-2921. Fix MockRM/MockAM#waitForState sleep too long. (Tsuyoshi Ozawa via wangda)
...
(cherry picked from commit 341a476812015d0d584b198b451ea9458645a47c)
2015-05-13 13:07:05 -07:00
cnauroth
ddc4afeff2
HADOOP-11966. Variable cygwin is undefined in hadoop-config.sh when executed through hadoop-daemon.sh. Contributed by Chris Nauroth.
2015-05-13 12:25:49 -07:00
Kihwal Lee
2e9392c157
HDFS-8358. TestTraceAdmin fails. Contributed by Masatake Iwasaki.
...
(cherry picked from commit f9a46a00d2020c6d6466fbc829ada0521cb78dc0)
2015-05-13 14:16:37 -05:00
Tsz-Wo Nicholas Sze
bdf8f64be8
HDFS-8143. Mover should exit after some retry when failed to move blocks. Contributed by surendra singh lilhore
2015-05-13 11:58:35 -07:00
Vinayakumar B
2adb1257b1
HDFS-6300. Prevent multiple balancers from running simultaneously (Contributed by Rakesh R)
...
(cherry picked from commit 065d8f2a34296b566e7ca541a284f7991212f14c)
2015-05-13 17:30:40 +05:30
Akira Ajisaka
b9a92c4452
HADOOP-9723. Improve error message when hadoop archive output path already exists. Contributed by Jean-Baptiste Onofré and Yongjun Zhang.
...
(cherry picked from commit 92c38e41e1fffb9d60d4fa5d4d2212777af9e9a5)
2015-05-13 17:30:49 +09:00
Tsuyoshi Ozawa
780d4f416e
MAPREDUCE-6366. mapreduce.terasort.final.sync configuration in TeraSort doesn't work. Contributed by Takuya Fukudome.
...
(cherry picked from commit e82067bfe680ce04acc0153693cce3cd385e5567)
2015-05-13 16:45:46 +09:00
Akira Ajisaka
345e62c6d5
Revert "MAPREDUCE-5762. Port MAPREDUCE-3223 (Remove MRv1 config from mapred-default.xml) to branch-2. (aajisaka)"
...
This reverts commit 853cc0466811c310486fff6042d7b76ab3b78947.
2015-05-13 14:02:41 +09:00
Zhijie Shen
6043224458
YARN-3539. Updated timeline server documentation and marked REST APIs evolving. Contributed by Steve Loughran.
...
(cherry picked from commit fcd0702c10ce574b887280476aba63d6682d5271)
2015-05-12 21:13:47 -07:00
Akira Ajisaka
7596c6e731
HDFS-6184. Capture NN's thread dump when it fails over. Contributed by Ming Ma.
...
(cherry picked from commit 2463666ecb553dbde1b8c540a21ad3d599239acf)
2015-05-13 11:37:59 +09:00
Vinod Kumar Vavilapalli
d5755ba241
MAPREDUCE-6251. Added a new config for JobClient to retry JobStatus calls so that they don't fail on history-server backed by DFSes with not so strong guarantees. Contributed by Craig Welch.
...
(cherry picked from commit f24452d14e9ba48cdb82e5e6e5c10ce5b1407308)
2015-05-12 12:13:23 -07:00
Karthik Kambatla
9d6c63f8be
YARN-3613. TestContainerManagerSecurity should init and start Yarn cluster in setup instead of individual methods. (nijel via kasha)
...
(cherry picked from commit fe0df596271340788095cb43a1944e19ac4c2cf7)
2015-05-12 10:45:51 -07:00
Haohui Mai
8011d4688f
HADOOP-11962. Sasl message with MD5 challenge text shouldn't be LOG out even in debug level. Contributed by Junping Du.
2015-05-12 10:30:43 -07:00
Devaraj K
5fceebd696
YARN-3629. NodeID is always printed as "null" in node manager
...
initialization log. Contributed by nijel.
(cherry picked from commit 5c2f05cd9bad9bf9beb0f4ca18f4ae1bc3e84499)
2015-05-12 22:22:40 +05:30
Tsuyoshi Ozawa
fb5b0ebb45
MAPREDUCE-6361. NPE issue in shuffle caused by concurrent issue between copySucceeded() in one thread and copyFailed() in another thread on the same host. Contributed by Junping Du.
...
(cherry picked from commit f4e2b3cc0b1f4e49c306bc09a9dddd0495225bb2)
2015-05-13 00:28:36 +09:00
yliu
c31c6fbda7
HDFS-8255. Rename getBlockReplication to getPreferredBlockReplication. (Contributed by Zhe Zhang)
2015-05-12 21:26:57 +08:00
Devaraj K
f887243f88
YARN-3513. Remove unused variables in ContainersMonitorImpl and add debug
...
log for overall resource usage by all containers. Contributed by
Naganarasimha G R.
(cherry picked from commit 8badd82ce256e4dc8c234961120d62a88358ab39)
2015-05-12 16:56:26 +05:30