11069 Commits

Author SHA1 Message Date
Karthik Kambatla
bbe9bb078c YARN-4812. TestFairScheduler#testContinuousScheduling fails intermittently. (kasha)
(cherry picked from commit f84af8bd588763c4e99305742d8c86ed596e8359)
2016-03-17 05:54:40 -07:00
Akira Ajisaka
365d236175 MAPREDUCE-6645. TestWordStats outputs logs under directories other than target/test-dir. Contributed by Gabor Liptak.
(cherry picked from commit 80fa70c4e15f16b411cb3691df546499c6a19d4c)
2016-03-17 18:09:20 +09:00
Andrew Wang
d4370f224b HDFS-10173. Typo in DataXceiverServer. Contributed by Michael Han.
(cherry picked from commit 02a250db9f4bc54436cd9900a084215e5e3c8dae)
2016-03-16 18:50:00 -07:00
Wangda Tan
484976fa2b YARN-4108. CapacityScheduler: Improve preemption to only kill containers that would satisfy the incoming request. (Wangda Tan)
(cherry picked from commit 7e8c9beb4156dcaeb3a11e60aaa06d2370626913)
(cherry picked from commit ae14e5d07f1b6702a5160637438028bb03d9387e)
2016-03-16 17:03:35 -07:00
Steve Loughran
186a7c6bb3 YARN-4593 Deadlock in AbstractService.getConfig() (stevel) 2016-03-16 14:35:13 +00:00
Steve Loughran
1463400aad HADOOP-12888 Shell to disable bash and setsid support when running under JVM security manager (Costin Leau via stevel) 2016-03-16 14:31:50 +00:00
Karthik Kambatla
ab03266831 YARN-4560. Make scheduler error checking message more user friendly. (Ray Chiang via kasha)
(cherry picked from commit 3ef5500783f043ff206458d8c10ed3d5405a8b0c)
2016-03-15 23:47:19 -07:00
Xuan
398dbde538 Revert "YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. (Xuan Gong via gtcarrera9)"
This reverts commit 3a0b69544183f71c4683bc477656473494fc09d0.

(cherry picked from commit a888b5bc533bb91a3394f15a69879be1d7838592)
2016-03-15 22:11:16 -07:00
Wangda Tan
abfb2957d1 MAPREDUCE-6579. JobStatus#getFailureInfo should not output diagnostic information when the job is running. (Akira AJISAKA via wangda)
(cherry picked from commit 6529c87551e07e9da1e1b273eff4c6bad6b3e838)
2016-03-15 17:30:37 -07:00
Li Lu
94649b9cc0 YARN-4817. Change Log Level to DEBUG for putDomain call in ATS 1.5. (Xuan Gong via gtcarrera9)
(cherry-picked from commit 5176a69868484f864c977a6cd13923167082407c)
2016-03-15 11:48:37 -07:00
Li Lu
14a4110b75 YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. (Xuan Gong via gtcarrera9)
(cherry picked from commit 3a0b69544183f71c4683bc477656473494fc09d0)
2016-03-15 11:42:30 -07:00
Robert Kanter
da24fde333 TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IllegalArgumentException from cleanup (templedf via rkanter)
(cherry picked from commit 22ca176dfe125a4f7bf38cc63ab8106c40a7a7ba)
2016-03-15 10:05:28 -07:00
Kihwal Lee
8b00d9de25 HDFS-9904. testCheckpointCancellationDuringUpload occasionally fails. Contributed by Lin Yiqun.
(cherry picked from commit d4574017845cfa7521e703f80efd404afd09b8c4)
2016-03-15 10:54:37 -05:00
Masatake Iwasaki
d595429538 HDFS-9928. Make HDFS commands guide up to date (Wei-Chiu Chuang via iwasakims) 2016-03-15 21:04:14 +09:00
Siddharth Seth
edd9abf302 YARN-4816. Fix incompatible change in SystemClock.
(cherry picked from commit eba66a64d28b50a660d6f537c767677f5fa0f7ea)
2016-03-14 20:15:41 -07:00
Tsz-Wo Nicholas Sze
f85d979a3f HADOOP-12923. Move the test code in ipc.Client to test. 2016-03-14 15:49:34 -07:00
Colin Patrick Mccabe
8ac3fc7540 HDFS-9947. Block#toString should not output information from derived classes (cmccabe)
(cherry picked from commit 9a43094e12ab8d35d49ceda2e2c5f83093bb3a5b)
2016-03-14 14:59:46 -07:00
Ravi Prakash
51b7d8935a HDFS-9953. Download File from UI broken after pagination. Contributed by Brahma Reddy Battula 2016-03-14 14:32:42 -07:00
Karthik Kambatla
b4c8693096 YARN-4719. Add a helper library to maintain node state and allows common queries. (kasha)
(cherry picked from commit 20d389ce61eaacb5ddfb329015f50e96ad894f8d)
2016-03-14 14:22:21 -07:00
Chris Nauroth
dd462bc32f HDFS-9941. Do not log StandbyException on NN, other minor logging fixes. Contributed by Arpit Agarwal.
(cherry picked from commit 5644137adad30c84e40d2c4719627b3aabc73628)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockUnderConstructionFeature.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirWriteFileOp.java
2016-03-14 09:55:27 -07:00
Junping Du
3d5ac829da YARN-4545. Allow YARN distributed shell to use ATS v1.5 APIs. Li Lu via junping_du
(cherry picked from commit f291d82cd49c04a81380bc45c97c279d791b571c)
2016-03-14 08:30:07 -07:00
Colin Patrick Mccabe
b67b5b09a7 HDFS-9942. Add an HTrace span when refreshing the groups for a username (cmccabe)
(cherry picked from commit 6e9a582eb1ab040f532fbe95694f5272cda34188)
2016-03-11 12:27:12 -08:00
Steve Loughran
1c96fd0a23 Revert "HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims)"
This reverts commit 7994ab3fa01699ebea3edb3d0b28946e90825ba2.
2016-03-11 16:59:42 +00:00
Akira Ajisaka
c2e14d1bbb MAPREDUCE-6520. Migrate MR Client test cases part 1. Contributed by Dustin Cote.
(cherry picked from commit 247a7906092065289ea81139e71badcac6abef1e)
2016-03-11 22:54:40 +09:00
Akira Ajisaka
99f61afcdd Revert "MAPREDUCE-6520. Migrate MR Client test cases part 1."
This reverts commit 7d665f0a987c17dcf8a26113c61a70dee196ee3d.
2016-03-11 22:52:10 +09:00
Akira Ajisaka
7d665f0a98 MAPREDUCE-6520. Migrate MR Client test cases part 1.
(cherry picked from commit ef68b441957c6deb65adae2272d60ac929d00733)
2016-03-11 22:25:29 +09:00
Masatake Iwasaki
7994ab3fa0 HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims)
(cherry picked from commit 682adc6ba9db3bed94fd4ea3d83761db6abfe695)
2016-03-11 15:05:34 +09:00
Arpit Agarwal
b0ea50bb29 HDFS-1477. Support reconfiguring dfs.heartbeat.interval and dfs.namenode.heartbeat.recheck-interval without NN restart. (Contributed by Xiaobing Zhou) 2016-03-10 19:05:22 -08:00
Colin Patrick Mccabe
710811652c HDFS-9933. ReverseXML should be capitalized in oiv usage message (cmccabe)
(cherry picked from commit 79961ecea888e0ee85b7a75e239bb6bb3335eb17)
2016-03-10 13:45:02 -08:00
Colin Patrick Mccabe
c82d1e1187 HDFS-9934. ReverseXML oiv processor should bail out if the XML file's layoutVersion doesn't match oiv's (cmccabe)
(cherry picked from commit bd49354c6d6387620b0de2219eab1714ec2d64f8)
2016-03-10 13:41:32 -08:00
Colin Patrick Mccabe
b8b580e6b8 HDFS-9927. Document the new OIV ReverseXML processor (Wei-Chiu Chuang via cmccabe)
(cherry picked from commit 500875dfccdb3bb6709767962d1927ddb1cc5514)
2016-03-10 13:39:20 -08:00
Li Lu
2b16a54fbe YARN-4696. Improving EntityGroupFSTimelineStore on exception handling, test setup, and concurrency.
This commit amends commit d49cfb350454c2dfa2f3eb70f79b6d5030ce7bec with a missed test file.

(cherry picked from commit 017d2c127b9cbd75d3e31467172ed832f27ef826)
2016-03-10 13:04:57 -08:00
Li Lu
92125e6057 HADOOP-12906. AuthenticatedURL should convert a 404/Not Found into an FileNotFoundException. (Steve Loughran via gtcarrera9)
(cherry-picked from commit 9a79b738c582bd84727831987b845535625d75fe)
2016-03-10 11:39:44 -08:00
Li Lu
76ef097fd1 YARN-4696. Improving EntityGroupFSTimelineStore on exception handling, test setup, and concurrency. (Steve Loughran via gtcarrera9)
(cherry-picked from commit d49cfb350454c2dfa2f3eb70f79b6d5030ce7bec)
2016-03-10 10:56:51 -08:00
Harsh J
2e32aa5475 HADOOP-11404. Clarify the "expected client Kerberos principal is null" authorization message. Contributed by Stephen Chu
(cherry picked from commit 318c9b68b059981796f2742b4b7ee604ccdc47e5)
2016-03-10 17:09:56 +05:30
Allen Wittenauer
95d30a6ec6 HADOOP-12798. Update changelog and release notes (2016-03-04) (aw)
(cherry picked from commit 55f73a1cbd45a62774e471b7a8a1e0cc40eecdd4)
2016-03-09 19:39:13 -08:00
Allen Wittenauer
140a33df9b HADOOP-11791. Update src/site/markdown/releases to include old versions of Hadoop (aw)
(cherry picked from commit d759b4bd74ae3d530f8091fa5765664fc850530b)
2016-03-09 19:39:05 -08:00
Allen Wittenauer
9f4b3eaac0 Revert "HADOOP-12366. expose calculated paths (aw)"
This reverts commit 45bb467918ce986760ba5f7a948cf016656f0e57.
2016-03-09 09:59:19 -08:00
Arpit Agarwal
a06ecb085e HADOOP-12903. IPC Server should allow suppressing exception logging by type, not log 'server too busy' messages. (Arpit Agarwal) 2016-03-08 23:30:36 -08:00
Akira Ajisaka
0d8ad99e0d HADOOP-12688. Fix deadlinks in Compatibility.md. Contributed by Gabor Liptak.
(cherry picked from commit 4cbefafcac4e7b20a23b7b416af1a2efe71e1080)
2016-03-09 15:33:14 +09:00
Chris Nauroth
38a031ce68 HADOOP-12905. Clean up CHANGES.txt RAT exclusions from pom.xml files. Contributed by Chris Nauroth.
(cherry picked from commit 89b16d27e26216fc4e5153683105b323c310a0af)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/pom.xml
	hadoop-mapreduce-project/pom.xml
2016-03-08 21:22:57 -08:00
Allen Wittenauer
837a2c5450 HADOOP-12904. Update Yetus to 0.2.0 (aw) 2016-03-08 16:45:46 -08:00
Wangda Tan
f7b38a7fb8 YARN-4465. SchedulerUtils#validateRequest for Label check should happen only when nodelabel enabled. (Bibin A Chundatt via wangda)
(cherry picked from commit 0233d4e0ee9947a95c018b1539310fc0bff6c44e)
2016-03-08 14:28:26 -08:00
Andrew Wang
7e29d732ee HADOOP-12895. SSLFactory#createSSLSocketFactory exception message is wrong. Contributed by Wei-Chiu Chuang.
(cherry picked from commit a3cc6e2511e096ea9a54f500b59257866a1df66b)
2016-03-08 13:52:01 -08:00
Jian He
fb139b0c40 YARN-4764. Application submission fails when submitted queue is not available in scheduler xml. Contributed by Bibin A Chundatt
(cherry picked from commit 3c33158d1cb38ee4ab3baa21752a3cdf0bdc8ccc)
2016-03-08 13:12:33 -08:00
Akira Ajisaka
0586386472 HADOOP-12860. Expand section "Data Encryption on HTTP" in SecureMode documentation. Contributed by Wei-Chiu Chuang.
(cherry picked from commit f86850b544dcb34ee3c9336fad584309e886dbed)
2016-03-08 14:29:46 +09:00
Arpit Agarwal
9d67f98e05 HDFS-9882. Add heartbeatsTotal in Datanode metrics. (Contributed by Hua Liu) 2016-03-07 21:10:34 -08:00
Ming Ma
aae39ff973 HADOOP-12789. log classpath of ApplicationClassLoader at INFO level. (Sangjin Lee via mingma)
(cherry picked from commit 49eedc7ff02ea61764f416f0e2ddf81370aec5fb)
2016-03-07 20:27:10 -08:00
Akira Ajisaka
fe0009a2bd HDFS-9812. Streamer threads leak if failure happens when closing DFSOutputStream. Contributed by Lin Yiqun.
(cherry picked from commit 352d299cf8ebe330d24117df98d1e6a64ae38c26)
2016-03-08 10:55:59 +09:00
Andrew Wang
fed2339e28 HADOOP-12901. Add warning log when KMSClientProvider cannot create a connection to the KMS server. (Xiao Chen via wang)
(cherry picked from commit 391da36d93358038c50c15d91543f6c765fa0471)
2016-03-07 14:00:08 -08:00