Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
13,178 Commits 326 Branches 371 Tags
Commit Graph

13178 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Daniel Templeton
2dae9299ef YARN-6343. Docker docs MR example is broken (Contributed by Prashant Jha via Daniel Templeton) 
(cherry picked from commit 14a39907c636420800210b984f2f78b639c8382c)
 2017-04-10 10:03:06 -07:00
Akira Ajisaka
21af5be51a
HADOOP-14290. Update SLF4J from 1.7.10 to 1.7.25. 
(cherry picked from commit 5d38504071d72745c42588c7a6e76bcffb13832c)
 2017-04-09 01:48:03 +09:00
Karthik Kambatla
e0b143e51a Revert "YARN-6298. Metric preemptCall is not used in new preemption. (Yufei Gu via kasha)" 
This reverts commit dcfce5fcddcfdd23392586c87adf7c14e8ef265e.
 2017-04-07 17:37:31 -07:00
Karthik Kambatla
dcfce5fcdd YARN-6298. Metric preemptCall is not used in new preemption. (Yufei Gu via kasha) 
(cherry picked from commit 2aa8967809b05e558b36ab6fc8c5110ddb723b45)
 2017-04-07 17:36:39 -07:00
John Zhuge
ff2870310e HADOOP-14174. Set default ADLS access token provider type to ClientCredential. Contributed by John Zhuge. 
Signed-off-by: John Zhuge <jzhuge@apache.org>
(cherry picked from commit 56e81f2a204d5e65d29222df1b2ba4d892f9c0d5)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/conf/TestCommonConfigurationFields.java
 2017-04-07 15:01:29 -07:00
Robert Kanter
cbb1c76195 YARN-6368. Decommissioning an NM results in a -1 exit code (miklos.szegedi@cloudera.com via rkanter) 
(cherry picked from commit 63f7322522e0ab223ceb91440636eb62ca0a3e41)
 2017-04-07 14:28:39 -07:00
Zhe Zhang
c85026038a HADOOP-14276. Add a nanosecond API to Time/Timer/FakeTimer. Contributed by Erik Krogen. 
(cherry picked from commit 95b7f1d29a5e2dadd70a56fca5faa006c5bd74fc)
 2017-04-07 10:39:40 -07:00
Akira Ajisaka
a467e5412e
YARN-6288. Addendum patch to fix compile error. 2017-04-07 12:19:46 +09:00
Ming Ma
db5b4c292b YARN-5797. Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches. (Chris Trezzo via mingma) 2017-04-06 17:08:59 -07:00
Xiaoyu Yao
0391c92022 HDFS-11608. HDFS write crashed with block size greater than 2 GB. Contributed by Xiaobing Zhou. 
(cherry picked from commit 0eacd4c13be9bad0fbed9421a6539c64bbda4df1)
 2017-04-06 16:15:56 -07:00
Andrew Wang
ed8f738be5 HADOOP-14104. Client should always ask namenode for kms provider path. Contributed by Rushabh S Shah. 2017-04-06 14:38:22 -07:00
Xiaoyu Yao
325be6e720 HDFS-11362. StorageDirectory should initialize a non-null default StorageDirType. Contribute by Hanisha Koneru. 
(cherry picked from commit dde3bbf351ef3121ae80a96d06668d8fe33c788f)
 2017-04-06 14:33:30 -07:00
Jason Lowe
84b7f2e956 YARN-6288. Exceptions during aggregated log writes are mishandled. Contributed by Akira Ajisaka 
(cherry picked from commit 1b081ca27e05e97d8b7d284ca24200d43763e481)
 2017-04-06 16:25:41 -05:00
Andrew Wang
832c2f52f8 HADOOP-13688. Stop bundling HTML source code in javadoc JARs. 
(cherry picked from commit 72a2ae6452e615c66d10829da38737896814e02b)
 2017-04-06 13:14:59 -07:00
Junping Du
98759b426c HADOOP-13996. Fix some release build issues, include gpg timeout and disable sign for hadoop-dist. Contributed by Andrew Wang. 2017-04-06 13:06:10 -07:00
Xiaoyu Yao
9016614eb1 HDFS-11302. Improve Logging for SSLHostnameVerifier. Contributed by Chen Liang. 
(cherry picked from commit 32bb36b750ab656f2f32f6c74eaa1a3e68ae956e)
 2017-04-05 18:30:33 -07:00
Arpit Agarwal
75e60b6bb7 HDFS-11131. TestThrottledAsyncChecker#testCancellation is flaky. 2017-04-05 17:54:27 -07:00
Daniel Templeton
2f32accaaf MAPREDUCE-6846. Fragments specified for libjar paths are not handled correctly 
(Contributed by Chris Trezzo via Daniel Templeton)

(cherry picked from commit a92bc8a6c1c50d34d8229a67dc9d197823001551)
 2017-04-05 17:26:06 -07:00
Daniel Templeton
59ad5cd68d YARN-6381. FSAppAttempt has several variables that should be final 
(Contributed by Ameet Zaveri via Daniel Templeton)

(cherry picked from commit 984df31a31c25ffc8541467dc41913f62f69e1df)
 2017-04-05 16:44:35 -07:00
Karthik Kambatla
7c0f9bd5e7 YARN-6448. Continuous scheduling thread crashes while sorting nodes. (Yufei Gu via kasha) 
(cherry picked from commit b4c4f365948d36b36942f912ef994c1c21ba59e3)
 2017-04-05 16:00:30 -07:00
Chris Douglas
72aa0a7ab3 HADOOP-13626. Remove distcp dependency on FileStatus serialization 
(cherry picked from commit a1a0281e12ea96476e75b076f76d5b5eb5254eea)
 2017-04-05 15:47:46 -07:00
Xiaobing Zhou
9f20532ef5 HDFS-11628. Clarify the behavior of HDFS Mover in documentation. Contributed by Xiaobing Zhou. 2017-04-05 15:33:19 -07:00
Varun Saxena
0a7ec1fcf7 YARN-6437. TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently (Jason Lowe via Varun Saxena) 
(cherry picked from commit 7d963c477ab997e0daad760dd3c568d7010fe511)
 2017-04-06 01:58:32 +05:30
Andrew Wang
e154893d3b HDFS-11538. Move ClientProtocol HA proxies into hadoop-hdfs-client. Contributed by Huafeng Wang. 2017-04-05 12:52:34 -07:00
Andrew Wang
3660309fd0 Revert "Revert "Revert "HDFS-11431. hadoop-hdfs-client JAR does not include ConfiguredFailoverProxyProvider.""" 
This reverts commit c51507dde030d2ddcff18a8a06b8211af89fab2b.
 2017-04-05 12:50:21 -07:00
Jason Lowe
903278559a YARN-6403. Invalid local resource request can raise NPE and make NM exit. Contributed by Tao Yang 
(cherry picked from commit e8071aa249c7b21b1de084ee5a9ca2a44efd3bf0)
 2017-04-05 12:31:48 -05:00
Hanisha Koneru
4cdda4ba87 HDFS-11545. Propagate DataNode's slow disks info to the NameNode via Heartbeat. Contributed by Hanisha Koneru. 2017-04-05 07:35:09 -07:00
Akira Ajisaka
438901f6c8
MAPREDUCE-6824. TaskAttemptImpl#createCommonContainerLaunchContext is longer than 150 lines. Contributed by Chris Trezzo. 2017-04-05 16:45:38 +09:00
Varun Saxena
05c008256a YARN-6420. RM startup failure due to wrong order in nodelabel editlog (Bibin A Chundatt via Varun Saxena) 
(cherry picked from commit 19b89c4c7be0236aafded560b7bcad7e39d1c4ed)
 2017-04-05 09:40:09 +05:30
Akira Ajisaka
88e1799034
HDFS-9651. Add missing robots.txt files. 
(cherry picked from commit 8cb73255274bd46ea8aedbb28f25fa13b38723ad)
 2017-04-05 12:48:12 +09:00
Akira Ajisaka
a563fa8ee9
HDFS-9651. All web UIs should include a robots.txt file. Contributed by Lars Francke. 
(cherry picked from commit 09e6caec3dbba257f11fe7246d4c25ee8fc95d8b)
 2017-04-05 12:46:09 +09:00
Ming Ma
7507ccd38a YARN-6004. Refactor TestResourceLocalizationService#testDownloadingResourcesOnContainer so that it is less than 150 lines. (Chris Trezzo via mingma) 2017-04-04 18:05:09 -07:00
Karthik Kambatla
1938f97c0b YARN-6436. TestSchedulingPolicy#testParseSchedulingPolicy timeout is too low. (Eric Badger via kasha) 
(cherry picked from commit 9cc04b4708879012da1f9ef690679d8d1e45c0cc)
 2017-04-04 17:08:59 -07:00
Wangda Tan
70a810adc0 YARN-6109. Add an ability to convert ChildQueue to ParentQueue. (Xuan Gong via wangda) 
(cherry picked from commit 3fdae0a2b66c5fb6853875b66fcf50bc96d6e2e9)
 2017-04-04 14:39:38 -07:00
Mingliang Liu
8ee3e7e4b1 HADOOP-14273. Azure: NativeAzureFileSystem should respect config for kerberosSupportEnabled flag. Contributed by Santhosh G Nayak 
(cherry picked from commit 56ab02eed9b61e1c80605104dfc4c87fc6abac96)
 2017-04-04 11:16:48 -07:00
Mingliang Liu
ce8cdc109b HADOOP-14272. Azure: WasbRemoteCallHelper should use String equals for comparison. Contributed by Santhosh G Nayak 
(cherry picked from commit 27a44b60c1a55cabbf1873bca62db4e321c901ca)
 2017-04-04 11:04:42 -07:00
Hanisha Koneru
fbe86471cf HDFS-11551. Support Timeout when checking single disk. Contributed by Hanisha Koneru. 2017-04-04 10:49:44 -07:00
Mingliang Liu
8c21b2a259 HADOOP-14268. Fix markdown itemization in hadoop-aws documents. Contributed by Akira Ajisaka 
(cherry picked from commit 5faa949b782be48ef400d2eb1695f420455de764)
 2017-04-03 11:07:56 -07:00
Wei-Chiu Chuang
4f1f16f1a6 HDFS-11515. -du throws ConcurrentModificationException. Contributed by Istvan Fajth, Wei-Chiu Chuang. 
(cherry picked from commit bc7aff7cec07bbc3fed63a00c8f1584c34670998)
 2017-04-03 07:36:08 -07:00
Eric Payne
4396c8e938 YARN-6354. LeveldbRMStateStore can parse invalid keys when recovering reservations. Contributed by Jason Lowe 
(cherry picked from commit 318bfb01bc6793da09e32e9cc292eb63224b6ca2)
 2017-03-31 12:36:01 -05:00
Jason Lowe
3ae529ba54 YARN-6411. Clean up the overwrite of createDispatcher() in subclass of MockRM. Contributed by Yufei Gu 
(cherry picked from commit 4d1fac5df2508011adfc4c5d683beb00fd5ced45)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/api/impl/TestAMRMClientOnRMRestart.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/security/TestClientToAMTokens.java
 2017-03-31 10:21:44 -05:00
Mingliang Liu
9e7f8cbf9a HDFS-11592. Closing a file has a wasteful preconditions in NameNode. Contributed by Eric Badger 
(cherry picked from commit e5f0622a6f40706d360d45200c8f259c79046438)
 2017-03-30 15:44:44 -07:00
Jonathan Eagles
60e65a3e55 HADOOP-14216. Addendum to Improve Configuration XML Parsing Performance (jeagles) 2017-03-30 14:15:37 -05:00
Jason Lowe
a52b30f7e8 MAPREDUCE-6836. exception thrown when accessing the job configuration web UI. Contributed by Haibo Chen 
(cherry picked from commit c9b7ce92737f0a829408936ed9a361220d3e9680)
 2017-03-30 12:56:04 -05:00
Jason Lowe
526499533e MAPREDUCE-6850. Shuffle Handler keep-alive connections are closed from the server side. Contributed by Jonathan Eagles 
(cherry picked from commit c8bd5fc7a86f9890ceaa37a89491ab650e7e9a64)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-shuffle/src/main/java/org/apache/hadoop/mapred/ShuffleHandler.java
 2017-03-30 11:10:20 -05:00
Akira Ajisaka
bb187e145a
HADOOP-14256. [S3A DOC] Correct the format for "Seoul" example. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 0d053eeb3002f348d34cf3aac5b43333af8ff10a)
 2017-03-30 18:13:01 +09:00
Zhe Zhang
3f5dc51ec9 MAPREDUCE-6873. MR Job Submission Fails if MR framework application path not on defaultFS. Contributed by Erik Krogen. 
(cherry picked from commit de7efd2687ccb74608249abf4c83c84a9345ec0a)
 2017-03-29 22:11:22 -07:00
Ming Ma
2ae9ae1864 MAPREDUCE-6862. Fragments are not handled correctly by resource limit checking. (Chris Trezzo via mingma) 
(cherry picked from commit ceab00ac62f8057a07b4b936799e6f04271e6e41)
 2017-03-29 17:42:40 -07:00
Varun Saxena
3fe7d36e72 YARN-6352. Header injections are possible in application proxy servlet (Naganarasimha G R via Varun Saxena) 2017-03-30 03:49:32 +05:30
Daniel Templeton
c2636468d7 YARN-5685. RM configuration allows all failover methods to disabled when automatic failover is enabled 
(cherry picked from commit 640ba1d23fe8b8105bae6d342ddc1c839302f8e5)
 2017-03-29 12:38:50 -07:00