Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
13,717 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

13717 Commits

Author SHA1 Message Date
Xuan c143708acf YARN-7257. AggregatedLogsBlock reports a bad 'end' value as a bad 
'start' value. Contributed by Jason Lowe

(cherry picked from commit 28c4957fcc)
(cherry picked from commit 81e7872793)
 2017-09-27 16:04:06 -07:00
Rohith Sharma K S c570ddaa66 YARN-7157. Add admin configuration to filter per-user's apps in secure cluster. Contributed by Sunil G. 2017-09-27 11:49:59 +05:30
Akira Ajisaka 61f41b071d
HADOOP-14822. hadoop-project/pom.xml is executable. Contributed by Ajay Kumar. 
(cherry picked from commit dd378775df)
 2017-09-27 14:27:13 +09:00
Yiqun Lin 2e2f8e42cf HDFS-12495. TestPendingInvalidateBlock#testPendingDeleteUnknownBlocks fails intermittently. Contributed by Eric Badger. 
(cherry picked from commit e9b790db9d)
 2017-09-27 10:45:44 +08:00
Daryn Sharp 7f3ed5f61e [HDFS-12386] Add fsserver defaults call to WebhdfsFileSystem. (Rushabh Shah via daryn) 2017-09-26 15:21:37 -05:00
Steve Loughran 27a41848ac
HADOOP-14890 Move up to AWS SDK 1.11.199. 
Contributed by Steve Loughran.
 2017-09-26 20:11:10 +01:00
Jason Lowe c4de765fcb Revert "YARN-6570. No logs were found for running application, running" 
This reverts commit 6aaca3d08e.
 2017-09-26 10:44:16 -05:00
Jason Lowe 0aac5af6e1 HADOOP-14891. Remove references to Guava Objects.toStringHelper. Contributed by Jonathan Eagles 2017-09-26 10:08:06 -05:00
Rohith Sharma K S c27f682032 YARN-65. Reduce RM app memory footprint once app has completed. Contributed by Manikandan R. 
(cherry picked from commit 06e5a7b5cf)
 2017-09-26 14:50:34 +05:30
Akira Ajisaka b017af2391
HADOOP-14893. WritableRpcEngine should use Time.monotonicNow. Contributed by Chetna Chaudhari. 
(cherry picked from commit d08b8c801a)
 2017-09-26 16:47:50 +09:00
Wangda Tan 179d8dc83c YARN-7118. AHS REST API can return NullPointerException. (Billie Rinaldi via wangda) 
Change-Id: I16ca93385ab80e3680d4d173b8d1b79929ea7174
 2017-09-25 21:41:00 -07:00
Arun Suresh e7199cb494 YARN-7240. Add more states and transitions to stabilize the NM Container state machine. (Kartheek Muthyala via asuresh) 
(cherry picked from commit df800f6cf3)
 2017-09-25 16:36:58 -07:00
Anu Engineer 17b17aed0f HADOOP-14901. ReuseObjectMapper in Hadoop Common. Contributed by Hanisha Koneru. 2017-09-25 13:44:51 -07:00
Jason Lowe 09be0acae0 HADOOP-14881. LoadGenerator should use Time.monotonicNow() to measure durations. Contributed by Bharat Viswanadham 
(cherry picked from commit ac05a51bbb)
 2017-09-25 15:38:52 -05:00
Akira Ajisaka c0dacda546
YARN-7153. Remove duplicated code in AMRMClientAsyncImpl.java. Contributed by Sen Zhao. 
(cherry picked from commit e928ee583c)
 2017-09-26 02:05:35 +09:00
Akira Ajisaka 6004fb4676
HADOOP-14892. MetricsSystemImpl should use Time.monotonicNow for measuring durations. Contributed by Chetna Chaudhari. 
(cherry picked from commit 3a10367a17)
 2017-09-26 01:48:24 +09:00
Anu Engineer de5744c903 HDFS-12531. Fix conflict in the javadoc of UnderReplicatedBlocks.java in branch-2. Contributed by Bharat Viswanadham. 2017-09-23 11:16:50 -07:00
Anu Engineer d0c0bd573b Revert "YARN-7118. AHS REST API can return NullPointerException. Contributed by Billie Rinaldi." 
This reverts commit de1d747644.
 2017-09-23 11:12:16 -07:00
Junping Du de1d747644 YARN-7118. AHS REST API can return NullPointerException. Contributed by Billie Rinaldi. 
(cherry picked from commit 4002bf0a9e)
 2017-09-22 13:59:03 -07:00
Jason Lowe 2c10abaddd MAPREDUCE-6967. gridmix/SleepReducer should use Time.monotonicNow for measuring durations. Contributed by Chetna Chaudhari 
(cherry picked from commit b133dc5700)
 2017-09-22 15:30:53 -05:00
Arpit Agarwal 09290659e7 HDFS-12530. Processor argument in Offline Image Viewer should be case insensitive. Contributed by Hanisha Koneru. 2017-09-22 09:48:10 -07:00
Jason Lowe b94acb6efb MAPREDUCE-6965. QuasiMonteCarlo should use Time.monotonicNow for measuring durations. Contributed by Chetna Chaudhari 
(cherry picked from commit 908d8e914e)
 2017-09-22 09:37:09 -05:00
Akira Ajisaka d80e2f2eae
MAPREDUCE-6966. DistSum should use Time.monotonicNow for measuring durations. Contributed by Chetna Chaudhari. 
(cherry picked from commit c71d137960)
 2017-09-22 15:10:19 +09:00
Akira Ajisaka 9d4de9c556
MAPREDUCE-6947. Moving logging APIs over to slf4j in hadoop-mapreduce-examples. Contributed by Gergely Novák. 
(cherry picked from commit 53be075241)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-examples/src/main/java/org/apache/hadoop/examples/terasort/TeraOutputFormat.java
 2017-09-22 13:29:17 +09:00
Carlo Curino 7cd9018b13 [YARN FEDERATION BACKPORT] Fixing more Java 1.7 compilation issues 2017-09-21 18:19:36 -07:00
Carlo Curino 88b32edb8f YARN-7010. Federation: routing REST invocations transparently to multiple RMs (part 2 - getApps). (Contributed by Giovanni Matteo Fumarola via curino) 
(cherry picked from commit cc8893edc0)
 2017-09-21 18:09:44 -07:00
Arun Suresh 2aacb9d3fb YARN-6923. Metrics for Federation Router. (Giovanni Matteo Fumarola via asuresh) 
(cherry picked from commit ae8fb13b31)
 2017-09-21 18:09:37 -07:00
Arun Suresh ac090b38ad YARN-5603. Metrics for Federation StateStore. (Ellen Hui via asuresh) 
(cherry picked from commit 75abc9a8e2)
 2017-09-21 18:09:30 -07:00
Subru Krishnan 261f769d79 YARN-6900. ZooKeeper based implementation of the FederationStateStore. (Íñigo Goiri via Subru). 
(cherry picked from commit de462da04e)
 2017-09-21 18:09:23 -07:00
Subru Krishnan 9ad067efe9 YARN-6996. Change javax.cache library implementation from JSR107 to Apache Geronimo. (Ray Chiang via Subru). 
(cherry picked from commit 18f3603bce)
 2017-09-21 18:09:16 -07:00
Carlo Curino 8220b19af7 YARN-6896. Federation: routing REST invocations transparently to multiple RMs (part 1 - basic execution). (Contributed by Giovanni Matteo Fumarola via curino) 
(cherry picked from commit cc59b5fb26)
 2017-09-21 18:09:07 -07:00
Subru Krishnan a1ee4ad77f YARN-6970. Add PoolInitializationException as retriable exception in FederationFacade. (Giovanni Matteo Fumarola via Subru). 
(cherry picked from commit ad2a350662)
 2017-09-21 18:08:30 -07:00
Carlo Curino d11be2dcac [YARN FEDERATION BACKPORT] Fix compilation issues due to: hadoop-router/pom.xml versions and Java 1.7 2017-09-21 17:56:46 -07:00
Allen Wittenauer baa2bec843 YARN-2280. Resource manager web service fields are not accessible (Krisztian Horvath via aw) 
(cherry picked from commit a5cf985bf5)
 2017-09-21 17:52:25 -07:00
Carlo Curino d3afff7603 YARN-6853. Add MySql Scripts for FederationStateStore. (Contributed by Giovanni Matteo Fumarola via curino) 
(cherry picked from commit 874ddbf0b5)
(cherry picked from commit 9625a030de)
 2017-09-21 17:15:36 -07:00
Subru Krishnan 190b79af8c YARN-6902. Update Microsoft JDBC Driver for SQL Server version in License.txt. (Botong Huang via Subru). 
(cherry picked from commit c581e94384)
(cherry picked from commit 894ff83dd6)
 2017-09-21 17:15:31 -07:00
Carlo Curino bfd967d338 YARN-5412. Create a proxy chain for ResourceManager REST API in the Router. (Contributed by Giovanni Matteo Fumarola via curino) 
(cherry picked from commit b6240b92ab)
(cherry picked from commit acda6b96a4)
 2017-09-21 17:13:28 -07:00
Subru Krishnan 049f7c84a1 YARN-6866. Minor clean-up and fixes in anticipation of YARN-2915 merge with trunk. (Botong Huang via Subru). 
(cherry picked from commit 40453879ec)
(cherry picked from commit 86f05c3312)
 2017-09-21 16:55:43 -07:00
Subru Krishnan 66980c00f6 Bumping up hadoop-yarn-server-router module to 3.0.0-beta1 post rebase. 
(cherry picked from commit 69e3ed2680)
(cherry picked from commit 8737c2a8e9)
 2017-09-21 16:55:42 -07:00
Subru Krishnan 58e2458c2e Bumping up yarn-server-router (new) module pom to beta1 and fixing imports post rebase. 
(cherry picked from commit f1eff212c5)
(cherry picked from commit 712e97d4cf)
 2017-09-21 16:55:41 -07:00
Subru Krishnan fdbd214d4a YARN-6821. Move FederationStateStore SQL DDL files from test resource to sbin. 
(cherry picked from commit cd9db822f0)
(cherry picked from commit 3e1dc7ece0)
 2017-09-21 16:55:40 -07:00
Subru Krishnan 055138c5c4 YARN-6815. FederationStateStoreFacade return behavior should be consistent irrespective of whether caching is enabled or not. 
(cherry picked from commit 8820693cd7)
(cherry picked from commit 825108d08a)
 2017-09-21 16:55:40 -07:00
Subru Krishnan d3fb1711a4 YARN-6807. Adding required missing configs to Federation configuration guide based on e2e testing. (Tanuj Nayak via Subru). 
(cherry picked from commit b4ac9d1b63)
(cherry picked from commit f427e4201f)
 2017-09-21 16:55:39 -07:00
Subru Krishnan 169037cbb4 YARN-3659. Federation: routing client invocations transparently to multiple RMs. (Giovanni Matteo Fumarola via Subru). 
(cherry picked from commit 52daa6d971)
(cherry picked from commit 43a97174fe)
 2017-09-21 16:55:33 -07:00
Subru Krishnan 8ed4daddc4 YARN-6724. Add ability to blacklist sub-clusters when invoking Routing policies. (Giovanni Matteo Fumarola via Subru). 
(cherry picked from commit f8e5de5969)
(cherry picked from commit 4cfec943b1)
 2017-09-21 16:55:01 -07:00
Subru Krishnan 35a38330ef YARN-6511. Federation: transparently spanning application across multiple sub-clusters. (Botong Huang via Subru). 
(cherry picked from commit 8c988d235e)
(cherry picked from commit 70b1a757f1)
 2017-09-21 16:49:55 -07:00
Subru Krishnan 7ede8c1a53 YARN-3666. Federation Intercepting and propagating AM- home RM communications. (Botong Huang via Subru). 
(cherry picked from commit 2399eb8200)
(cherry picked from commit bed1832c93)
 2017-09-21 16:49:54 -07:00
Subru Krishnan 7dd6caff9e YARN-6484. Documenting the YARN Federation feature. (Carlo Curino via Subru). 
(cherry picked from commit 749ca890e6)
(cherry picked from commit d6c29b2f5b)
 2017-09-21 16:49:54 -07:00
Subru Krishnan b9fdc24e43 YARN-6666. Fix unit test failure in TestRouterClientRMService. (Botong Huang via Subru). 
(cherry picked from commit e750907d0a)
(cherry picked from commit 42949a6e01)
 2017-09-21 16:49:48 -07:00
Subru Krishnan e4832bef6d Bumping up hadoop-yarn-server-router module to 3.0.0-alpha4 post rebase. 
(cherry picked from commit bd9c7b1bec)
(cherry picked from commit f317e0cb48)
 2017-09-21 16:47:50 -07:00