Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,297 Commits 326 Branches 371 Tags
Commit Graph

17297 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Inigo Goiri
e8b511ca33 HDFS-12384. Fixing compilation issue with BanDuplicateClasses. Contributed by Inigo Goiri. 
(cherry picked from commit fabe02c8fafa807198054da0c02b2ebaafda76aa)
 2017-10-06 19:04:44 -07:00
Inigo Goiri
ad48e844fa HDFS-10631. Federation State Store ZooKeeper implementation. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 23c4ddee11ab1300325a6361124ee8ad6f68d7a4)
 2017-10-06 19:04:44 -07:00
Inigo Goiri
503849477a HDFS-12312. Rebasing HDFS-10467 (2). Contributed by Inigo Goiri. 
(cherry picked from commit 90ba6843fb3ac5dc7576535e66a75a5e3433247b)
 2017-10-06 19:04:43 -07:00
Inigo Goiri
24d275842f HDFS-11554. [Documentation] Router-based federation documentation. Contributed by Inigo Goiri. 
(cherry picked from commit ee3260211d94aed223dd6f2386a166eb2c7d67af)
 2017-10-06 19:04:43 -07:00
Inigo Goiri
54a355dc8d HDFS-10646. Federation admin tool. Contributed by Inigo Goiri. 
(cherry picked from commit ae27e31fbcf546481db0b0345772db2e9132372e)
 2017-10-06 19:04:43 -07:00
Inigo Goiri
a0cce0fa0b HDFS-10880. Federation Mount Table State Store internal API. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 58b97df661441150d35abd44b3a8606206b46441)
 2017-10-06 19:04:42 -07:00
Inigo Goiri
c0fb7b283e HDFS-11826. Federation Namenode Heartbeat. Contributed by Inigo Goiri. 
(cherry picked from commit 928f8dab52191e733984d37f47b69719ccf11313)
 2017-10-06 19:04:41 -07:00
Inigo Goiri
a11e99efeb HDFS-10687. Federation Membership State Store internal API. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 95cae08849d23cf12c5d280c29f90908e6a90d40)
 2017-10-06 19:04:41 -07:00
Inigo Goiri
ad0fca5dea HDFS-12223. Rebasing HDFS-10467. Contributed by Inigo Goiri. 
(cherry picked from commit 47db6e9d8e2c264671c89fdd6cb11a7c762d2cce)
 2017-10-06 19:04:41 -07:00
Inigo Goiri
2b99a4d29f HDFS-11546. Federation Router RPC server. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 8a9cdebebf26841a0f1e99fb08135f4597f2eba2)
 2017-10-06 19:04:40 -07:00
Inigo Goiri
9b09f73006 HDFS-10630. Federation State Store FS Implementation. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit c6e0bd640cdaf83a660fa050809cad6f1d4c6f4d)
 2017-10-06 19:04:40 -07:00
Inigo
05afc382d9 HDFS-10882. Federation State Store Interface API. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 6d94c90ece1c1d23d4c97e72c54e9991f5dbc481)
 2017-10-06 19:04:39 -07:00
Inigo
ff134679e0 HDFS-10881. Federation State Store Driver API. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 0f88e049156dce173afc0dbda864e29190dd2210)
 2017-10-06 19:04:39 -07:00
Inigo
9e3491fafa HDFS-10629. Federation Roter. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 6821e801724ac38e9737538b2164c9ae88792282)
 2017-10-06 19:04:16 -07:00
Yufei Gu
4cfc7d0af6 YARN-7207. Cache the RM proxy server address. (Yufei Gu) 
(cherry picked from commit 72d22b753abde4d07a727479d3f3d5d84d5dd6b2)

# Conflicts:
#	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMContext.java
#	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMContextImpl.java
 2017-10-06 10:03:48 -07:00
Yufei Gu
9bb9831347 YARN-2162. Add ability in Fair Scheduler to optionally configure maxResources in terms of percentage. (Yufei Gu) 2017-10-06 00:29:15 -07:00
Xiao Chen
3106552b75 HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah. 
(cherry picked from commit 212342d6db14673f8f5652a5209e1c4fcc0f0ede)
 2017-10-05 19:47:13 -07:00
Andrew Wang
e159272003 HDFS-12567. BlockPlacementPolicyRackFaultTolerant fails with racks with very few nodes. 
(cherry picked from commit 644c2f6924f341f51d809c91dccfff88fc82f6f0)
 2017-10-05 16:58:46 -07:00
Haibo Chen
c021c8a19f YARN-7009. TestNMClient.testNMClientNoCleanupOnStop is flaky by design. (Miklos Szegedi via Haibo Chen) 
(cherry picked from commit c071aad5da6f6601978e73d38ce5813958848bc4)
 2017-10-05 15:51:08 -07:00
Chris Trezzo
e5af16cf6c YARN-2960. Add documentation for the YARN shared cache. 
(cherry picked from commit 7e76f85bc68166b01b51fcf6ba4b3fd9281d4a03)
 2017-10-05 11:15:39 -07:00
Chris Trezzo
4b9b66f921 Revert "YARN-2960. Add documentation for the YARN shared cache." 
This reverts commit 54a01c28cc153872aa7eed68000ab0ddf010054a.
 2017-10-05 11:11:02 -07:00
Chris Trezzo
54a01c28cc YARN-2960. Add documentation for the YARN shared cache. 
(cherry picked from commit 7e76f85bc68166b01b51fcf6ba4b3fd9281d4a03)
 2017-10-05 10:54:44 -07:00
Arun Suresh
b61d12e300 YARN-7258. Add Node and Rack Hints to Opportunistic Scheduler. (Kartheek Muthyala via asuresh). 
(cherry picked from commit b733348dde18a242e6c9074c512116a8baf1d281)
 2017-10-05 10:06:30 -07:00
Sunil G
807d8b41ad YARN-6182. Fix alignment issues and missing information in new YARN UI's Queue page. Contributed by Akhil PB. 
(cherry picked from commit f702c9575495e3af99d4b5cae9f73969e1a6dfc2)
 2017-10-05 11:35:36 +05:30
Sunil G
6a152b3e91 YARN-7279. Fix typo in helper message of ContainerLauncher. Contributed by Elek, Marton. 
(cherry picked from commit 592bf2d550a07ea5c5df3ba0ab2952c34d941b4b)
 2017-10-05 10:52:49 +05:30
Subru Krishnan
829a8e26b9 YARN-5329. Placement Agent enhancements required to support recurring reservations in ReservationSystem. (Carlo Curino via Subru). 
(cherry picked from commit e6e614e380ed1d746973b50f666a9c40d272073e)
 2017-10-04 19:29:03 -07:00
Akira Ajisaka
5c2f07eed7
HADOOP-14616. Client fails to read a block with erasure code (XOR, native) when one of the data block is lost. Contributed by Huafeng Wang. 
(cherry picked from commit fe84cdc9daa37af791a23a390e080777090c5e24)
 2017-10-05 11:07:33 +09:00
Subru Krishnan
8d59b1fbee YARN-5330. SharingPolicy enhancements required to support recurring reservations in ReservationSystem. (Carlo Curino via Subru). 
(cherry picked from commit fa6137501c1499ae33f6e0e2adc31671a7e782dc)
 2017-10-04 16:41:18 -07:00
Subru Krishnan
eb0a00c9b5 YARN-5328. Plan/ResourceAllocation data structure enhancements required to support recurring reservations in ReservationSystem. 
(cherry picked from commit b6e7d1369690eaf50ce9ea7968f91a72ecb74de0)
 2017-10-04 16:41:18 -07:00
Subru Krishnan
b5acbfef48 YARN-2037. Add work preserving restart support for Unmanaged AMs. (Botong Huang via Subru). 
(cherry picked from commit d4d2fd1acd2fdddf04f45e67897804eea30d79a1)
 2017-10-04 16:33:39 -07:00
Andrew Wang
c8c2c89282 HADOOP-14928. Update site release notes for 3.0.0 GA. 
(cherry picked from commit cae1c734febc67fdecb754e386bf7df4241832db)
 2017-10-04 14:59:48 -07:00
Akira Ajisaka
fe0d6f5b1c
YARN-7044. TestContainerAllocation#testAMContainerAllocationWhenDNSUnavailable fails. 
(cherry picked from commit 2df1b2ac0509ba10fff606ada7e9b3562c12dd16)
 2017-10-05 06:08:05 +09:00
Daniel Templeton
280b1fe1b4 HADOOP-14459. SerializationFactory shouldn't throw a NullPointerException if the serializations list is not defined 
(Contributed by Nandor Kollar via Daniel Templeton)

(cherry picked from commit 20e9ce3ab33599d2ac6859a8319e1ce0bf0a4363)
 2017-10-04 15:11:03 +02:00
Akira Ajisaka
7ba174791b
YARN-6975. Moving logging APIs over to slf4j in hadoop-yarn-server-tests, hadoop-yarn-server-web-proxy and hadoop-yarn-server-router. Contributed by Yeliang Cang. 
(cherry picked from commit acf5b880d8283f5a96455c89a6b1b548d0d8c0e7)
 2017-10-04 14:54:15 +09:00
Ray Chiang
01b047b41b YARN-7219. Make AllocateRequestProto compatible with branch-2/branch-2.8. (rchiang) 
(cherry picked from commit 67e12169b0ae8f3a9edb6511d3ea7ffd57b82e75)
 2017-10-03 15:16:31 -07:00
Yufei Gu
f982ffe336 YARN-7211. AMSimulator in SLS does't work due to responseId refactoring.(Contributed by Botong Huang via Yufei Gu) 
(cherry picked from commit 79e37dc6dba44e7d1d913593304db7a8516056aa)
 2017-10-03 15:12:09 -07:00
Akira Ajisaka
b658ae002f
YARN-6943. Update Yarn to YARN in documentation. Contributed by Chetna Chaudhari. 
(cherry picked from commit c9b525bd943fe7e098e72fb9be5623862c7ab5ff)
 2017-10-04 07:02:31 +09:00
Akira Ajisaka
2fa1d39952
YARN-6916. Moving logging APIs over to slf4j in hadoop-yarn-server-common. Contributed by Bibin A Chundatt and Akira Ajisaka. 
(cherry picked from commit 4a877737182808fe3392a116762ba59973a477a6)
 2017-10-04 06:08:00 +09:00
Jian He
d2c3b93ee5 YARN-7269. Tracking URL in the app state does not get redirected to ApplicationMaster for Running applications. Contributed by Wangda Tan 
(cherry picked from commit 4111e6c7819d66e17e0932302c589777a355dbae)
 2017-10-03 12:23:03 -07:00
Akira Ajisaka
47aa044fcc
MAPREDUCE-6971. Moving logging APIs over to slf4j in hadoop-mapreduce-client-app. Contributed by Jinjiang Ling. 
(cherry picked from commit 453d48bdfbb67ed3e66c33c4aef239c3d7bdd3bc)
 2017-10-03 12:15:43 +09:00
Sidharta S
dcc454b4a0 YARN-7226. Whitelisted variables do not support delayed variable expansion. Contributed by Jason Lowe 
(cherry picked from commit 7eb8499996869cdb63743f1c9eca2ba91d57ad08)
 2017-10-02 19:32:19 -07:00
Wangda Tan
c2f751cb0f YARN-7259. Add size-based rolling policy to LogAggregationIndexedFileController. (xgong via wangda) 
Change-Id: Ifaf82c0aee6b73b9b6ebf103aa72e131e3942f31
(cherry picked from commit 280080fad01304c85a9ede4d4f7b707eb36c0155)
 2017-10-02 16:37:27 -07:00
Junping Du
aef3e4b6af YARN-7194. Log aggregation status is always Failed with the newly added log aggregation IndexedFileFormat. Contributed by Xuan Gong. 
(cherry picked from commit c92c1d521eadfd8a4cd8205cc6aee74816f353f4)
 2017-10-02 16:35:27 -07:00
Lei Xu
eb76d3dbec HDFS-12569. Unset EC policy logs empty payload in edit log. (Lei (Eddy) Xu) 
(cherry picked from commit 0eab2fcac615228447e7f8bdf4b3ee742ea796ae)
 2017-10-02 15:33:35 -07:00
Xiao Chen
3dd3f924fc HADOOP-14095. Document caveats about the default JavaKeyStoreProvider in KMS. 
(cherry picked from commit d7ecac379a02876919d3e6081d42f0937f54e664)
 2017-09-29 19:34:42 -07:00
Wangda Tan
d58d75ca50 YARN-6509. Add a size threshold beyond which yarn logs will require a force option. (Xuan Gong via wangda) 
Change-Id: I755fe903337d4ff9ec35dae5b9cce638794e1d0f
(cherry picked from commit ec2ae3060a807c8754826af2135a68c08b2e4f13)
 2017-09-29 16:49:59 -07:00
Junping Du
c3eade44d0 YARN-7072. Add a new log aggregation file format controller. Contributed by Xuan Gong. 
(cherry picked from commit 3fddabc2fe4fbdb8ef3f9ce7558955c4f0794dcc)
 2017-09-29 16:49:44 -07:00
Wangda Tan
cdaab892d8 YARN-6550. Capture launch_container.sh logs to a separate log file. (Suma Shivaprasad via wangda) 
Change-Id: I0ee0b1bb459437432a22cf68861a6354f0decabb
(cherry picked from commit febeead5f95c6fc245ea3735f5b538d4bb4dc8a4)
 2017-09-29 16:46:34 -07:00
Andrew Wang
575763fb7f HADOOP-14909. Fix the word of erasure encoding in the top page. Contributed by Takanobu Asanuma. 
(cherry picked from commit 373d0a51955cabff77e934a28ba2de308207374a)
 2017-09-29 13:34:39 -07:00
Lei Xu
337506190b HDFS-12453. TestDataNodeHotSwapVolumes fails in trunk Jenkins runs. (Lei (Eddy) Xu) 2017-09-29 10:47:37 -07:00