Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,085 Commits 326 Branches 371 Tags
Commit Graph

8085 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Karthik Kambatla
25be97808b YARN-2874. Dead lock in DelegationTokenRenewer which blocks RM to execute any further apps. (Naganarasimha G R via kasha) 
(cherry picked from commit 799353e2c7db5af6e40e3521439b5c8a3c5c6a51)
 2014-12-03 13:45:03 -08:00
Brandon Li
97b3e2b79b HDFS-7458. Add description to the nfs ports in core-site.xml used by nfs test to avoid confusion. Contributed by Yongjun Zhang 
(cherry picked from commit a1e822595c3dc5eadbd5430e57bc4691d09d5e68)
 2014-12-03 13:32:29 -08:00
Andrew Wang
696e15f0d1 HADOOP-11342. KMS key ACL should ignore ALL operation for default key ACL and whitelist key ACL. Contributed by Dian Fu. 
(cherry picked from commit 1812241ee10c0a98844bffb9341f770d54655f52)
 2014-12-03 12:00:29 -08:00
Jason Lowe
db723a8499 MAPREDUCE-5932. Provide an option to use a dedicated reduce-side shuffle log. Contributed by Gera Shegalov 
(cherry picked from commit 03ab24aa01ffea1cacf1fa9cbbf73c3f2904d981)

Conflicts:

	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
 2014-12-03 17:12:47 +00:00
Steve Loughran
81ad192730 HDFS-7448 TestBookKeeperHACheckpoints fails in trunk (Akira Ajisaka via stevel) 2014-12-03 12:20:01 +00:00
Junping Du
86535ff65f YARN-1156. Enhance NodeManager AllocatedGB and AvailableGB metrics for aggregation of decimal values. (Contributed by Tsuyoshi OZAWA) 
(cherry picked from commit e65b7c5ff6b0c013e510e750fe5cf59acfefea5f)
 2014-12-03 04:12:35 -08:00
stack
fe6ee8a3f1 HDFS-6735. A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream (Lars Hofhansl via stack) 
(cherry picked from commit 7caa3bc98e6880f98c5c32c486a0c539f9fd3f5f)
 2014-12-02 20:59:45 -08:00
Andrew Wang
c962eef533 HADOOP-11344. KMS kms-config.sh sets a default value for the keystore password even in non-ssl setup. Contributed by Arun Suresh. 
(cherry picked from commit 3d48ad7eb424206dd1528179b35de4cdf51afdf3)
 2014-12-02 19:04:33 -08:00
Jian He
d6f3d4893d YARN-2894. Fixed a bug regarding application view acl when RM fails over. Contributed by Rohith Sharmaks 
(cherry picked from commit 392c3aaea8e8f156b76e418157fa347256283c56)
 2014-12-02 17:17:16 -08:00
Colin Patrick Mccabe
06552a15d5 HDFS-7446. HDFS inotify should have the ability to determine what txid it has read up to (cmccabe) 
(cherry picked from commit 75a326aaff8c92349701d9b3473c3070b8c2be44)
 2014-12-02 17:15:42 -08:00
Haohui Mai
f32af158ed HDFS-7462. Consolidate implementation of mkdirs() into a single class. Contributed by Haohui Mai. 2014-12-02 15:00:19 -08:00
Jian He
5067ac098b YARN-2136. Changed RMStateStore to ignore store opearations when fenced. Contributed by Varun Saxena 
(cherry picked from commit 52bcefca8bb13d3757009f1f08203e7dca3b1e16)
 2014-12-02 11:02:00 -08:00
stack
6d904985e8 HADOOP-11301. [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack) 
(cherry picked from commit b36f29298247f6c5db9f6eff7c2f5177a0fe3de5)
 2014-12-01 23:08:16 -08:00
stack
76245dfccd Revert "HBASE-11301 [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack)" 
This reverts commit fd6a801ddb2d2db83f98e7aab183a6e07ce4890c.

Refers to an HBASE rather than HADOOP issue.
 2014-12-01 23:02:32 -08:00
stack
fd6a801ddb HBASE-11301 [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack) 
(cherry picked from commit 74f4d8590de85eaa92c711010bbc0ff0e33ee2e8)
 2014-12-01 22:55:12 -08:00
Andrew Wang
881c77107e HADOOP-11341. KMS support for whitelist key ACLs. Contributed by Arun Suresh. 
(cherry picked from commit 31b4d2daa14a7f6e8ee73fd3160e126d8db62ffb)
 2014-12-01 21:58:21 -08:00
Colin Patrick Mccabe
f9c5dec152 CHANGES.txt: add HADOOP-11257 
(cherry picked from commit c1f2bb2d31d40bda5bb2c5bdf31e4f6e433d1e77)
 2014-12-01 21:58:15 -08:00
Haohui Mai
9ce77520a8 HDFS-7438. Consolidate the implementation of rename() into a single class. Contributed by Haohui Mai. 2014-12-01 21:51:16 -08:00
Haohui Mai
49122df1c0 HDFS-7450. Consolidate the implementation of GetFileInfo(), GetListings() and GetContentSummary() into a single class. Contributed by Haohui Mai. 2014-12-01 21:37:44 -08:00
Andrew Wang
084667aad9 HADOOP-11337. KeyAuthorizationKeyProvider access checks need to be done atomically. Contributed by Dian Fu. 
(cherry picked from commit 9fa29902575ac3774bf3728e7bcde7f3eefb1d4c)
 2014-12-01 21:22:03 -08:00
Zhijie Shen
d21ef79707 YARN-2890. MiniYARNCluster should start the timeline server based on the configuration. Contributed by Mit Desai. 
(cherry picked from commit 51af8d367de94689770f57c64bea3b244d7755f6)
 2014-12-01 19:08:31 -08:00
Jian He
d208c90148 YARN-2765. Added leveldb-based implementation for RMStateStore. Contributed by Jason Lowe 
(cherry picked from commit a7fba0bc28764e0fb36c335ea60cc58079fe007f)
 2014-12-01 16:45:17 -08:00
Jason Lowe
b6d7b789bd MAPREDUCE-6160. Potential NullPointerException in MRClientProtocol interface implementation. Contributed by Rohith 
(cherry picked from commit 0c588904f8b68cad219d2bd8e33081d5cae656e5)
 2014-12-01 22:40:38 +00:00
Jason Lowe
38ea1419f6 YARN-2905. AggregatedLogsBlock page can infinitely loop if the aggregated log file is corrupted. Contributed by Varun Saxena 
(cherry picked from commit 0f9528b99addbb0fd9a19d84db22a8c8e934b05f)
 2014-12-01 22:30:20 +00:00
Jason Lowe
2bdef5697b MAPREDUCE-6172. TestDbClasses timeouts are too aggressive. Contributed by Varun Saxena 
(cherry picked from commit 2b30fb1053e70c128b98013fb63cf9a095623be6)
 2014-12-01 21:52:51 +00:00
Colin Patrick Mccabe
f6d1bf5ed1 HADOOP-11333. Fix deadlock in DomainSocketWatcher when the notification pipe is full (zhaoyunjiong via cmccabe) 
(cherry picked from commit 86e3993def01223f92b8d1dd35f6c1f8ab6033f5)
 2014-12-01 11:48:53 -08:00
Junping Du
c7bd22974a YARN-2907. SchedulerNode#toString should print all resource detail instead of only memory. (Contributed by Rohith) 
(cherry picked from commit c732ed760e115192652280cd4b5799d49e62db7e)
 2014-12-01 05:41:56 -08:00
Uma Maheswara Rao G
f4ab306347 HDFS-7210. Avoid two separate RPC's namenode.append() and namenode.getFileInfo() for an append call from DFSClient. (Vinayakumar B via umamahesh) 
(cherry picked from commit 1556f86a31a54733d6550363aa0e027acca7823b)
 2014-11-28 21:13:17 +05:30
Colin Patrick Mccabe
8f98225418 HADOOP-11257. Update "hadoop jar" documentation to warn against using it for launching yarn jars (iwasakims via cmccabe) 2014-11-26 13:42:07 -08:00
Zhijie Shen
a9adc1295c YARN-2165. Added the sanity check for the numeric configuration values of the timeline service. Contributed by Vasanth kumar RJ. 
(cherry picked from commit 8f1454cc6d46afa057770a39aecc151c5f048b57)
 2014-11-26 12:12:42 -08:00
Haohui Mai
ae04ce29e5 HDFS-7444. convertToBlockUnderConstruction should preserve BlockCollection. Contributed by Haohui Mai. 2014-11-26 10:37:54 -08:00
Uma Maheswara Rao G
6545342a6d HDFS-7310. Mover can give first priority to local DN if it has target storage type available in local DN. (Vinayakumar B via umamahesh) 
(cherry picked from commit 058af60c56207907f2bedf76df4284e86d923e0c)
 2014-11-26 23:34:21 +05:30
Steve Loughran
6a01497d7c HDFS-6803 Document DFSClient#DFSInputStream expectations reading and preading in concurrent context. (stack via stevel) 2014-11-26 11:43:46 +00:00
Haohui Mai
0c8a8ba86e HDFS-7440. Update CHANGES.txt for HDFS-7440. 2014-11-25 21:05:21 -08:00
Haohui Mai
3e011f1ec2 HDFS-7440. Consolidate snapshot related operations in a single class. Contributed by Haohui Mai. 2014-11-25 21:03:57 -08:00
Karthik Kambatla
3d4536af82 YARN-2188. [YARN-1492] Client service for cache manager. (Chris Trezzo and Sangjin Lee via kasha) 
(cherry picked from commit 834b3b98e7ecc4bfe93c7dd1a9e928e9653cf138)
 2014-11-25 16:22:14 -08:00
Jian He
ae35b0e14d YARN-2906. CapacitySchedulerPage shows HTML tags for a queue's Active Users. Contributed by Jason Lowe 
(cherry picked from commit 8a7ca13b13c0c3f008a6490cc96d4d48a051d1f7)
 2014-11-25 16:18:02 -08:00
Andrew Wang
8018d1af58 HADOOP-11173. Improve error messages for some KeyShell commands. 
(cherry picked from commit fae266bbf19e44a2595fa62366d9b65e7c996df8)
 2014-11-25 16:13:37 -08:00
Andrew Wang
915176c4e7 HDFS-7097. Allow block reports to be processed during checkpointing on standby name node. (kihwal via wang) 
(cherry picked from commit f43a20c529ac3f104add95b222de6580757b3763)
 2014-11-25 15:37:21 -08:00
Andrew Wang
aad16f8f5c HADOOP-11300. KMS startup scripts must not display the keystore / truststore passwords. Contributed by Arun Suresh. 
(cherry picked from commit 56f3eecc129486d3297d082d9b97f26b40d0a2c6)
 2014-11-25 15:12:09 -08:00
Jian He
80e9be2d95 MAPREDUCE-5568. Fixed CompletedJob in JHS to show progress percentage correctly in case the number of mappers or reducers is zero. Contributed by MinJi Kim 
(cherry picked from commit 78f7cdbfd6e2b9fac51c369c748ae93d12ef065a)
 2014-11-25 13:03:40 -08:00
Jian He
2863056530 YARN-2404. Removed ApplicationAttemptState and ApplicationState class in RMStateStore. Contributed by Tsuyoshi OZAWA 
(cherry picked from commit 5805a81efbc024024d8172489dfdc6cf77879416)
 2014-11-25 12:51:03 -08:00
yliu
4b62d6d2fd HADOOP-11322. key based ACL check in KMS always check KeyOpType.MANAGEMENT even actual KeyOpType is not MANAGEMENT. (Dian Fu via yliu) 2014-11-25 01:12:31 +08:00
Haohui Mai
57a76f71bd HDFS-7303. NN UI fails to distinguish datanodes on the same host. Contributed by Benoy Antony. 2014-11-24 17:46:46 -08:00
Haohui Mai
9d462fb60c HDFS-7436. Consolidate implementation of concat(). Contributed by Haohui Mai. 2014-11-24 15:42:54 -08:00
Zhijie Shen
57d62d4ded YARN-2697. Remove useless RMAuthenticationHandler. Contributed by Haosong Huang. 
(cherry picked from commit e37a4ff0c1712a1cb80e0412ec53a5d10b8d30f9)
 2014-11-24 15:06:44 -08:00
Jason Lowe
89ef49fb08 YARN-1984. LeveldbTimelineStore does not handle db exceptions properly. Contributed by Varun Saxena 
(cherry picked from commit 1ce4d33c2dc86d711b227a04d2f9a2ab696a24a1)
 2014-11-24 22:38:09 +00:00
Colin Patrick Mccabe
69df08aada CHANGES.txt: add HDFS-7419 2014-11-24 11:50:23 -08:00
Colin Patrick Mccabe
640fd43075 CHANGES.txt: add HDFS-4882 2014-11-24 11:43:47 -08:00
Haohui Mai
9db888b896 HDFS-7412. Move RetryCache to NameNodeRpcServer. Contributed by Haohui Mai. 2014-11-24 11:11:35 -08:00