Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,360 Commits 326 Branches 371 Tags
Commit Graph

8360 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Allen Wittenauer
730597c20c HDFS-316. Balancer should run for a configurable # of iterations (Xiaoyu Yao via aw) 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HDFSCommands.apt.vm
 2015-02-12 18:02:23 -08:00
Akira Ajisaka
9d8dbf8ea4 YARN-3191. Log object should be initialized with its own class. Contributed by Rohith. 
(cherry picked from commit 99c7f2b8fa417303e8f42ea3641c302135879280)
 2015-02-12 17:59:04 -08:00
Colin Patrick Mccabe
a9a361c549 HDFS-7790. Do not create optional fields in DFSInputStream unless they are needed (cmccabe) 
(cherry picked from commit 871cb56152e6039ff56c6fabfcd45451029471c3)
 2015-02-12 17:49:11 -08:00
Akira Ajisaka
5696376e29 HDFS-7684. The host:port settings of the deamons should be trimmed before use. Contributed by Anu Engineer. 
(cherry picked from commit 9235e2fb4e94a86671e1494f293c973cf572281c)
 2015-02-12 17:40:48 -08:00
Xuan
df6bee5a75 YARN-3179. Update use of Iterator to Iterable in RMAdminCLI and 
CommonNodeLabelsManager. Contributed by Ray Chiang

(cherry picked from commit 2586915bb3178d26ad692f93d53aaffbb55d9ed9)
 2015-02-12 17:32:58 -08:00
Xuan
5f0495689f YARN-3158. Correct log messages in ResourceTrackerService. Contributed 
by Varun Saxena

(cherry picked from commit 99f6bd4f7ab1c5cac57362690c686139e73251d9)
 2015-02-12 16:43:28 -08:00
Jian He
b5d6f76c6a YARN-3104. Fixed RM to not generate new AMRM tokens on every heartbeat between rolling and activation. Contributed by Jason Lowe 
(cherry picked from commit 18297e09727e4af95140084760ae1267e8fe51c4)
 2015-02-12 16:03:12 -08:00
Akira Ajisaka
4d0e792a82 HADOOP-9869. Configuration.getSocketAddr()/getEnum() should use getTrimmed(). Contributed by Tsuyoshi Ozawa. 
(cherry picked from commit 9395c7669714845a51e464ab7a2214168bf03a36)
 2015-02-12 15:52:27 -08:00
Karthik Kambatla
fcfbdf6440 YARN-3181. FairScheduler: Fix up outdated findbugs issues. (kasha) 
(cherry picked from commit c2b185def846f5577a130003a533b9c377b58fab)
 2015-02-12 15:39:50 -08:00
Jian He
1be2d64ddd YARN-3124. Fixed CS LeafQueue/ParentQueue to use QueueCapacities to track capacities-by-label. Contributed by Wangda Tan 
(cherry picked from commit 18a594257e052e8f10a03e5594e6cc6901dc56be)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-02-12 15:01:14 -08:00
Akira Ajisaka
7d6c3c6dbe HADOOP-11586. Update use of Iterator to Iterable in AbstractMetricsContext.java. Contributed by Ray Chiang. 
(cherry picked from commit 11d8934463fca00db225a1c7660e0815832352d8)
 2015-02-12 14:42:10 -08:00
Junping Du
380cc4dbed YARN-2079. Recover NonAggregatingLogHandler state upon nodemanager restart. (Contributed by Jason Lowe) 
(cherry picked from commit 04f5ef18f7877ce30b12b1a3c1e851c420531b72)
 2015-02-12 11:48:24 -08:00
Xuan
58d9ce2ea1 YARN-3147. Clean up RM web proxy code. Contributed by Steve Loughran 
(cherry picked from commit 83be450acc7fc9bb9f7bbd006e7b0804bf10279c)
 2015-02-12 10:59:18 -08:00
Arpit Agarwal
676fc2d1dc HDFS-7723. Quota By Storage Type namenode implemenation. (Contributed by Xiaoyu Yao) 2015-02-12 10:50:14 -08:00
Colin Patrick Mccabe
e35788aa5a HDFS-7694. FSDataInputStream should support "unbuffer" (cmccabe) 
(cherry picked from commit 6b39ad0865cb2a7960dd59d68178f0bf28865ce2)
 2015-02-12 10:42:14 -08:00
Haohui Mai
92f52e8962 HADOOP-11587. TestMapFile#testMainMethodMapFile creates test files in hadoop-common project root. Contributed by Xiaoyu Yao. 2015-02-12 10:31:04 -08:00
Jing Zhao
2156e38d5e HDFS-3689. Add support for variable length block. Contributed by Jing Zhao. 
(cherry picked from commit 2848db814a98b83e7546f65a2751e56fb5b2dbe0)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirConcatOp.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogLoader.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestFileAppend3.java
 2015-02-12 10:23:13 -08:00
Tsuyoshi Ozawa
9d57392f5b MAPREDUCE-6221. Stringifier is left unclosed in Chain#getChainElementConf(). Contributed by Ted Yu. 
(cherry picked from commit 9b0ba59b8284fae132535fbca5ce372d7a6c38c0)
 2015-02-13 02:28:19 +09:00
Kihwal Lee
146f559097 Adding missing files from HDFS-7404 
(cherry picked from commit 8d7215d40fb206bff7558527b1aef7bd40d427ff)
 2015-02-12 11:18:41 -06:00
Kihwal Lee
39594301e1 HDFS-7704. DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out. Contributed by Rushabh Shah. 
(cherry picked from commit 38262779bbf38a427bad6d044e91165567f1d206)
 2015-02-12 09:17:10 -06:00
Tsuyoshi Ozawa
dc14f2772f YARN-3157. Refactor the exception handling in ConverterUtils#to*Id. Contributed by Bibin A Chundatt. 
(cherry picked from commit 7bc492adab90c4533c20d48c004e92cb917cd199)
 2015-02-12 23:49:27 +09:00
Tsuyoshi Ozawa
941a923514 MAPREDUCE-4431. mapred command should print the reason on killing already completed jobs. Contributed by Devaraj K. 
(cherry picked from commit ac8d52bf50bba1a29489ee75fd90717d8a2b0cc9)
 2015-02-12 20:37:14 +09:00
Junping Du
634cc297ba YARN-1580. Documentation error regarding container-allocation.expiry-interval-ms (Brahma Reddy Battula via junping_du) 
(cherry picked from commit 46c7577b9843766b8cc3e81eae1100d4c194286a)
 2015-02-12 03:40:57 -08:00
Tsuyoshi Ozawa
9129b3415c MAPREDUCE-5335. Rename Job Tracker terminology in ShuffleSchedulerImpl. Contributed by Devaraj K. 
(cherry picked from commit b42d09eb62bd1725d70da59f1a6fdac83cea82d1)
 2015-02-12 20:08:47 +09:00
Tsuyoshi Ozawa
c9c1d9a5a6 HADOOP-11543. Improve help message for hadoop/yarn command. Contributed by Brahma Reddy Battula. 2015-02-12 19:03:24 +09:00
Devaraj K
a00c9362e6 MAPREDUCE-6253. Update use of Iterator to Iterable. Contributed by Ray 
Chiang.

(cherry picked from commit 76e309ead01f02b32335330cd920536f907fb71f)
 2015-02-12 13:47:19 +05:30
Tsuyoshi Ozawa
fd047702e4 YARN-1237. Description for yarn.nodemanager.aux-services in yarn-default.xml is misleading. Contributed by Brahma Reddy Battula. 
(cherry picked from commit b3bcbaf277ec389ec048a4b5cd59b2e90781a30b)
 2015-02-12 15:19:54 +09:00
Xuan
cac6fe217a YARN-3151. On Failover tracking url wrong in application cli for KILLED 
application. Contributed by Rohith

(cherry picked from commit 65c69e296edad48e50ef36e47803625ea46b51e1)
 2015-02-11 21:21:06 -08:00
yliu
f8d0825f39 HDFS-7761. cleanup unnecssary code logic in LocatedBlock. (yliu) 2015-02-12 03:09:38 +08:00
cnauroth
c9266132ee HADOOP-10140. Specification of HADOOP_CONF_DIR via the environment in hadoop_config.cmd. Contributed by Kiran Kumar M R. 
(cherry picked from commit 67efab935e0366ff783cf2bbd2363da4ebb02772)
 2015-02-11 16:36:18 -08:00
Tsz-Wo Nicholas Sze
65a6cf47ec HDFS-6133. Add a feature for replica pinning so that a pinned replica will not be moved by Balancer/Mover. Contributed by zhaoyunjiong 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/datatransfer/Receiver.java
 2015-02-11 15:16:34 -08:00
Colin Patrick Mccabe
2ca76df21a HDFS-7771. fuse_dfs should permit FILE: on the front of KRB5CCNAME (cmccabe) 
(cherry picked from commit 50625e660ac0f76e7fe46d55df3d15cbbf058753)
 2015-02-11 12:14:56 -08:00
Haohui Mai
744db47872 HDFS-7736. Fix typos in dfsadmin/fsck/snapshotDiff usage messages. Contributed by Brahma Reddy Battula. 2015-02-11 11:24:44 -08:00
Tsz-Wo Nicholas Sze
b49eeddbaf HDFS-7751. Fix TestHDFSCLI for quota with storage type. Contributed by Xiaoyu Yao 2015-02-11 11:10:05 -08:00
Arpit Agarwal
8fa0fc9574 HDFS-7720. Quota by Storage Type API, tools and ClientNameNode Protocol changes. (Contributed by Xiaoyu Yao) 2015-02-11 11:07:53 -08:00
Konstantin V Shvachko
04789db74c HDFS-7760. Document truncate for WebHDFS. Contributed by Konstantin Shvachko. 2015-02-11 10:05:53 -08:00
Konstantin V Shvachko
ada7791ef4 HADOOP-11579. Documentation for truncate. Contributed by Konstantin Shvachko. 2015-02-11 10:03:54 -08:00
Jason Lowe
38333c8f29 YARN-3074. Nodemanager dies when localizer runner tries to write to a full disk. Contributed by Varun Saxena 
(cherry picked from commit b379972ab39551d4b57436a54c0098a63742c7e1)
 2015-02-11 16:34:42 +00:00
Steve Loughran
a8eaec396f YARN-2683. [YARN-913] registry config options: document and move to core-default. (stevel) 2015-02-11 14:26:22 +00:00
Steve Loughran
4241c2be3d YARN-2616 [YARN-913] Add CLI client to the registry to list, view and manipulate entries. (Akshay Radia via stevel) 2015-02-11 14:18:46 +00:00
Junping Du
f2c3058b8d YARN-3160. Fix non-atomic operation on nodeUpdateQueue in RMNodeImpl. (Contributed by Chengbing Liu) 
(cherry picked from commit c541a374d88ffed6ee71b0e5d556939ccd2c5159)
 2015-02-11 03:46:40 -08:00
Konstantin V Shvachko
7f18176cd7 HDFS-7753. Fix Multithreaded correctness Warnings in BackupImage. Contributed by Rakesh R and Konstantin Shvachko. 2015-02-11 00:52:12 -08:00
Tsz-Wo Nicholas Sze
acc172e371 HDFS-7769. TestHDFSCLI should not create files in hdfs project root dir. 2015-02-10 17:50:00 -08:00
Zhijie Shen
fd75b8c9ca YARN-2246. Made the proxy tracking URL always be http(s)://proxy addr:port/proxy/<appId> to avoid duplicate sections. Contributed by Devaraj K. 
(cherry picked from commit d5855c0e46404cfc1b5a63e59015e68ba668f0ea)
 2015-02-10 15:29:09 -08:00
Colin Patrick Mccabe
5e7deba1f4 HADOOP-10953. NetworkTopology#add calls NetworkTopology#toString without holding the netlock (Liang Xie via Colin P. McCabe) 
(cherry picked from commit 6338ce3ae8870548cac5abe2f685748b5efb13c1)
 2015-02-10 13:30:49 -08:00
Jason Lowe
ca11ffa5de YARN-2809. Implement workaround for linux kernel panic when removing cgroup. Contributed by Nathan Roberts 
(cherry picked from commit 3f5431a22fcef7e3eb9aceeefe324e5b7ac84049)
 2015-02-10 17:28:18 +00:00
Jason Lowe
9ffd985dc0 YARN-3090. DeletionService can silently ignore deletion task failures. Contributed by Varun Saxena 
(cherry picked from commit 4eb5f7fa32bab1b9ce3fb58eca51e2cd2e194cd5)
 2015-02-10 16:55:21 +00:00
Harsh J
442bc776db HADOOP-11512. Use getTrimmedStrings when reading serialization keys. Contributed by Ryan P. 2015-02-10 12:52:41 +05:30
Konstantin V Shvachko
2b722b904e HDFS-7058. Tests for truncate CLI. Contributed by Dasha Boudnik. 2015-02-09 21:31:02 -08:00
Vinayakumar B
a1bf7aecf7 HDFS-7714. Simultaneous restart of HA NameNodes and DataNode can cause DataNode to register successfully with only one NameNode.(Contributed by Vinayakumar B) 
(cherry picked from commit 3d15728ff5301296801e541d9b23bd1687c4adad)
 2015-02-10 10:45:14 +05:30