Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,342 Commits 326 Branches 371 Tags
Commit Graph

8342 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Xuan
43b1878f86 YARN-2758. Update TestApplicationHistoryClientService to use the new generic history store. Contributed by Zhijie Shen 2014-10-28 13:30:55 -07:00
Kihwal Lee
946463efef HDFS-7213. processIncrementalBlockReport performance degradation. 
Contributed by Eric Payne.
(cherry picked from commit e226b5b40d716b6d363c43a8783766b72734e347)
 2014-10-28 14:55:16 -05:00
Kihwal Lee
dabaf582eb HDFS-6663. Admin command to track file and locations from block id. 
Contributed by Chen He.
(cherry picked from commit 371a3b87ed346732ed58a4faab0c6c1db57c86ed)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/DFSck.java
 2014-10-28 14:32:18 -05:00
Xuan
43a53f2b65 YARN-2279. Add UTs to cover timeline server authentication. Contributed by Zhijie Shen 2014-10-28 11:18:35 -07:00
Karthik Kambatla
3f7edeb055 YARN-2760. Remove 'experimental' from FairScheduler docs. (Harsh J via kasha) 
(cherry picked from commit ade3727ecb092935dcc0f1291c1e6cf43d764a03)
 2014-10-28 08:49:34 -07:00
yliu
8b812a35b8 HDFS-6606. Optimize HDFS Encrypted Transport performance. (yliu) 2014-10-28 21:16:34 +08:00
Harsh J
9548bb360b HDFS-6741. Improve permission denied message when FSPermissionChecker#checkOwner fails. Contributed by Stephen Chu and Harsh J. (harsh) 2014-10-28 12:24:14 +05:30
yliu
2e156f01a2 HADOOP-11233. hadoop.security.kms.client.encrypted.key.cache.expiry property spelled wrong in core-default. (Stephen Chu via yliu) 2014-10-28 14:44:13 +08:00
Zhijie Shen
52695d38fc MAPREDUCE-6018. Added an MR specific config to enable emitting job history data to the timeline server. Contributed by Robert Kanter. 
(cherry picked from commit 971e91c8c03a23e4613ed3f071b4f982ee5a1b63)
 2014-10-27 21:08:38 -07:00
Zhijie Shen
733380fa70 MAPREDUCE-5933. Enabled MR AM to post history events to the timeline server. Contributed by Robert Kanter. 
(cherry picked from commit 6b2f11b54bc679b0715fe66bd129e340e8c61c5c)
 2014-10-27 20:41:02 -07:00
Jian He
a1c7a707ca YARN-2502. Changed DistributedShell to support node labels. Contributed by Wangda Tan 
(cherry picked from commit f6b963fdfc517429149165e4bb6fb947be6e3c99)
 2014-10-27 20:13:53 -07:00
Colin Patrick Mccabe
296c4064fc HDFS-7282. Fix intermittent TestShortCircuitCache and TestBlockReaderFactory failures resulting from TemporarySocketDirectory GC (Jinghui Wang via Colin P. McCabe) 
(cherry picked from commit 518a7f4af3d8deeecabfa0629b16521ce09de459)
 2014-10-27 17:45:15 -07:00
Haohui Mai
0e05624618 HDFS-5928. Show namespace and namenode ID on NN dfshealth page. Contributed by Siqi Li. 2014-10-27 16:25:03 -07:00
Vinod Kumar Vavilapalli
0ad33e1483 YARN-2704. Changed ResourceManager to optionally obtain tokens itself for the sake of localization and log-aggregation for long-running services. Contributed by Jian He. 
(cherry picked from commit a16d022ca4313a41425c8e97841c841a2d6f2f54)
 2014-10-27 15:50:51 -07:00
cnauroth
5dbd27f8b4 HDFS-6934. Revert files accidentally committed. 
(cherry picked from commit 5b1dfe78b8b06335bed0bcb83f12bb936d4c021b)
 2014-10-27 12:15:47 -07:00
cnauroth
3d67da502a HDFS-6934. Move checksum computation off the hot path when writing to RAM disk. Contributed by Chris Nauroth. 
(cherry picked from commit 463aec11718e47d4aabb86a7a539cb973460aae6)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
 2014-10-27 11:50:47 -07:00
Jing Zhao
57e82e647b HDFS-7296. HdfsConstants#MEMORY_STORAGE_POLICY_ID and HdfsConstants#MEMORY_STORAGE_POLICY_ID are missing in branch-2. Contributed by Jing Zhao. 2014-10-27 11:20:57 -07:00
Jian He
2d3c64943d YARN-2591. Fixed AHSWebServices to return FORBIDDEN(403) if the request user doesn't have access to the history data. Contributed by Zhijie Shen 
(cherry picked from commit c05b581a5522eed499d3ba16af9fa6dc694563f6)
 2014-10-27 10:46:37 -07:00
Xuan
3a77838535 YARN-2726. CapacityScheduler should explicitly log when an accessible label has no capacity. Contributed by Wangda Tan 2014-10-27 10:28:45 -07:00
Colin Patrick Mccabe
5f3d967aae HDFS-7278. Add a command that allows sysadmins to manually trigger full block reports from a DN (cmccabe) 
(cherry picked from commit baf794dc404ac54f4e8332654eadfac1bebacb8f)
 2014-10-27 10:13:32 -07:00
Harsh J
8d781aaad3 HDFS-6538. Comment format error in ShortCircuitRegistry javadoc. Contributed by David Luo. (harsh) 2014-10-27 19:26:02 +05:30
Harsh J
c88ac8a738 HADOOP-11236. NFS: Fix javadoc warning in RpcProgram.java. Contributed by Abhiraj Butala. (harsh) 2014-10-27 19:13:50 +05:30
Zhijie Shen
cb3974524c YARN-2734. Skipped sub-folders in the local log dir when aggregating logs. Contributed by Xuan Gong. 
(cherry picked from commit caecd9fffe7c6216be31f3ab65349182045451fa)
 2014-10-26 12:59:29 -07:00
Vinod Kumar Vavilapalli
b1e17d2dab HADOOP-11170. Pulling into branch-2.6 also, fixing CHANGES.txt. 
(cherry picked from commit 9ada9284d82fd926e8085e571f953330fc87266f)
 2014-10-26 11:26:18 -07:00
Vinod Kumar Vavilapalli
36d3f1fcca YARN-2743. Fixed a bug in ResourceManager that was causing RMDelegationToken identifiers to be tampered and thus causing app submission failures in secure mode. Contributed by Jian He. 
(cherry picked from commit 018664550507981297fd9f91e29408e6b7801ea9)
 2014-10-26 11:15:45 -07:00
Xuan
f862999a7e YARN-2723. Fix rmadmin -replaceLabelsOnNode does not correctly parse 
port. Contributed by Naganarasimha G R
 2014-10-25 12:47:09 -07:00
Byron Wong
d991cd52d8 HADOOP-6857. FsShell should report raw disk usage including replication factor. Contributed by Byron Wong. 2014-10-25 12:39:03 -07:00
Karthik Kambatla
acc6f622e0 YARN-2183. [YARN-1492] Cleaner service for cache manager. (Chris Trezzo and Sangjin Lee via kasha) 
(cherry picked from commit c51e53d7aad46059f52d4046a5fedfdfd3c37955)
 2014-10-25 11:50:06 -07:00
Jian He
9bd149978d YARN-2314. Disable ContainerManagementProtocolProxy cache by default to prevent creating thousands of threads in a large cluster. Contributed by Jason Lowe 
(cherry picked from commit f44cf99599119b5e989be724eeab447b2dc4fe53)
 2014-10-24 23:06:00 -07:00
Jian He
96a6e02d16 YARN-1915. Fixed a race condition that client could use the ClientToAMToken to contact with AM before AM actually receives the ClientToAMTokenMasterKey. Contributed by Jason Lowe 
(cherry picked from commit 5864dd99a419b8a0fb973a4984c0f1d1e02ccf16)
 2014-10-24 22:48:48 -07:00
Karthik Kambatla
9af3cfc7eb YARN-2713. "RM Home" link in NM should point to one of the RMs in an HA setup. (kasha) 
(cherry picked from commit 683897fd028dcc2185383f73b52d15245a69e0cb)
 2014-10-24 15:00:37 -07:00
Zhijie Shen
1b81105143 YARN-2703. Added logUploadedTime into LogValue for better display. Contributed by Xuan Gong. 
(cherry picked from commit f81dc3f995579c1b94b11d60e9fc6da56c8a9496)
 2014-10-24 14:12:17 -07:00
Colin Patrick Mccabe
2bcda17ee7 HDFS-6988. Improve HDFS-6581 eviction configuration (Xiaoyu Yao via Colin P. McCabe) 
(cherry picked from commit a52eb4bc5fb21574859f779001ea9d95bf5207fe)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
 2014-10-24 13:17:59 -07:00
Jian He
299c9b456d HADOOP-11228. Winutils task: unsecure path should not call AddNodeManagerAndUserACEsToObject. Contributed by Remus Rusanu 
(cherry picked from commit f7e89bb349d4512b47f94b545e3f489a85e851f0)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2014-10-24 12:54:00 -07:00
Jitendra Pandey
5fb7660ad6 HDFS-6904. Added files missing in previous commit. 2014-10-24 12:01:54 -07:00
Jitendra Pandey
b576890f35 HDFS-6904. YARN unable to renew delegation token fetched via webhdfs due to incorrect service port. 2014-10-24 11:36:54 -07:00
Zhijie Shen
13c60bac57 YARN-2724. Skipped uploading a local log file to HDFS if exception is raised when opening it. Contributed by Xuan Gong. 
(cherry picked from commit e31f0a6558b106662c83e1f797216e412b6689a9)
 2014-10-24 11:15:19 -07:00
Haohui Mai
1f6258f535 HDFS-7283. Bump DataNode OOM log from WARN to ERROR. Contributed by Stephen Chu. 2014-10-24 10:50:28 -07:00
Haohui Mai
a4bb56b93b HDFS-7258. CacheReplicationMonitor rescan schedule log should use DEBUG level instead of INFO level. Contributed by Xiaoyu Yao. 2014-10-23 23:58:49 -07:00
Jian He
d57f2b9dea Updated CHANGES.txt to move YARN-2682 to branch-2.6 
(cherry picked from commit 071c925c7dffbb825884a5df5a0104e7793b30fc)
 2014-10-23 22:28:23 -07:00
Zhijie Shen
3b03ea6b50 YARN-2209. Replaced AM resync/shutdown command with corresponding exceptions and made related MR changes. Contributed by Jian He. 
(cherry picked from commit 0f3b6900be1a3b2e4624f31f84656f4a32dadce9)
 2014-10-23 22:03:30 -07:00
yliu
193724ccaf HDFS-7243. HDFS concat operation should not be allowed in Encryption Zone. (clamb via yliu) 2014-10-24 11:41:49 +08:00
Colin Patrick Mccabe
caa658a015 HDFS-7223. Tracing span description of IPC client is too long (iwasakims via cmccabe) 
(cherry picked from commit 5b56ac4c72d69d1b3d6feec9d96c9d62eb02d28c)
 2014-10-23 19:15:08 -07:00
Karthik Kambatla
c99d89f2c6 HADOOP-11170. ZKDelegationTokenSecretManager fails to renewToken created by a peer. (Arun Suresh and Gregory Chanan via kasha) 
(cherry picked from commit db45f047ab6b19d8a3e7752bb2cde10827cd8dad)
 2014-10-23 17:06:36 -07:00
Haohui Mai
92ad210699 HDFS-7257. Add the time of last HA state transition to NN's /jmx page. Contributed by Charles Lamb. 2014-10-23 16:53:17 -07:00
Allen Wittenauer
a58f88056c HDFS-7232. Populate hostname in httpfs audit log (Zoran Dimitrijevic via aw) 2014-10-23 14:07:07 -07:00
Colin Patrick Mccabe
a36fd88671 HDFS-7227. Fix findbugs warning about NP_DEREFERENCE_OF_READLINE_VALUE in SpanReceiverHost (cmccabe) 
(cherry picked from commit 7ab754545dca16518e8fe9353ef69b77f365426b)
 2014-10-23 13:26:10 -07:00
Andrew Wang
d3b9e9be24 HDFS-7222. Expose DataNode network errors as a metric. (Charles Lamb via wang) 
(cherry picked from commit 86cad007d7d6366b293bb9a073814889081c8662)
 2014-10-23 12:53:39 -07:00
Brandon Li
d27cd5ad77 HDFS-7180. NFSv3 gateway frequently gets stuck due to GC. Contributed by Brandon Li 
(cherry picked from commit d71d40a63d198991077d5babd70be5e9787a53f1)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-10-22 21:34:15 -07:00
Zhijie Shen
36515435ff YARN-2732. Fixed syntax error in SecureContainer.apt.vm. Contributed by Jian He. 
(cherry picked from commit b94b8b30f282563ee2ecdd25761b2345aaf06c9b)
 2014-10-22 18:41:05 -07:00