Commit Graph

9222 Commits

Author SHA1 Message Date
Zhijie Shen 971e91c8c0 MAPREDUCE-6018. Added an MR specific config to enable emitting job history data to the timeline server. Contributed by Robert Kanter. 2014-10-27 21:03:53 -07:00
Zhijie Shen 6b2f11b54b MAPREDUCE-5933. Enabled MR AM to post history events to the timeline server. Contributed by Robert Kanter. 2014-10-27 20:35:40 -07:00
Jian He f6b963fdfc YARN-2502. Changed DistributedShell to support node labels. Contributed by Wangda Tan 2014-10-27 20:13:00 -07:00
Colin Patrick Mccabe b0e19c9d54 HADOOP-10926. Improve test-patch.sh to apply binary diffs (cmccabe) 2014-10-27 18:22:28 -07:00
Colin Patrick Mccabe 518a7f4af3 HDFS-7282. Fix intermittent TestShortCircuitCache and TestBlockReaderFactory failures resulting from TemporarySocketDirectory GC (Jinghui Wang via Colin P. McCabe) 2014-10-27 17:44:07 -07:00
Haohui Mai 00b4e44a2e HDFS-5928. Show namespace and namenode ID on NN dfshealth page. Contributed by Siqi Li. 2014-10-27 16:22:19 -07:00
Vinod Kumar Vavilapalli a16d022ca4 YARN-2704. Changed ResourceManager to optionally obtain tokens itself for the sake of localization and log-aggregation for long-running services. Contributed by Jian He. 2014-10-27 15:49:47 -07:00
cnauroth 5b1dfe78b8 HDFS-6934. Revert files accidentally committed. 2014-10-27 12:15:10 -07:00
Jian He c05b581a55 YARN-2591. Fixed AHSWebServices to return FORBIDDEN(403) if the request user doesn't have access to the history data. Contributed by Zhijie Shen 2014-10-27 10:45:53 -07:00
Xuan ce1a4419a6 YARN-2726. CapacityScheduler should explicitly log when an accessible label has no capacity. Contributed by Wangda Tan 2014-10-27 10:26:21 -07:00
Colin Patrick Mccabe baf794dc40 HDFS-7278. Add a command that allows sysadmins to manually trigger full block reports from a DN (cmccabe) 2014-10-27 09:53:16 -07:00
cnauroth 463aec1171 HDFS-6934. Move checksum computation off the hot path when writing to RAM disk. Contributed by Chris Nauroth. 2014-10-27 09:38:30 -07:00
Harsh J 0058eadbd3 HDFS-6538. Comment format error in ShortCircuitRegistry javadoc. Contributed by David Luo. (harsh) 2014-10-27 19:24:50 +05:30
Harsh J 2429b31656 HADOOP-11236. NFS: Fix javadoc warning in RpcProgram.java. Contributed by Abhiraj Butala. (harsh) 2014-10-27 19:09:52 +05:30
Zhijie Shen caecd9fffe YARN-2734. Skipped sub-folders in the local log dir when aggregating logs. Contributed by Xuan Gong. 2014-10-26 12:57:31 -07:00
Vinod Kumar Vavilapalli 9ada9284d8 HADOOP-11170. Pulling into branch-2.6 also, fixing CHANGES.txt. 2014-10-26 11:25:24 -07:00
Vinod Kumar Vavilapalli 0186645505 YARN-2743. Fixed a bug in ResourceManager that was causing RMDelegationToken identifiers to be tampered and thus causing app submission failures in secure mode. Contributed by Jian He. 2014-10-26 11:14:34 -07:00
Xuan 65d95b1a52 YARN-2723. Fix rmadmin -replaceLabelsOnNode does not correctly parse
port. Contributed by Naganarasimha G R
2014-10-25 12:45:14 -07:00
Byron Wong 28051e4155 HADOOP-6857. FsShell should report raw disk usage including replication factor. Contributed by Byron Wong. 2014-10-25 12:31:41 -07:00
Karthik Kambatla c51e53d7aa YARN-2183. [YARN-1492] Cleaner service for cache manager. (Chris Trezzo and Sangjin Lee via kasha) 2014-10-25 10:31:06 -07:00
Jian He f44cf99599 YARN-2314. Disable ContainerManagementProtocolProxy cache by default to prevent creating thousands of threads in a large cluster. Contributed by Jason Lowe 2014-10-24 23:05:16 -07:00
Jian He 5864dd99a4 YARN-1915. Fixed a race condition that client could use the ClientToAMToken to contact with AM before AM actually receives the ClientToAMTokenMasterKey. Contributed by Jason Lowe 2014-10-24 22:47:56 -07:00
Karthik Kambatla 683897fd02 YARN-2713. "RM Home" link in NM should point to one of the RMs in an HA setup. (kasha) 2014-10-24 15:00:12 -07:00
Haohui Mai 0ac698864d Fix CHANGES.txt for HADOOP-112321 and HADOOP-10748. 2014-10-24 14:23:43 -07:00
Haohui Mai dc6e819ed8 HADOOP-11231. Remove dead code in ServletUtil. Contributed by Li Lu. 2014-10-24 14:19:52 -07:00
Zhijie Shen f81dc3f995 YARN-2703. Added logUploadedTime into LogValue for better display. Contributed by Xuan Gong. 2014-10-24 14:10:46 -07:00
Colin Patrick Mccabe a52eb4bc5f HDFS-6988. Improve HDFS-6581 eviction configuration (Xiaoyu Yao via Colin P. McCabe) 2014-10-24 13:08:59 -07:00
Jian He 501e49f2e1 Fix CHANGES.txt for HADOOP-11228 2014-10-24 12:56:39 -07:00
Jian He f7e89bb349 HADOOP-11228. Winutils task: unsecure path should not call AddNodeManagerAndUserACEsToObject. Contributed by Remus Rusanu 2014-10-24 12:50:27 -07:00
Jitendra Pandey 86ac0d40b8 HDFS-6904. Added files missing in previous commit. 2014-10-24 12:01:09 -07:00
Jitendra Pandey e2be333744 HDFS-6904. YARN unable to renew delegation token fetched via webhdfs due to incorrect service port. 2014-10-24 11:35:19 -07:00
Zhijie Shen e31f0a6558 YARN-2724. Skipped uploading a local log file to HDFS if exception is raised when opening it. Contributed by Xuan Gong. 2014-10-24 11:13:44 -07:00
Haohui Mai b3d8a642a9 HDFS-7283. Bump DataNode OOM log from WARN to ERROR. Contributed by Stephen Chu. 2014-10-24 10:50:16 -07:00
Haohui Mai 0942c99eba HDFS-7258. CacheReplicationMonitor rescan schedule log should use DEBUG level instead of INFO level. Contributed by Xiaoyu Yao. 2014-10-23 23:58:32 -07:00
Jian He 071c925c7d Updated CHANGES.txt to move YARN-2682 to branch-2.6 2014-10-23 22:27:25 -07:00
Zhijie Shen 0f3b6900be YARN-2209. Replaced AM resync/shutdown command with corresponding exceptions and made related MR changes. Contributed by Jian He. 2014-10-23 21:56:03 -07:00
yliu 57dec28807 HDFS-7243. HDFS concat operation should not be allowed in Encryption Zone. (clamb via yliu) 2014-10-24 11:12:18 +08:00
Colin Patrick Mccabe 5b56ac4c72 HDFS-7223. Tracing span description of IPC client is too long (iwasakims via cmccabe) 2014-10-23 19:14:00 -07:00
Karthik Kambatla db45f047ab HADOOP-11170. ZKDelegationTokenSecretManager fails to renewToken created by a peer. (Arun Suresh and Gregory Chanan via kasha) 2014-10-23 17:04:14 -07:00
Haohui Mai 670879ef41 HDFS-7257. Add the time of last HA state transition to NN's /jmx page. Contributed by Charles Lamb. 2014-10-23 16:52:58 -07:00
Allen Wittenauer 828429dec1 HDFS-7232. Populate hostname in httpfs audit log (Zoran Dimitrijevic via aw) 2014-10-23 14:06:19 -07:00
Colin Patrick Mccabe 7ab754545d HDFS-7227. Fix findbugs warning about NP_DEREFERENCE_OF_READLINE_VALUE in SpanReceiverHost (cmccabe) 2014-10-23 13:25:39 -07:00
Andrew Wang 86cad007d7 HDFS-7222. Expose DataNode network errors as a metric. (Charles Lamb via wang) 2014-10-23 12:53:01 -07:00
Andrew Wang 8c5b23b547 HDFS-7165. Separate block metrics for files with replication count 1. (Zhe Zhang via wang) 2014-10-23 12:28:02 -07:00
Brandon Li d71d40a63d HDFS-7180. NFSv3 gateway frequently gets stuck due to GC. Contributed by Brandon Li 2014-10-22 21:27:01 -07:00
Zhijie Shen b94b8b30f2 YARN-2732. Fixed syntax error in SecureContainer.apt.vm. Contributed by Jian He. 2014-10-22 18:39:29 -07:00
Haohui Mai f729ecf9d2 HDFS-7277. Remove explicit dependency on netty 3.2 in BKJournal. Contributed by Haohui Mai. 2014-10-22 17:31:57 -07:00
Jian He 3b12fd6cfb YARN-2198. Remove the need to run NodeManager as privileged account for Windows Secure Container Executor. Contributed by Remus Rusanu 2014-10-22 15:57:46 -07:00
Andrew Wang a36399e09c HDFS-6824. Additional user documentation for HDFS encryption. 2014-10-22 14:38:47 -07:00
Andrew Wang 08457e9e57 Move HDFS-2486 down to 2.7.0 in CHANGES.txt 2014-10-22 14:35:06 -07:00