Zhijie Shen
ae62fe2ebd
YARN-2741. Made NM web UI serve logs on the drive other than C: on Windows. Contributed by Craig Welch.
...
(cherry picked from commit 8984e9b177
)
2014-10-28 14:13:31 -07:00
Xuan
126d1b9089
YARN-2758. Update TestApplicationHistoryClientService to use the new generic history store. Contributed by Zhijie Shen
2014-10-28 13:32:42 -07:00
Xuan
615af9e454
YARN-2279. Add UTs to cover timeline server authentication. Contributed by Zhijie Shen
2014-10-28 11:20:46 -07:00
Karthik Kambatla
f5361a8354
YARN-2760. Remove 'experimental' from FairScheduler docs. (Harsh J via kasha)
...
(cherry picked from commit ade3727ecb
)
2014-10-28 08:50:04 -07:00
yliu
9465da32e8
HDFS-6606. Optimize HDFS Encrypted Transport performance. (yliu)
2014-10-28 21:19:26 +08:00
yliu
fe4da80c76
HADOOP-11233. hadoop.security.kms.client.encrypted.key.cache.expiry property spelled wrong in core-default. (Stephen Chu via yliu)
2014-10-28 14:47:11 +08:00
Vinayakumar B
3e4e6e3da7
HDFS-6995. Block should be placed in the client's 'rack-local' node if 'client-local' node is not available (vinayakumarb)
...
Adding missed test file
(cherry picked from commit cba1f9e389
)
(cherry picked from commit fea721daf9
)
2014-10-28 10:06:06 +05:30
Vinayakumar B
043364ffa8
HDFS-6995. Block should be placed in the client's 'rack-local' node if 'client-local' node is not available (vinayakumarb)
...
(cherry picked from commit ed841dd9a9
)
(cherry picked from commit 5f58886770
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2014-10-28 10:04:56 +05:30
Zhijie Shen
d92d4e32f2
MAPREDUCE-6018. Added an MR specific config to enable emitting job history data to the timeline server. Contributed by Robert Kanter.
...
(cherry picked from commit 971e91c8c0
)
2014-10-27 21:09:20 -07:00
Zhijie Shen
71ab776b21
MAPREDUCE-5933. Enabled MR AM to post history events to the timeline server. Contributed by Robert Kanter.
...
(cherry picked from commit 6b2f11b54b
)
2014-10-27 20:45:22 -07:00
Jian He
8d4c93aabf
YARN-2502. Changed DistributedShell to support node labels. Contributed by Wangda Tan
...
(cherry picked from commit f6b963fdfc
)
2014-10-27 20:14:30 -07:00
cnauroth
c03cca7e23
HDFS-7128. Decommission slows way down when it gets towards the end. Contributed by Ming Ma.
...
(cherry picked from commit 80cb472620f0a7889e311ca32212a42b95c6794e)
(cherry picked from commit 7e949744b1
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DatanodeDescriptor.java
2014-10-27 16:41:55 -07:00
Vinod Kumar Vavilapalli
0af8cc9ca2
YARN-2704. Changed ResourceManager to optionally obtain tokens itself for the sake of localization and log-aggregation for long-running services. Contributed by Jian He.
...
(cherry picked from commit a16d022ca4
)
2014-10-27 15:51:20 -07:00
cnauroth
e8d77593fa
HDFS-6934. Revert files accidentally committed.
...
(cherry picked from commit 5b1dfe78b8
)
(cherry picked from commit 5dbd27f8b4
)
2014-10-27 12:18:48 -07:00
cnauroth
a9f31af29c
HDFS-6934. Move checksum computation off the hot path when writing to RAM disk. Contributed by Chris Nauroth.
...
(cherry picked from commit 463aec1171
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
(cherry picked from commit 3d67da502a
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/BlockReaderLocal.java
2014-10-27 12:01:47 -07:00
Jing Zhao
6724c2f7e4
HDFS-7296. HdfsConstants#MEMORY_STORAGE_POLICY_ID and HdfsConstants#MEMORY_STORAGE_POLICY_ID are missing in branch-2. Contributed by Jing Zhao.
2014-10-27 11:21:48 -07:00
Jian He
ba1e549145
YARN-2591. Fixed AHSWebServices to return FORBIDDEN(403) if the request user doesn't have access to the history data. Contributed by Zhijie Shen
...
(cherry picked from commit c05b581a55
)
2014-10-27 10:46:59 -07:00
Xuan
55c5612caf
YARN-2726. CapacityScheduler should explicitly log when an accessible label has no capacity. Contributed by Wangda Tan
2014-10-27 10:30:09 -07:00
Zhijie Shen
ab7a21569c
YARN-2734. Skipped sub-folders in the local log dir when aggregating logs. Contributed by Xuan Gong.
...
(cherry picked from commit caecd9fffe
)
2014-10-26 13:00:26 -07:00
Vinod Kumar Vavilapalli
259db7a726
YARN-2743. Fixed a bug in ResourceManager that was causing RMDelegationToken identifiers to be tampered and thus causing app submission failures in secure mode. Contributed by Jian He.
...
(cherry picked from commit 0186645505
)
2014-10-26 11:29:06 -07:00
Karthik Kambatla
7bb5071a9e
HADOOP-11170. ZKDelegationTokenSecretManager fails to renewToken created by a peer. (Arun Suresh and Gregory Chanan via kasha)
...
(cherry picked from commit db45f047ab
)
Conflicts:
hadoop-common-project/hadoop-common/CHANGES.txt
2014-10-26 11:28:50 -07:00
Xuan
cccfc27e0d
YARN-2723. Fix rmadmin -replaceLabelsOnNode does not correctly parse port. Contributed by Naganarasimha G R
2014-10-25 12:49:05 -07:00
Jian He
c8d48d2981
YARN-2314. Disable ContainerManagementProtocolProxy cache by default to prevent creating thousands of threads in a large cluster. Contributed by Jason Lowe
...
(cherry picked from commit f44cf99599
)
2014-10-24 23:06:38 -07:00
Jian He
728cc2394c
YARN-1915. Fixed a race condition that client could use the ClientToAMToken to contact with AM before AM actually receives the ClientToAMTokenMasterKey. Contributed by Jason Lowe
...
(cherry picked from commit 5864dd99a4
)
2014-10-24 22:49:19 -07:00
Zhijie Shen
a41371e173
YARN-2703. Added logUploadedTime into LogValue for better display. Contributed by Xuan Gong.
...
(cherry picked from commit f81dc3f995
)
2014-10-24 14:13:28 -07:00
Colin Patrick Mccabe
62f23d0b7d
HDFS-6988. Improve HDFS-6581 eviction configuration (Xiaoyu Yao via Colin P. McCabe)
...
(cherry picked from commit a52eb4bc5f
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
(cherry picked from commit 2bcda17ee7
)
2014-10-24 13:22:26 -07:00
Jian He
f236e17216
HADOOP-11228. Winutils task: unsecure path should not call AddNodeManagerAndUserACEsToObject. Contributed by Remus Rusanu
...
(cherry picked from commit f7e89bb349
)
Conflicts:
hadoop-common-project/hadoop-common/CHANGES.txt
(cherry picked from commit 299c9b456d
)
2014-10-24 12:58:11 -07:00
Jitendra Pandey
abb28fbb46
HDFS-6904. Added files missing in previous commit.
2014-10-24 11:59:55 -07:00
Jitendra Pandey
327db15362
HDFS-6904. YARN unable to renew delegation token fetched via webhdfs due to incorrect service port.
2014-10-24 11:44:22 -07:00
Zhijie Shen
38fa39aa17
YARN-2724. Skipped uploading a local log file to HDFS if exception is raised when opening it. Contributed by Xuan Gong.
...
(cherry picked from commit e31f0a6558
)
2014-10-24 11:16:44 -07:00
Zhijie Shen
09e422302f
YARN-2209. Replaced AM resync/shutdown command with corresponding exceptions and made related MR changes. Contributed by Jian He.
...
(cherry picked from commit 0f3b6900be
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2014-10-23 22:18:27 -07:00
yliu
82ac5c901e
HDFS-7243. HDFS concat operation should not be allowed in Encryption Zone. (clamb via yliu)
2014-10-24 11:35:13 +08:00
Brandon Li
e1baa3a503
HDFS-7180. NFSv3 gateway frequently gets stuck due to GC. Contributed by Brandon Li
...
(cherry picked from commit d71d40a63d
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
(cherry picked from commit d27cd5ad77
)
2014-10-22 21:35:09 -07:00
Zhijie Shen
78efd4fd5c
YARN-2732. Fixed syntax error in SecureContainer.apt.vm. Contributed by Jian He.
...
(cherry picked from commit b94b8b30f2
)
2014-10-22 18:42:27 -07:00
Jian He
29d0164ee7
YARN-2198. Remove the need to run NodeManager as privileged account for Windows Secure Container Executor. Contributed by Remus Rusanu
...
(cherry picked from commit 3b12fd6cfb
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2014-10-22 16:22:08 -07:00
Jian He
a057552468
YARN-2682. Updated WindowsSecureContainerExecutor to not use DefaultContainerExecutor#getFirstApplicationDir and use getWorkingDir() instead. Contributed by Zhihai Xu
...
(cherry picked from commit 0fd0ebae64
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/DefaultContainerExecutor.java
2014-10-22 16:19:40 -07:00
Vinod Kumar Vavilapalli
e282805f1c
YARN-1063. Augmented Hadoop common winutils to have the ability to create containers as domain users. Contributed by Remus Rusanu.
...
Committed as a YARN patch even though all the code changes are in common.
(cherry picked from commit 5ca97f1e60
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2014-10-22 16:10:49 -07:00
Karthik Kambatla
6064b9d02f
HADOOP-11122. Fix findbugs in ZK DelegationTokenSecretManagers. (Arun Suresh via kasha)
...
(cherry picked from commit 70719e5c62
)
2014-10-22 14:36:06 -07:00
Steve Loughran
ada23f3dd3
YARN-2700 TestSecureRMRegistryOperations failing on windows: auth problems
2014-10-22 21:12:52 +01:00
Jian He
cca473a321
MAPREDUCE-6126. Fixed Rumen JobBuilder to ignore NormalizedResourceEvent. Contributed by Junping Du
...
Conflicts:
hadoop-mapreduce-project/CHANGES.txt
(cherry picked from commit 9b973b7c83
)
2014-10-22 10:58:21 -07:00
Steve Loughran
8fdff5b791
YARN-2692 ktutil test hanging on some machines/ktutil versions (stevel)
2014-10-22 14:34:57 +01:00
Zhijie Shen
b1ca12bc0b
YARN-2721. Suppress NodeExist exception thrown by ZKRMStateStore when it retries creating znode. Contributed by Jian He.
...
(cherry picked from commit 7e3b5e6f5c
)
2014-10-21 21:53:27 -07:00
Vinod Kumar Vavilapalli
a1c5d4c51f
YARN-2715. Fixed ResourceManager to respect common configurations for proxy users/groups beyond just the YARN level config. Contributed by Zhijie Shen.
...
(cherry picked from commit c0e034336c
)
2014-10-21 20:11:14 -07:00
Zhijie Shen
7df8cbdd0f
YARN-2709. Made timeline client getDelegationToken API retry if ConnectException happens. Contributed by Li Lu.
...
(cherry picked from commit b2942762d7
)
2014-10-21 16:09:23 -07:00
Colin Patrick Mccabe
1ec2dbf093
HDFS-7154. Fix returning value of starting reconfiguration task (Lei Xu via Colin P. McCabe)
...
(cherry picked from commit 7aab5fa1bd
)
(cherry picked from commit 8c3b007236
)
2014-10-21 15:42:39 -07:00
cnauroth
8727f9e1b0
YARN-2720. Windows: Wildcard classpath variables not expanded against resources contained in archives. Contributed by Craig Welch.
...
(cherry picked from commit 6637e3cf95
)
(cherry picked from commit a066134277
)
2014-10-21 12:36:43 -07:00
Brandon Li
20108263fb
HDFS-7215.Add JvmPauseMonitor to NFS gateway. Contributed by Brandon Li
...
(cherry picked from commit 4e134a02a4
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
(cherry picked from commit c800e058ea
)
2014-10-21 11:56:26 -07:00
Brandon Li
3fa1ee2923
HDFS-7259. Unresponseive NFS mount point due to deferred COMMIT response. Contributed by Brandon Li
...
(cherry picked from commit 33e020cb19
)
2014-10-21 11:05:50 -07:00
Jason Lowe
413fe4cb02
YARN-90. NodeManager should identify failed disks becoming good again. Contributed by Varun Vasudev
...
(cherry picked from commit 6f2028bd15
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestDirectoryCollection.java
2014-10-21 17:43:22 +00:00
Zhijie Shen
fcdeba204c
YARN-2717. Avoided duplicate logging when container logs are not found. Contributed by Xuan Gong.
...
(cherry picked from commit 171f2376d2
)
2014-10-20 22:24:19 -07:00