Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,943 Commits 326 Branches 371 Tags
Commit Graph

11943 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jason Lowe
782aeabcd5 YARN-5389. TestYarnClient#testReservationDelete fails. Contributed by Sean Po 
(cherry picked from commit 3d86110a5ccfdaff8671fb6ad8f67b4ab66f33da)
 2016-08-25 14:47:40 +00:00
Varun Vasudev
952c309dd9 YARN-5042. Mount /sys/fs/cgroup into Docker containers as read only mount. Contributed by luhuichun. 
(cherry picked from commit 42d9876471ff0bf0ea240cd48fe483cda8aa1ec7)
 2016-08-25 14:18:12 +05:30
Varun Saxena
42feab2436 YARN-5537. Fix intermittent failure of TestAMRMClient#testAMRMClientWithContainerResourceChange (Bibin A Chundatt via Varun Saxena) 2016-08-25 14:12:28 +05:30
Kihwal Lee
ba3257baf5 HDFS-10772. Reduce byte/string conversions for get listing. Contributed by Daryn Sharp. 
(cherry picked from commit a1f3293762dddb0ca953d1145f5b53d9086b25b8)
 2016-08-24 15:25:33 -05:00
Xiao Chen
e31745e281 HADOOP-13396. Allow pluggable audit loggers in KMS. Contributed by Xiao Chen. 
(cherry picked from commit 3476156807733505746951f0c9346592742bbbb2)

Conflicts:
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMSAudit.java
 2016-08-24 11:09:54 -07:00
Arun Suresh
bd348d20b2 Revert "YARN-5049. Extend NMStateStore to save queued container information. (Konstantinos Karanasos via asuresh)" 
This reverts commit 307cda70dbde6a8e377794b395a0d958603df5d7.
 2016-08-24 10:23:06 -07:00
Wei-Chiu Chuang
d19e29bd68 HDFS-8986. Add option to -du to calculate directory space usage excluding snapshots. Contributed by Xiao Chen. 2016-08-24 08:49:54 -07:00
Jason Lowe
5cdc4ba9f4 MAPREDUCE-6761. Regression when handling providers - invalid configuration ServiceConfiguration causes Cluster initialization failure. Contributed by Peter Vary 
(cherry picked from commit 6fa9bf4407a0b09be8ce4e52d2fde89adba34f1a)
 2016-08-24 14:42:06 +00:00
Daryn Sharp
a30f6a68fa HDFS-10762. Pass IIP for file status related methods 
(cherry picked from commit ec252ce0fc0998ce13f31af3440c08a236328e5a)
 2016-08-24 08:51:05 -05:00
Akira Ajisaka
2321b73037 HADOOP-13538. Deprecate getInstance and initialize methods with Path in TrashPolicy. Contributed by Yiqun Lin. 
(cherry picked from commit 092b4d5bfd02131d62723fc5673892305eb9fcef)
 2016-08-24 16:50:11 +09:00
Zhe Zhang
dfcbc12026 HADOOP-12765. HttpServer2 should switch to using the non-blocking SslSelectChannelConnector to prevent performance degradation when handling SSL connections. Contributed by Min Shen. Branch-2 patch contributed by Wei-Chiu Chuang. 2016-08-23 14:46:08 -07:00
Naganarasimha
5fa241daa0 YARN-4491. yarn list command to support filtering by tags. Contributed by Varun Saxena 
(cherry picked from commit 143c59e4c5a811eb2c12cf6626d558f9b8796e03)
 2016-08-24 01:55:24 +05:30
Masatake Iwasaki
e1d3b8e71f HADOOP-13497. fix wrong command in CredentialProviderAPI.md. Contributed by Yuanbo Liu. 
(cherry picked from commit 8aae8d6bf03ade0607547ed461dc99a336a7e9d4)
 2016-08-24 00:09:50 +09:00
Jason Lowe
8cd3996246 HDFS-9745. TestSecureNNWithQJM#testSecureMode sometimes fails with timeouts. Contributed by Xiao Chen 
(cherry picked from commit 126d165efd80e266a8309241f3cf059e358f5019)
 2016-08-23 14:48:35 +00:00
Chris Nauroth
cda68de9b9 HADOOP-13446. Support running isolated unit tests separate from AWS integration tests. Contributed by Chris Nauroth. 2016-08-23 07:19:20 -07:00
Jian He
a318ef7a66 HADOOP-13524. mvn eclipse:eclipse generates .gitignore'able files. Contributed by Vinod Kumar Vavilapalli 
(cherry picked from commit dd76238a3bafd58faa6f38f075505bef1012f150)
 2016-08-23 19:13:48 +08:00
Akira Ajisaka
94a844b4f6 HDFS-10783. The option '-maxSize' and '-step' fail in OfflineImageViewer. Contributed by Yiqun Lin. 
(cherry picked from commit e90f3359de299ef5e3a54ca71070e3dfe1dbb98c)
 2016-08-23 19:58:13 +09:00
Rohith Sharma K S
a19859c3f5 YARN-5544. TestNodeBlacklistingOnAMFailures fails on trunk. Contributed by Sunil G. 
(cherry picked from commit 0d5997d2b98eb89e72828dfcd78f02aa4e7e1e67)
 2016-08-23 14:39:19 +05:30
Akira Ajisaka
41fe85f868 MAPREDUCE-6587. Remove unused params in connection-related methods of Fetcher. Contributed by Yiqun Lin. 
(cherry picked from commit 8cc4a67059e37b2083cd5468b35a64a403a3e3ae)
 2016-08-23 17:05:45 +09:00
Eric Yang
9faacbec2c HDFS-8312. Added permission check for moving file to Trash. (Weiwei Yang via Eric Yang) 2016-08-22 18:32:06 -07:00
Xiao Chen
a4b296734b HADOOP-13526. Add detailed logging in KMS for the authentication failure of proxy user. Contributed by Suraj Acharya. 
(cherry picked from commit 98e7be769a7e69bdaec4f67143949f282f6761cf)
 2016-08-22 18:08:09 -07:00
Xiao Chen
c76e0b93f0 HADOOP-13487. Hadoop KMS should load old delegation tokens from Zookeeper on startup. Contributed by Xiao Chen. 
(cherry picked from commit 2f21d53e3aaf97f425f954f52b50f36dddb6b886)
 2016-08-22 14:42:25 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
8a6a7c82f2 HDFS-10692. Update JDiff report's base version for HDFS from 2.6.0 to 2.7.2. Contributed by Wangda Tan. 
(cherry picked from commit dc7a1c54f4447fb01980ae61d5d67e90c4f52f00)
 2016-08-22 11:36:38 -07:00
Akira Ajisaka
62c7d09efa HDFS-10645. Make block report size as a metric and add this metric to datanode web ui. Contributed by Yuanbo Liu. 2016-08-22 14:22:37 +09:00
Mingliang Liu
50a8b0eb6b HADOOP-13527. Add Spark to CallerContext LimitedPrivate scope. (Contributed by Weiqing Yang) 2016-08-21 09:41:19 -07:00
Varun Saxena
4ba8dbf00e MAPREDUCE-6762. ControlledJob#toString failed with NPE when job status is not successfully updated (Weiwei Yang via Varun Saxena) 2016-08-21 21:50:44 +05:30
Jing Zhao
fff0418458 HDFS-10764. Fix INodeFile#getBlocks to not return null. Contributed by Arpit Agarwal. 
(cherry picked from commit 0faee62a0c8c1b8fd83227babfd00fbc2b26bddf)
 2016-08-19 22:23:55 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
a299146b6d HADOOP-13428. Fixed hadoop-common build files to generate jdiff by working around a jdiff-bug. Contributed by Wangda Tan. 
(cherry picked from commit 99603e902244f17b04cfd55122f47355d070b588)
 2016-08-19 19:10:35 -07:00
Wangda Tan
3e511f39c2 YARN-4685. Disable AM blacklisting by default to mitigate situations that application get hanged. (Rohith Sharma K S via wangda) 
(cherry picked from commit 2da32a6ef9edebd86ca9672d10ce35b5a46818cc)
 2016-08-19 16:47:42 -07:00
Wangda Tan
c7d782d2f6 YARN-3388. Allocation in LeafQueue could get stuck because DRF calculator isn't well supported when computing user-limit. (Nathan Roberts via wangda) 
(cherry picked from commit 444b2ea7afebf9f6c3d356154b71abfd0ea95b23)
 2016-08-19 16:47:03 -07:00
Wangda Tan
65822e55fd MAPREDUCE-6310. Add jdiff support to MapReduce. (Li Lu/vinodkv via wangda) 
(cherry picked from commit 3d937457ee60d617d71b36bb6a29344e771670b4)
 2016-08-19 16:41:47 -07:00
Varun Saxena
5128e3320e MAPREDUCE-6763. Shuffle server listen queue is too small (Jason Lowe via Varun Saxena) 2016-08-20 04:05:01 +05:30
Chris Nauroth
6dba38f08b HADOOP-13252. Tune S3A provider plugin mechanism. Contributed by Steve Loughran. 
(cherry picked from commit 763f0497bb996e331e40caed9ca0af966f5b3fac)
 2016-08-19 12:30:47 -07:00
Kihwal Lee
43d1279df0 HDFS-10711. Optimize FSPermissionChecker group membership check. Contributed by Daryn Sharp. 
(cherry picked from commit 2550371f66c49fe0e40aadaa68744311270084ce)
 2016-08-19 09:46:30 -05:00
Varun Saxena
928cccb9f9 YARN-5533. JMX AM Used metrics for queue wrong when app submited to nodelabel partition (Bibin A Chundatt via Varun Saxena) 2016-08-19 17:32:23 +05:30
Varun Saxena
a746775e9a Revert "YARN-5533. JMX AM Used metrics for queue wrong when app submited to nodelabel partition (Bibin A Chundatt via Varun Saxena)" 
This reverts commit 613048a8a24fe08554d2fcdd8b5bc57f7aadaf2f.
 2016-08-19 16:40:48 +05:30
Varun Saxena
613048a8a2 YARN-5533. JMX AM Used metrics for queue wrong when app submited to nodelabel partition (Bibin A Chundatt via Varun Saxena) 2016-08-19 15:18:42 +05:30
Jing Zhao
9fdd1ea724 HADOOP-13503. Improve SaslRpcClient failure logging. Contributed by Xiaobing Zhou. 2016-08-18 14:57:38 -07:00
Mingliang Liu
3f3957ad66 HADOOP-13512. ReloadingX509TrustManager should keep reloading in case of exception. (Contributed by Mingliang Liu) 2016-08-18 14:15:01 -07:00
Chris Nauroth
804a40720b HADOOP-13513. Java 1.7 support for org.apache.hadoop.fs.azure testcases. Contributed by Tibor Kiss. 
(cherry picked from commit ae4db2544346370404826d5b55b2678f5f92fe1f)
 2016-08-18 10:45:03 -07:00
Kihwal Lee
922d045e11 HDFS-10745. Directly resolve paths into INodesInPath. Contributed by Daryn Sharp. 2016-08-18 12:37:57 -05:00
Junping Du
d464483bf7 YARN-4676. Automatic and Asynchronous Decommissioning Nodes Status Tracking. Contributed by Diniel Zhi. 2016-08-18 07:23:29 -07:00
Steve Loughran
e39d81be80 HADOOP-13405 doc for fs.s3a.acl.default indicates incorrect values. Contributed by Shen Yinjie 2016-08-18 14:36:41 +01:00
Varun Saxena
5fa7a14da9 YARN=5526. DrainDispacher#serviceStop blocked if setDrainEventsOnStop invoked (sandflee via Varun Saxena) 2016-08-18 12:23:34 +05:30
Karthik Kambatla
07d5ab16df YARN-4702. FairScheduler: Allow setting maxResources for ad hoc queues. (Daniel Templeton via kasha) 
(cherry picked from commit 20f0eb871c57cc4c5a6d19aae0e3745b6175509b)
 2016-08-17 17:54:28 -07:00
Xiao Chen
a20b943cf9 HDFS-10549. Correctly revoke file leases when closing files. Contributed by Yiqun Lin. 
(cherry picked from commit 85aacaadb5a3f8c78b191867c0bde09b3c4b3c3c)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSStripedOutputStream.java
 2016-08-17 15:50:13 -07:00
Anu Engineer
ac8c3ae784 HADOOP-11786. Fix Javadoc typos in org.apache.hadoop.fs.FileSystem. Contributed by Andras Bokor. 2016-08-17 15:04:02 -07:00
Chris Nauroth
986162f977 HADOOP-13208. S3A listFiles(recursive=true) to do a bulk listObjects instead of walking the pseudo-tree of directories. Contributed by Steve Loughran. 
(cherry picked from commit 822d661b8fcc42bec6eea958d9fd02ef1aaa4b6c)
 2016-08-17 14:55:07 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
2486c4c63a Revert "HDFS-9395. Make HDFS audit logging consistant. Contributed by Kuhu Shukla." 
Reverting this on branch-2.* as it's an incompatible change.

This reverts commit 83f7f62be379045ad6933689b21b76c7086f919d.
 2016-08-17 13:33:09 -07:00
Varun Saxena
9dcb7197d4 YARN-5523. Yarn running container log fetching causes OutOfMemoryError (Xuan Gong via Varun Saxena) 2016-08-18 01:53:55 +05:30