Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,111 Commits 326 Branches 371 Tags
Commit Graph

12111 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jason Lowe
eeb18b0a46 YARN-5560. Clean up bad exception catching practices in TestYarnClient. Contributed by Sean Po 
(cherry picked from commit 4cbe61407dcb71f099bc7ec6ae87560d786ee714)
 2016-08-29 16:15:55 +00:00
Jason Lowe
039c831f5f HADOOP-13552. RetryInvocationHandler logs all remote exceptions. Contributed by Jason Lowe 
(cherry picked from commit 92d8f371553b88e5b3a9d3354e93f75d60d81368)
 2016-08-29 15:56:53 +00:00
Yongjun Zhang
e813a3ea4a HDFS-10652. Add a unit test for HDFS-4660. Contributed by Vinayakumar B., Wei-Chiu Chuang, Yongjun Zhang. 
(cherry picked from commit c25817159af17753b398956cfe6ff14984801b01)
 2016-08-27 22:59:19 -07:00
Wangda Tan
07e1527cc1 YARN-4889. Changes in AMRMClient for identifying resource-requests explicitly. (Arun Suresh via wangda) 
(cherry picked from commit 19c743c1bbcaf3df8f1d63e557143c960a538c42)
 2016-08-26 17:23:55 -07:00
Subru Krishnan
3ad7cb3e1c YARN-5327. API changes required to support recurring reservations in the YARN ReservationSystem. (Sangeetha Abdu Jyothi via Subru). 
(cherry picked from commit b930dc3ec06afa479a249490976e3e127d201706)
 2016-08-26 17:01:37 -07:00
Andrew Wang
1c47a356d8 HDFS-10793. Fix HdfsAuditLogger binary incompatibility introduced by HDFS-9184. Contributed by Manoj Govindassamy. 
(cherry picked from commit a445b82baaa58dcaaa3831e724a9915e9dde57c5)
 2016-08-26 15:40:05 -07:00
Zhe Zhang
f3a4cbcc60 HDFS-10798. Make the threshold of reporting FSNamesystem lock contention configurable. Contributed by Erik Krogen. 
(cherry picked from commit 407b519fb14f79f19ebc4fbdf08204336a7acf77)
 2016-08-26 14:20:48 -07:00
Kihwal Lee
442dfd1bbe HDFS-10768. Optimize mkdir ops. Contributed by Daryn Sharp. 
(cherry picked from commit 8b7adf4ddf420a93c586c4b2eac27dd0f649682e)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirWriteFileOp.java
 2016-08-26 15:49:56 -05:00
Karthik Kambatla
d9b42248de YARN-5373. NPE listing wildcard directory in containerLaunch. (Daniel Templeton via kasha) 
(cherry picked from commit cde3a00526c562a500308232e2b93498d22c90d7)
 2016-08-26 11:08:16 -07:00
Junping Du
af1502fcab YARN-5557. Add localize API to the ContainerManagementProtocol. Contributed by Jian He. 
(cherry picked from commit 9ef632f3b0b0e0808116cd1c7482a205b7ebef7d)
 2016-08-26 09:05:33 -07:00
Kihwal Lee
2a6497cc7c HDFS-8915. TestFSNamesystem.testFSLockGetWaiterCount fails intermittently. Contributed by Masatake Iwasaki. 
(cherry picked from commit 13fb1b50e608558b2970184908ee5b9fcd7eb7b6)
 2016-08-26 10:00:36 -05:00
Naganarasimha
026027166e YARN-3940. Application moveToQueue should check NodeLabel permission. Contributed by Bibin A Chundatt 
(cherry picked from commit 46e02ab719d06f2708c0a61e8011b8f261235193)
 2016-08-26 20:23:01 +05:30
Varun Vasudev
49a97a76f5 YARN-5430. Return container's ip and host from NM ContainerStatus call. Contributed by Jian He. 2016-08-26 16:33:21 +05:30
Naganarasimha
ee3358402a YARN-5564. Fix typo in RM_SCHEDULER_RESERVATION_THRESHOLD_INCREMENT_MULTIPLE. Contributed by Ray Chiang 
(cherry picked from commit 27c3b86252386c9c064a6420b3c650644cbb9ef3)
 2016-08-26 08:53:42 +05:30
Wei-Chiu Chuang
13cbf1677e MAPREDUCE-6764. Teragen LOG initialization bug. Contributed by Yufei Gu. 
(cherry picked from commit 1360bd2d545134b582e70f2add33a105710dc80b)
 2016-08-25 09:51:17 -07:00
Xiaoyu Yao
fc67501393 HDFS-10748. TestFileTruncate#testTruncateWithDataNodesRestart runs sometimes timeout. Contributed by Yiqun Lin. 
(cherry picked from commit 4da5000dd33cf013e7212848ed2c44f1e60e860e)
 2016-08-25 09:22:02 -07:00
Jason Lowe
4037b22b7c YARN-5389. TestYarnClient#testReservationDelete fails. Contributed by Sean Po 2016-08-25 15:10:23 +00:00
Jason Lowe
6de262cdc4 Revert "YARN-5389. TestYarnClient#testReservationDelete fails. Contributed by Sean Po" 
This reverts commit 782aeabcd55b1e1e933f0b924633d68662b50765.
 2016-08-25 14:59:20 +00:00
Jason Lowe
782aeabcd5 YARN-5389. TestYarnClient#testReservationDelete fails. Contributed by Sean Po 
(cherry picked from commit 3d86110a5ccfdaff8671fb6ad8f67b4ab66f33da)
 2016-08-25 14:47:40 +00:00
Varun Vasudev
952c309dd9 YARN-5042. Mount /sys/fs/cgroup into Docker containers as read only mount. Contributed by luhuichun. 
(cherry picked from commit 42d9876471ff0bf0ea240cd48fe483cda8aa1ec7)
 2016-08-25 14:18:12 +05:30
Varun Saxena
42feab2436 YARN-5537. Fix intermittent failure of TestAMRMClient#testAMRMClientWithContainerResourceChange (Bibin A Chundatt via Varun Saxena) 2016-08-25 14:12:28 +05:30
Kihwal Lee
ba3257baf5 HDFS-10772. Reduce byte/string conversions for get listing. Contributed by Daryn Sharp. 
(cherry picked from commit a1f3293762dddb0ca953d1145f5b53d9086b25b8)
 2016-08-24 15:25:33 -05:00
Xiao Chen
e31745e281 HADOOP-13396. Allow pluggable audit loggers in KMS. Contributed by Xiao Chen. 
(cherry picked from commit 3476156807733505746951f0c9346592742bbbb2)

Conflicts:
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMSAudit.java
 2016-08-24 11:09:54 -07:00
Arun Suresh
bd348d20b2 Revert "YARN-5049. Extend NMStateStore to save queued container information. (Konstantinos Karanasos via asuresh)" 
This reverts commit 307cda70dbde6a8e377794b395a0d958603df5d7.
 2016-08-24 10:23:06 -07:00
Wei-Chiu Chuang
d19e29bd68 HDFS-8986. Add option to -du to calculate directory space usage excluding snapshots. Contributed by Xiao Chen. 2016-08-24 08:49:54 -07:00
Jason Lowe
5cdc4ba9f4 MAPREDUCE-6761. Regression when handling providers - invalid configuration ServiceConfiguration causes Cluster initialization failure. Contributed by Peter Vary 
(cherry picked from commit 6fa9bf4407a0b09be8ce4e52d2fde89adba34f1a)
 2016-08-24 14:42:06 +00:00
Daryn Sharp
a30f6a68fa HDFS-10762. Pass IIP for file status related methods 
(cherry picked from commit ec252ce0fc0998ce13f31af3440c08a236328e5a)
 2016-08-24 08:51:05 -05:00
Akira Ajisaka
2321b73037 HADOOP-13538. Deprecate getInstance and initialize methods with Path in TrashPolicy. Contributed by Yiqun Lin. 
(cherry picked from commit 092b4d5bfd02131d62723fc5673892305eb9fcef)
 2016-08-24 16:50:11 +09:00
Zhe Zhang
dfcbc12026 HADOOP-12765. HttpServer2 should switch to using the non-blocking SslSelectChannelConnector to prevent performance degradation when handling SSL connections. Contributed by Min Shen. Branch-2 patch contributed by Wei-Chiu Chuang. 2016-08-23 14:46:08 -07:00
Naganarasimha
5fa241daa0 YARN-4491. yarn list command to support filtering by tags. Contributed by Varun Saxena 
(cherry picked from commit 143c59e4c5a811eb2c12cf6626d558f9b8796e03)
 2016-08-24 01:55:24 +05:30
Masatake Iwasaki
e1d3b8e71f HADOOP-13497. fix wrong command in CredentialProviderAPI.md. Contributed by Yuanbo Liu. 
(cherry picked from commit 8aae8d6bf03ade0607547ed461dc99a336a7e9d4)
 2016-08-24 00:09:50 +09:00
Jason Lowe
8cd3996246 HDFS-9745. TestSecureNNWithQJM#testSecureMode sometimes fails with timeouts. Contributed by Xiao Chen 
(cherry picked from commit 126d165efd80e266a8309241f3cf059e358f5019)
 2016-08-23 14:48:35 +00:00
Chris Nauroth
cda68de9b9 HADOOP-13446. Support running isolated unit tests separate from AWS integration tests. Contributed by Chris Nauroth. 2016-08-23 07:19:20 -07:00
Jian He
a318ef7a66 HADOOP-13524. mvn eclipse:eclipse generates .gitignore'able files. Contributed by Vinod Kumar Vavilapalli 
(cherry picked from commit dd76238a3bafd58faa6f38f075505bef1012f150)
 2016-08-23 19:13:48 +08:00
Akira Ajisaka
94a844b4f6 HDFS-10783. The option '-maxSize' and '-step' fail in OfflineImageViewer. Contributed by Yiqun Lin. 
(cherry picked from commit e90f3359de299ef5e3a54ca71070e3dfe1dbb98c)
 2016-08-23 19:58:13 +09:00
Rohith Sharma K S
a19859c3f5 YARN-5544. TestNodeBlacklistingOnAMFailures fails on trunk. Contributed by Sunil G. 
(cherry picked from commit 0d5997d2b98eb89e72828dfcd78f02aa4e7e1e67)
 2016-08-23 14:39:19 +05:30
Akira Ajisaka
41fe85f868 MAPREDUCE-6587. Remove unused params in connection-related methods of Fetcher. Contributed by Yiqun Lin. 
(cherry picked from commit 8cc4a67059e37b2083cd5468b35a64a403a3e3ae)
 2016-08-23 17:05:45 +09:00
Eric Yang
9faacbec2c HDFS-8312. Added permission check for moving file to Trash. (Weiwei Yang via Eric Yang) 2016-08-22 18:32:06 -07:00
Xiao Chen
a4b296734b HADOOP-13526. Add detailed logging in KMS for the authentication failure of proxy user. Contributed by Suraj Acharya. 
(cherry picked from commit 98e7be769a7e69bdaec4f67143949f282f6761cf)
 2016-08-22 18:08:09 -07:00
Xiao Chen
c76e0b93f0 HADOOP-13487. Hadoop KMS should load old delegation tokens from Zookeeper on startup. Contributed by Xiao Chen. 
(cherry picked from commit 2f21d53e3aaf97f425f954f52b50f36dddb6b886)
 2016-08-22 14:42:25 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
8a6a7c82f2 HDFS-10692. Update JDiff report's base version for HDFS from 2.6.0 to 2.7.2. Contributed by Wangda Tan. 
(cherry picked from commit dc7a1c54f4447fb01980ae61d5d67e90c4f52f00)
 2016-08-22 11:36:38 -07:00
Akira Ajisaka
62c7d09efa HDFS-10645. Make block report size as a metric and add this metric to datanode web ui. Contributed by Yuanbo Liu. 2016-08-22 14:22:37 +09:00
Mingliang Liu
50a8b0eb6b HADOOP-13527. Add Spark to CallerContext LimitedPrivate scope. (Contributed by Weiqing Yang) 2016-08-21 09:41:19 -07:00
Varun Saxena
4ba8dbf00e MAPREDUCE-6762. ControlledJob#toString failed with NPE when job status is not successfully updated (Weiwei Yang via Varun Saxena) 2016-08-21 21:50:44 +05:30
Jing Zhao
fff0418458 HDFS-10764. Fix INodeFile#getBlocks to not return null. Contributed by Arpit Agarwal. 
(cherry picked from commit 0faee62a0c8c1b8fd83227babfd00fbc2b26bddf)
 2016-08-19 22:23:55 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
a299146b6d HADOOP-13428. Fixed hadoop-common build files to generate jdiff by working around a jdiff-bug. Contributed by Wangda Tan. 
(cherry picked from commit 99603e902244f17b04cfd55122f47355d070b588)
 2016-08-19 19:10:35 -07:00
Wangda Tan
3e511f39c2 YARN-4685. Disable AM blacklisting by default to mitigate situations that application get hanged. (Rohith Sharma K S via wangda) 
(cherry picked from commit 2da32a6ef9edebd86ca9672d10ce35b5a46818cc)
 2016-08-19 16:47:42 -07:00
Wangda Tan
c7d782d2f6 YARN-3388. Allocation in LeafQueue could get stuck because DRF calculator isn't well supported when computing user-limit. (Nathan Roberts via wangda) 
(cherry picked from commit 444b2ea7afebf9f6c3d356154b71abfd0ea95b23)
 2016-08-19 16:47:03 -07:00
Wangda Tan
65822e55fd MAPREDUCE-6310. Add jdiff support to MapReduce. (Li Lu/vinodkv via wangda) 
(cherry picked from commit 3d937457ee60d617d71b36bb6a29344e771670b4)
 2016-08-19 16:41:47 -07:00
Varun Saxena
5128e3320e MAPREDUCE-6763. Shuffle server listen queue is too small (Jason Lowe via Varun Saxena) 2016-08-20 04:05:01 +05:30