Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,783 Commits 326 Branches 371 Tags
Commit Graph

11783 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jason Lowe
9df118e5fe MAPREDUCE-4784. TestRecovery occasionally fails. Contributed by Haibo Chen 
(cherry picked from commit af508605a9edc126c170160291dbc2fe58b66dea)

Conflicts:

	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestRecovery.java
(cherry picked from commit f70f522e805b2d8dd49bae07fc65d37a78ad2fca)
 2016-08-30 14:09:45 +00:00
Zhe Zhang
ee28034a8a HDFS-10814. Add assertion for getNumEncryptionZones when no EZ is created. Contributed by Vinitha Reddy Gankidi. 
(cherry picked from commit 4bd45f54eedd449a98a90540698c6ceb47454fec)
 2016-08-29 23:43:04 -07:00
Xiao Chen
a291306510 HDFS-4210. Throw helpful exception when DNS entry for JournalNode cannot be resolved. Contributed by Charles Lamb and John Zhuge. 
(cherry picked from commit 046f6bf0f944311fc70de3a96fc6ab8211cbbbd8)
 2016-08-29 17:42:30 -07:00
Ray Chiang
9ad3a7a43b YARN-5567. Fix script exit code checking in NodeHealthScriptRunner#reportHealthStatus. (Yufei Gu via rchiang) 
(cherry picked from commit 05ede003868871addc30162e9707c3dc14ed6b7a)
(cherry picked from commit 3b19bcb8f0f70606a8080bc46fa64cd34f6280d7)
 2016-08-29 16:15:39 -07:00
Zhe Zhang
765139e4da YARN-5550. TestYarnCLI#testGetContainers should format according to CONTAINER_PATTERN. Contributed by Jonathan Hung. 
(cherry picked from commit ed6ff5cd789cab621fbfb88c8e8de4f215cd2961)
(cherry picked from commit 3ad4f0823c22b686120e8fa06ac52d705defcc61)
 2016-08-29 14:51:40 -07:00
Yongjun Zhang
18f7628664 HDFS-10625. VolumeScanner to report why a block is found bad. Contributed by Rushabh S Shah and Yiqun Lin. 
(cherry picked from commit 5d1609ddf275e4907bd224bf618e2aad4b262888)
 2016-08-29 14:15:23 -07:00
Mingliang Liu
250ddf155f HADOOP-13559. Remove close() within try-with-resources in ChecksumFileSystem/ChecksumFs classes. (Contributed by Aaron Fabbri) 
(cherry picked from commit 6fcb04c1780ac3dca5b986f1bcd558fffccb3eb9)
 2016-08-29 13:05:34 -07:00
Jason Lowe
f6578999d1 MAPREDUCE-6768. TestRecovery.testSpeculative failed with NPE. Contributed by Haibo Chen 
(cherry picked from commit 44d0af2611cb565d8ec68f92e27937342646cca5)
 2016-08-29 19:58:23 +00:00
Mingliang Liu
f84ae6f091 HDFS-10807. Doc about upgrading to a version of HDFS with snapshots may be confusing. (Contributed by Mingliang Liu) 
(cherry picked from commit 6742fb6e68d349055f985eb640d845e689d75384)
 2016-08-29 10:19:53 -07:00
Jason Lowe
09e585e30a YARN-5560. Clean up bad exception catching practices in TestYarnClient. Contributed by Sean Po 
(cherry picked from commit 4cbe61407dcb71f099bc7ec6ae87560d786ee714)
 2016-08-29 16:20:04 +00:00
Jason Lowe
b1979bec51 HADOOP-13552. RetryInvocationHandler logs all remote exceptions. Contributed by Jason Lowe 
(cherry picked from commit 92d8f371553b88e5b3a9d3354e93f75d60d81368)
 2016-08-29 15:58:34 +00:00
Yongjun Zhang
6f10a0a87b HDFS-10652. Add a unit test for HDFS-4660. Contributed by Vinayakumar B., Wei-Chiu Chuang, Yongjun Zhang. 
(cherry picked from commit c25817159af17753b398956cfe6ff14984801b01)
 2016-08-27 23:11:57 -07:00
Andrew Wang
42e03d7bfe HDFS-10793. Fix HdfsAuditLogger binary incompatibility introduced by HDFS-9184. Contributed by Manoj Govindassamy. 
(cherry picked from commit a445b82baaa58dcaaa3831e724a9915e9dde57c5)
(cherry picked from commit 1c47a356d8a29d95f9f991379d3bec92d28a728c)
 2016-08-26 15:40:13 -07:00
Zhe Zhang
96cf681b5d HDFS-10798. Make the threshold of reporting FSNamesystem lock contention configurable. Contributed by Erik Krogen. 
(cherry picked from commit 407b519fb14f79f19ebc4fbdf08204336a7acf77)
(cherry picked from commit f3a4cbcc60572c73e0d15580bae42a36c92fe247)
 2016-08-26 14:23:51 -07:00
Kihwal Lee
1c5ecb6cc4 HDFS-8915. TestFSNamesystem.testFSLockGetWaiterCount fails intermittently. Contributed by Masatake Iwasaki. 
(cherry picked from commit 13fb1b50e608558b2970184908ee5b9fcd7eb7b6)
 2016-08-26 10:01:19 -05:00
Naganarasimha
b952ce854b YARN-3940. Application moveToQueue should check NodeLabel permission. Contributed by Bibin A Chundatt 
(cherry picked from commit 46e02ab719d06f2708c0a61e8011b8f261235193)
 2016-08-26 20:24:37 +05:30
Wei-Chiu Chuang
8d467037cf MAPREDUCE-6764. Teragen LOG initialization bug. Contributed by Yufei Gu. 
(cherry picked from commit 1360bd2d545134b582e70f2add33a105710dc80b)
(cherry picked from commit 13cbf1677ef5ba82b16d9a5ab1661333a492226d)
 2016-08-25 09:54:57 -07:00
Xiaoyu Yao
db415ea166 HDFS-10748. TestFileTruncate#testTruncateWithDataNodesRestart runs sometimes timeout. Contributed by Yiqun Lin. 
(cherry picked from commit 4da5000dd33cf013e7212848ed2c44f1e60e860e)
 2016-08-25 09:22:16 -07:00
Jason Lowe
8657dece8b YARN-5389. TestYarnClient#testReservationDelete fails. Contributed by Sean Po 
(cherry picked from commit 4037b22b7cb2755df17a65b03f6c0b9f63a476cd)
 2016-08-25 15:11:47 +00:00
Wei-Chiu Chuang
bd729af8a8 HDFS-8986. Add option to -du to calculate directory space usage excluding snapshots. Contributed by Xiao Chen. 2016-08-24 08:53:43 -07:00
Jason Lowe
00c8ab91ba MAPREDUCE-6761. Regression when handling providers - invalid configuration ServiceConfiguration causes Cluster initialization failure. Contributed by Peter Vary 
(cherry picked from commit 6fa9bf4407a0b09be8ce4e52d2fde89adba34f1a)
 2016-08-24 14:42:53 +00:00
Akira Ajisaka
f871aed87e HADOOP-13538. Deprecate getInstance and initialize methods with Path in TrashPolicy. Contributed by Yiqun Lin. 
(cherry picked from commit 092b4d5bfd02131d62723fc5673892305eb9fcef)
(cherry picked from commit 2321b73037fcf7ea9ee60c1a94838233c3df8908)
 2016-08-24 16:50:28 +09:00
Zhe Zhang
8bc33bf343 HADOOP-12765. HttpServer2 should switch to using the non-blocking SslSelectChannelConnector to prevent performance degradation when handling SSL connections. Contributed by Min Shen. Branch-2 patch contributed by Wei-Chiu Chuang. 
(cherry picked from commit dfcbc12026b591745a7d7279f2b840152cb53a91)
 2016-08-23 14:46:47 -07:00
Masatake Iwasaki
80d8e79e26 HADOOP-13497. fix wrong command in CredentialProviderAPI.md. Contributed by Yuanbo Liu. 
(cherry picked from commit 8aae8d6bf03ade0607547ed461dc99a336a7e9d4)
 2016-08-24 00:10:37 +09:00
Jason Lowe
f57a26378e HDFS-9745. TestSecureNNWithQJM#testSecureMode sometimes fails with timeouts. Contributed by Xiao Chen 
(cherry picked from commit 126d165efd80e266a8309241f3cf059e358f5019)
 2016-08-23 14:49:27 +00:00
Jian He
5ae8b82f37 HADOOP-13524. mvn eclipse:eclipse generates .gitignore'able files. Contributed by Vinod Kumar Vavilapalli 
(cherry picked from commit dd76238a3bafd58faa6f38f075505bef1012f150)
 2016-08-23 19:14:19 +08:00
Akira Ajisaka
dde3eaed62 HDFS-10783. The option '-maxSize' and '-step' fail in OfflineImageViewer. Contributed by Yiqun Lin. 
(cherry picked from commit e90f3359de299ef5e3a54ca71070e3dfe1dbb98c)
(cherry picked from commit 94a844b4f61d4a47b2a5885e3db065a07ed29d97)
 2016-08-23 19:59:07 +09:00
Rohith Sharma K S
71a3b01d51 YARN-5544. TestNodeBlacklistingOnAMFailures fails on trunk. Contributed by Sunil G. 
(cherry picked from commit 0d5997d2b98eb89e72828dfcd78f02aa4e7e1e67)
 2016-08-23 14:40:05 +05:30
Akira Ajisaka
854af9cee1 MAPREDUCE-6587. Remove unused params in connection-related methods of Fetcher. Contributed by Yiqun Lin. 
(cherry picked from commit 8cc4a67059e37b2083cd5468b35a64a403a3e3ae)
(cherry picked from commit 41fe85f8688e6edd2a94ffd831d776e7c7a3614f)
 2016-08-23 17:12:32 +09:00
Xiao Chen
0f9bed050d HADOOP-13487. Hadoop KMS should load old delegation tokens from Zookeeper on startup. Contributed by Xiao Chen. 
(cherry picked from commit 2f21d53e3aaf97f425f954f52b50f36dddb6b886)
 2016-08-22 14:42:20 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
c0c4cc8ee8 HDFS-10692. Update JDiff report's base version for HDFS from 2.6.0 to 2.7.2. Contributed by Wangda Tan. 
(cherry picked from commit dc7a1c54f4447fb01980ae61d5d67e90c4f52f00)
 2016-08-22 11:37:14 -07:00
Varun Saxena
e714d82196 MAPREDUCE-6750. Fix TestHSAdminServer#testRefreshSuperUserGroups (Kihwal Lee via Varun Saxena) 2016-08-22 11:05:01 -05:00
Kihwal Lee
c9199095f8 HDFS-10738. Fix TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration test failure. Contributed by Rakesh R. 
(cherry picked from commit 0f701f433dd3be233bf53e856864c82349e8274e)
(cherry picked from commit 7f1879abe642219fce0328a8e96c983601d202b0)
 2016-08-22 11:04:03 -05:00
Mingliang Liu
9d304822f6 HADOOP-13527. Add Spark to CallerContext LimitedPrivate scope. (Contributed by Weiqing Yang) 
(cherry picked from commit 115ecb52a86b49aad3d058a6b4c1c7926b8b0a40)
 2016-08-21 09:42:06 -07:00
Jing Zhao
8628ad0790 HDFS-10764. Fix INodeFile#getBlocks to not return null. Contributed by Arpit Agarwal. 
(cherry picked from commit 0faee62a0c8c1b8fd83227babfd00fbc2b26bddf)
(cherry picked from commit fff0418458b23c3096384082f8f387b451efad09)
 2016-08-19 22:27:24 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
b2efb2040c HADOOP-13428. Fixed hadoop-common build files to generate jdiff by working around a jdiff-bug. Contributed by Wangda Tan. 
(cherry picked from commit 99603e902244f17b04cfd55122f47355d070b588)
 2016-08-19 19:11:04 -07:00
Wangda Tan
2e9d84d24c YARN-4685. Disable AM blacklisting by default to mitigate situations that application get hanged. (Rohith Sharma K S via wangda) 
(cherry picked from commit 2da32a6ef9edebd86ca9672d10ce35b5a46818cc)
(cherry picked from commit 3e511f39c220ef65708125a37e630c495c450ad1)
 2016-08-19 16:55:40 -07:00
Wangda Tan
9bf420b3bc YARN-4837. User facing aspects of 'AM blacklisting' feature need fixing. (vinodkv via wangda) 2016-08-19 16:55:34 -07:00
Wangda Tan
3bf2e16f76 YARN-3388. Allocation in LeafQueue could get stuck because DRF calculator isn't well supported when computing user-limit. (Nathan Roberts via wangda) 
(cherry picked from commit 444b2ea7afebf9f6c3d356154b71abfd0ea95b23)
(cherry picked from commit c7d782d2f6e61103f7a009c48b11dcd64e07c2ce)
 2016-08-19 16:54:03 -07:00
Wangda Tan
e2bd490236 MAPREDUCE-6310. Add jdiff support to MapReduce. (Li Lu/vinodkv via wangda) 
(cherry picked from commit 3d937457ee60d617d71b36bb6a29344e771670b4)
(cherry picked from commit 65822e55fd99511ab0c39f802d3ec58290445f9d)
 2016-08-19 16:49:54 -07:00
Varun Saxena
6f1a9f1b6a MAPREDUCE-6763. Shuffle server listen queue is too small (Jason Lowe via Varun Saxena) 2016-08-20 04:08:55 +05:30
Kihwal Lee
4f3df8e22a HDFS-7959. WebHdfs logging is missing on Datanode (Kihwal Lee via sjlee) 
(cherry picked from commit ae90d4dd908cf3f9e9ff26fa8e92f028057a9ca1)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/webhdfs/WebHdfsHandler.java
 2016-08-19 15:32:11 -05:00
Chris Nauroth
dd6c149c4a HADOOP-13252. Tune S3A provider plugin mechanism. Contributed by Steve Loughran. 
(cherry picked from commit 763f0497bb996e331e40caed9ca0af966f5b3fac)
(cherry picked from commit 6dba38f08ba84109b01c8ce8d30c71354d089dbe)
 2016-08-19 12:55:57 -07:00
Jing Zhao
5d91f9fe35 HADOOP-13503. Improve SaslRpcClient failure logging. Contributed by Xiaobing Zhou. 
(cherry picked from commit 9fdd1ea72497f7a8aadbfedeba36688e0c16c52e)
 2016-08-18 15:00:17 -07:00
Mingliang Liu
ef38aa64c6 HADOOP-13512. ReloadingX509TrustManager should keep reloading in case of exception. (Contributed by Mingliang Liu) 
(cherry picked from commit 0f51eae0c085ded38216824377acf8122638c3a5)
 2016-08-18 14:22:58 -07:00
Varun Vasudev
5b49bcaee3 YARN-4307. Display blacklisted nodes for AM container in the RM web UI. Contributed by Naganarasimha G R. 
(cherry picked from commit 308d63f382e1992ea2b8ccf3130edaaa751c644d)
(cherry picked from commit 99966b1912320326fb63be1ce6d4222d736ca365)
 2016-08-18 12:33:52 -07:00
Karthik Kambatla
42a88f9c58 YARN-3446. FairScheduler headroom calculation should exclude nodes in the blacklist. (Zhihai Xu via kasha) 
(cherry picked from commit 9d04f26d4c42170ee3dab2f6fb09a94bbf72fc65)
(cherry picked from commit f0923819c35b8c499a9bcd0c6c78511f3a400fef)
 2016-08-18 12:30:39 -07:00
Chris Nauroth
1c4e039ba7 HADOOP-13513. Java 1.7 support for org.apache.hadoop.fs.azure testcases. Contributed by Tibor Kiss. 
(cherry picked from commit ae4db2544346370404826d5b55b2678f5f92fe1f)
(cherry picked from commit 804a40720bd5cf04415831b7bb33e98d11b2046e)
 2016-08-18 10:45:20 -07:00
Steve Loughran
c09797ce9f HADOOP-13405 doc for fs.s3a.acl.default indicates incorrect values. Contributed by Shen Yinjie 2016-08-18 14:35:26 +01:00
Arpit Agarwal
1fe08c919a HDFS-10682. Replace FsDatasetImpl object lock with a separate lock object. (Contributed by Chen Liang) 2016-08-17 16:22:07 -07:00