Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,145 Commits 326 Branches 371 Tags
Commit Graph

12145 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Brahma Reddy Battula
cddd35e1f0 HDFS-10969. Fix typos in hdfs-default.xml Contributed by Yiqun Lin 
(cherry picked from commit be3cb10f5301c2d526d0ba37dbe82f426683a801)
 2016-10-07 22:19:21 +05:30
Robert Kanter
7bfa595679 HADOOP-12611. TestZKSignerSecretProvider#testMultipleInit occasionally fail (ebadger via rkanter) 
(cherry picked from commit c183b9de8d072a35dcde96a20b1550981f886e86)
 2016-10-07 09:37:17 -07:00
Junping Du
8bee319130 YARN-5659. getPathFromYarnURL should use standard methods. Contributed by Sergey Shelukhin. 
(cherry picked from commit 459a4833a90437a52787a41c2759a4b18cfe411c)
 2016-10-07 07:47:16 -07:00
Steve Loughran
a6bb21eec4 HADOOP-12977 s3a to handle delete("/", true) robustly. Contributed by Steve Loughran. 2016-10-07 12:47:14 +01:00
Andrew Wang
9315242109 HADOOP-13689. Do not attach javadoc and sources jars during non-dist build. 
(cherry picked from commit bf372173d0f7cb97b62556cbd199a075254b96e6)
 2016-10-06 15:08:27 -07:00
Kihwal Lee
e3a9666d28 HDFS-10955. Pass IIP for FSDirAttr methods. Contributed by Daryn Sharp. 2016-10-06 16:32:12 -05:00
Chris Nauroth
a28ffd0fde HADOOP-13150. Avoid use of toString() in output of HDFS ACL shell commands. Contributed by Chris Nauroth. 
(cherry picked from commit 1d330fbaf6b50802750aa461640773fb788ef884)
 2016-10-06 13:22:35 -07:00
Chris Nauroth
ecccb114ae HADOOP-13323. Downgrade stack trace on FS load from Warn to debug. Contributed by Steve Loughran. 
(cherry picked from commit 2d46c3f6b7d55b6a2f124d07fe26d37359615df4)
 2016-10-06 10:57:08 -07:00
Mingliang Liu
7aee005c03 HDFS-10893. Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test. Contributed by Mingliang Liu 2016-10-06 08:59:49 -07:00
Rohith Sharma K S
94a6f65989 YARN-5101. YARN_APPLICATION_UPDATED event is parsed in ApplicationHistoryManagerOnTimelineStore#convertToApplicationReport with reversed order. Contributed by Sunil G. 
(cherry picked from commit 4d2f380d787a6145f45c87ba663079fedbf645b8)
 2016-10-06 20:43:47 +05:30
Jian He
caafa980af YARN-3139. Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler. Contributed by Wangda Tan 2016-10-06 07:55:14 -07:00
Brahma Reddy Battula
69c1ab4ad5 HADOOP-13690. Fix typos in core-default.xml. Contributed by Yiqun Lin 
(cherry picked from commit 35b9d7de9f0a95c277b63a3e50134cce4941b78d)
 2016-10-06 18:07:23 +05:30
Brahma Reddy Battula
d9e4ad78ca HDFS-10963. Reduce log level when network topology cannot find enough datanodes. Contributed by Xiao chen 
(cherry picked from commit b90fc70d671481564e468550c770c925f25d7db0)
 2016-10-06 17:48:49 +05:30
Akira Ajisaka
5f1432d98e MAPREDUCE-6789. Fix TestAMWebApp failure. Contributed by Daniel Templeton. 
(cherry picked from commit 272a21747e8a89b6daccc19b71c21de3d17b8d62)
 2016-10-06 15:59:19 +09:00
Mingliang Liu
a868cf4046 Revert "HDFS-10893. Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test. Contributed by Mingliang Liu" 
This reverts commit 14bacd2b999c91a3f7a19b38fd63404e6f91c4a0.
 2016-10-05 23:10:28 -07:00
Mingliang Liu
14bacd2b99 HDFS-10893. Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test. Contributed by Mingliang Liu 2016-10-05 22:54:27 -07:00
Wei-Chiu Chuang
434403a2a0 HDFS-10683. Make class Token$PrivateToken private. Contributed by John Zhuge. 
(cherry picked from commit c5ca2169151a5eec57152775789b6f53664e102c)
 2016-10-05 17:46:46 -07:00
Andrew Wang
6b2a853dd7 HDFS-10962. TestRequestHedgingProxyProvider is flaky. 
(cherry picked from commit e68c7b96c76b243da53ae539e7c760bf2c08f26e)
 2016-10-05 15:09:11 -07:00
Chris Douglas
539c3e4dc0 YARN-5702. Refactor TestPBImplRecords for reuse in other YARN modules. Contributed by Subru Krishnan 
(cherry picked from commit d65b957776c4f055f82549a610fd1e8494580fe6)
 2016-10-05 12:19:21 -07:00
Steve Loughran
6ed335a018 HADOOP-12667 s3a to support createNonRecursive API. Contributed by Sean Mackrory 2016-10-05 15:01:15 +01:00
Akira Ajisaka
bdbb75e083 HADOOP-13685. Document -safely option of rm command. Contributed by Xiaoyu Yao. 
(cherry picked from commit 9a61b52fbefd2970af78bb283ae174d462d57a13)
 2016-10-05 20:41:29 +09:00
Varun Vasudev
3ce02387ea YARN-5704. Provide config knobs to control enabling/disabling new/work in progress features in container-executor. Contributed by Sidharta Seethana. 
(cherry picked from commit 0992708d790b5bd3dab85987b7ad7c6fc2cc4b18)
 2016-10-05 15:32:50 +05:30
Kihwal Lee
b565fa8e05 HDFS-10956. Remove rename/delete performance penalty when not using snapshots. Contributed by Daryn Sharp. 
(cherry picked from commit 44f48ee96ee6b2a3909911c37bfddb0c963d5ffc)
 2016-10-04 15:26:42 -05:00
Chris Nauroth
213f0ad7f0 HADOOP-13674. S3A can provide a more detailed error message when accessing a bucket through an incorrect S3 endpoint. Contributed by Chris Nauroth. 
(cherry picked from commit 88b9444a81081da9b168d2e290f9552b58a4d8c6)
 2016-10-04 10:37:04 -07:00
Kihwal Lee
a9a2f64e56 HDFS-10878. TestDFSClientRetries#testIdempotentAllocateBlockAndClose throws ConcurrentModificationException. Contributed by Rushabh S Shah. 
(cherry picked from commit 382307cbdd94107350fe6fad1acf87d63c9be9d6)
 2016-10-04 11:10:29 -05:00
Brahma Reddy Battula
560e524f93 HDFS-10947. Correct the API name for truncate in webhdfs document. Contributed by Surendra Singh Lilhore 
(cherry picked from commit ef7f06f7d1561db13bd3b07a5f62815ec29e1cdf)
 2016-10-04 18:51:40 +05:30
Brahma Reddy Battula
c9df3c5f21 HDFS-10944. Correct the javadoc of dfsadmin#disallowSnapshot. Contributed by Jagadesh Kiran N 
(cherry picked from commit 5ea0210c7fea1324973e7f69256bc53f31ee4cf7)
 2016-10-04 18:37:43 +05:30
Mingliang Liu
612aa0cc0b HDFS-10934. TestDFSShell#testStat fails intermittently. Contributed by Eric Badger 
(cherry picked from commit f61e3d13e9610cbd09886359553f27d6480f6735)
 2016-10-03 22:47:09 -04:00
Mingliang Liu
d963ecb918 HDFS-10810. setreplication removing block from underconstrcution temporarily. Contributed by Brahma Reddy Battula 2016-10-03 21:59:31 -04:00
Xiao Chen
d9b686a2bd HDFS-10918. Add a tool to get FileEncryptionInfo from CLI. Contributed by Xiao Chen. 
(cherry picked from commit 853d65a157362661ccab10379c2d82e780382f83)
 2016-10-03 16:02:07 -07:00
Karthik Kambatla
1578781fe9 YARN-4767. Network issues can cause persistent RM UI outage. (Daniel Templeton via kasha) 
(cherry picked from commit 736d33cddd88a0cec925a451940b2523999a9c51)
 2016-10-03 14:36:14 -07:00
Xiaoyu Yao
6f3744195d HDFS-10690. Optimize insertion/removal of replica in ShortCircuitCache. Contributed by Fenghua Hu. 
(cherry picked from commit 607705c488fa5263d851cee578a2d319e6e52ecd)
 2016-10-03 11:00:15 -07:00
Karthik Kambatla
876fc2e61a MAPREDUCE-6638. Do not attempt to recover progress from previous job attempts if spill encryption is enabled. (Haibo Chen via kasha) 
(cherry picked from commit de7a0a92ca1983b35ca4beb7ab712fd700a9e6e0)
 2016-10-03 10:30:44 -07:00
Kihwal Lee
03b797a6ac HDFS-10940. Reduce performance penalty of block caching when not used. Contributed by Daryn Sharp. 
(cherry picked from commit 744208431f7365bf054e6b773b86af2583001e1d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirStatAndListingOp.java
 2016-10-03 11:41:19 -05:00
Kihwal Lee
ebfbce3b5f HDFS-10945. Fix the Findbugwaring FSNamesystem#renameTo() in branch-2. Contributed by Brahma Reddy Battula. 2016-10-03 10:48:14 -05:00
Kihwal Lee
2ee47f02cf HDFS-10619. Cache path in InodesInPath. Contributed by Daryn Sharp. 
(cherry picked from commit 90020624b05230ad4a7fbd666d0177ecb107a4d6)
 2016-10-03 09:20:08 -05:00
Karthik Kambatla
f8c2c7b2c0 YARN-5672. FairScheduler: Wrong queue name in log when adding application. (Wilfred Spiegelenburg via kasha) 
(cherry picked from commit 0da54e8848764c71a31473516d23ada582013f8c)
 2016-10-03 06:04:09 -07:00
Naganarasimha
04f594dbea YARN-4855. Should check if node exists when replace nodelabels. Contributeed by Tao Jie 
(cherry picked from commit 6e130c308cf1b97e8386b6a43c26d72d2850119c)
 2016-10-03 02:13:46 -04:00
Karthik Kambatla
57726eed83 YARN-5678. Log demand as demand in FSLeafQueue and FSParentQueue. (Yufei Gu via kasha) 
(cherry picked from commit 82857037b6e960dccdaf9e6b1b238411498a0dfe)
 2016-10-02 22:10:07 -07:00
Arpit Agarwal
6dd747b6bc Revert "HDFS-10923. Make InstrumentedLock require ReentrantLock." 
This reverts commit 9873ed32c63a62b39760126a123ed759c3222eb9.
 2016-09-30 23:12:07 -07:00
Arpit Agarwal
9873ed32c6 HDFS-10923. Make InstrumentedLock require ReentrantLock. 2016-09-30 23:04:22 -07:00
Subru Krishnan
9f43f89899 YARN-5384. Expose priority in ReservationSystem submission APIs. (Sean Po via Subru). 
(cherry picked from commit 3a3697deab3e3397082222deb66fb613d86ff9ae)
 2016-09-30 19:43:29 -07:00
Xiao Chen
1ed23a134c HADOOP-13317. Add logs to KMS server-side to improve supportability. Contributed by Suraj Acharya. 
(cherry picked from commit 89bd6d29a62afd7ed8ff87bcc29d17b1cb53dcb6)
 2016-09-30 17:52:13 -07:00
Kihwal Lee
2551ff80b7 HDFS-10851. FSDirStatAndListingOp: stop passing path as string. Contributed by Daryn Sharp. 2016-09-30 15:59:40 -05:00
Robert Kanter
56ec975ea9 YARN-5693. Reduce loglevel to Debug in ContainerManagementProtocolProxy and AMRMClientImpl (yufeigu via rkanter) 
(cherry picked from commit 2549ee9d4c4ddd3ebccdebb8623df30c0a8f27d2)
 2016-09-30 13:35:58 -07:00
Zhe Zhang
dfca0f4abb HDFS-10896. Move lock logging logic from FSNamesystem into FSNamesystemLock. Contributed by Erik Krogen. 
(cherry-picked from commit 434c5ea75dc3d87513e49290ac9999148ff5163c)
 2016-09-30 13:30:31 -07:00
Wei-Chiu Chuang
a6863e5334 HADOOP-12974. Create a CachingGetSpaceUsed implementation that uses df. Contributed by Elliott Clark. 
(cherry picked from commit 57aec2b46b0e46b73a1f49927e30e2c41138d535)
 2016-09-30 13:00:04 -07:00
Kihwal Lee
10222cd54e HDFS-10850. getEZForPath should NOT throw FNF. Contributed by Andrew Wang. 
(cherry picked from commit 0670149c88852cd7c4d6774bff06c7c588558739)
 2016-09-30 08:58:38 -05:00
Akira Ajisaka
25df276c6b HADOOP-13640. Fix findbugs warning in VersionInfoMojo.java. Contributed by Yuanbo Liu. 
(cherry picked from commit 82c55dcbc8e3d5314aae9f8f600c660759213e45)
 2016-09-30 18:18:26 +09:00
Li Lu
919c0802fa YARN-4205. Addendum patch to fix branch-2. 2016-09-29 15:41:31 -07:00