Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,262 Commits 326 Branches 371 Tags
Commit Graph

12262 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Akira Ajisaka
8007d024b8
HADOOP-14374. License error in GridmixTestUtils.java. Contributed by lixinglong. 
(cherry picked from commit c60164fb60d3d8afb0fb8410936ccc231c4593f9)
(cherry picked from commit 753954f7beb3a1ca4a60cc3f59c809aed3839dd2)
 2017-05-09 05:39:26 -05:00
Varun Vasudev
341457a0f2 YARN-4562. YARN WebApp ignores the configuration passed to it for keystore settings. Contributed by Sergey Shelukhin. 
(cherry picked from commit 07920acc165f17e8fe3ca9d21283a2123223f438)
(cherry picked from commit 4baee3eb674cfdab6e1bfa678211354656829ae3)
 2017-05-09 10:59:15 +05:30
Kihwal Lee
f8b6aa1ed1 HADOOP-13437. KMS should reload whitelist and default key ACLs when hot-reloading. Contributed by Xiao Chen. 
(cherry picked from commit 9daa9979a1f92fb3230361c10ddfcc1633795c0e)
 2017-05-08 08:36:53 -05:00
Kihwal Lee
9d8d3a84bd HDFS-11702. Remove indefinite caching of key provider uri in DFSClient. Contributed by Rushabh S Shah. 
(cherry picked from commit cef2815cf48154fe82f44082dcbdce6373c81284)
 2017-05-08 08:31:18 -05:00
Xiaoyu Yao
a80ac0822b HADOOP-14207. "dfsadmin -refreshCallQueue" fails with DecayRpcScheduler. Contributed by Surendra Singh Lihore. 
(cherry picked from commit 918dee10f56861d15bb6644edcefb4246a3e00a4)
(cherry picked from commit 81883e3150c42e866ba9e68d68b734f2772344b2)
 2017-05-04 16:03:39 -07:00
Kihwal Lee
103dfae7b9 HADOOP-14372. TestSymlinkLocalFS timeouts are too low. Contributed by Eric Badger. 
(cherry picked from commit d4631e466bc85ce605061673a31f451353da9713)
 2017-05-03 09:49:50 -05:00
Erik Krogen
bcafaf2c61 HDFS-11717. Add unit test for HDFS-11709 StandbyCheckpointer should handle non-existing legacyOivImageDir gracefully. Contributed by Erik Krogen. 
(cherry picked from commit d9014bda93760f223789d2ec9f5e35f40de157d4)
(cherry picked from commit 9d6b873d3c249aa76420ab03ceefc6180295915f)
 2017-05-02 18:44:26 -07:00
Jason Lowe
e4af087d92 HADOOP-14306. TestLocalFileSystem tests have very low timeouts. Contributed by Eric Badger 
(cherry picked from commit cedaf4cab9d5013acd559dcb92d4976823ccdf85)
 2017-05-02 16:54:00 -05:00
Karthik Kambatla
dd46bc0f54 YARN-5343. TestContinuousScheduling#testSortedNodes fails intermittently. (Yufei Gu via kasha) 
(cherry picked from commit 7992c0b42ceb10fd3ca6c4ced4f59b8e8998e046)
 2017-05-02 16:46:10 -05:00
Karthik Kambatla
d382a21423 YARN-4812. TestFairScheduler#testContinuousScheduling fails intermittently. (kasha) 
(cherry picked from commit f84af8bd588763c4e99305742d8c86ed596e8359)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestContinuousScheduling.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestFairScheduler.java
 2017-05-02 16:40:46 -05:00
Ming Ma
d1ae1fb449 HDFS-9922. Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes. (Chris Trezzo via mingma) 
(cherry picked from commit b48f27e794e42ba90836314834e872616437d7c9)
(cherry picked from commit 32b115da1d75b9b5b6a770371fbecfda43928bb9)
 2017-05-02 12:48:51 -07:00
Andrew Wang
ab511286fd HADOOP-14369. NetworkTopology calls expensive toString() when logging. Contributed by Inigo Goiri. 
(cherry picked from commit dcc292d7ded200a4976f6d348952ecba10f01db2)
(cherry picked from commit 484bab39442939e1fe8424def25d1aa4ca99a2e5)
 2017-05-02 10:53:59 -07:00
Ming Ma
305a9d886a HDFS-9016. Display upgrade domain information in fsck. 2017-05-02 09:52:16 -07:00
Akira Ajisaka
42fa35d531
HADOOP-14371. License error in TestLoadBalancingKMSClientProvider.java. Contributed by hu xiaodong. 
(cherry picked from commit 20cde552748cc6be1c5ca590755d4e5a67baf187)
(cherry picked from commit 036624900be0bcc2af7f60a28a72cea0295f7300)
 2017-05-02 23:39:25 +09:00
Ming Ma
c4c5533216 HDFS-9005. Provide configuration support for upgrade domain. 2017-05-02 06:53:32 -07:00
Kihwal Lee
c9bf21b0f3 HDFS-11714. Newly added NN storage directory won't get initialized and cause space exhaustion. Contributed by Kihwal Lee. 2017-05-01 17:34:19 -05:00
Kihwal Lee
d1e6b6db7c HDFS-11609. Some blocks can be permanently lost if nodes are decommissioned while dead. Contributed by Kihwal Lee. 2017-05-01 14:28:27 -05:00
Steve Loughran
993ab15b39 YARN-524 TestYarnVersionInfo failing if generated properties doesn't include an SVN URL 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1463300 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 7c65dbb9385567fe1d8e280b81ecb97b109d18a8)

Conflicts:
	hadoop-yarn-project/CHANGES.txt

(cherry picked from commit 5ca4f0f82e41c2833fd8520bc1f764a3f958bdf6)
 2017-05-01 08:58:53 -05:00
Eric Payne
5b9460301a YARN-6536. TestAMRMClient.testAMRMClientWithSaslEncryption fails intermittently. Contributed by Jason Lowe. 
(cherry picked from commit fdf5192bbbb3c81e5fb221758297605271139dc9)
 2017-04-28 15:23:05 -05:00
Eric Payne
84106e80a8 HADOOP-14320. TestIPC.testIpcWithReaderQueuing fails intermittently. Contributed by Eric Badger. 
(cherry picked from commit 6fe11f61556407f8efb9b376623cd61609a40d5f)
 2017-04-28 14:55:14 -05:00
Robert Kanter
26492de185 YARN-5894. fixed license warning caused by de.ruedigermoeller:fst:jar:2.24 (haibochen via rkanter) 
(cherry picked from commit 371b6467dcee8517ef0d49b9f391302a6d9ed648)
 2017-04-28 09:21:41 -07:00
Konstantin V Shvachko
cb12ada03f HDFS-11384. Balancer disperses getBlocks calls to avoid NameNode's rpc queue saturation. Contributed by Konstantin V Shvachko. 
(cherry picked from commit 28eb2aabebd15c15a357d86e23ca407d3c85211c)
 2017-04-27 11:42:48 -07:00
Zhe Zhang
70f18911c7 HDFS-11709. StandbyCheckpointer should handle an non-existing legacyOivImageDir gracefully. Contributed by Erik Krogen. 
(cherry picked from commit d8a33098309f17dfb0e3a000934f68394de44bf7)
(cherry picked from commit fc46f398d9192e83c7197115589eca7805c49943)
 2017-04-27 09:54:10 -07:00
Steve Loughran
40b9c30d64
HADOOP-14346. CryptoOutputStream throws IOException if stream is closed. 
Contributed by Pierre Lacave
 2017-04-27 12:17:20 +01:00
Eric Payne
73563bc9b6 YARN-5617. AMs only intended to run one attempt can be run more than once? Contributed by Jason Lowe. 2017-04-26 14:33:27 -05:00
John Zhuge
19e94bfd1b HADOOP-14341. Support multi-line value for ssl.server.exclude.cipher.list. Contributed by John Zhuge. 
(cherry picked from commit 9ccb849eb69f05bccc3435306ec4bde104e411bf)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/http/HttpServer2.java
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/ssl/SSLFactory.java
 2017-04-25 22:41:27 -07:00
Mingliang Liu
c3c9a91900 HADOOP-14349. Rename ADLS CONTRACT_ENABLE_KEY. Contributed by Mingliang Liu 
(cherry picked from commit e4c32bccde3147f51263cb58cdb480453b1cb3e9)
(cherry picked from commit e7a08cc6dc1f729d04dea9239f0a8c90c8be5598)
 2017-04-25 20:55:42 -07:00
Jason Lowe
d85dbd11ae HDFS-11691. Add a proper scheme to the datanode links in NN web UI. Contributed by Kihwal Lee 
(cherry picked from commit e4321ec84321672a714419278946fe1012daac71)
 2017-04-25 17:32:07 -05:00
Yongjun Zhang
c88e5e1836 HDFS-11689. New exception thrown by DFSClient%isHDFSEncryptionEnabled broke hacky hive code. Contributed by Yongjun Zhang. 
(cherry picked from commit 5078df7be317e635615c05c5da3285798993ff1f)
 2017-04-21 14:12:04 -07:00
John Zhuge
28f0de875d HADOOP-14241. Add ADLS sensitive config keys to default list. Contributed by John Zhuge. 
(cherry picked from commit 6865746ea444c57569e9b2464d8240dafcdbaaa5)
 2017-04-19 22:24:33 -07:00
John Zhuge
e813110734 Revert "HADOOP-14241. Add ADLS sensitive config keys to default list. Contributed by John Zhuge." 
This reverts commit 935ea448c1364befb58dd1ccedd4d7f736c8002a.
 2017-04-19 13:34:43 -07:00
John Zhuge
935ea448c1 HADOOP-14241. Add ADLS sensitive config keys to default list. Contributed by John Zhuge. 
(cherry picked from commit 0344bea3fd4031622edd828a610c9fdc23c53d26)
 2017-04-19 12:09:09 -07:00
Yiqun Lin
daa532b902 HDFS-11316. TestDataNodeVolumeFailure#testUnderReplicationAfterVolFailure fails in trunk. Contributed by Yiqun Lin. 
(cherry picked from commit 724bb8635144dd16fc18cf95a78db6c3d5d1c468)
 2017-04-19 12:31:14 -05:00
Steve Loughran
952113ebfd
HADOOP-14321. explicitly exclude s3a root dir ITests from parallel runs. 
Contributed by Steve Loughran

(cherry picked from commit 1ae6be46b4a02870f9471b05f8d39101b8885830)
 2017-04-19 15:37:27 +01:00
Kengo Seki
525b258944
HADOOP-14315. Python example in the rack awareness document doesn't work due to bad indentation 
This closes #214

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 654372db859656a2201ae9f9f7c374c6564ea34d)
(cherry picked from commit 6cfceee86547211c71f8cb6f9c63798a229de03e)
 2017-04-18 17:16:03 +09:00
Akira Ajisaka
c8bcc96500
HADOOP-14318. Remove non-existent setfattr command option from FileSystemShell.md. Contributed by Doris Gu. 
(cherry picked from commit 84a8848aaecd56b4cc85185924c2e33674165e01)
(cherry picked from commit a17bd7089263511b46918948843d05bb18750b1f)
 2017-04-18 16:46:01 +09:00
Konstantin V Shvachko
8b3b3aac10 HDFS-11634. Optimize BlockIterator when interating starts in the middle. Contributed by Konstantin V Shvachko. 
(cherry picked from commit 8dfcd95d580bb090af7f40af0a57061518c18c8c)
 2017-04-17 17:09:38 -07:00
Zhe Zhang
07047335a3 HDFS-11615. FSNamesystemLock metrics can be inaccurate due to millisecond precision. Contributed by Erik Krogen. 
(cherry picked from commit ad49098eb324e238d97db68d7239ed2c4d84afa0)
(cherry picked from commit 051ab778065d3659c5284b5d95d04156c4ee7ffa)
 2017-04-17 16:36:21 -07:00
Junping Du
0de6f28020 YARN-6304. Skip rm.transitionToActive call to RM if RM is already active. Contributed by Rohith Sharma K S. 
(cherry picked from commit 6ed9d362242d36bfae4083bf3b1c2eb32fbb2f72)
(cherry picked from commit 9289f4527d8fc3418fdeb8bf213b0f62525092d5)
 2017-04-17 15:59:00 -07:00
Arun Suresh
5970e8297d HADOOP-14311. Add python2.7-dev to Dockerfile (Allen Wittenauer via asuresh) 
(cherry picked from commit 0ac17dc644c0429ff8a6f743bf9d3ecdd7458e58)
(cherry picked from commit 8515d35bd5424d0cf27e44d3618c3ea5ae7ea969)
 2017-04-14 16:59:25 -07:00
Jason Lowe
a61ec7c374 YARN-6480. Timeout is too aggressive for TestAMRestart.testPreemptedAMRestartOnRMRestart. Contributed by Eric Badger 
(cherry picked from commit 416880550214e58f2284a045ad0c96ba4aa78ea8)
 2017-04-14 17:18:08 -05:00
Eric Payne
d27f74d915 YARN-5994. TestCapacityScheduler.testAMLimitUsage fails intermittently. Contributed by Eric Badger 
(cherry picked from commit 157a9f310429f6be71d2d3e2bce42d0b36e9a1be)
 2017-04-14 11:54:30 -05:00
Wei-Chiu Chuang
ecaedca5c4
HDFS-10506. OIV's ReverseXML processor cannot reconstruct some snapshot details. Contributed by Akira Ajisaka. 
(cherry picked from commit 14414705f79495eda11e302f38c792128fe0182b)
 2017-04-14 21:11:31 +09:00
Junping Du
c43ee00587 YARN-3760. FSDataOutputStream leak in AggregatedLogFormat.LogWriter.close(). Contributed by Haibo Chen. 
(cherry picked from commit c26ccf1adb3a72df3f68e1150b86b813c691203a)
(cherry picked from commit 9d9087a67ad599e678948d5c1036e51cb8cf5e3a)
(cherry picked from commit d77cada182ef805679dc79498d6b6cc6e7f6b6d4)
 2017-04-12 14:17:04 -07:00
Mingliang Liu
9eebbcf459 HDFS-11558. BPServiceActor thread name is too long. Contributed by Xiaobing Zhou 2017-04-12 13:39:20 -07:00
Kihwal Lee
9dfe0b3515 HDFS-11648. Lazy construct the IIP pathname. Contributed by Daryn Sharp. 
(cherry picked from commit 8ed230c805625549b1cecc830e909a7027bb4961)
 2017-04-12 13:30:41 -05:00
Chris Nauroth
c4bf504395 HDFS-11163. Mover should move the file blocks to default storage once policy is unset. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit 00ed21a6fedb45a7c8992b8d45adaa83f14af34c)
(cherry picked from commit d5e2bd4096bf2b4d8a5a22042145a08905f93cd4)
 2017-04-11 21:55:28 -07:00
Steve Loughran
32475a7b6c HADOOP-14066 VersionInfo should be marked as public API 
(cherry picked from commit 2ed65540a3fe73db5d2dd0d25e658ccf13c9188a)
 2017-04-11 15:06:45 -07:00
Junping Du
dfac95a3a2 Preparing for 2.8.1 development 2017-04-11 11:21:49 -07:00
Jason Lowe
c5b1a8910d YARN-6461. TestRMAdminCLI has very low test timeouts. Contributed by Eric Badger 
(cherry picked from commit 90d97372ed11aaa95d338db8583f578da159834a)
 2017-04-11 09:18:56 -05:00