Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,322 Commits 326 Branches 371 Tags
Commit Graph

9322 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Vinitha Reddy Gankidi
a76eb7fa34 HDFS-10301. Interleaving processing of storages from repeated block reports causes false zombie storage detection, removes valid blocks. Contributed by Vinitha Gankidi. 2016-07-30 17:01:49 -07:00
Akira Ajisaka
379d587d23 HDFS-10691. FileDistribution fails in hdfs oiv command due to ArrayIndexOutOfBoundsException. Contributed by Yiqun Lin. 2016-07-30 08:29:55 +09:00
Vinayakumar B
2371ed0551 HDFS-8682. Should not remove decommissioned node,while calculating the number of live/dead decommissioned node. (Contributed by J. Andreina) 
(cherry picked from commit fdb56f74f38cabb0f94e0781fcedb1594904c026)
 2016-07-29 16:07:33 -07:00
Konstantin V Shvachko
fb00663aaa HDFS-8780. Fetching live/dead datanode list with arg true for removeDecommissionNode,returns list with decom node. (Contributed by J.Andreina) 
(cherry picked from commit 2893da4f538e8802fd8d6de774faaed4b88a48c0)
 2016-07-29 15:56:12 -07:00
Wangda Tan
6cb2e9733d Backport Doclet fixes from YARN-3426 2016-07-27 16:41:55 -07:00
Haohui Mai
63711c3960 HADOOP-11814. Reformat hadoop-annotations, o.a.h.classification.tools. Contributed by Li Lu. 
(cherry picked from commit dc0282d64c6528b02aa9f2df49be01223f087081)
 2016-07-27 16:41:55 -07:00
Masatake Iwasaki
b904a7fd00 HDFS-9601. NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding block. (iwasakims) 2016-07-28 00:45:13 +09:00
Jason Lowe
4edff93c7c MAPREDUCE-6744. Increase timeout on TestDFSIO tests. Contributed by Eric Badger 
(cherry picked from commit 703fdf86c6e42d6d555090f670ca5cbd1ef48bf9)
 2016-07-25 21:59:48 +00:00
Rohith Sharma K S
400a6144e2 YARN-5092. TestRMDelegationTokens fails intermittently. Contributed by Jason Lowe. 2016-07-22 20:57:35 +05:30
Jing Zhao
2a5b8e5b3a HDFS-10653. Optimize conversion from path string to components. Contributed by Daryn Sharp. 
(cherry picked from commit bd3dcf46e263b6e6aa3fca6a5d9936cc49e3280f)
(cherry picked from commit 6a7fe835f19141cc633824cd5d21f1e30f014bce)
 2016-07-21 11:30:06 -07:00
Jason Lowe
9938010264 YARN-3707. RM Web UI queue filter doesn't work. Contributed by Wangda Tan 
(cherry picked from commit 446d51591e6e99cc60a85c4b9fbac379a8caa49d)
(cherry picked from commit 03af057a477b2a31b66831d66f8a38cff42f2201)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2016-07-21 18:17:29 +00:00
Jason Lowe
5220d4dc27 HADOOP-11149. Increase the timeout of TestZKFailoverController. Contributed by Steve Loughran. 
(cherry picked from commit 579f9030dadac4bf53f38ae8499a95a3bdd43c97)

Conflicts:

	hadoop-common-project/hadoop-common/CHANGES.txt
 2016-07-21 15:01:56 +00:00
Varun Vasudev
1b8641a3c3 YARN-5309. Fix SSLFactory truststore reloader thread leak in TimelineClientImpl. Contributed by Weiwei Yang. 2016-07-20 13:06:31 +05:30
Akira Ajisaka
a6798991f0 HADOOP-12991. Conflicting default ports in DelegateToFileSystem. Contributed by Kai Sasaki. 
(cherry picked from commit dc065dd64ca3e101b0c0a7bcc7d7a067b77d6c82)
(cherry picked from commit 8fe2c450b38ab51087eea867fd1dd960915a6fed)
 2016-07-19 16:07:40 -07:00
Akira Ajisaka
833117c219 HADOOP-13202. Avoid possible overflow in org.apache.hadoop.util.bloom.BloomFilter#getNBytes. Contributed by Kai Sasaki. 
(cherry picked from commit c2bcffb34ebe4399b523a44f69d23761648bd0c4)
(cherry picked from commit 09375baad1ba732b73701cdbd0ee77618ed6f687)
 2016-07-18 11:52:43 -07:00
Tsuyoshi Ozawa
65adabd0d1 HADOOP-13298. Fix the leftover L&N files in hadoop-build-tools/src/main/resources/META-INF/. (ozawa) 
(cherry picked from commit ea9f43781e5a9a4a6121dd3be106ced6b811754d)
 2016-07-16 08:20:43 +09:00
Arpit Agarwal
c35c1e6703 HDFS-10623. Remove unused import of httpclient.HttpConnection from TestWebHdfsTokens. (Contributed by Hanisha Koneru) 2016-07-14 13:01:15 -07:00
Zhe Zhang
45ed97e0d2 HADOOP-13290. Appropriate use of generics in FairCallQueue. Contributed by Jonathan Hung. 
(cherry picked from commit 728bf7f6988e13f17f03d2e3a4037b7238c4fd45)
(cherry picked from commit b95f1af8a9aafb3e482c7b8825f2097f2ceb0e8e)
(cherry picked from commit cbd885b6fa26b7a84a4a19d6084d95665f21378a)
 2016-07-13 16:49:54 -07:00
Zhe Zhang
c7e1e92c1a HDFS-10544. Balancer doesn't work with IPFailoverProxyProvider. 
(cherry picked from commit 087290e6b1cb1082646d966b65494082712ebe3e)
(cherry picked from commit 5b4e916b3cae2540267d48716fd9240dfc055288)
(cherry picked from commit af94dfaa53532d7c650478050621d216360e04b5)
 2016-07-13 14:36:26 -07:00
Arpit Agarwal
771033babd HADOOP-12570. HDFS Secure Mode Documentation updates. (Arpit Agarwal) 2016-07-13 13:02:01 -07:00
Tsuyoshi Ozawa
7c5e7433e1 HADOOP-11361. Fix a race condition in MetricsSourceAdapter.updateJmxCache. Contributed by Vinayakumar B, Yongjun Zhang, and Brahma Reddy Battula. (ozawa) 
Updated CHANGES.txt

(cherry picked from commit 77ffe7621212be9f462ca37a542a13d167eca4e0)
 2016-07-13 21:49:02 +09:00
Varun Saxena
954dac6860 YARN-5353. ResourceManager can leak delegation tokens when they are shared across apps. (Jason Lowe via Varun Saxena). 2016-07-13 07:31:49 +05:30
Vinod Kumar Vavilapalli
c454639abf HADOOP-13312. Updated CHANGES.txt to reflect all the changes in branch-2.7. Contributed by Akira Ajisaka. 2016-07-12 15:41:22 -07:00
Jason Lowe
f8f995629d YARN-4393. Fix intermittent test failure for TestResourceLocalizationService#testFailedDirsResourceRelease (Varun Saxana via rohithsharmaks) 
(cherry picked from commit 791c1639ae0b351e0bf0b2ecec854dc72ab07935)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2016-07-12 19:30:53 +00:00
Akira Ajisaka
e8c253d500 HADOOP-13297. Add missing dependency in setting maven-remote-resource-plugin to fix builds. Contributed by Sean Busbey. 
(cherry picked from commit 7bd5d4272cd686e06c5d5fcc489b69312dacb47b)
(cherry picked from commit 02b037f6257e7379b6bbd656ccbe4472d3f46c40)
 2016-07-11 17:24:35 -07:00
Jason Lowe
6759cbc56a HADOOP-13362. DefaultMetricsSystem leaks the source name when a source unregisters. Contributed by Junping Du 2016-07-11 20:58:40 +00:00
Andrew Wang
830516b8c5 HADOOP-13350. Additional fix to LICENSE and NOTICE. Contributed by Xiao Chen. 2016-07-07 10:45:01 -07:00
Andrew Wang
5ebebc6524 HDFS-10488. Update WebHDFS documentation regarding CREATE and MKDIR default permissions. Contributed by Wellington Chevreuil. 
(cherry picked from commit 728623242f47c6bffb46cfcc8f3425b58c1fde3a)
 2016-07-07 10:38:33 -07:00
Yongjun Zhang
81f0d56c57 HDFS-10396. Using -diff option with DistCp may get "Comparison method violates its general contract" exception. Contributed by Yongjun Zhang. 
(cherry picked from commit 8113855b3af913e6dcd09626953c64d43168efbd)
 2016-06-28 23:45:19 -07:00
Chris Douglas
7595d89612 HADOOP-12636. Prevent ServiceLoader failure init for unused FileSystems. Contributed by Inigo Goiri. 
Cherry picked from commit #8652cce5b2
 2016-06-27 14:32:42 +01:00
Masatake Iwasaki
01f5e609a2 HADOOP-12588. addendum patch to fix intermittent failure of TestGangliaMetrics. (iwasakims) 
(cherry picked from commit 67089875f0ea2a47cca0c237fccf239bf6fe2d53)
 2016-06-22 23:52:44 +09:00
Brahma Reddy Battula
6a1fc34595 HDFS-9530. ReservedSpace is not cleared for abandoned Blocks (Contributed by Brahma Reddy Battula) 2016-06-21 16:12:46 +05:30
Rohith Sharma K S
4a498f5fa1 YARN-5197. RM leaks containers if running container disappears from node update. Contributed by Jason Lowe. 2016-06-21 11:32:34 +05:30
Rohith Sharma K S
0bc531aa8f Adding-release-2.7.4-to-CHANGES.txt 2016-06-21 11:27:13 +05:30
Akira Ajisaka
e19cd05a87 HADOOP-13192. org.apache.hadoop.util.LineReader cannot handle multibyte delimiters correctly. Contributed by binde. 
(cherry picked from commit fc6b50cc574e144fd314dea6c11987c6a384bfa6)
(cherry picked from commit 39ea0891d2b1369ec8c1ea4312489309e1a85227)
 2016-06-20 17:11:23 +09:00
Brahma Reddy Battula
be94ed6ceb HDFS-10474. hftp copy fails when file name with Chinese+special char in branch-2 (Contributed by Brahma Reddy Battula) 2016-06-20 12:43:18 +05:30
Xiaoyu Yao
138d0f0bc4 HADOOP-13255. KMSClientProvider should check and renew tgt when doing delegation token operations. Contributed by Xiao Chen. 
(cherry picked from commit ddf66427ff92a3886f94954e21d59e998412059b)
 2016-06-16 20:19:13 -07:00
Konstantin V Shvachko
10574bce81 HADOOP-13189. FairCallQueue makes callQueue larger than the configured capacity. Contributed by Vinitha Gankidi. 2016-06-16 19:11:58 -07:00
Akira Ajisaka
5c3ae65f76 HADOOP-12893. Verify LICENSE.txt and NOTICE.txt. Contributed by Xiao Chen, Andrew Wang, and Akira Ajisaka. 2016-06-16 13:41:05 +09:00
Arpit Agarwal
aca4310f32 HDFS-9906. Remove spammy log spew when a datanode is restarted. (Contributed by Brahma Reddy Battula) 
(cherry picked from commit 02949b2151f1eecce3e1bcdbbec1afac164a6065)
 2016-06-14 23:13:48 -07:00
Vinod Kumar Vavilapalli
f4b58eae94 Preparing for 2.7.4 development: Updating snapshot version to 2.7.4 on branch-2.7. 2016-06-14 19:14:02 -07:00
Kihwal Lee
8854cdd9ee HDFS-8581. ContentSummary on / skips further counts on yielding lock (contributed by J.Andreina) 
(cherry picked from commit 4014ce5990bff9b0ecb3d38a633d40eaf6cf07a7)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestQuota.java
 2016-06-14 08:25:09 -05:00
Akira Ajisaka
d44873a2a0 HADOOP-13270. BZip2CompressionInputStream finds the same compression marker twice in corner case, causing duplicate data blocks. Contributed by Kai Sasaki. 
(cherry picked from commit e3ba9ad3f116306910f74645ded91506345b9f6e)
(cherry picked from commit d219550e8bf4c24be68a74f7b8032b6a8b8af0fc)
 2016-06-14 10:23:17 +09:00
Masatake Iwasaki
5a3fed0602 HDFS-9905. WebHdfsFileSystem#runWithRetry should display original stack trace on error. (Wei-Chiu Chuang via iwasakims) 
cherry-picked from 6fcde2e38da04cae3aad6b13cf442af211f71506
 2016-06-09 20:48:58 +00:00
Eric Payne
577466c1f2 Added missing entries to hadoop-yarn-project/CHANGES.txt for YARN-5069 YARN-5009 YARN-5008 YARN-4751 YARN-3362 2016-06-09 16:28:37 +00:00
Jason Lowe
ab0679ed3f YARN-4288. Fixed RMProxy to retry on IOException from local host. Contributed by Junping Du 
(cherry picked from commit c41699965e78ce5e87669d17923ab84e494c4188)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2016-06-08 17:57:59 +00:00
Jason Lowe
fdea6ee0d1 YARN-5206. RegistrySecurity includes id:pass in exception text if considered invalid. Contributed by Steve Loughran 
(cherry picked from commit 8c8a377cac10b086a7ff37ee366b79e6b04d2738)
 2016-06-08 14:16:36 +00:00
Zhe Zhang
9b68eda274 HDFS-10458. getFileEncryptionInfo should return quickly for non-encrypted cluster. 
(cherry picked from commit 6de9213df111a9a4ed875db995d67af72d08a798)
(cherry picked from commit 06e38c835d0ad9619d4bea662f2dd7d0f62007a9)
(cherry picked from commit 0274636529cfac4d64582a7c21631aebbf4deb1b)
 2016-06-06 16:09:14 -07:00
Xiaoyu Yao
97e79662b6 HDFS-8548. Minicluster throws NPE on shutdown. Contributed by surendra singh lilhore. 
(cherry picked from commit 6a76250b39f33466bdc8dabab33070c90aa1a389)
 2016-06-03 12:55:31 -07:00
Akira Ajisaka
fe08ba439e HDFS-9476. TestDFSUpgradeFromImage#testUpgradeFromRel1BBWImage occasionally fail. Contributed by Masatake Iwasaki. 
(cherry picked from commit 69555fca066815053dd9168ebe15868a5c02cdcd)
(cherry picked from commit 3dd557e4b6b852ee99f6acc29cca1088dc3a39ff)
 2016-06-02 18:55:36 +09:00