Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,365 Commits 326 Branches 371 Tags
Commit Graph

12365 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Brahma Reddy Battula
69a4b0c7d2 HDFS-10699. Log object instance get incorrectly in TestDFSAdmin. Contributed by Yiqun Lin 
(cherry picked from commit f5e401de3e7ad6e73b07fef1cb5915753b08fbdb)
 2016-10-20 21:08:39 +05:30
Brahma Reddy Battula
df5671db74 HDFS-9480. Expose nonDfsUsed via StorageTypeStats. Contributed by Brahma Reddy Battula 
(cherry picked from commit 4c73be135ca6ee2ba0b075a507097900db206b09)
 2016-10-20 20:47:37 +05:30
Steve Loughran
c640ba5fc9 HADOOP-13735 ITestS3AFileContextStatistics.testStatistics() failing. Contributed by Pieter Reuse 2016-10-20 14:50:30 +01:00
Brahma Reddy Battula
5a37668d1b HDFS-11025. TestDiskspaceQuotaUpdate fails in trunk due to Bind exception. Contributed by Yiqun Lin 
(cherry picked from commit 73504b1bdc4b93c64741de5eb9d022817fdfa22f)
 2016-10-20 10:42:34 +05:30
Arpit Agarwal
a3cbaf0c04 HDFS-10752. Several log refactoring/improvement suggestion in HDFS. Contributed by Hanisha Koneru. 2016-10-19 17:20:15 -07:00
Xiao Chen
ad7d3c4db8 HDFS-11009. Add a tool to reconstruct block meta file from CLI. 
(cherry picked from commit bc4a32aea50e86819730312e89315c0244ce64bf)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetUtil.java
 2016-10-18 22:40:58 -07:00
Xiaoyu Yao
74f1c49d76 HDFS-10906. Add unit tests for Trash with HDFS encryption zones. Contributed by Hanisha Koneru. 
(cherry picked from commit 0c79d5af74944363f3d04f7e1702411db564bbfd)
 2016-10-18 14:07:57 -07:00
Steve Loughran
bc176961e6 HADOOP-13560. S3ABlockOutputStream to support huge (many GB) file writes. Contributed by Steve Loughran 2016-10-18 19:33:38 +01:00
Kai Zheng
3972bb3bba HDFS-10920. TestStorageMover#testNoSpaceDisk is failing intermittently. Contributed by Rakesh R 2016-10-18 15:08:15 +06:00
Akira Ajisaka
b2618685fb HADOOP-13522. Add %A and %a formats for fs -stat command to print permissions. Contributed by Alex Garbarini. 
(cherry picked from commit bedfec0c10144087168bc79501ffd5ab4fa52606)
 2016-10-18 15:03:33 +09:00
Vinitha Reddy Gankidi
278eeb1056 HDFS-10712. TestDataNodeVolumeFailure should pass not null BlockReportContext. Contributed by Vinitha Gankidi. 2016-10-17 18:55:26 -07:00
Ming Ma
d55a7f8935 HDFS-9390. Block management for maintenance states. 2016-10-17 17:46:29 -07:00
Allen Wittenauer
a5a56c3564 HADOOP-13034. Log message about input options in distcp lacks some items (Takashi Ohnishi via aw) 
(cherry picked from commit 422c73a8657d8699920f7db13d4be200e16c4272)
 2016-10-17 16:35:32 -07:00
Robert Kanter
e02c756f16 YARN-5466. DefaultContainerExecutor needs JavaDocs (templedf via rkanter) 
(cherry picked from commit f5d92359145dfb820a9521e00e2d44c4ee96e67e)
 2016-10-17 14:29:42 -07:00
Xiaoyu Yao
61aceb87df HDFS-10922. Adding additional unit tests for Trash (II). Contributed by Weiwei Yang. 
(cherry picked from commit f1802d0be05ecc0b3248690b6f9efedbc7784112)
 2016-10-17 14:21:51 -07:00
Andrew Wang
4ed7cf3b36 HADOOP-13724. Fix a few typos in site markdown documents. Contributed by Ding Fei. 
(cherry picked from commit 987ee51141a15d3f4d1df4dc792a192b92b87b5f)
 2016-10-17 13:32:39 -07:00
Allen Wittenauer
fbdb23d2af HADOOP-11559. Add links to RackAwareness and InterfaceClassification to site index (Masatake Iwasaki via aw) 
(cherry picked from commit 7eeca90daabd74934d4c94af6f07fd598abdb4ed)

 Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-project/src/site/site.xml
 2016-10-17 13:32:28 -07:00
Eric Yang
7993fb5b81 HADOOP-13707. Skip authorization for anonymous user to access Hadoop 
web interface in non-secure environment.  (Yuanbo Liu via eyang)

    (cherry picked from commit dc308e98b9f8f7458a28a015515876ddea5666f2)
    With Addendum patch
 2016-10-17 07:57:45 -07:00
Eric Yang
a4356bb7a5 HADOOP-13707. Skip authorization for anonymous user to access Hadoop 
web interface in non-secure environment.  (Yuanbo Liu via eyang)

    (cherry picked from commit dc308e98b9f8f7458a28a015515876ddea5666f2)
    With Addendum patch
 2016-10-16 20:32:48 -07:00
Eric Yang
439422fff9 HADOOP-13707. Skip authorization for anonymous user to access Hadoop 
web interface in non-secure environment.  (Yuanbo Liu via eyang)

(cherry picked from commit dc308e98b9f8f7458a28a015515876ddea5666f2)
With Addendum patch
 2016-10-15 21:23:21 -07:00
Masatake Iwasaki
a13a607e20 HADOOP-13419. Fix javadoc warnings by JDK8 in hadoop-common package. Contributed by Kai Sasaki. 2016-10-16 12:44:19 +09:00
Brahma Reddy Battula
64e532393b HDFS-11003. Expose XmitsInProgress through DataNodeMXBean. Contributed By Brahma Reddy Battula 
(cherry picked from commit 5f4ae85bd8a20510948696467873498723b06477)
 2016-10-15 22:29:55 +05:30
Brahma Reddy Battula
a0eee72053 Revert "HADOOP-13707. Skip authorization for anonymous user to access Hadoop" 
This reverts commit dc308e98b9f8f7458a28a015515876ddea5666f2.
 2016-10-15 22:13:45 +05:30
Akira Ajisaka
35832901e8 HDFS-11012. Unnecessary INFO logging on DFSClients for InvalidToken. Contributed by Harsh J. 
(cherry picked from commit 5ad037df25ab3206509083276b7ef4ef001be48b)
 2016-10-15 22:17:55 +09:00
Eric Yang
dc308e98b9 HADOOP-13707. Skip authorization for anonymous user to access Hadoop 
web interface in non-secure environment.  (Yuanbo Liu via eyang)
 2016-10-14 22:13:24 -07:00
Vinitha Reddy Gankidi
863e1020c0 HDFS-10301. Remove FBR tracking state to fix false zombie storage detection for interleaving block reports. Contributed by Vinitha Gankidi. 
(cherry picked from commit 391ce535a739dc92cb90017d759217265a4fd969)
 2016-10-14 18:25:52 -07:00
Lei Xu
78cb79fa91 HDFS-10960. TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove. (Manoj Govindassamy via lei) 2016-10-14 15:00:27 -07:00
Mingliang Liu
bbcbf78f0f HDFS-11008. Change unit test for testing parsing "-source" parameter in Balancer CLI. Contributed by Mingliang Liu 
(cherry picked from commit 76cc84e6d41c2b02218c2c98d60481cd565e067c)
 2016-10-14 14:43:58 -07:00
Kihwal Lee
1c0f2ef82f Revert "HDFS-10960. TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove. (Manoj Govindassamy via lei)" 
This reverts commit aa8593f923e5686d8baa11bd00d227e48a860c13.
 2016-10-14 16:38:25 -05:00
Lei Xu
aa8593f923 HDFS-10960. TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove. (Manoj Govindassamy via lei) 
(cherry picked from commit 8c520a27cbd9daba05367d3a83017a2eab5258eb)
 2016-10-14 13:43:26 -07:00
Andrew Wang
86325e4346 HDFS-10883. 's behavior is not consistent in DFS after enabling EZ. Contributed by Yuanbo Liu. 
(cherry picked from commit 0007360c3344b3485fa17de0fd2015a628de947c)
 2016-10-14 11:41:36 -07:00
Varun Saxena
e9a58691ab YARN-5599. Publish AM launch command to ATS (Rohith Sharma K S via Varun Saxena) 2016-10-14 23:32:29 +05:30
Benoy Antony
156b92e36b HDFS-10735 Distcp using webhdfs on secure HA clusters fails with StandbyException 
(cherry picked from commit 701c27a7762294e1a5fb2b3ac81f5534aa37f667)
 2016-10-14 10:29:42 -07:00
Kihwal Lee
6e0b55fe79 HDFS-10990. TestPendingInvalidateBlock should wait for IBRs. Contributed by Yiqun Lin. 
(cherry picked from commit 8a9f6635a33e9648e9396e9ec5571fa34aa0c773)
 2016-10-14 11:40:11 -05:00
Xiaoyu Yao
1eb8c0e880 HADOOP-13686. Adding additional unit test for Trash (I). Contributed by Weiwei Yang. 
(cherry picked from commit dbe663d5241feea0c88a3a9391ad48a029001d94)
 2016-10-13 23:05:58 -07:00
Xiao Chen
562c358a83 HADOOP-13669. Addendum patch for KMS Server should log exceptions before throwing. 
(cherry picked from commit ae51b11f7872eaac558acf00fd23f6d7b1841cfe)
 2016-10-13 22:32:25 -07:00
Chris Douglas
f0f2681b4f YARN-5717. Add tests for container-executor is_feature_enabled. Contributed by Sidharta Seethana 
(cherry picked from commit cf3f43e95bf46030875137fc36da5c1fbe14250d)
 2016-10-13 20:49:50 -07:00
Jing Zhao
ad69baf6a9 HADOOP-13024. Distcp with -delete feature on raw data not implemented. Contributed by Mavin Martin. 
(cherry picked from commit 0a85d079838f532a13ca237300386d1b3bc1b178)
 2016-10-13 13:26:02 -07:00
Andrew Wang
dc78e0e7fc Revert "HDFS-10990. TestPendingInvalidateBlock should wait for IBRs. Contributed by Yiqun Lin." 
This reverts commit 2e153bc8abc3fe2f50660136af32711c50e7e7e7.
 2016-10-13 13:23:04 -07:00
Kihwal Lee
c5a1303704 HDFS-10987. Make Decommission less expensive when lot of blocks present. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 332a61fd74fd2a9874319232c583ab5d2c53ff03)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DecommissionManager.java
 2016-10-13 14:55:22 -05:00
Andrew Wang
2e153bc8ab HDFS-10990. TestPendingInvalidateBlock should wait for IBRs. Contributed by Yiqun Lin. 
(cherry picked from commit fdce515091f0a61ffd6c9ae464a68447dedf1124)
 2016-10-13 11:42:03 -07:00
Arpit Agarwal
ecd3467f11 HADOOP-13710. Supress CachingGetSpaceUsed from logging interrupted exception stacktrace. Contributed by Hanisha Koneru. 2016-10-13 11:37:12 -07:00
Xiaoyu Yao
874402a295 HADOOP-13565. KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request. Contributed by Xiaoyu Yao. 
(cherry picked from commit 9097e2efe4c92d83c8fab88dc11be84505a6cab5)
 2016-10-13 10:54:51 -07:00
Brahma Reddy Battula
b60e545a08 10986. DFSAdmin should log detailed error message if any. Contributed by MingLiang Liu 
(cherry picked from commit 29aa11b1a252e007ed62fad362096ca43aa408af)
 2016-10-13 21:41:25 +05:30
Kihwal Lee
a6197c1fa8 HDFS-11000. webhdfs PUT does not work if requests are routed to call queue. Contributed by Kihwal Lee. 
(cherry picked from commit 9454dc5e8091354cd0a4b8c8aa5f4004529db5d5)
 2016-10-13 08:48:33 -05:00
Akira Ajisaka
43cf0b2973 HDFS-11002. Fix broken attr/getfattr/setfattr links in ExtendedAttributes.md. Contributed by Mingliang Liu. 
(cherry picked from commit 901eca004d0e7e413b109a93128892176c808d61)
 2016-10-13 14:30:45 +09:00
Mingliang Liu
b36aaa913c HDFS-10903. Replace config key literal strings with config key names II: hadoop hdfs. Contributed by Chen Liang 2016-10-12 17:26:11 -07:00
Andrew Wang
f131d61ff8 HADOOP-13700. Remove unthrown IOException from TrashPolicy#initialize and #getInstance signatures. 
(cherry picked from commit 12d739a34ba868b3f7f5adf7f37a60d4aca9061b)
 2016-10-12 15:20:07 -07:00
Kihwal Lee
5305a392c3 HDFS-10789. Route webhdfs through the RPC call queue. Contributed by Daryn Sharp and Rushabh S Shah. 
(cherry picked from commit 85cd06f6636f295ad1f3bf2a90063f4714c9cca7)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/web/resources/NamenodeWebHdfsMethods.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
 2016-10-12 15:22:51 -05:00
Mingliang Liu
e341e5151a HDFS-10965. Add unit test for HDFS command 'dfsadmin -printTopology'. Contributed by Xiaobing Zhou 
(cherry picked from commit f340d286d441d78c847722b529939b78abf9d2f3)
 2016-10-11 19:59:36 -07:00