Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,193 Commits 326 Branches 371 Tags
Commit Graph

12193 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Brahma Reddy Battula
a0eee72053 Revert "HADOOP-13707. Skip authorization for anonymous user to access Hadoop" 
This reverts commit dc308e98b9f8f7458a28a015515876ddea5666f2.
 2016-10-15 22:13:45 +05:30
Akira Ajisaka
35832901e8 HDFS-11012. Unnecessary INFO logging on DFSClients for InvalidToken. Contributed by Harsh J. 
(cherry picked from commit 5ad037df25ab3206509083276b7ef4ef001be48b)
 2016-10-15 22:17:55 +09:00
Eric Yang
dc308e98b9 HADOOP-13707. Skip authorization for anonymous user to access Hadoop 
web interface in non-secure environment.  (Yuanbo Liu via eyang)
 2016-10-14 22:13:24 -07:00
Vinitha Reddy Gankidi
863e1020c0 HDFS-10301. Remove FBR tracking state to fix false zombie storage detection for interleaving block reports. Contributed by Vinitha Gankidi. 
(cherry picked from commit 391ce535a739dc92cb90017d759217265a4fd969)
 2016-10-14 18:25:52 -07:00
Lei Xu
78cb79fa91 HDFS-10960. TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove. (Manoj Govindassamy via lei) 2016-10-14 15:00:27 -07:00
Mingliang Liu
bbcbf78f0f HDFS-11008. Change unit test for testing parsing "-source" parameter in Balancer CLI. Contributed by Mingliang Liu 
(cherry picked from commit 76cc84e6d41c2b02218c2c98d60481cd565e067c)
 2016-10-14 14:43:58 -07:00
Kihwal Lee
1c0f2ef82f Revert "HDFS-10960. TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove. (Manoj Govindassamy via lei)" 
This reverts commit aa8593f923e5686d8baa11bd00d227e48a860c13.
 2016-10-14 16:38:25 -05:00
Lei Xu
aa8593f923 HDFS-10960. TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove. (Manoj Govindassamy via lei) 
(cherry picked from commit 8c520a27cbd9daba05367d3a83017a2eab5258eb)
 2016-10-14 13:43:26 -07:00
Andrew Wang
86325e4346 HDFS-10883. 's behavior is not consistent in DFS after enabling EZ. Contributed by Yuanbo Liu. 
(cherry picked from commit 0007360c3344b3485fa17de0fd2015a628de947c)
 2016-10-14 11:41:36 -07:00
Varun Saxena
e9a58691ab YARN-5599. Publish AM launch command to ATS (Rohith Sharma K S via Varun Saxena) 2016-10-14 23:32:29 +05:30
Benoy Antony
156b92e36b HDFS-10735 Distcp using webhdfs on secure HA clusters fails with StandbyException 
(cherry picked from commit 701c27a7762294e1a5fb2b3ac81f5534aa37f667)
 2016-10-14 10:29:42 -07:00
Kihwal Lee
6e0b55fe79 HDFS-10990. TestPendingInvalidateBlock should wait for IBRs. Contributed by Yiqun Lin. 
(cherry picked from commit 8a9f6635a33e9648e9396e9ec5571fa34aa0c773)
 2016-10-14 11:40:11 -05:00
Xiaoyu Yao
1eb8c0e880 HADOOP-13686. Adding additional unit test for Trash (I). Contributed by Weiwei Yang. 
(cherry picked from commit dbe663d5241feea0c88a3a9391ad48a029001d94)
 2016-10-13 23:05:58 -07:00
Xiao Chen
562c358a83 HADOOP-13669. Addendum patch for KMS Server should log exceptions before throwing. 
(cherry picked from commit ae51b11f7872eaac558acf00fd23f6d7b1841cfe)
 2016-10-13 22:32:25 -07:00
Chris Douglas
f0f2681b4f YARN-5717. Add tests for container-executor is_feature_enabled. Contributed by Sidharta Seethana 
(cherry picked from commit cf3f43e95bf46030875137fc36da5c1fbe14250d)
 2016-10-13 20:49:50 -07:00
Jing Zhao
ad69baf6a9 HADOOP-13024. Distcp with -delete feature on raw data not implemented. Contributed by Mavin Martin. 
(cherry picked from commit 0a85d079838f532a13ca237300386d1b3bc1b178)
 2016-10-13 13:26:02 -07:00
Andrew Wang
dc78e0e7fc Revert "HDFS-10990. TestPendingInvalidateBlock should wait for IBRs. Contributed by Yiqun Lin." 
This reverts commit 2e153bc8abc3fe2f50660136af32711c50e7e7e7.
 2016-10-13 13:23:04 -07:00
Kihwal Lee
c5a1303704 HDFS-10987. Make Decommission less expensive when lot of blocks present. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 332a61fd74fd2a9874319232c583ab5d2c53ff03)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DecommissionManager.java
 2016-10-13 14:55:22 -05:00
Andrew Wang
2e153bc8ab HDFS-10990. TestPendingInvalidateBlock should wait for IBRs. Contributed by Yiqun Lin. 
(cherry picked from commit fdce515091f0a61ffd6c9ae464a68447dedf1124)
 2016-10-13 11:42:03 -07:00
Arpit Agarwal
ecd3467f11 HADOOP-13710. Supress CachingGetSpaceUsed from logging interrupted exception stacktrace. Contributed by Hanisha Koneru. 2016-10-13 11:37:12 -07:00
Xiaoyu Yao
874402a295 HADOOP-13565. KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request. Contributed by Xiaoyu Yao. 
(cherry picked from commit 9097e2efe4c92d83c8fab88dc11be84505a6cab5)
 2016-10-13 10:54:51 -07:00
Brahma Reddy Battula
b60e545a08 10986. DFSAdmin should log detailed error message if any. Contributed by MingLiang Liu 
(cherry picked from commit 29aa11b1a252e007ed62fad362096ca43aa408af)
 2016-10-13 21:41:25 +05:30
Kihwal Lee
a6197c1fa8 HDFS-11000. webhdfs PUT does not work if requests are routed to call queue. Contributed by Kihwal Lee. 
(cherry picked from commit 9454dc5e8091354cd0a4b8c8aa5f4004529db5d5)
 2016-10-13 08:48:33 -05:00
Akira Ajisaka
43cf0b2973 HDFS-11002. Fix broken attr/getfattr/setfattr links in ExtendedAttributes.md. Contributed by Mingliang Liu. 
(cherry picked from commit 901eca004d0e7e413b109a93128892176c808d61)
 2016-10-13 14:30:45 +09:00
Mingliang Liu
b36aaa913c HDFS-10903. Replace config key literal strings with config key names II: hadoop hdfs. Contributed by Chen Liang 2016-10-12 17:26:11 -07:00
Andrew Wang
f131d61ff8 HADOOP-13700. Remove unthrown IOException from TrashPolicy#initialize and #getInstance signatures. 
(cherry picked from commit 12d739a34ba868b3f7f5adf7f37a60d4aca9061b)
 2016-10-12 15:20:07 -07:00
Kihwal Lee
5305a392c3 HDFS-10789. Route webhdfs through the RPC call queue. Contributed by Daryn Sharp and Rushabh S Shah. 
(cherry picked from commit 85cd06f6636f295ad1f3bf2a90063f4714c9cca7)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/web/resources/NamenodeWebHdfsMethods.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
 2016-10-12 15:22:51 -05:00
Mingliang Liu
e341e5151a HDFS-10965. Add unit test for HDFS command 'dfsadmin -printTopology'. Contributed by Xiaobing Zhou 
(cherry picked from commit f340d286d441d78c847722b529939b78abf9d2f3)
 2016-10-11 19:59:36 -07:00
Xiao Chen
b413dd34b3 HADOOP-13698. Document caveat for KeyShell when underlying KeyProvider does not delete a key. 
(cherry picked from commit b84c4891f9eca8d56593e48e9df88be42e24220d)
 2016-10-11 17:05:17 -07:00
Xiaoyu Yao
2c77aca782 HDFS-10984. Expose nntop output as metrics. Contributed by Siddharth Wagle. 
(cherry picked from commit 61f0490a73085bbaf6639d9234277e59dc1145db)
 2016-10-11 15:56:12 -07:00
Andrew Wang
a52c33fdb8 HDFS-10991. Export hdfsTruncateFile symbol in libhdfs. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit dacd3ec66b111be24131957c986f0c748cf9ea26)
 2016-10-11 15:07:22 -07:00
Wei-Chiu Chuang
56184de510 HADOOP-13684. Snappy may complain Hadoop is built without snappy if libhadoop is not found. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 4b32b1420d98ea23460d05ae94f2698109b3d6f7)
 2016-10-11 13:22:25 -07:00
Wei-Chiu Chuang
402856a8a7 HDFS-10933. Refactor TestFsck. Contributed by Takanobu Asanuma. 2016-10-11 13:18:48 -07:00
Mingliang Liu
21fcb5726a HADOOP-13697. LogLevel#main should not throw exception if no arguments. Contributed by Mingliang Liu 
(cherry picked from commit 2fb392a587d288b628936ca6d18fabad04afc585)
 2016-10-11 11:18:46 -07:00
Jason Lowe
28bd08798d YARN-5551. Ignore file backed pages from memory computation when smaps is enabled. Contributed by Rajesh Balamohan 
(cherry picked from commit ecb51b857ac7faceff981b2b6f22ea1af0d42ab1)
 2016-10-11 15:14:08 +00:00
Naganarasimha
dc5f7a9d5e YARN-5057. Resourcemanager.security.TestDelegationTokenRenewer fails in trunk. Contributed by Jason Lowe. 
(cherry picked from commit 0773ffd0f8383384f8cf8599476565f78aae70c9)
 2016-10-10 18:06:28 -04:00
Mingliang Liu
de30f13a0a HDFS-10985. o.a.h.ha.TestZKFailoverController should not use fixed time sleep before assertions. Contributed by Mingliang Liu 2016-10-10 13:37:00 -07:00
Mingliang Liu
11e748394d HDFS-10988. Refactor TestBalancerBandwidth. Contributed by Brahma Reddy Battula 
(cherry picked from commit b963818621c200160bb37624f177bdcb059de4eb)
 2016-10-10 13:23:10 -07:00
Xiao Chen
eebda43ec1 HADOOP-13669. KMS Server should log exceptions before throwing. Contributed by Suraj Acharya. 
(cherry picked from commit fc18c32540ed6a410adb123e1105729e0343b7f5)
 2016-10-10 12:51:08 -07:00
Mingliang Liu
6c137ea94e HDFS-10972. Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'. Contributed by Xiaobing Zhou 
(cherry picked from commit 3441c746b5f35c46fca5a0f252c86c8357fe932e)
 2016-10-10 11:45:43 -07:00
Kai Zheng
ad0659557b HADOOP-13641. Update UGI#spawnAutoRenewalThreadForUserCreds to reduce indentation. Contributed by Huafeng Wang 2016-10-10 11:44:04 +06:00
Xiao Chen
5c96ef365d HDFS-10797. Disk usage summary of snapshots causes renamed blocks to get counted twice. Contributed by Sean Mackrory. 
(cherry picked from commit 3ea027e970ec7c95a10e581435cdb6c3a6b64abb)
 2016-10-07 17:37:23 -07:00
Kihwal Lee
7f05306895 HDFS-10980. Optimize check for existence of parent directory. Contributed by Daryn Sharp. 
(cherry picked from commit e57fa81d9559a93d77fd724f7792326c31a490be)
 2016-10-07 17:21:28 -05:00
Robert Kanter
48ca6be76e MAPREDUCE-6776. yarn.app.mapreduce.client.job.max-retries should have a more useful default (miklos.szegedi@cloudera.com via rkanter) 
(cherry picked from commit f3f37e6fb8172f6434e06eb9a137c0c155b3952e)
 2016-10-07 14:47:23 -07:00
Xiao Chen
b9761f2fc9 HADOOP-13627. Have an explicit KerberosAuthException for UGI to throw, text from public constants. Contributed by Xiao Chen. 
(cherry picked from commit 2e853be6577a5b98fd860e6d64f89ca6d160514a)
 2016-10-07 13:46:45 -07:00
Kihwal Lee
5ea87e4aeb HDFS-10979. Pass IIP for FSDirDeleteOp methods. Contributed by Daryn Sharp. 
(cherry picked from commit 3565c9af17ab05bf9e7f68b71b6c6850df772bb9)
 2016-10-07 14:35:28 -05:00
Chris Nauroth
2de2d0df1d HADOOP-13692. hadoop-aws should declare explicit dependency on Jackson 2 jars to prevent classpath conflicts. Contributed by Chris Nauroth. 
(cherry picked from commit 69620f955997250d1b543d86d4907ee50218152a)
 2016-10-07 11:41:31 -07:00
Kihwal Lee
76c03acc6d HDFS-10939. Reduce performance penalty of encryption zones. Contributed by Daryn Sharp. 2016-10-07 13:20:05 -05:00
Brahma Reddy Battula
cddd35e1f0 HDFS-10969. Fix typos in hdfs-default.xml Contributed by Yiqun Lin 
(cherry picked from commit be3cb10f5301c2d526d0ba37dbe82f426683a801)
 2016-10-07 22:19:21 +05:30
Robert Kanter
7bfa595679 HADOOP-12611. TestZKSignerSecretProvider#testMultipleInit occasionally fail (ebadger via rkanter) 
(cherry picked from commit c183b9de8d072a35dcde96a20b1550981f886e86)
 2016-10-07 09:37:17 -07:00