Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,235 Commits 326 Branches 371 Tags
Commit Graph

12235 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Andrew Wang
86325e4346 HDFS-10883. 's behavior is not consistent in DFS after enabling EZ. Contributed by Yuanbo Liu. 
(cherry picked from commit 0007360c3344b3485fa17de0fd2015a628de947c)
 2016-10-14 11:41:36 -07:00
Varun Saxena
e9a58691ab YARN-5599. Publish AM launch command to ATS (Rohith Sharma K S via Varun Saxena) 2016-10-14 23:32:29 +05:30
Benoy Antony
156b92e36b HDFS-10735 Distcp using webhdfs on secure HA clusters fails with StandbyException 
(cherry picked from commit 701c27a7762294e1a5fb2b3ac81f5534aa37f667)
 2016-10-14 10:29:42 -07:00
Kihwal Lee
6e0b55fe79 HDFS-10990. TestPendingInvalidateBlock should wait for IBRs. Contributed by Yiqun Lin. 
(cherry picked from commit 8a9f6635a33e9648e9396e9ec5571fa34aa0c773)
 2016-10-14 11:40:11 -05:00
Xiaoyu Yao
1eb8c0e880 HADOOP-13686. Adding additional unit test for Trash (I). Contributed by Weiwei Yang. 
(cherry picked from commit dbe663d5241feea0c88a3a9391ad48a029001d94)
 2016-10-13 23:05:58 -07:00
Xiao Chen
562c358a83 HADOOP-13669. Addendum patch for KMS Server should log exceptions before throwing. 
(cherry picked from commit ae51b11f7872eaac558acf00fd23f6d7b1841cfe)
 2016-10-13 22:32:25 -07:00
Chris Douglas
f0f2681b4f YARN-5717. Add tests for container-executor is_feature_enabled. Contributed by Sidharta Seethana 
(cherry picked from commit cf3f43e95bf46030875137fc36da5c1fbe14250d)
 2016-10-13 20:49:50 -07:00
Jing Zhao
ad69baf6a9 HADOOP-13024. Distcp with -delete feature on raw data not implemented. Contributed by Mavin Martin. 
(cherry picked from commit 0a85d079838f532a13ca237300386d1b3bc1b178)
 2016-10-13 13:26:02 -07:00
Andrew Wang
dc78e0e7fc Revert "HDFS-10990. TestPendingInvalidateBlock should wait for IBRs. Contributed by Yiqun Lin." 
This reverts commit 2e153bc8abc3fe2f50660136af32711c50e7e7e7.
 2016-10-13 13:23:04 -07:00
Kihwal Lee
c5a1303704 HDFS-10987. Make Decommission less expensive when lot of blocks present. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 332a61fd74fd2a9874319232c583ab5d2c53ff03)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DecommissionManager.java
 2016-10-13 14:55:22 -05:00
Andrew Wang
2e153bc8ab HDFS-10990. TestPendingInvalidateBlock should wait for IBRs. Contributed by Yiqun Lin. 
(cherry picked from commit fdce515091f0a61ffd6c9ae464a68447dedf1124)
 2016-10-13 11:42:03 -07:00
Arpit Agarwal
ecd3467f11 HADOOP-13710. Supress CachingGetSpaceUsed from logging interrupted exception stacktrace. Contributed by Hanisha Koneru. 2016-10-13 11:37:12 -07:00
Xiaoyu Yao
874402a295 HADOOP-13565. KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request. Contributed by Xiaoyu Yao. 
(cherry picked from commit 9097e2efe4c92d83c8fab88dc11be84505a6cab5)
 2016-10-13 10:54:51 -07:00
Brahma Reddy Battula
b60e545a08 10986. DFSAdmin should log detailed error message if any. Contributed by MingLiang Liu 
(cherry picked from commit 29aa11b1a252e007ed62fad362096ca43aa408af)
 2016-10-13 21:41:25 +05:30
Kihwal Lee
a6197c1fa8 HDFS-11000. webhdfs PUT does not work if requests are routed to call queue. Contributed by Kihwal Lee. 
(cherry picked from commit 9454dc5e8091354cd0a4b8c8aa5f4004529db5d5)
 2016-10-13 08:48:33 -05:00
Akira Ajisaka
43cf0b2973 HDFS-11002. Fix broken attr/getfattr/setfattr links in ExtendedAttributes.md. Contributed by Mingliang Liu. 
(cherry picked from commit 901eca004d0e7e413b109a93128892176c808d61)
 2016-10-13 14:30:45 +09:00
Mingliang Liu
b36aaa913c HDFS-10903. Replace config key literal strings with config key names II: hadoop hdfs. Contributed by Chen Liang 2016-10-12 17:26:11 -07:00
Andrew Wang
f131d61ff8 HADOOP-13700. Remove unthrown IOException from TrashPolicy#initialize and #getInstance signatures. 
(cherry picked from commit 12d739a34ba868b3f7f5adf7f37a60d4aca9061b)
 2016-10-12 15:20:07 -07:00
Kihwal Lee
5305a392c3 HDFS-10789. Route webhdfs through the RPC call queue. Contributed by Daryn Sharp and Rushabh S Shah. 
(cherry picked from commit 85cd06f6636f295ad1f3bf2a90063f4714c9cca7)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/web/resources/NamenodeWebHdfsMethods.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
 2016-10-12 15:22:51 -05:00
Mingliang Liu
e341e5151a HDFS-10965. Add unit test for HDFS command 'dfsadmin -printTopology'. Contributed by Xiaobing Zhou 
(cherry picked from commit f340d286d441d78c847722b529939b78abf9d2f3)
 2016-10-11 19:59:36 -07:00
Xiao Chen
b413dd34b3 HADOOP-13698. Document caveat for KeyShell when underlying KeyProvider does not delete a key. 
(cherry picked from commit b84c4891f9eca8d56593e48e9df88be42e24220d)
 2016-10-11 17:05:17 -07:00
Xiaoyu Yao
2c77aca782 HDFS-10984. Expose nntop output as metrics. Contributed by Siddharth Wagle. 
(cherry picked from commit 61f0490a73085bbaf6639d9234277e59dc1145db)
 2016-10-11 15:56:12 -07:00
Andrew Wang
a52c33fdb8 HDFS-10991. Export hdfsTruncateFile symbol in libhdfs. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit dacd3ec66b111be24131957c986f0c748cf9ea26)
 2016-10-11 15:07:22 -07:00
Wei-Chiu Chuang
56184de510 HADOOP-13684. Snappy may complain Hadoop is built without snappy if libhadoop is not found. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 4b32b1420d98ea23460d05ae94f2698109b3d6f7)
 2016-10-11 13:22:25 -07:00
Wei-Chiu Chuang
402856a8a7 HDFS-10933. Refactor TestFsck. Contributed by Takanobu Asanuma. 2016-10-11 13:18:48 -07:00
Mingliang Liu
21fcb5726a HADOOP-13697. LogLevel#main should not throw exception if no arguments. Contributed by Mingliang Liu 
(cherry picked from commit 2fb392a587d288b628936ca6d18fabad04afc585)
 2016-10-11 11:18:46 -07:00
Jason Lowe
28bd08798d YARN-5551. Ignore file backed pages from memory computation when smaps is enabled. Contributed by Rajesh Balamohan 
(cherry picked from commit ecb51b857ac7faceff981b2b6f22ea1af0d42ab1)
 2016-10-11 15:14:08 +00:00
Naganarasimha
dc5f7a9d5e YARN-5057. Resourcemanager.security.TestDelegationTokenRenewer fails in trunk. Contributed by Jason Lowe. 
(cherry picked from commit 0773ffd0f8383384f8cf8599476565f78aae70c9)
 2016-10-10 18:06:28 -04:00
Mingliang Liu
de30f13a0a HDFS-10985. o.a.h.ha.TestZKFailoverController should not use fixed time sleep before assertions. Contributed by Mingliang Liu 2016-10-10 13:37:00 -07:00
Mingliang Liu
11e748394d HDFS-10988. Refactor TestBalancerBandwidth. Contributed by Brahma Reddy Battula 
(cherry picked from commit b963818621c200160bb37624f177bdcb059de4eb)
 2016-10-10 13:23:10 -07:00
Xiao Chen
eebda43ec1 HADOOP-13669. KMS Server should log exceptions before throwing. Contributed by Suraj Acharya. 
(cherry picked from commit fc18c32540ed6a410adb123e1105729e0343b7f5)
 2016-10-10 12:51:08 -07:00
Mingliang Liu
6c137ea94e HDFS-10972. Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'. Contributed by Xiaobing Zhou 
(cherry picked from commit 3441c746b5f35c46fca5a0f252c86c8357fe932e)
 2016-10-10 11:45:43 -07:00
Kai Zheng
ad0659557b HADOOP-13641. Update UGI#spawnAutoRenewalThreadForUserCreds to reduce indentation. Contributed by Huafeng Wang 2016-10-10 11:44:04 +06:00
Xiao Chen
5c96ef365d HDFS-10797. Disk usage summary of snapshots causes renamed blocks to get counted twice. Contributed by Sean Mackrory. 
(cherry picked from commit 3ea027e970ec7c95a10e581435cdb6c3a6b64abb)
 2016-10-07 17:37:23 -07:00
Kihwal Lee
7f05306895 HDFS-10980. Optimize check for existence of parent directory. Contributed by Daryn Sharp. 
(cherry picked from commit e57fa81d9559a93d77fd724f7792326c31a490be)
 2016-10-07 17:21:28 -05:00
Robert Kanter
48ca6be76e MAPREDUCE-6776. yarn.app.mapreduce.client.job.max-retries should have a more useful default (miklos.szegedi@cloudera.com via rkanter) 
(cherry picked from commit f3f37e6fb8172f6434e06eb9a137c0c155b3952e)
 2016-10-07 14:47:23 -07:00
Xiao Chen
b9761f2fc9 HADOOP-13627. Have an explicit KerberosAuthException for UGI to throw, text from public constants. Contributed by Xiao Chen. 
(cherry picked from commit 2e853be6577a5b98fd860e6d64f89ca6d160514a)
 2016-10-07 13:46:45 -07:00
Kihwal Lee
5ea87e4aeb HDFS-10979. Pass IIP for FSDirDeleteOp methods. Contributed by Daryn Sharp. 
(cherry picked from commit 3565c9af17ab05bf9e7f68b71b6c6850df772bb9)
 2016-10-07 14:35:28 -05:00
Chris Nauroth
2de2d0df1d HADOOP-13692. hadoop-aws should declare explicit dependency on Jackson 2 jars to prevent classpath conflicts. Contributed by Chris Nauroth. 
(cherry picked from commit 69620f955997250d1b543d86d4907ee50218152a)
 2016-10-07 11:41:31 -07:00
Kihwal Lee
76c03acc6d HDFS-10939. Reduce performance penalty of encryption zones. Contributed by Daryn Sharp. 2016-10-07 13:20:05 -05:00
Brahma Reddy Battula
cddd35e1f0 HDFS-10969. Fix typos in hdfs-default.xml Contributed by Yiqun Lin 
(cherry picked from commit be3cb10f5301c2d526d0ba37dbe82f426683a801)
 2016-10-07 22:19:21 +05:30
Robert Kanter
7bfa595679 HADOOP-12611. TestZKSignerSecretProvider#testMultipleInit occasionally fail (ebadger via rkanter) 
(cherry picked from commit c183b9de8d072a35dcde96a20b1550981f886e86)
 2016-10-07 09:37:17 -07:00
Junping Du
8bee319130 YARN-5659. getPathFromYarnURL should use standard methods. Contributed by Sergey Shelukhin. 
(cherry picked from commit 459a4833a90437a52787a41c2759a4b18cfe411c)
 2016-10-07 07:47:16 -07:00
Steve Loughran
a6bb21eec4 HADOOP-12977 s3a to handle delete("/", true) robustly. Contributed by Steve Loughran. 2016-10-07 12:47:14 +01:00
Andrew Wang
9315242109 HADOOP-13689. Do not attach javadoc and sources jars during non-dist build. 
(cherry picked from commit bf372173d0f7cb97b62556cbd199a075254b96e6)
 2016-10-06 15:08:27 -07:00
Kihwal Lee
e3a9666d28 HDFS-10955. Pass IIP for FSDirAttr methods. Contributed by Daryn Sharp. 2016-10-06 16:32:12 -05:00
Chris Nauroth
a28ffd0fde HADOOP-13150. Avoid use of toString() in output of HDFS ACL shell commands. Contributed by Chris Nauroth. 
(cherry picked from commit 1d330fbaf6b50802750aa461640773fb788ef884)
 2016-10-06 13:22:35 -07:00
Chris Nauroth
ecccb114ae HADOOP-13323. Downgrade stack trace on FS load from Warn to debug. Contributed by Steve Loughran. 
(cherry picked from commit 2d46c3f6b7d55b6a2f124d07fe26d37359615df4)
 2016-10-06 10:57:08 -07:00
Mingliang Liu
7aee005c03 HDFS-10893. Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test. Contributed by Mingliang Liu 2016-10-06 08:59:49 -07:00
Rohith Sharma K S
94a6f65989 YARN-5101. YARN_APPLICATION_UPDATED event is parsed in ApplicationHistoryManagerOnTimelineStore#convertToApplicationReport with reversed order. Contributed by Sunil G. 
(cherry picked from commit 4d2f380d787a6145f45c87ba663079fedbf645b8)
 2016-10-06 20:43:47 +05:30