2206 Commits

Author SHA1 Message Date
Zhihai Xu
6c66dd4875 HADOOP-12404. Disable caching for JarURLConnection to avoid sharing JarFile with other users when loading resource from URL in Configuration class. Contributed by Zhihai Xu
(cherry picked from commit 88d89267ff6b66e144bfcceb09532191975f2a4a)
2015-09-18 10:44:53 -07:00
Zhihai Xu
7c429fbaa9 Revert "Disable caching for JarURLConnection to avoid sharing JarFile with other users when loading resource from URL in Configuration class. Contributed by Zhihai Xu"
This reverts commit 7576b4247b9df8e5e39e61e8157d0ac48f55bf30.
2015-09-18 10:25:38 -07:00
Zhihai Xu
7576b4247b Disable caching for JarURLConnection to avoid sharing JarFile with other users when loading resource from URL in Configuration class. Contributed by Zhihai Xu
(cherry picked from commit e690a32e57bc14b0cca0e2d39da513841d81b4fc)
2015-09-18 08:27:58 -07:00
Wangda Tan
1f75e951f5 HADOOP-12386. RetryPolicies.RETRY_FOREVER should be able to specify a retry interval. (Sunil G via wangda)
(cherry picked from commit 6b97fa6652da29a203f1537508b43333633eb760)
2015-09-17 17:47:22 -07:00
Jason Lowe
316296e35f MAPREDUCE-6481. LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes. Contributed by Zhihai Xu
(cherry picked from commit 58d1a02b8d66b1d2a6ac2158be32bd35ad2e69bd)
2015-09-17 14:31:57 +00:00
Haohui Mai
d5936aa48c HADOOP-12417. TestWebDelegationToken failing with port in use. Contributed by Mingliang Liu. 2015-09-16 18:38:54 -07:00
Eric Yang
b4bb8e1731 HADOOP-12374. Updated expunge command description.
(WeiWei Yang via eyang)
2015-09-15 20:05:01 -07:00
Akira Ajisaka
e38e5b56bd HADOOP-12416. Trash messages should be handled by Logger instead of being delivered on System.out. Contributed by Mingliang Liu.
(cherry picked from commit 77aaf4cf7dd344eb094d9c079e5fb993c6696ebf)
2015-09-16 10:20:53 +09:00
Vinayakumar B
2b78714c68 HDFS-8953. DataNode Metrics logging (Contributed by Kanaka Kumar Avvaru)
(cherry picked from commit ce69c9b54c642cfbe789fc661cfc7dcbb07b4ac5)
2015-09-16 00:18:59 +05:30
cnauroth
be9354d010 HADOOP-12413. AccessControlList should avoid calling getGroupNames in isUserInList with empty groups. Contributed by Zhihai Xu.
(cherry picked from commit b2017d9b032af20044fdf60ddbd1575a554ccb79)
2015-09-15 10:42:02 -07:00
Vinayakumar B
aa963ab441 HDFS-9067. o.a.h.hdfs.server.datanode.fsdataset.impl.TestLazyWriter is failing in trunk (Contributed by Surendra Singh Lilhore)
(cherry picked from commit a4405674919d14be89bc4da22db2f417b5ae6ac3)
2015-09-15 17:33:15 +05:30
Steve Loughran
c8fe31e03a HADOOP-12407. Test failing: hadoop.ipc.TestSaslRPC. (stevel) 2015-09-12 18:55:42 +01:00
Robert Kanter
764f8baa99 HADOOP-12348. MetricsSystemImpl creates MetricsSourceAdapter with wrong time unit parameter. (zxu via rkanter) 2015-09-11 15:21:22 -07:00
Steve Loughran
4073539118 HADOOP-12324. Better exception reporting in SaslPlainServer. (Mike Yoder via stevel) 2015-09-11 15:55:14 +01:00
Vinayakumar B
ddecd86818 HDFS-8929. Add a metric to expose the timestamp of the last journal (Contributed by surendra singh lilhore)
(cherry picked from commit 94cf7ab9d28a885181afeb2c181dfe857d158254)
2015-09-09 11:06:06 +05:30
Zhihai Xu
113f778303 HADOOP-12388. Fix components' version information in the web page About the Cluster. Contributed by Jun Gong.
(cherry picked from commit d9c1fab2ec2930a011b7cca4a393881d39b8f6ec)
2015-09-08 13:09:23 -07:00
Vinayakumar B
a0594961de HADOOP-12384. Add '-direct' flag option for fs copy so that user can choose not to create '._COPYING_' file (Contributed by J.Andreina)
(cherry picked from commit 090d26652c04916a1ede4ca55e7f2ca4fc5f6249)
2015-09-08 19:11:46 +05:30
Andrew Wang
355398e441 HADOOP-12358. Add -safely flag to rm to prompt when deleting many files. Contributed by Xiaoyu Yao.
(cherry picked from commit e1feaf6db03451068c660a863926032b35a569f8)
2015-09-04 13:48:42 -07:00
Arpit Agarwal
e1842ce678 HDFS-9009. Send metrics logs to NullAppender by default. (Arpit Agarwal) 2015-09-03 11:14:53 -07:00
Tsuyoshi Ozawa
538a4ddc7e HADOOP-12213. Interrupted exception can occur when Client#stop is called. Contributed by Kuhu Shukla.
(cherry picked from commit 0ebc658105336cfe3e1a248b411de60f1d380928)
2015-09-03 23:32:59 +09:00
Jian He
cd82fa2f83 YARN-4101. RM should print alert messages if Zookeeper and Resourcemanager gets connection issue. Contributed by Xuan Gong
(cherry picked from commit 09c64ba1ba8be7a2ac31f4e42efb8c99b682399f)
2015-09-02 17:46:04 -07:00
Akira Ajisaka
25efccba01 HDFS-8388. Time and Date format need to be in sync in NameNode UI page. Contributed by Surendra Singh Lilhore.
(cherry picked from commit 65ccf2b1252a5c83755fa24a93cf1d30ee59b2c3)
2015-09-02 14:30:23 +09:00
Tsuyoshi Ozawa
b1499ab0fe HADOOP-10365. BufferedOutputStream in FileUtil#unpackEntries() should be closed in finally block. Contributed by Kiran Kumar M R and Sanghyun Yun.
(cherry picked from commit dd149adeace8727864371c5a1484c6534f8b450b)
2015-09-02 02:02:10 +09:00
Akira Ajisaka
236c4ab511 HADOOP-12359. hadoop fs -getmerge doc is wrong. Contributed by Jagadesh Kiran N.
(cherry picked from commit 2e251a767427a38ecb6c309ad979feecb29a09f4)
2015-09-01 20:56:46 +09:00
yliu
2345627ad3 HADOOP-12367. Move TestFileUtil's test resources to resources folder. (wang via yliu) 2015-09-01 16:25:11 +08:00
Andrew Wang
8dbe2a12bb HADOOP-12368. Mark ViewFileSystemBaseTest and ViewFsBaseTest as abstract.
(cherry picked from commit 7ad3556ed38560585579172aa68356f37b2288c8)
2015-08-31 18:19:12 -07:00
Lei Xu
de42fce390 HADOOP-12346. Increase some default timeouts / retries for S3a connector. (Sean Mackrory via Lei (Eddy) Xu) 2015-08-29 09:58:57 -07:00
Arpit Agarwal
f1d5f1417e HDFS-8983. NameNode support for protected directories. (Contributed by Arpit Agarwal) 2015-08-29 09:57:53 -07:00
Jing Zhao
10c4d6df61 HDFS-8896. DataNode object isn't GCed when shutdown, because it has GC root in ShutdownHookManager. Contributed by Walter Su.
(cherry picked from commit f44b599003bb79b1ec9b92e7546546523ec01676)
2015-08-26 16:28:38 -07:00
Harsh J
e993498302 HADOOP-12352. Delay in checkpointing Trash can leave trash for 2 intervals before deleting. Contributed by Casey Brotherton.
(cherry picked from commit af78767870b8296886c03f8be24cf13a4e2bd4b0)
2015-08-25 11:22:08 +05:30
Xiaoyu Yao
7a0a31586a HADOOP-12325. RPC Metrics : Add the ability track and log slow RPCs. Contributed by Anu Engineer
(cherry picked from commit 48774d0a45d95557affbd6bbaf8035cc9575ef36)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2015-08-24 14:33:37 -07:00
Xuan
205b98c059 YARN-221. NM should provide a way for AM to tell it not to aggregate
logs. Contributed by Ming Ma

(cherry picked from commit 37e1c3d82a96d781e1c9982988b7de4aa5242d0c)
2015-08-22 16:26:39 -07:00
Akira Ajisaka
5fb8ac18d1 HADOOP-12061. Incorrect command in single cluster setup document. Contributed by Kengo Seki. 2015-08-20 11:11:12 +09:00
Robert Kanter
acf241242d HADOOP-12317. Applications fail on NM restart on some linux distro because NM container recovery declares AM container as LOST (adhoot via rkanter)
(cherry picked from commit 1e06299df82b98795124fe8a33578c111e744ff4)
2015-08-19 19:01:03 -07:00
Arpit Agarwal
10a0ddbac3 HDFS-8911. NameNode Metric : Add Editlog counters as a JMX metric. (Contributed by Anu Engineer) 2015-08-19 09:42:48 -07:00
Tsz-Wo Nicholas Sze
7245f7fad2 HDFS-8826. In Balancer, add an option to specify the source node list so that balancer only selects blocks to move from those nodes. 2015-08-18 19:26:58 -07:00
Chris Douglas
79af15fd37 HDFS-8435. Support CreateFlag in WebHDFS. Contributed by Jakob Homan 2015-08-18 17:33:21 -07:00
Benoy Antony
d84e4a90d0 hadoop-12050. Enable MaxInactiveInterval for hadoop http auth token. Contributed by Huizhi Lu.
(cherry picked from commit 71aedfabf39e03104c8d22456e95ef6349aae6c0)
2015-08-18 13:53:47 -07:00
Allen Wittenauer
40d8faf868 HADOOP-9891. CLIMiniCluster instructions fail with MiniYarnCluster ClassNotFoundException (Darrell Taylor via aw)
(cherry picked from commit 4d8fb8c19c04088cf8f8e9deecb571273adeaab5)
2015-08-18 12:32:09 -07:00
Arpit Agarwal
85cb596e2e HDFS-8880. NameNode metrics logging. (Arpit Agarwal) 2015-08-17 16:55:24 -07:00
Xiaoyu Yao
27ccbd51f6 HDFS-8883. NameNode Metrics : Add FSNameSystem lock Queue Length. Contributed by Anu Engineer.
(cherry picked from commit a7862d5fe4c505f5d4b0c675438a971733f1f53a)
2015-08-17 10:23:56 -07:00
Arpit Agarwal
25c4dab891 HADOOP-12322. Typos in rpcmetrics.java. (Contributed by Anu Engineer) 2015-08-13 21:17:39 -07:00
yliu
073cb16d81 HADOOP-12295. Improve NetworkTopology#InnerNode#remove logic. (yliu) 2015-08-13 16:42:40 +08:00
cnauroth
bf8b09d4b8 HADOOP-12258. Need translate java.nio.file.NoSuchFileException to FileNotFoundException to avoid regression. Contributed by Zhihai Xu.
(cherry picked from commit 6cc8e38db5b26bdd02bc6bc1c9684db2593eec25)
2015-08-12 16:45:05 -07:00
Aaron T. Myers
43f386e748 HADOOP-12318. Expose underlying LDAP exceptions in SaslPlainServer. Contributed by Mike Yoder.
(cherry picked from commit 28ea4c068ea0152af682058b02311bba81780770)
2015-08-12 15:16:36 -07:00
Andrew Wang
d53296281a HDFS-8887. Expose storage type and storage ID in BlockLocation.
(cherry picked from commit 1ea1a8334ea01814121490a5bfd2a0205c66d6e4)
2015-08-11 23:33:06 -07:00
Xuan
2ebdf5bfce YARN-3999. RM hangs on draing events. Contributed by Jian He
(cherry picked from commit 3ae716fa696b87e849dae40225dc59fb5ed114cb)
2015-08-11 18:26:00 -07:00
Jian He
5950c1f6f8 HADOOP-11932. MetricsSinkAdapter may hang when being stopped. Contributed by Brahma Reddy Battula
(cherry picked from commit f59612edd74d1bef2b60870c24c1f67c56b2b3cb)
2015-08-05 16:14:09 -07:00
cnauroth
b83d475252 HADOOP-12304. Applications using FileContext fail with the default file system configured to be wasb/s3/etc. Contributed by Chris Nauroth.
(cherry picked from commit 3da0bedaec38714a62c3b7244e84bc4f981ddf45)
2015-08-05 14:56:54 -07:00
Colin Patrick Mccabe
e2d46ac5a4 HADOOP-12302. Fix native compilation on Windows after HADOOP-7824 (Vinayakumar B via Colin P. McCabe)
(cherry picked from commit 4ab49a436522f87cd462a9eae20fe10fe5c28fb2)
2015-08-05 10:01:32 -07:00