2550 Commits

Author SHA1 Message Date
Andrew Wang
7a668981f5 HADOOP-12362. Set hadoop.tmp.dir and hadoop.log.dir in pom. Contributed by Charlie Helin.
(cherry picked from commit 90fe7bcc3b30f8497d7a5124c91c5aea28f2fccb)
2015-08-27 10:17:04 -07:00
Jing Zhao
10c4d6df61 HDFS-8896. DataNode object isn't GCed when shutdown, because it has GC root in ShutdownHookManager. Contributed by Walter Su.
(cherry picked from commit f44b599003bb79b1ec9b92e7546546523ec01676)
2015-08-26 16:28:38 -07:00
Harsh J
e993498302 HADOOP-12352. Delay in checkpointing Trash can leave trash for 2 intervals before deleting. Contributed by Casey Brotherton.
(cherry picked from commit af78767870b8296886c03f8be24cf13a4e2bd4b0)
2015-08-25 11:22:08 +05:30
Xiaoyu Yao
7a0a31586a HADOOP-12325. RPC Metrics : Add the ability track and log slow RPCs. Contributed by Anu Engineer
(cherry picked from commit 48774d0a45d95557affbd6bbaf8035cc9575ef36)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2015-08-24 14:33:37 -07:00
Xuan
205b98c059 YARN-221. NM should provide a way for AM to tell it not to aggregate
logs. Contributed by Ming Ma

(cherry picked from commit 37e1c3d82a96d781e1c9982988b7de4aa5242d0c)
2015-08-22 16:26:39 -07:00
Xiaoyu Yao
a7e5a88b59 HADOOP-12347. Fix mismatch parameter name in javadocs of AuthToken#setMaxInactives. Contributed by Xiaoyu Yao
(cherry picked from commit caa636bf10d96ca2d4e151225fb46134ce99f9cf)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2015-08-21 16:41:34 -07:00
Vinod Kumar Vavilapalli
45be1240d9 Creating 2.6.2 entries in CHANGES.txt files.
(cherry picked from commit 33474939a048ac7bbe07df772f0000c84979722f)
2015-08-20 17:23:54 -07:00
Akira Ajisaka
5fb8ac18d1 HADOOP-12061. Incorrect command in single cluster setup document. Contributed by Kengo Seki. 2015-08-20 11:11:12 +09:00
Robert Kanter
acf241242d HADOOP-12317. Applications fail on NM restart on some linux distro because NM container recovery declares AM container as LOST (adhoot via rkanter)
(cherry picked from commit 1e06299df82b98795124fe8a33578c111e744ff4)
2015-08-19 19:01:03 -07:00
Arpit Agarwal
10a0ddbac3 HDFS-8911. NameNode Metric : Add Editlog counters as a JMX metric. (Contributed by Anu Engineer) 2015-08-19 09:42:48 -07:00
Tsz-Wo Nicholas Sze
7245f7fad2 HDFS-8826. In Balancer, add an option to specify the source node list so that balancer only selects blocks to move from those nodes. 2015-08-18 19:26:58 -07:00
Chris Douglas
79af15fd37 HDFS-8435. Support CreateFlag in WebHDFS. Contributed by Jakob Homan 2015-08-18 17:33:21 -07:00
Benoy Antony
d84e4a90d0 hadoop-12050. Enable MaxInactiveInterval for hadoop http auth token. Contributed by Huizhi Lu.
(cherry picked from commit 71aedfabf39e03104c8d22456e95ef6349aae6c0)
2015-08-18 13:53:47 -07:00
Allen Wittenauer
40d8faf868 HADOOP-9891. CLIMiniCluster instructions fail with MiniYarnCluster ClassNotFoundException (Darrell Taylor via aw)
(cherry picked from commit 4d8fb8c19c04088cf8f8e9deecb571273adeaab5)
2015-08-18 12:32:09 -07:00
Arpit Agarwal
85cb596e2e HDFS-8880. NameNode metrics logging. (Arpit Agarwal) 2015-08-17 16:55:24 -07:00
Xiaoyu Yao
27ccbd51f6 HDFS-8883. NameNode Metrics : Add FSNameSystem lock Queue Length. Contributed by Anu Engineer.
(cherry picked from commit a7862d5fe4c505f5d4b0c675438a971733f1f53a)
2015-08-17 10:23:56 -07:00
Vinayakumar B
eef0526127 HADOOP-7139. Allow appending to existing SequenceFiles (Contributed by kanaka kumar avvaru)
Moved to 2.6.1

(cherry picked from commit fc508b41a90a193f06a0e28ee40862bf9ee0f0c7)
2015-08-14 15:55:45 +05:30
Vinayakumar B
796b94df1e HADOOP-11333. Fix deadlock in DomainSocketWatcher when the notification pipe is full (zhaoyunjiong via cmccabe)
Moved to 2.6.1

(cherry picked from commit 05ed69058f22ebeccc58faf0be491c269e950526)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2015-08-14 12:55:25 +05:30
Vinayakumar B
a6ec5c3dec HADOOP-10786. Fix UGI#reloginFromKeytab on Java 8. Contributed by Stephen Chu.
Moved CHANGES.txt entry to 2.6.1

(cherry picked from commit e7aa81394dce61cc96d480e21204263a5f2ed153)
2015-08-14 12:24:29 +05:30
Vinayakumar B
e0b1744de9 HADOOP-10786. Fix UGI#reloginFromKeytab on Java 8. Contributed by Stephen Chu.
Moved CHANGES.txt entry to 2.6.1

(cherry picked from commit d6050f06a3b7e049541b1cb4597c388abf00a5be)
2015-08-14 12:10:22 +05:30
Arpit Agarwal
25c4dab891 HADOOP-12322. Typos in rpcmetrics.java. (Contributed by Anu Engineer) 2015-08-13 21:17:39 -07:00
yliu
073cb16d81 HADOOP-12295. Improve NetworkTopology#InnerNode#remove logic. (yliu) 2015-08-13 16:42:40 +08:00
cnauroth
bf8b09d4b8 HADOOP-12258. Need translate java.nio.file.NoSuchFileException to FileNotFoundException to avoid regression. Contributed by Zhihai Xu.
(cherry picked from commit 6cc8e38db5b26bdd02bc6bc1c9684db2593eec25)
2015-08-12 16:45:05 -07:00
Aaron T. Myers
43f386e748 HADOOP-12318. Expose underlying LDAP exceptions in SaslPlainServer. Contributed by Mike Yoder.
(cherry picked from commit 28ea4c068ea0152af682058b02311bba81780770)
2015-08-12 15:16:36 -07:00
Andrew Wang
d53296281a HDFS-8887. Expose storage type and storage ID in BlockLocation.
(cherry picked from commit 1ea1a8334ea01814121490a5bfd2a0205c66d6e4)
2015-08-11 23:33:06 -07:00
Xuan
2ebdf5bfce YARN-3999. RM hangs on draing events. Contributed by Jian He
(cherry picked from commit 3ae716fa696b87e849dae40225dc59fb5ed114cb)
2015-08-11 18:26:00 -07:00
Jian He
5950c1f6f8 HADOOP-11932. MetricsSinkAdapter may hang when being stopped. Contributed by Brahma Reddy Battula
(cherry picked from commit f59612edd74d1bef2b60870c24c1f67c56b2b3cb)
2015-08-05 16:14:09 -07:00
cnauroth
b83d475252 HADOOP-12304. Applications using FileContext fail with the default file system configured to be wasb/s3/etc. Contributed by Chris Nauroth.
(cherry picked from commit 3da0bedaec38714a62c3b7244e84bc4f981ddf45)
2015-08-05 14:56:54 -07:00
Colin Patrick Mccabe
e2d46ac5a4 HADOOP-12302. Fix native compilation on Windows after HADOOP-7824 (Vinayakumar B via Colin P. McCabe)
(cherry picked from commit 4ab49a436522f87cd462a9eae20fe10fe5c28fb2)
2015-08-05 10:01:32 -07:00
Colin Patrick Mccabe
e92107b18f HADOOP-12280. Skip unit tests based on maven profile rather than NativeCodeLoader.isNativeCodeLoaded (Masatake Iwasaki via Colin P. McCabe)
(cherry picked from commit 6f83274afc1eba1159427684d72d8f13778c5a88)
2015-08-05 09:43:03 -07:00
Akira Ajisaka
e55eb6f20c HADOOP-12274. Remove direct download link from BULIDING.txt. Contributed by Caleb Severn.
(cherry picked from commit 52f3525586154723a606cc31d33fdc1bece1dd5f)
2015-08-05 17:47:43 +09:00
Lei Xu
f7b0f292e7 HADOOP-12269. Update aws-sdk dependency to 1.10.6 (Thomas Demoor via Lei (Eddy) Xu)
(cherry picked from commit d5403747b57b1e294e533ce17f197e7be8f5339c)
2015-08-04 18:56:07 -07:00
Zhihai Xu
b9ec7f15d0 HADOOP-12268. AbstractContractAppendTest#testRenameFileBeingAppended misses rename operation. Contributed by Zhihai Xu
(cherry picked from commit a628a6f126473a99f9370ba642994ce2909a2d9e)
2015-07-31 21:47:34 -07:00
Colin Patrick Mccabe
7d68f17731 HADOOP-12183. Annotate the HTrace span created by FsShell with the command-line arguments passed by the user (Masatake Iwasaki via Colin P. McCabe)
(cherry picked from commit 454da959c726528ac98dbca1b935a83ed4b9e235)
2015-07-31 15:14:35 -07:00
Colin Patrick Mccabe
07a042aa3c HADOOP-7824. NativeIO.java flags and identifiers must be set correctly for each platform, not hardcoded to their Linux values (Martin Walsh via Colin P. McCabe)
(cherry picked from commit 21d10ccc6e463cf250414264c78acb4a6e7c83e3)
2015-07-31 15:02:01 -07:00
Harsh J
68034bd6c2 HADOOP-12271. Hadoop Jar Error Should Be More Explanatory. Contributed by Josh Elser.
(cherry picked from commit 2087eaf684d9fb14b5390e21bf17e93ac8fea7f8)
2015-07-31 10:13:07 +05:30
Jason Lowe
e6b4714d0b HADOOP-10945. 4-digit octal umask permissions throws a parse error. Contributed by Chang Li
(cherry picked from commit 6f0a35724f0da80146dbae4b6f6c341e1d3101f5)
2015-07-29 15:25:59 +00:00
Akira Ajisaka
dff49aee08 Revert "HDFS-6682. Add a metric to expose the timestamp of the oldest under-replicated block. (aajisaka)"
This reverts commit 17319c4a659dd150ccfe80da81fbaee69ca8ef1e.
2015-07-29 16:52:54 +09:00
Jakob Homan
71a5aa267d HDFS-8180. AbstractFileSystem Implementation for WebHdfs. Contributed by Sathosh G Nayak.
(cherry picked from commit 0712a8103fec6e9a9ceba335e3c3800b85b2c7ca)
2015-07-28 21:11:02 -07:00
Colin Patrick Mccabe
5875935669 HADOOP-12175. FsShell must load SpanReceierHost to support tracing (Masatake Iwasaki via Colin P. McCabe)
(cherry picked from commit 69b095730bd87706ddcbabeea6c513290ee4cdf5)
2015-07-28 12:56:36 -07:00
Arun Suresh
ffe6a34d5b HDFS-7858. Improve HA Namenode Failover detection on the client. (asuresh)
(cherry picked from commit 030fcfa99c345ad57625486eeabedebf2fd4411f)
2015-07-27 23:03:34 -07:00
Akira Ajisaka
c650ab0037 HADOOP-12245. References to misspelled REMAINING_QUATA in FileSystemShell.md. Contributed by Gabor Liptak.
(cherry picked from commit e21dde501aa9323b7f34b4bc4ba9d282ec4f2707)
2015-07-28 11:34:16 +09:00
Allen Wittenauer
cf348f2eb8 HADOOP-11807. add a lint mode to releasedocmaker (ramtin via aw)
(cherry picked from commit 8e657fba2fd33f7550597ea9c4c6e9a87aa1ef1c)
(cherry picked from commit 098ba450cc98475b84d60bb5ac3bd7b558b2a67c)
2015-07-24 18:32:05 -07:00
Colin Patrick Mccabe
2419711369 HADOOP-12170. hadoop-common's JNIFlags.cmake is redundant and can be removed (Alan Burlison via Colin P. McCabe)
(cherry picked from commit e4b0c74434b82c25256a59b03d62b1a66bb8ac69)
2015-07-24 13:23:51 -07:00
Allen Wittenauer
fed9f767b1 HADOOP-11813. releasedocmaker.py should use today's date instead of unreleased (Darrell Taylor via aw)
(cherry picked from commit f325522c1423f89dced999a16d49a004b2879743)
2015-07-24 11:55:57 -07:00
Allen Wittenauer
2a0688fdb8 HADOOP-11797. releasedocmaker.py needs to put ASF headers on output (aw)
(cherry picked from commit 8d3c0f601d549a22648050bcc9a0e4acf37edc81)
2015-07-24 11:55:56 -07:00
Robert Kanter
731ed9cad8 HADOOP-12259. Utility to Dynamic port allocation (brahmareddy via rkanter)
(cherry picked from commit ee233ec95ce8cfc8309d3adc072d926cd85eba08)
2015-07-24 09:42:04 -07:00
Akira Ajisaka
17319c4a65 HDFS-6682. Add a metric to expose the timestamp of the oldest under-replicated block. (aajisaka)
(cherry picked from commit 02c01815eca656814febcdaca6115e5f53b9c746)
2015-07-24 11:39:16 +09:00
Andrew Wang
cf258b6d98 HADOOP-12189. Improve CallQueueManager#swapQueue to make queue elements drop nearly impossible. Contributed by Zhihai Xu.
(cherry picked from commit 6736a1ab7033523ed5f304fdfed46d7f348665b4)
2015-07-23 14:42:44 -07:00
Allen Wittenauer
a37285620d HADOOP-11731. Rework the changelog and releasenotes (aw)
(cherry picked from commit f383fd9b6caf4557613250c5c218b1a1b65a212b)

 Conflicts:
	hadoop-project/src/site/site.xml
2015-07-23 14:08:10 -07:00